2023-10-06T02:44:30.163 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-10-06T02:44:30.163 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/openfiletable} --archive /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412172 --verbose --name yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi --owner scheduled_yuriw@teuthology -- /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412172/orig.config.yaml 2023-10-06T02:44:30.208 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T02:44:30.298 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412172 branch: wip-yuri-testing-2023-10-05-0730-quincy description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/openfiletable} email: yweinste@redhat.com first_in_suite: false job_id: '7412172' kernel: client: branch: testing kdb: true sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '20.04' overrides: admin_socket: branch: wip-yuri-testing-2023-10-05-0730-quincy ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 kclient: syntax: v1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri-testing-2023-10-05-0730-quincy sha1: f1e315a9732d36c05ec316678e2397dc58561c7f owner: scheduled_yuriw@teuthology priority: 75 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 7519 sha1: 736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 sleep_before_teardown: 0 subset: 111/12000 suite: fs suite_branch: wip-yuri-testing-2023-10-05-0730-quincy suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_f1e315a9732d36c05ec316678e2397dc58561c7f/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: f1e315a9732d36c05ec316678e2397dc58561c7f targets: smithi057.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= smithi105.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_openfiletable teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 54e62bcbac4e53d9685e08328b790d3b20d71cae timestamp: 2023-10-05_23:52:50 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-10-06T02:44:30.298 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_f1e315a9732d36c05ec316678e2397dc58561c7f/qa; will attempt to use it 2023-10-06T02:44:30.299 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_f1e315a9732d36c05ec316678e2397dc58561c7f/qa/tasks 2023-10-06T02:44:30.299 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-10-06T02:44:30.301 INFO:teuthology.task.internal:Checking packages... 2023-10-06T02:44:30.324 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2' 2023-10-06T02:44:30.324 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-06T02:44:30.324 INFO:teuthology.packaging:ref: None 2023-10-06T02:44:30.324 INFO:teuthology.packaging:tag: None 2023-10-06T02:44:30.324 INFO:teuthology.packaging:branch: wip-yuri-testing-2023-10-05-0730-quincy 2023-10-06T02:44:30.324 INFO:teuthology.packaging:sha1: 736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 2023-10-06T02:44:30.324 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=wip-yuri-testing-2023-10-05-0730-quincy 2023-10-06T02:44:30.547 INFO:teuthology.task.internal:Found packages for ceph version 17.2.6-1296-gf1e315a9-1focal 2023-10-06T02:44:30.547 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-10-06T02:44:30.552 INFO:teuthology.task.internal:no buildpackages task found 2023-10-06T02:44:30.552 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-10-06T02:44:30.608 INFO:teuthology.task.internal:Saving configuration 2023-10-06T02:44:30.625 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-10-06T02:44:30.723 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-06T02:44:30.748 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi057.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412172', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 02:38:25.243163', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2023-10-06T02:44:30.770 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi105.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412172', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 02:38:25.241676', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2023-10-06T02:44:30.770 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-10-06T02:44:30.776 INFO:teuthology.task.internal:roles: ubuntu@smithi057.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-10-06T02:44:30.776 INFO:teuthology.task.internal:roles: ubuntu@smithi105.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-10-06T02:44:30.776 INFO:teuthology.run_tasks:Running task console_log... 2023-10-06T02:44:30.870 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f97a6b70040>, signals=[15]) 2023-10-06T02:44:30.870 INFO:teuthology.run_tasks:Running task internal.connect... 2023-10-06T02:44:30.875 INFO:teuthology.task.internal:Opening connections... 2023-10-06T02:44:30.876 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi057.front.sepia.ceph.com 2023-10-06T02:44:30.878 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T02:44:30.928 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi105.front.sepia.ceph.com 2023-10-06T02:44:30.928 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T02:44:30.974 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-10-06T02:44:30.980 DEBUG:teuthology.orchestra.run.smithi057:> uname -m 2023-10-06T02:44:31.009 INFO:teuthology.orchestra.run.smithi057.stdout:x86_64 2023-10-06T02:44:31.009 DEBUG:teuthology.orchestra.run.smithi057:> cat /etc/os-release 2023-10-06T02:44:31.060 INFO:teuthology.orchestra.run.smithi057.stdout:NAME="Ubuntu" 2023-10-06T02:44:31.060 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-06T02:44:31.060 INFO:teuthology.orchestra.run.smithi057.stdout:ID=ubuntu 2023-10-06T02:44:31.060 INFO:teuthology.orchestra.run.smithi057.stdout:ID_LIKE=debian 2023-10-06T02:44:31.060 INFO:teuthology.orchestra.run.smithi057.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-06T02:44:31.060 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION_ID="20.04" 2023-10-06T02:44:31.060 INFO:teuthology.orchestra.run.smithi057.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-06T02:44:31.061 INFO:teuthology.orchestra.run.smithi057.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-06T02:44:31.061 INFO:teuthology.orchestra.run.smithi057.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-06T02:44:31.061 INFO:teuthology.orchestra.run.smithi057.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-06T02:44:31.061 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION_CODENAME=focal 2023-10-06T02:44:31.061 INFO:teuthology.orchestra.run.smithi057.stdout:UBUNTU_CODENAME=focal 2023-10-06T02:44:31.061 INFO:teuthology.lock.ops:Updating smithi057.front.sepia.ceph.com on lock server 2023-10-06T02:44:31.089 DEBUG:teuthology.orchestra.run.smithi105:> uname -m 2023-10-06T02:44:31.096 INFO:teuthology.orchestra.run.smithi105.stdout:x86_64 2023-10-06T02:44:31.096 DEBUG:teuthology.orchestra.run.smithi105:> cat /etc/os-release 2023-10-06T02:44:31.145 INFO:teuthology.orchestra.run.smithi105.stdout:NAME="Ubuntu" 2023-10-06T02:44:31.145 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-06T02:44:31.145 INFO:teuthology.orchestra.run.smithi105.stdout:ID=ubuntu 2023-10-06T02:44:31.145 INFO:teuthology.orchestra.run.smithi105.stdout:ID_LIKE=debian 2023-10-06T02:44:31.146 INFO:teuthology.orchestra.run.smithi105.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-06T02:44:31.146 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION_ID="20.04" 2023-10-06T02:44:31.146 INFO:teuthology.orchestra.run.smithi105.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-06T02:44:31.146 INFO:teuthology.orchestra.run.smithi105.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-06T02:44:31.146 INFO:teuthology.orchestra.run.smithi105.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-06T02:44:31.146 INFO:teuthology.orchestra.run.smithi105.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-06T02:44:31.146 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION_CODENAME=focal 2023-10-06T02:44:31.146 INFO:teuthology.orchestra.run.smithi105.stdout:UBUNTU_CODENAME=focal 2023-10-06T02:44:31.146 INFO:teuthology.lock.ops:Updating smithi105.front.sepia.ceph.com on lock server 2023-10-06T02:44:31.172 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-10-06T02:44:31.180 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-10-06T02:44:31.201 INFO:teuthology.task.internal:Checking for old test directory... 2023-10-06T02:44:31.202 DEBUG:teuthology.orchestra.run.smithi057:> test '!' -e /home/ubuntu/cephtest 2023-10-06T02:44:31.204 DEBUG:teuthology.orchestra.run.smithi105:> test '!' -e /home/ubuntu/cephtest 2023-10-06T02:44:31.210 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-10-06T02:44:31.225 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-10-06T02:44:31.225 DEBUG:teuthology.orchestra.run.smithi057:> test -z $(ls -A /var/lib/ceph) 2023-10-06T02:44:31.227 DEBUG:teuthology.orchestra.run.smithi105:> test -z $(ls -A /var/lib/ceph) 2023-10-06T02:44:31.238 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-10-06T02:44:31.293 INFO:teuthology.run_tasks:Running task kernel... 2023-10-06T02:44:31.307 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'} 2023-10-06T02:44:31.307 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2023-10-06T02:44:31.308 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2023-10-06T02:44:31.308 DEBUG:teuthology.orchestra.run.smithi057:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-06T02:44:31.308 DEBUG:teuthology.orchestra.run.smithi105:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-06T02:44:31.313 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:44:31.314 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=testing 2023-10-06T02:44:31.317 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:44:31.318 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=testing 2023-10-06T02:44:31.479 DEBUG:teuthology.task.kernel:sha1 for client.0 is fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-10-06T02:44:31.480 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c"... 2023-10-06T02:44:31.480 DEBUG:teuthology.orchestra.run.smithi057:> uname -r 2023-10-06T02:44:31.486 INFO:teuthology.orchestra.run.smithi057.stdout:5.4.0-124-generic 2023-10-06T02:44:31.486 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-124-generic vs fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-10-06T02:44:31.487 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-10-06T02:44:31.487 INFO:teuthology.task.kernel:Installing linux-firmware on client.0... 2023-10-06T02:44:31.487 DEBUG:teuthology.orchestra.run.smithi057:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2023-10-06T02:44:31.542 DEBUG:teuthology.task.kernel:sha1 for client.1 is fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-10-06T02:44:31.542 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c"... 2023-10-06T02:44:31.542 DEBUG:teuthology.orchestra.run.smithi105:> uname -r 2023-10-06T02:44:31.546 INFO:teuthology.orchestra.run.smithi057.stderr:bash: line 0: cd: /lib/firmware/updates: No such file or directory 2023-10-06T02:44:31.548 INFO:teuthology.orchestra.run.smithi105.stdout:5.4.0-124-generic 2023-10-06T02:44:31.549 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-124-generic vs fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-10-06T02:44:31.549 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-10-06T02:44:31.549 INFO:teuthology.task.kernel:Installing linux-firmware on client.1... 2023-10-06T02:44:31.549 DEBUG:teuthology.orchestra.run.smithi105:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2023-10-06T02:44:31.570 INFO:teuthology.orchestra.run.smithi105.stderr:bash: line 0: cd: /lib/firmware/updates: No such file or directory 2023-10-06T02:44:31.651 INFO:teuthology.orchestra.run.smithi057.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2023-10-06T02:44:31.653 DEBUG:teuthology.orchestra.run.smithi057:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2023-10-06T02:44:31.691 DEBUG:teuthology.orchestra.run.smithi057:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2023-10-06T02:44:31.694 INFO:teuthology.orchestra.run.smithi105.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2023-10-06T02:44:31.695 DEBUG:teuthology.orchestra.run.smithi105:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2023-10-06T02:44:31.708 DEBUG:teuthology.orchestra.run.smithi057:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2023-10-06T02:44:31.768 DEBUG:teuthology.orchestra.run.smithi105:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2023-10-06T02:44:31.783 DEBUG:teuthology.orchestra.run.smithi105:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2023-10-06T02:45:23.147 INFO:teuthology.orchestra.run.smithi105.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2023-10-06T02:45:23.147 INFO:teuthology.orchestra.run.smithi105.stderr: * [new branch] main -> origin/main 2023-10-06T02:45:23.200 INFO:teuthology.orchestra.run.smithi105.stderr: * [new tag] 20190312 -> 20190312 2023-10-06T02:45:23.200 INFO:teuthology.orchestra.run.smithi105.stderr: * [new tag] 20190416 -> 20190416 2023-10-06T02:45:23.200 INFO:teuthology.orchestra.run.smithi105.stderr: * [new tag] 20190514 -> 20190514 2023-10-06T02:45:23.200 INFO:teuthology.orchestra.run.smithi105.stderr: * [new tag] 20190618 -> 20190618 2023-10-06T02:45:23.201 INFO:teuthology.orchestra.run.smithi105.stderr: * [new tag] 20190717 -> 20190717 2023-10-06T02:45:23.201 INFO:teuthology.orchestra.run.smithi105.stderr: * [new tag] 20190815 -> 20190815 2023-10-06T02:45:23.201 INFO:teuthology.orchestra.run.smithi105.stderr: * [new tag] 20190923 -> 20190923 2023-10-06T02:45:23.201 INFO:teuthology.orchestra.run.smithi105.stderr: * [new tag] 20191022 -> 20191022 2023-10-06T02:45:23.201 INFO:teuthology.orchestra.run.smithi105.stderr: * [new tag] 20191215 -> 20191215 2023-10-06T02:45:23.205 INFO:teuthology.orchestra.run.smithi105.stderr: * [new tag] 20200122 -> 20200122 2023-10-06T02:45:23.205 INFO:teuthology.orchestra.run.smithi105.stderr: * [new tag] 20200316 -> 20200316 2023-10-06T02:45:23.205 INFO:teuthology.orchestra.run.smithi105.stderr: * [new tag] 20200421 -> 20200421 2023-10-06T02:45:23.205 INFO:teuthology.orchestra.run.smithi105.stderr: * [new tag] 20200519 -> 20200519 2023-10-06T02:45:23.205 INFO:teuthology.orchestra.run.smithi105.stderr: * [new tag] 20200619 -> 20200619 2023-10-06T02:45:23.205 INFO:teuthology.orchestra.run.smithi105.stderr: * [new tag] 20200721 -> 20200721 2023-10-06T02:45:23.205 INFO:teuthology.orchestra.run.smithi105.stderr: * [new tag] 20200817 -> 20200817 2023-10-06T02:45:23.205 INFO:teuthology.orchestra.run.smithi105.stderr: * [new tag] 20200918 -> 20200918 2023-10-06T02:45:23.205 INFO:teuthology.orchestra.run.smithi105.stderr: * [new tag] 20201022 -> 20201022 2023-10-06T02:45:23.205 INFO:teuthology.orchestra.run.smithi105.stderr: * [new tag] 20201118 -> 20201118 2023-10-06T02:45:23.205 INFO:teuthology.orchestra.run.smithi105.stderr: * [new tag] 20201218 -> 20201218 2023-10-06T02:45:23.206 INFO:teuthology.orchestra.run.smithi105.stderr: * [new tag] 20210208 -> 20210208 2023-10-06T02:45:23.206 INFO:teuthology.orchestra.run.smithi105.stderr: * [new tag] 20210315 -> 20210315 2023-10-06T02:45:23.206 INFO:teuthology.orchestra.run.smithi105.stderr: * [new tag] 20210511 -> 20210511 2023-10-06T02:45:23.206 INFO:teuthology.orchestra.run.smithi105.stderr: * [new tag] 20210716 -> 20210716 2023-10-06T02:45:23.206 INFO:teuthology.orchestra.run.smithi105.stderr: * [new tag] 20210818 -> 20210818 2023-10-06T02:45:23.206 INFO:teuthology.orchestra.run.smithi105.stderr: * [new tag] 20210919 -> 20210919 2023-10-06T02:45:23.206 INFO:teuthology.orchestra.run.smithi105.stderr: * [new tag] 20211027 -> 20211027 2023-10-06T02:45:23.206 INFO:teuthology.orchestra.run.smithi105.stderr: * [new tag] 20211216 -> 20211216 2023-10-06T02:45:23.206 INFO:teuthology.orchestra.run.smithi105.stderr: * [new tag] 20220209 -> 20220209 2023-10-06T02:45:23.206 INFO:teuthology.orchestra.run.smithi105.stderr: * [new tag] 20220310 -> 20220310 2023-10-06T02:45:23.206 INFO:teuthology.orchestra.run.smithi105.stderr: * [new tag] 20220411 -> 20220411 2023-10-06T02:45:23.207 INFO:teuthology.orchestra.run.smithi105.stderr: * [new tag] 20220509 -> 20220509 2023-10-06T02:45:23.207 INFO:teuthology.orchestra.run.smithi105.stderr: * [new tag] 20220610 -> 20220610 2023-10-06T02:45:23.207 INFO:teuthology.orchestra.run.smithi105.stderr: * [new tag] 20220708 -> 20220708 2023-10-06T02:45:23.207 INFO:teuthology.orchestra.run.smithi105.stderr: * [new tag] 20220815 -> 20220815 2023-10-06T02:45:23.207 INFO:teuthology.orchestra.run.smithi105.stderr: * [new tag] 20220913 -> 20220913 2023-10-06T02:45:23.207 INFO:teuthology.orchestra.run.smithi105.stderr: * [new tag] 20221012 -> 20221012 2023-10-06T02:45:23.207 INFO:teuthology.orchestra.run.smithi105.stderr: * [new tag] 20221109 -> 20221109 2023-10-06T02:45:23.207 INFO:teuthology.orchestra.run.smithi105.stderr: * [new tag] 20221214 -> 20221214 2023-10-06T02:45:23.207 INFO:teuthology.orchestra.run.smithi105.stderr: * [new tag] 20230117 -> 20230117 2023-10-06T02:45:23.207 INFO:teuthology.orchestra.run.smithi105.stderr: * [new tag] 20230210 -> 20230210 2023-10-06T02:45:23.207 INFO:teuthology.orchestra.run.smithi105.stderr: * [new tag] 20230310 -> 20230310 2023-10-06T02:45:23.207 INFO:teuthology.orchestra.run.smithi105.stderr: * [new tag] 20230404 -> 20230404 2023-10-06T02:45:23.208 INFO:teuthology.orchestra.run.smithi105.stderr: * [new tag] 20230515 -> 20230515 2023-10-06T02:45:23.208 INFO:teuthology.orchestra.run.smithi105.stderr: * [new tag] 20230625 -> 20230625 2023-10-06T02:45:23.208 INFO:teuthology.orchestra.run.smithi105.stderr: * [new tag] 20230804 -> 20230804 2023-10-06T02:45:23.208 INFO:teuthology.orchestra.run.smithi105.stderr: * [new tag] 20230919 -> 20230919 2023-10-06T02:45:26.596 INFO:teuthology.orchestra.run.smithi057.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2023-10-06T02:45:26.596 INFO:teuthology.orchestra.run.smithi057.stderr: * [new branch] main -> origin/main 2023-10-06T02:45:26.656 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20190312 -> 20190312 2023-10-06T02:45:26.657 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20190416 -> 20190416 2023-10-06T02:45:26.657 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20190514 -> 20190514 2023-10-06T02:45:26.657 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20190618 -> 20190618 2023-10-06T02:45:26.657 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20190717 -> 20190717 2023-10-06T02:45:26.657 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20190815 -> 20190815 2023-10-06T02:45:26.657 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20190923 -> 20190923 2023-10-06T02:45:26.657 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20191022 -> 20191022 2023-10-06T02:45:26.657 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20191215 -> 20191215 2023-10-06T02:45:26.657 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20200122 -> 20200122 2023-10-06T02:45:26.657 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20200316 -> 20200316 2023-10-06T02:45:26.657 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20200421 -> 20200421 2023-10-06T02:45:26.657 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20200519 -> 20200519 2023-10-06T02:45:26.658 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20200619 -> 20200619 2023-10-06T02:45:26.658 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20200721 -> 20200721 2023-10-06T02:45:26.658 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20200817 -> 20200817 2023-10-06T02:45:26.658 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20200918 -> 20200918 2023-10-06T02:45:26.658 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20201022 -> 20201022 2023-10-06T02:45:26.658 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20201118 -> 20201118 2023-10-06T02:45:26.658 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20201218 -> 20201218 2023-10-06T02:45:26.658 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20210208 -> 20210208 2023-10-06T02:45:26.658 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20210315 -> 20210315 2023-10-06T02:45:26.658 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20210511 -> 20210511 2023-10-06T02:45:26.658 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20210716 -> 20210716 2023-10-06T02:45:26.658 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20210818 -> 20210818 2023-10-06T02:45:26.661 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20210919 -> 20210919 2023-10-06T02:45:26.661 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20211027 -> 20211027 2023-10-06T02:45:26.661 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20211216 -> 20211216 2023-10-06T02:45:26.661 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20220209 -> 20220209 2023-10-06T02:45:26.661 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20220310 -> 20220310 2023-10-06T02:45:26.661 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20220411 -> 20220411 2023-10-06T02:45:26.661 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20220509 -> 20220509 2023-10-06T02:45:26.662 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20220610 -> 20220610 2023-10-06T02:45:26.662 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20220708 -> 20220708 2023-10-06T02:45:26.662 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20220815 -> 20220815 2023-10-06T02:45:26.662 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20220913 -> 20220913 2023-10-06T02:45:26.662 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20221012 -> 20221012 2023-10-06T02:45:26.662 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20221109 -> 20221109 2023-10-06T02:45:26.662 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20221214 -> 20221214 2023-10-06T02:45:26.662 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20230117 -> 20230117 2023-10-06T02:45:26.662 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20230210 -> 20230210 2023-10-06T02:45:26.662 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20230310 -> 20230310 2023-10-06T02:45:26.662 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20230404 -> 20230404 2023-10-06T02:45:26.662 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20230515 -> 20230515 2023-10-06T02:45:26.663 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20230625 -> 20230625 2023-10-06T02:45:26.663 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20230804 -> 20230804 2023-10-06T02:45:26.663 INFO:teuthology.orchestra.run.smithi057.stderr: * [new tag] 20230919 -> 20230919 2023-10-06T02:45:26.849 INFO:teuthology.orchestra.run.smithi105.stderr:Updating files: 51% (1638/3158) Updating files: 52% (1643/3158) Updating files: 53% (1674/3158) Updating files: 54% (1706/3158) Updating files: 55% (1737/3158) Updating files: 56% (1769/3158) Updating files: 57% (1801/3158) Updating files: 58% (1832/3158) Updating files: 59% (1864/3158) Updating files: 60% (1895/3158) Updating files: 61% (1927/3158) Updating files: 62% (1958/3158) Updating files: 63% (1990/3158) Updating files: 64% (2022/3158) Updating files: 65% (2053/3158) Updating files: 66% (2085/3158) Updating files: 66% (2105/3158) Updating files: 67% (2116/3158) Updating files: 68% (2148/3158) Updating files: 69% (2180/3158) Updating files: 70% (2211/3158) Updating files: 71% (2243/3158) Updating files: 72% (2274/3158) Updating files: 73% (2306/3158) Updating files: 74% (2337/3158) Updating files: 75% (2369/3158) Updating files: 76% (2401/3158) Updating files: 77% (2432/3158) Updating files: 78% (2464/3158) Updating files: 79% (2495/3158) Updating files: 80% (2527/3158) Updating files: 81% (2558/3158) Updating files: 81% (2588/3158) Updating files: 82% (2590/3158) Updating files: 83% (2622/3158) Updating files: 84% (2653/3158) Updating files: 85% (2685/3158) Updating files: 86% (2716/3158) Updating files: 87% (2748/3158) Updating files: 88% (2780/3158) Updating files: 89% (2811/3158) Updating files: 90% (2843/3158) Updating files: 91% (2874/3158) Updating files: 92% (2906/3158) Updating files: 93% (2937/3158) Updating files: 94% (2969/3158) Updating files: 95% (3001/3158) Updating files: 96% (3032/3158) Updating files: 97% (3064/3158) Updating files: 98% (3095/3158) Updating files: 99% (3127/3158) Updating files: 100% (3158/3158) Updating files: 100% (3158/3158), done. 2023-10-06T02:45:26.854 INFO:teuthology.orchestra.run.smithi105.stdout:HEAD is now at 5105ff4b Merge branch 'mlimonci/upstream-packaging' into 'main' 2023-10-06T02:45:26.869 INFO:teuthology.task.kernel:Downloading kernel fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c on client.1... 2023-10-06T02:45:26.870 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-10-06T02:45:27.089 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/ubuntu/focal/flavors/default/pool/main/l/linux-6.5.0-rc7-gfef64f93da2b/ 2023-10-06T02:45:27.089 DEBUG:teuthology.orchestra.run.smithi105:> rm -f /tmp/linux-image.deb && echo linux-image-6.5.0-rc7-gfef64f93da2b_6.5.0-rc7-gfef64f93da2b-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://4.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/ubuntu/focal/flavors/default/pool/main/l/linux-6.5.0-rc7-gfef64f93da2b/ --input-file=- 2023-10-06T02:45:27.092 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi105.front.sepia.ceph.com to complete... 2023-10-06T02:45:28.599 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06 02:45:28 URL:https://4.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/ubuntu/focal/flavors/default/pool/main/l/linux-6.5.0-rc7-gfef64f93da2b/linux-image-6.5.0-rc7-gfef64f93da2b_6.5.0-rc7-gfef64f93da2b-1_amd64.deb [38832758/38832758] -> "/tmp/linux-image.deb" [1] 2023-10-06T02:45:28.600 INFO:teuthology.orchestra.run.smithi105.stderr:FINISHED --2023-10-06 02:45:28-- 2023-10-06T02:45:28.600 INFO:teuthology.orchestra.run.smithi105.stderr:Total wall clock time: 1.5s 2023-10-06T02:45:28.600 INFO:teuthology.orchestra.run.smithi105.stderr:Downloaded: 1 files, 37M in 1.3s (27.5 MB/s) 2023-10-06T02:45:28.602 INFO:teuthology.task.kernel:Installing kernel fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c on client.1... 2023-10-06T02:45:28.602 DEBUG:teuthology.orchestra.run.smithi105:> sudo dpkg -i /tmp/linux-image.deb 2023-10-06T02:45:28.863 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package linux-image-6.5.0-rc7-gfef64f93da2b. 2023-10-06T02:45:30.512 INFO:teuthology.orchestra.run.smithi057.stderr:Updating files: 49% (1552/3158) Updating files: 50% (1579/3158) Updating files: 51% (1611/3158) Updating files: 52% (1643/3158) Updating files: 53% (1674/3158) Updating files: 54% (1706/3158) Updating files: 55% (1737/3158) Updating files: 56% (1769/3158) Updating files: 57% (1801/3158) Updating files: 58% (1832/3158) Updating files: 59% (1864/3158) Updating files: 60% (1895/3158) Updating files: 61% (1927/3158) Updating files: 62% (1958/3158) Updating files: 63% (1990/3158) Updating files: 64% (2022/3158) Updating files: 64% (2045/3158) Updating files: 65% (2053/3158) Updating files: 66% (2085/3158) Updating files: 67% (2116/3158) Updating files: 68% (2148/3158) Updating files: 69% (2180/3158) Updating files: 70% (2211/3158) Updating files: 71% (2243/3158) Updating files: 72% (2274/3158) Updating files: 73% (2306/3158) Updating files: 74% (2337/3158) Updating files: 75% (2369/3158) Updating files: 76% (2401/3158) Updating files: 77% (2432/3158) Updating files: 78% (2464/3158) Updating files: 79% (2495/3158) Updating files: 80% (2527/3158) Updating files: 81% (2558/3158) Updating files: 81% (2573/3158) Updating files: 82% (2590/3158) Updating files: 83% (2622/3158) Updating files: 84% (2653/3158) Updating files: 85% (2685/3158) Updating files: 86% (2716/3158) Updating files: 87% (2748/3158) Updating files: 88% (2780/3158) Updating files: 89% (2811/3158) Updating files: 90% (2843/3158) Updating files: 91% (2874/3158) Updating files: 92% (2906/3158) Updating files: 93% (2937/3158) Updating files: 94% (2969/3158) Updating files: 95% (3001/3158) Updating files: 96% (3032/3158) Updating files: 97% (3064/3158) Updating files: 98% (3095/3158) Updating files: 99% (3127/3158) Updating files: 100% (3158/3158) Updating files: 100% (3158/3158), done. 2023-10-06T02:45:30.517 INFO:teuthology.orchestra.run.smithi057.stdout:HEAD is now at 5105ff4b Merge branch 'mlimonci/upstream-packaging' into 'main' 2023-10-06T02:45:30.534 INFO:teuthology.task.kernel:Downloading kernel fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c on client.0... 2023-10-06T02:45:30.534 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-10-06T02:45:30.596 INFO:teuthology.orchestra.run.smithi105.stdout:(Reading database ... 104373 files and directories currently installed.) 2023-10-06T02:45:30.601 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack /tmp/linux-image.deb ... 2023-10-06T02:45:30.685 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/ubuntu/focal/flavors/default/pool/main/l/linux-6.5.0-rc7-gfef64f93da2b/ 2023-10-06T02:45:30.685 DEBUG:teuthology.orchestra.run.smithi057:> rm -f /tmp/linux-image.deb && echo linux-image-6.5.0-rc7-gfef64f93da2b_6.5.0-rc7-gfef64f93da2b-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://4.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/ubuntu/focal/flavors/default/pool/main/l/linux-6.5.0-rc7-gfef64f93da2b/ --input-file=- 2023-10-06T02:45:30.687 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi057.front.sepia.ceph.com to complete... 2023-10-06T02:45:30.715 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking linux-image-6.5.0-rc7-gfef64f93da2b (6.5.0-rc7-gfef64f93da2b-1) ... 2023-10-06T02:45:32.192 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06 02:45:31 URL:https://4.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/ubuntu/focal/flavors/default/pool/main/l/linux-6.5.0-rc7-gfef64f93da2b/linux-image-6.5.0-rc7-gfef64f93da2b_6.5.0-rc7-gfef64f93da2b-1_amd64.deb [38832758/38832758] -> "/tmp/linux-image.deb" [1] 2023-10-06T02:45:32.192 INFO:teuthology.orchestra.run.smithi057.stderr:FINISHED --2023-10-06 02:45:31-- 2023-10-06T02:45:32.192 INFO:teuthology.orchestra.run.smithi057.stderr:Total wall clock time: 1.5s 2023-10-06T02:45:32.192 INFO:teuthology.orchestra.run.smithi057.stderr:Downloaded: 1 files, 37M in 1.3s (27.5 MB/s) 2023-10-06T02:45:32.194 INFO:teuthology.task.kernel:Installing kernel fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c on client.0... 2023-10-06T02:45:32.194 DEBUG:teuthology.orchestra.run.smithi057:> sudo dpkg -i /tmp/linux-image.deb 2023-10-06T02:45:32.511 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package linux-image-6.5.0-rc7-gfef64f93da2b. 2023-10-06T02:45:33.614 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up linux-image-6.5.0-rc7-gfef64f93da2b (6.5.0-rc7-gfef64f93da2b-1) ... 2023-10-06T02:45:33.735 INFO:teuthology.orchestra.run.smithi105.stderr:update-initramfs: Generating /boot/initrd.img-6.5.0-rc7-gfef64f93da2b 2023-10-06T02:45:34.256 INFO:teuthology.orchestra.run.smithi057.stdout:(Reading database ... 104373 files and directories currently installed.) 2023-10-06T02:45:34.261 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack /tmp/linux-image.deb ... 2023-10-06T02:45:34.385 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking linux-image-6.5.0-rc7-gfef64f93da2b (6.5.0-rc7-gfef64f93da2b-1) ... 2023-10-06T02:45:37.464 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up linux-image-6.5.0-rc7-gfef64f93da2b (6.5.0-rc7-gfef64f93da2b-1) ... 2023-10-06T02:45:37.597 INFO:teuthology.orchestra.run.smithi057.stderr:update-initramfs: Generating /boot/initrd.img-6.5.0-rc7-gfef64f93da2b 2023-10-06T02:45:58.536 INFO:teuthology.orchestra.run.smithi105.stderr:Sourcing file `/etc/default/grub' 2023-10-06T02:45:58.547 INFO:teuthology.orchestra.run.smithi105.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-10-06T02:45:58.580 INFO:teuthology.orchestra.run.smithi105.stderr:Generating grub configuration file ... 2023-10-06T02:45:58.930 INFO:teuthology.orchestra.run.smithi105.stderr:Found linux image: /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b 2023-10-06T02:45:58.954 INFO:teuthology.orchestra.run.smithi105.stderr:Found initrd image: /boot/initrd.img-6.5.0-rc7-gfef64f93da2b 2023-10-06T02:45:59.340 INFO:teuthology.orchestra.run.smithi105.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-10-06T02:45:59.353 INFO:teuthology.orchestra.run.smithi105.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-10-06T02:46:01.365 INFO:teuthology.orchestra.run.smithi105.stderr:done 2023-10-06T02:46:01.541 DEBUG:teuthology.orchestra.run.smithi105:> dpkg-deb -c /tmp/linux-image.deb 2023-10-06T02:46:01.551 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./ 2023-10-06T02:46:01.552 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./boot/ 2023-10-06T02:46:01.552 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 4382168 2023-09-11 02:20 ./boot/System.map-6.5.0-rc7-gfef64f93da2b 2023-10-06T02:46:01.565 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 168454 2023-09-11 02:20 ./boot/config-6.5.0-rc7-gfef64f93da2b 2023-10-06T02:46:01.565 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11294080 2023-09-11 02:20 ./boot/vmlinuz-6.5.0-rc7-gfef64f93da2b 2023-10-06T02:46:01.589 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./etc/ 2023-10-06T02:46:01.590 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./etc/kernel/ 2023-10-06T02:46:01.590 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./etc/kernel/postinst.d/ 2023-10-06T02:46:01.590 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./etc/kernel/postrm.d/ 2023-10-06T02:46:01.590 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./etc/kernel/preinst.d/ 2023-10-06T02:46:01.590 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./etc/kernel/prerm.d/ 2023-10-06T02:46:01.590 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/ 2023-10-06T02:46:01.590 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/ 2023-10-06T02:46:01.590 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/ 2023-10-06T02:46:01.590 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/ 2023-10-06T02:46:01.591 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/ 2023-10-06T02:46:01.591 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/ 2023-10-06T02:46:01.591 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/ 2023-10-06T02:46:01.591 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 490385 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/aesni-intel.ko 2023-10-06T02:46:01.591 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 25329 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-10-06T02:46:01.591 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 29529 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-10-06T02:46:01.591 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 30313 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-10-06T02:46:01.591 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 93113 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-10-06T02:46:01.591 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 106729 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-10-06T02:46:01.591 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 152241 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-10-06T02:46:01.591 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12553 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-10-06T02:46:01.591 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13777 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-10-06T02:46:01.592 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 83889 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-10-06T02:46:01.592 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 18625 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-10-06T02:46:01.592 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 47225 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-10-06T02:46:01.592 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 47209 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-avx2.ko 2023-10-06T02:46:01.592 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 51801 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-10-06T02:46:01.592 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 38937 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-10-06T02:46:01.592 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 40529 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-10-06T02:46:01.592 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 58585 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-10-06T02:46:01.592 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 50497 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-10-06T02:46:01.592 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 32065 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-10-06T02:46:01.592 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13625 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-10-06T02:46:01.592 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/ 2023-10-06T02:46:01.593 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu/ 2023-10-06T02:46:01.593 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu/mce/ 2023-10-06T02:46:01.593 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 40113 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-10-06T02:46:01.593 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13281 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpuid.ko 2023-10-06T02:46:01.593 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17865 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/msr.ko 2023-10-06T02:46:01.593 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/ 2023-10-06T02:46:01.593 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 348201 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm-amd.ko 2023-10-06T02:46:01.593 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 882105 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm-intel.ko 2023-10-06T02:46:01.594 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 2277369 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm.ko 2023-10-06T02:46:01.650 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/ 2023-10-06T02:46:01.650 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 53585 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/af_alg.ko 2023-10-06T02:46:01.650 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 23097 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/algif_hash.ko 2023-10-06T02:46:01.650 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 20049 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/algif_skcipher.ko 2023-10-06T02:46:01.650 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17209 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/ansi_cprng.ko 2023-10-06T02:46:01.651 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 19641 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/anubis.ko 2023-10-06T02:46:01.651 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10145 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/arc4.ko 2023-10-06T02:46:01.651 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/asymmetric_keys/ 2023-10-06T02:46:01.651 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10185 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2023-10-06T02:46:01.651 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/ 2023-10-06T02:46:01.651 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11249 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_memcpy.ko 2023-10-06T02:46:01.651 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 19473 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_pq.ko 2023-10-06T02:46:01.651 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 21561 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_raid6_recov.ko 2023-10-06T02:46:01.651 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13825 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_tx.ko 2023-10-06T02:46:01.651 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17745 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_xor.ko 2023-10-06T02:46:01.651 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17921 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/raid6test.ko 2023-10-06T02:46:01.651 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 20489 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/authenc.ko 2023-10-06T02:46:01.652 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 22641 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/authencesn.ko 2023-10-06T02:46:01.652 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 21817 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blake2b_generic.ko 2023-10-06T02:46:01.652 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12729 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blowfish_common.ko 2023-10-06T02:46:01.652 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10537 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blowfish_generic.ko 2023-10-06T02:46:01.652 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 38873 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/camellia_generic.ko 2023-10-06T02:46:01.652 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 27321 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast5_generic.ko 2023-10-06T02:46:01.652 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17745 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast6_generic.ko 2023-10-06T02:46:01.652 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10537 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast_common.ko 2023-10-06T02:46:01.652 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 35097 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/ccm.ko 2023-10-06T02:46:01.652 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14769 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cmac.ko 2023-10-06T02:46:01.652 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 9585 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crc32_generic.ko 2023-10-06T02:46:01.652 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 46961 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cryptd.ko 2023-10-06T02:46:01.653 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 25249 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crypto_engine.ko 2023-10-06T02:46:01.653 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 26953 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crypto_simd.ko 2023-10-06T02:46:01.653 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 24737 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crypto_user.ko 2023-10-06T02:46:01.653 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17729 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cts.ko 2023-10-06T02:46:01.653 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10913 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/des_generic.ko 2023-10-06T02:46:01.653 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15681 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/dh_generic.ko 2023-10-06T02:46:01.653 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11001 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/echainiv.ko 2023-10-06T02:46:01.653 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 25321 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/essiv.ko 2023-10-06T02:46:01.653 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17993 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/fcrypt.ko 2023-10-06T02:46:01.653 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 26897 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/khazad.ko 2023-10-06T02:46:01.653 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15649 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/lrw.ko 2023-10-06T02:46:01.653 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11513 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/lz4.ko 2023-10-06T02:46:01.654 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11529 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/lz4hc.ko 2023-10-06T02:46:01.654 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11761 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/md4.ko 2023-10-06T02:46:01.654 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 9729 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/michael_mic.ko 2023-10-06T02:46:01.654 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10673 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/pcbc.ko 2023-10-06T02:46:01.654 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 18745 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/pcrypt.ko 2023-10-06T02:46:01.654 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16049 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/rmd160.ko 2023-10-06T02:46:01.654 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 29393 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/seed.ko 2023-10-06T02:46:01.654 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 27081 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/serpent_generic.ko 2023-10-06T02:46:01.654 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 149193 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/tcrypt.ko 2023-10-06T02:46:01.654 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10881 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/tea.ko 2023-10-06T02:46:01.654 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 28777 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/twofish_common.ko 2023-10-06T02:46:01.654 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13233 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/twofish_generic.ko 2023-10-06T02:46:01.655 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17401 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/vmac.ko 2023-10-06T02:46:01.655 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 36185 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/wp512.ko 2023-10-06T02:46:01.655 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14105 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xcbc.ko 2023-10-06T02:46:01.655 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 26665 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xor.ko 2023-10-06T02:46:01.655 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 18713 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xts.ko 2023-10-06T02:46:01.655 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 9481 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xxhash_generic.ko 2023-10-06T02:46:01.655 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ 2023-10-06T02:46:01.655 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/ 2023-10-06T02:46:01.655 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 18249 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/acpi_extlog.ko 2023-10-06T02:46:01.655 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 26969 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/acpi_ipmi.ko 2023-10-06T02:46:01.655 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 28793 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/acpi_pad.ko 2023-10-06T02:46:01.655 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/apei/ 2023-10-06T02:46:01.655 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 31241 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/apei/einj.ko 2023-10-06T02:46:01.656 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12801 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/ec_sys.ko 2023-10-06T02:46:01.656 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14937 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/platform_profile.ko 2023-10-06T02:46:01.656 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 24401 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/sbs.ko 2023-10-06T02:46:01.656 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 19521 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/sbshc.ko 2023-10-06T02:46:01.656 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 100401 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/video.ko 2023-10-06T02:46:01.656 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/ 2023-10-06T02:46:01.656 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 21473 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/acard-ahci.ko 2023-10-06T02:46:01.656 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 88625 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/ahci.ko 2023-10-06T02:46:01.656 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14593 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/ahci_platform.ko 2023-10-06T02:46:01.656 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 87841 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/libahci.ko 2023-10-06T02:46:01.656 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 35049 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/libahci_platform.ko 2023-10-06T02:46:01.656 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17009 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_acpi.ko 2023-10-06T02:46:01.657 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 30553 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ali.ko 2023-10-06T02:46:01.657 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 33625 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_amd.ko 2023-10-06T02:46:01.657 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 21201 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_artop.ko 2023-10-06T02:46:01.657 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 21049 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_atiixp.ko 2023-10-06T02:46:01.657 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 24809 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_atp867x.ko 2023-10-06T02:46:01.657 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17585 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cmd640.ko 2023-10-06T02:46:01.657 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 25241 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cmd64x.ko 2023-10-06T02:46:01.657 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14921 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cypress.ko 2023-10-06T02:46:01.657 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17721 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_efar.ko 2023-10-06T02:46:01.657 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 21809 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt366.ko 2023-10-06T02:46:01.657 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 34033 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt37x.ko 2023-10-06T02:46:01.657 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 23057 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt3x2n.ko 2023-10-06T02:46:01.658 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16793 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt3x3.ko 2023-10-06T02:46:01.658 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16857 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_it8213.ko 2023-10-06T02:46:01.658 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 35177 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_it821x.ko 2023-10-06T02:46:01.658 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12753 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_jmicron.ko 2023-10-06T02:46:01.658 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 51737 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_legacy.ko 2023-10-06T02:46:01.658 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15057 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_marvell.ko 2023-10-06T02:46:01.658 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16153 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_mpiix.ko 2023-10-06T02:46:01.658 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12705 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_netcell.ko 2023-10-06T02:46:01.658 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16681 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ninja32.ko 2023-10-06T02:46:01.658 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14969 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ns87410.ko 2023-10-06T02:46:01.658 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17225 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ns87415.ko 2023-10-06T02:46:01.658 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16433 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_oldpiix.ko 2023-10-06T02:46:01.659 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15249 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_opti.ko 2023-10-06T02:46:01.659 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 20609 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_optidma.ko 2023-10-06T02:46:01.659 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 32521 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pcmcia.ko 2023-10-06T02:46:01.659 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 37729 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pdc2027x.ko 2023-10-06T02:46:01.659 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 20489 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-10-06T02:46:01.659 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14097 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_piccolo.ko 2023-10-06T02:46:01.659 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15321 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_radisys.ko 2023-10-06T02:46:01.659 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 19449 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_rdc.ko 2023-10-06T02:46:01.659 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15201 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_rz1000.ko 2023-10-06T02:46:01.659 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13809 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sch.ko 2023-10-06T02:46:01.659 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 23001 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_serverworks.ko 2023-10-06T02:46:01.659 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 23385 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sil680.ko 2023-10-06T02:46:01.659 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 19569 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sl82c105.ko 2023-10-06T02:46:01.660 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15881 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_triflex.ko 2023-10-06T02:46:01.660 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 30425 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_via.ko 2023-10-06T02:46:01.660 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 22729 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pdc_adma.ko 2023-10-06T02:46:01.660 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 28993 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_inic162x.ko 2023-10-06T02:46:01.660 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 83225 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_mv.ko 2023-10-06T02:46:01.660 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 70537 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_nv.ko 2023-10-06T02:46:01.660 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 37369 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_promise.ko 2023-10-06T02:46:01.660 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 22969 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_qstor.ko 2023-10-06T02:46:01.660 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 29201 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sil.ko 2023-10-06T02:46:01.660 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 38273 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sil24.ko 2023-10-06T02:46:01.660 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17873 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sis.ko 2023-10-06T02:46:01.660 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 20305 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_svw.ko 2023-10-06T02:46:01.661 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 44721 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sx4.ko 2023-10-06T02:46:01.661 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15465 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_uli.ko 2023-10-06T02:46:01.661 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 35121 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_via.ko 2023-10-06T02:46:01.661 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 20001 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_vsc.ko 2023-10-06T02:46:01.661 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/auxdisplay/ 2023-10-06T02:46:01.661 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16289 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/auxdisplay/ks0108.ko 2023-10-06T02:46:01.661 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/bcma/ 2023-10-06T02:46:01.661 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 124457 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/bcma/bcma.ko 2023-10-06T02:46:01.661 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/ 2023-10-06T02:46:01.662 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/aoe/ 2023-10-06T02:46:01.662 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 113705 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/aoe/aoe.ko 2023-10-06T02:46:01.662 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/drbd/ 2023-10-06T02:46:01.662 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 968433 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/drbd/drbd.ko 2023-10-06T02:46:01.662 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 173201 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/floppy.ko 2023-10-06T02:46:01.662 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/mtip32xx/ 2023-10-06T02:46:01.662 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 94297 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-10-06T02:46:01.662 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 115345 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/nbd.ko 2023-10-06T02:46:01.662 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/null_blk/ 2023-10-06T02:46:01.662 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 110361 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/null_blk/null_blk.ko 2023-10-06T02:46:01.662 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 98225 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/pktcdvd.ko 2023-10-06T02:46:01.663 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 259401 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/rbd.ko 2023-10-06T02:46:01.663 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkback/ 2023-10-06T02:46:01.663 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 98129 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-10-06T02:46:01.663 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/zram/ 2023-10-06T02:46:01.663 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 60265 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/zram/zram.ko 2023-10-06T02:46:01.663 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ 2023-10-06T02:46:01.663 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 30849 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/applicom.ko 2023-10-06T02:46:01.663 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12009 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hangcheck-timer.ko 2023-10-06T02:46:01.663 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/ 2023-10-06T02:46:01.663 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13889 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/amd-rng.ko 2023-10-06T02:46:01.663 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 18809 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/intel-rng.ko 2023-10-06T02:46:01.663 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13385 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-10-06T02:46:01.664 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10673 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/via-rng.ko 2023-10-06T02:46:01.664 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15633 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/virtio-rng.ko 2023-10-06T02:46:01.664 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ 2023-10-06T02:46:01.664 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 30857 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-10-06T02:46:01.664 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 150665 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-10-06T02:46:01.664 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 26561 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-10-06T02:46:01.664 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 139057 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_si.ko 2023-10-06T02:46:01.664 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 70833 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-10-06T02:46:01.664 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 53609 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-10-06T02:46:01.664 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 36321 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/lp.ko 2023-10-06T02:46:01.664 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/mwave/ 2023-10-06T02:46:01.665 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 84121 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/mwave/mwave.ko 2023-10-06T02:46:01.665 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 25873 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/nvram.ko 2023-10-06T02:46:01.665 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 32169 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ppdev.ko 2023-10-06T02:46:01.665 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 51113 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tlclk.ko 2023-10-06T02:46:01.665 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/ 2023-10-06T02:46:01.665 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16401 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_atmel.ko 2023-10-06T02:46:01.665 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15881 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2023-10-06T02:46:01.665 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 23473 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2023-10-06T02:46:01.665 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 32985 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2023-10-06T02:46:01.666 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 30121 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_infineon.ko 2023-10-06T02:46:01.666 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 22697 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_nsc.ko 2023-10-06T02:46:01.666 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 23561 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/xen-tpmfront.ko 2023-10-06T02:46:01.666 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/xillybus/ 2023-10-06T02:46:01.666 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16985 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/xillybus/xillybus_class.ko 2023-10-06T02:46:01.666 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 50945 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/xillybus/xillybus_core.ko 2023-10-06T02:46:01.667 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12393 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/xillybus/xillybus_pcie.ko 2023-10-06T02:46:01.667 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/clk/ 2023-10-06T02:46:01.667 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12489 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/clk/clk-palmas.ko 2023-10-06T02:46:01.667 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 47849 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/clk/clk-si5351.ko 2023-10-06T02:46:01.667 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11457 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/clk/clk-twl6040.ko 2023-10-06T02:46:01.667 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 19313 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/clk/clk-wm831x.ko 2023-10-06T02:46:01.667 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/ 2023-10-06T02:46:01.667 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10097 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-10-06T02:46:01.667 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16833 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/p4-clockmod.ko 2023-10-06T02:46:01.667 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 25297 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/speedstep-lib.ko 2023-10-06T02:46:01.667 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ 2023-10-06T02:46:01.667 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp/ 2023-10-06T02:46:01.668 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 70785 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-10-06T02:46:01.668 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 234473 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp/ccp.ko 2023-10-06T02:46:01.668 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/ 2023-10-06T02:46:01.669 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/ 2023-10-06T02:46:01.669 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_common/ 2023-10-06T02:46:01.669 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 408489 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-10-06T02:46:01.669 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2023-10-06T02:46:01.669 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 23657 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-10-06T02:46:01.669 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 19937 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/padlock-aes.ko 2023-10-06T02:46:01.669 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 21537 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/padlock-sha.ko 2023-10-06T02:46:01.669 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/virtio/ 2023-10-06T02:46:01.669 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 68937 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-10-06T02:46:01.669 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dca/ 2023-10-06T02:46:01.669 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 29785 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dca/dca.ko 2023-10-06T02:46:01.669 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/ 2023-10-06T02:46:01.670 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/dw/ 2023-10-06T02:46:01.670 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15857 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/dw/dw_dmac.ko 2023-10-06T02:46:01.670 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/ioat/ 2023-10-06T02:46:01.670 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 122641 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/ioat/ioatdma.ko 2023-10-06T02:46:01.670 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/ 2023-10-06T02:46:01.670 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 80273 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/amd64_edac.ko 2023-10-06T02:46:01.670 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 35769 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/e752x_edac.ko 2023-10-06T02:46:01.670 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 63617 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/edac_mce_amd.ko 2023-10-06T02:46:01.670 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 18105 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i3000_edac.ko 2023-10-06T02:46:01.670 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 18065 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i3200_edac.ko 2023-10-06T02:46:01.670 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 22537 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i5100_edac.ko 2023-10-06T02:46:01.671 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 25657 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i5400_edac.ko 2023-10-06T02:46:01.671 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 24913 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i7300_edac.ko 2023-10-06T02:46:01.671 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 52025 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i7core_edac.ko 2023-10-06T02:46:01.671 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 18433 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i82975x_edac.ko 2023-10-06T02:46:01.671 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 20017 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/ie31200_edac.ko 2023-10-06T02:46:01.671 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 56809 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/sb_edac.ko 2023-10-06T02:46:01.671 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17529 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/x38_edac.ko 2023-10-06T02:46:01.671 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/extcon/ 2023-10-06T02:46:01.671 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12673 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/extcon/extcon-gpio.ko 2023-10-06T02:46:01.671 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 27185 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/extcon/extcon-max14577.ko 2023-10-06T02:46:01.674 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 29569 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/extcon/extcon-max77693.ko 2023-10-06T02:46:01.674 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 24745 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/extcon/extcon-max8997.ko 2023-10-06T02:46:01.674 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 26537 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/extcon/extcon-palmas.ko 2023-10-06T02:46:01.674 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 23713 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/extcon/extcon-rt8973a.ko 2023-10-06T02:46:01.674 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 27785 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/extcon/extcon-sm5502.ko 2023-10-06T02:46:01.674 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware/ 2023-10-06T02:46:01.674 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 34953 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware/dmi-sysfs.ko 2023-10-06T02:46:01.674 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware/efi/ 2023-10-06T02:46:01.674 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15521 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware/efi/efi-pstore.ko 2023-10-06T02:46:01.675 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 20889 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware/iscsi_ibft.ko 2023-10-06T02:46:01.675 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/ 2023-10-06T02:46:01.675 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12305 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-adp5520.ko 2023-10-06T02:46:01.675 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 20153 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-amd8111.ko 2023-10-06T02:46:01.675 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14993 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-arizona.ko 2023-10-06T02:46:01.675 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13841 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-da9052.ko 2023-10-06T02:46:01.675 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11921 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-da9055.ko 2023-10-06T02:46:01.675 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 22065 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-dln2.ko 2023-10-06T02:46:01.676 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 77849 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-f7188x.ko 2023-10-06T02:46:01.676 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 28649 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-generic.ko 2023-10-06T02:46:01.676 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 19569 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-ich.ko 2023-10-06T02:46:01.676 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11969 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-janz-ttl.ko 2023-10-06T02:46:01.676 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14113 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-kempld.ko 2023-10-06T02:46:01.676 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12673 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-lp3943.ko 2023-10-06T02:46:01.676 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 9505 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-max7300.ko 2023-10-06T02:46:01.676 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11969 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-max730x.ko 2023-10-06T02:46:01.677 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 18577 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-max732x.ko 2023-10-06T02:46:01.677 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 25145 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-ml-ioh.ko 2023-10-06T02:46:01.677 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 46761 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-pca953x.ko 2023-10-06T02:46:01.677 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 26833 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-pcf857x.ko 2023-10-06T02:46:01.677 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14377 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-rdc321x.ko 2023-10-06T02:46:01.677 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 20593 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-sch.ko 2023-10-06T02:46:01.677 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 19505 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-sch311x.ko 2023-10-06T02:46:01.677 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12145 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-tps65912.ko 2023-10-06T02:46:01.677 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 21057 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-twl4030.ko 2023-10-06T02:46:01.677 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11425 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-twl6040.ko 2023-10-06T02:46:01.677 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 20601 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-viperboard.ko 2023-10-06T02:46:01.678 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15449 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-vx855.ko 2023-10-06T02:46:01.678 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16281 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-wm831x.ko 2023-10-06T02:46:01.678 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11617 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-wm8350.ko 2023-10-06T02:46:01.678 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16753 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-wm8994.ko 2023-10-06T02:46:01.678 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/ 2023-10-06T02:46:01.678 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11577 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-a4tech.ko 2023-10-06T02:46:01.678 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 39081 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-apple.ko 2023-10-06T02:46:01.678 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14481 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-appleir.ko 2023-10-06T02:46:01.678 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 8353 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-aureal.ko 2023-10-06T02:46:01.678 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15169 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-axff.ko 2023-10-06T02:46:01.678 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11049 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-belkin.ko 2023-10-06T02:46:01.679 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10313 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-cherry.ko 2023-10-06T02:46:01.679 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16041 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-chicony.ko 2023-10-06T02:46:01.679 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 59145 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-cp2112.ko 2023-10-06T02:46:01.679 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11049 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-cypress.ko 2023-10-06T02:46:01.679 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16385 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-dr.ko 2023-10-06T02:46:01.679 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10697 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-elecom.ko 2023-10-06T02:46:01.679 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17665 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-elo.ko 2023-10-06T02:46:01.679 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13457 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-emsff.ko 2023-10-06T02:46:01.679 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10105 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-ezkey.ko 2023-10-06T02:46:01.679 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14305 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gaff.ko 2023-10-06T02:46:01.679 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 9225 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-generic.ko 2023-10-06T02:46:01.680 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17129 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gt683r.ko 2023-10-06T02:46:01.680 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12681 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gyration.ko 2023-10-06T02:46:01.680 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 9881 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtek-kbd.ko 2023-10-06T02:46:01.680 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10457 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtek-mouse.ko 2023-10-06T02:46:01.680 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14449 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtekff.ko 2023-10-06T02:46:01.680 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 19105 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-hyperv.ko 2023-10-06T02:46:01.680 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10489 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-icade.ko 2023-10-06T02:46:01.680 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 9241 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-kensington.ko 2023-10-06T02:46:01.680 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 8545 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-keytouch.ko 2023-10-06T02:46:01.680 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17201 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-kye.ko 2023-10-06T02:46:01.680 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10809 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-lcpower.ko 2023-10-06T02:46:01.680 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 20497 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-led.ko 2023-10-06T02:46:01.681 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 42297 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-lenovo.ko 2023-10-06T02:46:01.681 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 30761 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-lg-g15.ko 2023-10-06T02:46:01.681 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 57809 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-logitech-dj.ko 2023-10-06T02:46:01.681 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 101009 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-10-06T02:46:01.681 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 80993 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-logitech.ko 2023-10-06T02:46:01.681 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 30801 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-magicmouse.ko 2023-10-06T02:46:01.681 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 21969 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-microsoft.ko 2023-10-06T02:46:01.681 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10361 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-monterey.ko 2023-10-06T02:46:01.681 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 50153 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-multitouch.ko 2023-10-06T02:46:01.681 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 32593 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-ntrig.ko 2023-10-06T02:46:01.681 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 8857 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-ortek.ko 2023-10-06T02:46:01.681 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 9121 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-penmount.ko 2023-10-06T02:46:01.682 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12289 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-petalynx.ko 2023-10-06T02:46:01.682 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 72937 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-picolcd.ko 2023-10-06T02:46:01.682 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14225 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-pl.ko 2023-10-06T02:46:01.682 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15105 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-plantronics.ko 2023-10-06T02:46:01.682 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 8417 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-primax.ko 2023-10-06T02:46:01.682 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 35457 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-rmi.ko 2023-10-06T02:46:01.682 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 20761 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-arvo.ko 2023-10-06T02:46:01.682 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14065 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-common.ko 2023-10-06T02:46:01.682 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 31361 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-isku.ko 2023-10-06T02:46:01.682 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 29657 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-kone.ko 2023-10-06T02:46:01.683 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 31065 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-10-06T02:46:01.683 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 21097 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-konepure.ko 2023-10-06T02:46:01.683 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 29417 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-10-06T02:46:01.683 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13305 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-lua.ko 2023-10-06T02:46:01.683 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 29241 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-pyra.ko 2023-10-06T02:46:01.683 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 27889 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-ryos.ko 2023-10-06T02:46:01.683 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 19473 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-savu.ko 2023-10-06T02:46:01.683 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 23393 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat.ko 2023-10-06T02:46:01.683 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13681 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-saitek.ko 2023-10-06T02:46:01.683 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15193 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-samsung.ko 2023-10-06T02:46:01.683 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 36801 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sensor-hub.ko 2023-10-06T02:46:01.683 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13601 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sjoy.ko 2023-10-06T02:46:01.683 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 51201 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sony.ko 2023-10-06T02:46:01.684 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 8313 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-speedlink.ko 2023-10-06T02:46:01.684 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14881 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-steelseries.ko 2023-10-06T02:46:01.684 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 9817 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sunplus.ko 2023-10-06T02:46:01.684 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16993 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-thrustmaster.ko 2023-10-06T02:46:01.684 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10537 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-tivo.ko 2023-10-06T02:46:01.684 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15089 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-tmff.ko 2023-10-06T02:46:01.684 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14385 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-topseed.ko 2023-10-06T02:46:01.684 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16473 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-twinhan.ko 2023-10-06T02:46:01.684 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 71457 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-uclogic.ko 2023-10-06T02:46:01.684 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10921 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-waltop.ko 2023-10-06T02:46:01.684 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 143585 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-wiimote.ko 2023-10-06T02:46:01.684 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 8153 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-xinmo.ko 2023-10-06T02:46:01.685 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13321 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-zpff.ko 2023-10-06T02:46:01.685 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16665 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-zydacron.ko 2023-10-06T02:46:01.685 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 267689 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid.ko 2023-10-06T02:46:01.685 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 32321 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/uhid.ko 2023-10-06T02:46:01.685 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/usbhid/ 2023-10-06T02:46:01.685 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 125721 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/usbhid/usbhid.ko 2023-10-06T02:46:01.685 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 19137 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/usbhid/usbkbd.ko 2023-10-06T02:46:01.685 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14953 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/usbhid/usbmouse.ko 2023-10-06T02:46:01.685 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 217401 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/wacom.ko 2023-10-06T02:46:01.685 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/ 2023-10-06T02:46:01.685 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 63497 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_balloon.ko 2023-10-06T02:46:01.685 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 89609 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_utils.ko 2023-10-06T02:46:01.686 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 301449 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_vmbus.ko 2023-10-06T02:46:01.686 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ 2023-10-06T02:46:01.686 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 66593 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/abituguru.ko 2023-10-06T02:46:01.686 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 61393 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/abituguru3.ko 2023-10-06T02:46:01.686 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 34745 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/acpi_power_meter.ko 2023-10-06T02:46:01.686 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17505 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ad7414.ko 2023-10-06T02:46:01.686 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 19313 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ad7418.ko 2023-10-06T02:46:01.686 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 25257 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adc128d818.ko 2023-10-06T02:46:01.686 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 31729 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1025.ko 2023-10-06T02:46:01.686 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 97977 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1026.ko 2023-10-06T02:46:01.686 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 19745 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1029.ko 2023-10-06T02:46:01.687 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 45553 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1031.ko 2023-10-06T02:46:01.687 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 26289 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm9240.ko 2023-10-06T02:46:01.687 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14769 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ads7828.ko 2023-10-06T02:46:01.687 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10769 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7410.ko 2023-10-06T02:46:01.687 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 22049 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7411.ko 2023-10-06T02:46:01.687 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 74433 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7462.ko 2023-10-06T02:46:01.687 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 39585 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7470.ko 2023-10-06T02:46:01.687 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 67929 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7475.ko 2023-10-06T02:46:01.687 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 19625 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7x10.ko 2023-10-06T02:46:01.687 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 39073 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/amc6821.ko 2023-10-06T02:46:01.687 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 55265 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/applesmc.ko 2023-10-06T02:46:01.687 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 49913 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asb100.ko 2023-10-06T02:46:01.687 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 58617 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asc7621.ko 2023-10-06T02:46:01.688 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 40881 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asus_atk0110.ko 2023-10-06T02:46:01.688 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17225 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/atxp1.ko 2023-10-06T02:46:01.688 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 28281 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/coretemp.ko 2023-10-06T02:46:01.688 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 24657 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/da9052-hwmon.ko 2023-10-06T02:46:01.688 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17265 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/da9055-hwmon.ko 2023-10-06T02:46:01.688 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 44465 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-10-06T02:46:01.688 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 99601 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/dme1737.ko 2023-10-06T02:46:01.688 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 19489 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ds1621.ko 2023-10-06T02:46:01.688 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15321 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ds620.ko 2023-10-06T02:46:01.688 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 29777 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/emc1403.ko 2023-10-06T02:46:01.688 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 33185 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/emc2103.ko 2023-10-06T02:46:01.688 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 30321 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/emc6w201.ko 2023-10-06T02:46:01.689 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 66985 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f71805f.ko 2023-10-06T02:46:01.689 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 94457 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f71882fg.ko 2023-10-06T02:46:01.689 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 41401 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f75375s.ko 2023-10-06T02:46:01.689 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 21305 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/fam15h_power.ko 2023-10-06T02:46:01.689 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 55433 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/fschmd.ko 2023-10-06T02:46:01.689 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14481 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/g760a.ko 2023-10-06T02:46:01.689 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 24017 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/g762.ko 2023-10-06T02:46:01.689 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 46801 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/gl518sm.ko 2023-10-06T02:46:01.689 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 45529 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/gl520sm.ko 2023-10-06T02:46:01.689 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13273 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/hih6130.ko 2023-10-06T02:46:01.689 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 9745 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/hwmon-vid.ko 2023-10-06T02:46:01.689 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11553 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/i5500_temp.ko 2023-10-06T02:46:01.690 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 22601 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/i5k_amb.ko 2023-10-06T02:46:01.690 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 34505 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ibmaem.ko 2023-10-06T02:46:01.690 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 21297 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ibmpex.ko 2023-10-06T02:46:01.690 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 24873 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ina209.ko 2023-10-06T02:46:01.690 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13401 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ina2xx.ko 2023-10-06T02:46:01.690 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 129217 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/it87.ko 2023-10-06T02:46:01.690 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 18841 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/jc42.ko 2023-10-06T02:46:01.690 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 24025 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/k10temp.ko 2023-10-06T02:46:01.690 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13553 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/k8temp.ko 2023-10-06T02:46:01.690 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 18929 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lineage-pem.ko 2023-10-06T02:46:01.691 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 48601 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm63.ko 2023-10-06T02:46:01.691 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16761 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm73.ko 2023-10-06T02:46:01.691 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 36777 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm75.ko 2023-10-06T02:46:01.691 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 19537 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm77.ko 2023-10-06T02:46:01.691 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 34657 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm78.ko 2023-10-06T02:46:01.691 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 31745 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm80.ko 2023-10-06T02:46:01.691 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16889 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm83.ko 2023-10-06T02:46:01.691 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 72833 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm85.ko 2023-10-06T02:46:01.691 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 46153 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm87.ko 2023-10-06T02:46:01.691 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 37913 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm90.ko 2023-10-06T02:46:01.691 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 19745 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm92.ko 2023-10-06T02:46:01.692 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 108841 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm93.ko 2023-10-06T02:46:01.692 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 33393 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95234.ko 2023-10-06T02:46:01.692 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16265 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95241.ko 2023-10-06T02:46:01.692 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 18113 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95245.ko 2023-10-06T02:46:01.692 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 24017 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc2945.ko 2023-10-06T02:46:01.692 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13793 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4151.ko 2023-10-06T02:46:01.692 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15193 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4215.ko 2023-10-06T02:46:01.692 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14953 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4222.ko 2023-10-06T02:46:01.692 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14825 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4245.ko 2023-10-06T02:46:01.692 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13249 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4260.ko 2023-10-06T02:46:01.692 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14993 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4261.ko 2023-10-06T02:46:01.692 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 33489 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max16065.ko 2023-10-06T02:46:01.693 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 18433 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max1619.ko 2023-10-06T02:46:01.693 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 24353 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max1668.ko 2023-10-06T02:46:01.693 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 19969 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max197.ko 2023-10-06T02:46:01.693 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 26617 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6639.ko 2023-10-06T02:46:01.693 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 23321 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6650.ko 2023-10-06T02:46:01.693 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 35777 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6697.ko 2023-10-06T02:46:01.693 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 18585 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/mc13783-adc.ko 2023-10-06T02:46:01.693 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10585 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/mcp3021.ko 2023-10-06T02:46:01.693 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15937 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2023-10-06T02:46:01.693 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 44129 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6683.ko 2023-10-06T02:46:01.694 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 116697 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6775-core.ko 2023-10-06T02:46:01.694 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 60705 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6775.ko 2023-10-06T02:46:01.694 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 59737 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct7802.ko 2023-10-06T02:46:01.694 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 82337 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pc87360.ko 2023-10-06T02:46:01.694 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 54433 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pc87427.ko 2023-10-06T02:46:01.694 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 18473 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pcf8591.ko 2023-10-06T02:46:01.695 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ 2023-10-06T02:46:01.695 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 21353 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-10-06T02:46:01.697 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17065 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-10-06T02:46:01.697 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 28329 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-10-06T02:46:01.697 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 9577 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max16064.ko 2023-10-06T02:46:01.697 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17657 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max34440.ko 2023-10-06T02:46:01.698 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10169 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max8688.ko 2023-10-06T02:46:01.698 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15505 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-10-06T02:46:01.700 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 81841 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-10-06T02:46:01.700 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 8729 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-10-06T02:46:01.701 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 30729 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-10-06T02:46:01.701 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15073 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-10-06T02:46:01.701 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 20681 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-10-06T02:46:01.701 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13017 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/powr1220.ko 2023-10-06T02:46:01.701 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 18705 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch5627.ko 2023-10-06T02:46:01.701 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 28817 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch5636.ko 2023-10-06T02:46:01.701 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 27145 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch56xx-common.ko 2023-10-06T02:46:01.701 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 32137 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sht15.ko 2023-10-06T02:46:01.701 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13505 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sht21.ko 2023-10-06T02:46:01.701 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16833 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/shtc1.ko 2023-10-06T02:46:01.701 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 40105 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sis5595.ko 2023-10-06T02:46:01.702 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 31929 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smm665.ko 2023-10-06T02:46:01.702 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 19577 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47b397.ko 2023-10-06T02:46:01.702 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 39193 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47m1.ko 2023-10-06T02:46:01.702 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 37385 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47m192.ko 2023-10-06T02:46:01.702 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 26553 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/thmc50.ko 2023-10-06T02:46:01.702 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17057 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp102.ko 2023-10-06T02:46:01.702 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14097 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp103.ko 2023-10-06T02:46:01.702 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 21257 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp401.ko 2023-10-06T02:46:01.702 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 19537 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp421.ko 2023-10-06T02:46:01.702 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 19697 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/via-cputemp.ko 2023-10-06T02:46:01.702 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 41945 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/via686a.ko 2023-10-06T02:46:01.703 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 52457 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/vt1211.ko 2023-10-06T02:46:01.703 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 51545 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/vt8231.ko 2023-10-06T02:46:01.703 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 57513 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83627ehf.ko 2023-10-06T02:46:01.703 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 78873 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83627hf.ko 2023-10-06T02:46:01.703 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 71345 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83781d.ko 2023-10-06T02:46:01.703 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 63289 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83791d.ko 2023-10-06T02:46:01.703 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 71321 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83792d.ko 2023-10-06T02:46:01.703 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 101457 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83793.ko 2023-10-06T02:46:01.703 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 119505 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83795.ko 2023-10-06T02:46:01.703 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17313 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83l785ts.ko 2023-10-06T02:46:01.703 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 35625 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83l786ng.ko 2023-10-06T02:46:01.703 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13825 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/wm831x-hwmon.ko 2023-10-06T02:46:01.704 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10625 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/wm8350-hwmon.ko 2023-10-06T02:46:01.705 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/ 2023-10-06T02:46:01.705 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos/ 2023-10-06T02:46:01.705 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 20049 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-10-06T02:46:01.705 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 19345 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-10-06T02:46:01.705 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/ 2023-10-06T02:46:01.706 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 27969 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-ali1535.ko 2023-10-06T02:46:01.706 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 28801 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-ali1563.ko 2023-10-06T02:46:01.706 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 27777 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2023-10-06T02:46:01.706 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17937 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-10-06T02:46:01.706 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 26193 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-10-06T02:46:01.706 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16201 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-10-06T02:46:01.706 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15153 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2023-10-06T02:46:01.707 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 6929 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-10-06T02:46:01.707 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13961 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2023-10-06T02:46:01.707 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 48641 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-10-06T02:46:01.707 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 23905 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-10-06T02:46:01.707 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 20001 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-10-06T02:46:01.707 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17337 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-10-06T02:46:01.707 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12393 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-dln2.ko 2023-10-06T02:46:01.707 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17585 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-gpio.ko 2023-10-06T02:46:01.707 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 62729 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-i801.ko 2023-10-06T02:46:01.707 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 22433 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-isch.ko 2023-10-06T02:46:01.708 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 47889 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-10-06T02:46:01.708 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17369 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-kempld.ko 2023-10-06T02:46:01.708 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17881 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-10-06T02:46:01.708 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 22337 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-10-06T02:46:01.708 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 26329 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-ocores.ko 2023-10-06T02:46:01.708 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 25121 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-parport.ko 2023-10-06T02:46:01.708 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16497 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-10-06T02:46:01.708 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 47241 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-10-06T02:46:01.708 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15289 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2023-10-06T02:46:01.708 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 18649 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-10-06T02:46:01.708 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11809 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-10-06T02:46:01.709 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 22313 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-sis5595.ko 2023-10-06T02:46:01.709 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 29361 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-sis630.ko 2023-10-06T02:46:01.709 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 20329 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-10-06T02:46:01.709 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 19241 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2023-10-06T02:46:01.709 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 19809 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-10-06T02:46:01.709 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13801 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-via.ko 2023-10-06T02:46:01.709 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 26081 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-10-06T02:46:01.709 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 19041 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-10-06T02:46:01.709 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 47593 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-xiic.ko 2023-10-06T02:46:01.709 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 22385 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-mux.ko 2023-10-06T02:46:01.709 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 18825 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-smbus.ko 2023-10-06T02:46:01.710 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 27065 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-stub.ko 2023-10-06T02:46:01.710 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/muxes/ 2023-10-06T02:46:01.710 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14785 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2023-10-06T02:46:01.710 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13457 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2023-10-06T02:46:01.710 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 26865 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2023-10-06T02:46:01.710 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ 2023-10-06T02:46:01.710 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ 2023-10-06T02:46:01.710 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 273641 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_cm.ko 2023-10-06T02:46:01.710 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 876913 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_core.ko 2023-10-06T02:46:01.710 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 69321 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_umad.ko 2023-10-06T02:46:01.710 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 324145 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-10-06T02:46:01.711 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 97961 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/iw_cm.ko 2023-10-06T02:46:01.711 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 279345 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/rdma_cm.ko 2023-10-06T02:46:01.711 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 66177 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-10-06T02:46:01.711 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/ 2023-10-06T02:46:01.711 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/cxgb4/ 2023-10-06T02:46:01.711 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 492569 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-10-06T02:46:01.711 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx4/ 2023-10-06T02:46:01.711 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 419193 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-10-06T02:46:01.711 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx5/ 2023-10-06T02:46:01.711 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 739705 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-10-06T02:46:01.711 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mthca/ 2023-10-06T02:46:01.712 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 296649 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-10-06T02:46:01.712 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/ocrdma/ 2023-10-06T02:46:01.712 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 153681 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2023-10-06T02:46:01.712 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/usnic/ 2023-10-06T02:46:01.712 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 169017 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2023-10-06T02:46:01.712 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/ 2023-10-06T02:46:01.712 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/ipoib/ 2023-10-06T02:46:01.712 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 263177 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-10-06T02:46:01.712 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/iser/ 2023-10-06T02:46:01.712 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 100225 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-10-06T02:46:01.713 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/isert/ 2023-10-06T02:46:01.713 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 111993 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-10-06T02:46:01.713 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srp/ 2023-10-06T02:46:01.713 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 129081 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-10-06T02:46:01.713 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srpt/ 2023-10-06T02:46:01.713 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 129553 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-10-06T02:46:01.713 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/ 2023-10-06T02:46:01.713 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10745 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/evbug.ko 2023-10-06T02:46:01.713 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 24129 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/ff-memless.ko 2023-10-06T02:46:01.714 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/ 2023-10-06T02:46:01.714 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11881 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-10-06T02:46:01.714 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12145 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/fm801-gp.ko 2023-10-06T02:46:01.714 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 41217 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/gameport.ko 2023-10-06T02:46:01.714 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12497 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/lightning.ko 2023-10-06T02:46:01.714 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17529 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/ns558.ko 2023-10-06T02:46:01.714 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 41825 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/joydev.ko 2023-10-06T02:46:01.714 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/ 2023-10-06T02:46:01.714 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13313 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/adp5520-keys.ko 2023-10-06T02:46:01.715 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 30441 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/adp5588-keys.ko 2023-10-06T02:46:01.715 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 26905 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/adp5589-keys.ko 2023-10-06T02:46:01.715 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 24761 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2023-10-06T02:46:01.715 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 36649 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/gpio_keys.ko 2023-10-06T02:46:01.715 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 18273 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2023-10-06T02:46:01.715 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 21257 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/lkkbd.ko 2023-10-06T02:46:01.715 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 28121 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/lm8323.ko 2023-10-06T02:46:01.715 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15113 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/lm8333.ko 2023-10-06T02:46:01.716 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 24265 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/matrix_keypad.ko 2023-10-06T02:46:01.716 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 18217 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/max7359_keypad.ko 2023-10-06T02:46:01.716 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15897 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/mcs_touchkey.ko 2023-10-06T02:46:01.716 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16489 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2023-10-06T02:46:01.716 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11585 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/newtonkbd.ko 2023-10-06T02:46:01.716 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11073 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/opencores-kbd.ko 2023-10-06T02:46:01.716 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15209 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/qt1070.ko 2023-10-06T02:46:01.716 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 21121 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/qt2160.ko 2023-10-06T02:46:01.717 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 23817 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/samsung-keypad.ko 2023-10-06T02:46:01.717 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11481 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/stowaway.ko 2023-10-06T02:46:01.717 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 18289 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/sunkbd.ko 2023-10-06T02:46:01.717 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 20729 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/tca6416-keypad.ko 2023-10-06T02:46:01.717 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16177 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/tca8418_keypad.ko 2023-10-06T02:46:01.717 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16801 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/twl4030_keypad.ko 2023-10-06T02:46:01.717 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11753 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/xtkbd.ko 2023-10-06T02:46:01.717 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11465 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/matrix-keymap.ko 2023-10-06T02:46:01.717 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/ 2023-10-06T02:46:01.718 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 34329 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/appletouch.ko 2023-10-06T02:46:01.718 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 34177 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/bcm5974.ko 2023-10-06T02:46:01.718 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 123681 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/cyapatp.ko 2023-10-06T02:46:01.718 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 89449 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/elan_i2c.ko 2023-10-06T02:46:01.718 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14025 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/gpio_mouse.ko 2023-10-06T02:46:01.718 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 335849 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/psmouse.ko 2023-10-06T02:46:01.718 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14681 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/sermouse.ko 2023-10-06T02:46:01.718 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 23881 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-10-06T02:46:01.718 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 22569 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/synaptics_usb.ko 2023-10-06T02:46:01.719 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15665 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/vsxxxaa.ko 2023-10-06T02:46:01.719 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/rmi4/ 2023-10-06T02:46:01.719 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 109849 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/rmi4/rmi_core.ko 2023-10-06T02:46:01.719 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/ 2023-10-06T02:46:01.719 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11665 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/altera_ps2.ko 2023-10-06T02:46:01.719 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16289 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/arc_ps2.ko 2023-10-06T02:46:01.719 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16425 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/ct82c710.ko 2023-10-06T02:46:01.719 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16953 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-10-06T02:46:01.719 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15833 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/parkbd.ko 2023-10-06T02:46:01.720 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13225 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/pcips2.ko 2023-10-06T02:46:01.720 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 20153 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/ps2mult.ko 2023-10-06T02:46:01.720 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 24129 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/serio_raw.ko 2023-10-06T02:46:01.720 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17977 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/serport.ko 2023-10-06T02:46:01.720 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13337 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/sparse-keymap.ko 2023-10-06T02:46:01.720 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu/ 2023-10-06T02:46:01.720 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu/amd/ 2023-10-06T02:46:01.720 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 38857 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu/amd/iommu_v2.ko 2023-10-06T02:46:01.720 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/ 2023-10-06T02:46:01.721 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13817 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-88pm860x.ko 2023-10-06T02:46:01.721 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11385 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-adp5520.ko 2023-10-06T02:46:01.721 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 59753 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-bd2802.ko 2023-10-06T02:46:01.721 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 24785 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-blinkm.ko 2023-10-06T02:46:01.721 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10473 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-da903x.ko 2023-10-06T02:46:01.721 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12241 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-da9052.ko 2023-10-06T02:46:01.721 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16561 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-gpio.ko 2023-10-06T02:46:01.721 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15793 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-lm3530.ko 2023-10-06T02:46:01.721 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 30505 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-lm3533.ko 2023-10-06T02:46:01.721 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 19353 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-lm355x.ko 2023-10-06T02:46:01.722 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 19961 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-lm3642.ko 2023-10-06T02:46:01.722 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16241 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-lp3944.ko 2023-10-06T02:46:01.722 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11233 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-lp8788.ko 2023-10-06T02:46:01.722 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14929 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-max8997.ko 2023-10-06T02:46:01.722 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12609 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-mc13783.ko 2023-10-06T02:46:01.722 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13385 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-menf21bmc.ko 2023-10-06T02:46:01.722 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 20721 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-pca9532.ko 2023-10-06T02:46:01.722 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 20481 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-pca955x.ko 2023-10-06T02:46:01.722 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17857 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-pca963x.ko 2023-10-06T02:46:01.723 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 34433 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-ss4200.ko 2023-10-06T02:46:01.723 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 24865 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-tca6507.ko 2023-10-06T02:46:01.723 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15665 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-wm831x-status.ko 2023-10-06T02:46:01.723 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11841 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-wm8350.ko 2023-10-06T02:46:01.723 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ 2023-10-06T02:46:01.723 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10049 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-10-06T02:46:01.723 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10873 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-10-06T02:46:01.723 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 9089 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-10-06T02:46:01.723 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 7617 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-10-06T02:46:01.723 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14249 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-10-06T02:46:01.723 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14073 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-10-06T02:46:01.723 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11889 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-10-06T02:46:01.724 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14073 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-10-06T02:46:01.724 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/ 2023-10-06T02:46:01.724 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/bcache/ 2023-10-06T02:46:01.724 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 655473 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/bcache/bcache.ko 2023-10-06T02:46:01.724 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 40569 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-bio-prison.ko 2023-10-06T02:46:01.724 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 89601 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-bufio.ko 2023-10-06T02:46:01.724 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 47529 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-cache-smq.ko 2023-10-06T02:46:01.724 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 155993 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-cache.ko 2023-10-06T02:46:01.724 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 107049 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-crypt.ko 2023-10-06T02:46:01.724 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 21521 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-delay.ko 2023-10-06T02:46:01.724 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 53897 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-era.ko 2023-10-06T02:46:01.725 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 28529 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-flakey.ko 2023-10-06T02:46:01.725 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 41593 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-log-userspace.ko 2023-10-06T02:46:01.725 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 32721 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-log.ko 2023-10-06T02:46:01.725 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 49545 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-mirror.ko 2023-10-06T02:46:01.725 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 78017 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-multipath.ko 2023-10-06T02:46:01.725 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16457 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-queue-length.ko 2023-10-06T02:46:01.725 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 70953 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-raid.ko 2023-10-06T02:46:01.725 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 36273 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-region-hash.ko 2023-10-06T02:46:01.725 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15857 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-round-robin.ko 2023-10-06T02:46:01.725 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16785 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-service-time.ko 2023-10-06T02:46:01.725 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 109593 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-snapshot.ko 2023-10-06T02:46:01.725 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 19361 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-switch.ko 2023-10-06T02:46:01.726 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 181585 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-thin-pool.ko 2023-10-06T02:46:01.726 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 51737 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-verity.ko 2023-10-06T02:46:01.726 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 8441 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-zero.ko 2023-10-06T02:46:01.726 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15105 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/faulty.ko 2023-10-06T02:46:01.726 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 19433 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/linear.ko 2023-10-06T02:46:01.726 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 32305 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/multipath.ko 2023-10-06T02:46:01.726 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/persistent-data/ 2023-10-06T02:46:01.726 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 199937 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-10-06T02:46:01.726 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 37321 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid0.ko 2023-10-06T02:46:01.726 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 112609 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid1.ko 2023-10-06T02:46:01.726 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 160553 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid10.ko 2023-10-06T02:46:01.727 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 396153 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid456.ko 2023-10-06T02:46:01.871 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/ 2023-10-06T02:46:01.871 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/ 2023-10-06T02:46:01.872 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 178113 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptbase.ko 2023-10-06T02:46:01.872 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 63385 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptctl.ko 2023-10-06T02:46:01.872 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 44649 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptfc.ko 2023-10-06T02:46:01.872 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 37161 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptlan.ko 2023-10-06T02:46:01.872 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 123353 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptsas.ko 2023-10-06T02:46:01.872 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 79017 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptscsih.ko 2023-10-06T02:46:01.872 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 53081 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptspi.ko 2023-10-06T02:46:01.872 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/ 2023-10-06T02:46:01.872 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17305 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/88pm800.ko 2023-10-06T02:46:01.872 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12761 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/88pm805.ko 2023-10-06T02:46:01.872 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11193 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/88pm80x.ko 2023-10-06T02:46:01.873 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11865 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/arizona-i2c.ko 2023-10-06T02:46:01.873 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 123721 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/arizona.ko 2023-10-06T02:46:01.873 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11961 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/bcm590xx.ko 2023-10-06T02:46:01.873 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17465 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/cros_ec_dev.ko 2023-10-06T02:46:01.873 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 34993 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/dln2.ko 2023-10-06T02:46:01.873 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16689 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/janz-cmodio.ko 2023-10-06T02:46:01.873 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 53585 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/kempld-core.ko 2023-10-06T02:46:01.873 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 27529 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/lm3533-core.ko 2023-10-06T02:46:01.873 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14993 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/lm3533-ctrlbank.ko 2023-10-06T02:46:01.873 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13009 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/lp3943.ko 2023-10-06T02:46:01.873 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 54569 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/lpc_ich.ko 2023-10-06T02:46:01.873 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12113 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/lpc_sch.ko 2023-10-06T02:46:01.874 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17409 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/max8907.ko 2023-10-06T02:46:01.874 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 29857 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/mc13xxx-core.ko 2023-10-06T02:46:01.874 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11809 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/mc13xxx-i2c.ko 2023-10-06T02:46:01.874 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11593 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/menf21bmc.ko 2023-10-06T02:46:01.874 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17329 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/pcf50633-adc.ko 2023-10-06T02:46:01.874 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 9153 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/pcf50633-gpio.ko 2023-10-06T02:46:01.874 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 34873 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/pcf50633.ko 2023-10-06T02:46:01.874 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10105 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/rdc321x-southbridge.ko 2023-10-06T02:46:01.874 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 20289 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/retu-mfd.ko 2023-10-06T02:46:01.874 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 80425 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/si476x-core.ko 2023-10-06T02:46:01.874 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 48441 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/sm501.ko 2023-10-06T02:46:01.875 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 19825 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/ti_am335x_tscadc.ko 2023-10-06T02:46:01.875 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 51137 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/tps65010.ko 2023-10-06T02:46:01.875 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10417 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/tps6507x.ko 2023-10-06T02:46:01.875 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13329 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/viperboard.ko 2023-10-06T02:46:01.875 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10537 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/vx855.ko 2023-10-06T02:46:01.875 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17953 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/wl1273-core.ko 2023-10-06T02:46:01.875 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 44345 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/wm8994.ko 2023-10-06T02:46:01.875 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/ 2023-10-06T02:46:01.875 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13833 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/ad525x_dpot-i2c.ko 2023-10-06T02:46:01.876 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 48489 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/ad525x_dpot.ko 2023-10-06T02:46:01.876 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/altera-stapl/ 2023-10-06T02:46:01.876 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 46585 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-10-06T02:46:01.876 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 18393 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/apds9802als.ko 2023-10-06T02:46:01.876 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 36729 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/apds990x.ko 2023-10-06T02:46:01.876 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 45593 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/bh1770glc.ko 2023-10-06T02:46:01.876 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/c2port/ 2023-10-06T02:46:01.876 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11145 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2023-10-06T02:46:01.877 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 35305 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/c2port/core.ko 2023-10-06T02:46:01.877 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/cb710/ 2023-10-06T02:46:01.877 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 25161 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/cb710/cb710.ko 2023-10-06T02:46:01.877 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17801 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/ds1682.ko 2023-10-06T02:46:01.877 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 8897 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/dummy-irq.ko 2023-10-06T02:46:01.877 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/echo/ 2023-10-06T02:46:01.877 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13657 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/echo/echo.ko 2023-10-06T02:46:01.877 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/ 2023-10-06T02:46:01.877 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 37849 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/at24.ko 2023-10-06T02:46:01.877 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14321 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/eeprom.ko 2023-10-06T02:46:01.877 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14769 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-10-06T02:46:01.878 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13537 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/max6875.ko 2023-10-06T02:46:01.878 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 32993 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/enclosure.ko 2023-10-06T02:46:01.878 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/genwqe/ 2023-10-06T02:46:01.878 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 152137 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/genwqe/genwqe_card.ko 2023-10-06T02:46:01.878 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14129 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/hmc6352.ko 2023-10-06T02:46:01.878 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 31193 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/hpilo.ko 2023-10-06T02:46:01.878 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/ibmasm/ 2023-10-06T02:46:01.878 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 72601 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/ibmasm/ibmasm.ko 2023-10-06T02:46:01.878 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 19785 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/ics932s401.ko 2023-10-06T02:46:01.879 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 21681 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/isl29003.ko 2023-10-06T02:46:01.879 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15753 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/isl29020.ko 2023-10-06T02:46:01.879 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d/ 2023-10-06T02:46:01.879 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 42585 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-10-06T02:46:01.879 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13857 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-10-06T02:46:01.879 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/ 2023-10-06T02:46:01.879 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 125209 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei-me.ko 2023-10-06T02:46:01.879 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 56521 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei-txe.ko 2023-10-06T02:46:01.879 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 309857 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei.ko 2023-10-06T02:46:01.879 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 31329 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/phantom.ko 2023-10-06T02:46:01.880 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/ti-st/ 2023-10-06T02:46:01.880 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 74905 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/ti-st/st_drv.ko 2023-10-06T02:46:01.880 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 24305 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tifm_7xx1.ko 2023-10-06T02:46:01.880 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 28873 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tifm_core.ko 2023-10-06T02:46:01.880 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 18729 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tsl2550.ko 2023-10-06T02:46:01.880 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 48673 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_balloon.ko 2023-10-06T02:46:01.880 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_vmci/ 2023-10-06T02:46:01.880 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 183857 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-10-06T02:46:01.880 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ 2023-10-06T02:46:01.880 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/bonding/ 2023-10-06T02:46:01.880 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 487865 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/bonding/bonding.ko 2023-10-06T02:46:01.881 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/ 2023-10-06T02:46:01.881 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/b53/ 2023-10-06T02:46:01.881 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 106009 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/b53/b53_common.ko 2023-10-06T02:46:01.881 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 40281 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/bcm-sf2.ko 2023-10-06T02:46:01.881 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14689 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6060.ko 2023-10-06T02:46:01.881 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6xxx/ 2023-10-06T02:46:01.881 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 452681 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-10-06T02:46:01.881 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16929 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dummy.ko 2023-10-06T02:46:01.881 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17945 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/eql.ko 2023-10-06T02:46:01.881 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ 2023-10-06T02:46:01.881 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/ 2023-10-06T02:46:01.882 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 45785 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-10-06T02:46:01.882 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 42105 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-10-06T02:46:01.882 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 130489 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-10-06T02:46:01.882 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 68785 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-10-06T02:46:01.882 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/ 2023-10-06T02:46:01.882 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 37649 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/8390.ko 2023-10-06T02:46:01.882 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 59689 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-10-06T02:46:01.882 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 27193 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-10-06T02:46:01.882 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 99113 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-10-06T02:46:01.882 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/adaptec/ 2023-10-06T02:46:01.882 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 54521 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-10-06T02:46:01.883 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/agere/ 2023-10-06T02:46:01.883 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 69145 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/agere/et131x.ko 2023-10-06T02:46:01.883 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/alteon/ 2023-10-06T02:46:01.883 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 59521 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-10-06T02:46:01.883 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/altera/ 2023-10-06T02:46:01.883 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 41393 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-10-06T02:46:01.883 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/ 2023-10-06T02:46:01.883 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 54545 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-10-06T02:46:01.883 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 49225 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-10-06T02:46:01.883 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 87345 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-10-06T02:46:01.883 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/ 2023-10-06T02:46:01.883 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/alx/ 2023-10-06T02:46:01.884 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 97321 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-10-06T02:46:01.884 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1c/ 2023-10-06T02:46:01.884 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 104609 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-10-06T02:46:01.884 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1e/ 2023-10-06T02:46:01.884 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 90257 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-10-06T02:46:01.884 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx/ 2023-10-06T02:46:01.884 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 81505 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-10-06T02:46:01.884 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 69713 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-10-06T02:46:01.884 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/ 2023-10-06T02:46:01.884 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 78401 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-10-06T02:46:01.884 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 176881 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-10-06T02:46:01.884 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2023-10-06T02:46:01.885 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 1422209 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-10-06T02:46:01.885 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 128377 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-10-06T02:46:01.885 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/genet/ 2023-10-06T02:46:01.885 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 132289 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-10-06T02:46:01.885 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 312145 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-10-06T02:46:01.885 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade/ 2023-10-06T02:46:01.885 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade/bna/ 2023-10-06T02:46:01.885 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 323553 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-10-06T02:46:01.885 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/ 2023-10-06T02:46:01.885 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb/ 2023-10-06T02:46:01.885 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 193433 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-10-06T02:46:01.886 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2023-10-06T02:46:01.886 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 347641 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-10-06T02:46:01.886 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2023-10-06T02:46:01.886 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 1044145 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-10-06T02:46:01.886 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2023-10-06T02:46:01.886 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 166113 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-10-06T02:46:01.886 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2023-10-06T02:46:01.886 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 34881 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-10-06T02:46:01.886 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco/ 2023-10-06T02:46:01.886 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco/enic/ 2023-10-06T02:46:01.887 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 204329 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-10-06T02:46:01.887 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/ 2023-10-06T02:46:01.887 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/ 2023-10-06T02:46:01.887 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 69449 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-10-06T02:46:01.887 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 61489 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-10-06T02:46:01.887 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 141161 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-10-06T02:46:01.887 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 51433 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-10-06T02:46:01.887 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 62865 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-10-06T02:46:01.887 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 31305 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-10-06T02:46:01.887 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink/ 2023-10-06T02:46:01.887 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 60873 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-10-06T02:46:01.888 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 62833 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-10-06T02:46:01.888 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 45721 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dnet.ko 2023-10-06T02:46:01.888 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 25233 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ec_bhf.ko 2023-10-06T02:46:01.888 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex/ 2023-10-06T02:46:01.888 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex/benet/ 2023-10-06T02:46:01.888 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 281329 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-10-06T02:46:01.888 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 49505 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ethoc.ko 2023-10-06T02:46:01.888 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 51737 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/fealnx.ko 2023-10-06T02:46:01.888 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/fujitsu/ 2023-10-06T02:46:01.888 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 45281 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2023-10-06T02:46:01.888 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ 2023-10-06T02:46:01.889 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 90465 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e100.ko 2023-10-06T02:46:01.889 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000/ 2023-10-06T02:46:01.889 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 295713 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-10-06T02:46:01.889 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000e/ 2023-10-06T02:46:01.889 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 584249 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-10-06T02:46:01.889 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/fm10k/ 2023-10-06T02:46:01.889 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 246321 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-10-06T02:46:01.889 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/i40e/ 2023-10-06T02:46:01.889 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 924017 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-10-06T02:46:01.889 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/iavf/ 2023-10-06T02:46:01.890 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 302577 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-10-06T02:46:01.890 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igb/ 2023-10-06T02:46:01.890 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 514889 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-10-06T02:46:01.890 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igbvf/ 2023-10-06T02:46:01.890 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 93593 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-10-06T02:46:01.890 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbe/ 2023-10-06T02:46:01.890 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 734297 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-10-06T02:46:01.890 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbevf/ 2023-10-06T02:46:01.890 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 151841 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-10-06T02:46:01.890 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 86921 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/jme.ko 2023-10-06T02:46:01.891 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/ 2023-10-06T02:46:01.891 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 20977 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-10-06T02:46:01.891 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 102385 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/skge.ko 2023-10-06T02:46:01.891 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 122681 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-10-06T02:46:01.891 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/ 2023-10-06T02:46:01.891 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4/ 2023-10-06T02:46:01.891 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 727433 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-10-06T02:46:01.891 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 280513 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-10-06T02:46:01.891 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5/ 2023-10-06T02:46:01.891 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2023-10-06T02:46:01.892 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 1097537 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-10-06T02:46:01.892 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/micrel/ 2023-10-06T02:46:01.892 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 53041 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/micrel/ks8842.ko 2023-10-06T02:46:01.892 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 40993 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2023-10-06T02:46:01.892 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 19489 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2023-10-06T02:46:01.892 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 95665 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-10-06T02:46:01.892 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom/ 2023-10-06T02:46:01.892 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom/myri10ge/ 2023-10-06T02:46:01.892 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 108809 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-10-06T02:46:01.892 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi/ 2023-10-06T02:46:01.893 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 73377 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-10-06T02:46:01.893 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 47713 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-10-06T02:46:01.893 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/neterion/ 2023-10-06T02:46:01.893 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 150905 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-10-06T02:46:01.893 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/nvidia/ 2023-10-06T02:46:01.893 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 136785 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-10-06T02:46:01.893 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines/ 2023-10-06T02:46:01.893 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 50481 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-10-06T02:46:01.893 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 43145 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-10-06T02:46:01.893 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/ 2023-10-06T02:46:01.893 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/netxen/ 2023-10-06T02:46:01.894 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 227113 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-10-06T02:46:01.894 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 87081 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-10-06T02:46:01.894 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2023-10-06T02:46:01.894 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 671393 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-10-06T02:46:01.894 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rdc/ 2023-10-06T02:46:01.894 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 43017 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-10-06T02:46:01.894 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/ 2023-10-06T02:46:01.894 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 67385 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-10-06T02:46:01.894 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 83921 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-10-06T02:46:01.894 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 29321 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/atp.ko 2023-10-06T02:46:01.894 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 189817 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-10-06T02:46:01.895 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/samsung/ 2023-10-06T02:46:01.895 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/samsung/sxgbe/ 2023-10-06T02:46:01.895 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 104241 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2023-10-06T02:46:01.895 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sfc/ 2023-10-06T02:46:01.895 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 952929 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-10-06T02:46:01.895 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/silan/ 2023-10-06T02:46:01.895 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 47177 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-10-06T02:46:01.895 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis/ 2023-10-06T02:46:01.895 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 54809 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis/sis190.ko 2023-10-06T02:46:01.895 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 63273 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis/sis900.ko 2023-10-06T02:46:01.895 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/ 2023-10-06T02:46:01.896 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 61537 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-10-06T02:46:01.896 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 67129 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-10-06T02:46:01.896 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 73345 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-10-06T02:46:01.896 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 68209 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-10-06T02:46:01.896 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/ 2023-10-06T02:46:01.896 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac/ 2023-10-06T02:46:01.896 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13441 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2023-10-06T02:46:01.896 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 40137 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-10-06T02:46:01.896 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 20769 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2023-10-06T02:46:01.896 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 481681 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-10-06T02:46:01.897 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/ 2023-10-06T02:46:01.897 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 103321 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/cassini.ko 2023-10-06T02:46:01.897 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 166121 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/niu.ko 2023-10-06T02:46:01.897 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 66473 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/sungem.ko 2023-10-06T02:46:01.897 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 78737 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-10-06T02:46:01.897 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/tehuti/ 2023-10-06T02:46:01.897 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 49993 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-10-06T02:46:01.897 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ti/ 2023-10-06T02:46:01.897 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 86465 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ti/tlan.ko 2023-10-06T02:46:01.897 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via/ 2023-10-06T02:46:01.898 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 80257 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-10-06T02:46:01.898 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 83681 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-10-06T02:46:01.898 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet/ 2023-10-06T02:46:01.898 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 46241 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-10-06T02:46:01.898 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 30849 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-10-06T02:46:01.898 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/xircom/ 2023-10-06T02:46:01.898 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 60041 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-10-06T02:46:01.898 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/fddi/ 2023-10-06T02:46:01.898 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 41001 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/fddi/defxx.ko 2023-10-06T02:46:01.898 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/fddi/skfp/ 2023-10-06T02:46:01.899 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 216977 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/fddi/skfp/skfp.ko 2023-10-06T02:46:01.899 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 77401 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/geneve.ko 2023-10-06T02:46:01.899 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/hyperv/ 2023-10-06T02:46:01.899 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 235593 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-10-06T02:46:01.899 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ieee802154/ 2023-10-06T02:46:01.899 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 18257 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ieee802154/fakelb.ko 2023-10-06T02:46:01.899 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 25073 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ifb.ko 2023-10-06T02:46:01.899 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ipvlan/ 2023-10-06T02:46:01.899 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 83993 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ipvlan/ipvlan.ko 2023-10-06T02:46:01.899 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 62065 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/macvlan.ko 2023-10-06T02:46:01.899 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15865 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/macvtap.ko 2023-10-06T02:46:01.900 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/ 2023-10-06T02:46:01.900 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 19817 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-10-06T02:46:01.900 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14185 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-10-06T02:46:01.900 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13745 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-gpio.ko 2023-10-06T02:46:01.900 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 8825 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-regmap.ko 2023-10-06T02:46:01.900 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16025 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio.ko 2023-10-06T02:46:01.900 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 20513 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mii.ko 2023-10-06T02:46:01.900 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 41697 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/netconsole.ko 2023-10-06T02:46:01.900 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13145 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/nlmon.ko 2023-10-06T02:46:01.900 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs/ 2023-10-06T02:46:01.900 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17897 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs/pcs-lynx.ko 2023-10-06T02:46:01.901 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 32329 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-10-06T02:46:01.901 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/ 2023-10-06T02:46:01.901 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 9737 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/amd.ko 2023-10-06T02:46:01.901 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 50097 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-10-06T02:46:01.901 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 43273 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm7xxx.ko 2023-10-06T02:46:01.901 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11521 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm87xx.ko 2023-10-06T02:46:01.901 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 41793 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/broadcom.ko 2023-10-06T02:46:01.901 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10561 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/cicada.ko 2023-10-06T02:46:01.901 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12961 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/davicom.ko 2023-10-06T02:46:01.901 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 9449 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/et1011c.ko 2023-10-06T02:46:01.902 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 24905 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/icplus.ko 2023-10-06T02:46:01.902 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15785 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/lxt.ko 2023-10-06T02:46:01.902 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 78185 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/marvell.ko 2023-10-06T02:46:01.902 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 75713 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/micrel.ko 2023-10-06T02:46:01.902 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12033 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/national.ko 2023-10-06T02:46:01.902 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 97265 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/phylink.ko 2023-10-06T02:46:01.902 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10001 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/qsemi.ko 2023-10-06T02:46:01.902 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 49553 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/realtek.ko 2023-10-06T02:46:01.902 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 25753 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/smsc.ko 2023-10-06T02:46:01.902 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10793 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/ste10Xp.ko 2023-10-06T02:46:01.903 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 24033 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/vitesse.ko 2023-10-06T02:46:01.903 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/plip/ 2023-10-06T02:46:01.903 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 43465 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/plip/plip.ko 2023-10-06T02:46:01.903 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ 2023-10-06T02:46:01.903 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15857 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/bsd_comp.ko 2023-10-06T02:46:01.903 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 29929 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_async.ko 2023-10-06T02:46:01.903 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17665 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_deflate.ko 2023-10-06T02:46:01.903 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 18625 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_mppe.ko 2023-10-06T02:46:01.903 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 28945 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_synctty.ko 2023-10-06T02:46:01.903 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 42545 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pppoe.ko 2023-10-06T02:46:01.903 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13441 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pppox.ko 2023-10-06T02:46:01.903 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 31969 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pptp.ko 2023-10-06T02:46:01.904 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 28225 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/sb1000.ko 2023-10-06T02:46:01.904 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip/ 2023-10-06T02:46:01.904 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 42513 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip/slip.ko 2023-10-06T02:46:01.904 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 26929 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/sungem_phy.ko 2023-10-06T02:46:01.904 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 64937 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/tap.ko 2023-10-06T02:46:01.904 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/ 2023-10-06T02:46:01.904 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 106025 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team.ko 2023-10-06T02:46:01.904 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13497 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_activebackup.ko 2023-10-06T02:46:01.904 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10209 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_broadcast.ko 2023-10-06T02:46:01.904 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 28993 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-10-06T02:46:01.904 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 9641 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_random.ko 2023-10-06T02:46:01.905 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 9321 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-10-06T02:46:01.905 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 88257 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/veth.ko 2023-10-06T02:46:01.905 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vmxnet3/ 2023-10-06T02:46:01.905 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 120497 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-10-06T02:46:01.905 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vxlan/ 2023-10-06T02:46:01.905 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 293441 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vxlan/vxlan.ko 2023-10-06T02:46:01.905 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netback/ 2023-10-06T02:46:01.905 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 143889 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netback/xen-netback.ko 2023-10-06T02:46:01.905 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ntb/ 2023-10-06T02:46:01.905 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 20969 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ntb/ntb.ko 2023-10-06T02:46:01.905 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/ 2023-10-06T02:46:01.906 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host/ 2023-10-06T02:46:01.906 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 264585 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host/nvme-core.ko 2023-10-06T02:46:01.906 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 102393 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host/nvme.ko 2023-10-06T02:46:01.906 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/ 2023-10-06T02:46:01.906 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 133817 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport.ko 2023-10-06T02:46:01.906 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14561 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_cs.ko 2023-10-06T02:46:01.906 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 84337 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_pc.ko 2023-10-06T02:46:01.906 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 26121 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_serial.ko 2023-10-06T02:46:01.906 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/ 2023-10-06T02:46:01.906 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/hotplug/ 2023-10-06T02:46:01.906 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 25009 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-10-06T02:46:01.906 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17849 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2023-10-06T02:46:01.907 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 20137 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2023-10-06T02:46:01.907 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11857 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/pci-stub.ko 2023-10-06T02:46:01.907 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 47377 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/xen-pcifront.ko 2023-10-06T02:46:01.907 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/ 2023-10-06T02:46:01.907 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 26793 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/i82092.ko 2023-10-06T02:46:01.907 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 145785 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/pcmcia.ko 2023-10-06T02:46:01.907 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 62081 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/pcmcia_core.ko 2023-10-06T02:46:01.907 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 34345 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2023-10-06T02:46:01.907 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 34265 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/pd6729.ko 2023-10-06T02:46:01.907 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 112913 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/yenta_socket.ko 2023-10-06T02:46:01.907 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/phy/ 2023-10-06T02:46:01.908 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/phy/broadcom/ 2023-10-06T02:46:01.908 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10841 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2023-10-06T02:46:01.908 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/phy/samsung/ 2023-10-06T02:46:01.908 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 8441 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2023-10-06T02:46:01.908 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl/ 2023-10-06T02:46:01.908 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl/intel/ 2023-10-06T02:46:01.908 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 71521 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-10-06T02:46:01.908 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/ 2023-10-06T02:46:01.908 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/chrome/ 2023-10-06T02:46:01.908 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 50889 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2023-10-06T02:46:01.908 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 20849 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/chrome/cros_ec.ko 2023-10-06T02:46:01.909 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 21433 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2023-10-06T02:46:01.909 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 25417 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2023-10-06T02:46:01.909 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 26225 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2023-10-06T02:46:01.909 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 18201 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2023-10-06T02:46:01.909 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17425 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2023-10-06T02:46:01.909 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/ 2023-10-06T02:46:01.909 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 67097 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/acer-wmi.ko 2023-10-06T02:46:01.909 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 39145 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/acerhdf.ko 2023-10-06T02:46:01.910 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 36913 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/apple-gmux.ko 2023-10-06T02:46:01.910 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 59665 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-laptop.ko 2023-10-06T02:46:01.910 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 30705 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-10-06T02:46:01.910 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 106873 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-wmi.ko 2023-10-06T02:46:01.910 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 36913 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/classmate-laptop.ko 2023-10-06T02:46:01.910 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 49121 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-10-06T02:46:01.910 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13961 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-10-06T02:46:01.910 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 40265 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-10-06T02:46:01.910 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 22521 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-10-06T02:46:01.910 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 36657 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/hdaps.ko 2023-10-06T02:46:01.910 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 19449 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/ibm_rtl.ko 2023-10-06T02:46:01.911 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel/ 2023-10-06T02:46:01.911 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12073 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-10-06T02:46:01.911 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 8985 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2023-10-06T02:46:01.911 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 43521 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel_ips.ko 2023-10-06T02:46:01.911 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 20273 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/msi-wmi.ko 2023-10-06T02:46:01.911 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10377 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/mxm-wmi.ko 2023-10-06T02:46:01.911 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 34801 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-10-06T02:46:01.911 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 42329 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/samsung-laptop.ko 2023-10-06T02:46:01.911 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14169 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/samsung-q10.ko 2023-10-06T02:46:01.911 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17321 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/topstar-laptop.ko 2023-10-06T02:46:01.912 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13721 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-10-06T02:46:01.912 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17081 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/toshiba_haps.ko 2023-10-06T02:46:01.912 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10161 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/wmi-bmof.ko 2023-10-06T02:46:01.912 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 57545 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/wmi.ko 2023-10-06T02:46:01.912 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/ 2023-10-06T02:46:01.912 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/ 2023-10-06T02:46:01.912 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 30345 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/88pm860x_battery.ko 2023-10-06T02:46:01.912 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 33985 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/88pm860x_charger.ko 2023-10-06T02:46:01.912 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 55057 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/bq2415x_charger.ko 2023-10-06T02:46:01.912 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 53993 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/bq24190_charger.ko 2023-10-06T02:46:01.912 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 21553 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/bq24735-charger.ko 2023-10-06T02:46:01.913 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17337 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/cros_peripheral_charger.ko 2023-10-06T02:46:01.913 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 19609 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/da9030_battery.ko 2023-10-06T02:46:01.913 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 19841 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/da9052-battery.ko 2023-10-06T02:46:01.913 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 29281 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/ds2760_battery.ko 2023-10-06T02:46:01.913 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 23217 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/ds2780_battery.ko 2023-10-06T02:46:01.913 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 23353 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/ds2781_battery.ko 2023-10-06T02:46:01.913 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 23649 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/ds2782_battery.ko 2023-10-06T02:46:01.913 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 20353 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/gpio-charger.ko 2023-10-06T02:46:01.913 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 18041 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/isp1704_charger.ko 2023-10-06T02:46:01.913 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 20273 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/lp8727_charger.ko 2023-10-06T02:46:01.913 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12577 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/max14577_charger.ko 2023-10-06T02:46:01.913 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 25897 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/max17040_battery.ko 2023-10-06T02:46:01.914 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 30289 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/max17042_battery.ko 2023-10-06T02:46:01.914 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 18585 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/max8903_charger.ko 2023-10-06T02:46:01.914 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 23729 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/max8925_power.ko 2023-10-06T02:46:01.914 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 21657 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/pcf50633-charger.ko 2023-10-06T02:46:01.914 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 38009 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/sbs-battery.ko 2023-10-06T02:46:01.914 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 28385 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/test_power.ko 2023-10-06T02:46:01.914 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 18865 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/tps65090-charger.ko 2023-10-06T02:46:01.914 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11969 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/wm831x_backup.ko 2023-10-06T02:46:01.914 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 24521 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/wm831x_power.ko 2023-10-06T02:46:01.914 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 22417 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/wm8350_power.ko 2023-10-06T02:46:01.914 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap/ 2023-10-06T02:46:01.915 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 57737 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap/intel_rapl_common.ko 2023-10-06T02:46:01.915 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17345 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap/intel_rapl_msr.ko 2023-10-06T02:46:01.915 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/ 2023-10-06T02:46:01.915 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/ 2023-10-06T02:46:01.915 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15521 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps-gpio.ko 2023-10-06T02:46:01.915 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13249 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps-ldisc.ko 2023-10-06T02:46:01.915 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15913 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps_parport.ko 2023-10-06T02:46:01.915 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 41921 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/pps_core.ko 2023-10-06T02:46:01.915 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp/ 2023-10-06T02:46:01.915 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 66385 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp/ptp.ko 2023-10-06T02:46:01.915 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16449 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp/ptp_kvm.ko 2023-10-06T02:46:01.915 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/ 2023-10-06T02:46:01.916 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 23497 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-88pm80x.ko 2023-10-06T02:46:01.916 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 24521 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-88pm860x.ko 2023-10-06T02:46:01.916 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15393 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-bq32k.ko 2023-10-06T02:46:01.916 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12961 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-bq4802.ko 2023-10-06T02:46:01.916 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 20105 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-da9052.ko 2023-10-06T02:46:01.916 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 18505 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-da9055.ko 2023-10-06T02:46:01.916 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 20177 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-da9063.ko 2023-10-06T02:46:01.916 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16457 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1286.ko 2023-10-06T02:46:01.916 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 68577 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1307.ko 2023-10-06T02:46:01.916 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 20817 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1374.ko 2023-10-06T02:46:01.916 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 18217 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1511.ko 2023-10-06T02:46:01.917 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16737 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1553.ko 2023-10-06T02:46:01.917 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13953 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1672.ko 2023-10-06T02:46:01.917 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13369 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1742.ko 2023-10-06T02:46:01.917 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17305 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds2404.ko 2023-10-06T02:46:01.917 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 23705 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds3232.ko 2023-10-06T02:46:01.917 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11081 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-em3027.ko 2023-10-06T02:46:01.917 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 24329 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-fm3130.ko 2023-10-06T02:46:01.917 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17705 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-isl12022.ko 2023-10-06T02:46:01.917 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 36057 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-isl1208.ko 2023-10-06T02:46:01.917 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14673 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-lp8788.ko 2023-10-06T02:46:01.917 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 38097 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m41t80.ko 2023-10-06T02:46:01.917 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12089 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m48t35.ko 2023-10-06T02:46:01.918 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 25945 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m48t59.ko 2023-10-06T02:46:01.918 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14177 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m48t86.ko 2023-10-06T02:46:01.918 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11633 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-max6900.ko 2023-10-06T02:46:01.918 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14737 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-max8907.ko 2023-10-06T02:46:01.918 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15409 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-max8925.ko 2023-10-06T02:46:01.918 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 25809 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-max8997.ko 2023-10-06T02:46:01.918 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16681 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-max8998.ko 2023-10-06T02:46:01.918 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 18513 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-mc13xxx.ko 2023-10-06T02:46:01.918 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11409 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-msm6242.ko 2023-10-06T02:46:01.918 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 19625 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-palmas.ko 2023-10-06T02:46:01.918 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 40121 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf2127.ko 2023-10-06T02:46:01.919 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17977 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf50633.ko 2023-10-06T02:46:01.919 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 26817 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf85063.ko 2023-10-06T02:46:01.919 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 21825 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8523.ko 2023-10-06T02:46:01.919 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 29881 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8563.ko 2023-10-06T02:46:01.919 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12441 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8583.ko 2023-10-06T02:46:01.919 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 18033 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rc5t583.ko 2023-10-06T02:46:01.919 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13049 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rp5c01.ko 2023-10-06T02:46:01.919 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 33753 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rs5c372.ko 2023-10-06T02:46:01.919 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 27833 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-10-06T02:46:01.919 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 25257 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rx8025.ko 2023-10-06T02:46:01.919 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 20113 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rx8581.ko 2023-10-06T02:46:01.919 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 21617 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-s35390a.ko 2023-10-06T02:46:01.920 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16825 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-10-06T02:46:01.920 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17889 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-tps6586x.ko 2023-10-06T02:46:01.920 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 21545 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-tps65910.ko 2023-10-06T02:46:01.920 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 20545 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-wm831x.ko 2023-10-06T02:46:01.920 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 21345 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-wm8350.ko 2023-10-06T02:46:01.920 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 27873 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-x1205.ko 2023-10-06T02:46:01.920 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ 2023-10-06T02:46:01.920 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 77617 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-9xxx.ko 2023-10-06T02:46:01.920 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 57665 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-sas.ko 2023-10-06T02:46:01.920 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 55169 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-xxxx.ko 2023-10-06T02:46:01.920 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 135169 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/BusLogic.ko 2023-10-06T02:46:01.921 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 26657 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/a100u2w.ko 2023-10-06T02:46:01.921 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aacraid/ 2023-10-06T02:46:01.921 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 272353 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aacraid/aacraid.ko 2023-10-06T02:46:01.921 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 100617 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/advansys.ko 2023-10-06T02:46:01.921 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx/ 2023-10-06T02:46:01.921 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 356265 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-10-06T02:46:01.921 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 295801 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-10-06T02:46:01.921 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic94xx/ 2023-10-06T02:46:01.921 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 189321 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic94xx/aic94xx.ko 2023-10-06T02:46:01.921 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 24073 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/am53c974.ko 2023-10-06T02:46:01.921 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/arcmsr/ 2023-10-06T02:46:01.922 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 106569 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-10-06T02:46:01.922 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 38185 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/atp870u.ko 2023-10-06T02:46:01.922 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/be2iscsi/ 2023-10-06T02:46:01.922 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 246897 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-10-06T02:46:01.922 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bfa/ 2023-10-06T02:46:01.922 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 1172185 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bfa/bfa.ko 2023-10-06T02:46:01.922 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2fc/ 2023-10-06T02:46:01.922 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 237169 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-10-06T02:46:01.922 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2i/ 2023-10-06T02:46:01.922 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 115393 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-10-06T02:46:01.922 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 40609 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ch.ko 2023-10-06T02:46:01.922 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/csiostor/ 2023-10-06T02:46:01.923 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 308889 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/csiostor/csiostor.ko 2023-10-06T02:46:01.923 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/ 2023-10-06T02:46:01.923 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb3i/ 2023-10-06T02:46:01.923 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 76193 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-10-06T02:46:01.923 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb4i/ 2023-10-06T02:46:01.923 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 101449 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-10-06T02:46:01.923 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 146785 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-10-06T02:46:01.923 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 75529 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/dc395x.ko 2023-10-06T02:46:01.923 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 38121 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/dmx3191d.ko 2023-10-06T02:46:01.923 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esas2r/ 2023-10-06T02:46:01.923 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 212401 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esas2r/esas2r.ko 2023-10-06T02:46:01.924 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 60489 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esp_scsi.ko 2023-10-06T02:46:01.924 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe/ 2023-10-06T02:46:01.924 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 78289 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe/fcoe.ko 2023-10-06T02:46:01.924 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 158193 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-10-06T02:46:01.924 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 18945 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fdomain.ko 2023-10-06T02:46:01.924 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fnic/ 2023-10-06T02:46:01.924 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 262729 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fnic/fnic.ko 2023-10-06T02:46:01.924 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 201793 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hpsa.ko 2023-10-06T02:46:01.924 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 51145 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hptiop.ko 2023-10-06T02:46:01.924 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 49041 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hv_storvsc.ko 2023-10-06T02:46:01.925 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 35321 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/imm.ko 2023-10-06T02:46:01.925 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 44057 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/initio.ko 2023-10-06T02:46:01.925 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 266521 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ipr.ko 2023-10-06T02:46:01.925 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 101881 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ips.ko 2023-10-06T02:46:01.925 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/isci/ 2023-10-06T02:46:01.925 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 317249 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/isci/isci.ko 2023-10-06T02:46:01.925 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 26361 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-10-06T02:46:01.925 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 52897 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/iscsi_tcp.ko 2023-10-06T02:46:01.925 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libfc/ 2023-10-06T02:46:01.925 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 314961 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libfc/libfc.ko 2023-10-06T02:46:01.926 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 145569 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libiscsi.ko 2023-10-06T02:46:01.926 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 53521 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libiscsi_tcp.ko 2023-10-06T02:46:01.926 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libsas/ 2023-10-06T02:46:01.926 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 217209 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libsas/libsas.ko 2023-10-06T02:46:01.926 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/lpfc/ 2023-10-06T02:46:01.926 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 2192585 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/lpfc/lpfc.ko 2023-10-06T02:46:01.926 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/ 2023-10-06T02:46:01.926 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 73545 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-10-06T02:46:01.926 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 33505 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-10-06T02:46:01.926 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 310729 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-10-06T02:46:01.927 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 84697 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid.ko 2023-10-06T02:46:01.927 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mpt3sas/ 2023-10-06T02:46:01.927 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 659513 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-10-06T02:46:01.927 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvsas/ 2023-10-06T02:46:01.927 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 119929 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvsas/mvsas.ko 2023-10-06T02:46:01.927 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 78153 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvumi.ko 2023-10-06T02:46:01.927 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pcmcia/ 2023-10-06T02:46:01.927 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 81601 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2023-10-06T02:46:01.927 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11713 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2023-10-06T02:46:01.927 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 20865 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2023-10-06T02:46:01.927 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 23857 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2023-10-06T02:46:01.928 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pm8001/ 2023-10-06T02:46:01.928 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 364257 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-10-06T02:46:01.928 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 123489 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pmcraid.ko 2023-10-06T02:46:01.928 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 33617 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ppa.ko 2023-10-06T02:46:01.928 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 55345 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla1280.ko 2023-10-06T02:46:01.928 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx/ 2023-10-06T02:46:01.928 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 1860193 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-10-06T02:46:01.928 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 85313 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-10-06T02:46:01.928 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla4xxx/ 2023-10-06T02:46:01.928 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 558865 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-10-06T02:46:01.928 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 19025 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qlogicfas408.ko 2023-10-06T02:46:01.929 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 18985 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/raid_class.ko 2023-10-06T02:46:01.929 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 238801 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_debug.ko 2023-10-06T02:46:01.929 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 173921 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_fc.ko 2023-10-06T02:46:01.929 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 278865 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-10-06T02:46:01.929 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 97705 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_sas.ko 2023-10-06T02:46:01.929 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 73881 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_spi.ko 2023-10-06T02:46:01.929 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 44993 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_srp.ko 2023-10-06T02:46:01.929 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 26249 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ses.ko 2023-10-06T02:46:01.929 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 115849 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/st.ko 2023-10-06T02:46:01.929 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 46825 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/stex.ko 2023-10-06T02:46:01.930 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/sym53c8xx_2/ 2023-10-06T02:46:01.930 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 162121 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-10-06T02:46:01.930 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 42361 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/virtio_scsi.ko 2023-10-06T02:46:01.930 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 50297 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/vmw_pvscsi.ko 2023-10-06T02:46:01.930 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 40001 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/wd719x.ko 2023-10-06T02:46:01.930 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 50025 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/xen-scsifront.ko 2023-10-06T02:46:01.930 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ssb/ 2023-10-06T02:46:01.930 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 129417 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ssb/ssb.ko 2023-10-06T02:46:01.930 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/ 2023-10-06T02:46:01.930 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/iscsi/ 2023-10-06T02:46:01.930 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 739089 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-10-06T02:46:01.931 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/loopback/ 2023-10-06T02:46:01.931 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 49985 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/loopback/tcm_loop.ko 2023-10-06T02:46:01.931 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 39713 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_file.ko 2023-10-06T02:46:01.931 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 42961 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_iblock.ko 2023-10-06T02:46:01.931 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 931721 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_mod.ko 2023-10-06T02:46:01.931 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 44321 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_pscsi.ko 2023-10-06T02:46:01.931 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 122545 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_user.ko 2023-10-06T02:46:01.931 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/tcm_fc/ 2023-10-06T02:46:01.931 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 75641 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-10-06T02:46:01.932 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/ 2023-10-06T02:46:01.932 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/ 2023-10-06T02:46:01.932 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/ 2023-10-06T02:46:01.932 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 23481 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-10-06T02:46:01.932 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 29153 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-10-06T02:46:01.932 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 9953 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-10-06T02:46:01.932 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10257 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-10-06T02:46:01.932 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15081 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-10-06T02:46:01.932 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16497 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-10-06T02:46:01.932 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 26809 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-10-06T02:46:01.932 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 20281 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-10-06T02:46:01.932 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14865 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-10-06T02:46:01.933 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14393 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-10-06T02:46:01.933 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13001 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-10-06T02:46:01.933 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 37065 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-10-06T02:46:01.933 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 30729 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/intel_powerclamp.ko 2023-10-06T02:46:01.933 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 21673 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-10-06T02:46:01.933 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12001 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-10-06T02:46:01.933 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 26489 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-10-06T02:46:01.933 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/ 2023-10-06T02:46:01.933 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/ipwireless/ 2023-10-06T02:46:01.933 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 78073 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-10-06T02:46:01.934 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 57881 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/moxa.ko 2023-10-06T02:46:01.934 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 50793 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/mxser.ko 2023-10-06T02:46:01.934 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 107545 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/n_gsm.ko 2023-10-06T02:46:01.934 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 32041 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/n_hdlc.ko 2023-10-06T02:46:01.934 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 68137 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/nozomi.ko 2023-10-06T02:46:01.934 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/ 2023-10-06T02:46:01.934 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/8250/ 2023-10-06T02:46:01.934 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 35745 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/8250/8250_dw.ko 2023-10-06T02:46:01.934 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 59497 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-10-06T02:46:01.934 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 18281 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/altera_jtaguart.ko 2023-10-06T02:46:01.934 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 22465 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/altera_uart.ko 2023-10-06T02:46:01.935 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 9489 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/arc_uart.ko 2023-10-06T02:46:01.935 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 72193 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/fsl_lpuart.ko 2023-10-06T02:46:01.935 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/jsm/ 2023-10-06T02:46:01.935 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 103017 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/jsm/jsm.ko 2023-10-06T02:46:01.935 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 28785 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/rp2.ko 2023-10-06T02:46:01.935 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 52073 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/sc16is7xx.ko 2023-10-06T02:46:01.935 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 100185 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/synclink_gt.ko 2023-10-06T02:46:01.935 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/ 2023-10-06T02:46:01.935 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/core/ 2023-10-06T02:46:01.935 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 536809 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/core/ufshcd-core.ko 2023-10-06T02:46:01.936 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/host/ 2023-10-06T02:46:01.936 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 28377 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-10-06T02:46:01.936 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14433 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2023-10-06T02:46:01.936 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/ 2023-10-06T02:46:01.936 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 44585 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio.ko 2023-10-06T02:46:01.936 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12241 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_aec.ko 2023-10-06T02:46:01.936 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11281 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_cif.ko 2023-10-06T02:46:01.936 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 18329 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_dmem_genirq.ko 2023-10-06T02:46:01.936 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13001 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_mf624.ko 2023-10-06T02:46:01.936 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12177 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_netx.ko 2023-10-06T02:46:01.937 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10601 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_pci_generic.ko 2023-10-06T02:46:01.937 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16057 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_pdrv_genirq.ko 2023-10-06T02:46:01.937 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13633 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_sercos3.ko 2023-10-06T02:46:01.937 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/ 2023-10-06T02:46:01.937 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/c67x00/ 2023-10-06T02:46:01.937 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 73273 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/c67x00/c67x00.ko 2023-10-06T02:46:01.937 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/chipidea/ 2023-10-06T02:46:01.937 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 143785 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/chipidea/ci_hdrc.ko 2023-10-06T02:46:01.937 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 18505 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2023-10-06T02:46:01.937 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12713 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2023-10-06T02:46:01.937 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13057 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2023-10-06T02:46:01.938 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/ 2023-10-06T02:46:01.938 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 85457 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/cdc-acm.ko 2023-10-06T02:46:01.938 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 51393 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/cdc-wdm.ko 2023-10-06T02:46:01.938 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 47465 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/usblp.ko 2023-10-06T02:46:01.938 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 89833 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/usbtmc.ko 2023-10-06T02:46:01.938 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/common/ 2023-10-06T02:46:01.938 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 22953 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/common/ulpi.ko 2023-10-06T02:46:01.938 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/dwc2/ 2023-10-06T02:46:01.938 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11873 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/dwc2/dwc2_pci.ko 2023-10-06T02:46:01.938 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/dwc3/ 2023-10-06T02:46:01.938 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12089 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/dwc3/dwc3-haps.ko 2023-10-06T02:46:01.939 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 30041 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/dwc3/dwc3-pci.ko 2023-10-06T02:46:01.939 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 445217 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/dwc3/dwc3.ko 2023-10-06T02:46:01.939 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/ 2023-10-06T02:46:01.939 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/function/ 2023-10-06T02:46:01.939 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 60089 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/function/u_ether.ko 2023-10-06T02:46:01.939 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 51753 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/function/u_serial.ko 2023-10-06T02:46:01.939 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 29049 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2023-10-06T02:46:01.939 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 42649 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2023-10-06T02:46:01.939 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 28089 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2023-10-06T02:46:01.939 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 36585 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2023-10-06T02:46:01.940 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 92377 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2023-10-06T02:46:01.940 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 51025 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2023-10-06T02:46:01.940 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 122073 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2023-10-06T02:46:01.940 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 57921 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2023-10-06T02:46:01.940 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 22345 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2023-10-06T02:46:01.940 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 31265 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2023-10-06T02:46:01.940 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 57705 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2023-10-06T02:46:01.940 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 85841 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2023-10-06T02:46:01.940 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 19521 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2023-10-06T02:46:01.940 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 58433 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2023-10-06T02:46:01.940 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 67337 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2023-10-06T02:46:01.941 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/legacy/ 2023-10-06T02:46:01.941 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 21265 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2023-10-06T02:46:01.941 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 18057 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2023-10-06T02:46:01.941 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 18465 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2023-10-06T02:46:01.941 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 21657 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/legacy/g_ether.ko 2023-10-06T02:46:01.941 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 28401 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2023-10-06T02:46:01.941 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 18993 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/legacy/g_hid.ko 2023-10-06T02:46:01.941 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 20409 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2023-10-06T02:46:01.941 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16977 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2023-10-06T02:46:01.942 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 32073 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2023-10-06T02:46:01.942 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16793 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/legacy/g_printer.ko 2023-10-06T02:46:01.942 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 19393 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/legacy/g_serial.ko 2023-10-06T02:46:01.942 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 27201 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/legacy/g_zero.ko 2023-10-06T02:46:01.942 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 62153 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2023-10-06T02:46:01.942 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15201 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2023-10-06T02:46:01.942 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 161321 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/libcomposite.ko 2023-10-06T02:46:01.942 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/udc/ 2023-10-06T02:46:01.942 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17705 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2023-10-06T02:46:01.942 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/udc/bdc/ 2023-10-06T02:46:01.943 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 157665 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2023-10-06T02:46:01.943 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 36065 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/udc/goku_udc.ko 2023-10-06T02:46:01.943 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 52993 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/udc/gr_udc.ko 2023-10-06T02:46:01.943 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 69689 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2023-10-06T02:46:01.943 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 56009 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/udc/mv_udc.ko 2023-10-06T02:46:01.943 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 76033 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/udc/net2272.ko 2023-10-06T02:46:01.943 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 75057 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/udc/net2280.ko 2023-10-06T02:46:01.943 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 73153 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/udc/pch_udc.ko 2023-10-06T02:46:01.943 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 65793 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2023-10-06T02:46:01.943 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 66073 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2023-10-06T02:46:01.943 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 81489 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2023-10-06T02:46:01.944 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 156057 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/udc/udc-core.ko 2023-10-06T02:46:01.944 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host/ 2023-10-06T02:46:01.944 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11585 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host/bcma-hcd.ko 2023-10-06T02:46:01.944 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 80097 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host/isp116x-hcd.ko 2023-10-06T02:46:01.944 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 87337 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host/oxu210hp-hcd.ko 2023-10-06T02:46:01.944 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 78849 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host/r8a66597-hcd.ko 2023-10-06T02:46:01.944 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 51305 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host/sl811-hcd.ko 2023-10-06T02:46:01.944 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15593 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host/sl811_cs.ko 2023-10-06T02:46:01.944 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13305 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host/ssb-hcd.ko 2023-10-06T02:46:01.944 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 25945 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host/xhci-plat-hcd.ko 2023-10-06T02:46:01.944 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image/ 2023-10-06T02:46:01.944 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 34585 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image/mdc800.ko 2023-10-06T02:46:01.945 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 21081 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image/microtek.ko 2023-10-06T02:46:01.945 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/ 2023-10-06T02:46:01.945 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 41841 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/adutux.ko 2023-10-06T02:46:01.945 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 20713 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/appledisplay.ko 2023-10-06T02:46:01.945 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17721 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/cypress_cy7c63.ko 2023-10-06T02:46:01.945 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 23049 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/cytherm.ko 2023-10-06T02:46:01.945 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13729 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/ehset.ko 2023-10-06T02:46:01.945 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15057 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/emi26.ko 2023-10-06T02:46:01.945 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15985 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/emi62.ko 2023-10-06T02:46:01.945 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11433 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/ezusb.ko 2023-10-06T02:46:01.945 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 19297 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/idmouse.ko 2023-10-06T02:46:01.946 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 36617 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/iowarrior.ko 2023-10-06T02:46:01.946 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11593 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/isight_firmware.ko 2023-10-06T02:46:01.946 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 36529 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/ldusb.ko 2023-10-06T02:46:01.946 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 36265 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/legousbtower.ko 2023-10-06T02:46:01.946 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 27793 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/lvstest.ko 2023-10-06T02:46:01.946 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/sisusbvga/ 2023-10-06T02:46:01.946 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 64841 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-10-06T02:46:01.946 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13001 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/trancevibrator.ko 2023-10-06T02:46:01.946 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 20473 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usb3503.ko 2023-10-06T02:46:01.946 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 25145 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usblcd.ko 2023-10-06T02:46:01.947 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 22753 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usbsevseg.ko 2023-10-06T02:46:01.947 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 70873 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usbtest.ko 2023-10-06T02:46:01.947 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 41945 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/uss720.ko 2023-10-06T02:46:01.947 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 27617 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/yurex.ko 2023-10-06T02:46:01.947 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/mon/ 2023-10-06T02:46:01.947 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 73185 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/mon/usbmon.ko 2023-10-06T02:46:01.947 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/musb/ 2023-10-06T02:46:01.947 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 301521 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/musb/musb_hdrc.ko 2023-10-06T02:46:01.947 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/phy/ 2023-10-06T02:46:01.947 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 21105 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/phy/phy-generic.ko 2023-10-06T02:46:01.947 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 20177 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2023-10-06T02:46:01.948 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12257 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/phy/phy-isp1301.ko 2023-10-06T02:46:01.948 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 21745 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/phy/phy-tahvo.ko 2023-10-06T02:46:01.948 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ 2023-10-06T02:46:01.948 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13249 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/aircable.ko 2023-10-06T02:46:01.948 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 33433 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ark3116.ko 2023-10-06T02:46:01.948 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 26737 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/belkin_sa.ko 2023-10-06T02:46:01.948 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 38105 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ch341.ko 2023-10-06T02:46:01.948 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 70209 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cp210x.ko 2023-10-06T02:46:01.948 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 31169 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cyberjack.ko 2023-10-06T02:46:01.948 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 57937 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cypress_m8.ko 2023-10-06T02:46:01.948 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 49753 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/digi_acceleport.ko 2023-10-06T02:46:01.949 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 9617 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/empeg.ko 2023-10-06T02:46:01.949 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 43897 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/f81232.ko 2023-10-06T02:46:01.949 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 175145 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ftdi_sio.ko 2023-10-06T02:46:01.949 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 52713 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/garmin_gps.ko 2023-10-06T02:46:01.949 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 137105 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/io_edgeport.ko 2023-10-06T02:46:01.949 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 124673 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/io_ti.ko 2023-10-06T02:46:01.949 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 67769 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ipaq.ko 2023-10-06T02:46:01.949 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 19161 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ipw.ko 2023-10-06T02:46:01.949 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 26601 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ir-usb.ko 2023-10-06T02:46:01.949 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 57937 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-10-06T02:46:01.949 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 107417 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/keyspan.ko 2023-10-06T02:46:01.949 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 35497 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/keyspan_pda.ko 2023-10-06T02:46:01.950 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 25449 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/kl5kusb105.ko 2023-10-06T02:46:01.950 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 33521 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/kobil_sct.ko 2023-10-06T02:46:01.950 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 32841 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mct_u232.ko 2023-10-06T02:46:01.950 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 21993 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/metro-usb.ko 2023-10-06T02:46:01.950 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 66489 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mos7720.ko 2023-10-06T02:46:01.950 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 78113 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mos7840.ko 2023-10-06T02:46:01.950 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 56593 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mxuport.ko 2023-10-06T02:46:01.950 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13833 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/navman.ko 2023-10-06T02:46:01.950 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11617 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/omninet.ko 2023-10-06T02:46:01.950 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 24281 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/opticon.ko 2023-10-06T02:46:01.950 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 190233 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/option.ko 2023-10-06T02:46:01.950 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 38905 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/oti6858.ko 2023-10-06T02:46:01.951 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 54313 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/pl2303.ko 2023-10-06T02:46:01.951 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 9801 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/qcaux.ko 2023-10-06T02:46:01.951 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 37825 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/qcserial.ko 2023-10-06T02:46:01.951 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 34561 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/quatech2.ko 2023-10-06T02:46:01.951 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14745 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/safe_serial.ko 2023-10-06T02:46:01.951 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 51297 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/sierra.ko 2023-10-06T02:46:01.951 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 21673 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/spcp8x5.ko 2023-10-06T02:46:01.951 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 29913 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ssu100.ko 2023-10-06T02:46:01.951 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16913 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/symbolserial.ko 2023-10-06T02:46:01.951 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 61337 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-10-06T02:46:01.951 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 23729 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-10-06T02:46:01.951 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10241 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb_debug.ko 2023-10-06T02:46:01.952 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 33313 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb_wwan.ko 2023-10-06T02:46:01.952 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 125505 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usbserial.ko 2023-10-06T02:46:01.952 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 28753 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/visor.ko 2023-10-06T02:46:01.952 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 37409 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/whiteheat.ko 2023-10-06T02:46:01.952 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10537 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/wishbone-serial.ko 2023-10-06T02:46:01.952 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 9289 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/xsens_mt.ko 2023-10-06T02:46:01.952 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ 2023-10-06T02:46:01.952 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 52913 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/uas.ko 2023-10-06T02:46:01.952 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 26017 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-alauda.ko 2023-10-06T02:46:01.952 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13049 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-cypress.ko 2023-10-06T02:46:01.952 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 22049 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-datafab.ko 2023-10-06T02:46:01.953 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 33497 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-10-06T02:46:01.953 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13745 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-freecom.ko 2023-10-06T02:46:01.953 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 19769 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-isd200.ko 2023-10-06T02:46:01.953 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 19361 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-10-06T02:46:01.953 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13713 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-karma.ko 2023-10-06T02:46:01.953 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17841 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-onetouch.ko 2023-10-06T02:46:01.953 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 28441 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-realtek.ko 2023-10-06T02:46:01.953 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 28905 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-sddr09.ko 2023-10-06T02:46:01.953 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 19521 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-sddr55.ko 2023-10-06T02:46:01.953 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 35337 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-usbat.ko 2023-10-06T02:46:01.953 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 180017 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/usb-storage.ko 2023-10-06T02:46:01.953 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/ 2023-10-06T02:46:01.954 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 67457 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/usbip-core.ko 2023-10-06T02:46:01.954 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 71345 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/usbip-host.ko 2023-10-06T02:46:01.954 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 105401 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-10-06T02:46:01.954 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/ 2023-10-06T02:46:01.954 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci/ 2023-10-06T02:46:01.954 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 153697 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-10-06T02:46:01.954 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 29537 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci/vfio-pci.ko 2023-10-06T02:46:01.954 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 100569 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/vfio.ko 2023-10-06T02:46:01.954 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 75137 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-10-06T02:46:01.954 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/ 2023-10-06T02:46:01.954 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 113889 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost.ko 2023-10-06T02:46:01.955 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16985 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_iotlb.ko 2023-10-06T02:46:01.955 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 58137 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_net.ko 2023-10-06T02:46:01.955 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 89289 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_scsi.ko 2023-10-06T02:46:01.955 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/ 2023-10-06T02:46:01.955 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/ 2023-10-06T02:46:01.955 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15417 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/88pm860x_bl.ko 2023-10-06T02:46:01.955 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12393 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/aat2870_bl.ko 2023-10-06T02:46:01.955 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 23305 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/adp5520_bl.ko 2023-10-06T02:46:01.955 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 32609 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/adp8860_bl.ko 2023-10-06T02:46:01.955 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 39993 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/adp8870_bl.ko 2023-10-06T02:46:01.955 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16921 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/apple_bl.ko 2023-10-06T02:46:01.956 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16777 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/as3711_bl.ko 2023-10-06T02:46:01.956 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12097 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/bd6107.ko 2023-10-06T02:46:01.956 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11409 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/da903x_bl.ko 2023-10-06T02:46:01.956 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11273 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/da9052_bl.ko 2023-10-06T02:46:01.956 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11945 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/gpio_backlight.ko 2023-10-06T02:46:01.956 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14769 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/kb3886_bl.ko 2023-10-06T02:46:01.956 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 22017 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/lcd.ko 2023-10-06T02:46:01.956 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 23657 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/lm3533_bl.ko 2023-10-06T02:46:01.956 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 19337 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/lm3639_bl.ko 2023-10-06T02:46:01.956 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11425 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/lv5207lp.ko 2023-10-06T02:46:01.956 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14345 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/max8925_bl.ko 2023-10-06T02:46:01.957 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11313 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/pandora_bl.ko 2023-10-06T02:46:01.957 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10865 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/pcf50633-backlight.ko 2023-10-06T02:46:01.957 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10897 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/platform_lcd.ko 2023-10-06T02:46:01.957 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12721 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/wm831x_bl.ko 2023-10-06T02:46:01.957 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/ 2023-10-06T02:46:01.957 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters/ 2023-10-06T02:46:01.957 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 18785 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters/ds2482.ko 2023-10-06T02:46:01.957 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 38961 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters/ds2490.ko 2023-10-06T02:46:01.957 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11265 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters/matrox_w1.ko 2023-10-06T02:46:01.957 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12417 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters/w1-gpio.ko 2023-10-06T02:46:01.957 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/ 2023-10-06T02:46:01.958 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12041 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-10-06T02:46:01.958 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 22809 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-10-06T02:46:01.958 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15113 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-10-06T02:46:01.958 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10825 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-10-06T02:46:01.958 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14153 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-10-06T02:46:01.958 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11929 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-10-06T02:46:01.958 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14113 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-10-06T02:46:01.958 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14049 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-10-06T02:46:01.958 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17921 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-10-06T02:46:01.959 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 7385 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_smem.ko 2023-10-06T02:46:01.959 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 56425 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_therm.ko 2023-10-06T02:46:01.959 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 102657 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/wire.ko 2023-10-06T02:46:01.959 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ 2023-10-06T02:46:01.959 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 18793 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/acquirewdt.ko 2023-10-06T02:46:01.959 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 19977 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/advantechwdt.ko 2023-10-06T02:46:01.959 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 18561 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/alim1535_wdt.ko 2023-10-06T02:46:01.959 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 22969 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/alim7101_wdt.ko 2023-10-06T02:46:01.959 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 19113 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/cpu5wdt.ko 2023-10-06T02:46:01.959 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13617 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/da9052_wdt.ko 2023-10-06T02:46:01.960 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12777 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/da9055_wdt.ko 2023-10-06T02:46:01.960 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17409 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/da9063_wdt.ko 2023-10-06T02:46:01.960 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 20169 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/dw_wdt.ko 2023-10-06T02:46:01.960 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 20265 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/eurotechwdt.ko 2023-10-06T02:46:01.960 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 23865 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/f71808e_wdt.ko 2023-10-06T02:46:01.960 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 27401 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/hpwdt.ko 2023-10-06T02:46:01.960 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15577 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/i6300esb.ko 2023-10-06T02:46:01.960 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10833 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-10-06T02:46:01.960 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 21913 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/iTCO_wdt.ko 2023-10-06T02:46:01.960 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 19241 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ib700wdt.ko 2023-10-06T02:46:01.961 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 18689 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ibmasr.ko 2023-10-06T02:46:01.961 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 19713 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-10-06T02:46:01.961 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 21225 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/it8712f_wdt.ko 2023-10-06T02:46:01.961 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13841 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/it87_wdt.ko 2023-10-06T02:46:01.961 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 21489 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/kempld_wdt.ko 2023-10-06T02:46:01.961 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 18617 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/machzwd.ko 2023-10-06T02:46:01.961 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14721 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/mena21_wdt.ko 2023-10-06T02:46:01.961 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13217 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/menf21bmc_wdt.ko 2023-10-06T02:46:01.961 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 24673 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/nv_tco.ko 2023-10-06T02:46:01.961 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17737 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/of_xilinx_wdt.ko 2023-10-06T02:46:01.961 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 22265 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/pc87413_wdt.ko 2023-10-06T02:46:01.962 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 38657 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/pcwd_pci.ko 2023-10-06T02:46:01.962 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 31825 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/pcwd_usb.ko 2023-10-06T02:46:01.962 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13129 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/retu_wdt.ko 2023-10-06T02:46:01.962 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 20449 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sbc60xxwdt.ko 2023-10-06T02:46:01.962 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14129 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sbc_epx_c3.ko 2023-10-06T02:46:01.962 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17321 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-10-06T02:46:01.962 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 23809 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sc1200wdt.ko 2023-10-06T02:46:01.962 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 23321 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sch311x_wdt.ko 2023-10-06T02:46:01.962 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 21577 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/smsc37b787_wdt.ko 2023-10-06T02:46:01.962 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17273 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/softdog.ko 2023-10-06T02:46:01.962 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 22273 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sp5100_tco.ko 2023-10-06T02:46:01.962 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12817 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/twl4030_wdt.ko 2023-10-06T02:46:01.963 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17649 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/via_wdt.ko 2023-10-06T02:46:01.963 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 19161 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-10-06T02:46:01.963 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 20681 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83877f_wdt.ko 2023-10-06T02:46:01.963 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 25409 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83977f_wdt.ko 2023-10-06T02:46:01.963 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 18497 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/wafer5823wdt.ko 2023-10-06T02:46:01.963 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 28089 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/wdt_pci.ko 2023-10-06T02:46:01.963 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16257 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/wm831x_wdt.ko 2023-10-06T02:46:01.963 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13785 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/wm8350_wdt.ko 2023-10-06T02:46:01.963 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15697 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/xen_wdt.ko 2023-10-06T02:46:01.963 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/ 2023-10-06T02:46:01.963 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 24729 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-evtchn.ko 2023-10-06T02:46:01.964 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 26745 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-gntalloc.ko 2023-10-06T02:46:01.964 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 47841 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-gntdev.ko 2023-10-06T02:46:01.964 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-pciback/ 2023-10-06T02:46:01.964 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 176417 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-10-06T02:46:01.964 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 40105 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-privcmd.ko 2023-10-06T02:46:01.964 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 71321 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-scsiback.ko 2023-10-06T02:46:01.964 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xenfs/ 2023-10-06T02:46:01.964 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 19425 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xenfs/xenfs.ko 2023-10-06T02:46:01.964 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ 2023-10-06T02:46:01.964 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/9p/ 2023-10-06T02:46:01.964 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 165625 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/9p/9p.ko 2023-10-06T02:46:01.965 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/adfs/ 2023-10-06T02:46:01.965 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 60881 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/adfs/adfs.ko 2023-10-06T02:46:01.965 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/affs/ 2023-10-06T02:46:01.965 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 162617 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/affs/affs.ko 2023-10-06T02:46:01.965 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/afs/ 2023-10-06T02:46:01.965 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 931937 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/afs/kafs.ko 2023-10-06T02:46:01.965 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/autofs/ 2023-10-06T02:46:01.965 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 100937 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/autofs/autofs4.ko 2023-10-06T02:46:01.965 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/befs/ 2023-10-06T02:46:01.965 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 64481 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/befs/befs.ko 2023-10-06T02:46:01.965 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/bfs/ 2023-10-06T02:46:01.966 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 40993 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/bfs/bfs.ko 2023-10-06T02:46:01.966 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 34625 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/binfmt_misc.ko 2023-10-06T02:46:01.966 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/btrfs/ 2023-10-06T02:46:01.966 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 3474249 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/btrfs/btrfs.ko 2023-10-06T02:46:01.966 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cachefiles/ 2023-10-06T02:46:01.966 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 305745 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cachefiles/cachefiles.ko 2023-10-06T02:46:01.966 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ceph/ 2023-10-06T02:46:01.966 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 1316257 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ceph/ceph.ko 2023-10-06T02:46:01.966 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/coda/ 2023-10-06T02:46:01.966 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 100497 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/coda/coda.ko 2023-10-06T02:46:01.966 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/configfs/ 2023-10-06T02:46:01.967 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 108073 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/configfs/configfs.ko 2023-10-06T02:46:01.967 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cramfs/ 2023-10-06T02:46:01.967 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 29273 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cramfs/cramfs.ko 2023-10-06T02:46:01.967 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/dlm/ 2023-10-06T02:46:01.967 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 633825 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/dlm/dlm.ko 2023-10-06T02:46:01.967 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/efs/ 2023-10-06T02:46:01.967 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 36585 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/efs/efs.ko 2023-10-06T02:46:01.967 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/f2fs/ 2023-10-06T02:46:01.967 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 1500513 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/f2fs/f2fs.ko 2023-10-06T02:46:01.967 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/ 2023-10-06T02:46:01.967 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 27865 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/msdos.ko 2023-10-06T02:46:01.968 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/freevxfs/ 2023-10-06T02:46:01.968 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 42457 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/freevxfs/freevxfs.ko 2023-10-06T02:46:01.968 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fscache/ 2023-10-06T02:46:01.968 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 226505 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fscache/fscache.ko 2023-10-06T02:46:01.968 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse/ 2023-10-06T02:46:01.968 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 24473 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse/cuse.ko 2023-10-06T02:46:01.968 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/gfs2/ 2023-10-06T02:46:01.968 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 1226385 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/gfs2/gfs2.ko 2023-10-06T02:46:01.968 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfs/ 2023-10-06T02:46:01.968 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 141241 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfs/hfs.ko 2023-10-06T02:46:01.968 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfsplus/ 2023-10-06T02:46:01.968 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 221553 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfsplus/hfsplus.ko 2023-10-06T02:46:01.969 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hpfs/ 2023-10-06T02:46:01.969 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 193577 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hpfs/hpfs.ko 2023-10-06T02:46:01.969 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/isofs/ 2023-10-06T02:46:01.969 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 74393 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/isofs/isofs.ko 2023-10-06T02:46:01.969 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/jfs/ 2023-10-06T02:46:01.969 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 421097 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/jfs/jfs.ko 2023-10-06T02:46:01.969 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/lockd/ 2023-10-06T02:46:01.969 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 279041 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/lockd/lockd.ko 2023-10-06T02:46:01.969 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/minix/ 2023-10-06T02:46:01.969 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 87833 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/minix/minix.ko 2023-10-06T02:46:01.970 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/netfs/ 2023-10-06T02:46:01.970 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 124697 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/netfs/netfs.ko 2023-10-06T02:46:01.970 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/ 2023-10-06T02:46:01.970 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/blocklayout/ 2023-10-06T02:46:01.970 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 81521 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-10-06T02:46:01.970 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/filelayout/ 2023-10-06T02:46:01.970 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 59425 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-10-06T02:46:01.970 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/flexfilelayout/ 2023-10-06T02:46:01.970 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 117705 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-10-06T02:46:01.970 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 1053889 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfs.ko 2023-10-06T02:46:01.971 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 66089 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfsv2.ko 2023-10-06T02:46:01.971 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 119801 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfsv3.ko 2023-10-06T02:46:01.971 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 2041809 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfsv4.ko 2023-10-06T02:46:01.971 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common/ 2023-10-06T02:46:01.971 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16937 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common/grace.ko 2023-10-06T02:46:01.971 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16145 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common/nfs_acl.ko 2023-10-06T02:46:01.971 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfsd/ 2023-10-06T02:46:01.971 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 1504929 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfsd/nfsd.ko 2023-10-06T02:46:01.971 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nilfs2/ 2023-10-06T02:46:01.971 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 591401 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nilfs2/nilfs2.ko 2023-10-06T02:46:01.971 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/ 2023-10-06T02:46:01.972 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13793 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-celtic.ko 2023-10-06T02:46:01.972 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13169 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-centeuro.ko 2023-10-06T02:46:01.972 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13793 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-croatian.ko 2023-10-06T02:46:01.972 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12865 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-cyrillic.ko 2023-10-06T02:46:01.972 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13481 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-gaelic.ko 2023-10-06T02:46:01.972 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12857 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-greek.ko 2023-10-06T02:46:01.972 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13793 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-iceland.ko 2023-10-06T02:46:01.972 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13169 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-inuit.ko 2023-10-06T02:46:01.972 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14097 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-roman.ko 2023-10-06T02:46:01.972 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13793 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-romanian.ko 2023-10-06T02:46:01.973 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13793 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-turkish.ko 2023-10-06T02:46:01.973 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11297 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_ascii.ko 2023-10-06T02:46:01.973 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12537 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1250.ko 2023-10-06T02:46:01.973 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12233 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1251.ko 2023-10-06T02:46:01.973 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12921 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1255.ko 2023-10-06T02:46:01.973 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12537 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp737.ko 2023-10-06T02:46:01.973 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12537 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp775.ko 2023-10-06T02:46:01.973 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12225 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp850.ko 2023-10-06T02:46:01.973 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12225 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp852.ko 2023-10-06T02:46:01.973 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12225 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp855.ko 2023-10-06T02:46:01.973 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11913 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp857.ko 2023-10-06T02:46:01.974 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12849 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp860.ko 2023-10-06T02:46:01.974 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13161 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp861.ko 2023-10-06T02:46:01.974 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13473 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp862.ko 2023-10-06T02:46:01.974 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13161 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp863.ko 2023-10-06T02:46:01.974 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12849 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp864.ko 2023-10-06T02:46:01.974 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13161 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp865.ko 2023-10-06T02:46:01.974 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12537 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp866.ko 2023-10-06T02:46:01.974 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12225 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp869.ko 2023-10-06T02:46:01.974 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11985 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp874.ko 2023-10-06T02:46:01.974 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 94137 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp932.ko 2023-10-06T02:46:01.974 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 142673 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp936.ko 2023-10-06T02:46:01.975 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 165745 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp949.ko 2023-10-06T02:46:01.975 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 118121 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp950.ko 2023-10-06T02:46:01.975 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12457 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_euc-jp.ko 2023-10-06T02:46:01.975 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11305 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-1.ko 2023-10-06T02:46:01.975 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11929 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-13.ko 2023-10-06T02:46:01.975 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11929 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-14.ko 2023-10-06T02:46:01.975 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11929 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-15.ko 2023-10-06T02:46:01.975 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11921 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-2.ko 2023-10-06T02:46:01.975 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11921 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-3.ko 2023-10-06T02:46:01.975 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11921 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-4.ko 2023-10-06T02:46:01.975 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11921 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-5.ko 2023-10-06T02:46:01.976 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11617 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-6.ko 2023-10-06T02:46:01.976 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12233 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-7.ko 2023-10-06T02:46:01.976 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11617 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-9.ko 2023-10-06T02:46:01.976 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12537 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-r.ko 2023-10-06T02:46:01.976 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 8017 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-ru.ko 2023-10-06T02:46:01.976 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12537 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-u.ko 2023-10-06T02:46:01.976 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 8337 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_utf8.ko 2023-10-06T02:46:01.976 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ntfs/ 2023-10-06T02:46:01.976 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 219361 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ntfs/ntfs.ko 2023-10-06T02:46:01.976 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ 2023-10-06T02:46:01.976 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/cluster/ 2023-10-06T02:46:01.977 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 244177 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-10-06T02:46:01.977 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlm/ 2023-10-06T02:46:01.977 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 440785 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-10-06T02:46:01.977 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlmfs/ 2023-10-06T02:46:01.977 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 53841 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-10-06T02:46:01.977 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 2589873 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2.ko 2023-10-06T02:46:01.977 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17905 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-10-06T02:46:01.977 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 31585 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-10-06T02:46:01.977 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 35881 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-10-06T02:46:01.977 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/omfs/ 2023-10-06T02:46:01.978 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 52569 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/omfs/omfs.ko 2023-10-06T02:46:01.978 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/overlayfs/ 2023-10-06T02:46:01.978 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 336889 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/overlayfs/overlay.ko 2023-10-06T02:46:01.978 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/pstore/ 2023-10-06T02:46:01.978 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 54609 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/pstore/ramoops.ko 2023-10-06T02:46:01.978 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/qnx4/ 2023-10-06T02:46:01.978 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 26801 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/qnx4/qnx4.ko 2023-10-06T02:46:01.978 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/qnx6/ 2023-10-06T02:46:01.978 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 46649 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/qnx6/qnx6.ko 2023-10-06T02:46:01.978 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/quota/ 2023-10-06T02:46:01.979 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 30881 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/quota/quota_tree.ko 2023-10-06T02:46:01.979 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14361 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/quota/quota_v1.ko 2023-10-06T02:46:01.979 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 22017 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/quota/quota_v2.ko 2023-10-06T02:46:01.979 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/reiserfs/ 2023-10-06T02:46:01.979 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 530697 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/reiserfs/reiserfs.ko 2023-10-06T02:46:01.979 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/romfs/ 2023-10-06T02:46:01.979 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 28505 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/romfs/romfs.ko 2023-10-06T02:46:01.979 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/ 2023-10-06T02:46:01.979 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/client/ 2023-10-06T02:46:01.979 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 2661209 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/client/cifs.ko 2023-10-06T02:46:01.980 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common/ 2023-10-06T02:46:01.980 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 7161 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common/cifs_arc4.ko 2023-10-06T02:46:01.980 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11257 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common/cifs_md4.ko 2023-10-06T02:46:01.980 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/squashfs/ 2023-10-06T02:46:01.980 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 134313 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/squashfs/squashfs.ko 2023-10-06T02:46:01.980 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/sysv/ 2023-10-06T02:46:01.980 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 89737 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/sysv/sysv.ko 2023-10-06T02:46:01.980 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/udf/ 2023-10-06T02:46:01.980 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 248049 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/udf/udf.ko 2023-10-06T02:46:01.980 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ufs/ 2023-10-06T02:46:01.980 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 160857 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ufs/ufs.ko 2023-10-06T02:46:01.981 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/xfs/ 2023-10-06T02:46:01.981 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 3998129 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/xfs/xfs.ko 2023-10-06T02:46:01.981 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/ 2023-10-06T02:46:01.981 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/locking/ 2023-10-06T02:46:01.981 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 74865 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/locking/locktorture.ko 2023-10-06T02:46:01.981 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/time/ 2023-10-06T02:46:01.981 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13737 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/time/test_udelay.ko 2023-10-06T02:46:01.981 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 58473 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/torture.ko 2023-10-06T02:46:01.981 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ 2023-10-06T02:46:01.981 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 6833 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crc-itu-t.ko 2023-10-06T02:46:01.982 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 6529 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crc7.ko 2023-10-06T02:46:01.982 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 7025 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crc8.ko 2023-10-06T02:46:01.982 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto/ 2023-10-06T02:46:01.982 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 7097 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto/libarc4.ko 2023-10-06T02:46:01.982 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 37081 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto/libdes.ko 2023-10-06T02:46:01.982 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13313 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/interval_tree_test.ko 2023-10-06T02:46:01.982 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 8425 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/libcrc32c.ko 2023-10-06T02:46:01.982 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 24929 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lru_cache.ko 2023-10-06T02:46:01.982 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4/ 2023-10-06T02:46:01.982 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 33801 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4/lz4_compress.ko 2023-10-06T02:46:01.983 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 22633 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4/lz4hc_compress.ko 2023-10-06T02:46:01.983 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/math/ 2023-10-06T02:46:01.983 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 6617 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/math/cordic.ko 2023-10-06T02:46:01.983 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 8233 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/memory-notifier-error-inject.ko 2023-10-06T02:46:01.983 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10929 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/notifier-error-inject.ko 2023-10-06T02:46:01.983 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14089 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/percpu_test.ko 2023-10-06T02:46:01.983 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 8305 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/pm-notifier-error-inject.ko 2023-10-06T02:46:01.983 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/raid6/ 2023-10-06T02:46:01.983 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 143433 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/raid6/raid6_pq.ko 2023-10-06T02:46:01.983 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 21105 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/rbtree_test.ko 2023-10-06T02:46:01.983 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/reed_solomon/ 2023-10-06T02:46:01.984 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 18737 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/reed_solomon/reed_solomon.ko 2023-10-06T02:46:01.984 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 38841 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/test-kstrtox.ko 2023-10-06T02:46:01.984 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 26321 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/test-string_helpers.ko 2023-10-06T02:46:01.984 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 4760825 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/test_bpf.ko 2023-10-06T02:46:01.984 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 49081 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/test_firmware.ko 2023-10-06T02:46:01.984 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 6369 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/test_module.ko 2023-10-06T02:46:01.984 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 20801 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/test_user_copy.ko 2023-10-06T02:46:01.984 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 9585 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_bm.ko 2023-10-06T02:46:01.984 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11121 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_fsm.ko 2023-10-06T02:46:01.984 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 9689 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_kmp.ko 2023-10-06T02:46:01.984 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/xz/ 2023-10-06T02:46:01.985 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13545 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/xz/xz_dec_test.ko 2023-10-06T02:46:01.985 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/mm/ 2023-10-06T02:46:01.985 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15489 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/mm/hwpoison-inject.ko 2023-10-06T02:46:01.985 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ 2023-10-06T02:46:01.985 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/ 2023-10-06T02:46:01.985 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 55737 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/6lowpan.ko 2023-10-06T02:46:01.985 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 7049 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_dest.ko 2023-10-06T02:46:01.985 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 7065 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_fragment.ko 2023-10-06T02:46:01.985 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 7049 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_hop.ko 2023-10-06T02:46:01.985 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 6985 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_ipv6.ko 2023-10-06T02:46:01.985 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 7065 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_mobility.ko 2023-10-06T02:46:01.985 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 7065 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_routing.ko 2023-10-06T02:46:01.986 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15329 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_udp.ko 2023-10-06T02:46:01.986 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/ 2023-10-06T02:46:01.986 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 30385 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/garp.ko 2023-10-06T02:46:01.986 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 34785 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/mrp.ko 2023-10-06T02:46:01.986 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 8545 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/p8022.ko 2023-10-06T02:46:01.986 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15841 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/psnap.ko 2023-10-06T02:46:01.986 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11537 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/stp.ko 2023-10-06T02:46:01.986 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/8021q/ 2023-10-06T02:46:01.987 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 81017 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/8021q/8021q.ko 2023-10-06T02:46:01.987 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/ 2023-10-06T02:46:01.987 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 198465 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet.ko 2023-10-06T02:46:01.987 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 35961 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_fd.ko 2023-10-06T02:46:01.987 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 26345 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_rdma.ko 2023-10-06T02:46:01.987 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 32321 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_virtio.ko 2023-10-06T02:46:01.987 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/batman-adv/ 2023-10-06T02:46:01.987 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 652553 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/batman-adv/batman-adv.ko 2023-10-06T02:46:01.987 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/ 2023-10-06T02:46:01.987 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 63825 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/br_netfilter.ko 2023-10-06T02:46:01.987 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 772505 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/bridge.ko 2023-10-06T02:46:01.988 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ 2023-10-06T02:46:01.988 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 7657 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-10-06T02:46:01.988 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12385 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_among.ko 2023-10-06T02:46:01.988 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 9169 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_arp.ko 2023-10-06T02:46:01.988 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 9073 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-10-06T02:46:01.988 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 9625 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-10-06T02:46:01.988 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 8737 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_ip.ko 2023-10-06T02:46:01.988 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 9145 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-10-06T02:46:01.988 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 9825 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_limit.ko 2023-10-06T02:46:01.989 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13217 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_log.ko 2023-10-06T02:46:01.989 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 7585 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_mark.ko 2023-10-06T02:46:01.989 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 7593 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-10-06T02:46:01.989 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 8385 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-10-06T02:46:01.989 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 7537 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-10-06T02:46:01.990 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 9593 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-10-06T02:46:01.990 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 8649 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_snat.ko 2023-10-06T02:46:01.990 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 8889 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_stp.ko 2023-10-06T02:46:01.990 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12401 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-10-06T02:46:01.990 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11529 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-10-06T02:46:01.990 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 9817 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-10-06T02:46:01.990 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 9793 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-10-06T02:46:01.990 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 55937 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtables.ko 2023-10-06T02:46:01.990 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14041 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-10-06T02:46:01.990 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13945 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-10-06T02:46:01.990 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ceph/ 2023-10-06T02:46:01.991 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 1046921 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ceph/libceph.ko 2023-10-06T02:46:01.991 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core/ 2023-10-06T02:46:01.991 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 124793 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core/pktgen.ko 2023-10-06T02:46:01.991 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/ 2023-10-06T02:46:01.991 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 194321 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp.ko 2023-10-06T02:46:01.991 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 8665 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_diag.ko 2023-10-06T02:46:01.991 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 56945 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_ipv4.ko 2023-10-06T02:46:01.991 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 59457 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_ipv6.ko 2023-10-06T02:46:01.991 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/ 2023-10-06T02:46:01.991 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 390297 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/dsa_core.ko 2023-10-06T02:46:01.991 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13337 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_brcm.ko 2023-10-06T02:46:01.991 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12577 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_dsa.ko 2023-10-06T02:46:01.992 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 7721 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_none.ko 2023-10-06T02:46:01.992 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 8953 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_trailer.ko 2023-10-06T02:46:01.992 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/hsr/ 2023-10-06T02:46:01.992 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 100257 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/hsr/hsr.ko 2023-10-06T02:46:01.992 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/ 2023-10-06T02:46:01.992 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/6lowpan/ 2023-10-06T02:46:01.992 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 45169 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-10-06T02:46:01.992 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 254601 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/ieee802154.ko 2023-10-06T02:46:01.992 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 47265 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/ieee802154_socket.ko 2023-10-06T02:46:01.992 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ 2023-10-06T02:46:01.993 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 24729 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ah4.ko 2023-10-06T02:46:01.993 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 38905 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/esp4.ko 2023-10-06T02:46:01.993 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 48345 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/fou.ko 2023-10-06T02:46:01.993 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 18241 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/gre.ko 2023-10-06T02:46:01.993 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 48529 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/inet_diag.ko 2023-10-06T02:46:01.993 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 60593 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_gre.ko 2023-10-06T02:46:01.993 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 61281 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_tunnel.ko 2023-10-06T02:46:01.993 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 34457 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_vti.ko 2023-10-06T02:46:01.993 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14001 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ipcomp.ko 2023-10-06T02:46:01.993 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 28889 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ipip.ko 2023-10-06T02:46:01.994 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ 2023-10-06T02:46:01.994 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 37689 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arp_tables.ko 2023-10-06T02:46:01.994 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 8873 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-10-06T02:46:01.994 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10409 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-10-06T02:46:01.994 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 41601 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ip_tables.ko 2023-10-06T02:46:01.994 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10057 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-10-06T02:46:01.994 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 9681 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2023-10-06T02:46:01.994 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14145 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-10-06T02:46:01.994 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11177 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-10-06T02:46:01.994 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14929 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-10-06T02:46:01.994 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11305 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_filter.ko 2023-10-06T02:46:01.995 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11649 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-10-06T02:46:01.995 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14929 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-10-06T02:46:01.995 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11545 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-10-06T02:46:01.995 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10409 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_security.ko 2023-10-06T02:46:01.995 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12169 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-10-06T02:46:01.995 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 8817 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-10-06T02:46:01.995 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 27625 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-10-06T02:46:01.995 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 18225 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-10-06T02:46:01.995 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13337 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-10-06T02:46:01.995 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 20561 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2023-10-06T02:46:01.995 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 9329 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-10-06T02:46:01.995 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15225 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-10-06T02:46:01.996 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 9961 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-10-06T02:46:01.996 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17161 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-10-06T02:46:01.996 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 9009 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-10-06T02:46:01.996 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13073 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_bic.ko 2023-10-06T02:46:01.996 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13737 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_dctcp.ko 2023-10-06T02:46:01.996 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15121 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_diag.ko 2023-10-06T02:46:01.996 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 9537 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_highspeed.ko 2023-10-06T02:46:01.996 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12401 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_htcp.ko 2023-10-06T02:46:01.996 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10449 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_hybla.ko 2023-10-06T02:46:01.996 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11473 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_illinois.ko 2023-10-06T02:46:01.997 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10433 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_lp.ko 2023-10-06T02:46:01.997 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 8329 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_scalable.ko 2023-10-06T02:46:01.997 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14425 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_vegas.ko 2023-10-06T02:46:01.997 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10089 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_veno.ko 2023-10-06T02:46:01.997 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10953 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_westwood.ko 2023-10-06T02:46:01.997 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10185 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_yeah.ko 2023-10-06T02:46:01.997 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 22601 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tunnel4.ko 2023-10-06T02:46:01.997 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16361 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/udp_diag.ko 2023-10-06T02:46:01.997 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 41577 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/udp_tunnel.ko 2023-10-06T02:46:01.997 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11425 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/xfrm4_tunnel.ko 2023-10-06T02:46:01.997 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ 2023-10-06T02:46:01.997 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 26441 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ah6.ko 2023-10-06T02:46:01.998 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 39537 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/esp6.ko 2023-10-06T02:46:01.998 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14425 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/fou6.ko 2023-10-06T02:46:01.998 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 80793 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_gre.ko 2023-10-06T02:46:01.998 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 92817 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_tunnel.ko 2023-10-06T02:46:01.998 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10609 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-10-06T02:46:01.998 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 54089 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_vti.ko 2023-10-06T02:46:01.998 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13785 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ipcomp6.ko 2023-10-06T02:46:01.998 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 19017 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/mip6.ko 2023-10-06T02:46:01.998 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ 2023-10-06T02:46:01.998 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 42209 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-10-06T02:46:01.999 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11753 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2023-10-06T02:46:01.999 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 9753 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-10-06T02:46:01.999 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14161 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-10-06T02:46:01.999 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14337 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-10-06T02:46:01.999 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 7801 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-10-06T02:46:01.999 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16209 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-10-06T02:46:01.999 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16033 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-10-06T02:46:01.999 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 8913 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-10-06T02:46:01.999 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 9897 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-10-06T02:46:01.999 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10937 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-10-06T02:46:01.999 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10897 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-10-06T02:46:01.999 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11321 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-10-06T02:46:01.999 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11121 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-10-06T02:46:02.000 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14969 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-10-06T02:46:02.000 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11617 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-10-06T02:46:02.000 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10433 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-10-06T02:46:02.000 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 38833 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-10-06T02:46:02.000 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 8449 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-10-06T02:46:02.000 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 26057 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-10-06T02:46:02.000 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 9801 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-10-06T02:46:02.000 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15441 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-10-06T02:46:02.000 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 9633 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-10-06T02:46:02.000 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16025 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-10-06T02:46:02.000 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 9009 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-10-06T02:46:02.001 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 73161 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/sit.ko 2023-10-06T02:46:02.001 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 24193 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/tunnel6.ko 2023-10-06T02:46:02.001 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 23305 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/xfrm6_tunnel.ko 2023-10-06T02:46:02.001 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/key/ 2023-10-06T02:46:02.001 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 82929 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/key/af_key.ko 2023-10-06T02:46:02.001 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/ 2023-10-06T02:46:02.001 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 125873 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_core.ko 2023-10-06T02:46:02.001 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 20273 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_debugfs.ko 2023-10-06T02:46:02.001 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 25865 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_eth.ko 2023-10-06T02:46:02.001 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 35049 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ip.ko 2023-10-06T02:46:02.002 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 36745 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ip6.ko 2023-10-06T02:46:02.002 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 33001 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_netlink.ko 2023-10-06T02:46:02.002 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 53153 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ppp.ko 2023-10-06T02:46:02.002 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/lapb/ 2023-10-06T02:46:02.002 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 48065 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/lapb/lapb.ko 2023-10-06T02:46:02.002 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/llc/ 2023-10-06T02:46:02.002 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 23225 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/llc/llc.ko 2023-10-06T02:46:02.002 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 267257 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/llc/llc2.ko 2023-10-06T02:46:02.002 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mac802154/ 2023-10-06T02:46:02.002 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 291041 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mac802154/mac802154.ko 2023-10-06T02:46:02.002 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mpls/ 2023-10-06T02:46:02.003 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 9393 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mpls/mpls_gso.ko 2023-10-06T02:46:02.003 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ 2023-10-06T02:46:02.003 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ 2023-10-06T02:46:02.003 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 119649 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set.ko 2023-10-06T02:46:02.003 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 28449 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-10-06T02:46:02.003 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 27033 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-10-06T02:46:02.003 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 26465 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-10-06T02:46:02.003 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 102033 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-10-06T02:46:02.003 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 103121 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-10-06T02:46:02.003 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 104593 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-10-06T02:46:02.003 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 105129 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-10-06T02:46:02.003 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 114393 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-10-06T02:46:02.004 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 61161 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-10-06T02:46:02.004 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 111161 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-10-06T02:46:02.004 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 114673 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-10-06T02:46:02.004 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 114329 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-10-06T02:46:02.004 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 113217 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-10-06T02:46:02.004 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 116217 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-10-06T02:46:02.004 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 30145 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-10-06T02:46:02.004 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ 2023-10-06T02:46:02.004 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 412889 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs.ko 2023-10-06T02:46:02.004 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11961 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-10-06T02:46:02.004 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 7625 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-10-06T02:46:02.005 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17729 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-10-06T02:46:02.005 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17905 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-10-06T02:46:02.005 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 20657 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-10-06T02:46:02.005 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 7689 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-10-06T02:46:02.005 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 7689 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-10-06T02:46:02.005 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10681 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-10-06T02:46:02.005 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 9233 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-10-06T02:46:02.005 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 7697 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-10-06T02:46:02.005 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13521 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-10-06T02:46:02.005 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 7697 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-10-06T02:46:02.005 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10993 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-10-06T02:46:02.005 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 48897 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conncount.ko 2023-10-06T02:46:02.006 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 408665 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack.ko 2023-10-06T02:46:02.006 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15985 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-10-06T02:46:02.006 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10177 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-10-06T02:46:02.006 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 33761 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-10-06T02:46:02.006 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 118145 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_h323.ko 2023-10-06T02:46:02.006 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 22185 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_irc.ko 2023-10-06T02:46:02.006 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 8817 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-10-06T02:46:02.006 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 108393 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-10-06T02:46:02.006 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 33825 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-10-06T02:46:02.006 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17401 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_sane.ko 2023-10-06T02:46:02.006 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 66641 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_sip.ko 2023-10-06T02:46:02.007 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11233 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-10-06T02:46:02.007 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 19185 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-10-06T02:46:02.007 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10113 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_dup_netdev.ko 2023-10-06T02:46:02.007 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 88513 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_flow_table.ko 2023-10-06T02:46:02.007 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 9593 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_flow_table_inet.ko 2023-10-06T02:46:02.007 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 37129 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_log_syslog.ko 2023-10-06T02:46:02.007 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 95353 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat.ko 2023-10-06T02:46:02.007 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10129 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_amanda.ko 2023-10-06T02:46:02.007 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12625 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_ftp.ko 2023-10-06T02:46:02.007 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11857 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_irc.ko 2023-10-06T02:46:02.007 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 28929 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_sip.ko 2023-10-06T02:46:02.008 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 8809 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_tftp.ko 2023-10-06T02:46:02.008 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 44025 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_synproxy_core.ko 2023-10-06T02:46:02.008 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 609257 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_tables.ko 2023-10-06T02:46:02.008 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 43873 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink.ko 2023-10-06T02:46:02.008 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 30273 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_acct.ko 2023-10-06T02:46:02.008 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 30625 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_cttimeout.ko 2023-10-06T02:46:02.008 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 39905 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_log.ko 2023-10-06T02:46:02.008 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 22713 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_osf.ko 2023-10-06T02:46:02.008 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 49673 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_queue.ko 2023-10-06T02:46:02.008 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10457 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_chain_nat.ko 2023-10-06T02:46:02.008 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 33257 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_compat.ko 2023-10-06T02:46:02.008 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 40721 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_ct.ko 2023-10-06T02:46:02.009 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 9601 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_dup_netdev.ko 2023-10-06T02:46:02.009 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11345 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_fib.ko 2023-10-06T02:46:02.009 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13745 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_fwd_netdev.ko 2023-10-06T02:46:02.009 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14185 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_hash.ko 2023-10-06T02:46:02.009 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 20065 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_limit.ko 2023-10-06T02:46:02.009 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15401 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_log.ko 2023-10-06T02:46:02.009 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14801 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_masq.ko 2023-10-06T02:46:02.009 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14441 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_nat.ko 2023-10-06T02:46:02.009 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13673 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_numgen.ko 2023-10-06T02:46:02.009 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11793 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_osf.ko 2023-10-06T02:46:02.010 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14073 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_queue.ko 2023-10-06T02:46:02.010 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14257 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_redir.ko 2023-10-06T02:46:02.010 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10497 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_reject.ko 2023-10-06T02:46:02.010 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10081 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_reject_inet.ko 2023-10-06T02:46:02.010 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12737 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_socket.ko 2023-10-06T02:46:02.010 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 20393 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_synproxy.ko 2023-10-06T02:46:02.010 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14849 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_tproxy.ko 2023-10-06T02:46:02.010 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 89329 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/x_tables.ko 2023-10-06T02:46:02.010 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12097 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_AUDIT.ko 2023-10-06T02:46:02.010 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 9633 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CHECKSUM.ko 2023-10-06T02:46:02.011 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 7729 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CLASSIFY.ko 2023-10-06T02:46:02.011 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11521 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-10-06T02:46:02.011 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 18169 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CT.ko 2023-10-06T02:46:02.011 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10497 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_DSCP.ko 2023-10-06T02:46:02.011 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 9465 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_HL.ko 2023-10-06T02:46:02.011 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13433 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_HMARK.ko 2023-10-06T02:46:02.011 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 38857 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_IDLETIMER.ko 2023-10-06T02:46:02.011 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13873 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_LED.ko 2023-10-06T02:46:02.011 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11489 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_LOG.ko 2023-10-06T02:46:02.011 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11753 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_MASQUERADE.ko 2023-10-06T02:46:02.011 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11657 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NETMAP.ko 2023-10-06T02:46:02.011 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 9473 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NFLOG.ko 2023-10-06T02:46:02.012 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13289 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NFQUEUE.ko 2023-10-06T02:46:02.012 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 19689 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_RATEEST.ko 2023-10-06T02:46:02.012 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11073 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_REDIRECT.ko 2023-10-06T02:46:02.012 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14337 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_SECMARK.ko 2023-10-06T02:46:02.012 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16057 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TCPMSS.ko 2023-10-06T02:46:02.012 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10433 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-10-06T02:46:02.012 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17369 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TEE.ko 2023-10-06T02:46:02.012 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16785 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TPROXY.ko 2023-10-06T02:46:02.012 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 8321 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TRACE.ko 2023-10-06T02:46:02.012 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13897 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_addrtype.ko 2023-10-06T02:46:02.012 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13897 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_bpf.ko 2023-10-06T02:46:02.013 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15577 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cgroup.ko 2023-10-06T02:46:02.013 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11209 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cluster.ko 2023-10-06T02:46:02.013 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 7505 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_comment.ko 2023-10-06T02:46:02.013 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10465 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connbytes.ko 2023-10-06T02:46:02.013 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11081 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connlabel.ko 2023-10-06T02:46:02.013 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 9401 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connlimit.ko 2023-10-06T02:46:02.013 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13129 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connmark.ko 2023-10-06T02:46:02.013 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12401 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_conntrack.ko 2023-10-06T02:46:02.013 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 7817 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cpu.ko 2023-10-06T02:46:02.013 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10969 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_dccp.ko 2023-10-06T02:46:02.013 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 7865 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_devgroup.ko 2023-10-06T02:46:02.014 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 8801 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_dscp.ko 2023-10-06T02:46:02.014 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10657 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ecn.ko 2023-10-06T02:46:02.014 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11473 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_esp.ko 2023-10-06T02:46:02.014 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 43457 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_hashlimit.ko 2023-10-06T02:46:02.014 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11313 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_helper.ko 2023-10-06T02:46:02.014 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 7865 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_hl.ko 2023-10-06T02:46:02.014 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11921 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ipcomp.ko 2023-10-06T02:46:02.014 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11473 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_iprange.ko 2023-10-06T02:46:02.014 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11785 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ipvs.ko 2023-10-06T02:46:02.014 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16041 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_l2tp.ko 2023-10-06T02:46:02.015 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 8001 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_length.ko 2023-10-06T02:46:02.015 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10273 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_limit.ko 2023-10-06T02:46:02.015 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 7545 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_mac.ko 2023-10-06T02:46:02.015 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 8641 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_mark.ko 2023-10-06T02:46:02.015 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11825 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_multiport.ko 2023-10-06T02:46:02.015 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13817 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_nat.ko 2023-10-06T02:46:02.015 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10105 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_nfacct.ko 2023-10-06T02:46:02.015 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 8297 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_osf.ko 2023-10-06T02:46:02.015 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 9553 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_owner.ko 2023-10-06T02:46:02.015 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 9729 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_physdev.ko 2023-10-06T02:46:02.015 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 7633 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_pkttype.ko 2023-10-06T02:46:02.015 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11985 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_policy.ko 2023-10-06T02:46:02.016 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 9473 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_quota.ko 2023-10-06T02:46:02.016 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10409 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_rateest.ko 2023-10-06T02:46:02.016 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 8257 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_realm.ko 2023-10-06T02:46:02.016 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 36441 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_recent.ko 2023-10-06T02:46:02.016 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13329 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_sctp.ko 2023-10-06T02:46:02.016 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 30089 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_set.ko 2023-10-06T02:46:02.016 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16089 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_socket.ko 2023-10-06T02:46:02.016 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 9505 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_state.ko 2023-10-06T02:46:02.016 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 9473 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_statistic.ko 2023-10-06T02:46:02.016 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 8809 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_string.ko 2023-10-06T02:46:02.016 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 8553 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_tcpmss.ko 2023-10-06T02:46:02.017 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15777 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_tcpudp.ko 2023-10-06T02:46:02.017 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11129 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_time.ko 2023-10-06T02:46:02.017 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 9105 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_u32.ko 2023-10-06T02:46:02.017 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netlink/ 2023-10-06T02:46:02.017 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13969 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netlink/netlink_diag.ko 2023-10-06T02:46:02.017 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/nsh/ 2023-10-06T02:46:02.017 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12425 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/nsh/nsh.ko 2023-10-06T02:46:02.017 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/ 2023-10-06T02:46:02.017 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 379545 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/openvswitch.ko 2023-10-06T02:46:02.017 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10321 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-geneve.ko 2023-10-06T02:46:02.017 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 9449 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-gre.ko 2023-10-06T02:46:02.018 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11793 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-vxlan.ko 2023-10-06T02:46:02.018 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/packet/ 2023-10-06T02:46:02.018 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13057 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/packet/af_packet_diag.ko 2023-10-06T02:46:02.018 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/phonet/ 2023-10-06T02:46:02.018 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 109961 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/phonet/phonet.ko 2023-10-06T02:46:02.018 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 54761 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/phonet/pn_pep.ko 2023-10-06T02:46:02.018 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/ 2023-10-06T02:46:02.018 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 252889 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds.ko 2023-10-06T02:46:02.018 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 165081 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds_rdma.ko 2023-10-06T02:46:02.018 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 67241 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds_tcp.ko 2023-10-06T02:46:02.019 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rxrpc/ 2023-10-06T02:46:02.019 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 820137 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rxrpc/rxrpc.ko 2023-10-06T02:46:02.019 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/ 2023-10-06T02:46:02.019 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 32249 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_csum.ko 2023-10-06T02:46:02.019 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 23537 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_gact.ko 2023-10-06T02:46:02.019 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 26897 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_ipt.ko 2023-10-06T02:46:02.019 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 34057 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_mirred.ko 2023-10-06T02:46:02.019 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 23425 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_nat.ko 2023-10-06T02:46:02.019 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 43817 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_pedit.ko 2023-10-06T02:46:02.019 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 31985 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_police.ko 2023-10-06T02:46:02.019 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 20313 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_simple.ko 2023-10-06T02:46:02.020 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 36353 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_skbedit.ko 2023-10-06T02:46:02.020 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 36057 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_vlan.ko 2023-10-06T02:46:02.020 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 26145 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_basic.ko 2023-10-06T02:46:02.020 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 33945 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_bpf.ko 2023-10-06T02:46:02.020 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 19233 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_cgroup.ko 2023-10-06T02:46:02.020 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 31377 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_flow.ko 2023-10-06T02:46:02.020 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 31769 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_fw.ko 2023-10-06T02:46:02.020 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 38489 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_route.ko 2023-10-06T02:46:02.020 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 61409 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_u32.ko 2023-10-06T02:46:02.020 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 7441 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_cmp.ko 2023-10-06T02:46:02.020 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13457 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_ipset.ko 2023-10-06T02:46:02.021 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 33337 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_meta.ko 2023-10-06T02:46:02.021 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 7897 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_nbyte.ko 2023-10-06T02:46:02.021 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10625 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_text.ko 2023-10-06T02:46:02.021 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 7249 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_u32.ko 2023-10-06T02:46:02.021 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 21649 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_choke.ko 2023-10-06T02:46:02.021 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 20849 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_codel.ko 2023-10-06T02:46:02.021 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 33753 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_drr.ko 2023-10-06T02:46:02.021 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 33609 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_fq.ko 2023-10-06T02:46:02.021 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 31601 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_fq_codel.ko 2023-10-06T02:46:02.021 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 35433 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_gred.ko 2023-10-06T02:46:02.021 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 48409 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_hfsc.ko 2023-10-06T02:46:02.022 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 22073 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_hhf.ko 2023-10-06T02:46:02.022 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 65793 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_htb.ko 2023-10-06T02:46:02.022 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16065 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_ingress.ko 2023-10-06T02:46:02.022 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 30273 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_mqprio.ko 2023-10-06T02:46:02.022 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10793 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_mqprio_lib.ko 2023-10-06T02:46:02.022 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 26065 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_multiq.ko 2023-10-06T02:46:02.022 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 35601 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_netem.ko 2023-10-06T02:46:02.022 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 27545 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_pie.ko 2023-10-06T02:46:02.022 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10265 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_plug.ko 2023-10-06T02:46:02.023 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 24729 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_prio.ko 2023-10-06T02:46:02.023 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 47849 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_qfq.ko 2023-10-06T02:46:02.023 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 32953 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_red.ko 2023-10-06T02:46:02.023 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 26881 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_sfb.ko 2023-10-06T02:46:02.023 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 31425 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_sfq.ko 2023-10-06T02:46:02.023 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 28897 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_tbf.ko 2023-10-06T02:46:02.023 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 27729 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_teql.ko 2023-10-06T02:46:02.023 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp/ 2023-10-06T02:46:02.023 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 930369 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp/sctp.ko 2023-10-06T02:46:02.023 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 19033 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp/sctp_diag.ko 2023-10-06T02:46:02.023 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/ 2023-10-06T02:46:02.023 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss/ 2023-10-06T02:46:02.024 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 335569 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-10-06T02:46:02.024 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 61833 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-10-06T02:46:02.024 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 1514673 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/sunrpc.ko 2023-10-06T02:46:02.024 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/xprtrdma/ 2023-10-06T02:46:02.024 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 707401 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-10-06T02:46:02.024 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc/ 2023-10-06T02:46:02.024 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10025 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc/diag.ko 2023-10-06T02:46:02.024 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 862385 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc/tipc.ko 2023-10-06T02:46:02.024 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/unix/ 2023-10-06T02:46:02.024 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15729 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/unix/unix_diag.ko 2023-10-06T02:46:02.024 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/ 2023-10-06T02:46:02.024 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 84841 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-10-06T02:46:02.025 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 68033 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-10-06T02:46:02.025 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 95985 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock.ko 2023-10-06T02:46:02.025 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10705 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock_diag.ko 2023-10-06T02:46:02.025 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17521 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock_loopback.ko 2023-10-06T02:46:02.025 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/x25/ 2023-10-06T02:46:02.025 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 125097 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/x25/x25.ko 2023-10-06T02:46:02.025 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/xfrm/ 2023-10-06T02:46:02.025 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 22657 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/xfrm/xfrm_algo.ko 2023-10-06T02:46:02.025 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 20705 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/xfrm/xfrm_ipcomp.ko 2023-10-06T02:46:02.025 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 102353 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/xfrm/xfrm_user.ko 2023-10-06T02:46:02.025 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt/ 2023-10-06T02:46:02.026 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt/lib/ 2023-10-06T02:46:02.026 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15513 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt/lib/irqbypass.ko 2023-10-06T02:46:02.026 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 638591 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/modules.alias 2023-10-06T02:46:02.026 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 624324 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/modules.alias.bin 2023-10-06T02:46:02.026 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 7656 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin 2023-10-06T02:46:02.026 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 23361 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin.alias.bin 2023-10-06T02:46:02.026 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 9821 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin.bin 2023-10-06T02:46:02.026 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 69921 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin.modinfo 2023-10-06T02:46:02.026 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 146449 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/modules.dep 2023-10-06T02:46:02.026 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 232695 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/modules.dep.bin 2023-10-06T02:46:02.027 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 210 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/modules.devname 2023-10-06T02:46:02.027 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 72754 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/modules.order 2023-10-06T02:46:02.027 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 879 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/modules.softdep 2023-10-06T02:46:02.027 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 252880 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/modules.symbols 2023-10-06T02:46:02.027 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 307898 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/modules.symbols.bin 2023-10-06T02:46:02.027 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./usr/ 2023-10-06T02:46:02.027 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./usr/share/ 2023-10-06T02:46:02.027 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./usr/share/doc/ 2023-10-06T02:46:02.027 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./usr/share/doc/linux-image-6.5.0-rc7-gfef64f93da2b/ 2023-10-06T02:46:02.027 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 172 2023-09-11 02:20 ./usr/share/doc/linux-image-6.5.0-rc7-gfef64f93da2b/changelog.Debian.gz 2023-10-06T02:46:02.027 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 691 2023-09-11 02:20 ./usr/share/doc/linux-image-6.5.0-rc7-gfef64f93da2b/copyright 2023-10-06T02:46:02.028 DEBUG:teuthology.task.kernel:get_image_version: 6.5.0-rc7-gfef64f93da2b 2023-10-06T02:46:02.028 INFO:teuthology.task.kernel:searching for kernel 6.5.0-rc7-gfef64f93da2b 2023-10-06T02:46:02.029 DEBUG:teuthology.orchestra.run.smithi105:> egrep '(submenu|menuentry.*6.5.0-rc7-gfef64f93da2b).*{' /boot/grub/grub.cfg 2023-10-06T02:46:02.037 INFO:teuthology.orchestra.run.smithi105.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2023-10-06T02:46:02.037 INFO:teuthology.orchestra.run.smithi105.stdout: menuentry 'Ubuntu, with Linux 6.5.0-rc7-gfef64f93da2b' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.5.0-rc7-gfef64f93da2b-advanced-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2023-10-06T02:46:02.037 INFO:teuthology.orchestra.run.smithi105.stdout: menuentry 'Ubuntu, with Linux 6.5.0-rc7-gfef64f93da2b (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.5.0-rc7-gfef64f93da2b-recovery-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2023-10-06T02:46:02.038 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2023-10-06T02:46:02.038 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.5.0-rc7-gfef64f93da2b 2023-10-06T02:46:02.038 DEBUG:teuthology.orchestra.run.smithi105:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2023-10-06T02:46:02.081 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi105.front.sepia.ceph.com to complete... 2023-10-06T02:46:02.762 INFO:teuthology.orchestra.run.smithi105.stderr:Sourcing file `/etc/default/grub' 2023-10-06T02:46:02.766 INFO:teuthology.orchestra.run.smithi105.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-10-06T02:46:02.780 INFO:teuthology.orchestra.run.smithi105.stderr:Generating grub configuration file ... 2023-10-06T02:46:03.020 INFO:teuthology.orchestra.run.smithi105.stderr:Found linux image: /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b 2023-10-06T02:46:03.032 INFO:teuthology.orchestra.run.smithi105.stderr:Found initrd image: /boot/initrd.img-6.5.0-rc7-gfef64f93da2b 2023-10-06T02:46:03.369 INFO:teuthology.orchestra.run.smithi105.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-10-06T02:46:03.379 INFO:teuthology.orchestra.run.smithi105.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-10-06T02:46:03.535 INFO:teuthology.orchestra.run.smithi057.stderr:Sourcing file `/etc/default/grub' 2023-10-06T02:46:03.546 INFO:teuthology.orchestra.run.smithi057.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-10-06T02:46:03.570 INFO:teuthology.orchestra.run.smithi057.stderr:Generating grub configuration file ... 2023-10-06T02:46:03.870 INFO:teuthology.orchestra.run.smithi057.stderr:Found linux image: /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b 2023-10-06T02:46:03.891 INFO:teuthology.orchestra.run.smithi057.stderr:Found initrd image: /boot/initrd.img-6.5.0-rc7-gfef64f93da2b 2023-10-06T02:46:04.292 INFO:teuthology.orchestra.run.smithi057.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-10-06T02:46:04.304 INFO:teuthology.orchestra.run.smithi057.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-10-06T02:46:04.380 INFO:teuthology.orchestra.run.smithi105.stderr:done 2023-10-06T02:46:06.232 INFO:teuthology.orchestra.run.smithi057.stderr:done 2023-10-06T02:46:06.370 DEBUG:teuthology.orchestra.run.smithi057:> dpkg-deb -c /tmp/linux-image.deb 2023-10-06T02:46:06.380 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./ 2023-10-06T02:46:06.380 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./boot/ 2023-10-06T02:46:06.380 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 4382168 2023-09-11 02:20 ./boot/System.map-6.5.0-rc7-gfef64f93da2b 2023-10-06T02:46:06.397 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 168454 2023-09-11 02:20 ./boot/config-6.5.0-rc7-gfef64f93da2b 2023-10-06T02:46:06.397 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11294080 2023-09-11 02:20 ./boot/vmlinuz-6.5.0-rc7-gfef64f93da2b 2023-10-06T02:46:06.417 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./etc/ 2023-10-06T02:46:06.417 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./etc/kernel/ 2023-10-06T02:46:06.417 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./etc/kernel/postinst.d/ 2023-10-06T02:46:06.417 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./etc/kernel/postrm.d/ 2023-10-06T02:46:06.417 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./etc/kernel/preinst.d/ 2023-10-06T02:46:06.417 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./etc/kernel/prerm.d/ 2023-10-06T02:46:06.418 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/ 2023-10-06T02:46:06.418 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/ 2023-10-06T02:46:06.418 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/ 2023-10-06T02:46:06.418 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/ 2023-10-06T02:46:06.418 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/ 2023-10-06T02:46:06.418 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/ 2023-10-06T02:46:06.418 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/ 2023-10-06T02:46:06.418 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 490385 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/aesni-intel.ko 2023-10-06T02:46:06.421 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 25329 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-10-06T02:46:06.421 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 29529 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-10-06T02:46:06.421 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 30313 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-10-06T02:46:06.421 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 93113 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-10-06T02:46:06.421 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 106729 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-10-06T02:46:06.421 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 152241 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-10-06T02:46:06.421 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12553 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-10-06T02:46:06.421 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13777 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-10-06T02:46:06.422 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 83889 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-10-06T02:46:06.422 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18625 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-10-06T02:46:06.422 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 47225 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-10-06T02:46:06.422 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 47209 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-avx2.ko 2023-10-06T02:46:06.422 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 51801 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-10-06T02:46:06.422 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 38937 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-10-06T02:46:06.423 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 40529 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-10-06T02:46:06.423 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 58585 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-10-06T02:46:06.423 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 50497 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-10-06T02:46:06.423 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 32065 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-10-06T02:46:06.423 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13625 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-10-06T02:46:06.423 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/ 2023-10-06T02:46:06.423 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu/ 2023-10-06T02:46:06.423 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu/mce/ 2023-10-06T02:46:06.423 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 40113 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-10-06T02:46:06.424 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13281 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpuid.ko 2023-10-06T02:46:06.424 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17865 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/msr.ko 2023-10-06T02:46:06.424 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/ 2023-10-06T02:46:06.424 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 348201 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm-amd.ko 2023-10-06T02:46:06.424 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 882105 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm-intel.ko 2023-10-06T02:46:06.424 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 2277369 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm.ko 2023-10-06T02:46:06.437 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/ 2023-10-06T02:46:06.438 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 53585 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/af_alg.ko 2023-10-06T02:46:06.438 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 23097 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/algif_hash.ko 2023-10-06T02:46:06.438 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20049 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/algif_skcipher.ko 2023-10-06T02:46:06.438 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17209 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/ansi_cprng.ko 2023-10-06T02:46:06.438 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19641 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/anubis.ko 2023-10-06T02:46:06.438 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10145 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/arc4.ko 2023-10-06T02:46:06.438 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/asymmetric_keys/ 2023-10-06T02:46:06.439 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10185 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2023-10-06T02:46:06.439 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/ 2023-10-06T02:46:06.439 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11249 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_memcpy.ko 2023-10-06T02:46:06.439 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19473 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_pq.ko 2023-10-06T02:46:06.439 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21561 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_raid6_recov.ko 2023-10-06T02:46:06.439 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13825 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_tx.ko 2023-10-06T02:46:06.439 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17745 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_xor.ko 2023-10-06T02:46:06.439 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17921 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/raid6test.ko 2023-10-06T02:46:06.439 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20489 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/authenc.ko 2023-10-06T02:46:06.439 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 22641 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/authencesn.ko 2023-10-06T02:46:06.439 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21817 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blake2b_generic.ko 2023-10-06T02:46:06.439 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12729 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blowfish_common.ko 2023-10-06T02:46:06.439 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10537 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blowfish_generic.ko 2023-10-06T02:46:06.440 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 38873 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/camellia_generic.ko 2023-10-06T02:46:06.440 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 27321 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast5_generic.ko 2023-10-06T02:46:06.440 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17745 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast6_generic.ko 2023-10-06T02:46:06.440 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10537 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast_common.ko 2023-10-06T02:46:06.440 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 35097 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/ccm.ko 2023-10-06T02:46:06.440 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14769 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cmac.ko 2023-10-06T02:46:06.440 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9585 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crc32_generic.ko 2023-10-06T02:46:06.440 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 46961 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cryptd.ko 2023-10-06T02:46:06.440 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 25249 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crypto_engine.ko 2023-10-06T02:46:06.440 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 26953 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crypto_simd.ko 2023-10-06T02:46:06.440 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 24737 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crypto_user.ko 2023-10-06T02:46:06.440 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17729 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cts.ko 2023-10-06T02:46:06.441 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10913 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/des_generic.ko 2023-10-06T02:46:06.441 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15681 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/dh_generic.ko 2023-10-06T02:46:06.441 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11001 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/echainiv.ko 2023-10-06T02:46:06.441 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 25321 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/essiv.ko 2023-10-06T02:46:06.441 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17993 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/fcrypt.ko 2023-10-06T02:46:06.441 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 26897 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/khazad.ko 2023-10-06T02:46:06.441 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15649 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/lrw.ko 2023-10-06T02:46:06.441 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11513 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/lz4.ko 2023-10-06T02:46:06.441 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11529 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/lz4hc.ko 2023-10-06T02:46:06.441 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11761 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/md4.ko 2023-10-06T02:46:06.441 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9729 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/michael_mic.ko 2023-10-06T02:46:06.441 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10673 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/pcbc.ko 2023-10-06T02:46:06.441 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18745 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/pcrypt.ko 2023-10-06T02:46:06.442 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16049 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/rmd160.ko 2023-10-06T02:46:06.442 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 29393 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/seed.ko 2023-10-06T02:46:06.442 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 27081 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/serpent_generic.ko 2023-10-06T02:46:06.442 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 149193 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/tcrypt.ko 2023-10-06T02:46:06.442 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10881 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/tea.ko 2023-10-06T02:46:06.442 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 28777 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/twofish_common.ko 2023-10-06T02:46:06.442 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13233 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/twofish_generic.ko 2023-10-06T02:46:06.442 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17401 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/vmac.ko 2023-10-06T02:46:06.442 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 36185 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/wp512.ko 2023-10-06T02:46:06.442 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14105 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xcbc.ko 2023-10-06T02:46:06.442 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 26665 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xor.ko 2023-10-06T02:46:06.442 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18713 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xts.ko 2023-10-06T02:46:06.443 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9481 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xxhash_generic.ko 2023-10-06T02:46:06.443 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ 2023-10-06T02:46:06.443 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/ 2023-10-06T02:46:06.443 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18249 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/acpi_extlog.ko 2023-10-06T02:46:06.443 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 26969 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/acpi_ipmi.ko 2023-10-06T02:46:06.443 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 28793 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/acpi_pad.ko 2023-10-06T02:46:06.443 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/apei/ 2023-10-06T02:46:06.443 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 31241 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/apei/einj.ko 2023-10-06T02:46:06.443 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12801 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/ec_sys.ko 2023-10-06T02:46:06.443 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14937 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/platform_profile.ko 2023-10-06T02:46:06.443 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 24401 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/sbs.ko 2023-10-06T02:46:06.443 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19521 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/sbshc.ko 2023-10-06T02:46:06.443 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 100401 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/video.ko 2023-10-06T02:46:06.444 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/ 2023-10-06T02:46:06.444 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21473 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/acard-ahci.ko 2023-10-06T02:46:06.444 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 88625 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/ahci.ko 2023-10-06T02:46:06.444 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14593 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/ahci_platform.ko 2023-10-06T02:46:06.444 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 87841 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/libahci.ko 2023-10-06T02:46:06.444 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 35049 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/libahci_platform.ko 2023-10-06T02:46:06.444 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17009 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_acpi.ko 2023-10-06T02:46:06.444 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 30553 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ali.ko 2023-10-06T02:46:06.444 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 33625 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_amd.ko 2023-10-06T02:46:06.444 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21201 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_artop.ko 2023-10-06T02:46:06.444 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21049 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_atiixp.ko 2023-10-06T02:46:06.444 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 24809 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_atp867x.ko 2023-10-06T02:46:06.445 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17585 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cmd640.ko 2023-10-06T02:46:06.445 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 25241 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cmd64x.ko 2023-10-06T02:46:06.445 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14921 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cypress.ko 2023-10-06T02:46:06.445 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17721 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_efar.ko 2023-10-06T02:46:06.445 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21809 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt366.ko 2023-10-06T02:46:06.445 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 34033 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt37x.ko 2023-10-06T02:46:06.445 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 23057 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt3x2n.ko 2023-10-06T02:46:06.445 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16793 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt3x3.ko 2023-10-06T02:46:06.445 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16857 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_it8213.ko 2023-10-06T02:46:06.445 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 35177 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_it821x.ko 2023-10-06T02:46:06.445 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12753 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_jmicron.ko 2023-10-06T02:46:06.445 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 51737 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_legacy.ko 2023-10-06T02:46:06.446 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15057 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_marvell.ko 2023-10-06T02:46:06.446 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16153 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_mpiix.ko 2023-10-06T02:46:06.446 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12705 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_netcell.ko 2023-10-06T02:46:06.446 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16681 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ninja32.ko 2023-10-06T02:46:06.446 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14969 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ns87410.ko 2023-10-06T02:46:06.446 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17225 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ns87415.ko 2023-10-06T02:46:06.446 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16433 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_oldpiix.ko 2023-10-06T02:46:06.446 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15249 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_opti.ko 2023-10-06T02:46:06.446 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20609 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_optidma.ko 2023-10-06T02:46:06.446 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 32521 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pcmcia.ko 2023-10-06T02:46:06.446 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 37729 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pdc2027x.ko 2023-10-06T02:46:06.446 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20489 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-10-06T02:46:06.446 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14097 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_piccolo.ko 2023-10-06T02:46:06.447 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15321 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_radisys.ko 2023-10-06T02:46:06.447 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19449 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_rdc.ko 2023-10-06T02:46:06.447 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15201 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_rz1000.ko 2023-10-06T02:46:06.447 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13809 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sch.ko 2023-10-06T02:46:06.447 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 23001 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_serverworks.ko 2023-10-06T02:46:06.447 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 23385 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sil680.ko 2023-10-06T02:46:06.447 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19569 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sl82c105.ko 2023-10-06T02:46:06.447 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15881 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_triflex.ko 2023-10-06T02:46:06.447 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 30425 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_via.ko 2023-10-06T02:46:06.447 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 22729 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pdc_adma.ko 2023-10-06T02:46:06.447 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 28993 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_inic162x.ko 2023-10-06T02:46:06.447 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 83225 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_mv.ko 2023-10-06T02:46:06.448 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 70537 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_nv.ko 2023-10-06T02:46:06.448 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 37369 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_promise.ko 2023-10-06T02:46:06.448 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 22969 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_qstor.ko 2023-10-06T02:46:06.448 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 29201 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sil.ko 2023-10-06T02:46:06.448 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 38273 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sil24.ko 2023-10-06T02:46:06.448 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17873 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sis.ko 2023-10-06T02:46:06.448 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20305 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_svw.ko 2023-10-06T02:46:06.448 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 44721 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sx4.ko 2023-10-06T02:46:06.448 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15465 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_uli.ko 2023-10-06T02:46:06.448 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 35121 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_via.ko 2023-10-06T02:46:06.448 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20001 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_vsc.ko 2023-10-06T02:46:06.448 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/auxdisplay/ 2023-10-06T02:46:06.448 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16289 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/auxdisplay/ks0108.ko 2023-10-06T02:46:06.449 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/bcma/ 2023-10-06T02:46:06.449 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 124457 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/bcma/bcma.ko 2023-10-06T02:46:06.449 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/ 2023-10-06T02:46:06.449 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/aoe/ 2023-10-06T02:46:06.449 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 113705 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/aoe/aoe.ko 2023-10-06T02:46:06.449 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/drbd/ 2023-10-06T02:46:06.449 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 968433 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/drbd/drbd.ko 2023-10-06T02:46:06.449 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 173201 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/floppy.ko 2023-10-06T02:46:06.449 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/mtip32xx/ 2023-10-06T02:46:06.449 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 94297 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-10-06T02:46:06.449 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 115345 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/nbd.ko 2023-10-06T02:46:06.449 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/null_blk/ 2023-10-06T02:46:06.449 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 110361 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/null_blk/null_blk.ko 2023-10-06T02:46:06.450 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 98225 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/pktcdvd.ko 2023-10-06T02:46:06.450 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 259401 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/rbd.ko 2023-10-06T02:46:06.450 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkback/ 2023-10-06T02:46:06.450 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 98129 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-10-06T02:46:06.498 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/zram/ 2023-10-06T02:46:06.498 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 60265 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/zram/zram.ko 2023-10-06T02:46:06.498 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ 2023-10-06T02:46:06.498 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 30849 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/applicom.ko 2023-10-06T02:46:06.498 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12009 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hangcheck-timer.ko 2023-10-06T02:46:06.499 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/ 2023-10-06T02:46:06.499 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13889 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/amd-rng.ko 2023-10-06T02:46:06.499 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18809 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/intel-rng.ko 2023-10-06T02:46:06.499 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13385 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-10-06T02:46:06.499 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10673 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/via-rng.ko 2023-10-06T02:46:06.499 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15633 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/virtio-rng.ko 2023-10-06T02:46:06.499 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ 2023-10-06T02:46:06.499 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 30857 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-10-06T02:46:06.499 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 150665 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-10-06T02:46:06.499 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 26561 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-10-06T02:46:06.499 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 139057 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_si.ko 2023-10-06T02:46:06.499 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 70833 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-10-06T02:46:06.500 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 53609 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-10-06T02:46:06.500 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 36321 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/lp.ko 2023-10-06T02:46:06.500 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/mwave/ 2023-10-06T02:46:06.500 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 84121 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/mwave/mwave.ko 2023-10-06T02:46:06.500 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 25873 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/nvram.ko 2023-10-06T02:46:06.500 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 32169 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ppdev.ko 2023-10-06T02:46:06.500 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 51113 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tlclk.ko 2023-10-06T02:46:06.500 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/ 2023-10-06T02:46:06.500 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16401 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_atmel.ko 2023-10-06T02:46:06.500 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15881 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2023-10-06T02:46:06.500 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 23473 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2023-10-06T02:46:06.500 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 32985 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2023-10-06T02:46:06.500 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 30121 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_infineon.ko 2023-10-06T02:46:06.501 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 22697 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_nsc.ko 2023-10-06T02:46:06.501 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 23561 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/xen-tpmfront.ko 2023-10-06T02:46:06.501 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/xillybus/ 2023-10-06T02:46:06.501 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16985 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/xillybus/xillybus_class.ko 2023-10-06T02:46:06.501 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 50945 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/xillybus/xillybus_core.ko 2023-10-06T02:46:06.501 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12393 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/xillybus/xillybus_pcie.ko 2023-10-06T02:46:06.501 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/clk/ 2023-10-06T02:46:06.501 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12489 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/clk/clk-palmas.ko 2023-10-06T02:46:06.501 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 47849 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/clk/clk-si5351.ko 2023-10-06T02:46:06.501 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11457 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/clk/clk-twl6040.ko 2023-10-06T02:46:06.501 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19313 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/clk/clk-wm831x.ko 2023-10-06T02:46:06.501 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/ 2023-10-06T02:46:06.502 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10097 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-10-06T02:46:06.502 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16833 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/p4-clockmod.ko 2023-10-06T02:46:06.502 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 25297 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/speedstep-lib.ko 2023-10-06T02:46:06.502 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ 2023-10-06T02:46:06.502 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp/ 2023-10-06T02:46:06.502 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 70785 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-10-06T02:46:06.502 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 234473 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp/ccp.ko 2023-10-06T02:46:06.502 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/ 2023-10-06T02:46:06.502 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/ 2023-10-06T02:46:06.502 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_common/ 2023-10-06T02:46:06.502 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 408489 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-10-06T02:46:06.502 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2023-10-06T02:46:06.503 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 23657 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-10-06T02:46:06.503 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19937 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/padlock-aes.ko 2023-10-06T02:46:06.503 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21537 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/padlock-sha.ko 2023-10-06T02:46:06.503 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/virtio/ 2023-10-06T02:46:06.503 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 68937 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-10-06T02:46:06.503 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dca/ 2023-10-06T02:46:06.503 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 29785 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dca/dca.ko 2023-10-06T02:46:06.503 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/ 2023-10-06T02:46:06.503 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/dw/ 2023-10-06T02:46:06.503 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15857 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/dw/dw_dmac.ko 2023-10-06T02:46:06.504 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/ioat/ 2023-10-06T02:46:06.504 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 122641 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/ioat/ioatdma.ko 2023-10-06T02:46:06.504 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/ 2023-10-06T02:46:06.504 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 80273 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/amd64_edac.ko 2023-10-06T02:46:06.504 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 35769 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/e752x_edac.ko 2023-10-06T02:46:06.504 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 63617 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/edac_mce_amd.ko 2023-10-06T02:46:06.504 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18105 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i3000_edac.ko 2023-10-06T02:46:06.504 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18065 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i3200_edac.ko 2023-10-06T02:46:06.504 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 22537 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i5100_edac.ko 2023-10-06T02:46:06.504 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 25657 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i5400_edac.ko 2023-10-06T02:46:06.504 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 24913 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i7300_edac.ko 2023-10-06T02:46:06.505 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 52025 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i7core_edac.ko 2023-10-06T02:46:06.505 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18433 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i82975x_edac.ko 2023-10-06T02:46:06.505 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20017 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/ie31200_edac.ko 2023-10-06T02:46:06.505 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 56809 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/sb_edac.ko 2023-10-06T02:46:06.505 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17529 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/x38_edac.ko 2023-10-06T02:46:06.505 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/extcon/ 2023-10-06T02:46:06.505 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12673 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/extcon/extcon-gpio.ko 2023-10-06T02:46:06.505 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 27185 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/extcon/extcon-max14577.ko 2023-10-06T02:46:06.505 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 29569 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/extcon/extcon-max77693.ko 2023-10-06T02:46:06.505 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 24745 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/extcon/extcon-max8997.ko 2023-10-06T02:46:06.505 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 26537 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/extcon/extcon-palmas.ko 2023-10-06T02:46:06.505 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 23713 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/extcon/extcon-rt8973a.ko 2023-10-06T02:46:06.505 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 27785 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/extcon/extcon-sm5502.ko 2023-10-06T02:46:06.506 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware/ 2023-10-06T02:46:06.506 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 34953 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware/dmi-sysfs.ko 2023-10-06T02:46:06.506 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware/efi/ 2023-10-06T02:46:06.506 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15521 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware/efi/efi-pstore.ko 2023-10-06T02:46:06.506 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20889 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware/iscsi_ibft.ko 2023-10-06T02:46:06.506 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/ 2023-10-06T02:46:06.506 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12305 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-adp5520.ko 2023-10-06T02:46:06.506 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20153 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-amd8111.ko 2023-10-06T02:46:06.506 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14993 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-arizona.ko 2023-10-06T02:46:06.507 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13841 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-da9052.ko 2023-10-06T02:46:06.507 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11921 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-da9055.ko 2023-10-06T02:46:06.507 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 22065 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-dln2.ko 2023-10-06T02:46:06.507 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 77849 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-f7188x.ko 2023-10-06T02:46:06.507 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 28649 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-generic.ko 2023-10-06T02:46:06.507 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19569 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-ich.ko 2023-10-06T02:46:06.507 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11969 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-janz-ttl.ko 2023-10-06T02:46:06.507 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14113 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-kempld.ko 2023-10-06T02:46:06.507 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12673 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-lp3943.ko 2023-10-06T02:46:06.507 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9505 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-max7300.ko 2023-10-06T02:46:06.507 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11969 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-max730x.ko 2023-10-06T02:46:06.507 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18577 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-max732x.ko 2023-10-06T02:46:06.507 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 25145 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-ml-ioh.ko 2023-10-06T02:46:06.508 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 46761 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-pca953x.ko 2023-10-06T02:46:06.508 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 26833 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-pcf857x.ko 2023-10-06T02:46:06.508 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14377 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-rdc321x.ko 2023-10-06T02:46:06.508 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20593 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-sch.ko 2023-10-06T02:46:06.508 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19505 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-sch311x.ko 2023-10-06T02:46:06.508 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12145 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-tps65912.ko 2023-10-06T02:46:06.508 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21057 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-twl4030.ko 2023-10-06T02:46:06.508 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11425 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-twl6040.ko 2023-10-06T02:46:06.508 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20601 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-viperboard.ko 2023-10-06T02:46:06.508 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15449 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-vx855.ko 2023-10-06T02:46:06.508 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16281 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-wm831x.ko 2023-10-06T02:46:06.508 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11617 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-wm8350.ko 2023-10-06T02:46:06.509 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16753 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-wm8994.ko 2023-10-06T02:46:06.509 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/ 2023-10-06T02:46:06.509 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11577 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-a4tech.ko 2023-10-06T02:46:06.509 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 39081 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-apple.ko 2023-10-06T02:46:06.509 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14481 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-appleir.ko 2023-10-06T02:46:06.509 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8353 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-aureal.ko 2023-10-06T02:46:06.509 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15169 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-axff.ko 2023-10-06T02:46:06.509 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11049 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-belkin.ko 2023-10-06T02:46:06.509 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10313 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-cherry.ko 2023-10-06T02:46:06.509 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16041 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-chicony.ko 2023-10-06T02:46:06.510 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 59145 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-cp2112.ko 2023-10-06T02:46:06.510 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11049 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-cypress.ko 2023-10-06T02:46:06.510 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16385 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-dr.ko 2023-10-06T02:46:06.510 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10697 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-elecom.ko 2023-10-06T02:46:06.510 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17665 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-elo.ko 2023-10-06T02:46:06.510 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13457 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-emsff.ko 2023-10-06T02:46:06.510 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10105 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-ezkey.ko 2023-10-06T02:46:06.510 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14305 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gaff.ko 2023-10-06T02:46:06.510 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9225 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-generic.ko 2023-10-06T02:46:06.510 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17129 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gt683r.ko 2023-10-06T02:46:06.510 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12681 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gyration.ko 2023-10-06T02:46:06.511 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9881 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtek-kbd.ko 2023-10-06T02:46:06.511 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10457 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtek-mouse.ko 2023-10-06T02:46:06.511 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14449 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtekff.ko 2023-10-06T02:46:06.511 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19105 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-hyperv.ko 2023-10-06T02:46:06.511 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10489 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-icade.ko 2023-10-06T02:46:06.511 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9241 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-kensington.ko 2023-10-06T02:46:06.511 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8545 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-keytouch.ko 2023-10-06T02:46:06.511 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17201 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-kye.ko 2023-10-06T02:46:06.511 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10809 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-lcpower.ko 2023-10-06T02:46:06.512 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20497 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-led.ko 2023-10-06T02:46:06.512 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 42297 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-lenovo.ko 2023-10-06T02:46:06.512 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 30761 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-lg-g15.ko 2023-10-06T02:46:06.512 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 57809 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-logitech-dj.ko 2023-10-06T02:46:06.512 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 101009 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-10-06T02:46:06.512 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 80993 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-logitech.ko 2023-10-06T02:46:06.512 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 30801 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-magicmouse.ko 2023-10-06T02:46:06.513 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21969 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-microsoft.ko 2023-10-06T02:46:06.513 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10361 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-monterey.ko 2023-10-06T02:46:06.513 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 50153 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-multitouch.ko 2023-10-06T02:46:06.513 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 32593 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-ntrig.ko 2023-10-06T02:46:06.513 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8857 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-ortek.ko 2023-10-06T02:46:06.513 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9121 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-penmount.ko 2023-10-06T02:46:06.513 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12289 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-petalynx.ko 2023-10-06T02:46:06.513 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 72937 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-picolcd.ko 2023-10-06T02:46:06.513 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14225 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-pl.ko 2023-10-06T02:46:06.513 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15105 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-plantronics.ko 2023-10-06T02:46:06.514 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8417 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-primax.ko 2023-10-06T02:46:06.514 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 35457 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-rmi.ko 2023-10-06T02:46:06.514 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20761 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-arvo.ko 2023-10-06T02:46:06.514 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14065 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-common.ko 2023-10-06T02:46:06.514 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 31361 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-isku.ko 2023-10-06T02:46:06.514 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 29657 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-kone.ko 2023-10-06T02:46:06.514 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 31065 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-10-06T02:46:06.514 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21097 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-konepure.ko 2023-10-06T02:46:06.514 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 29417 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-10-06T02:46:06.514 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13305 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-lua.ko 2023-10-06T02:46:06.514 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 29241 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-pyra.ko 2023-10-06T02:46:06.515 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 27889 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-ryos.ko 2023-10-06T02:46:06.515 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19473 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-savu.ko 2023-10-06T02:46:06.515 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 23393 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat.ko 2023-10-06T02:46:06.515 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13681 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-saitek.ko 2023-10-06T02:46:06.515 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15193 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-samsung.ko 2023-10-06T02:46:06.515 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 36801 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sensor-hub.ko 2023-10-06T02:46:06.515 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13601 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sjoy.ko 2023-10-06T02:46:06.515 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 51201 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sony.ko 2023-10-06T02:46:06.515 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8313 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-speedlink.ko 2023-10-06T02:46:06.515 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14881 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-steelseries.ko 2023-10-06T02:46:06.515 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9817 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sunplus.ko 2023-10-06T02:46:06.516 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16993 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-thrustmaster.ko 2023-10-06T02:46:06.516 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10537 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-tivo.ko 2023-10-06T02:46:06.516 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15089 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-tmff.ko 2023-10-06T02:46:06.516 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14385 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-topseed.ko 2023-10-06T02:46:06.516 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16473 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-twinhan.ko 2023-10-06T02:46:06.516 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 71457 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-uclogic.ko 2023-10-06T02:46:06.516 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10921 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-waltop.ko 2023-10-06T02:46:06.516 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 143585 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-wiimote.ko 2023-10-06T02:46:06.516 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8153 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-xinmo.ko 2023-10-06T02:46:06.516 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13321 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-zpff.ko 2023-10-06T02:46:06.516 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16665 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-zydacron.ko 2023-10-06T02:46:06.516 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 267689 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid.ko 2023-10-06T02:46:06.517 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 32321 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/uhid.ko 2023-10-06T02:46:06.517 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/usbhid/ 2023-10-06T02:46:06.517 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 125721 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/usbhid/usbhid.ko 2023-10-06T02:46:06.517 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19137 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/usbhid/usbkbd.ko 2023-10-06T02:46:06.517 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14953 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/usbhid/usbmouse.ko 2023-10-06T02:46:06.517 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 217401 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/wacom.ko 2023-10-06T02:46:06.517 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/ 2023-10-06T02:46:06.517 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 63497 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_balloon.ko 2023-10-06T02:46:06.517 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 89609 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_utils.ko 2023-10-06T02:46:06.517 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 301449 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_vmbus.ko 2023-10-06T02:46:06.518 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ 2023-10-06T02:46:06.518 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 66593 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/abituguru.ko 2023-10-06T02:46:06.518 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 61393 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/abituguru3.ko 2023-10-06T02:46:06.518 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 34745 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/acpi_power_meter.ko 2023-10-06T02:46:06.518 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17505 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ad7414.ko 2023-10-06T02:46:06.518 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19313 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ad7418.ko 2023-10-06T02:46:06.518 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 25257 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adc128d818.ko 2023-10-06T02:46:06.518 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 31729 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1025.ko 2023-10-06T02:46:06.518 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 97977 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1026.ko 2023-10-06T02:46:06.518 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19745 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1029.ko 2023-10-06T02:46:06.519 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 45553 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1031.ko 2023-10-06T02:46:06.519 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 26289 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm9240.ko 2023-10-06T02:46:06.519 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14769 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ads7828.ko 2023-10-06T02:46:06.519 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10769 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7410.ko 2023-10-06T02:46:06.519 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 22049 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7411.ko 2023-10-06T02:46:06.519 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 74433 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7462.ko 2023-10-06T02:46:06.519 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 39585 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7470.ko 2023-10-06T02:46:06.519 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 67929 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7475.ko 2023-10-06T02:46:06.519 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19625 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7x10.ko 2023-10-06T02:46:06.519 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 39073 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/amc6821.ko 2023-10-06T02:46:06.520 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 55265 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/applesmc.ko 2023-10-06T02:46:06.520 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 49913 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asb100.ko 2023-10-06T02:46:06.520 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 58617 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asc7621.ko 2023-10-06T02:46:06.520 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 40881 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asus_atk0110.ko 2023-10-06T02:46:06.520 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17225 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/atxp1.ko 2023-10-06T02:46:06.520 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 28281 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/coretemp.ko 2023-10-06T02:46:06.520 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 24657 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/da9052-hwmon.ko 2023-10-06T02:46:06.520 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17265 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/da9055-hwmon.ko 2023-10-06T02:46:06.520 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 44465 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-10-06T02:46:06.520 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 99601 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/dme1737.ko 2023-10-06T02:46:06.520 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19489 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ds1621.ko 2023-10-06T02:46:06.521 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15321 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ds620.ko 2023-10-06T02:46:06.521 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 29777 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/emc1403.ko 2023-10-06T02:46:06.521 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 33185 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/emc2103.ko 2023-10-06T02:46:06.521 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 30321 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/emc6w201.ko 2023-10-06T02:46:06.521 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 66985 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f71805f.ko 2023-10-06T02:46:06.521 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 94457 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f71882fg.ko 2023-10-06T02:46:06.521 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 41401 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f75375s.ko 2023-10-06T02:46:06.521 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21305 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/fam15h_power.ko 2023-10-06T02:46:06.521 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 55433 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/fschmd.ko 2023-10-06T02:46:06.521 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14481 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/g760a.ko 2023-10-06T02:46:06.521 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 24017 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/g762.ko 2023-10-06T02:46:06.521 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 46801 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/gl518sm.ko 2023-10-06T02:46:06.522 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 45529 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/gl520sm.ko 2023-10-06T02:46:06.522 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13273 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/hih6130.ko 2023-10-06T02:46:06.522 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9745 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/hwmon-vid.ko 2023-10-06T02:46:06.522 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11553 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/i5500_temp.ko 2023-10-06T02:46:06.522 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 22601 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/i5k_amb.ko 2023-10-06T02:46:06.522 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 34505 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ibmaem.ko 2023-10-06T02:46:06.522 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21297 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ibmpex.ko 2023-10-06T02:46:06.522 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 24873 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ina209.ko 2023-10-06T02:46:06.522 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13401 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ina2xx.ko 2023-10-06T02:46:06.522 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 129217 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/it87.ko 2023-10-06T02:46:06.522 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18841 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/jc42.ko 2023-10-06T02:46:06.522 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 24025 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/k10temp.ko 2023-10-06T02:46:06.523 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13553 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/k8temp.ko 2023-10-06T02:46:06.523 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18929 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lineage-pem.ko 2023-10-06T02:46:06.523 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 48601 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm63.ko 2023-10-06T02:46:06.523 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16761 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm73.ko 2023-10-06T02:46:06.523 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 36777 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm75.ko 2023-10-06T02:46:06.523 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19537 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm77.ko 2023-10-06T02:46:06.523 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 34657 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm78.ko 2023-10-06T02:46:06.523 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 31745 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm80.ko 2023-10-06T02:46:06.524 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16889 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm83.ko 2023-10-06T02:46:06.524 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 72833 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm85.ko 2023-10-06T02:46:06.524 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 46153 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm87.ko 2023-10-06T02:46:06.524 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 37913 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm90.ko 2023-10-06T02:46:06.524 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19745 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm92.ko 2023-10-06T02:46:06.524 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 108841 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm93.ko 2023-10-06T02:46:06.524 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 33393 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95234.ko 2023-10-06T02:46:06.524 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16265 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95241.ko 2023-10-06T02:46:06.524 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18113 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95245.ko 2023-10-06T02:46:06.525 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 24017 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc2945.ko 2023-10-06T02:46:06.525 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13793 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4151.ko 2023-10-06T02:46:06.525 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15193 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4215.ko 2023-10-06T02:46:06.525 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14953 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4222.ko 2023-10-06T02:46:06.525 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14825 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4245.ko 2023-10-06T02:46:06.525 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13249 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4260.ko 2023-10-06T02:46:06.525 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14993 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4261.ko 2023-10-06T02:46:06.525 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 33489 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max16065.ko 2023-10-06T02:46:06.525 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18433 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max1619.ko 2023-10-06T02:46:06.525 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 24353 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max1668.ko 2023-10-06T02:46:06.526 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19969 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max197.ko 2023-10-06T02:46:06.526 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 26617 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6639.ko 2023-10-06T02:46:06.526 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 23321 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6650.ko 2023-10-06T02:46:06.526 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 35777 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6697.ko 2023-10-06T02:46:06.526 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18585 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/mc13783-adc.ko 2023-10-06T02:46:06.526 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10585 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/mcp3021.ko 2023-10-06T02:46:06.526 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15937 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2023-10-06T02:46:06.526 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 44129 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6683.ko 2023-10-06T02:46:06.526 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 116697 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6775-core.ko 2023-10-06T02:46:06.526 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 60705 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6775.ko 2023-10-06T02:46:06.526 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 59737 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct7802.ko 2023-10-06T02:46:06.526 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 82337 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pc87360.ko 2023-10-06T02:46:06.527 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 54433 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pc87427.ko 2023-10-06T02:46:06.527 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18473 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pcf8591.ko 2023-10-06T02:46:06.527 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ 2023-10-06T02:46:06.527 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21353 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-10-06T02:46:06.527 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17065 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-10-06T02:46:06.527 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 28329 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-10-06T02:46:06.527 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9577 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max16064.ko 2023-10-06T02:46:06.527 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17657 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max34440.ko 2023-10-06T02:46:06.528 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10169 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max8688.ko 2023-10-06T02:46:06.528 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15505 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-10-06T02:46:06.528 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 81841 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-10-06T02:46:06.528 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8729 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-10-06T02:46:06.528 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 30729 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-10-06T02:46:06.528 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15073 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-10-06T02:46:06.528 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20681 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-10-06T02:46:06.528 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13017 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/powr1220.ko 2023-10-06T02:46:06.528 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18705 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch5627.ko 2023-10-06T02:46:06.528 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 28817 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch5636.ko 2023-10-06T02:46:06.529 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 27145 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch56xx-common.ko 2023-10-06T02:46:06.529 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 32137 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sht15.ko 2023-10-06T02:46:06.529 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13505 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sht21.ko 2023-10-06T02:46:06.529 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16833 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/shtc1.ko 2023-10-06T02:46:06.529 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 40105 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sis5595.ko 2023-10-06T02:46:06.529 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 31929 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smm665.ko 2023-10-06T02:46:06.529 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19577 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47b397.ko 2023-10-06T02:46:06.529 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 39193 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47m1.ko 2023-10-06T02:46:06.530 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 37385 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47m192.ko 2023-10-06T02:46:06.530 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 26553 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/thmc50.ko 2023-10-06T02:46:06.530 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17057 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp102.ko 2023-10-06T02:46:06.530 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14097 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp103.ko 2023-10-06T02:46:06.530 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21257 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp401.ko 2023-10-06T02:46:06.530 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19537 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp421.ko 2023-10-06T02:46:06.530 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19697 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/via-cputemp.ko 2023-10-06T02:46:06.530 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 41945 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/via686a.ko 2023-10-06T02:46:06.530 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 52457 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/vt1211.ko 2023-10-06T02:46:06.531 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 51545 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/vt8231.ko 2023-10-06T02:46:06.531 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 57513 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83627ehf.ko 2023-10-06T02:46:06.531 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 78873 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83627hf.ko 2023-10-06T02:46:06.531 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 71345 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83781d.ko 2023-10-06T02:46:06.531 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 63289 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83791d.ko 2023-10-06T02:46:06.531 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 71321 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83792d.ko 2023-10-06T02:46:06.531 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 101457 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83793.ko 2023-10-06T02:46:06.531 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 119505 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83795.ko 2023-10-06T02:46:06.531 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17313 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83l785ts.ko 2023-10-06T02:46:06.532 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 35625 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83l786ng.ko 2023-10-06T02:46:06.532 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13825 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/wm831x-hwmon.ko 2023-10-06T02:46:06.532 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10625 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/wm8350-hwmon.ko 2023-10-06T02:46:06.532 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/ 2023-10-06T02:46:06.532 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos/ 2023-10-06T02:46:06.532 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20049 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-10-06T02:46:06.532 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19345 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-10-06T02:46:06.532 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/ 2023-10-06T02:46:06.532 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 27969 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-ali1535.ko 2023-10-06T02:46:06.533 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 28801 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-ali1563.ko 2023-10-06T02:46:06.533 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 27777 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2023-10-06T02:46:06.533 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17937 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-10-06T02:46:06.533 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 26193 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-10-06T02:46:06.533 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16201 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-10-06T02:46:06.533 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15153 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2023-10-06T02:46:06.533 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 6929 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-10-06T02:46:06.533 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13961 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2023-10-06T02:46:06.533 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 48641 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-10-06T02:46:06.533 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 23905 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-10-06T02:46:06.534 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20001 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-10-06T02:46:06.534 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17337 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-10-06T02:46:06.534 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12393 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-dln2.ko 2023-10-06T02:46:06.534 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17585 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-gpio.ko 2023-10-06T02:46:06.534 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 62729 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-i801.ko 2023-10-06T02:46:06.534 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 22433 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-isch.ko 2023-10-06T02:46:06.534 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 47889 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-10-06T02:46:06.534 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17369 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-kempld.ko 2023-10-06T02:46:06.534 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17881 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-10-06T02:46:06.534 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 22337 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-10-06T02:46:06.534 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 26329 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-ocores.ko 2023-10-06T02:46:06.535 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 25121 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-parport.ko 2023-10-06T02:46:06.535 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16497 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-10-06T02:46:06.535 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 47241 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-10-06T02:46:06.535 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15289 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2023-10-06T02:46:06.535 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18649 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-10-06T02:46:06.535 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11809 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-10-06T02:46:06.535 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 22313 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-sis5595.ko 2023-10-06T02:46:06.535 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 29361 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-sis630.ko 2023-10-06T02:46:06.535 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20329 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-10-06T02:46:06.535 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19241 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2023-10-06T02:46:06.535 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19809 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-10-06T02:46:06.536 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13801 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-via.ko 2023-10-06T02:46:06.536 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 26081 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-10-06T02:46:06.536 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19041 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-10-06T02:46:06.536 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 47593 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-xiic.ko 2023-10-06T02:46:06.536 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 22385 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-mux.ko 2023-10-06T02:46:06.536 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18825 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-smbus.ko 2023-10-06T02:46:06.536 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 27065 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-stub.ko 2023-10-06T02:46:06.536 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/muxes/ 2023-10-06T02:46:06.536 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14785 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2023-10-06T02:46:06.536 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13457 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2023-10-06T02:46:06.536 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 26865 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2023-10-06T02:46:06.537 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ 2023-10-06T02:46:06.537 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ 2023-10-06T02:46:06.537 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 273641 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_cm.ko 2023-10-06T02:46:06.537 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 876913 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_core.ko 2023-10-06T02:46:06.537 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 69321 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_umad.ko 2023-10-06T02:46:06.537 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 324145 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-10-06T02:46:06.537 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 97961 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/iw_cm.ko 2023-10-06T02:46:06.537 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 279345 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/rdma_cm.ko 2023-10-06T02:46:06.537 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 66177 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-10-06T02:46:06.538 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/ 2023-10-06T02:46:06.538 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/cxgb4/ 2023-10-06T02:46:06.538 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 492569 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-10-06T02:46:06.538 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx4/ 2023-10-06T02:46:06.538 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 419193 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-10-06T02:46:06.538 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx5/ 2023-10-06T02:46:06.538 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 739705 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-10-06T02:46:06.538 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mthca/ 2023-10-06T02:46:06.538 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 296649 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-10-06T02:46:06.538 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/ocrdma/ 2023-10-06T02:46:06.538 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 153681 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2023-10-06T02:46:06.538 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/usnic/ 2023-10-06T02:46:06.539 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 169017 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2023-10-06T02:46:06.539 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/ 2023-10-06T02:46:06.539 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/ipoib/ 2023-10-06T02:46:06.539 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 263177 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-10-06T02:46:06.539 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/iser/ 2023-10-06T02:46:06.539 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 100225 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-10-06T02:46:06.539 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/isert/ 2023-10-06T02:46:06.539 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 111993 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-10-06T02:46:06.539 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srp/ 2023-10-06T02:46:06.539 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 129081 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-10-06T02:46:06.539 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srpt/ 2023-10-06T02:46:06.540 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 129553 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-10-06T02:46:06.540 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/ 2023-10-06T02:46:06.540 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10745 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/evbug.ko 2023-10-06T02:46:06.540 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 24129 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/ff-memless.ko 2023-10-06T02:46:06.540 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/ 2023-10-06T02:46:06.540 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11881 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-10-06T02:46:06.540 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12145 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/fm801-gp.ko 2023-10-06T02:46:06.540 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 41217 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/gameport.ko 2023-10-06T02:46:06.540 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12497 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/lightning.ko 2023-10-06T02:46:06.541 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17529 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/ns558.ko 2023-10-06T02:46:06.541 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 41825 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/joydev.ko 2023-10-06T02:46:06.541 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/ 2023-10-06T02:46:06.541 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13313 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/adp5520-keys.ko 2023-10-06T02:46:06.541 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 30441 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/adp5588-keys.ko 2023-10-06T02:46:06.541 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 26905 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/adp5589-keys.ko 2023-10-06T02:46:06.541 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 24761 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2023-10-06T02:46:06.541 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 36649 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/gpio_keys.ko 2023-10-06T02:46:06.541 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18273 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2023-10-06T02:46:06.541 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21257 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/lkkbd.ko 2023-10-06T02:46:06.541 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 28121 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/lm8323.ko 2023-10-06T02:46:06.542 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15113 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/lm8333.ko 2023-10-06T02:46:06.542 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 24265 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/matrix_keypad.ko 2023-10-06T02:46:06.542 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18217 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/max7359_keypad.ko 2023-10-06T02:46:06.542 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15897 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/mcs_touchkey.ko 2023-10-06T02:46:06.542 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16489 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2023-10-06T02:46:06.542 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11585 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/newtonkbd.ko 2023-10-06T02:46:06.542 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11073 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/opencores-kbd.ko 2023-10-06T02:46:06.542 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15209 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/qt1070.ko 2023-10-06T02:46:06.542 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21121 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/qt2160.ko 2023-10-06T02:46:06.542 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 23817 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/samsung-keypad.ko 2023-10-06T02:46:06.542 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11481 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/stowaway.ko 2023-10-06T02:46:06.542 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18289 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/sunkbd.ko 2023-10-06T02:46:06.543 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20729 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/tca6416-keypad.ko 2023-10-06T02:46:06.543 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16177 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/tca8418_keypad.ko 2023-10-06T02:46:06.543 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16801 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/twl4030_keypad.ko 2023-10-06T02:46:06.543 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11753 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/xtkbd.ko 2023-10-06T02:46:06.543 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11465 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/matrix-keymap.ko 2023-10-06T02:46:06.543 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/ 2023-10-06T02:46:06.543 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 34329 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/appletouch.ko 2023-10-06T02:46:06.543 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 34177 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/bcm5974.ko 2023-10-06T02:46:06.543 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 123681 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/cyapatp.ko 2023-10-06T02:46:06.543 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 89449 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/elan_i2c.ko 2023-10-06T02:46:06.543 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14025 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/gpio_mouse.ko 2023-10-06T02:46:06.543 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 335849 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/psmouse.ko 2023-10-06T02:46:06.544 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14681 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/sermouse.ko 2023-10-06T02:46:06.544 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 23881 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-10-06T02:46:06.544 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 22569 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/synaptics_usb.ko 2023-10-06T02:46:06.544 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15665 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/vsxxxaa.ko 2023-10-06T02:46:06.544 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/rmi4/ 2023-10-06T02:46:06.544 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 109849 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/rmi4/rmi_core.ko 2023-10-06T02:46:06.544 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/ 2023-10-06T02:46:06.544 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11665 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/altera_ps2.ko 2023-10-06T02:46:06.544 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16289 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/arc_ps2.ko 2023-10-06T02:46:06.544 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16425 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/ct82c710.ko 2023-10-06T02:46:06.544 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16953 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-10-06T02:46:06.544 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15833 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/parkbd.ko 2023-10-06T02:46:06.545 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13225 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/pcips2.ko 2023-10-06T02:46:06.545 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20153 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/ps2mult.ko 2023-10-06T02:46:06.545 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 24129 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/serio_raw.ko 2023-10-06T02:46:06.545 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17977 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/serport.ko 2023-10-06T02:46:06.545 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13337 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/sparse-keymap.ko 2023-10-06T02:46:06.545 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu/ 2023-10-06T02:46:06.545 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu/amd/ 2023-10-06T02:46:06.545 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 38857 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu/amd/iommu_v2.ko 2023-10-06T02:46:06.545 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/ 2023-10-06T02:46:06.545 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13817 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-88pm860x.ko 2023-10-06T02:46:06.546 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11385 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-adp5520.ko 2023-10-06T02:46:06.546 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 59753 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-bd2802.ko 2023-10-06T02:46:06.546 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 24785 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-blinkm.ko 2023-10-06T02:46:06.546 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10473 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-da903x.ko 2023-10-06T02:46:06.546 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12241 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-da9052.ko 2023-10-06T02:46:06.546 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16561 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-gpio.ko 2023-10-06T02:46:06.546 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15793 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-lm3530.ko 2023-10-06T02:46:06.546 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 30505 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-lm3533.ko 2023-10-06T02:46:06.546 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19353 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-lm355x.ko 2023-10-06T02:46:06.546 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19961 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-lm3642.ko 2023-10-06T02:46:06.546 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16241 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-lp3944.ko 2023-10-06T02:46:06.546 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11233 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-lp8788.ko 2023-10-06T02:46:06.547 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14929 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-max8997.ko 2023-10-06T02:46:06.547 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12609 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-mc13783.ko 2023-10-06T02:46:06.547 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13385 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-menf21bmc.ko 2023-10-06T02:46:06.547 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20721 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-pca9532.ko 2023-10-06T02:46:06.547 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20481 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-pca955x.ko 2023-10-06T02:46:06.547 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17857 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-pca963x.ko 2023-10-06T02:46:06.547 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 34433 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-ss4200.ko 2023-10-06T02:46:06.547 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 24865 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-tca6507.ko 2023-10-06T02:46:06.547 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15665 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-wm831x-status.ko 2023-10-06T02:46:06.547 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11841 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-wm8350.ko 2023-10-06T02:46:06.547 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ 2023-10-06T02:46:06.547 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10049 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-10-06T02:46:06.548 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10873 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-10-06T02:46:06.548 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9089 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-10-06T02:46:06.548 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 7617 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-10-06T02:46:06.548 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14249 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-10-06T02:46:06.548 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14073 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-10-06T02:46:06.548 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11889 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-10-06T02:46:06.548 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14073 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-10-06T02:46:06.548 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/ 2023-10-06T02:46:06.548 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/bcache/ 2023-10-06T02:46:06.548 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 655473 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/bcache/bcache.ko 2023-10-06T02:46:06.548 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 40569 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-bio-prison.ko 2023-10-06T02:46:06.548 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 89601 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-bufio.ko 2023-10-06T02:46:06.548 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 47529 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-cache-smq.ko 2023-10-06T02:46:06.549 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 155993 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-cache.ko 2023-10-06T02:46:06.549 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 107049 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-crypt.ko 2023-10-06T02:46:06.549 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21521 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-delay.ko 2023-10-06T02:46:06.549 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 53897 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-era.ko 2023-10-06T02:46:06.549 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 28529 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-flakey.ko 2023-10-06T02:46:06.549 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 41593 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-log-userspace.ko 2023-10-06T02:46:06.549 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 32721 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-log.ko 2023-10-06T02:46:06.549 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 49545 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-mirror.ko 2023-10-06T02:46:06.549 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 78017 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-multipath.ko 2023-10-06T02:46:06.549 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16457 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-queue-length.ko 2023-10-06T02:46:06.549 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 70953 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-raid.ko 2023-10-06T02:46:06.549 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 36273 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-region-hash.ko 2023-10-06T02:46:06.550 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15857 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-round-robin.ko 2023-10-06T02:46:06.550 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16785 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-service-time.ko 2023-10-06T02:46:06.550 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 109593 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-snapshot.ko 2023-10-06T02:46:06.550 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19361 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-switch.ko 2023-10-06T02:46:06.550 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 181585 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-thin-pool.ko 2023-10-06T02:46:06.550 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 51737 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-verity.ko 2023-10-06T02:46:06.550 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8441 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-zero.ko 2023-10-06T02:46:06.550 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15105 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/faulty.ko 2023-10-06T02:46:06.550 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19433 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/linear.ko 2023-10-06T02:46:06.550 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 32305 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/multipath.ko 2023-10-06T02:46:06.550 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/persistent-data/ 2023-10-06T02:46:06.550 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 199937 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-10-06T02:46:06.551 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 37321 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid0.ko 2023-10-06T02:46:06.551 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 112609 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid1.ko 2023-10-06T02:46:06.551 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 160553 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid10.ko 2023-10-06T02:46:06.551 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 396153 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid456.ko 2023-10-06T02:46:06.551 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/ 2023-10-06T02:46:06.551 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/ 2023-10-06T02:46:06.551 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 178113 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptbase.ko 2023-10-06T02:46:06.551 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 63385 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptctl.ko 2023-10-06T02:46:06.551 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 44649 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptfc.ko 2023-10-06T02:46:06.551 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 37161 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptlan.ko 2023-10-06T02:46:06.551 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 123353 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptsas.ko 2023-10-06T02:46:06.551 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 79017 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptscsih.ko 2023-10-06T02:46:06.551 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 53081 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptspi.ko 2023-10-06T02:46:06.552 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/ 2023-10-06T02:46:06.552 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17305 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/88pm800.ko 2023-10-06T02:46:06.552 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12761 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/88pm805.ko 2023-10-06T02:46:06.552 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11193 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/88pm80x.ko 2023-10-06T02:46:06.552 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11865 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/arizona-i2c.ko 2023-10-06T02:46:06.552 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 123721 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/arizona.ko 2023-10-06T02:46:06.552 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11961 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/bcm590xx.ko 2023-10-06T02:46:06.552 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17465 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/cros_ec_dev.ko 2023-10-06T02:46:06.552 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 34993 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/dln2.ko 2023-10-06T02:46:06.552 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16689 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/janz-cmodio.ko 2023-10-06T02:46:06.552 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 53585 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/kempld-core.ko 2023-10-06T02:46:06.552 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 27529 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/lm3533-core.ko 2023-10-06T02:46:06.552 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14993 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/lm3533-ctrlbank.ko 2023-10-06T02:46:06.553 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13009 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/lp3943.ko 2023-10-06T02:46:06.553 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 54569 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/lpc_ich.ko 2023-10-06T02:46:06.553 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12113 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/lpc_sch.ko 2023-10-06T02:46:06.553 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17409 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/max8907.ko 2023-10-06T02:46:06.553 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 29857 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/mc13xxx-core.ko 2023-10-06T02:46:06.553 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11809 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/mc13xxx-i2c.ko 2023-10-06T02:46:06.553 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11593 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/menf21bmc.ko 2023-10-06T02:46:06.553 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17329 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/pcf50633-adc.ko 2023-10-06T02:46:06.553 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9153 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/pcf50633-gpio.ko 2023-10-06T02:46:06.553 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 34873 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/pcf50633.ko 2023-10-06T02:46:06.553 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10105 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/rdc321x-southbridge.ko 2023-10-06T02:46:06.554 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20289 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/retu-mfd.ko 2023-10-06T02:46:06.554 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 80425 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/si476x-core.ko 2023-10-06T02:46:06.554 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 48441 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/sm501.ko 2023-10-06T02:46:06.554 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19825 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/ti_am335x_tscadc.ko 2023-10-06T02:46:06.554 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 51137 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/tps65010.ko 2023-10-06T02:46:06.554 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10417 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/tps6507x.ko 2023-10-06T02:46:06.554 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13329 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/viperboard.ko 2023-10-06T02:46:06.554 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10537 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/vx855.ko 2023-10-06T02:46:06.554 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17953 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/wl1273-core.ko 2023-10-06T02:46:06.554 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 44345 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/wm8994.ko 2023-10-06T02:46:06.554 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/ 2023-10-06T02:46:06.554 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13833 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/ad525x_dpot-i2c.ko 2023-10-06T02:46:06.555 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 48489 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/ad525x_dpot.ko 2023-10-06T02:46:06.555 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/altera-stapl/ 2023-10-06T02:46:06.555 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 46585 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-10-06T02:46:06.555 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18393 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/apds9802als.ko 2023-10-06T02:46:06.555 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 36729 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/apds990x.ko 2023-10-06T02:46:06.555 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 45593 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/bh1770glc.ko 2023-10-06T02:46:06.555 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/c2port/ 2023-10-06T02:46:06.555 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11145 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2023-10-06T02:46:06.555 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 35305 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/c2port/core.ko 2023-10-06T02:46:06.555 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/cb710/ 2023-10-06T02:46:06.555 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 25161 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/cb710/cb710.ko 2023-10-06T02:46:06.555 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17801 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/ds1682.ko 2023-10-06T02:46:06.556 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8897 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/dummy-irq.ko 2023-10-06T02:46:06.556 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/echo/ 2023-10-06T02:46:06.556 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13657 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/echo/echo.ko 2023-10-06T02:46:06.556 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/ 2023-10-06T02:46:06.556 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 37849 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/at24.ko 2023-10-06T02:46:06.556 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14321 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/eeprom.ko 2023-10-06T02:46:06.556 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14769 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-10-06T02:46:06.556 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13537 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/max6875.ko 2023-10-06T02:46:06.556 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 32993 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/enclosure.ko 2023-10-06T02:46:06.556 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/genwqe/ 2023-10-06T02:46:06.556 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 152137 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/genwqe/genwqe_card.ko 2023-10-06T02:46:06.556 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14129 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/hmc6352.ko 2023-10-06T02:46:06.557 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 31193 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/hpilo.ko 2023-10-06T02:46:06.557 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/ibmasm/ 2023-10-06T02:46:06.557 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 72601 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/ibmasm/ibmasm.ko 2023-10-06T02:46:06.557 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19785 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/ics932s401.ko 2023-10-06T02:46:06.557 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21681 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/isl29003.ko 2023-10-06T02:46:06.557 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15753 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/isl29020.ko 2023-10-06T02:46:06.557 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d/ 2023-10-06T02:46:06.557 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 42585 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-10-06T02:46:06.557 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13857 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-10-06T02:46:06.557 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/ 2023-10-06T02:46:06.557 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 125209 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei-me.ko 2023-10-06T02:46:06.557 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 56521 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei-txe.ko 2023-10-06T02:46:06.557 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 309857 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei.ko 2023-10-06T02:46:06.558 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 31329 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/phantom.ko 2023-10-06T02:46:06.558 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/ti-st/ 2023-10-06T02:46:06.558 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 74905 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/ti-st/st_drv.ko 2023-10-06T02:46:06.558 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 24305 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tifm_7xx1.ko 2023-10-06T02:46:06.558 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 28873 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tifm_core.ko 2023-10-06T02:46:06.558 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18729 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tsl2550.ko 2023-10-06T02:46:06.558 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 48673 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_balloon.ko 2023-10-06T02:46:06.558 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_vmci/ 2023-10-06T02:46:06.558 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 183857 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-10-06T02:46:06.558 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ 2023-10-06T02:46:06.558 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/bonding/ 2023-10-06T02:46:06.558 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 487865 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/bonding/bonding.ko 2023-10-06T02:46:06.559 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/ 2023-10-06T02:46:06.559 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/b53/ 2023-10-06T02:46:06.559 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 106009 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/b53/b53_common.ko 2023-10-06T02:46:06.559 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 40281 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/bcm-sf2.ko 2023-10-06T02:46:06.559 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14689 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6060.ko 2023-10-06T02:46:06.559 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6xxx/ 2023-10-06T02:46:06.559 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 452681 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-10-06T02:46:06.559 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16929 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dummy.ko 2023-10-06T02:46:06.559 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17945 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/eql.ko 2023-10-06T02:46:06.559 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ 2023-10-06T02:46:06.559 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/ 2023-10-06T02:46:06.559 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 45785 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-10-06T02:46:06.560 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 42105 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-10-06T02:46:06.560 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 130489 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-10-06T02:46:06.560 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 68785 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-10-06T02:46:06.560 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/ 2023-10-06T02:46:06.560 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 37649 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/8390.ko 2023-10-06T02:46:06.560 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 59689 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-10-06T02:46:06.560 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 27193 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-10-06T02:46:06.560 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 99113 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-10-06T02:46:06.560 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/adaptec/ 2023-10-06T02:46:06.560 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 54521 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-10-06T02:46:06.560 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/agere/ 2023-10-06T02:46:06.560 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 69145 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/agere/et131x.ko 2023-10-06T02:46:06.561 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/alteon/ 2023-10-06T02:46:06.561 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 59521 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-10-06T02:46:06.561 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/altera/ 2023-10-06T02:46:06.561 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 41393 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-10-06T02:46:06.561 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/ 2023-10-06T02:46:06.561 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 54545 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-10-06T02:46:06.561 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 49225 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-10-06T02:46:06.561 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 87345 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-10-06T02:46:06.561 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/ 2023-10-06T02:46:06.561 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/alx/ 2023-10-06T02:46:06.561 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 97321 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-10-06T02:46:06.561 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1c/ 2023-10-06T02:46:06.562 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 104609 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-10-06T02:46:06.562 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1e/ 2023-10-06T02:46:06.562 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 90257 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-10-06T02:46:06.562 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx/ 2023-10-06T02:46:06.562 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 81505 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-10-06T02:46:06.562 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 69713 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-10-06T02:46:06.562 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/ 2023-10-06T02:46:06.562 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 78401 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-10-06T02:46:06.562 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 176881 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-10-06T02:46:06.562 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2023-10-06T02:46:06.562 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 1422209 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-10-06T02:46:06.562 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 128377 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-10-06T02:46:06.563 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/genet/ 2023-10-06T02:46:06.563 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 132289 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-10-06T02:46:06.563 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 312145 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-10-06T02:46:06.563 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade/ 2023-10-06T02:46:06.563 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade/bna/ 2023-10-06T02:46:06.563 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 323553 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-10-06T02:46:06.620 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/ 2023-10-06T02:46:06.621 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb/ 2023-10-06T02:46:06.621 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 193433 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-10-06T02:46:06.621 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2023-10-06T02:46:06.621 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 347641 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-10-06T02:46:06.621 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2023-10-06T02:46:06.621 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 1044145 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-10-06T02:46:06.621 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2023-10-06T02:46:06.621 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 166113 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-10-06T02:46:06.621 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2023-10-06T02:46:06.621 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 34881 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-10-06T02:46:06.621 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco/ 2023-10-06T02:46:06.621 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco/enic/ 2023-10-06T02:46:06.622 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 204329 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-10-06T02:46:06.622 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/ 2023-10-06T02:46:06.622 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/ 2023-10-06T02:46:06.622 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 69449 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-10-06T02:46:06.622 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 61489 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-10-06T02:46:06.622 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 141161 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-10-06T02:46:06.622 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 51433 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-10-06T02:46:06.622 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 62865 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-10-06T02:46:06.622 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 31305 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-10-06T02:46:06.622 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink/ 2023-10-06T02:46:06.622 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 60873 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-10-06T02:46:06.623 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 62833 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-10-06T02:46:06.623 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 45721 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dnet.ko 2023-10-06T02:46:06.623 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 25233 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ec_bhf.ko 2023-10-06T02:46:06.623 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex/ 2023-10-06T02:46:06.623 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex/benet/ 2023-10-06T02:46:06.623 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 281329 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-10-06T02:46:06.623 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 49505 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ethoc.ko 2023-10-06T02:46:06.623 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 51737 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/fealnx.ko 2023-10-06T02:46:06.623 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/fujitsu/ 2023-10-06T02:46:06.623 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 45281 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2023-10-06T02:46:06.623 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ 2023-10-06T02:46:06.623 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 90465 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e100.ko 2023-10-06T02:46:06.624 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000/ 2023-10-06T02:46:06.624 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 295713 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-10-06T02:46:06.624 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000e/ 2023-10-06T02:46:06.624 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 584249 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-10-06T02:46:06.624 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/fm10k/ 2023-10-06T02:46:06.624 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 246321 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-10-06T02:46:06.624 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/i40e/ 2023-10-06T02:46:06.624 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 924017 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-10-06T02:46:06.624 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/iavf/ 2023-10-06T02:46:06.624 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 302577 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-10-06T02:46:06.624 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igb/ 2023-10-06T02:46:06.624 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 514889 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-10-06T02:46:06.625 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igbvf/ 2023-10-06T02:46:06.625 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 93593 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-10-06T02:46:06.625 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbe/ 2023-10-06T02:46:06.625 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 734297 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-10-06T02:46:06.625 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbevf/ 2023-10-06T02:46:06.625 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 151841 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-10-06T02:46:06.625 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 86921 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/jme.ko 2023-10-06T02:46:06.625 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/ 2023-10-06T02:46:06.625 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20977 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-10-06T02:46:06.625 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 102385 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/skge.ko 2023-10-06T02:46:06.625 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 122681 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-10-06T02:46:06.625 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/ 2023-10-06T02:46:06.625 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4/ 2023-10-06T02:46:06.626 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 727433 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-10-06T02:46:06.626 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 280513 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-10-06T02:46:06.626 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5/ 2023-10-06T02:46:06.626 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2023-10-06T02:46:06.626 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 1097537 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-10-06T02:46:06.626 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/micrel/ 2023-10-06T02:46:06.626 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 53041 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/micrel/ks8842.ko 2023-10-06T02:46:06.626 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 40993 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2023-10-06T02:46:06.626 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19489 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2023-10-06T02:46:06.626 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 95665 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-10-06T02:46:06.626 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom/ 2023-10-06T02:46:06.627 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom/myri10ge/ 2023-10-06T02:46:06.627 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 108809 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-10-06T02:46:06.627 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi/ 2023-10-06T02:46:06.627 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 73377 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-10-06T02:46:06.627 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 47713 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-10-06T02:46:06.627 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/neterion/ 2023-10-06T02:46:06.627 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 150905 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-10-06T02:46:06.627 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/nvidia/ 2023-10-06T02:46:06.627 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 136785 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-10-06T02:46:06.627 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines/ 2023-10-06T02:46:06.627 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 50481 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-10-06T02:46:06.627 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 43145 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-10-06T02:46:06.628 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/ 2023-10-06T02:46:06.628 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/netxen/ 2023-10-06T02:46:06.628 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 227113 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-10-06T02:46:06.628 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 87081 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-10-06T02:46:06.628 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2023-10-06T02:46:06.628 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 671393 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-10-06T02:46:06.628 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rdc/ 2023-10-06T02:46:06.628 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 43017 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-10-06T02:46:06.628 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/ 2023-10-06T02:46:06.628 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 67385 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-10-06T02:46:06.628 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 83921 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-10-06T02:46:06.628 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 29321 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/atp.ko 2023-10-06T02:46:06.628 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 189817 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-10-06T02:46:06.629 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/samsung/ 2023-10-06T02:46:06.629 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/samsung/sxgbe/ 2023-10-06T02:46:06.629 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 104241 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2023-10-06T02:46:06.629 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sfc/ 2023-10-06T02:46:06.629 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 952929 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-10-06T02:46:06.629 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/silan/ 2023-10-06T02:46:06.629 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 47177 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-10-06T02:46:06.629 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis/ 2023-10-06T02:46:06.629 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 54809 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis/sis190.ko 2023-10-06T02:46:06.629 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 63273 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis/sis900.ko 2023-10-06T02:46:06.629 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/ 2023-10-06T02:46:06.629 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 61537 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-10-06T02:46:06.630 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 67129 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-10-06T02:46:06.630 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 73345 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-10-06T02:46:06.630 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 68209 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-10-06T02:46:06.630 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/ 2023-10-06T02:46:06.630 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac/ 2023-10-06T02:46:06.630 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13441 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2023-10-06T02:46:06.630 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 40137 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-10-06T02:46:06.630 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20769 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2023-10-06T02:46:06.630 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 481681 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-10-06T02:46:06.630 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/ 2023-10-06T02:46:06.630 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 103321 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/cassini.ko 2023-10-06T02:46:06.630 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 166121 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/niu.ko 2023-10-06T02:46:06.631 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 66473 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/sungem.ko 2023-10-06T02:46:06.631 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 78737 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-10-06T02:46:06.631 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/tehuti/ 2023-10-06T02:46:06.631 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 49993 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-10-06T02:46:06.631 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ti/ 2023-10-06T02:46:06.631 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 86465 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ti/tlan.ko 2023-10-06T02:46:06.631 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via/ 2023-10-06T02:46:06.631 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 80257 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-10-06T02:46:06.631 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 83681 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-10-06T02:46:06.631 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet/ 2023-10-06T02:46:06.631 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 46241 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-10-06T02:46:06.631 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 30849 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-10-06T02:46:06.632 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/xircom/ 2023-10-06T02:46:06.632 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 60041 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-10-06T02:46:06.632 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/fddi/ 2023-10-06T02:46:06.632 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 41001 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/fddi/defxx.ko 2023-10-06T02:46:06.632 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/fddi/skfp/ 2023-10-06T02:46:06.632 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 216977 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/fddi/skfp/skfp.ko 2023-10-06T02:46:06.632 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 77401 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/geneve.ko 2023-10-06T02:46:06.632 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/hyperv/ 2023-10-06T02:46:06.633 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 235593 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-10-06T02:46:06.633 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ieee802154/ 2023-10-06T02:46:06.633 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18257 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ieee802154/fakelb.ko 2023-10-06T02:46:06.633 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 25073 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ifb.ko 2023-10-06T02:46:06.633 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ipvlan/ 2023-10-06T02:46:06.633 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 83993 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ipvlan/ipvlan.ko 2023-10-06T02:46:06.633 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 62065 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/macvlan.ko 2023-10-06T02:46:06.633 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15865 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/macvtap.ko 2023-10-06T02:46:06.633 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/ 2023-10-06T02:46:06.633 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19817 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-10-06T02:46:06.633 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14185 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-10-06T02:46:06.634 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13745 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-gpio.ko 2023-10-06T02:46:06.634 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8825 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-regmap.ko 2023-10-06T02:46:06.634 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16025 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio.ko 2023-10-06T02:46:06.634 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20513 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mii.ko 2023-10-06T02:46:06.634 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 41697 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/netconsole.ko 2023-10-06T02:46:06.634 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13145 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/nlmon.ko 2023-10-06T02:46:06.634 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs/ 2023-10-06T02:46:06.634 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17897 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs/pcs-lynx.ko 2023-10-06T02:46:06.634 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 32329 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-10-06T02:46:06.634 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/ 2023-10-06T02:46:06.635 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9737 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/amd.ko 2023-10-06T02:46:06.635 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 50097 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-10-06T02:46:06.635 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 43273 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm7xxx.ko 2023-10-06T02:46:06.635 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11521 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm87xx.ko 2023-10-06T02:46:06.635 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 41793 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/broadcom.ko 2023-10-06T02:46:06.635 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10561 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/cicada.ko 2023-10-06T02:46:06.635 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12961 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/davicom.ko 2023-10-06T02:46:06.635 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9449 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/et1011c.ko 2023-10-06T02:46:06.635 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 24905 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/icplus.ko 2023-10-06T02:46:06.635 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15785 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/lxt.ko 2023-10-06T02:46:06.635 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 78185 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/marvell.ko 2023-10-06T02:46:06.635 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 75713 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/micrel.ko 2023-10-06T02:46:06.636 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12033 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/national.ko 2023-10-06T02:46:06.636 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 97265 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/phylink.ko 2023-10-06T02:46:06.636 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10001 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/qsemi.ko 2023-10-06T02:46:06.636 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 49553 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/realtek.ko 2023-10-06T02:46:06.636 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 25753 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/smsc.ko 2023-10-06T02:46:06.636 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10793 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/ste10Xp.ko 2023-10-06T02:46:06.636 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 24033 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/vitesse.ko 2023-10-06T02:46:06.636 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/plip/ 2023-10-06T02:46:06.636 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 43465 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/plip/plip.ko 2023-10-06T02:46:06.636 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ 2023-10-06T02:46:06.636 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15857 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/bsd_comp.ko 2023-10-06T02:46:06.636 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 29929 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_async.ko 2023-10-06T02:46:06.636 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17665 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_deflate.ko 2023-10-06T02:46:06.637 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18625 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_mppe.ko 2023-10-06T02:46:06.637 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 28945 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_synctty.ko 2023-10-06T02:46:06.637 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 42545 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pppoe.ko 2023-10-06T02:46:06.637 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13441 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pppox.ko 2023-10-06T02:46:06.637 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 31969 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pptp.ko 2023-10-06T02:46:06.637 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 28225 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/sb1000.ko 2023-10-06T02:46:06.637 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip/ 2023-10-06T02:46:06.637 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 42513 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip/slip.ko 2023-10-06T02:46:06.637 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 26929 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/sungem_phy.ko 2023-10-06T02:46:06.638 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 64937 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/tap.ko 2023-10-06T02:46:06.638 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/ 2023-10-06T02:46:06.638 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 106025 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team.ko 2023-10-06T02:46:06.638 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13497 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_activebackup.ko 2023-10-06T02:46:06.638 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10209 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_broadcast.ko 2023-10-06T02:46:06.638 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 28993 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-10-06T02:46:06.638 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9641 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_random.ko 2023-10-06T02:46:06.638 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9321 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-10-06T02:46:06.639 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 88257 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/veth.ko 2023-10-06T02:46:06.639 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vmxnet3/ 2023-10-06T02:46:06.639 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 120497 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-10-06T02:46:06.639 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vxlan/ 2023-10-06T02:46:06.639 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 293441 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vxlan/vxlan.ko 2023-10-06T02:46:06.639 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netback/ 2023-10-06T02:46:06.639 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 143889 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netback/xen-netback.ko 2023-10-06T02:46:06.639 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ntb/ 2023-10-06T02:46:06.639 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20969 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ntb/ntb.ko 2023-10-06T02:46:06.639 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/ 2023-10-06T02:46:06.640 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host/ 2023-10-06T02:46:06.640 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 264585 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host/nvme-core.ko 2023-10-06T02:46:06.640 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 102393 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host/nvme.ko 2023-10-06T02:46:06.640 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/ 2023-10-06T02:46:06.640 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 133817 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport.ko 2023-10-06T02:46:06.640 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14561 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_cs.ko 2023-10-06T02:46:06.640 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 84337 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_pc.ko 2023-10-06T02:46:06.640 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 26121 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_serial.ko 2023-10-06T02:46:06.640 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/ 2023-10-06T02:46:06.640 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/hotplug/ 2023-10-06T02:46:06.641 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 25009 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-10-06T02:46:06.641 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17849 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2023-10-06T02:46:06.641 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20137 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2023-10-06T02:46:06.641 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11857 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/pci-stub.ko 2023-10-06T02:46:06.641 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 47377 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/xen-pcifront.ko 2023-10-06T02:46:06.641 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/ 2023-10-06T02:46:06.641 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 26793 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/i82092.ko 2023-10-06T02:46:06.641 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 145785 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/pcmcia.ko 2023-10-06T02:46:06.641 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 62081 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/pcmcia_core.ko 2023-10-06T02:46:06.641 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 34345 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2023-10-06T02:46:06.641 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 34265 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/pd6729.ko 2023-10-06T02:46:06.641 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 112913 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/yenta_socket.ko 2023-10-06T02:46:06.642 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/phy/ 2023-10-06T02:46:06.642 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/phy/broadcom/ 2023-10-06T02:46:06.642 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10841 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2023-10-06T02:46:06.642 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/phy/samsung/ 2023-10-06T02:46:06.642 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8441 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2023-10-06T02:46:06.642 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl/ 2023-10-06T02:46:06.642 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl/intel/ 2023-10-06T02:46:06.642 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 71521 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-10-06T02:46:06.642 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/ 2023-10-06T02:46:06.642 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/chrome/ 2023-10-06T02:46:06.643 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 50889 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2023-10-06T02:46:06.643 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20849 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/chrome/cros_ec.ko 2023-10-06T02:46:06.643 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21433 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2023-10-06T02:46:06.643 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 25417 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2023-10-06T02:46:06.643 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 26225 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2023-10-06T02:46:06.643 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18201 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2023-10-06T02:46:06.643 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17425 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2023-10-06T02:46:06.643 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/ 2023-10-06T02:46:06.643 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 67097 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/acer-wmi.ko 2023-10-06T02:46:06.644 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 39145 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/acerhdf.ko 2023-10-06T02:46:06.644 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 36913 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/apple-gmux.ko 2023-10-06T02:46:06.644 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 59665 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-laptop.ko 2023-10-06T02:46:06.644 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 30705 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-10-06T02:46:06.644 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 106873 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-wmi.ko 2023-10-06T02:46:06.644 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 36913 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/classmate-laptop.ko 2023-10-06T02:46:06.644 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 49121 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-10-06T02:46:06.644 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13961 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-10-06T02:46:06.645 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 40265 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-10-06T02:46:06.645 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 22521 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-10-06T02:46:06.645 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 36657 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/hdaps.ko 2023-10-06T02:46:06.645 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19449 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/ibm_rtl.ko 2023-10-06T02:46:06.645 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel/ 2023-10-06T02:46:06.645 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12073 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-10-06T02:46:06.645 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8985 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2023-10-06T02:46:06.645 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 43521 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel_ips.ko 2023-10-06T02:46:06.645 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20273 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/msi-wmi.ko 2023-10-06T02:46:06.645 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10377 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/mxm-wmi.ko 2023-10-06T02:46:06.646 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 34801 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-10-06T02:46:06.646 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 42329 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/samsung-laptop.ko 2023-10-06T02:46:06.646 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14169 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/samsung-q10.ko 2023-10-06T02:46:06.646 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17321 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/topstar-laptop.ko 2023-10-06T02:46:06.646 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13721 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-10-06T02:46:06.646 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17081 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/toshiba_haps.ko 2023-10-06T02:46:06.646 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10161 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/wmi-bmof.ko 2023-10-06T02:46:06.646 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 57545 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/wmi.ko 2023-10-06T02:46:06.646 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/ 2023-10-06T02:46:06.646 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/ 2023-10-06T02:46:06.647 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 30345 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/88pm860x_battery.ko 2023-10-06T02:46:06.647 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 33985 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/88pm860x_charger.ko 2023-10-06T02:46:06.647 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 55057 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/bq2415x_charger.ko 2023-10-06T02:46:06.647 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 53993 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/bq24190_charger.ko 2023-10-06T02:46:06.647 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21553 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/bq24735-charger.ko 2023-10-06T02:46:06.647 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17337 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/cros_peripheral_charger.ko 2023-10-06T02:46:06.647 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19609 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/da9030_battery.ko 2023-10-06T02:46:06.647 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19841 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/da9052-battery.ko 2023-10-06T02:46:06.647 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 29281 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/ds2760_battery.ko 2023-10-06T02:46:06.647 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 23217 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/ds2780_battery.ko 2023-10-06T02:46:06.648 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 23353 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/ds2781_battery.ko 2023-10-06T02:46:06.648 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 23649 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/ds2782_battery.ko 2023-10-06T02:46:06.648 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20353 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/gpio-charger.ko 2023-10-06T02:46:06.648 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18041 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/isp1704_charger.ko 2023-10-06T02:46:06.648 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20273 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/lp8727_charger.ko 2023-10-06T02:46:06.648 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12577 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/max14577_charger.ko 2023-10-06T02:46:06.648 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 25897 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/max17040_battery.ko 2023-10-06T02:46:06.648 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 30289 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/max17042_battery.ko 2023-10-06T02:46:06.648 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18585 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/max8903_charger.ko 2023-10-06T02:46:06.649 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 23729 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/max8925_power.ko 2023-10-06T02:46:06.649 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21657 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/pcf50633-charger.ko 2023-10-06T02:46:06.649 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 38009 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/sbs-battery.ko 2023-10-06T02:46:06.649 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 28385 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/test_power.ko 2023-10-06T02:46:06.649 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18865 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/tps65090-charger.ko 2023-10-06T02:46:06.649 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11969 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/wm831x_backup.ko 2023-10-06T02:46:06.649 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 24521 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/wm831x_power.ko 2023-10-06T02:46:06.649 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 22417 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/power/supply/wm8350_power.ko 2023-10-06T02:46:06.649 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap/ 2023-10-06T02:46:06.650 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 57737 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap/intel_rapl_common.ko 2023-10-06T02:46:06.650 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17345 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap/intel_rapl_msr.ko 2023-10-06T02:46:06.650 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/ 2023-10-06T02:46:06.650 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/ 2023-10-06T02:46:06.650 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15521 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps-gpio.ko 2023-10-06T02:46:06.650 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13249 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps-ldisc.ko 2023-10-06T02:46:06.650 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15913 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps_parport.ko 2023-10-06T02:46:06.650 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 41921 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/pps_core.ko 2023-10-06T02:46:06.650 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp/ 2023-10-06T02:46:06.651 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 66385 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp/ptp.ko 2023-10-06T02:46:06.651 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16449 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp/ptp_kvm.ko 2023-10-06T02:46:06.651 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/ 2023-10-06T02:46:06.651 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 23497 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-88pm80x.ko 2023-10-06T02:46:06.651 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 24521 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-88pm860x.ko 2023-10-06T02:46:06.651 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15393 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-bq32k.ko 2023-10-06T02:46:06.651 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12961 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-bq4802.ko 2023-10-06T02:46:06.651 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20105 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-da9052.ko 2023-10-06T02:46:06.651 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18505 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-da9055.ko 2023-10-06T02:46:06.652 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20177 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-da9063.ko 2023-10-06T02:46:06.652 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16457 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1286.ko 2023-10-06T02:46:06.652 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 68577 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1307.ko 2023-10-06T02:46:06.652 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20817 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1374.ko 2023-10-06T02:46:06.652 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18217 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1511.ko 2023-10-06T02:46:06.652 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16737 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1553.ko 2023-10-06T02:46:06.652 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13953 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1672.ko 2023-10-06T02:46:06.652 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13369 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1742.ko 2023-10-06T02:46:06.652 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17305 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds2404.ko 2023-10-06T02:46:06.653 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 23705 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds3232.ko 2023-10-06T02:46:06.653 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11081 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-em3027.ko 2023-10-06T02:46:06.653 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 24329 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-fm3130.ko 2023-10-06T02:46:06.653 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17705 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-isl12022.ko 2023-10-06T02:46:06.653 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 36057 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-isl1208.ko 2023-10-06T02:46:06.653 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14673 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-lp8788.ko 2023-10-06T02:46:06.653 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 38097 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m41t80.ko 2023-10-06T02:46:06.653 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12089 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m48t35.ko 2023-10-06T02:46:06.653 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 25945 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m48t59.ko 2023-10-06T02:46:06.653 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14177 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m48t86.ko 2023-10-06T02:46:06.654 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11633 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-max6900.ko 2023-10-06T02:46:06.654 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14737 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-max8907.ko 2023-10-06T02:46:06.654 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15409 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-max8925.ko 2023-10-06T02:46:06.654 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 25809 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-max8997.ko 2023-10-06T02:46:06.654 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16681 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-max8998.ko 2023-10-06T02:46:06.654 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18513 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-mc13xxx.ko 2023-10-06T02:46:06.654 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11409 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-msm6242.ko 2023-10-06T02:46:06.654 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19625 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-palmas.ko 2023-10-06T02:46:06.654 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 40121 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf2127.ko 2023-10-06T02:46:06.654 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17977 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf50633.ko 2023-10-06T02:46:06.655 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 26817 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf85063.ko 2023-10-06T02:46:06.655 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21825 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8523.ko 2023-10-06T02:46:06.655 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 29881 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8563.ko 2023-10-06T02:46:06.655 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12441 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8583.ko 2023-10-06T02:46:06.655 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18033 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rc5t583.ko 2023-10-06T02:46:06.655 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13049 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rp5c01.ko 2023-10-06T02:46:06.655 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 33753 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rs5c372.ko 2023-10-06T02:46:06.655 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 27833 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-10-06T02:46:06.655 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 25257 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rx8025.ko 2023-10-06T02:46:06.655 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20113 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rx8581.ko 2023-10-06T02:46:06.655 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21617 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-s35390a.ko 2023-10-06T02:46:06.655 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16825 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-10-06T02:46:06.656 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17889 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-tps6586x.ko 2023-10-06T02:46:06.656 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21545 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-tps65910.ko 2023-10-06T02:46:06.656 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20545 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-wm831x.ko 2023-10-06T02:46:06.656 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21345 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-wm8350.ko 2023-10-06T02:46:06.656 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 27873 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-x1205.ko 2023-10-06T02:46:06.656 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ 2023-10-06T02:46:06.657 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 77617 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-9xxx.ko 2023-10-06T02:46:06.657 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 57665 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-sas.ko 2023-10-06T02:46:06.657 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 55169 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-xxxx.ko 2023-10-06T02:46:06.657 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 135169 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/BusLogic.ko 2023-10-06T02:46:06.657 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 26657 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/a100u2w.ko 2023-10-06T02:46:06.657 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aacraid/ 2023-10-06T02:46:06.657 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 272353 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aacraid/aacraid.ko 2023-10-06T02:46:06.658 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 100617 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/advansys.ko 2023-10-06T02:46:06.658 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx/ 2023-10-06T02:46:06.658 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 356265 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-10-06T02:46:06.658 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 295801 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-10-06T02:46:06.658 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic94xx/ 2023-10-06T02:46:06.658 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 189321 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic94xx/aic94xx.ko 2023-10-06T02:46:06.658 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 24073 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/am53c974.ko 2023-10-06T02:46:06.658 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/arcmsr/ 2023-10-06T02:46:06.658 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 106569 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-10-06T02:46:06.658 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 38185 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/atp870u.ko 2023-10-06T02:46:06.658 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/be2iscsi/ 2023-10-06T02:46:06.658 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 246897 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-10-06T02:46:06.659 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bfa/ 2023-10-06T02:46:06.659 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 1172185 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bfa/bfa.ko 2023-10-06T02:46:06.659 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2fc/ 2023-10-06T02:46:06.659 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 237169 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-10-06T02:46:06.659 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2i/ 2023-10-06T02:46:06.659 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 115393 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-10-06T02:46:06.659 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 40609 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ch.ko 2023-10-06T02:46:06.659 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/csiostor/ 2023-10-06T02:46:06.659 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 308889 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/csiostor/csiostor.ko 2023-10-06T02:46:06.660 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/ 2023-10-06T02:46:06.660 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb3i/ 2023-10-06T02:46:06.660 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 76193 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-10-06T02:46:06.660 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb4i/ 2023-10-06T02:46:06.660 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 101449 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-10-06T02:46:06.660 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 146785 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-10-06T02:46:06.660 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 75529 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/dc395x.ko 2023-10-06T02:46:06.660 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 38121 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/dmx3191d.ko 2023-10-06T02:46:06.660 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esas2r/ 2023-10-06T02:46:06.660 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 212401 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esas2r/esas2r.ko 2023-10-06T02:46:06.660 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 60489 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esp_scsi.ko 2023-10-06T02:46:06.661 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe/ 2023-10-06T02:46:06.661 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 78289 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe/fcoe.ko 2023-10-06T02:46:06.661 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 158193 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-10-06T02:46:06.661 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18945 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fdomain.ko 2023-10-06T02:46:06.661 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fnic/ 2023-10-06T02:46:06.661 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 262729 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fnic/fnic.ko 2023-10-06T02:46:06.661 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 201793 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hpsa.ko 2023-10-06T02:46:06.661 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 51145 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hptiop.ko 2023-10-06T02:46:06.661 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 49041 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hv_storvsc.ko 2023-10-06T02:46:06.661 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 35321 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/imm.ko 2023-10-06T02:46:06.661 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 44057 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/initio.ko 2023-10-06T02:46:06.661 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 266521 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ipr.ko 2023-10-06T02:46:06.662 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 101881 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ips.ko 2023-10-06T02:46:06.662 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/isci/ 2023-10-06T02:46:06.662 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 317249 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/isci/isci.ko 2023-10-06T02:46:06.662 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 26361 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-10-06T02:46:06.662 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 52897 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/iscsi_tcp.ko 2023-10-06T02:46:06.662 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libfc/ 2023-10-06T02:46:06.662 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 314961 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libfc/libfc.ko 2023-10-06T02:46:06.662 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 145569 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libiscsi.ko 2023-10-06T02:46:06.662 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 53521 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libiscsi_tcp.ko 2023-10-06T02:46:06.662 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libsas/ 2023-10-06T02:46:06.662 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 217209 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libsas/libsas.ko 2023-10-06T02:46:06.662 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/lpfc/ 2023-10-06T02:46:06.663 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 2192585 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/lpfc/lpfc.ko 2023-10-06T02:46:06.663 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/ 2023-10-06T02:46:06.663 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 73545 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-10-06T02:46:06.663 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 33505 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-10-06T02:46:06.663 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 310729 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-10-06T02:46:06.663 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 84697 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid.ko 2023-10-06T02:46:06.663 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mpt3sas/ 2023-10-06T02:46:06.663 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 659513 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-10-06T02:46:06.663 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvsas/ 2023-10-06T02:46:06.663 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 119929 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvsas/mvsas.ko 2023-10-06T02:46:06.663 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 78153 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvumi.ko 2023-10-06T02:46:06.663 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pcmcia/ 2023-10-06T02:46:06.663 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 81601 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2023-10-06T02:46:06.664 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11713 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2023-10-06T02:46:06.664 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20865 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2023-10-06T02:46:06.664 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 23857 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2023-10-06T02:46:06.664 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pm8001/ 2023-10-06T02:46:06.664 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 364257 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-10-06T02:46:06.664 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 123489 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pmcraid.ko 2023-10-06T02:46:06.664 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 33617 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ppa.ko 2023-10-06T02:46:06.664 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 55345 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla1280.ko 2023-10-06T02:46:06.664 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx/ 2023-10-06T02:46:06.664 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 1860193 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-10-06T02:46:06.664 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 85313 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-10-06T02:46:06.664 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla4xxx/ 2023-10-06T02:46:06.665 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 558865 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-10-06T02:46:06.665 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19025 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qlogicfas408.ko 2023-10-06T02:46:06.665 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18985 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/raid_class.ko 2023-10-06T02:46:06.665 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 238801 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_debug.ko 2023-10-06T02:46:06.665 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 173921 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_fc.ko 2023-10-06T02:46:06.665 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 278865 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-10-06T02:46:06.665 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 97705 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_sas.ko 2023-10-06T02:46:06.665 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 73881 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_spi.ko 2023-10-06T02:46:06.665 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 44993 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_srp.ko 2023-10-06T02:46:06.665 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 26249 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ses.ko 2023-10-06T02:46:06.665 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 115849 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/st.ko 2023-10-06T02:46:06.665 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 46825 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/stex.ko 2023-10-06T02:46:06.666 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/sym53c8xx_2/ 2023-10-06T02:46:06.666 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 162121 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-10-06T02:46:06.666 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 42361 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/virtio_scsi.ko 2023-10-06T02:46:06.666 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 50297 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/vmw_pvscsi.ko 2023-10-06T02:46:06.666 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 40001 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/wd719x.ko 2023-10-06T02:46:06.666 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 50025 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/xen-scsifront.ko 2023-10-06T02:46:06.666 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ssb/ 2023-10-06T02:46:06.666 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 129417 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ssb/ssb.ko 2023-10-06T02:46:06.666 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/ 2023-10-06T02:46:06.666 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/iscsi/ 2023-10-06T02:46:06.666 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 739089 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-10-06T02:46:06.666 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/loopback/ 2023-10-06T02:46:06.667 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 49985 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/loopback/tcm_loop.ko 2023-10-06T02:46:06.667 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 39713 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_file.ko 2023-10-06T02:46:06.667 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 42961 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_iblock.ko 2023-10-06T02:46:06.667 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 931721 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_mod.ko 2023-10-06T02:46:06.667 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 44321 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_pscsi.ko 2023-10-06T02:46:06.667 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 122545 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_user.ko 2023-10-06T02:46:06.667 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/tcm_fc/ 2023-10-06T02:46:06.667 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 75641 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-10-06T02:46:06.667 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/ 2023-10-06T02:46:06.667 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/ 2023-10-06T02:46:06.667 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/ 2023-10-06T02:46:06.667 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 23481 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-10-06T02:46:06.667 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 29153 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-10-06T02:46:06.668 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9953 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-10-06T02:46:06.668 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10257 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-10-06T02:46:06.668 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15081 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-10-06T02:46:06.668 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16497 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-10-06T02:46:06.668 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 26809 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-10-06T02:46:06.668 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20281 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-10-06T02:46:06.668 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14865 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-10-06T02:46:06.668 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14393 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-10-06T02:46:06.668 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13001 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-10-06T02:46:06.668 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 37065 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-10-06T02:46:06.668 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 30729 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/intel_powerclamp.ko 2023-10-06T02:46:06.668 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21673 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-10-06T02:46:06.669 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12001 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-10-06T02:46:06.669 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 26489 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-10-06T02:46:06.669 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/ 2023-10-06T02:46:06.669 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/ipwireless/ 2023-10-06T02:46:06.669 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 78073 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-10-06T02:46:06.669 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 57881 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/moxa.ko 2023-10-06T02:46:06.669 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 50793 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/mxser.ko 2023-10-06T02:46:06.669 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 107545 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/n_gsm.ko 2023-10-06T02:46:06.669 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 32041 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/n_hdlc.ko 2023-10-06T02:46:06.669 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 68137 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/nozomi.ko 2023-10-06T02:46:06.669 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/ 2023-10-06T02:46:06.669 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/8250/ 2023-10-06T02:46:06.670 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 35745 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/8250/8250_dw.ko 2023-10-06T02:46:06.670 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 59497 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-10-06T02:46:06.670 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18281 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/altera_jtaguart.ko 2023-10-06T02:46:06.670 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 22465 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/altera_uart.ko 2023-10-06T02:46:06.670 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9489 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/arc_uart.ko 2023-10-06T02:46:06.670 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 72193 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/fsl_lpuart.ko 2023-10-06T02:46:06.670 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/jsm/ 2023-10-06T02:46:06.670 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 103017 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/jsm/jsm.ko 2023-10-06T02:46:06.670 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 28785 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/rp2.ko 2023-10-06T02:46:06.670 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 52073 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/sc16is7xx.ko 2023-10-06T02:46:06.670 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 100185 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/synclink_gt.ko 2023-10-06T02:46:06.670 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/ 2023-10-06T02:46:06.671 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/core/ 2023-10-06T02:46:06.671 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 536809 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/core/ufshcd-core.ko 2023-10-06T02:46:06.671 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/host/ 2023-10-06T02:46:06.671 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 28377 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-10-06T02:46:06.671 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14433 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2023-10-06T02:46:06.671 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/ 2023-10-06T02:46:06.671 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 44585 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio.ko 2023-10-06T02:46:06.671 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12241 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_aec.ko 2023-10-06T02:46:06.671 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11281 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_cif.ko 2023-10-06T02:46:06.671 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18329 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_dmem_genirq.ko 2023-10-06T02:46:06.671 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13001 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_mf624.ko 2023-10-06T02:46:06.671 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12177 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_netx.ko 2023-10-06T02:46:06.672 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10601 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_pci_generic.ko 2023-10-06T02:46:06.672 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16057 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_pdrv_genirq.ko 2023-10-06T02:46:06.672 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13633 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_sercos3.ko 2023-10-06T02:46:06.672 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/ 2023-10-06T02:46:06.672 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/c67x00/ 2023-10-06T02:46:06.672 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 73273 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/c67x00/c67x00.ko 2023-10-06T02:46:06.672 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/chipidea/ 2023-10-06T02:46:06.672 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 143785 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/chipidea/ci_hdrc.ko 2023-10-06T02:46:06.672 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18505 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2023-10-06T02:46:06.672 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12713 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2023-10-06T02:46:06.672 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13057 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2023-10-06T02:46:06.672 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/ 2023-10-06T02:46:06.673 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 85457 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/cdc-acm.ko 2023-10-06T02:46:06.673 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 51393 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/cdc-wdm.ko 2023-10-06T02:46:06.673 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 47465 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/usblp.ko 2023-10-06T02:46:06.673 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 89833 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/usbtmc.ko 2023-10-06T02:46:06.673 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/common/ 2023-10-06T02:46:06.673 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 22953 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/common/ulpi.ko 2023-10-06T02:46:06.673 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/dwc2/ 2023-10-06T02:46:06.673 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11873 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/dwc2/dwc2_pci.ko 2023-10-06T02:46:06.673 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/dwc3/ 2023-10-06T02:46:06.673 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12089 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/dwc3/dwc3-haps.ko 2023-10-06T02:46:06.673 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 30041 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/dwc3/dwc3-pci.ko 2023-10-06T02:46:06.673 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 445217 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/dwc3/dwc3.ko 2023-10-06T02:46:06.673 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/ 2023-10-06T02:46:06.674 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/function/ 2023-10-06T02:46:06.674 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 60089 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/function/u_ether.ko 2023-10-06T02:46:06.674 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 51753 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/function/u_serial.ko 2023-10-06T02:46:06.674 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 29049 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2023-10-06T02:46:06.674 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 42649 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2023-10-06T02:46:06.674 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 28089 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2023-10-06T02:46:06.674 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 36585 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2023-10-06T02:46:06.674 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 92377 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2023-10-06T02:46:06.674 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 51025 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2023-10-06T02:46:06.674 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 122073 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2023-10-06T02:46:06.674 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 57921 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2023-10-06T02:46:06.674 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 22345 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2023-10-06T02:46:06.675 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 31265 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2023-10-06T02:46:06.675 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 57705 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2023-10-06T02:46:06.675 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 85841 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2023-10-06T02:46:06.675 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19521 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2023-10-06T02:46:06.675 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 58433 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2023-10-06T02:46:06.675 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 67337 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2023-10-06T02:46:06.675 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/legacy/ 2023-10-06T02:46:06.675 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21265 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2023-10-06T02:46:06.675 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18057 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2023-10-06T02:46:06.675 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18465 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2023-10-06T02:46:06.675 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21657 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/legacy/g_ether.ko 2023-10-06T02:46:06.675 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 28401 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2023-10-06T02:46:06.676 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18993 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/legacy/g_hid.ko 2023-10-06T02:46:06.676 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20409 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2023-10-06T02:46:06.676 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16977 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2023-10-06T02:46:06.676 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 32073 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2023-10-06T02:46:06.676 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16793 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/legacy/g_printer.ko 2023-10-06T02:46:06.676 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19393 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/legacy/g_serial.ko 2023-10-06T02:46:06.676 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 27201 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/legacy/g_zero.ko 2023-10-06T02:46:06.676 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 62153 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2023-10-06T02:46:06.676 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15201 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2023-10-06T02:46:06.676 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 161321 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/libcomposite.ko 2023-10-06T02:46:06.676 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/udc/ 2023-10-06T02:46:06.676 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17705 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2023-10-06T02:46:06.677 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/udc/bdc/ 2023-10-06T02:46:06.677 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 157665 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2023-10-06T02:46:06.677 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 36065 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/udc/goku_udc.ko 2023-10-06T02:46:06.677 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 52993 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/udc/gr_udc.ko 2023-10-06T02:46:06.677 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 69689 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2023-10-06T02:46:06.677 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 56009 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/udc/mv_udc.ko 2023-10-06T02:46:06.677 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 76033 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/udc/net2272.ko 2023-10-06T02:46:06.677 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 75057 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/udc/net2280.ko 2023-10-06T02:46:06.677 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 73153 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/udc/pch_udc.ko 2023-10-06T02:46:06.677 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 65793 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2023-10-06T02:46:06.677 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 66073 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2023-10-06T02:46:06.677 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 81489 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2023-10-06T02:46:06.677 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 156057 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/gadget/udc/udc-core.ko 2023-10-06T02:46:06.678 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host/ 2023-10-06T02:46:06.678 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11585 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host/bcma-hcd.ko 2023-10-06T02:46:06.678 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 80097 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host/isp116x-hcd.ko 2023-10-06T02:46:06.678 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 87337 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host/oxu210hp-hcd.ko 2023-10-06T02:46:06.678 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 78849 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host/r8a66597-hcd.ko 2023-10-06T02:46:06.678 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 51305 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host/sl811-hcd.ko 2023-10-06T02:46:06.678 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15593 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host/sl811_cs.ko 2023-10-06T02:46:06.678 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13305 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host/ssb-hcd.ko 2023-10-06T02:46:06.678 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 25945 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host/xhci-plat-hcd.ko 2023-10-06T02:46:06.678 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image/ 2023-10-06T02:46:06.678 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 34585 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image/mdc800.ko 2023-10-06T02:46:06.678 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21081 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image/microtek.ko 2023-10-06T02:46:06.679 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/ 2023-10-06T02:46:06.679 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 41841 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/adutux.ko 2023-10-06T02:46:06.679 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20713 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/appledisplay.ko 2023-10-06T02:46:06.679 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17721 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/cypress_cy7c63.ko 2023-10-06T02:46:06.679 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 23049 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/cytherm.ko 2023-10-06T02:46:06.679 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13729 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/ehset.ko 2023-10-06T02:46:06.679 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15057 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/emi26.ko 2023-10-06T02:46:06.679 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15985 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/emi62.ko 2023-10-06T02:46:06.679 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11433 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/ezusb.ko 2023-10-06T02:46:06.679 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19297 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/idmouse.ko 2023-10-06T02:46:06.679 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 36617 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/iowarrior.ko 2023-10-06T02:46:06.679 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11593 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/isight_firmware.ko 2023-10-06T02:46:06.680 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 36529 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/ldusb.ko 2023-10-06T02:46:06.680 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 36265 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/legousbtower.ko 2023-10-06T02:46:06.680 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 27793 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/lvstest.ko 2023-10-06T02:46:06.680 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/sisusbvga/ 2023-10-06T02:46:06.680 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 64841 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-10-06T02:46:06.680 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13001 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/trancevibrator.ko 2023-10-06T02:46:06.680 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20473 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usb3503.ko 2023-10-06T02:46:06.680 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 25145 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usblcd.ko 2023-10-06T02:46:06.680 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 22753 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usbsevseg.ko 2023-10-06T02:46:06.680 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 70873 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usbtest.ko 2023-10-06T02:46:06.680 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 41945 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/uss720.ko 2023-10-06T02:46:06.680 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 27617 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/yurex.ko 2023-10-06T02:46:06.680 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/mon/ 2023-10-06T02:46:06.681 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 73185 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/mon/usbmon.ko 2023-10-06T02:46:06.681 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/musb/ 2023-10-06T02:46:06.681 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 301521 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/musb/musb_hdrc.ko 2023-10-06T02:46:06.681 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/phy/ 2023-10-06T02:46:06.681 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21105 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/phy/phy-generic.ko 2023-10-06T02:46:06.681 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20177 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2023-10-06T02:46:06.681 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12257 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/phy/phy-isp1301.ko 2023-10-06T02:46:06.681 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21745 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/phy/phy-tahvo.ko 2023-10-06T02:46:06.681 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ 2023-10-06T02:46:06.681 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13249 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/aircable.ko 2023-10-06T02:46:06.681 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 33433 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ark3116.ko 2023-10-06T02:46:06.681 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 26737 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/belkin_sa.ko 2023-10-06T02:46:06.682 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 38105 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ch341.ko 2023-10-06T02:46:06.682 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 70209 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cp210x.ko 2023-10-06T02:46:06.682 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 31169 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cyberjack.ko 2023-10-06T02:46:06.682 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 57937 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cypress_m8.ko 2023-10-06T02:46:06.682 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 49753 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/digi_acceleport.ko 2023-10-06T02:46:06.682 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9617 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/empeg.ko 2023-10-06T02:46:06.682 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 43897 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/f81232.ko 2023-10-06T02:46:06.682 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 175145 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ftdi_sio.ko 2023-10-06T02:46:06.682 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 52713 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/garmin_gps.ko 2023-10-06T02:46:06.683 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 137105 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/io_edgeport.ko 2023-10-06T02:46:06.683 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 124673 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/io_ti.ko 2023-10-06T02:46:06.683 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 67769 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ipaq.ko 2023-10-06T02:46:06.683 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19161 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ipw.ko 2023-10-06T02:46:06.683 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 26601 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ir-usb.ko 2023-10-06T02:46:06.683 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 57937 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-10-06T02:46:06.683 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 107417 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/keyspan.ko 2023-10-06T02:46:06.683 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 35497 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/keyspan_pda.ko 2023-10-06T02:46:06.683 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 25449 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/kl5kusb105.ko 2023-10-06T02:46:06.683 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 33521 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/kobil_sct.ko 2023-10-06T02:46:06.683 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 32841 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mct_u232.ko 2023-10-06T02:46:06.684 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21993 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/metro-usb.ko 2023-10-06T02:46:06.684 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 66489 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mos7720.ko 2023-10-06T02:46:06.684 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 78113 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mos7840.ko 2023-10-06T02:46:06.684 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 56593 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mxuport.ko 2023-10-06T02:46:06.684 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13833 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/navman.ko 2023-10-06T02:46:06.684 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11617 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/omninet.ko 2023-10-06T02:46:06.684 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 24281 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/opticon.ko 2023-10-06T02:46:06.684 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 190233 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/option.ko 2023-10-06T02:46:06.684 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 38905 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/oti6858.ko 2023-10-06T02:46:06.684 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 54313 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/pl2303.ko 2023-10-06T02:46:06.684 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9801 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/qcaux.ko 2023-10-06T02:46:06.684 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 37825 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/qcserial.ko 2023-10-06T02:46:06.684 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 34561 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/quatech2.ko 2023-10-06T02:46:06.685 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14745 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/safe_serial.ko 2023-10-06T02:46:06.685 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 51297 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/sierra.ko 2023-10-06T02:46:06.685 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21673 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/spcp8x5.ko 2023-10-06T02:46:06.685 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 29913 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ssu100.ko 2023-10-06T02:46:06.685 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16913 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/symbolserial.ko 2023-10-06T02:46:06.685 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 61337 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-10-06T02:46:06.685 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 23729 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-10-06T02:46:06.685 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10241 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb_debug.ko 2023-10-06T02:46:06.685 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 33313 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb_wwan.ko 2023-10-06T02:46:06.685 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 125505 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usbserial.ko 2023-10-06T02:46:06.685 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 28753 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/visor.ko 2023-10-06T02:46:06.685 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 37409 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/whiteheat.ko 2023-10-06T02:46:06.686 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10537 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/wishbone-serial.ko 2023-10-06T02:46:06.686 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9289 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/xsens_mt.ko 2023-10-06T02:46:06.686 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ 2023-10-06T02:46:06.686 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 52913 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/uas.ko 2023-10-06T02:46:06.686 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 26017 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-alauda.ko 2023-10-06T02:46:06.686 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13049 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-cypress.ko 2023-10-06T02:46:06.686 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 22049 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-datafab.ko 2023-10-06T02:46:06.686 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 33497 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-10-06T02:46:06.686 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13745 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-freecom.ko 2023-10-06T02:46:06.686 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19769 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-isd200.ko 2023-10-06T02:46:06.686 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19361 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-10-06T02:46:06.686 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13713 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-karma.ko 2023-10-06T02:46:06.687 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17841 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-onetouch.ko 2023-10-06T02:46:06.687 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 28441 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-realtek.ko 2023-10-06T02:46:06.687 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 28905 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-sddr09.ko 2023-10-06T02:46:06.687 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19521 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-sddr55.ko 2023-10-06T02:46:06.687 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 35337 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-usbat.ko 2023-10-06T02:46:06.687 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 180017 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/usb-storage.ko 2023-10-06T02:46:06.687 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/ 2023-10-06T02:46:06.687 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 67457 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/usbip-core.ko 2023-10-06T02:46:06.687 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 71345 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/usbip-host.ko 2023-10-06T02:46:06.687 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 105401 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-10-06T02:46:06.687 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/ 2023-10-06T02:46:06.687 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci/ 2023-10-06T02:46:06.687 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 153697 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-10-06T02:46:06.688 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 29537 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci/vfio-pci.ko 2023-10-06T02:46:06.688 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 100569 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/vfio.ko 2023-10-06T02:46:06.688 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 75137 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-10-06T02:46:06.688 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/ 2023-10-06T02:46:06.688 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 113889 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost.ko 2023-10-06T02:46:06.688 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16985 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_iotlb.ko 2023-10-06T02:46:06.688 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 58137 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_net.ko 2023-10-06T02:46:06.688 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 89289 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_scsi.ko 2023-10-06T02:46:06.688 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/ 2023-10-06T02:46:06.688 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/ 2023-10-06T02:46:06.688 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15417 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/88pm860x_bl.ko 2023-10-06T02:46:06.688 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12393 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/aat2870_bl.ko 2023-10-06T02:46:06.689 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 23305 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/adp5520_bl.ko 2023-10-06T02:46:06.689 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 32609 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/adp8860_bl.ko 2023-10-06T02:46:06.689 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 39993 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/adp8870_bl.ko 2023-10-06T02:46:06.689 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16921 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/apple_bl.ko 2023-10-06T02:46:06.689 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16777 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/as3711_bl.ko 2023-10-06T02:46:06.689 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12097 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/bd6107.ko 2023-10-06T02:46:06.689 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11409 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/da903x_bl.ko 2023-10-06T02:46:06.689 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11273 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/da9052_bl.ko 2023-10-06T02:46:06.689 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11945 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/gpio_backlight.ko 2023-10-06T02:46:06.689 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14769 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/kb3886_bl.ko 2023-10-06T02:46:06.689 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 22017 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/lcd.ko 2023-10-06T02:46:06.689 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 23657 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/lm3533_bl.ko 2023-10-06T02:46:06.689 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19337 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/lm3639_bl.ko 2023-10-06T02:46:06.690 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11425 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/lv5207lp.ko 2023-10-06T02:46:06.690 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14345 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/max8925_bl.ko 2023-10-06T02:46:06.690 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11313 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/pandora_bl.ko 2023-10-06T02:46:06.690 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10865 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/pcf50633-backlight.ko 2023-10-06T02:46:06.690 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10897 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/platform_lcd.ko 2023-10-06T02:46:06.690 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12721 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/wm831x_bl.ko 2023-10-06T02:46:06.690 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/ 2023-10-06T02:46:06.690 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters/ 2023-10-06T02:46:06.690 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18785 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters/ds2482.ko 2023-10-06T02:46:06.690 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 38961 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters/ds2490.ko 2023-10-06T02:46:06.690 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11265 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters/matrox_w1.ko 2023-10-06T02:46:06.690 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12417 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters/w1-gpio.ko 2023-10-06T02:46:06.690 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/ 2023-10-06T02:46:06.691 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12041 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-10-06T02:46:06.691 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 22809 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-10-06T02:46:06.691 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15113 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-10-06T02:46:06.691 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10825 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-10-06T02:46:06.691 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14153 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-10-06T02:46:06.691 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11929 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-10-06T02:46:06.691 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14113 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-10-06T02:46:06.691 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14049 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-10-06T02:46:06.691 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17921 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-10-06T02:46:06.691 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 7385 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_smem.ko 2023-10-06T02:46:06.691 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 56425 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_therm.ko 2023-10-06T02:46:06.692 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 102657 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/wire.ko 2023-10-06T02:46:06.692 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ 2023-10-06T02:46:06.692 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18793 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/acquirewdt.ko 2023-10-06T02:46:06.692 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19977 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/advantechwdt.ko 2023-10-06T02:46:06.692 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18561 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/alim1535_wdt.ko 2023-10-06T02:46:06.692 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 22969 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/alim7101_wdt.ko 2023-10-06T02:46:06.692 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19113 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/cpu5wdt.ko 2023-10-06T02:46:06.692 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13617 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/da9052_wdt.ko 2023-10-06T02:46:06.692 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12777 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/da9055_wdt.ko 2023-10-06T02:46:06.692 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17409 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/da9063_wdt.ko 2023-10-06T02:46:06.692 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20169 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/dw_wdt.ko 2023-10-06T02:46:06.693 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20265 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/eurotechwdt.ko 2023-10-06T02:46:06.693 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 23865 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/f71808e_wdt.ko 2023-10-06T02:46:06.693 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 27401 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/hpwdt.ko 2023-10-06T02:46:06.693 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15577 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/i6300esb.ko 2023-10-06T02:46:06.693 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10833 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-10-06T02:46:06.693 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21913 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/iTCO_wdt.ko 2023-10-06T02:46:06.693 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19241 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ib700wdt.ko 2023-10-06T02:46:06.693 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18689 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ibmasr.ko 2023-10-06T02:46:06.693 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19713 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-10-06T02:46:06.693 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21225 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/it8712f_wdt.ko 2023-10-06T02:46:06.693 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13841 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/it87_wdt.ko 2023-10-06T02:46:06.693 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21489 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/kempld_wdt.ko 2023-10-06T02:46:06.693 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18617 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/machzwd.ko 2023-10-06T02:46:06.694 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14721 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/mena21_wdt.ko 2023-10-06T02:46:06.694 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13217 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/menf21bmc_wdt.ko 2023-10-06T02:46:06.694 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 24673 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/nv_tco.ko 2023-10-06T02:46:06.694 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17737 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/of_xilinx_wdt.ko 2023-10-06T02:46:06.694 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 22265 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/pc87413_wdt.ko 2023-10-06T02:46:06.694 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 38657 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/pcwd_pci.ko 2023-10-06T02:46:06.694 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 31825 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/pcwd_usb.ko 2023-10-06T02:46:06.694 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13129 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/retu_wdt.ko 2023-10-06T02:46:06.694 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20449 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sbc60xxwdt.ko 2023-10-06T02:46:06.694 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14129 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sbc_epx_c3.ko 2023-10-06T02:46:06.694 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17321 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-10-06T02:46:06.694 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 23809 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sc1200wdt.ko 2023-10-06T02:46:06.695 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 23321 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sch311x_wdt.ko 2023-10-06T02:46:06.695 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21577 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/smsc37b787_wdt.ko 2023-10-06T02:46:06.695 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17273 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/softdog.ko 2023-10-06T02:46:06.695 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 22273 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sp5100_tco.ko 2023-10-06T02:46:06.695 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12817 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/twl4030_wdt.ko 2023-10-06T02:46:06.695 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17649 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/via_wdt.ko 2023-10-06T02:46:06.695 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19161 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-10-06T02:46:06.695 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20681 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83877f_wdt.ko 2023-10-06T02:46:06.695 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 25409 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83977f_wdt.ko 2023-10-06T02:46:06.695 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18497 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/wafer5823wdt.ko 2023-10-06T02:46:06.695 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 28089 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/wdt_pci.ko 2023-10-06T02:46:06.695 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16257 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/wm831x_wdt.ko 2023-10-06T02:46:06.695 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13785 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/wm8350_wdt.ko 2023-10-06T02:46:06.696 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15697 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/xen_wdt.ko 2023-10-06T02:46:06.696 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/ 2023-10-06T02:46:06.696 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 24729 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-evtchn.ko 2023-10-06T02:46:06.696 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 26745 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-gntalloc.ko 2023-10-06T02:46:06.696 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 47841 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-gntdev.ko 2023-10-06T02:46:06.696 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-pciback/ 2023-10-06T02:46:06.696 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 176417 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-10-06T02:46:06.696 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 40105 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-privcmd.ko 2023-10-06T02:46:06.696 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 71321 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-scsiback.ko 2023-10-06T02:46:06.696 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xenfs/ 2023-10-06T02:46:06.696 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19425 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xenfs/xenfs.ko 2023-10-06T02:46:06.696 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ 2023-10-06T02:46:06.697 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/9p/ 2023-10-06T02:46:06.697 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 165625 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/9p/9p.ko 2023-10-06T02:46:06.697 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/adfs/ 2023-10-06T02:46:06.697 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 60881 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/adfs/adfs.ko 2023-10-06T02:46:06.697 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/affs/ 2023-10-06T02:46:06.697 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 162617 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/affs/affs.ko 2023-10-06T02:46:06.697 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/afs/ 2023-10-06T02:46:06.697 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 931937 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/afs/kafs.ko 2023-10-06T02:46:06.697 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/autofs/ 2023-10-06T02:46:06.697 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 100937 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/autofs/autofs4.ko 2023-10-06T02:46:06.697 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/befs/ 2023-10-06T02:46:06.697 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 64481 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/befs/befs.ko 2023-10-06T02:46:06.697 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/bfs/ 2023-10-06T02:46:06.698 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 40993 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/bfs/bfs.ko 2023-10-06T02:46:06.698 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 34625 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/binfmt_misc.ko 2023-10-06T02:46:06.698 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/btrfs/ 2023-10-06T02:46:06.698 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 3474249 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/btrfs/btrfs.ko 2023-10-06T02:46:06.698 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cachefiles/ 2023-10-06T02:46:06.698 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 305745 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cachefiles/cachefiles.ko 2023-10-06T02:46:06.698 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ceph/ 2023-10-06T02:46:06.698 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 1316257 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ceph/ceph.ko 2023-10-06T02:46:06.698 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/coda/ 2023-10-06T02:46:06.698 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 100497 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/coda/coda.ko 2023-10-06T02:46:06.698 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/configfs/ 2023-10-06T02:46:06.698 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 108073 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/configfs/configfs.ko 2023-10-06T02:46:06.699 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cramfs/ 2023-10-06T02:46:06.699 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 29273 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cramfs/cramfs.ko 2023-10-06T02:46:06.699 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/dlm/ 2023-10-06T02:46:06.699 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 633825 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/dlm/dlm.ko 2023-10-06T02:46:06.699 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/efs/ 2023-10-06T02:46:06.699 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 36585 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/efs/efs.ko 2023-10-06T02:46:06.699 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/f2fs/ 2023-10-06T02:46:06.699 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 1500513 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/f2fs/f2fs.ko 2023-10-06T02:46:06.734 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/ 2023-10-06T02:46:06.752 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 27865 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/msdos.ko 2023-10-06T02:46:06.752 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/freevxfs/ 2023-10-06T02:46:06.752 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 42457 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/freevxfs/freevxfs.ko 2023-10-06T02:46:06.752 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fscache/ 2023-10-06T02:46:06.752 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 226505 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fscache/fscache.ko 2023-10-06T02:46:06.752 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse/ 2023-10-06T02:46:06.752 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 24473 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse/cuse.ko 2023-10-06T02:46:06.752 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/gfs2/ 2023-10-06T02:46:06.752 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 1226385 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/gfs2/gfs2.ko 2023-10-06T02:46:06.753 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfs/ 2023-10-06T02:46:06.753 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 141241 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfs/hfs.ko 2023-10-06T02:46:06.753 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfsplus/ 2023-10-06T02:46:06.753 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 221553 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfsplus/hfsplus.ko 2023-10-06T02:46:06.753 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hpfs/ 2023-10-06T02:46:06.753 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 193577 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hpfs/hpfs.ko 2023-10-06T02:46:06.753 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/isofs/ 2023-10-06T02:46:06.753 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 74393 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/isofs/isofs.ko 2023-10-06T02:46:06.753 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/jfs/ 2023-10-06T02:46:06.753 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 421097 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/jfs/jfs.ko 2023-10-06T02:46:06.753 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/lockd/ 2023-10-06T02:46:06.753 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 279041 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/lockd/lockd.ko 2023-10-06T02:46:06.754 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/minix/ 2023-10-06T02:46:06.754 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 87833 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/minix/minix.ko 2023-10-06T02:46:06.754 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/netfs/ 2023-10-06T02:46:06.754 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 124697 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/netfs/netfs.ko 2023-10-06T02:46:06.754 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/ 2023-10-06T02:46:06.754 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/blocklayout/ 2023-10-06T02:46:06.754 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 81521 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-10-06T02:46:06.754 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/filelayout/ 2023-10-06T02:46:06.754 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 59425 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-10-06T02:46:06.754 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/flexfilelayout/ 2023-10-06T02:46:06.754 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 117705 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-10-06T02:46:06.754 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 1053889 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfs.ko 2023-10-06T02:46:06.755 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 66089 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfsv2.ko 2023-10-06T02:46:06.755 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 119801 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfsv3.ko 2023-10-06T02:46:06.755 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 2041809 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfsv4.ko 2023-10-06T02:46:06.755 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common/ 2023-10-06T02:46:06.755 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16937 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common/grace.ko 2023-10-06T02:46:06.755 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16145 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common/nfs_acl.ko 2023-10-06T02:46:06.755 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfsd/ 2023-10-06T02:46:06.755 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 1504929 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfsd/nfsd.ko 2023-10-06T02:46:06.755 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nilfs2/ 2023-10-06T02:46:06.755 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 591401 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nilfs2/nilfs2.ko 2023-10-06T02:46:06.755 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/ 2023-10-06T02:46:06.755 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13793 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-celtic.ko 2023-10-06T02:46:06.756 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13169 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-centeuro.ko 2023-10-06T02:46:06.756 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13793 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-croatian.ko 2023-10-06T02:46:06.756 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12865 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-cyrillic.ko 2023-10-06T02:46:06.756 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13481 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-gaelic.ko 2023-10-06T02:46:06.756 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12857 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-greek.ko 2023-10-06T02:46:06.756 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13793 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-iceland.ko 2023-10-06T02:46:06.756 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13169 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-inuit.ko 2023-10-06T02:46:06.756 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14097 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-roman.ko 2023-10-06T02:46:06.756 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13793 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-romanian.ko 2023-10-06T02:46:06.756 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13793 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-turkish.ko 2023-10-06T02:46:06.756 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11297 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_ascii.ko 2023-10-06T02:46:06.756 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12537 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1250.ko 2023-10-06T02:46:06.756 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12233 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1251.ko 2023-10-06T02:46:06.757 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12921 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1255.ko 2023-10-06T02:46:06.757 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12537 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp737.ko 2023-10-06T02:46:06.757 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12537 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp775.ko 2023-10-06T02:46:06.757 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12225 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp850.ko 2023-10-06T02:46:06.757 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12225 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp852.ko 2023-10-06T02:46:06.757 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12225 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp855.ko 2023-10-06T02:46:06.757 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11913 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp857.ko 2023-10-06T02:46:06.757 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12849 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp860.ko 2023-10-06T02:46:06.757 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13161 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp861.ko 2023-10-06T02:46:06.757 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13473 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp862.ko 2023-10-06T02:46:06.757 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13161 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp863.ko 2023-10-06T02:46:06.757 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12849 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp864.ko 2023-10-06T02:46:06.758 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13161 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp865.ko 2023-10-06T02:46:06.758 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12537 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp866.ko 2023-10-06T02:46:06.758 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12225 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp869.ko 2023-10-06T02:46:06.758 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11985 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp874.ko 2023-10-06T02:46:06.758 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 94137 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp932.ko 2023-10-06T02:46:06.758 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 142673 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp936.ko 2023-10-06T02:46:06.758 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 165745 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp949.ko 2023-10-06T02:46:06.758 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 118121 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp950.ko 2023-10-06T02:46:06.758 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12457 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_euc-jp.ko 2023-10-06T02:46:06.758 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11305 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-1.ko 2023-10-06T02:46:06.758 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11929 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-13.ko 2023-10-06T02:46:06.758 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11929 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-14.ko 2023-10-06T02:46:06.759 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11929 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-15.ko 2023-10-06T02:46:06.759 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11921 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-2.ko 2023-10-06T02:46:06.759 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11921 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-3.ko 2023-10-06T02:46:06.759 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11921 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-4.ko 2023-10-06T02:46:06.759 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11921 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-5.ko 2023-10-06T02:46:06.759 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11617 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-6.ko 2023-10-06T02:46:06.759 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12233 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-7.ko 2023-10-06T02:46:06.759 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11617 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-9.ko 2023-10-06T02:46:06.759 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12537 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-r.ko 2023-10-06T02:46:06.759 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8017 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-ru.ko 2023-10-06T02:46:06.759 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12537 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-u.ko 2023-10-06T02:46:06.759 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8337 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_utf8.ko 2023-10-06T02:46:06.759 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ntfs/ 2023-10-06T02:46:06.760 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 219361 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ntfs/ntfs.ko 2023-10-06T02:46:06.760 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ 2023-10-06T02:46:06.760 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/cluster/ 2023-10-06T02:46:06.760 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 244177 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-10-06T02:46:06.760 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlm/ 2023-10-06T02:46:06.760 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 440785 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-10-06T02:46:06.760 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlmfs/ 2023-10-06T02:46:06.760 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 53841 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-10-06T02:46:06.760 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 2589873 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2.ko 2023-10-06T02:46:06.760 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17905 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-10-06T02:46:06.760 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 31585 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-10-06T02:46:06.760 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 35881 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-10-06T02:46:06.760 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/omfs/ 2023-10-06T02:46:06.761 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 52569 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/omfs/omfs.ko 2023-10-06T02:46:06.761 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/overlayfs/ 2023-10-06T02:46:06.761 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 336889 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/overlayfs/overlay.ko 2023-10-06T02:46:06.761 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/pstore/ 2023-10-06T02:46:06.761 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 54609 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/pstore/ramoops.ko 2023-10-06T02:46:06.761 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/qnx4/ 2023-10-06T02:46:06.761 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 26801 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/qnx4/qnx4.ko 2023-10-06T02:46:06.761 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/qnx6/ 2023-10-06T02:46:06.761 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 46649 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/qnx6/qnx6.ko 2023-10-06T02:46:06.761 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/quota/ 2023-10-06T02:46:06.761 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 30881 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/quota/quota_tree.ko 2023-10-06T02:46:06.761 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14361 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/quota/quota_v1.ko 2023-10-06T02:46:06.762 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 22017 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/quota/quota_v2.ko 2023-10-06T02:46:06.762 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/reiserfs/ 2023-10-06T02:46:06.762 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 530697 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/reiserfs/reiserfs.ko 2023-10-06T02:46:06.762 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/romfs/ 2023-10-06T02:46:06.762 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 28505 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/romfs/romfs.ko 2023-10-06T02:46:06.762 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/ 2023-10-06T02:46:06.762 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/client/ 2023-10-06T02:46:06.762 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 2661209 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/client/cifs.ko 2023-10-06T02:46:06.762 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common/ 2023-10-06T02:46:06.762 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 7161 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common/cifs_arc4.ko 2023-10-06T02:46:06.762 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11257 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common/cifs_md4.ko 2023-10-06T02:46:06.762 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/squashfs/ 2023-10-06T02:46:06.762 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 134313 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/squashfs/squashfs.ko 2023-10-06T02:46:06.763 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/sysv/ 2023-10-06T02:46:06.763 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 89737 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/sysv/sysv.ko 2023-10-06T02:46:06.763 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/udf/ 2023-10-06T02:46:06.763 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 248049 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/udf/udf.ko 2023-10-06T02:46:06.763 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ufs/ 2023-10-06T02:46:06.763 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 160857 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ufs/ufs.ko 2023-10-06T02:46:06.763 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/xfs/ 2023-10-06T02:46:06.763 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 3998129 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/xfs/xfs.ko 2023-10-06T02:46:06.763 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/ 2023-10-06T02:46:06.763 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/locking/ 2023-10-06T02:46:06.763 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 74865 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/locking/locktorture.ko 2023-10-06T02:46:06.763 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/time/ 2023-10-06T02:46:06.763 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13737 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/time/test_udelay.ko 2023-10-06T02:46:06.764 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 58473 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/torture.ko 2023-10-06T02:46:06.764 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ 2023-10-06T02:46:06.764 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 6833 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crc-itu-t.ko 2023-10-06T02:46:06.764 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 6529 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crc7.ko 2023-10-06T02:46:06.764 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 7025 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crc8.ko 2023-10-06T02:46:06.764 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto/ 2023-10-06T02:46:06.764 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 7097 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto/libarc4.ko 2023-10-06T02:46:06.764 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 37081 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto/libdes.ko 2023-10-06T02:46:06.764 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13313 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/interval_tree_test.ko 2023-10-06T02:46:06.764 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8425 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/libcrc32c.ko 2023-10-06T02:46:06.764 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 24929 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lru_cache.ko 2023-10-06T02:46:06.764 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4/ 2023-10-06T02:46:06.765 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 33801 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4/lz4_compress.ko 2023-10-06T02:46:06.765 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 22633 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4/lz4hc_compress.ko 2023-10-06T02:46:06.765 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/math/ 2023-10-06T02:46:06.765 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 6617 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/math/cordic.ko 2023-10-06T02:46:06.765 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8233 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/memory-notifier-error-inject.ko 2023-10-06T02:46:06.765 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10929 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/notifier-error-inject.ko 2023-10-06T02:46:06.765 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14089 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/percpu_test.ko 2023-10-06T02:46:06.765 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8305 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/pm-notifier-error-inject.ko 2023-10-06T02:46:06.765 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/raid6/ 2023-10-06T02:46:06.765 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 143433 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/raid6/raid6_pq.ko 2023-10-06T02:46:06.765 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21105 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/rbtree_test.ko 2023-10-06T02:46:06.765 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/reed_solomon/ 2023-10-06T02:46:06.765 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18737 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/reed_solomon/reed_solomon.ko 2023-10-06T02:46:06.766 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 38841 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/test-kstrtox.ko 2023-10-06T02:46:06.766 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 26321 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/test-string_helpers.ko 2023-10-06T02:46:06.766 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 4760825 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/test_bpf.ko 2023-10-06T02:46:06.766 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 49081 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/test_firmware.ko 2023-10-06T02:46:06.766 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 6369 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/test_module.ko 2023-10-06T02:46:06.766 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20801 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/test_user_copy.ko 2023-10-06T02:46:06.766 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9585 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_bm.ko 2023-10-06T02:46:06.766 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11121 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_fsm.ko 2023-10-06T02:46:06.766 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9689 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_kmp.ko 2023-10-06T02:46:06.766 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/xz/ 2023-10-06T02:46:06.766 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13545 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/xz/xz_dec_test.ko 2023-10-06T02:46:06.766 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/mm/ 2023-10-06T02:46:06.767 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15489 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/mm/hwpoison-inject.ko 2023-10-06T02:46:06.767 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ 2023-10-06T02:46:06.767 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/ 2023-10-06T02:46:06.767 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 55737 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/6lowpan.ko 2023-10-06T02:46:06.767 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 7049 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_dest.ko 2023-10-06T02:46:06.767 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 7065 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_fragment.ko 2023-10-06T02:46:06.767 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 7049 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_hop.ko 2023-10-06T02:46:06.767 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 6985 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_ipv6.ko 2023-10-06T02:46:06.767 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 7065 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_mobility.ko 2023-10-06T02:46:06.767 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 7065 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_routing.ko 2023-10-06T02:46:06.767 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15329 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_udp.ko 2023-10-06T02:46:06.767 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/ 2023-10-06T02:46:06.767 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 30385 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/garp.ko 2023-10-06T02:46:06.768 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 34785 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/mrp.ko 2023-10-06T02:46:06.768 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8545 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/p8022.ko 2023-10-06T02:46:06.768 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15841 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/psnap.ko 2023-10-06T02:46:06.768 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11537 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/stp.ko 2023-10-06T02:46:06.768 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/8021q/ 2023-10-06T02:46:06.768 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 81017 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/8021q/8021q.ko 2023-10-06T02:46:06.768 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/ 2023-10-06T02:46:06.768 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 198465 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet.ko 2023-10-06T02:46:06.768 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 35961 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_fd.ko 2023-10-06T02:46:06.768 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 26345 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_rdma.ko 2023-10-06T02:46:06.768 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 32321 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_virtio.ko 2023-10-06T02:46:06.768 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/batman-adv/ 2023-10-06T02:46:06.769 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 652553 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/batman-adv/batman-adv.ko 2023-10-06T02:46:06.769 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/ 2023-10-06T02:46:06.769 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 63825 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/br_netfilter.ko 2023-10-06T02:46:06.769 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 772505 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/bridge.ko 2023-10-06T02:46:06.769 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ 2023-10-06T02:46:06.769 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 7657 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-10-06T02:46:06.769 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12385 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_among.ko 2023-10-06T02:46:06.769 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9169 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_arp.ko 2023-10-06T02:46:06.769 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9073 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-10-06T02:46:06.769 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9625 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-10-06T02:46:06.769 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8737 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_ip.ko 2023-10-06T02:46:06.769 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9145 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-10-06T02:46:06.770 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9825 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_limit.ko 2023-10-06T02:46:06.770 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13217 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_log.ko 2023-10-06T02:46:06.770 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 7585 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_mark.ko 2023-10-06T02:46:06.770 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 7593 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-10-06T02:46:06.770 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8385 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-10-06T02:46:06.770 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 7537 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-10-06T02:46:06.770 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9593 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-10-06T02:46:06.770 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8649 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_snat.ko 2023-10-06T02:46:06.770 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8889 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_stp.ko 2023-10-06T02:46:06.770 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12401 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-10-06T02:46:06.770 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11529 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-10-06T02:46:06.770 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9817 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-10-06T02:46:06.771 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9793 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-10-06T02:46:06.771 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 55937 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtables.ko 2023-10-06T02:46:06.771 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14041 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-10-06T02:46:06.771 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13945 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-10-06T02:46:06.771 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ceph/ 2023-10-06T02:46:06.771 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 1046921 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ceph/libceph.ko 2023-10-06T02:46:06.771 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core/ 2023-10-06T02:46:06.771 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 124793 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core/pktgen.ko 2023-10-06T02:46:06.771 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/ 2023-10-06T02:46:06.771 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 194321 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp.ko 2023-10-06T02:46:06.771 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8665 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_diag.ko 2023-10-06T02:46:06.771 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 56945 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_ipv4.ko 2023-10-06T02:46:06.771 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 59457 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_ipv6.ko 2023-10-06T02:46:06.772 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/ 2023-10-06T02:46:06.772 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 390297 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/dsa_core.ko 2023-10-06T02:46:06.772 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13337 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_brcm.ko 2023-10-06T02:46:06.772 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12577 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_dsa.ko 2023-10-06T02:46:06.772 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 7721 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_none.ko 2023-10-06T02:46:06.772 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8953 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_trailer.ko 2023-10-06T02:46:06.772 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/hsr/ 2023-10-06T02:46:06.772 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 100257 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/hsr/hsr.ko 2023-10-06T02:46:06.772 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/ 2023-10-06T02:46:06.772 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/6lowpan/ 2023-10-06T02:46:06.772 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 45169 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-10-06T02:46:06.772 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 254601 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/ieee802154.ko 2023-10-06T02:46:06.772 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 47265 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/ieee802154_socket.ko 2023-10-06T02:46:06.773 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ 2023-10-06T02:46:06.773 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 24729 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ah4.ko 2023-10-06T02:46:06.773 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 38905 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/esp4.ko 2023-10-06T02:46:06.773 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 48345 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/fou.ko 2023-10-06T02:46:06.773 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18241 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/gre.ko 2023-10-06T02:46:06.773 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 48529 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/inet_diag.ko 2023-10-06T02:46:06.773 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 60593 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_gre.ko 2023-10-06T02:46:06.773 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 61281 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_tunnel.ko 2023-10-06T02:46:06.773 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 34457 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_vti.ko 2023-10-06T02:46:06.773 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14001 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ipcomp.ko 2023-10-06T02:46:06.773 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 28889 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ipip.ko 2023-10-06T02:46:06.773 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ 2023-10-06T02:46:06.774 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 37689 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arp_tables.ko 2023-10-06T02:46:06.774 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8873 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-10-06T02:46:06.774 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10409 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-10-06T02:46:06.774 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 41601 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ip_tables.ko 2023-10-06T02:46:06.774 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10057 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-10-06T02:46:06.774 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9681 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2023-10-06T02:46:06.774 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14145 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-10-06T02:46:06.774 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11177 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-10-06T02:46:06.774 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14929 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-10-06T02:46:06.774 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11305 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_filter.ko 2023-10-06T02:46:06.774 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11649 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-10-06T02:46:06.774 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14929 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-10-06T02:46:06.775 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11545 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-10-06T02:46:06.775 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10409 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_security.ko 2023-10-06T02:46:06.775 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12169 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-10-06T02:46:06.775 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8817 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-10-06T02:46:06.775 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 27625 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-10-06T02:46:06.775 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18225 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-10-06T02:46:06.775 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13337 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-10-06T02:46:06.775 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20561 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2023-10-06T02:46:06.775 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9329 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-10-06T02:46:06.775 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15225 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-10-06T02:46:06.775 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9961 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-10-06T02:46:06.775 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17161 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-10-06T02:46:06.776 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9009 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-10-06T02:46:06.776 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13073 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_bic.ko 2023-10-06T02:46:06.776 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13737 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_dctcp.ko 2023-10-06T02:46:06.776 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15121 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_diag.ko 2023-10-06T02:46:06.776 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9537 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_highspeed.ko 2023-10-06T02:46:06.776 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12401 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_htcp.ko 2023-10-06T02:46:06.776 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10449 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_hybla.ko 2023-10-06T02:46:06.776 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11473 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_illinois.ko 2023-10-06T02:46:06.776 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10433 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_lp.ko 2023-10-06T02:46:06.776 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8329 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_scalable.ko 2023-10-06T02:46:06.776 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14425 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_vegas.ko 2023-10-06T02:46:06.776 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10089 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_veno.ko 2023-10-06T02:46:06.776 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10953 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_westwood.ko 2023-10-06T02:46:06.777 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10185 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_yeah.ko 2023-10-06T02:46:06.777 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 22601 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tunnel4.ko 2023-10-06T02:46:06.777 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16361 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/udp_diag.ko 2023-10-06T02:46:06.777 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 41577 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/udp_tunnel.ko 2023-10-06T02:46:06.777 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11425 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/xfrm4_tunnel.ko 2023-10-06T02:46:06.777 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ 2023-10-06T02:46:06.777 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 26441 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ah6.ko 2023-10-06T02:46:06.777 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 39537 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/esp6.ko 2023-10-06T02:46:06.777 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14425 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/fou6.ko 2023-10-06T02:46:06.777 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 80793 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_gre.ko 2023-10-06T02:46:06.777 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 92817 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_tunnel.ko 2023-10-06T02:46:06.777 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10609 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-10-06T02:46:06.777 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 54089 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_vti.ko 2023-10-06T02:46:06.778 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13785 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ipcomp6.ko 2023-10-06T02:46:06.778 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19017 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/mip6.ko 2023-10-06T02:46:06.778 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ 2023-10-06T02:46:06.778 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 42209 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-10-06T02:46:06.778 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11753 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2023-10-06T02:46:06.778 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9753 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-10-06T02:46:06.778 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14161 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-10-06T02:46:06.778 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14337 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-10-06T02:46:06.778 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 7801 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-10-06T02:46:06.778 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16209 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-10-06T02:46:06.778 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16033 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-10-06T02:46:06.778 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8913 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-10-06T02:46:06.779 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9897 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-10-06T02:46:06.779 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10937 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-10-06T02:46:06.779 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10897 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-10-06T02:46:06.779 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11321 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-10-06T02:46:06.779 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11121 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-10-06T02:46:06.779 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14969 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-10-06T02:46:06.779 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11617 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-10-06T02:46:06.779 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10433 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-10-06T02:46:06.779 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 38833 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-10-06T02:46:06.779 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8449 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-10-06T02:46:06.779 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 26057 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-10-06T02:46:06.779 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9801 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-10-06T02:46:06.779 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15441 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-10-06T02:46:06.780 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9633 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-10-06T02:46:06.780 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16025 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-10-06T02:46:06.780 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9009 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-10-06T02:46:06.780 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 73161 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/sit.ko 2023-10-06T02:46:06.780 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 24193 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/tunnel6.ko 2023-10-06T02:46:06.780 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 23305 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/xfrm6_tunnel.ko 2023-10-06T02:46:06.780 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/key/ 2023-10-06T02:46:06.780 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 82929 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/key/af_key.ko 2023-10-06T02:46:06.780 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/ 2023-10-06T02:46:06.780 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 125873 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_core.ko 2023-10-06T02:46:06.780 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20273 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_debugfs.ko 2023-10-06T02:46:06.780 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 25865 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_eth.ko 2023-10-06T02:46:06.780 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 35049 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ip.ko 2023-10-06T02:46:06.781 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 36745 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ip6.ko 2023-10-06T02:46:06.781 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 33001 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_netlink.ko 2023-10-06T02:46:06.781 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 53153 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ppp.ko 2023-10-06T02:46:06.781 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/lapb/ 2023-10-06T02:46:06.781 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 48065 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/lapb/lapb.ko 2023-10-06T02:46:06.781 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/llc/ 2023-10-06T02:46:06.781 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 23225 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/llc/llc.ko 2023-10-06T02:46:06.781 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 267257 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/llc/llc2.ko 2023-10-06T02:46:06.781 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mac802154/ 2023-10-06T02:46:06.781 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 291041 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mac802154/mac802154.ko 2023-10-06T02:46:06.781 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mpls/ 2023-10-06T02:46:06.781 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9393 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mpls/mpls_gso.ko 2023-10-06T02:46:06.782 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ 2023-10-06T02:46:06.782 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ 2023-10-06T02:46:06.782 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 119649 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set.ko 2023-10-06T02:46:06.782 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 28449 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-10-06T02:46:06.782 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 27033 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-10-06T02:46:06.782 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 26465 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-10-06T02:46:06.782 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 102033 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-10-06T02:46:06.782 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 103121 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-10-06T02:46:06.782 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 104593 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-10-06T02:46:06.782 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 105129 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-10-06T02:46:06.782 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 114393 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-10-06T02:46:06.782 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 61161 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-10-06T02:46:06.782 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 111161 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-10-06T02:46:06.783 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 114673 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-10-06T02:46:06.783 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 114329 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-10-06T02:46:06.783 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 113217 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-10-06T02:46:06.783 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 116217 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-10-06T02:46:06.783 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 30145 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-10-06T02:46:06.783 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ 2023-10-06T02:46:06.783 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 412889 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs.ko 2023-10-06T02:46:06.783 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11961 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-10-06T02:46:06.783 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 7625 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-10-06T02:46:06.783 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17729 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-10-06T02:46:06.783 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17905 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-10-06T02:46:06.783 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20657 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-10-06T02:46:06.783 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 7689 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-10-06T02:46:06.784 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 7689 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-10-06T02:46:06.784 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10681 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-10-06T02:46:06.784 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9233 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-10-06T02:46:06.784 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 7697 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-10-06T02:46:06.784 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13521 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-10-06T02:46:06.784 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 7697 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-10-06T02:46:06.784 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10993 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-10-06T02:46:06.784 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 48897 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conncount.ko 2023-10-06T02:46:06.784 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 408665 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack.ko 2023-10-06T02:46:06.784 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15985 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-10-06T02:46:06.784 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10177 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-10-06T02:46:06.784 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 33761 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-10-06T02:46:06.784 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 118145 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_h323.ko 2023-10-06T02:46:06.785 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 22185 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_irc.ko 2023-10-06T02:46:06.785 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8817 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-10-06T02:46:06.785 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 108393 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-10-06T02:46:06.785 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 33825 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-10-06T02:46:06.785 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17401 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_sane.ko 2023-10-06T02:46:06.785 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 66641 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_sip.ko 2023-10-06T02:46:06.785 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11233 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-10-06T02:46:06.785 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19185 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-10-06T02:46:06.785 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10113 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_dup_netdev.ko 2023-10-06T02:46:06.785 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 88513 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_flow_table.ko 2023-10-06T02:46:06.785 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9593 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_flow_table_inet.ko 2023-10-06T02:46:06.785 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 37129 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_log_syslog.ko 2023-10-06T02:46:06.785 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 95353 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat.ko 2023-10-06T02:46:06.786 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10129 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_amanda.ko 2023-10-06T02:46:06.786 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12625 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_ftp.ko 2023-10-06T02:46:06.786 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11857 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_irc.ko 2023-10-06T02:46:06.786 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 28929 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_sip.ko 2023-10-06T02:46:06.786 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8809 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_tftp.ko 2023-10-06T02:46:06.786 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 44025 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_synproxy_core.ko 2023-10-06T02:46:06.786 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 609257 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_tables.ko 2023-10-06T02:46:06.786 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 43873 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink.ko 2023-10-06T02:46:06.786 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 30273 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_acct.ko 2023-10-06T02:46:06.786 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 30625 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_cttimeout.ko 2023-10-06T02:46:06.786 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 39905 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_log.ko 2023-10-06T02:46:06.786 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 22713 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_osf.ko 2023-10-06T02:46:06.787 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 49673 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_queue.ko 2023-10-06T02:46:06.787 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10457 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_chain_nat.ko 2023-10-06T02:46:06.787 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 33257 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_compat.ko 2023-10-06T02:46:06.787 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 40721 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_ct.ko 2023-10-06T02:46:06.787 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9601 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_dup_netdev.ko 2023-10-06T02:46:06.787 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11345 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_fib.ko 2023-10-06T02:46:06.787 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13745 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_fwd_netdev.ko 2023-10-06T02:46:06.787 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14185 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_hash.ko 2023-10-06T02:46:06.787 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20065 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_limit.ko 2023-10-06T02:46:06.787 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15401 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_log.ko 2023-10-06T02:46:06.787 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14801 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_masq.ko 2023-10-06T02:46:06.787 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14441 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_nat.ko 2023-10-06T02:46:06.787 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13673 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_numgen.ko 2023-10-06T02:46:06.788 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11793 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_osf.ko 2023-10-06T02:46:06.788 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14073 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_queue.ko 2023-10-06T02:46:06.788 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14257 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_redir.ko 2023-10-06T02:46:06.788 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10497 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_reject.ko 2023-10-06T02:46:06.788 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10081 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_reject_inet.ko 2023-10-06T02:46:06.788 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12737 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_socket.ko 2023-10-06T02:46:06.788 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20393 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_synproxy.ko 2023-10-06T02:46:06.788 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14849 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_tproxy.ko 2023-10-06T02:46:06.788 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 89329 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/x_tables.ko 2023-10-06T02:46:06.788 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12097 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_AUDIT.ko 2023-10-06T02:46:06.788 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9633 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CHECKSUM.ko 2023-10-06T02:46:06.788 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 7729 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CLASSIFY.ko 2023-10-06T02:46:06.788 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11521 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-10-06T02:46:06.789 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 18169 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CT.ko 2023-10-06T02:46:06.789 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10497 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_DSCP.ko 2023-10-06T02:46:06.789 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9465 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_HL.ko 2023-10-06T02:46:06.789 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13433 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_HMARK.ko 2023-10-06T02:46:06.789 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 38857 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_IDLETIMER.ko 2023-10-06T02:46:06.789 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13873 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_LED.ko 2023-10-06T02:46:06.789 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11489 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_LOG.ko 2023-10-06T02:46:06.789 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11753 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_MASQUERADE.ko 2023-10-06T02:46:06.789 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11657 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NETMAP.ko 2023-10-06T02:46:06.789 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9473 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NFLOG.ko 2023-10-06T02:46:06.789 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13289 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NFQUEUE.ko 2023-10-06T02:46:06.789 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19689 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_RATEEST.ko 2023-10-06T02:46:06.789 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11073 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_REDIRECT.ko 2023-10-06T02:46:06.790 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 14337 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_SECMARK.ko 2023-10-06T02:46:06.790 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16057 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TCPMSS.ko 2023-10-06T02:46:06.790 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10433 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-10-06T02:46:06.790 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17369 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TEE.ko 2023-10-06T02:46:06.790 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16785 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TPROXY.ko 2023-10-06T02:46:06.790 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8321 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TRACE.ko 2023-10-06T02:46:06.790 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13897 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_addrtype.ko 2023-10-06T02:46:06.790 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13897 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_bpf.ko 2023-10-06T02:46:06.790 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15577 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cgroup.ko 2023-10-06T02:46:06.790 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11209 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cluster.ko 2023-10-06T02:46:06.790 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 7505 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_comment.ko 2023-10-06T02:46:06.790 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10465 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connbytes.ko 2023-10-06T02:46:06.790 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11081 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connlabel.ko 2023-10-06T02:46:06.791 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9401 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connlimit.ko 2023-10-06T02:46:06.791 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13129 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connmark.ko 2023-10-06T02:46:06.791 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12401 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_conntrack.ko 2023-10-06T02:46:06.791 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 7817 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cpu.ko 2023-10-06T02:46:06.791 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10969 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_dccp.ko 2023-10-06T02:46:06.791 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 7865 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_devgroup.ko 2023-10-06T02:46:06.791 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8801 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_dscp.ko 2023-10-06T02:46:06.791 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10657 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ecn.ko 2023-10-06T02:46:06.791 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11473 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_esp.ko 2023-10-06T02:46:06.791 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 43457 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_hashlimit.ko 2023-10-06T02:46:06.791 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11313 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_helper.ko 2023-10-06T02:46:06.791 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 7865 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_hl.ko 2023-10-06T02:46:06.792 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11921 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ipcomp.ko 2023-10-06T02:46:06.792 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11473 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_iprange.ko 2023-10-06T02:46:06.792 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11785 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ipvs.ko 2023-10-06T02:46:06.792 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16041 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_l2tp.ko 2023-10-06T02:46:06.792 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8001 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_length.ko 2023-10-06T02:46:06.792 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10273 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_limit.ko 2023-10-06T02:46:06.792 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 7545 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_mac.ko 2023-10-06T02:46:06.792 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8641 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_mark.ko 2023-10-06T02:46:06.792 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11825 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_multiport.ko 2023-10-06T02:46:06.792 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13817 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_nat.ko 2023-10-06T02:46:06.792 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10105 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_nfacct.ko 2023-10-06T02:46:06.792 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8297 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_osf.ko 2023-10-06T02:46:06.792 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9553 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_owner.ko 2023-10-06T02:46:06.793 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9729 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_physdev.ko 2023-10-06T02:46:06.793 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 7633 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_pkttype.ko 2023-10-06T02:46:06.793 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11985 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_policy.ko 2023-10-06T02:46:06.793 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9473 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_quota.ko 2023-10-06T02:46:06.793 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10409 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_rateest.ko 2023-10-06T02:46:06.793 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8257 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_realm.ko 2023-10-06T02:46:06.793 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 36441 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_recent.ko 2023-10-06T02:46:06.793 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13329 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_sctp.ko 2023-10-06T02:46:06.793 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 30089 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_set.ko 2023-10-06T02:46:06.793 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16089 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_socket.ko 2023-10-06T02:46:06.793 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9505 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_state.ko 2023-10-06T02:46:06.793 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9473 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_statistic.ko 2023-10-06T02:46:06.793 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8809 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_string.ko 2023-10-06T02:46:06.794 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 8553 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_tcpmss.ko 2023-10-06T02:46:06.794 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15777 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_tcpudp.ko 2023-10-06T02:46:06.794 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11129 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_time.ko 2023-10-06T02:46:06.794 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9105 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_u32.ko 2023-10-06T02:46:06.794 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netlink/ 2023-10-06T02:46:06.794 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13969 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netlink/netlink_diag.ko 2023-10-06T02:46:06.794 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/nsh/ 2023-10-06T02:46:06.794 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 12425 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/nsh/nsh.ko 2023-10-06T02:46:06.794 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/ 2023-10-06T02:46:06.794 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 379545 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/openvswitch.ko 2023-10-06T02:46:06.794 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10321 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-geneve.ko 2023-10-06T02:46:06.794 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9449 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-gre.ko 2023-10-06T02:46:06.795 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 11793 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-vxlan.ko 2023-10-06T02:46:06.795 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/packet/ 2023-10-06T02:46:06.795 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13057 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/packet/af_packet_diag.ko 2023-10-06T02:46:06.795 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/phonet/ 2023-10-06T02:46:06.795 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 109961 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/phonet/phonet.ko 2023-10-06T02:46:06.795 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 54761 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/phonet/pn_pep.ko 2023-10-06T02:46:06.795 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/ 2023-10-06T02:46:06.795 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 252889 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds.ko 2023-10-06T02:46:06.795 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 165081 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds_rdma.ko 2023-10-06T02:46:06.795 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 67241 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds_tcp.ko 2023-10-06T02:46:06.795 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rxrpc/ 2023-10-06T02:46:06.795 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 820137 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rxrpc/rxrpc.ko 2023-10-06T02:46:06.795 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/ 2023-10-06T02:46:06.796 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 32249 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_csum.ko 2023-10-06T02:46:06.796 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 23537 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_gact.ko 2023-10-06T02:46:06.796 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 26897 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_ipt.ko 2023-10-06T02:46:06.796 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 34057 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_mirred.ko 2023-10-06T02:46:06.796 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 23425 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_nat.ko 2023-10-06T02:46:06.796 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 43817 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_pedit.ko 2023-10-06T02:46:06.796 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 31985 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_police.ko 2023-10-06T02:46:06.796 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20313 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_simple.ko 2023-10-06T02:46:06.796 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 36353 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_skbedit.ko 2023-10-06T02:46:06.796 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 36057 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_vlan.ko 2023-10-06T02:46:06.796 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 26145 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_basic.ko 2023-10-06T02:46:06.796 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 33945 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_bpf.ko 2023-10-06T02:46:06.796 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19233 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_cgroup.ko 2023-10-06T02:46:06.797 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 31377 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_flow.ko 2023-10-06T02:46:06.797 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 31769 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_fw.ko 2023-10-06T02:46:06.797 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 38489 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_route.ko 2023-10-06T02:46:06.797 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 61409 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_u32.ko 2023-10-06T02:46:06.797 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 7441 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_cmp.ko 2023-10-06T02:46:06.797 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 13457 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_ipset.ko 2023-10-06T02:46:06.797 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 33337 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_meta.ko 2023-10-06T02:46:06.797 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 7897 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_nbyte.ko 2023-10-06T02:46:06.797 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10625 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_text.ko 2023-10-06T02:46:06.797 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 7249 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_u32.ko 2023-10-06T02:46:06.797 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 21649 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_choke.ko 2023-10-06T02:46:06.797 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20849 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_codel.ko 2023-10-06T02:46:06.797 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 33753 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_drr.ko 2023-10-06T02:46:06.798 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 33609 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_fq.ko 2023-10-06T02:46:06.798 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 31601 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_fq_codel.ko 2023-10-06T02:46:06.798 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 35433 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_gred.ko 2023-10-06T02:46:06.798 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 48409 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_hfsc.ko 2023-10-06T02:46:06.798 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 22073 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_hhf.ko 2023-10-06T02:46:06.798 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 65793 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_htb.ko 2023-10-06T02:46:06.798 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 16065 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_ingress.ko 2023-10-06T02:46:06.798 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 30273 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_mqprio.ko 2023-10-06T02:46:06.798 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10793 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_mqprio_lib.ko 2023-10-06T02:46:06.798 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 26065 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_multiq.ko 2023-10-06T02:46:06.798 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 35601 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_netem.ko 2023-10-06T02:46:06.798 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 27545 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_pie.ko 2023-10-06T02:46:06.799 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10265 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_plug.ko 2023-10-06T02:46:06.799 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 24729 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_prio.ko 2023-10-06T02:46:06.799 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 47849 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_qfq.ko 2023-10-06T02:46:06.799 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 32953 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_red.ko 2023-10-06T02:46:06.799 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 26881 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_sfb.ko 2023-10-06T02:46:06.799 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 31425 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_sfq.ko 2023-10-06T02:46:06.799 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 28897 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_tbf.ko 2023-10-06T02:46:06.799 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 27729 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_teql.ko 2023-10-06T02:46:06.799 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp/ 2023-10-06T02:46:06.799 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 930369 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp/sctp.ko 2023-10-06T02:46:06.799 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 19033 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp/sctp_diag.ko 2023-10-06T02:46:06.799 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/ 2023-10-06T02:46:06.800 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss/ 2023-10-06T02:46:06.800 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 335569 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-10-06T02:46:06.800 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 61833 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-10-06T02:46:06.800 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 1514673 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/sunrpc.ko 2023-10-06T02:46:06.800 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/xprtrdma/ 2023-10-06T02:46:06.800 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 707401 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-10-06T02:46:06.800 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc/ 2023-10-06T02:46:06.800 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10025 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc/diag.ko 2023-10-06T02:46:06.800 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 862385 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc/tipc.ko 2023-10-06T02:46:06.800 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/unix/ 2023-10-06T02:46:06.800 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15729 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/unix/unix_diag.ko 2023-10-06T02:46:06.800 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/ 2023-10-06T02:46:06.800 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 84841 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-10-06T02:46:06.801 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 68033 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-10-06T02:46:06.801 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 95985 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock.ko 2023-10-06T02:46:06.801 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 10705 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock_diag.ko 2023-10-06T02:46:06.801 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 17521 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock_loopback.ko 2023-10-06T02:46:06.801 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/x25/ 2023-10-06T02:46:06.801 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 125097 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/x25/x25.ko 2023-10-06T02:46:06.801 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/xfrm/ 2023-10-06T02:46:06.801 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 22657 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/xfrm/xfrm_algo.ko 2023-10-06T02:46:06.801 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 20705 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/xfrm/xfrm_ipcomp.ko 2023-10-06T02:46:06.801 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 102353 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/xfrm/xfrm_user.ko 2023-10-06T02:46:06.801 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt/ 2023-10-06T02:46:06.801 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt/lib/ 2023-10-06T02:46:06.801 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 15513 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt/lib/irqbypass.ko 2023-10-06T02:46:06.802 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 638591 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/modules.alias 2023-10-06T02:46:06.802 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 624324 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/modules.alias.bin 2023-10-06T02:46:06.802 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 7656 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin 2023-10-06T02:46:06.802 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 23361 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin.alias.bin 2023-10-06T02:46:06.802 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 9821 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin.bin 2023-10-06T02:46:06.802 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 69921 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin.modinfo 2023-10-06T02:46:06.802 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 146449 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/modules.dep 2023-10-06T02:46:06.802 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 232695 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/modules.dep.bin 2023-10-06T02:46:06.802 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 210 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/modules.devname 2023-10-06T02:46:06.802 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 72754 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/modules.order 2023-10-06T02:46:06.802 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 879 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/modules.softdep 2023-10-06T02:46:06.802 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 252880 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/modules.symbols 2023-10-06T02:46:06.803 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 307898 2023-09-11 02:20 ./lib/modules/6.5.0-rc7-gfef64f93da2b/modules.symbols.bin 2023-10-06T02:46:06.803 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./usr/ 2023-10-06T02:46:06.803 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./usr/share/ 2023-10-06T02:46:06.803 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./usr/share/doc/ 2023-10-06T02:46:06.803 INFO:teuthology.orchestra.run.smithi057.stdout:drwxr-xr-x root/root 0 2023-09-11 02:20 ./usr/share/doc/linux-image-6.5.0-rc7-gfef64f93da2b/ 2023-10-06T02:46:06.803 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 172 2023-09-11 02:20 ./usr/share/doc/linux-image-6.5.0-rc7-gfef64f93da2b/changelog.Debian.gz 2023-10-06T02:46:06.803 INFO:teuthology.orchestra.run.smithi057.stdout:-rw-r--r-- root/root 691 2023-09-11 02:20 ./usr/share/doc/linux-image-6.5.0-rc7-gfef64f93da2b/copyright 2023-10-06T02:46:06.804 DEBUG:teuthology.task.kernel:get_image_version: 6.5.0-rc7-gfef64f93da2b 2023-10-06T02:46:06.804 INFO:teuthology.task.kernel:searching for kernel 6.5.0-rc7-gfef64f93da2b 2023-10-06T02:46:06.804 DEBUG:teuthology.orchestra.run.smithi057:> egrep '(submenu|menuentry.*6.5.0-rc7-gfef64f93da2b).*{' /boot/grub/grub.cfg 2023-10-06T02:46:06.814 INFO:teuthology.orchestra.run.smithi057.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2023-10-06T02:46:06.814 INFO:teuthology.orchestra.run.smithi057.stdout: menuentry 'Ubuntu, with Linux 6.5.0-rc7-gfef64f93da2b' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.5.0-rc7-gfef64f93da2b-advanced-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2023-10-06T02:46:06.814 INFO:teuthology.orchestra.run.smithi057.stdout: menuentry 'Ubuntu, with Linux 6.5.0-rc7-gfef64f93da2b (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.5.0-rc7-gfef64f93da2b-recovery-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2023-10-06T02:46:06.815 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2023-10-06T02:46:06.815 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.5.0-rc7-gfef64f93da2b 2023-10-06T02:46:06.815 DEBUG:teuthology.orchestra.run.smithi057:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2023-10-06T02:46:06.857 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi057.front.sepia.ceph.com to complete... 2023-10-06T02:46:07.463 INFO:teuthology.orchestra.run.smithi057.stderr:Sourcing file `/etc/default/grub' 2023-10-06T02:46:07.471 INFO:teuthology.orchestra.run.smithi057.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-10-06T02:46:07.486 INFO:teuthology.orchestra.run.smithi057.stderr:Generating grub configuration file ... 2023-10-06T02:46:07.730 INFO:teuthology.orchestra.run.smithi057.stderr:Found linux image: /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b 2023-10-06T02:46:07.742 INFO:teuthology.orchestra.run.smithi057.stderr:Found initrd image: /boot/initrd.img-6.5.0-rc7-gfef64f93da2b 2023-10-06T02:46:08.086 INFO:teuthology.orchestra.run.smithi057.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-10-06T02:46:08.098 INFO:teuthology.orchestra.run.smithi057.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-10-06T02:46:09.075 INFO:teuthology.orchestra.run.smithi057.stderr:done 2023-10-06T02:46:35.522 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2023-10-06T02:46:35.523 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi105.front.sepia.ceph.com' 2023-10-06T02:46:35.523 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T02:46:40.188 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-10-06T02:46:40.188 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi057.front.sepia.ceph.com' 2023-10-06T02:46:40.188 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T02:47:10.210 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.105 2023-10-06T02:47:14.814 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.57 2023-10-06T02:47:19.214 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi105.front.sepia.ceph.com' 2023-10-06T02:47:19.215 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T02:47:23.818 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi057.front.sepia.ceph.com' 2023-10-06T02:47:23.819 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T02:47:37.594 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.105 2023-10-06T02:47:49.607 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi105.front.sepia.ceph.com' 2023-10-06T02:47:49.609 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T02:47:50.288 DEBUG:teuthology.orchestra.run.smithi105:> true 2023-10-06T02:47:51.062 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi105.front.sepia.ceph.com' 2023-10-06T02:47:51.062 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.5.0-rc7-gfef64f93da2b"... 2023-10-06T02:47:51.062 DEBUG:teuthology.orchestra.run.smithi105:> uname -r 2023-10-06T02:47:51.122 INFO:teuthology.orchestra.run.smithi105.stdout:6.5.0-rc7-gfef64f93da2b 2023-10-06T02:47:51.122 DEBUG:teuthology.task.kernel:current kernel version is 6.5.0-rc7-gfef64f93da2b vs 6.5.0-rc7-gfef64f93da2b 2023-10-06T02:47:51.122 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-06T02:47:51.122 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-10-06T02:47:52.124 DEBUG:teuthology.parallel:result is None 2023-10-06T02:48:23.821 DEBUG:teuthology.orchestra.remote:timed out 2023-10-06T02:48:35.822 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi057.front.sepia.ceph.com' 2023-10-06T02:48:35.823 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T02:48:36.068 DEBUG:teuthology.orchestra.run.smithi057:> true 2023-10-06T02:48:36.814 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi057.front.sepia.ceph.com' 2023-10-06T02:48:36.814 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.5.0-rc7-gfef64f93da2b"... 2023-10-06T02:48:36.815 DEBUG:teuthology.orchestra.run.smithi057:> uname -r 2023-10-06T02:48:36.875 INFO:teuthology.orchestra.run.smithi057.stdout:6.5.0-rc7-gfef64f93da2b 2023-10-06T02:48:36.875 DEBUG:teuthology.task.kernel:current kernel version is 6.5.0-rc7-gfef64f93da2b vs 6.5.0-rc7-gfef64f93da2b 2023-10-06T02:48:36.875 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-06T02:48:36.875 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-10-06T02:48:37.876 DEBUG:teuthology.parallel:result is None 2023-10-06T02:48:37.876 INFO:teuthology.run_tasks:Running task internal.base... 2023-10-06T02:48:37.885 INFO:teuthology.task.internal:Creating test directory... 2023-10-06T02:48:37.885 DEBUG:teuthology.orchestra.run.smithi057:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-06T02:48:37.892 DEBUG:teuthology.orchestra.run.smithi105:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-06T02:48:37.915 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-10-06T02:48:37.921 INFO:teuthology.run_tasks:Running task internal.archive... 2023-10-06T02:48:37.967 INFO:teuthology.task.internal:Creating archive directory... 2023-10-06T02:48:37.968 DEBUG:teuthology.orchestra.run.smithi057:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-06T02:48:37.975 DEBUG:teuthology.orchestra.run.smithi105:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-06T02:48:38.020 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-10-06T02:48:38.027 INFO:teuthology.task.internal:Enabling coredump saving... 2023-10-06T02:48:38.027 DEBUG:teuthology.orchestra.run.smithi057:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-06T02:48:38.047 DEBUG:teuthology.orchestra.run.smithi105:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-06T02:48:38.140 INFO:teuthology.orchestra.run.smithi057.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T02:48:38.180 INFO:teuthology.orchestra.run.smithi105.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T02:48:38.187 INFO:teuthology.orchestra.run.smithi057.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T02:48:38.209 INFO:teuthology.orchestra.run.smithi105.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T02:48:38.214 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-10-06T02:48:38.221 INFO:teuthology.task.internal:Configuring sudo... 2023-10-06T02:48:38.221 DEBUG:teuthology.orchestra.run.smithi057:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-06T02:48:38.228 DEBUG:teuthology.orchestra.run.smithi105:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-06T02:48:38.263 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-10-06T02:48:38.272 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-10-06T02:48:38.272 DEBUG:teuthology.orchestra.run.smithi057:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-06T02:48:38.307 DEBUG:teuthology.orchestra.run.smithi105:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-06T02:48:38.327 DEBUG:teuthology.orchestra.run.smithi057:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-06T02:48:38.384 DEBUG:teuthology.orchestra.run.smithi057:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-06T02:48:38.447 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-10-06T02:48:38.447 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-06T02:48:38.538 DEBUG:teuthology.orchestra.run.smithi105:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-06T02:48:38.558 DEBUG:teuthology.orchestra.run.smithi105:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-06T02:48:38.621 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2023-10-06T02:48:38.621 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-06T02:48:38.702 DEBUG:teuthology.orchestra.run.smithi057:> sudo service rsyslog restart 2023-10-06T02:48:38.709 DEBUG:teuthology.orchestra.run.smithi105:> sudo service rsyslog restart 2023-10-06T02:48:38.872 INFO:teuthology.run_tasks:Running task internal.timer... 2023-10-06T02:48:38.880 INFO:teuthology.task.internal:Starting timer... 2023-10-06T02:48:38.880 INFO:teuthology.run_tasks:Running task pcp... 2023-10-06T02:48:38.960 INFO:teuthology.run_tasks:Running task selinux... 2023-10-06T02:48:39.003 DEBUG:teuthology.task.selinux:Excluding smithi057: OS 'ubuntu' does not support SELinux 2023-10-06T02:48:39.003 DEBUG:teuthology.task.selinux:Excluding smithi105: OS 'ubuntu' does not support SELinux 2023-10-06T02:48:39.004 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-10-06T02:48:39.004 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2023-10-06T02:48:39.004 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-10-06T02:48:39.004 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-10-06T02:48:39.053 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-10-06T02:48:39.059 INFO:teuthology.repo_utils:Fetching main from origin 2023-10-06T02:48:39.164 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-10-06T02:48:39.181 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-10-06T02:48:39.182 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi057.front.sepia.ceph.com,smithi105.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-10-06T02:56:27.010 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi057.front.sepia.ceph.com'), Remote(name='ubuntu@smithi105.front.sepia.ceph.com')] 2023-10-06T02:56:27.011 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi057.front.sepia.ceph.com' 2023-10-06T02:56:27.012 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T02:56:27.115 DEBUG:teuthology.orchestra.run.smithi057:> true 2023-10-06T02:56:27.347 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi057.front.sepia.ceph.com' 2023-10-06T02:56:27.347 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi105.front.sepia.ceph.com' 2023-10-06T02:56:27.348 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T02:56:27.449 DEBUG:teuthology.orchestra.run.smithi105:> true 2023-10-06T02:56:27.682 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi105.front.sepia.ceph.com' 2023-10-06T02:56:27.682 INFO:teuthology.run_tasks:Running task clock... 2023-10-06T02:56:27.694 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-10-06T02:56:27.695 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-06T02:56:27.695 DEBUG:teuthology.orchestra.run.smithi057:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-06T02:56:27.702 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-06T02:56:27.702 DEBUG:teuthology.orchestra.run.smithi105:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-06T02:56:27.778 INFO:teuthology.orchestra.run.smithi057.stdout: 6 Oct 02:56:27 ntpd[22573]: ntpd 4.2.8p12@1.3728-o (1): Starting 2023-10-06T02:56:27.779 INFO:teuthology.orchestra.run.smithi057.stdout: 6 Oct 02:56:27 ntpd[22573]: Command line: ntpd -gq 2023-10-06T02:56:27.780 INFO:teuthology.orchestra.run.smithi057.stdout: 6 Oct 02:56:27 ntpd[22573]: proto: precision = 0.078 usec (-24) 2023-10-06T02:56:27.780 INFO:teuthology.orchestra.run.smithi057.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-10-06T02:56:27.781 INFO:teuthology.orchestra.run.smithi057.stdout: 6 Oct 02:56:27 ntpd[22573]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-10-06T02:56:27.781 INFO:teuthology.orchestra.run.smithi057.stderr:restrict ::: KOD does nothing without LIMITED. 2023-10-06T02:56:27.782 INFO:teuthology.orchestra.run.smithi057.stdout: 6 Oct 02:56:27 ntpd[22573]: restrict ::: KOD does nothing without LIMITED. 2023-10-06T02:56:27.782 INFO:teuthology.orchestra.run.smithi057.stdout: 6 Oct 02:56:27 ntpd[22573]: Listen and drop on 0 v6wildcard [::]:123 2023-10-06T02:56:27.782 INFO:teuthology.orchestra.run.smithi057.stdout: 6 Oct 02:56:27 ntpd[22573]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-10-06T02:56:27.782 INFO:teuthology.orchestra.run.smithi057.stdout: 6 Oct 02:56:27 ntpd[22573]: Listen normally on 2 lo 127.0.0.1:123 2023-10-06T02:56:27.782 INFO:teuthology.orchestra.run.smithi057.stdout: 6 Oct 02:56:27 ntpd[22573]: Listen normally on 3 ens1f0 172.21.15.57:123 2023-10-06T02:56:27.782 INFO:teuthology.orchestra.run.smithi057.stdout: 6 Oct 02:56:27 ntpd[22573]: Listen normally on 4 lo [::1]:123 2023-10-06T02:56:27.783 INFO:teuthology.orchestra.run.smithi057.stdout: 6 Oct 02:56:27 ntpd[22573]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:1562%4]:123 2023-10-06T02:56:27.783 INFO:teuthology.orchestra.run.smithi057.stdout: 6 Oct 02:56:27 ntpd[22573]: Listening on routing socket on fd #22 for interface updates 2023-10-06T02:56:27.804 INFO:teuthology.orchestra.run.smithi105.stdout: 6 Oct 02:56:27 ntpd[22677]: ntpd 4.2.8p12@1.3728-o (1): Starting 2023-10-06T02:56:27.804 INFO:teuthology.orchestra.run.smithi105.stdout: 6 Oct 02:56:27 ntpd[22677]: Command line: ntpd -gq 2023-10-06T02:56:27.805 INFO:teuthology.orchestra.run.smithi105.stdout: 6 Oct 02:56:27 ntpd[22677]: proto: precision = 0.041 usec (-24) 2023-10-06T02:56:27.806 INFO:teuthology.orchestra.run.smithi105.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-10-06T02:56:27.806 INFO:teuthology.orchestra.run.smithi105.stdout: 6 Oct 02:56:27 ntpd[22677]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-10-06T02:56:27.806 INFO:teuthology.orchestra.run.smithi105.stderr:restrict ::: KOD does nothing without LIMITED. 2023-10-06T02:56:27.807 INFO:teuthology.orchestra.run.smithi105.stdout: 6 Oct 02:56:27 ntpd[22677]: restrict ::: KOD does nothing without LIMITED. 2023-10-06T02:56:27.807 INFO:teuthology.orchestra.run.smithi105.stdout: 6 Oct 02:56:27 ntpd[22677]: Listen and drop on 0 v6wildcard [::]:123 2023-10-06T02:56:27.807 INFO:teuthology.orchestra.run.smithi105.stdout: 6 Oct 02:56:27 ntpd[22677]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-10-06T02:56:27.808 INFO:teuthology.orchestra.run.smithi105.stdout: 6 Oct 02:56:27 ntpd[22677]: Listen normally on 2 lo 127.0.0.1:123 2023-10-06T02:56:27.808 INFO:teuthology.orchestra.run.smithi105.stdout: 6 Oct 02:56:27 ntpd[22677]: Listen normally on 3 enp3s0f1 172.21.15.105:123 2023-10-06T02:56:27.808 INFO:teuthology.orchestra.run.smithi105.stdout: 6 Oct 02:56:27 ntpd[22677]: Listen normally on 4 lo [::1]:123 2023-10-06T02:56:27.808 INFO:teuthology.orchestra.run.smithi105.stdout: 6 Oct 02:56:27 ntpd[22677]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d429%5]:123 2023-10-06T02:56:27.808 INFO:teuthology.orchestra.run.smithi105.stdout: 6 Oct 02:56:27 ntpd[22677]: Listening on routing socket on fd #22 for interface updates 2023-10-06T02:56:28.779 INFO:teuthology.orchestra.run.smithi057.stderr: 6 Oct 02:56:28 ntpd[22573]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:56:28.779 INFO:teuthology.orchestra.run.smithi057.stderr: 6 Oct 02:56:28 ntpd[22573]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:56:28.780 INFO:teuthology.orchestra.run.smithi057.stderr: 6 Oct 02:56:28 ntpd[22573]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:56:28.780 INFO:teuthology.orchestra.run.smithi057.stderr: 6 Oct 02:56:28 ntpd[22573]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:56:28.780 INFO:teuthology.orchestra.run.smithi057.stderr: 6 Oct 02:56:28 ntpd[22573]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T02:56:28.780 INFO:teuthology.orchestra.run.smithi057.stderr: 6 Oct 02:56:28 ntpd[22573]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T02:56:29.807 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 02:56:29 ntpd[22677]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:56:29.807 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 02:56:29 ntpd[22677]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:56:29.807 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 02:56:29 ntpd[22677]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:56:29.807 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 02:56:29 ntpd[22677]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:56:29.807 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 02:56:29 ntpd[22677]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:56:29.807 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 02:56:29 ntpd[22677]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:56:29.807 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 02:56:29 ntpd[22677]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:56:29.808 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 02:56:29 ntpd[22677]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:56:29.808 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 02:56:29 ntpd[22677]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T02:56:29.808 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 02:56:29 ntpd[22677]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T02:56:29.808 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 02:56:29 ntpd[22677]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:56:29.808 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 02:56:29 ntpd[22677]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:56:29.808 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 02:56:29 ntpd[22677]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T02:56:29.808 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 02:56:29 ntpd[22677]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T02:56:29.808 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 02:56:29 ntpd[22677]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:56:29.808 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 02:56:29 ntpd[22677]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:56:29.809 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 02:56:29 ntpd[22677]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T02:56:29.809 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 02:56:29 ntpd[22677]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T02:56:30.780 INFO:teuthology.orchestra.run.smithi057.stderr: 6 Oct 02:56:30 ntpd[22573]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:56:30.780 INFO:teuthology.orchestra.run.smithi057.stderr: 6 Oct 02:56:30 ntpd[22573]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:56:30.780 INFO:teuthology.orchestra.run.smithi057.stderr: 6 Oct 02:56:30 ntpd[22573]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:56:30.780 INFO:teuthology.orchestra.run.smithi057.stderr: 6 Oct 02:56:30 ntpd[22573]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:56:30.780 INFO:teuthology.orchestra.run.smithi057.stderr: 6 Oct 02:56:30 ntpd[22573]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:56:30.780 INFO:teuthology.orchestra.run.smithi057.stderr: 6 Oct 02:56:30 ntpd[22573]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:56:30.780 INFO:teuthology.orchestra.run.smithi057.stderr: 6 Oct 02:56:30 ntpd[22573]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T02:56:30.780 INFO:teuthology.orchestra.run.smithi057.stderr: 6 Oct 02:56:30 ntpd[22573]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T02:56:30.804 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 02:56:30 ntpd[22677]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:56:30.805 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 02:56:30 ntpd[22677]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:56:31.779 INFO:teuthology.orchestra.run.smithi057.stderr: 6 Oct 02:56:31 ntpd[22573]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:56:31.780 INFO:teuthology.orchestra.run.smithi057.stderr: 6 Oct 02:56:31 ntpd[22573]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:56:31.780 INFO:teuthology.orchestra.run.smithi057.stderr: 6 Oct 02:56:31 ntpd[22573]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:56:31.780 INFO:teuthology.orchestra.run.smithi057.stderr: 6 Oct 02:56:31 ntpd[22573]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:56:31.780 INFO:teuthology.orchestra.run.smithi057.stderr: 6 Oct 02:56:31 ntpd[22573]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T02:56:31.780 INFO:teuthology.orchestra.run.smithi057.stderr: 6 Oct 02:56:31 ntpd[22573]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T02:56:31.807 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 02:56:31 ntpd[22677]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:56:31.807 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 02:56:31 ntpd[22677]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:56:31.807 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 02:56:31 ntpd[22677]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:56:31.807 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 02:56:31 ntpd[22677]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:56:31.808 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 02:56:31 ntpd[22677]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:56:31.808 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 02:56:31 ntpd[22677]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:56:31.808 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 02:56:31 ntpd[22677]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:56:31.808 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 02:56:31 ntpd[22677]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:56:31.808 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 02:56:31 ntpd[22677]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T02:56:31.808 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 02:56:31 ntpd[22677]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T02:56:31.808 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 02:56:31 ntpd[22677]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:56:31.808 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 02:56:31 ntpd[22677]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:56:31.808 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 02:56:31 ntpd[22677]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T02:56:31.808 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 02:56:31 ntpd[22677]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T02:56:31.809 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 02:56:31 ntpd[22677]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:56:31.809 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 02:56:31 ntpd[22677]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:56:31.809 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 02:56:31 ntpd[22677]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T02:56:31.809 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 02:56:31 ntpd[22677]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T02:56:32.781 INFO:teuthology.orchestra.run.smithi057.stderr: 6 Oct 02:56:32 ntpd[22573]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:56:32.781 INFO:teuthology.orchestra.run.smithi057.stderr: 6 Oct 02:56:32 ntpd[22573]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:56:32.781 INFO:teuthology.orchestra.run.smithi057.stderr: 6 Oct 02:56:32 ntpd[22573]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:56:32.781 INFO:teuthology.orchestra.run.smithi057.stderr: 6 Oct 02:56:32 ntpd[22573]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:56:32.782 INFO:teuthology.orchestra.run.smithi057.stderr: 6 Oct 02:56:32 ntpd[22573]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:56:32.782 INFO:teuthology.orchestra.run.smithi057.stderr: 6 Oct 02:56:32 ntpd[22573]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:56:32.782 INFO:teuthology.orchestra.run.smithi057.stderr: 6 Oct 02:56:32 ntpd[22573]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T02:56:32.782 INFO:teuthology.orchestra.run.smithi057.stderr: 6 Oct 02:56:32 ntpd[22573]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T02:56:32.782 INFO:teuthology.orchestra.run.smithi057.stderr: 6 Oct 02:56:32 ntpd[22573]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:56:32.782 INFO:teuthology.orchestra.run.smithi057.stderr: 6 Oct 02:56:32 ntpd[22573]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:56:32.783 INFO:teuthology.orchestra.run.smithi057.stderr: 6 Oct 02:56:32 ntpd[22573]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T02:56:32.783 INFO:teuthology.orchestra.run.smithi057.stderr: 6 Oct 02:56:32 ntpd[22573]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T02:56:33.780 INFO:teuthology.orchestra.run.smithi057.stderr: 6 Oct 02:56:33 ntpd[22573]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:56:33.781 INFO:teuthology.orchestra.run.smithi057.stderr: 6 Oct 02:56:33 ntpd[22573]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:56:33.781 INFO:teuthology.orchestra.run.smithi057.stderr: 6 Oct 02:56:33 ntpd[22573]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:56:33.781 INFO:teuthology.orchestra.run.smithi057.stderr: 6 Oct 02:56:33 ntpd[22573]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:56:33.781 INFO:teuthology.orchestra.run.smithi057.stderr: 6 Oct 02:56:33 ntpd[22573]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T02:56:33.781 INFO:teuthology.orchestra.run.smithi057.stderr: 6 Oct 02:56:33 ntpd[22573]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T02:56:33.806 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 02:56:33 ntpd[22677]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:56:33.806 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 02:56:33 ntpd[22677]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:56:33.806 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 02:56:33 ntpd[22677]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:56:33.806 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 02:56:33 ntpd[22677]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:56:33.806 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 02:56:33 ntpd[22677]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:56:33.807 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 02:56:33 ntpd[22677]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:56:33.807 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 02:56:33 ntpd[22677]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:56:33.807 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 02:56:33 ntpd[22677]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:56:33.807 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 02:56:33 ntpd[22677]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T02:56:33.807 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 02:56:33 ntpd[22677]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T02:56:33.807 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 02:56:33 ntpd[22677]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:56:33.807 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 02:56:33 ntpd[22677]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:56:33.807 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 02:56:33 ntpd[22677]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T02:56:33.807 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 02:56:33 ntpd[22677]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T02:56:33.807 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 02:56:33 ntpd[22677]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:56:33.807 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 02:56:33 ntpd[22677]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:56:33.807 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 02:56:33 ntpd[22677]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T02:56:33.808 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 02:56:33 ntpd[22677]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T02:56:34.779 INFO:teuthology.orchestra.run.smithi057.stderr: 6 Oct 02:56:34 ntpd[22573]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:56:34.780 INFO:teuthology.orchestra.run.smithi057.stderr: 6 Oct 02:56:34 ntpd[22573]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:56:34.780 INFO:teuthology.orchestra.run.smithi057.stderr: 6 Oct 02:56:34 ntpd[22573]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:56:34.780 INFO:teuthology.orchestra.run.smithi057.stderr: 6 Oct 02:56:34 ntpd[22573]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:56:34.780 INFO:teuthology.orchestra.run.smithi057.stderr: 6 Oct 02:56:34 ntpd[22573]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:56:34.780 INFO:teuthology.orchestra.run.smithi057.stderr: 6 Oct 02:56:34 ntpd[22573]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:56:34.780 INFO:teuthology.orchestra.run.smithi057.stderr: 6 Oct 02:56:34 ntpd[22573]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T02:56:34.780 INFO:teuthology.orchestra.run.smithi057.stderr: 6 Oct 02:56:34 ntpd[22573]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T02:56:34.780 INFO:teuthology.orchestra.run.smithi057.stdout: 6 Oct 02:56:34 ntpd[22573]: ntpd: time slew +0.000278 s 2023-10-06T02:56:34.780 INFO:teuthology.orchestra.run.smithi057.stdout:ntpd: time slew +0.000278s 2023-10-06T02:56:34.781 INFO:teuthology.orchestra.run.smithi057.stderr: 6 Oct 02:56:34 ntpd[22573]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-10-06T02:56:34.781 INFO:teuthology.orchestra.run.smithi057.stderr: 6 Oct 02:56:34 ntpd[22573]: can't open /var/log/ntpstats/loopstats.20231006: Permission denied 2023-10-06T02:56:34.935 INFO:teuthology.orchestra.run.smithi057.stdout: remote refid st t when poll reach delay offset jitter 2023-10-06T02:56:34.936 INFO:teuthology.orchestra.run.smithi057.stdout:============================================================================== 2023-10-06T02:56:34.936 INFO:teuthology.orchestra.run.smithi057.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-06T02:56:34.936 INFO:teuthology.orchestra.run.smithi057.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-06T02:56:34.936 INFO:teuthology.orchestra.run.smithi057.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-06T02:56:34.936 INFO:teuthology.orchestra.run.smithi057.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-06T02:56:35.805 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 02:56:35 ntpd[22677]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:56:35.806 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 02:56:35 ntpd[22677]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:56:35.806 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 02:56:35 ntpd[22677]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:56:35.806 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 02:56:35 ntpd[22677]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:56:35.806 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 02:56:35 ntpd[22677]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:56:35.806 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 02:56:35 ntpd[22677]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:56:35.806 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 02:56:35 ntpd[22677]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T02:56:35.806 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 02:56:35 ntpd[22677]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T02:56:35.806 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 02:56:35 ntpd[22677]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T02:56:35.806 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 02:56:35 ntpd[22677]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T02:56:35.807 INFO:teuthology.orchestra.run.smithi105.stdout: 6 Oct 02:56:35 ntpd[22677]: ntpd: time slew -0.000785 s 2023-10-06T02:56:35.807 INFO:teuthology.orchestra.run.smithi105.stdout:ntpd: time slew -0.000785s 2023-10-06T02:56:35.808 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 02:56:35 ntpd[22677]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-10-06T02:56:35.808 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 02:56:35 ntpd[22677]: can't open /var/log/ntpstats/loopstats.20231006: Permission denied 2023-10-06T02:56:35.946 INFO:teuthology.orchestra.run.smithi105.stdout: remote refid st t when poll reach delay offset jitter 2023-10-06T02:56:35.946 INFO:teuthology.orchestra.run.smithi105.stdout:============================================================================== 2023-10-06T02:56:35.946 INFO:teuthology.orchestra.run.smithi105.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-06T02:56:35.946 INFO:teuthology.orchestra.run.smithi105.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-06T02:56:35.946 INFO:teuthology.orchestra.run.smithi105.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-06T02:56:35.946 INFO:teuthology.orchestra.run.smithi105.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-06T02:56:35.948 INFO:teuthology.run_tasks:Running task install... 2023-10-06T02:56:35.958 DEBUG:teuthology.task.install:project ceph 2023-10-06T02:56:35.958 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2'}} 2023-10-06T02:56:35.958 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2'} 2023-10-06T02:56:35.958 INFO:teuthology.task.install:Using flavor: default 2023-10-06T02:56:35.964 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-10-06T02:56:35.964 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-10-06T02:56:35.965 DEBUG:teuthology.orchestra.run.smithi057:> sudo apt-key list | grep Ceph 2023-10-06T02:56:35.965 DEBUG:teuthology.orchestra.run.smithi105:> sudo apt-key list | grep Ceph 2023-10-06T02:56:36.207 INFO:teuthology.orchestra.run.smithi105.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2023-10-06T02:56:36.212 INFO:teuthology.orchestra.run.smithi057.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2023-10-06T02:56:36.355 INFO:teuthology.orchestra.run.smithi105.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-10-06T02:56:36.355 INFO:teuthology.orchestra.run.smithi105.stdout:uid [ unknown] Ceph.com (release key) 2023-10-06T02:56:36.356 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-10-06T02:56:36.356 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2023-10-06T02:56:36.357 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 2023-10-06T02:56:36.361 INFO:teuthology.orchestra.run.smithi057.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-10-06T02:56:36.361 INFO:teuthology.orchestra.run.smithi057.stdout:uid [ unknown] Ceph.com (release key) 2023-10-06T02:56:36.361 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-10-06T02:56:36.361 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2023-10-06T02:56:36.361 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 2023-10-06T02:56:36.509 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default/ 2023-10-06T02:56:36.509 INFO:teuthology.task.install.deb:Package version is 17.2.6-1296-g736ac5ba-1focal 2023-10-06T02:56:36.590 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default/ 2023-10-06T02:56:36.590 INFO:teuthology.task.install.deb:Package version is 17.2.6-1296-g736ac5ba-1focal 2023-10-06T02:56:36.698 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2023-10-06T02:56:36.699 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-10-06T02:56:36.714 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-10-06T02:56:36.714 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-10-06T02:56:36.733 DEBUG:teuthology.orchestra.run.smithi105:> sudo apt-get update 2023-10-06T02:56:36.748 DEBUG:teuthology.orchestra.run.smithi057:> sudo apt-get update 2023-10-06T02:56:37.017 INFO:teuthology.orchestra.run.smithi105.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-10-06T02:56:37.026 INFO:teuthology.orchestra.run.smithi105.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2023-10-06T02:56:37.063 INFO:teuthology.orchestra.run.smithi105.stdout:Ign:3 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal InRelease 2023-10-06T02:56:37.064 INFO:teuthology.orchestra.run.smithi105.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-10-06T02:56:37.071 INFO:teuthology.orchestra.run.smithi057.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-10-06T02:56:37.075 INFO:teuthology.orchestra.run.smithi057.stdout:Ign:2 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal InRelease 2023-10-06T02:56:37.077 INFO:teuthology.orchestra.run.smithi057.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-10-06T02:56:37.085 INFO:teuthology.orchestra.run.smithi105.stdout:Get:5 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal Release [7,662 B] 2023-10-06T02:56:37.097 INFO:teuthology.orchestra.run.smithi057.stdout:Get:4 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal Release [7,662 B] 2023-10-06T02:56:37.100 INFO:teuthology.orchestra.run.smithi105.stdout:Hit:6 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-10-06T02:56:37.109 INFO:teuthology.orchestra.run.smithi105.stdout:Ign:7 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal Release.gpg 2023-10-06T02:56:37.114 INFO:teuthology.orchestra.run.smithi057.stdout:Hit:5 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-10-06T02:56:37.122 INFO:teuthology.orchestra.run.smithi057.stdout:Ign:6 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal Release.gpg 2023-10-06T02:56:37.131 INFO:teuthology.orchestra.run.smithi105.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 Packages [17.4 kB] 2023-10-06T02:56:37.136 INFO:teuthology.orchestra.run.smithi057.stdout:Hit:7 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-10-06T02:56:37.143 INFO:teuthology.orchestra.run.smithi057.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 Packages [17.4 kB] 2023-10-06T02:56:37.175 INFO:teuthology.orchestra.run.smithi105.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main i386 Packages [3,380 B] 2023-10-06T02:56:37.193 INFO:teuthology.orchestra.run.smithi057.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main i386 Packages [3,380 B] 2023-10-06T02:56:38.426 INFO:teuthology.orchestra.run.smithi105.stdout:Fetched 28.4 kB in 1s (20.9 kB/s) 2023-10-06T02:56:38.540 INFO:teuthology.orchestra.run.smithi057.stdout:Fetched 28.4 kB in 1s (19.6 kB/s) 2023-10-06T02:56:39.646 INFO:teuthology.orchestra.run.smithi105.stdout:Reading package lists... 2023-10-06T02:56:39.686 DEBUG:teuthology.orchestra.run.smithi105:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=17.2.6-1296-g736ac5ba-1focal cephadm=17.2.6-1296-g736ac5ba-1focal ceph-mds=17.2.6-1296-g736ac5ba-1focal ceph-mgr=17.2.6-1296-g736ac5ba-1focal ceph-common=17.2.6-1296-g736ac5ba-1focal ceph-fuse=17.2.6-1296-g736ac5ba-1focal ceph-test=17.2.6-1296-g736ac5ba-1focal ceph-volume=17.2.6-1296-g736ac5ba-1focal radosgw=17.2.6-1296-g736ac5ba-1focal python3-rados=17.2.6-1296-g736ac5ba-1focal python3-rgw=17.2.6-1296-g736ac5ba-1focal python3-cephfs=17.2.6-1296-g736ac5ba-1focal python3-rbd=17.2.6-1296-g736ac5ba-1focal libcephfs2=17.2.6-1296-g736ac5ba-1focal libcephfs-dev=17.2.6-1296-g736ac5ba-1focal librados2=17.2.6-1296-g736ac5ba-1focal librbd1=17.2.6-1296-g736ac5ba-1focal rbd-fuse=17.2.6-1296-g736ac5ba-1focal python3-cephfs=17.2.6-1296-g736ac5ba-1focal cephfs-shell=17.2.6-1296-g736ac5ba-1focal cephfs-top=17.2.6-1296-g736ac5ba-1focal cephfs-mirror=17.2.6-1296-g736ac5ba-1focal 2023-10-06T02:56:39.810 INFO:teuthology.orchestra.run.smithi105.stdout:Reading package lists... 2023-10-06T02:56:39.829 INFO:teuthology.orchestra.run.smithi057.stdout:Reading package lists... 2023-10-06T02:56:39.873 DEBUG:teuthology.orchestra.run.smithi057:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=17.2.6-1296-g736ac5ba-1focal cephadm=17.2.6-1296-g736ac5ba-1focal ceph-mds=17.2.6-1296-g736ac5ba-1focal ceph-mgr=17.2.6-1296-g736ac5ba-1focal ceph-common=17.2.6-1296-g736ac5ba-1focal ceph-fuse=17.2.6-1296-g736ac5ba-1focal ceph-test=17.2.6-1296-g736ac5ba-1focal ceph-volume=17.2.6-1296-g736ac5ba-1focal radosgw=17.2.6-1296-g736ac5ba-1focal python3-rados=17.2.6-1296-g736ac5ba-1focal python3-rgw=17.2.6-1296-g736ac5ba-1focal python3-cephfs=17.2.6-1296-g736ac5ba-1focal python3-rbd=17.2.6-1296-g736ac5ba-1focal libcephfs2=17.2.6-1296-g736ac5ba-1focal libcephfs-dev=17.2.6-1296-g736ac5ba-1focal librados2=17.2.6-1296-g736ac5ba-1focal librbd1=17.2.6-1296-g736ac5ba-1focal rbd-fuse=17.2.6-1296-g736ac5ba-1focal python3-cephfs=17.2.6-1296-g736ac5ba-1focal cephfs-shell=17.2.6-1296-g736ac5ba-1focal cephfs-top=17.2.6-1296-g736ac5ba-1focal cephfs-mirror=17.2.6-1296-g736ac5ba-1focal 2023-10-06T02:56:39.996 INFO:teuthology.orchestra.run.smithi057.stdout:Reading package lists... 2023-10-06T02:56:40.009 INFO:teuthology.orchestra.run.smithi105.stdout:Building dependency tree... 2023-10-06T02:56:40.010 INFO:teuthology.orchestra.run.smithi105.stdout:Reading state information... 2023-10-06T02:56:40.196 INFO:teuthology.orchestra.run.smithi105.stdout:The following packages were automatically installed and are no longer required: 2023-10-06T02:56:40.197 INFO:teuthology.orchestra.run.smithi105.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-10-06T02:56:40.197 INFO:teuthology.orchestra.run.smithi105.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-06T02:56:40.197 INFO:teuthology.orchestra.run.smithi105.stdout:The following additional packages will be installed: 2023-10-06T02:56:40.198 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-10-06T02:56:40.198 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2023-10-06T02:56:40.199 INFO:teuthology.orchestra.run.smithi105.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-10-06T02:56:40.199 INFO:teuthology.orchestra.run.smithi105.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2023-10-06T02:56:40.199 INFO:teuthology.orchestra.run.smithi105.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2023-10-06T02:56:40.199 INFO:teuthology.orchestra.run.smithi105.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2023-10-06T02:56:40.199 INFO:teuthology.orchestra.run.smithi105.stdout: python-natsort-doc python-pastedeploy-tpl python3-atomicwrites python3-attr 2023-10-06T02:56:40.199 INFO:teuthology.orchestra.run.smithi105.stdout: python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2023-10-06T02:56:40.199 INFO:teuthology.orchestra.run.smithi105.stdout: python3-ceph-argparse python3-ceph-common python3-cherrypy3 python3-cmd2 2023-10-06T02:56:40.199 INFO:teuthology.orchestra.run.smithi105.stdout: python3-colorama python3-cryptography python3-decorator python3-google-auth 2023-10-06T02:56:40.199 INFO:teuthology.orchestra.run.smithi105.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2023-10-06T02:56:40.199 INFO:teuthology.orchestra.run.smithi105.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2023-10-06T02:56:40.199 INFO:teuthology.orchestra.run.smithi105.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-10-06T02:56:40.199 INFO:teuthology.orchestra.run.smithi105.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-10-06T02:56:40.199 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-10-06T02:56:40.200 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2023-10-06T02:56:40.200 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pytest python3-repoze.lru python3-requests-oauthlib python3-routes 2023-10-06T02:56:40.200 INFO:teuthology.orchestra.run.smithi105.stdout: python3-rsa python3-scipy python3-simplegeneric python3-simplejson 2023-10-06T02:56:40.200 INFO:teuthology.orchestra.run.smithi105.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-10-06T02:56:40.200 INFO:teuthology.orchestra.run.smithi105.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-10-06T02:56:40.200 INFO:teuthology.orchestra.run.smithi105.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-10-06T02:56:40.200 INFO:teuthology.orchestra.run.smithi105.stdout: qttranslations5-l10n socat xmlstarlet 2023-10-06T02:56:40.200 INFO:teuthology.orchestra.run.smithi105.stdout:Suggested packages: 2023-10-06T02:56:40.200 INFO:teuthology.orchestra.run.smithi105.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2023-10-06T02:56:40.201 INFO:teuthology.orchestra.run.smithi105.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2023-10-06T02:56:40.201 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2023-10-06T02:56:40.201 INFO:teuthology.orchestra.run.smithi105.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2023-10-06T02:56:40.201 INFO:teuthology.orchestra.run.smithi105.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2023-10-06T02:56:40.201 INFO:teuthology.orchestra.run.smithi105.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2023-10-06T02:56:40.201 INFO:teuthology.orchestra.run.smithi105.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2023-10-06T02:56:40.201 INFO:teuthology.orchestra.run.smithi105.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-10-06T02:56:40.201 INFO:teuthology.orchestra.run.smithi105.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2023-10-06T02:56:40.201 INFO:teuthology.orchestra.run.smithi105.stdout:Recommended packages: 2023-10-06T02:56:40.201 INFO:teuthology.orchestra.run.smithi105.stdout: btrfs-tools 2023-10-06T02:56:40.202 INFO:teuthology.orchestra.run.smithi057.stdout:Building dependency tree... 2023-10-06T02:56:40.202 INFO:teuthology.orchestra.run.smithi057.stdout:Reading state information... 2023-10-06T02:56:40.401 INFO:teuthology.orchestra.run.smithi105.stdout:The following NEW packages will be installed: 2023-10-06T02:56:40.445 INFO:teuthology.orchestra.run.smithi105.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-10-06T02:56:40.446 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-10-06T02:56:40.446 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-10-06T02:56:40.446 INFO:teuthology.orchestra.run.smithi105.stdout: cephfs-mirror cephfs-shell cephfs-top fonts-mathjax jq libcephfs-dev 2023-10-06T02:56:40.446 INFO:teuthology.orchestra.run.smithi105.stdout: libcephfs2 libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc 2023-10-06T02:56:40.446 INFO:teuthology.orchestra.run.smithi105.stdout: libjs-underscore liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 2023-10-06T02:56:40.446 INFO:teuthology.orchestra.run.smithi105.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 2023-10-06T02:56:40.448 INFO:teuthology.orchestra.run.smithi105.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 2023-10-06T02:56:40.448 INFO:teuthology.orchestra.run.smithi105.stdout: nvme-cli python-natsort-doc python-pastedeploy-tpl python3-atomicwrites 2023-10-06T02:56:40.448 INFO:teuthology.orchestra.run.smithi105.stdout: python3-attr python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2023-10-06T02:56:40.448 INFO:teuthology.orchestra.run.smithi105.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs python3-cherrypy3 2023-10-06T02:56:40.448 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cmd2 python3-colorama python3-cryptography python3-decorator 2023-10-06T02:56:40.448 INFO:teuthology.orchestra.run.smithi105.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2023-10-06T02:56:40.448 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2023-10-06T02:56:40.448 INFO:teuthology.orchestra.run.smithi105.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-10-06T02:56:40.449 INFO:teuthology.orchestra.run.smithi105.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-10-06T02:56:40.449 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-10-06T02:56:40.449 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2023-10-06T02:56:40.449 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru 2023-10-06T02:56:40.449 INFO:teuthology.orchestra.run.smithi105.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-10-06T02:56:40.449 INFO:teuthology.orchestra.run.smithi105.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-10-06T02:56:40.449 INFO:teuthology.orchestra.run.smithi105.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-10-06T02:56:40.449 INFO:teuthology.orchestra.run.smithi105.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-10-06T02:56:40.449 INFO:teuthology.orchestra.run.smithi105.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-10-06T02:56:40.449 INFO:teuthology.orchestra.run.smithi105.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2023-10-06T02:56:40.449 INFO:teuthology.orchestra.run.smithi105.stdout:The following packages will be upgraded: 2023-10-06T02:56:40.449 INFO:teuthology.orchestra.run.smithi105.stdout: librados2 librbd1 2023-10-06T02:56:40.450 INFO:teuthology.orchestra.run.smithi057.stdout:The following packages were automatically installed and are no longer required: 2023-10-06T02:56:40.450 INFO:teuthology.orchestra.run.smithi057.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-10-06T02:56:40.450 INFO:teuthology.orchestra.run.smithi057.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-06T02:56:40.450 INFO:teuthology.orchestra.run.smithi057.stdout:The following additional packages will be installed: 2023-10-06T02:56:40.450 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-10-06T02:56:40.450 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2023-10-06T02:56:40.450 INFO:teuthology.orchestra.run.smithi057.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-10-06T02:56:40.450 INFO:teuthology.orchestra.run.smithi057.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2023-10-06T02:56:40.450 INFO:teuthology.orchestra.run.smithi057.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2023-10-06T02:56:40.451 INFO:teuthology.orchestra.run.smithi057.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2023-10-06T02:56:40.451 INFO:teuthology.orchestra.run.smithi057.stdout: python-natsort-doc python-pastedeploy-tpl python3-atomicwrites python3-attr 2023-10-06T02:56:40.451 INFO:teuthology.orchestra.run.smithi057.stdout: python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2023-10-06T02:56:40.451 INFO:teuthology.orchestra.run.smithi057.stdout: python3-ceph-argparse python3-ceph-common python3-cherrypy3 python3-cmd2 2023-10-06T02:56:40.451 INFO:teuthology.orchestra.run.smithi057.stdout: python3-colorama python3-cryptography python3-decorator python3-google-auth 2023-10-06T02:56:40.451 INFO:teuthology.orchestra.run.smithi057.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2023-10-06T02:56:40.451 INFO:teuthology.orchestra.run.smithi057.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2023-10-06T02:56:40.451 INFO:teuthology.orchestra.run.smithi057.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-10-06T02:56:40.451 INFO:teuthology.orchestra.run.smithi057.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-10-06T02:56:40.451 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-10-06T02:56:40.451 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2023-10-06T02:56:40.451 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pytest python3-repoze.lru python3-requests-oauthlib python3-routes 2023-10-06T02:56:40.452 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rsa python3-scipy python3-simplegeneric python3-simplejson 2023-10-06T02:56:40.452 INFO:teuthology.orchestra.run.smithi057.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-10-06T02:56:40.452 INFO:teuthology.orchestra.run.smithi057.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-10-06T02:56:40.452 INFO:teuthology.orchestra.run.smithi057.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-10-06T02:56:40.452 INFO:teuthology.orchestra.run.smithi057.stdout: qttranslations5-l10n socat xmlstarlet 2023-10-06T02:56:40.452 INFO:teuthology.orchestra.run.smithi057.stdout:Suggested packages: 2023-10-06T02:56:40.452 INFO:teuthology.orchestra.run.smithi057.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2023-10-06T02:56:40.452 INFO:teuthology.orchestra.run.smithi057.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2023-10-06T02:56:40.452 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2023-10-06T02:56:40.452 INFO:teuthology.orchestra.run.smithi057.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2023-10-06T02:56:40.452 INFO:teuthology.orchestra.run.smithi057.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2023-10-06T02:56:40.452 INFO:teuthology.orchestra.run.smithi057.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2023-10-06T02:56:40.453 INFO:teuthology.orchestra.run.smithi057.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2023-10-06T02:56:40.453 INFO:teuthology.orchestra.run.smithi057.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-10-06T02:56:40.453 INFO:teuthology.orchestra.run.smithi057.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2023-10-06T02:56:40.453 INFO:teuthology.orchestra.run.smithi057.stdout:Recommended packages: 2023-10-06T02:56:40.453 INFO:teuthology.orchestra.run.smithi057.stdout: btrfs-tools 2023-10-06T02:56:40.491 INFO:teuthology.orchestra.run.smithi105.stdout:2 upgraded, 114 newly installed, 0 to remove and 256 not upgraded. 2023-10-06T02:56:40.492 INFO:teuthology.orchestra.run.smithi105.stdout:Need to get 210 MB of archives. 2023-10-06T02:56:40.492 INFO:teuthology.orchestra.run.smithi105.stdout:After this operation, 981 MB of additional disk space will be used. 2023-10-06T02:56:40.492 INFO:teuthology.orchestra.run.smithi105.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2023-10-06T02:56:40.511 INFO:teuthology.orchestra.run.smithi105.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2023-10-06T02:56:40.519 INFO:teuthology.orchestra.run.smithi105.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2023-10-06T02:56:40.544 INFO:teuthology.orchestra.run.smithi105.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2023-10-06T02:56:40.572 INFO:teuthology.orchestra.run.smithi105.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2023-10-06T02:56:40.601 INFO:teuthology.orchestra.run.smithi105.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2023-10-06T02:56:40.601 INFO:teuthology.orchestra.run.smithi105.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2023-10-06T02:56:40.601 INFO:teuthology.orchestra.run.smithi105.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2023-10-06T02:56:40.604 INFO:teuthology.orchestra.run.smithi105.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2023-10-06T02:56:40.605 INFO:teuthology.orchestra.run.smithi105.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2023-10-06T02:56:40.610 INFO:teuthology.orchestra.run.smithi105.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2023-10-06T02:56:40.614 INFO:teuthology.orchestra.run.smithi057.stdout:The following NEW packages will be installed: 2023-10-06T02:56:40.614 INFO:teuthology.orchestra.run.smithi057.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-10-06T02:56:40.614 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-10-06T02:56:40.614 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-10-06T02:56:40.615 INFO:teuthology.orchestra.run.smithi057.stdout: cephfs-mirror cephfs-shell cephfs-top fonts-mathjax jq libcephfs-dev 2023-10-06T02:56:40.615 INFO:teuthology.orchestra.run.smithi057.stdout: libcephfs2 libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc 2023-10-06T02:56:40.615 INFO:teuthology.orchestra.run.smithi057.stdout: libjs-underscore liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 2023-10-06T02:56:40.615 INFO:teuthology.orchestra.run.smithi057.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 2023-10-06T02:56:40.615 INFO:teuthology.orchestra.run.smithi057.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 2023-10-06T02:56:40.616 INFO:teuthology.orchestra.run.smithi057.stdout: nvme-cli python-natsort-doc python-pastedeploy-tpl python3-atomicwrites 2023-10-06T02:56:40.616 INFO:teuthology.orchestra.run.smithi057.stdout: python3-attr python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2023-10-06T02:56:40.616 INFO:teuthology.orchestra.run.smithi057.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs python3-cherrypy3 2023-10-06T02:56:40.616 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cmd2 python3-colorama python3-cryptography python3-decorator 2023-10-06T02:56:40.616 INFO:teuthology.orchestra.run.smithi057.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2023-10-06T02:56:40.616 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2023-10-06T02:56:40.616 INFO:teuthology.orchestra.run.smithi057.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-10-06T02:56:40.616 INFO:teuthology.orchestra.run.smithi057.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-10-06T02:56:40.616 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-10-06T02:56:40.616 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2023-10-06T02:56:40.616 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru 2023-10-06T02:56:40.617 INFO:teuthology.orchestra.run.smithi057.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-10-06T02:56:40.617 INFO:teuthology.orchestra.run.smithi057.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-10-06T02:56:40.617 INFO:teuthology.orchestra.run.smithi057.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-10-06T02:56:40.617 INFO:teuthology.orchestra.run.smithi057.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-10-06T02:56:40.617 INFO:teuthology.orchestra.run.smithi057.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-10-06T02:56:40.617 INFO:teuthology.orchestra.run.smithi057.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2023-10-06T02:56:40.618 INFO:teuthology.orchestra.run.smithi057.stdout:The following packages will be upgraded: 2023-10-06T02:56:40.618 INFO:teuthology.orchestra.run.smithi057.stdout: librados2 librbd1 2023-10-06T02:56:40.638 INFO:teuthology.orchestra.run.smithi105.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2023-10-06T02:56:40.640 INFO:teuthology.orchestra.run.smithi105.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2023-10-06T02:56:40.651 INFO:teuthology.orchestra.run.smithi105.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2023-10-06T02:56:40.653 INFO:teuthology.orchestra.run.smithi105.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2023-10-06T02:56:40.654 INFO:teuthology.orchestra.run.smithi105.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2023-10-06T02:56:40.656 INFO:teuthology.orchestra.run.smithi105.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2023-10-06T02:56:40.657 INFO:teuthology.orchestra.run.smithi105.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2023-10-06T02:56:40.657 INFO:teuthology.orchestra.run.smithi105.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2023-10-06T02:56:40.659 INFO:teuthology.orchestra.run.smithi105.stdout:Get:20 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 17.2.6-1296-g736ac5ba-1focal [3,501 kB] 2023-10-06T02:56:40.659 INFO:teuthology.orchestra.run.smithi105.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2023-10-06T02:56:40.660 INFO:teuthology.orchestra.run.smithi105.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2023-10-06T02:56:40.675 INFO:teuthology.orchestra.run.smithi105.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2023-10-06T02:56:40.676 INFO:teuthology.orchestra.run.smithi105.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2023-10-06T02:56:40.677 INFO:teuthology.orchestra.run.smithi105.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2023-10-06T02:56:40.679 INFO:teuthology.orchestra.run.smithi105.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-10-06T02:56:40.680 INFO:teuthology.orchestra.run.smithi105.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2023-10-06T02:56:40.681 INFO:teuthology.orchestra.run.smithi105.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2023-10-06T02:56:40.691 INFO:teuthology.orchestra.run.smithi105.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2023-10-06T02:56:40.691 INFO:teuthology.orchestra.run.smithi105.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2023-10-06T02:56:40.692 INFO:teuthology.orchestra.run.smithi105.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2023-10-06T02:56:40.694 INFO:teuthology.orchestra.run.smithi105.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2023-10-06T02:56:40.708 INFO:teuthology.orchestra.run.smithi105.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2023-10-06T02:56:40.711 INFO:teuthology.orchestra.run.smithi057.stdout:2 upgraded, 114 newly installed, 0 to remove and 256 not upgraded. 2023-10-06T02:56:40.711 INFO:teuthology.orchestra.run.smithi057.stdout:Need to get 210 MB of archives. 2023-10-06T02:56:40.711 INFO:teuthology.orchestra.run.smithi057.stdout:After this operation, 981 MB of additional disk space will be used. 2023-10-06T02:56:40.711 INFO:teuthology.orchestra.run.smithi057.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2023-10-06T02:56:40.716 INFO:teuthology.orchestra.run.smithi105.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2023-10-06T02:56:40.716 INFO:teuthology.orchestra.run.smithi105.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2023-10-06T02:56:40.717 INFO:teuthology.orchestra.run.smithi105.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2023-10-06T02:56:40.718 INFO:teuthology.orchestra.run.smithi105.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2023-10-06T02:56:40.720 INFO:teuthology.orchestra.run.smithi105.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2023-10-06T02:56:40.724 INFO:teuthology.orchestra.run.smithi105.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2023-10-06T02:56:40.726 INFO:teuthology.orchestra.run.smithi105.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-10-06T02:56:40.727 INFO:teuthology.orchestra.run.smithi105.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2023-10-06T02:56:40.729 INFO:teuthology.orchestra.run.smithi105.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2023-10-06T02:56:40.733 INFO:teuthology.orchestra.run.smithi057.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2023-10-06T02:56:40.741 INFO:teuthology.orchestra.run.smithi105.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2023-10-06T02:56:40.742 INFO:teuthology.orchestra.run.smithi057.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2023-10-06T02:56:40.743 INFO:teuthology.orchestra.run.smithi105.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2023-10-06T02:56:40.743 INFO:teuthology.orchestra.run.smithi105.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2023-10-06T02:56:40.744 INFO:teuthology.orchestra.run.smithi105.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2023-10-06T02:56:40.772 INFO:teuthology.orchestra.run.smithi057.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2023-10-06T02:56:40.798 INFO:teuthology.orchestra.run.smithi057.stdout:Get:5 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 17.2.6-1296-g736ac5ba-1focal [3,501 kB] 2023-10-06T02:56:40.806 INFO:teuthology.orchestra.run.smithi057.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2023-10-06T02:56:40.809 INFO:teuthology.orchestra.run.smithi057.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2023-10-06T02:56:40.820 INFO:teuthology.orchestra.run.smithi057.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2023-10-06T02:56:40.822 INFO:teuthology.orchestra.run.smithi057.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2023-10-06T02:56:40.845 INFO:teuthology.orchestra.run.smithi057.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2023-10-06T02:56:40.846 INFO:teuthology.orchestra.run.smithi057.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2023-10-06T02:56:40.849 INFO:teuthology.orchestra.run.smithi105.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2023-10-06T02:56:40.850 INFO:teuthology.orchestra.run.smithi057.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2023-10-06T02:56:40.868 INFO:teuthology.orchestra.run.smithi105.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2023-10-06T02:56:40.918 INFO:teuthology.orchestra.run.smithi057.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2023-10-06T02:56:40.918 INFO:teuthology.orchestra.run.smithi057.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2023-10-06T02:56:40.918 INFO:teuthology.orchestra.run.smithi057.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2023-10-06T02:56:40.918 INFO:teuthology.orchestra.run.smithi057.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2023-10-06T02:56:40.918 INFO:teuthology.orchestra.run.smithi057.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2023-10-06T02:56:40.918 INFO:teuthology.orchestra.run.smithi057.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2023-10-06T02:56:40.918 INFO:teuthology.orchestra.run.smithi057.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2023-10-06T02:56:40.918 INFO:teuthology.orchestra.run.smithi057.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2023-10-06T02:56:40.918 INFO:teuthology.orchestra.run.smithi057.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2023-10-06T02:56:40.919 INFO:teuthology.orchestra.run.smithi105.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2023-10-06T02:56:40.919 INFO:teuthology.orchestra.run.smithi105.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2023-10-06T02:56:40.919 INFO:teuthology.orchestra.run.smithi105.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2023-10-06T02:56:40.919 INFO:teuthology.orchestra.run.smithi105.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2023-10-06T02:56:40.919 INFO:teuthology.orchestra.run.smithi105.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2023-10-06T02:56:40.919 INFO:teuthology.orchestra.run.smithi105.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2023-10-06T02:56:40.920 INFO:teuthology.orchestra.run.smithi105.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2023-10-06T02:56:40.920 INFO:teuthology.orchestra.run.smithi105.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2023-10-06T02:56:40.920 INFO:teuthology.orchestra.run.smithi105.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2023-10-06T02:56:40.920 INFO:teuthology.orchestra.run.smithi105.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2023-10-06T02:56:40.920 INFO:teuthology.orchestra.run.smithi105.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2023-10-06T02:56:40.920 INFO:teuthology.orchestra.run.smithi105.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2023-10-06T02:56:40.920 INFO:teuthology.orchestra.run.smithi105.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2023-10-06T02:56:40.920 INFO:teuthology.orchestra.run.smithi105.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2023-10-06T02:56:40.920 INFO:teuthology.orchestra.run.smithi105.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2023-10-06T02:56:40.922 INFO:teuthology.orchestra.run.smithi105.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2023-10-06T02:56:40.923 INFO:teuthology.orchestra.run.smithi057.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2023-10-06T02:56:40.924 INFO:teuthology.orchestra.run.smithi057.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2023-10-06T02:56:40.925 INFO:teuthology.orchestra.run.smithi105.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2023-10-06T02:56:40.925 INFO:teuthology.orchestra.run.smithi105.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2023-10-06T02:56:40.943 INFO:teuthology.orchestra.run.smithi057.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2023-10-06T02:56:40.944 INFO:teuthology.orchestra.run.smithi057.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2023-10-06T02:56:40.947 INFO:teuthology.orchestra.run.smithi105.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2023-10-06T02:56:40.947 INFO:teuthology.orchestra.run.smithi057.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-10-06T02:56:40.949 INFO:teuthology.orchestra.run.smithi057.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2023-10-06T02:56:40.950 INFO:teuthology.orchestra.run.smithi057.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2023-10-06T02:56:40.950 INFO:teuthology.orchestra.run.smithi105.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2023-10-06T02:56:40.951 INFO:teuthology.orchestra.run.smithi057.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2023-10-06T02:56:40.952 INFO:teuthology.orchestra.run.smithi057.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2023-10-06T02:56:40.954 INFO:teuthology.orchestra.run.smithi057.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2023-10-06T02:56:40.962 INFO:teuthology.orchestra.run.smithi057.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2023-10-06T02:56:40.963 INFO:teuthology.orchestra.run.smithi057.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2023-10-06T02:56:40.982 INFO:teuthology.orchestra.run.smithi057.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2023-10-06T02:56:40.983 INFO:teuthology.orchestra.run.smithi057.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2023-10-06T02:56:40.984 INFO:teuthology.orchestra.run.smithi057.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2023-10-06T02:56:40.986 INFO:teuthology.orchestra.run.smithi057.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2023-10-06T02:56:40.989 INFO:teuthology.orchestra.run.smithi057.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2023-10-06T02:56:40.992 INFO:teuthology.orchestra.run.smithi057.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2023-10-06T02:56:40.994 INFO:teuthology.orchestra.run.smithi057.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-10-06T02:56:40.995 INFO:teuthology.orchestra.run.smithi057.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2023-10-06T02:56:41.000 INFO:teuthology.orchestra.run.smithi105.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2023-10-06T02:56:41.001 INFO:teuthology.orchestra.run.smithi105.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2023-10-06T02:56:41.001 INFO:teuthology.orchestra.run.smithi105.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2023-10-06T02:56:41.002 INFO:teuthology.orchestra.run.smithi057.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2023-10-06T02:56:41.002 INFO:teuthology.orchestra.run.smithi105.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2023-10-06T02:56:41.003 INFO:teuthology.orchestra.run.smithi105.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2023-10-06T02:56:41.004 INFO:teuthology.orchestra.run.smithi105.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2023-10-06T02:56:41.004 INFO:teuthology.orchestra.run.smithi057.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2023-10-06T02:56:41.018 INFO:teuthology.orchestra.run.smithi105.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2023-10-06T02:56:41.153 INFO:teuthology.orchestra.run.smithi057.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2023-10-06T02:56:41.153 INFO:teuthology.orchestra.run.smithi057.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2023-10-06T02:56:41.153 INFO:teuthology.orchestra.run.smithi057.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2023-10-06T02:56:41.153 INFO:teuthology.orchestra.run.smithi057.stdout:Get:47 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 17.2.6-1296-g736ac5ba-1focal [3,554 kB] 2023-10-06T02:56:41.154 INFO:teuthology.orchestra.run.smithi105.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-10-06T02:56:41.154 INFO:teuthology.orchestra.run.smithi105.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2023-10-06T02:56:41.154 INFO:teuthology.orchestra.run.smithi105.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2023-10-06T02:56:41.154 INFO:teuthology.orchestra.run.smithi105.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2023-10-06T02:56:41.154 INFO:teuthology.orchestra.run.smithi105.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2023-10-06T02:56:41.154 INFO:teuthology.orchestra.run.smithi105.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2023-10-06T02:56:41.154 INFO:teuthology.orchestra.run.smithi105.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2023-10-06T02:56:41.155 INFO:teuthology.orchestra.run.smithi105.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2023-10-06T02:56:41.155 INFO:teuthology.orchestra.run.smithi105.stdout:Get:84 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 17.2.6-1296-g736ac5ba-1focal [3,554 kB] 2023-10-06T02:56:41.161 INFO:teuthology.orchestra.run.smithi057.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2023-10-06T02:56:41.183 INFO:teuthology.orchestra.run.smithi057.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2023-10-06T02:56:41.185 INFO:teuthology.orchestra.run.smithi057.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2023-10-06T02:56:41.202 INFO:teuthology.orchestra.run.smithi057.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2023-10-06T02:56:41.211 INFO:teuthology.orchestra.run.smithi057.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2023-10-06T02:56:41.211 INFO:teuthology.orchestra.run.smithi057.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2023-10-06T02:56:41.211 INFO:teuthology.orchestra.run.smithi057.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2023-10-06T02:56:41.211 INFO:teuthology.orchestra.run.smithi057.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2023-10-06T02:56:41.211 INFO:teuthology.orchestra.run.smithi057.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2023-10-06T02:56:41.211 INFO:teuthology.orchestra.run.smithi057.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2023-10-06T02:56:41.212 INFO:teuthology.orchestra.run.smithi057.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2023-10-06T02:56:41.212 INFO:teuthology.orchestra.run.smithi057.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2023-10-06T02:56:41.217 INFO:teuthology.orchestra.run.smithi057.stdout:Get:60 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 17.2.6-1296-g736ac5ba-1focal [760 kB] 2023-10-06T02:56:41.227 INFO:teuthology.orchestra.run.smithi057.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2023-10-06T02:56:41.269 INFO:teuthology.orchestra.run.smithi057.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2023-10-06T02:56:41.270 INFO:teuthology.orchestra.run.smithi057.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2023-10-06T02:56:41.270 INFO:teuthology.orchestra.run.smithi057.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2023-10-06T02:56:41.270 INFO:teuthology.orchestra.run.smithi057.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2023-10-06T02:56:41.270 INFO:teuthology.orchestra.run.smithi057.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2023-10-06T02:56:41.270 INFO:teuthology.orchestra.run.smithi057.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2023-10-06T02:56:41.270 INFO:teuthology.orchestra.run.smithi057.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2023-10-06T02:56:41.270 INFO:teuthology.orchestra.run.smithi057.stdout:Get:69 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 17.2.6-1296-g736ac5ba-1focal [413 kB] 2023-10-06T02:56:41.270 INFO:teuthology.orchestra.run.smithi057.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2023-10-06T02:56:41.271 INFO:teuthology.orchestra.run.smithi057.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2023-10-06T02:56:41.276 INFO:teuthology.orchestra.run.smithi057.stdout:Get:72 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 17.2.6-1296-g736ac5ba-1focal [22.5 kB] 2023-10-06T02:56:41.277 INFO:teuthology.orchestra.run.smithi057.stdout:Get:73 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 17.2.6-1296-g736ac5ba-1focal [200 kB] 2023-10-06T02:56:41.292 INFO:teuthology.orchestra.run.smithi057.stdout:Get:74 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 17.2.6-1296-g736ac5ba-1focal [47.1 kB] 2023-10-06T02:56:41.293 INFO:teuthology.orchestra.run.smithi057.stdout:Get:75 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 17.2.6-1296-g736ac5ba-1focal [386 kB] 2023-10-06T02:56:41.308 INFO:teuthology.orchestra.run.smithi057.stdout:Get:76 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 17.2.6-1296-g736ac5ba-1focal [5,570 kB] 2023-10-06T02:56:41.325 INFO:teuthology.orchestra.run.smithi057.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2023-10-06T02:56:41.327 INFO:teuthology.orchestra.run.smithi057.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2023-10-06T02:56:41.327 INFO:teuthology.orchestra.run.smithi057.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2023-10-06T02:56:41.327 INFO:teuthology.orchestra.run.smithi057.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2023-10-06T02:56:41.328 INFO:teuthology.orchestra.run.smithi057.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2023-10-06T02:56:41.329 INFO:teuthology.orchestra.run.smithi057.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2023-10-06T02:56:41.344 INFO:teuthology.orchestra.run.smithi057.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2023-10-06T02:56:41.344 INFO:teuthology.orchestra.run.smithi057.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-10-06T02:56:41.345 INFO:teuthology.orchestra.run.smithi057.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2023-10-06T02:56:41.345 INFO:teuthology.orchestra.run.smithi057.stdout:Get:86 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2023-10-06T02:56:41.366 INFO:teuthology.orchestra.run.smithi057.stdout:Get:87 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2023-10-06T02:56:41.368 INFO:teuthology.orchestra.run.smithi057.stdout:Get:88 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2023-10-06T02:56:41.369 INFO:teuthology.orchestra.run.smithi057.stdout:Get:89 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2023-10-06T02:56:41.373 INFO:teuthology.orchestra.run.smithi057.stdout:Get:90 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2023-10-06T02:56:41.375 INFO:teuthology.orchestra.run.smithi057.stdout:Get:91 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2023-10-06T02:56:41.411 INFO:teuthology.orchestra.run.smithi105.stdout:Get:85 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 17.2.6-1296-g736ac5ba-1focal [760 kB] 2023-10-06T02:56:41.475 INFO:teuthology.orchestra.run.smithi105.stdout:Get:86 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 17.2.6-1296-g736ac5ba-1focal [413 kB] 2023-10-06T02:56:41.516 INFO:teuthology.orchestra.run.smithi105.stdout:Get:87 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 17.2.6-1296-g736ac5ba-1focal [22.5 kB] 2023-10-06T02:56:41.517 INFO:teuthology.orchestra.run.smithi105.stdout:Get:88 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 17.2.6-1296-g736ac5ba-1focal [200 kB] 2023-10-06T02:56:41.531 INFO:teuthology.orchestra.run.smithi105.stdout:Get:89 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 17.2.6-1296-g736ac5ba-1focal [47.1 kB] 2023-10-06T02:56:41.534 INFO:teuthology.orchestra.run.smithi105.stdout:Get:90 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 17.2.6-1296-g736ac5ba-1focal [386 kB] 2023-10-06T02:56:41.570 INFO:teuthology.orchestra.run.smithi105.stdout:Get:91 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 17.2.6-1296-g736ac5ba-1focal [5,570 kB] 2023-10-06T02:56:41.610 INFO:teuthology.orchestra.run.smithi057.stdout:Get:92 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 17.2.6-1296-g736ac5ba-1focal [116 kB] 2023-10-06T02:56:41.613 INFO:teuthology.orchestra.run.smithi057.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 17.2.6-1296-g736ac5ba-1focal [479 kB] 2023-10-06T02:56:41.637 INFO:teuthology.orchestra.run.smithi057.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 17.2.6-1296-g736ac5ba-1focal [27.8 MB] 2023-10-06T02:56:42.139 INFO:teuthology.orchestra.run.smithi105.stdout:Get:92 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 17.2.6-1296-g736ac5ba-1focal [116 kB] 2023-10-06T02:56:42.142 INFO:teuthology.orchestra.run.smithi105.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 17.2.6-1296-g736ac5ba-1focal [479 kB] 2023-10-06T02:56:42.166 INFO:teuthology.orchestra.run.smithi105.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 17.2.6-1296-g736ac5ba-1focal [27.8 MB] 2023-10-06T02:56:43.130 INFO:teuthology.orchestra.run.smithi057.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 17.2.6-1296-g736ac5ba-1focal [6,453 kB] 2023-10-06T02:56:43.464 INFO:teuthology.orchestra.run.smithi057.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 17.2.6-1296-g736ac5ba-1focal [221 kB] 2023-10-06T02:56:43.471 INFO:teuthology.orchestra.run.smithi057.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 17.2.6-1296-g736ac5ba-1focal [152 kB] 2023-10-06T02:56:43.480 INFO:teuthology.orchestra.run.smithi057.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 17.2.6-1296-g736ac5ba-1focal [1,591 kB] 2023-10-06T02:56:43.565 INFO:teuthology.orchestra.run.smithi057.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 17.2.6-1296-g736ac5ba-1focal [7,846 kB] 2023-10-06T02:56:43.981 INFO:teuthology.orchestra.run.smithi057.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 17.2.6-1296-g736ac5ba-1focal [28.7 MB] 2023-10-06T02:56:44.489 INFO:teuthology.orchestra.run.smithi105.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 17.2.6-1296-g736ac5ba-1focal [6,453 kB] 2023-10-06T02:56:45.021 INFO:teuthology.orchestra.run.smithi105.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 17.2.6-1296-g736ac5ba-1focal [221 kB] 2023-10-06T02:56:45.038 INFO:teuthology.orchestra.run.smithi105.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 17.2.6-1296-g736ac5ba-1focal [152 kB] 2023-10-06T02:56:45.063 INFO:teuthology.orchestra.run.smithi105.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 17.2.6-1296-g736ac5ba-1focal [1,591 kB] 2023-10-06T02:56:45.184 INFO:teuthology.orchestra.run.smithi105.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 17.2.6-1296-g736ac5ba-1focal [7,846 kB] 2023-10-06T02:56:45.530 INFO:teuthology.orchestra.run.smithi057.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 17.2.6-1296-g736ac5ba-1focal [3,920 B] 2023-10-06T02:56:45.531 INFO:teuthology.orchestra.run.smithi057.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 17.2.6-1296-g736ac5ba-1focal [869 kB] 2023-10-06T02:56:45.563 INFO:teuthology.orchestra.run.smithi057.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 17.2.6-1296-g736ac5ba-1focal [2,408 kB] 2023-10-06T02:56:45.775 INFO:teuthology.orchestra.run.smithi057.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 17.2.6-1296-g736ac5ba-1focal [79.1 kB] 2023-10-06T02:56:45.882 INFO:teuthology.orchestra.run.smithi105.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 17.2.6-1296-g736ac5ba-1focal [28.7 MB] 2023-10-06T02:56:45.882 INFO:teuthology.orchestra.run.smithi057.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 17.2.6-1296-g736ac5ba-1focal [117 kB] 2023-10-06T02:56:45.883 INFO:teuthology.orchestra.run.smithi057.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 17.2.6-1296-g736ac5ba-1focal [1,760 kB] 2023-10-06T02:56:45.883 INFO:teuthology.orchestra.run.smithi057.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 17.2.6-1296-g736ac5ba-1focal [7,888 kB] 2023-10-06T02:56:46.297 INFO:teuthology.orchestra.run.smithi057.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 17.2.6-1296-g736ac5ba-1focal [4,032 B] 2023-10-06T02:56:46.350 INFO:teuthology.orchestra.run.smithi057.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 17.2.6-1296-g736ac5ba-1focal [56.2 MB] 2023-10-06T02:56:47.867 INFO:teuthology.orchestra.run.smithi105.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 17.2.6-1296-g736ac5ba-1focal [3,920 B] 2023-10-06T02:56:47.874 INFO:teuthology.orchestra.run.smithi105.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 17.2.6-1296-g736ac5ba-1focal [869 kB] 2023-10-06T02:56:47.916 INFO:teuthology.orchestra.run.smithi105.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 17.2.6-1296-g736ac5ba-1focal [2,408 kB] 2023-10-06T02:56:48.090 INFO:teuthology.orchestra.run.smithi105.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 17.2.6-1296-g736ac5ba-1focal [79.1 kB] 2023-10-06T02:56:48.097 INFO:teuthology.orchestra.run.smithi105.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 17.2.6-1296-g736ac5ba-1focal [117 kB] 2023-10-06T02:56:48.103 INFO:teuthology.orchestra.run.smithi105.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 17.2.6-1296-g736ac5ba-1focal [1,760 kB] 2023-10-06T02:56:48.231 INFO:teuthology.orchestra.run.smithi105.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 17.2.6-1296-g736ac5ba-1focal [7,888 kB] 2023-10-06T02:56:48.805 INFO:teuthology.orchestra.run.smithi105.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 17.2.6-1296-g736ac5ba-1focal [4,032 B] 2023-10-06T02:56:48.806 INFO:teuthology.orchestra.run.smithi105.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 17.2.6-1296-g736ac5ba-1focal [56.2 MB] 2023-10-06T02:56:49.719 INFO:teuthology.orchestra.run.smithi057.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 17.2.6-1296-g736ac5ba-1focal [229 kB] 2023-10-06T02:56:49.721 INFO:teuthology.orchestra.run.smithi057.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 cephfs-mirror amd64 17.2.6-1296-g736ac5ba-1focal [240 kB] 2023-10-06T02:56:49.724 INFO:teuthology.orchestra.run.smithi057.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 17.2.6-1296-g736ac5ba-1focal [22.0 kB] 2023-10-06T02:56:49.724 INFO:teuthology.orchestra.run.smithi057.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 cephfs-top all 17.2.6-1296-g736ac5ba-1focal [13.1 kB] 2023-10-06T02:56:49.724 INFO:teuthology.orchestra.run.smithi057.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 17.2.6-1296-g736ac5ba-1focal [21.9 kB] 2023-10-06T02:56:49.725 INFO:teuthology.orchestra.run.smithi057.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 17.2.6-1296-g736ac5ba-1focal [17.0 MB] 2023-10-06T02:56:50.751 INFO:teuthology.orchestra.run.smithi057.stdout:Get:116 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 17.2.6-1296-g736ac5ba-1focal [79.5 kB] 2023-10-06T02:56:51.703 INFO:teuthology.orchestra.run.smithi057.stdout:Fetched 210 MB in 10s (20.7 MB/s) 2023-10-06T02:56:51.749 INFO:teuthology.orchestra.run.smithi105.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 17.2.6-1296-g736ac5ba-1focal [229 kB] 2023-10-06T02:56:51.750 INFO:teuthology.orchestra.run.smithi105.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 cephfs-mirror amd64 17.2.6-1296-g736ac5ba-1focal [240 kB] 2023-10-06T02:56:51.753 INFO:teuthology.orchestra.run.smithi105.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 17.2.6-1296-g736ac5ba-1focal [22.0 kB] 2023-10-06T02:56:51.753 INFO:teuthology.orchestra.run.smithi105.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 cephfs-top all 17.2.6-1296-g736ac5ba-1focal [13.1 kB] 2023-10-06T02:56:51.754 INFO:teuthology.orchestra.run.smithi105.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 17.2.6-1296-g736ac5ba-1focal [21.9 kB] 2023-10-06T02:56:51.754 INFO:teuthology.orchestra.run.smithi105.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 17.2.6-1296-g736ac5ba-1focal [17.0 MB] 2023-10-06T02:56:51.887 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-pyperclip. 2023-10-06T02:56:51.959 INFO:teuthology.orchestra.run.smithi057.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 107762 files and directories currently installed.) 2023-10-06T02:56:51.962 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2023-10-06T02:56:52.000 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2023-10-06T02:56:52.342 INFO:teuthology.orchestra.run.smithi105.stdout:Get:116 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 17.2.6-1296-g736ac5ba-1focal [79.5 kB] 2023-10-06T02:56:52.378 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-wcwidth. 2023-10-06T02:56:52.397 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2023-10-06T02:56:52.436 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2023-10-06T02:56:52.765 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-cmd2. 2023-10-06T02:56:52.785 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2023-10-06T02:56:52.823 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2023-10-06T02:56:53.209 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2023-10-06T02:56:53.222 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2023-10-06T02:56:53.271 INFO:teuthology.orchestra.run.smithi105.stdout:Fetched 210 MB in 12s (17.6 MB/s) 2023-10-06T02:56:53.301 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2023-10-06T02:56:53.457 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-pyperclip. 2023-10-06T02:56:53.526 INFO:teuthology.orchestra.run.smithi105.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 107762 files and directories currently installed.) 2023-10-06T02:56:53.531 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2023-10-06T02:56:53.586 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2023-10-06T02:56:53.675 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../004-librbd1_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:56:53.822 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking librbd1 (17.2.6-1296-g736ac5ba-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-10-06T02:56:53.923 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-wcwidth. 2023-10-06T02:56:53.942 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2023-10-06T02:56:53.973 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2023-10-06T02:56:54.518 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-cmd2. 2023-10-06T02:56:54.536 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2023-10-06T02:56:54.576 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2023-10-06T02:56:54.773 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../005-librados2_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:56:54.894 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking librados2 (17.2.6-1296-g736ac5ba-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-10-06T02:56:54.979 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2023-10-06T02:56:54.999 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2023-10-06T02:56:55.079 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2023-10-06T02:56:55.419 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../004-librbd1_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:56:55.567 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking librbd1 (17.2.6-1296-g736ac5ba-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-10-06T02:56:55.632 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libcephfs2. 2023-10-06T02:56:55.652 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../006-libcephfs2_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:56:55.690 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libcephfs2 (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:56.043 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-rados. 2023-10-06T02:56:56.063 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../007-python3-rados_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:56:56.101 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-rados (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:56.357 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../005-librados2_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:56:56.480 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking librados2 (17.2.6-1296-g736ac5ba-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-10-06T02:56:56.504 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-10-06T02:56:56.517 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../008-python3-ceph-argparse_17.2.6-1296-g736ac5ba-1focal_all.deb ... 2023-10-06T02:56:56.563 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-ceph-argparse (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:56.849 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-cephfs. 2023-10-06T02:56:56.861 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../009-python3-cephfs_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:56:56.898 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-cephfs (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:57.226 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package libcephfs2. 2023-10-06T02:56:57.245 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../006-libcephfs2_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:56:57.284 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libcephfs2 (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:57.284 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-ceph-common. 2023-10-06T02:56:57.298 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../010-python3-ceph-common_17.2.6-1296-g736ac5ba-1focal_all.deb ... 2023-10-06T02:56:57.343 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-ceph-common (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:57.687 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-rados. 2023-10-06T02:56:57.698 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-prettytable. 2023-10-06T02:56:57.703 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../007-python3-rados_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:56:57.717 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../011-python3-prettytable_0.7.2-5_all.deb ... 2023-10-06T02:56:57.756 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2023-10-06T02:56:57.769 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-rados (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:58.042 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-rbd. 2023-10-06T02:56:58.061 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../012-python3-rbd_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:56:58.137 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-rbd (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:58.172 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-10-06T02:56:58.191 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../008-python3-ceph-argparse_17.2.6-1296-g736ac5ba-1focal_all.deb ... 2023-10-06T02:56:58.230 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-ceph-argparse (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:58.512 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2023-10-06T02:56:58.531 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../013-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2023-10-06T02:56:58.543 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-cephfs. 2023-10-06T02:56:58.562 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../009-python3-cephfs_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:56:58.570 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-10-06T02:56:58.601 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-cephfs (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:58.942 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package librabbitmq4:amd64. 2023-10-06T02:56:58.960 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../014-librabbitmq4_0.10.0-1_amd64.deb ... 2023-10-06T02:56:58.972 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-ceph-common. 2023-10-06T02:56:58.991 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../010-python3-ceph-common_17.2.6-1296-g736ac5ba-1focal_all.deb ... 2023-10-06T02:56:59.025 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2023-10-06T02:56:59.030 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-ceph-common (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:59.378 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-10-06T02:56:59.397 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../015-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2023-10-06T02:56:59.400 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-prettytable. 2023-10-06T02:56:59.419 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../011-python3-prettytable_0.7.2-5_all.deb ... 2023-10-06T02:56:59.436 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-10-06T02:56:59.458 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2023-10-06T02:56:59.761 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-rbd. 2023-10-06T02:56:59.780 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../012-python3-rbd_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:56:59.813 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-10-06T02:56:59.819 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-rbd (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:56:59.833 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../016-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2023-10-06T02:56:59.930 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-10-06T02:57:00.214 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2023-10-06T02:57:00.231 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../013-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2023-10-06T02:57:00.272 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-10-06T02:57:00.275 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-10-06T02:57:00.292 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../017-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2023-10-06T02:57:00.332 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-10-06T02:57:00.641 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package librabbitmq4:amd64. 2023-10-06T02:57:00.660 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../014-librabbitmq4_0.10.0-1_amd64.deb ... 2023-10-06T02:57:00.716 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2023-10-06T02:57:00.869 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-10-06T02:57:00.889 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../018-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-10-06T02:57:00.946 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-06T02:57:01.095 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-10-06T02:57:01.114 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../015-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2023-10-06T02:57:01.153 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-10-06T02:57:01.481 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-10-06T02:57:01.500 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../019-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-10-06T02:57:01.539 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-06T02:57:01.564 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-10-06T02:57:01.582 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../016-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2023-10-06T02:57:01.622 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-10-06T02:57:01.934 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-10-06T02:57:01.953 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../020-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-10-06T02:57:01.992 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-06T02:57:02.034 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-10-06T02:57:02.052 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../017-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2023-10-06T02:57:02.092 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-10-06T02:57:02.395 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libthrift-0.13.0. 2023-10-06T02:57:02.415 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../021-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2023-10-06T02:57:02.469 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2023-10-06T02:57:02.655 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-10-06T02:57:02.672 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../018-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-10-06T02:57:02.734 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-06T02:57:02.839 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package librgw2. 2023-10-06T02:57:02.858 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../022-librgw2_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:57:02.898 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking librgw2 (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:03.291 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-10-06T02:57:03.310 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../019-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-10-06T02:57:03.349 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-06T02:57:03.692 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-rgw. 2023-10-06T02:57:03.711 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../023-python3-rgw_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:57:03.749 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-rgw (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:03.778 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-10-06T02:57:03.796 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../020-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-10-06T02:57:03.827 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-06T02:57:04.127 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package liboath0. 2023-10-06T02:57:04.147 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../024-liboath0_2.6.1-1.3_amd64.deb ... 2023-10-06T02:57:04.318 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2023-10-06T02:57:04.331 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package libthrift-0.13.0. 2023-10-06T02:57:04.343 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../021-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2023-10-06T02:57:04.388 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2023-10-06T02:57:04.838 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libradosstriper1. 2023-10-06T02:57:04.857 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../025-libradosstriper1_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:57:04.896 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libradosstriper1 (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:05.066 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package librgw2. 2023-10-06T02:57:05.086 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../022-librgw2_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:57:05.158 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking librgw2 (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:05.350 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-common. 2023-10-06T02:57:05.368 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../026-ceph-common_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:57:05.399 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-common (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:05.986 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-rgw. 2023-10-06T02:57:06.004 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../023-python3-rgw_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:57:06.035 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-rgw (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:06.405 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package liboath0. 2023-10-06T02:57:06.424 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../024-liboath0_2.6.1-1.3_amd64.deb ... 2023-10-06T02:57:06.463 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2023-10-06T02:57:06.841 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package libradosstriper1. 2023-10-06T02:57:06.860 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../025-libradosstriper1_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:57:06.899 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libradosstriper1 (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:07.461 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package ceph-common. 2023-10-06T02:57:07.479 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../026-ceph-common_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:57:07.519 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking ceph-common (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:08.204 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-base. 2023-10-06T02:57:08.223 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../027-ceph-base_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:57:08.276 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-base (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:09.275 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-cryptography. 2023-10-06T02:57:09.294 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../028-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2023-10-06T02:57:09.325 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2023-10-06T02:57:10.120 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-openssl. 2023-10-06T02:57:10.139 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../029-python3-openssl_19.0.0-1build1_all.deb ... 2023-10-06T02:57:10.170 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2023-10-06T02:57:10.489 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-10-06T02:57:10.509 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../030-ceph-mgr-modules-core_17.2.6-1296-g736ac5ba-1focal_all.deb ... 2023-10-06T02:57:10.547 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-mgr-modules-core (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:10.850 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package ceph-base. 2023-10-06T02:57:10.869 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../027-ceph-base_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:57:10.928 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking ceph-base (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:10.977 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-bcrypt. 2023-10-06T02:57:10.997 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../031-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2023-10-06T02:57:11.035 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2023-10-06T02:57:11.405 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-cherrypy3. 2023-10-06T02:57:11.423 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../032-python3-cherrypy3_8.9.1-6_all.deb ... 2023-10-06T02:57:11.454 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2023-10-06T02:57:11.833 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-natsort. 2023-10-06T02:57:11.852 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../033-python3-natsort_7.0.1-1_all.deb ... 2023-10-06T02:57:11.890 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-natsort (7.0.1-1) ... 2023-10-06T02:57:11.996 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-cryptography. 2023-10-06T02:57:12.015 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../028-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2023-10-06T02:57:12.054 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2023-10-06T02:57:12.244 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-jwt. 2023-10-06T02:57:12.263 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../034-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2023-10-06T02:57:12.302 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2023-10-06T02:57:12.516 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-openssl. 2023-10-06T02:57:12.535 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../029-python3-openssl_19.0.0-1build1_all.deb ... 2023-10-06T02:57:12.574 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2023-10-06T02:57:12.655 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-logutils. 2023-10-06T02:57:12.674 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../035-python3-logutils_0.3.3-7_all.deb ... 2023-10-06T02:57:12.713 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-logutils (0.3.3-7) ... 2023-10-06T02:57:12.894 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-10-06T02:57:12.912 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../030-ceph-mgr-modules-core_17.2.6-1296-g736ac5ba-1focal_all.deb ... 2023-10-06T02:57:12.952 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking ceph-mgr-modules-core (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:13.058 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-markupsafe. 2023-10-06T02:57:13.075 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../036-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2023-10-06T02:57:13.107 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2023-10-06T02:57:13.399 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-bcrypt. 2023-10-06T02:57:13.419 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../031-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2023-10-06T02:57:13.419 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-mako. 2023-10-06T02:57:13.437 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../037-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2023-10-06T02:57:13.457 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2023-10-06T02:57:13.476 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-10-06T02:57:13.818 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-cherrypy3. 2023-10-06T02:57:13.837 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../032-python3-cherrypy3_8.9.1-6_all.deb ... 2023-10-06T02:57:13.846 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-simplegeneric. 2023-10-06T02:57:13.865 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../038-python3-simplegeneric_0.8.1-3_all.deb ... 2023-10-06T02:57:13.876 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2023-10-06T02:57:13.904 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-10-06T02:57:14.249 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-singledispatch. 2023-10-06T02:57:14.268 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../039-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2023-10-06T02:57:14.297 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-natsort. 2023-10-06T02:57:14.307 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2023-10-06T02:57:14.315 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../033-python3-natsort_7.0.1-1_all.deb ... 2023-10-06T02:57:14.354 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-natsort (7.0.1-1) ... 2023-10-06T02:57:14.668 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-webob. 2023-10-06T02:57:14.687 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../040-python3-webob_1%3a1.8.5-2_all.deb ... 2023-10-06T02:57:14.724 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-jwt. 2023-10-06T02:57:14.726 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2023-10-06T02:57:14.743 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../034-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2023-10-06T02:57:14.807 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2023-10-06T02:57:15.186 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-logutils. 2023-10-06T02:57:15.198 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../035-python3-logutils_0.3.3-7_all.deb ... 2023-10-06T02:57:15.235 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-logutils (0.3.3-7) ... 2023-10-06T02:57:15.404 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-soupsieve. 2023-10-06T02:57:15.419 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../041-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2023-10-06T02:57:15.478 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2023-10-06T02:57:15.572 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-markupsafe. 2023-10-06T02:57:15.584 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../036-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2023-10-06T02:57:15.622 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2023-10-06T02:57:15.823 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-bs4. 2023-10-06T02:57:15.842 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../042-python3-bs4_4.8.2-1_all.deb ... 2023-10-06T02:57:15.881 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2023-10-06T02:57:15.975 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-mako. 2023-10-06T02:57:15.995 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../037-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2023-10-06T02:57:16.033 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-10-06T02:57:16.226 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-waitress. 2023-10-06T02:57:16.245 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../043-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2023-10-06T02:57:16.324 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2023-10-06T02:57:16.420 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-simplegeneric. 2023-10-06T02:57:16.439 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../038-python3-simplegeneric_0.8.1-3_all.deb ... 2023-10-06T02:57:16.478 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-10-06T02:57:16.696 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-tempita. 2023-10-06T02:57:16.715 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6_all.deb ... 2023-10-06T02:57:16.753 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-tempita (0.5.2-6) ... 2023-10-06T02:57:16.823 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-singledispatch. 2023-10-06T02:57:16.840 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../039-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2023-10-06T02:57:16.880 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2023-10-06T02:57:17.099 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-paste. 2023-10-06T02:57:17.117 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../045-python3-paste_3.4.0+dfsg1-1_all.deb ... 2023-10-06T02:57:17.173 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2023-10-06T02:57:17.242 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-webob. 2023-10-06T02:57:17.260 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../040-python3-webob_1%3a1.8.5-2_all.deb ... 2023-10-06T02:57:17.300 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2023-10-06T02:57:17.526 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-10-06T02:57:17.546 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2023-10-06T02:57:17.584 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2023-10-06T02:57:17.678 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-soupsieve. 2023-10-06T02:57:17.696 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../041-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2023-10-06T02:57:17.736 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2023-10-06T02:57:17.920 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-pastedeploy. 2023-10-06T02:57:17.940 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.0-1_all.deb ... 2023-10-06T02:57:17.978 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2023-10-06T02:57:18.072 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-bs4. 2023-10-06T02:57:18.084 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../042-python3-bs4_4.8.2-1_all.deb ... 2023-10-06T02:57:18.147 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2023-10-06T02:57:18.332 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-webtest. 2023-10-06T02:57:18.351 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../048-python3-webtest_2.0.32-2_all.deb ... 2023-10-06T02:57:18.390 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-webtest (2.0.32-2) ... 2023-10-06T02:57:18.533 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-waitress. 2023-10-06T02:57:18.546 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../043-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2023-10-06T02:57:18.589 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2023-10-06T02:57:18.734 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-pecan. 2023-10-06T02:57:18.752 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2023-10-06T02:57:18.792 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2023-10-06T02:57:18.979 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-tempita. 2023-10-06T02:57:18.991 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6_all.deb ... 2023-10-06T02:57:19.028 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-tempita (0.5.2-6) ... 2023-10-06T02:57:19.230 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-werkzeug. 2023-10-06T02:57:19.248 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../050-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2023-10-06T02:57:19.288 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-10-06T02:57:19.381 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-paste. 2023-10-06T02:57:19.394 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../045-python3-paste_3.4.0+dfsg1-1_all.deb ... 2023-10-06T02:57:19.431 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2023-10-06T02:57:19.675 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-10-06T02:57:19.694 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../051-libsqlite3-mod-ceph_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:57:19.754 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libsqlite3-mod-ceph (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:19.842 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-10-06T02:57:19.855 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2023-10-06T02:57:19.892 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2023-10-06T02:57:20.119 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-mgr. 2023-10-06T02:57:20.136 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../052-ceph-mgr_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:57:20.177 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-mgr (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:20.254 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-pastedeploy. 2023-10-06T02:57:20.266 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.0-1_all.deb ... 2023-10-06T02:57:20.303 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2023-10-06T02:57:20.682 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-webtest. 2023-10-06T02:57:20.694 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../048-python3-webtest_2.0.32-2_all.deb ... 2023-10-06T02:57:20.756 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-webtest (2.0.32-2) ... 2023-10-06T02:57:20.805 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-mon. 2023-10-06T02:57:20.824 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../053-ceph-mon_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:57:20.863 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-mon (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:21.076 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-pecan. 2023-10-06T02:57:21.089 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2023-10-06T02:57:21.151 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2023-10-06T02:57:21.572 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-werkzeug. 2023-10-06T02:57:21.585 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../050-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2023-10-06T02:57:21.631 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-10-06T02:57:22.043 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-10-06T02:57:22.060 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../051-libsqlite3-mod-ceph_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:57:22.101 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libsqlite3-mod-ceph (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:22.125 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-osd. 2023-10-06T02:57:22.144 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../054-ceph-osd_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:57:22.182 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-osd (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:22.521 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package ceph-mgr. 2023-10-06T02:57:22.539 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../052-ceph-mgr_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:57:22.598 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking ceph-mgr (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:23.124 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package ceph-mon. 2023-10-06T02:57:23.142 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../053-ceph-mon_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:57:23.182 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking ceph-mon (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:24.319 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package ceph-osd. 2023-10-06T02:57:24.336 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../054-ceph-osd_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:57:24.376 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking ceph-osd (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:24.744 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph. 2023-10-06T02:57:24.763 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../055-ceph_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:57:24.802 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:25.205 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-fuse. 2023-10-06T02:57:25.224 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../056-ceph-fuse_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:57:25.262 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-fuse (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:25.874 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-mds. 2023-10-06T02:57:25.891 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../057-ceph-mds_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:57:25.932 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-mds (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:26.493 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package cephadm. 2023-10-06T02:57:26.514 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../058-cephadm_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:57:26.560 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking cephadm (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:26.914 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package ceph. 2023-10-06T02:57:26.933 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../055-ceph_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:57:26.938 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-jinja2. 2023-10-06T02:57:26.956 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../059-python3-jinja2_2.10.1-2_all.deb ... 2023-10-06T02:57:26.972 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking ceph (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:27.003 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2023-10-06T02:57:27.349 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-10-06T02:57:27.349 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package ceph-fuse. 2023-10-06T02:57:27.367 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../060-ceph-mgr-cephadm_17.2.6-1296-g736ac5ba-1focal_all.deb ... 2023-10-06T02:57:27.368 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../056-ceph-fuse_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:57:27.406 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-mgr-cephadm (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:27.407 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking ceph-fuse (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:27.810 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-repoze.lru. 2023-10-06T02:57:27.829 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../061-python3-repoze.lru_0.7-2_all.deb ... 2023-10-06T02:57:27.867 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-10-06T02:57:27.869 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package ceph-mds. 2023-10-06T02:57:27.888 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../057-ceph-mds_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:57:27.969 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking ceph-mds (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:28.153 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libjs-underscore. 2023-10-06T02:57:28.173 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../062-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2023-10-06T02:57:28.211 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-10-06T02:57:28.539 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libjs-sphinxdoc. 2023-10-06T02:57:28.547 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package cephadm. 2023-10-06T02:57:28.559 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../063-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2023-10-06T02:57:28.566 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../058-cephadm_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:57:28.596 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-10-06T02:57:28.605 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking cephadm (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:28.941 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-routes. 2023-10-06T02:57:28.961 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../064-python3-routes_2.4.1-2_all.deb ... 2023-10-06T02:57:28.983 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-jinja2. 2023-10-06T02:57:28.999 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-routes (2.4.1-2) ... 2023-10-06T02:57:29.005 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../059-python3-jinja2_2.10.1-2_all.deb ... 2023-10-06T02:57:29.075 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2023-10-06T02:57:29.411 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-10-06T02:57:29.431 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../065-ceph-mgr-dashboard_17.2.6-1296-g736ac5ba-1focal_all.deb ... 2023-10-06T02:57:29.468 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-mgr-dashboard (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:29.486 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-10-06T02:57:29.504 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../060-ceph-mgr-cephadm_17.2.6-1296-g736ac5ba-1focal_all.deb ... 2023-10-06T02:57:29.544 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking ceph-mgr-cephadm (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:29.948 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-repoze.lru. 2023-10-06T02:57:29.967 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../061-python3-repoze.lru_0.7-2_all.deb ... 2023-10-06T02:57:30.005 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-decorator. 2023-10-06T02:57:30.029 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-10-06T02:57:30.029 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../066-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2023-10-06T02:57:30.063 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2023-10-06T02:57:30.300 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package libjs-underscore. 2023-10-06T02:57:30.319 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../062-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2023-10-06T02:57:30.357 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-10-06T02:57:30.425 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2023-10-06T02:57:30.444 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../067-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2023-10-06T02:57:30.482 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-10-06T02:57:30.677 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package libjs-sphinxdoc. 2023-10-06T02:57:30.696 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../063-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2023-10-06T02:57:30.735 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-10-06T02:57:30.827 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-scipy. 2023-10-06T02:57:30.845 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../068-python3-scipy_1.3.3-3build1_amd64.deb ... 2023-10-06T02:57:30.885 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2023-10-06T02:57:31.096 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-routes. 2023-10-06T02:57:31.109 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../064-python3-routes_2.4.1-2_all.deb ... 2023-10-06T02:57:31.146 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-routes (2.4.1-2) ... 2023-10-06T02:57:31.541 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-10-06T02:57:31.559 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../065-ceph-mgr-dashboard_17.2.6-1296-g736ac5ba-1focal_all.deb ... 2023-10-06T02:57:31.598 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking ceph-mgr-dashboard (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:32.136 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-decorator. 2023-10-06T02:57:32.154 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../066-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2023-10-06T02:57:32.202 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2023-10-06T02:57:32.259 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-sklearn-lib. 2023-10-06T02:57:32.272 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../069-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2023-10-06T02:57:32.317 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-10-06T02:57:32.547 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2023-10-06T02:57:32.566 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../067-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2023-10-06T02:57:32.605 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-10-06T02:57:32.863 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-joblib. 2023-10-06T02:57:32.882 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../070-python3-joblib_0.14.0-3_all.deb ... 2023-10-06T02:57:32.920 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-joblib (0.14.0-3) ... 2023-10-06T02:57:32.983 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-scipy. 2023-10-06T02:57:33.002 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../068-python3-scipy_1.3.3-3build1_amd64.deb ... 2023-10-06T02:57:33.032 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2023-10-06T02:57:33.325 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-sklearn. 2023-10-06T02:57:33.343 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../071-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2023-10-06T02:57:33.382 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-10-06T02:57:34.199 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-10-06T02:57:34.218 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../072-ceph-mgr-diskprediction-local_17.2.6-1296-g736ac5ba-1focal_all.deb ... 2023-10-06T02:57:34.256 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-mgr-diskprediction-local (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:34.508 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-sklearn-lib. 2023-10-06T02:57:34.527 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../069-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2023-10-06T02:57:34.566 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-10-06T02:57:35.213 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-joblib. 2023-10-06T02:57:35.232 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../070-python3-joblib_0.14.0-3_all.deb ... 2023-10-06T02:57:35.271 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-joblib (0.14.0-3) ... 2023-10-06T02:57:35.690 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-sklearn. 2023-10-06T02:57:35.708 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../071-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2023-10-06T02:57:35.718 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-cachetools. 2023-10-06T02:57:35.736 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../073-python3-cachetools_4.0.0-1_all.deb ... 2023-10-06T02:57:35.775 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2023-10-06T02:57:35.989 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-10-06T02:57:36.112 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-pyasn1. 2023-10-06T02:57:36.129 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../074-python3-pyasn1_0.4.2-3build1_all.deb ... 2023-10-06T02:57:36.169 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2023-10-06T02:57:36.548 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-10-06T02:57:36.567 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../075-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2023-10-06T02:57:36.606 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-10-06T02:57:36.954 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-rsa. 2023-10-06T02:57:36.974 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../076-python3-rsa_4.0-3_all.deb ... 2023-10-06T02:57:36.990 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-10-06T02:57:37.009 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../072-ceph-mgr-diskprediction-local_17.2.6-1296-g736ac5ba-1focal_all.deb ... 2023-10-06T02:57:37.011 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-rsa (4.0-3) ... 2023-10-06T02:57:37.048 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking ceph-mgr-diskprediction-local (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:37.383 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-google-auth. 2023-10-06T02:57:37.401 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../077-python3-google-auth_1.5.1-2_all.deb ... 2023-10-06T02:57:37.440 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2023-10-06T02:57:37.785 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-blinker. 2023-10-06T02:57:37.805 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../078-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2023-10-06T02:57:37.843 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-10-06T02:57:38.204 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-oauthlib. 2023-10-06T02:57:38.224 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../079-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2023-10-06T02:57:38.262 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2023-10-06T02:57:38.284 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-cachetools. 2023-10-06T02:57:38.304 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../073-python3-cachetools_4.0.0-1_all.deb ... 2023-10-06T02:57:38.367 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2023-10-06T02:57:38.649 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-10-06T02:57:38.670 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../080-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2023-10-06T02:57:38.715 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-10-06T02:57:38.745 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-pyasn1. 2023-10-06T02:57:38.764 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../074-python3-pyasn1_0.4.2-3build1_all.deb ... 2023-10-06T02:57:38.800 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2023-10-06T02:57:39.180 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-10-06T02:57:39.187 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-websocket. 2023-10-06T02:57:39.200 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../075-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2023-10-06T02:57:39.206 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../081-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2023-10-06T02:57:39.238 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-10-06T02:57:39.244 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2023-10-06T02:57:39.590 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-kubernetes. 2023-10-06T02:57:39.608 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../082-python3-kubernetes_7.0.0~a1-2_all.deb ... 2023-10-06T02:57:39.632 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-rsa. 2023-10-06T02:57:39.648 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2023-10-06T02:57:39.651 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../076-python3-rsa_4.0-3_all.deb ... 2023-10-06T02:57:39.690 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-rsa (4.0-3) ... 2023-10-06T02:57:40.110 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-google-auth. 2023-10-06T02:57:40.129 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../077-python3-google-auth_1.5.1-2_all.deb ... 2023-10-06T02:57:40.168 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2023-10-06T02:57:40.316 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-10-06T02:57:40.334 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../083-ceph-mgr-k8sevents_17.2.6-1296-g736ac5ba-1focal_all.deb ... 2023-10-06T02:57:40.379 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-mgr-k8sevents (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:40.532 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-blinker. 2023-10-06T02:57:40.552 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../078-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2023-10-06T02:57:40.623 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-10-06T02:57:40.762 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libonig5:amd64. 2023-10-06T02:57:40.780 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../084-libonig5_6.9.4-1_amd64.deb ... 2023-10-06T02:57:40.819 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2023-10-06T02:57:40.960 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-oauthlib. 2023-10-06T02:57:40.980 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../079-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2023-10-06T02:57:41.017 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2023-10-06T02:57:41.188 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libjq1:amd64. 2023-10-06T02:57:41.208 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../085-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-10-06T02:57:41.245 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-10-06T02:57:41.397 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-10-06T02:57:41.416 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../080-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2023-10-06T02:57:41.454 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-10-06T02:57:41.582 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package jq. 2023-10-06T02:57:41.602 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../086-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-10-06T02:57:41.640 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2023-10-06T02:57:41.934 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package socat. 2023-10-06T02:57:41.935 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-websocket. 2023-10-06T02:57:41.953 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../081-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2023-10-06T02:57:41.954 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../087-socat_1.7.3.3-2_amd64.deb ... 2023-10-06T02:57:41.992 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking socat (1.7.3.3-2) ... 2023-10-06T02:57:41.992 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2023-10-06T02:57:42.346 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package xmlstarlet. 2023-10-06T02:57:42.359 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-kubernetes. 2023-10-06T02:57:42.365 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../088-xmlstarlet_1.6.1-2build1_amd64.deb ... 2023-10-06T02:57:42.371 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../082-python3-kubernetes_7.0.0~a1-2_all.deb ... 2023-10-06T02:57:42.403 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2023-10-06T02:57:42.450 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2023-10-06T02:57:42.800 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-test. 2023-10-06T02:57:42.820 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../089-ceph-test_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:57:42.857 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-test (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:43.147 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-10-06T02:57:43.166 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../083-ceph-mgr-k8sevents_17.2.6-1296-g736ac5ba-1focal_all.deb ... 2023-10-06T02:57:43.221 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking ceph-mgr-k8sevents (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:43.600 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package libonig5:amd64. 2023-10-06T02:57:43.619 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../084-libonig5_6.9.4-1_amd64.deb ... 2023-10-06T02:57:43.657 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2023-10-06T02:57:44.061 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package libjq1:amd64. 2023-10-06T02:57:44.080 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../085-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-10-06T02:57:44.118 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-10-06T02:57:44.430 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package jq. 2023-10-06T02:57:44.448 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../086-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-10-06T02:57:44.488 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2023-10-06T02:57:44.783 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package socat. 2023-10-06T02:57:44.802 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../087-socat_1.7.3.3-2_amd64.deb ... 2023-10-06T02:57:44.841 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking socat (1.7.3.3-2) ... 2023-10-06T02:57:45.237 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package xmlstarlet. 2023-10-06T02:57:45.256 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../088-xmlstarlet_1.6.1-2build1_amd64.deb ... 2023-10-06T02:57:45.294 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2023-10-06T02:57:45.741 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package ceph-test. 2023-10-06T02:57:45.760 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../089-ceph-test_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:57:45.798 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking ceph-test (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:47.595 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-volume. 2023-10-06T02:57:47.613 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../090-ceph-volume_17.2.6-1296-g736ac5ba-1focal_all.deb ... 2023-10-06T02:57:47.653 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-volume (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:48.101 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package cephfs-mirror. 2023-10-06T02:57:48.119 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../091-cephfs-mirror_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:57:48.157 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking cephfs-mirror (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:48.561 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-colorama. 2023-10-06T02:57:48.581 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../092-python3-colorama_0.4.3-1build1_all.deb ... 2023-10-06T02:57:48.618 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2023-10-06T02:57:48.905 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package cephfs-shell. 2023-10-06T02:57:48.926 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../093-cephfs-shell_17.2.6-1296-g736ac5ba-1focal_all.deb ... 2023-10-06T02:57:48.971 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking cephfs-shell (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:49.282 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package cephfs-top. 2023-10-06T02:57:49.302 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../094-cephfs-top_17.2.6-1296-g736ac5ba-1focal_all.deb ... 2023-10-06T02:57:49.339 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking cephfs-top (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:49.634 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package fonts-mathjax. 2023-10-06T02:57:49.654 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../095-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2023-10-06T02:57:49.700 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2023-10-06T02:57:50.229 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libcephfs-dev. 2023-10-06T02:57:50.248 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../096-libcephfs-dev_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:57:50.286 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libcephfs-dev (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:50.461 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package ceph-volume. 2023-10-06T02:57:50.480 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../090-ceph-volume_17.2.6-1296-g736ac5ba-1focal_all.deb ... 2023-10-06T02:57:50.563 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking ceph-volume (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:50.690 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package nvme-cli. 2023-10-06T02:57:50.710 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../097-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2023-10-06T02:57:50.780 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2023-10-06T02:57:51.033 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package cephfs-mirror. 2023-10-06T02:57:51.052 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../091-cephfs-mirror_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:57:51.090 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking cephfs-mirror (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:51.169 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libjs-mathjax. 2023-10-06T02:57:51.189 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../098-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2023-10-06T02:57:51.227 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2023-10-06T02:57:51.469 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-colorama. 2023-10-06T02:57:51.488 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../092-python3-colorama_0.4.3-1build1_all.deb ... 2023-10-06T02:57:51.526 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2023-10-06T02:57:51.863 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package cephfs-shell. 2023-10-06T02:57:51.881 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../093-cephfs-shell_17.2.6-1296-g736ac5ba-1focal_all.deb ... 2023-10-06T02:57:51.920 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking cephfs-shell (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:52.232 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package cephfs-top. 2023-10-06T02:57:52.251 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../094-cephfs-top_17.2.6-1296-g736ac5ba-1focal_all.deb ... 2023-10-06T02:57:52.290 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking cephfs-top (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:52.601 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package fonts-mathjax. 2023-10-06T02:57:52.620 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../095-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2023-10-06T02:57:52.659 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2023-10-06T02:57:53.238 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package libcephfs-dev. 2023-10-06T02:57:53.257 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../096-libcephfs-dev_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:57:53.295 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libcephfs-dev (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:57:53.382 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python-natsort-doc. 2023-10-06T02:57:53.403 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../099-python-natsort-doc_7.0.1-1_all.deb ... 2023-10-06T02:57:53.440 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2023-10-06T02:57:53.734 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package nvme-cli. 2023-10-06T02:57:53.753 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../097-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2023-10-06T02:57:53.826 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-atomicwrites. 2023-10-06T02:57:53.830 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2023-10-06T02:57:53.840 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../100-python3-atomicwrites_1.1.5-2build1_all.deb ... 2023-10-06T02:57:53.884 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2023-10-06T02:57:54.204 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-attr. 2023-10-06T02:57:54.213 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package libjs-mathjax. 2023-10-06T02:57:54.225 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../101-python3-attr_19.3.0-2_all.deb ... 2023-10-06T02:57:54.232 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../098-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2023-10-06T02:57:54.270 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-attr (19.3.0-2) ... 2023-10-06T02:57:54.271 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2023-10-06T02:57:54.657 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-webencodings. 2023-10-06T02:57:54.677 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../102-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2023-10-06T02:57:54.715 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2023-10-06T02:57:55.034 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-html5lib. 2023-10-06T02:57:55.054 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../103-python3-html5lib_1.0.1-2_all.deb ... 2023-10-06T02:57:55.092 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2023-10-06T02:57:55.496 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-lxml:amd64. 2023-10-06T02:57:55.517 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../104-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2023-10-06T02:57:55.561 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-10-06T02:57:56.077 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-packaging. 2023-10-06T02:57:56.097 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../105-python3-packaging_20.3-1_all.deb ... 2023-10-06T02:57:56.134 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-packaging (20.3-1) ... 2023-10-06T02:57:56.322 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python-natsort-doc. 2023-10-06T02:57:56.343 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../099-python-natsort-doc_7.0.1-1_all.deb ... 2023-10-06T02:57:56.388 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2023-10-06T02:57:56.513 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-pastescript. 2023-10-06T02:57:56.533 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2023-10-06T02:57:56.571 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-10-06T02:57:56.767 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-atomicwrites. 2023-10-06T02:57:56.787 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../100-python3-atomicwrites_1.1.5-2build1_all.deb ... 2023-10-06T02:57:56.824 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2023-10-06T02:57:56.941 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-pluggy. 2023-10-06T02:57:56.961 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-2_all.deb ... 2023-10-06T02:57:56.998 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2023-10-06T02:57:57.194 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-attr. 2023-10-06T02:57:57.214 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../101-python3-attr_19.3.0-2_all.deb ... 2023-10-06T02:57:57.253 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-attr (19.3.0-2) ... 2023-10-06T02:57:57.379 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-psutil. 2023-10-06T02:57:57.398 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../108-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2023-10-06T02:57:57.436 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2023-10-06T02:57:57.647 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-webencodings. 2023-10-06T02:57:57.667 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../102-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2023-10-06T02:57:57.705 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2023-10-06T02:57:57.806 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-py. 2023-10-06T02:57:57.827 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../109-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2023-10-06T02:57:57.864 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2023-10-06T02:57:58.104 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-html5lib. 2023-10-06T02:57:58.124 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../103-python3-html5lib_1.0.1-2_all.deb ... 2023-10-06T02:57:58.161 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2023-10-06T02:57:58.267 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-pyinotify. 2023-10-06T02:57:58.288 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../110-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2023-10-06T02:57:58.333 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-10-06T02:57:58.531 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-lxml:amd64. 2023-10-06T02:57:58.545 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../104-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2023-10-06T02:57:58.598 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-10-06T02:57:58.653 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-pytest. 2023-10-06T02:57:58.673 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../111-python3-pytest_4.6.9-1_all.deb ... 2023-10-06T02:57:58.702 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-pytest (4.6.9-1) ... 2023-10-06T02:57:59.114 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-simplejson. 2023-10-06T02:57:59.127 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-packaging. 2023-10-06T02:57:59.135 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../112-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2023-10-06T02:57:59.147 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../105-python3-packaging_20.3-1_all.deb ... 2023-10-06T02:57:59.180 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2023-10-06T02:57:59.217 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-packaging (20.3-1) ... 2023-10-06T02:57:59.483 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-10-06T02:57:59.504 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../113-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2023-10-06T02:57:59.549 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-10-06T02:57:59.598 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-pastescript. 2023-10-06T02:57:59.618 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2023-10-06T02:57:59.655 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-10-06T02:58:00.051 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-pluggy. 2023-10-06T02:58:00.071 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-2_all.deb ... 2023-10-06T02:58:00.117 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2023-10-06T02:58:00.337 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package radosgw. 2023-10-06T02:58:00.358 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../114-radosgw_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:58:00.411 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking radosgw (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:00.479 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-psutil. 2023-10-06T02:58:00.497 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../108-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2023-10-06T02:58:00.537 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2023-10-06T02:58:00.932 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-py. 2023-10-06T02:58:00.951 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../109-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2023-10-06T02:58:00.989 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2023-10-06T02:58:01.468 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-pyinotify. 2023-10-06T02:58:01.489 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../110-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2023-10-06T02:58:01.542 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-10-06T02:58:01.904 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-pytest. 2023-10-06T02:58:01.925 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../111-python3-pytest_4.6.9-1_all.deb ... 2023-10-06T02:58:01.970 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-pytest (4.6.9-1) ... 2023-10-06T02:58:02.073 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package rbd-fuse. 2023-10-06T02:58:02.093 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../115-rbd-fuse_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:58:02.130 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking rbd-fuse (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:02.374 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-simplejson. 2023-10-06T02:58:02.393 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../112-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2023-10-06T02:58:02.431 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2023-10-06T02:58:02.515 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-attr (19.3.0-2) ... 2023-10-06T02:58:02.776 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-10-06T02:58:02.797 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../113-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2023-10-06T02:58:02.851 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-10-06T02:58:02.987 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2023-10-06T02:58:03.113 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-10-06T02:58:03.265 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2023-10-06T02:58:03.508 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up cephadm (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:03.630 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package radosgw. 2023-10-06T02:58:03.650 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../114-radosgw_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:58:03.730 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking radosgw (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:04.243 INFO:teuthology.orchestra.run.smithi057.stdout:Adding system user cephadm....done 2023-10-06T02:58:04.433 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2023-10-06T02:58:04.560 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2023-10-06T02:58:05.003 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-10-06T02:58:05.337 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2023-10-06T02:58:05.386 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package rbd-fuse. 2023-10-06T02:58:05.400 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../115-rbd-fuse_17.2.6-1296-g736ac5ba-1focal_amd64.deb ... 2023-10-06T02:58:05.443 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking rbd-fuse (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:05.463 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up liboath0 (2.6.1-1.3) ... 2023-10-06T02:58:05.589 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2023-10-06T02:58:05.824 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-attr (19.3.0-2) ... 2023-10-06T02:58:06.208 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2023-10-06T02:58:06.292 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-joblib (0.14.0-3) ... 2023-10-06T02:58:06.367 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-10-06T02:58:06.778 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2023-10-06T02:58:06.826 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2023-10-06T02:58:07.056 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up cephadm (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:07.137 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-cachetools (4.0.0-1) ... 2023-10-06T02:58:07.505 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2023-10-06T02:58:07.807 INFO:teuthology.orchestra.run.smithi105.stdout:Adding system user cephadm....done 2023-10-06T02:58:07.856 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2023-10-06T02:58:08.029 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2023-10-06T02:58:08.156 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2023-10-06T02:58:08.207 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-10-06T02:58:08.566 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-ceph-argparse (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:08.642 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-10-06T02:58:08.934 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-10-06T02:58:09.004 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2023-10-06T02:58:09.060 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2023-10-06T02:58:09.130 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up liboath0 (2.6.1-1.3) ... 2023-10-06T02:58:09.272 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2023-10-06T02:58:09.411 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2023-10-06T02:58:09.699 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-joblib (0.14.0-3) ... 2023-10-06T02:58:09.754 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2023-10-06T02:58:10.096 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-10-06T02:58:10.222 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2023-10-06T02:58:10.226 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2023-10-06T02:58:10.577 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-cachetools (4.0.0-1) ... 2023-10-06T02:58:10.690 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-natsort (7.0.1-1) ... 2023-10-06T02:58:10.929 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2023-10-06T02:58:11.049 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2023-10-06T02:58:11.280 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2023-10-06T02:58:11.408 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2023-10-06T02:58:11.647 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-10-06T02:58:11.834 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2023-10-06T02:58:12.032 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-ceph-argparse (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:12.169 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2023-10-06T02:58:12.408 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-10-06T02:58:12.533 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2023-10-06T02:58:12.578 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-tempita (0.5.2-6) ... 2023-10-06T02:58:12.885 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2023-10-06T02:58:12.963 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-packaging (20.3-1) ... 2023-10-06T02:58:13.228 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2023-10-06T02:58:13.330 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2023-10-06T02:58:13.456 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-10-06T02:58:13.579 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-10-06T02:58:13.607 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2023-10-06T02:58:13.705 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2023-10-06T02:58:13.967 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2023-10-06T02:58:14.156 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-natsort (7.0.1-1) ... 2023-10-06T02:58:14.460 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2023-10-06T02:58:14.516 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2023-10-06T02:58:14.813 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-10-06T02:58:14.858 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2023-10-06T02:58:15.259 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2023-10-06T02:58:15.273 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2023-10-06T02:58:15.644 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2023-10-06T02:58:15.733 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up socat (1.7.3.3-2) ... 2023-10-06T02:58:15.859 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-ceph-common (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:16.112 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-tempita (0.5.2-6) ... 2023-10-06T02:58:16.261 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-06T02:58:16.403 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-html5lib (1.0.1-2) ... 2023-10-06T02:58:16.488 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-packaging (20.3-1) ... 2023-10-06T02:58:16.830 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-10-06T02:58:16.847 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2023-10-06T02:58:16.981 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-10-06T02:58:16.989 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2023-10-06T02:58:17.107 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2023-10-06T02:58:17.115 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-pluggy (0.13.0-2) ... 2023-10-06T02:58:17.466 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-10-06T02:58:17.475 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2023-10-06T02:58:17.876 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-06T02:58:17.977 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2023-10-06T02:58:17.994 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-10-06T02:58:18.120 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2023-10-06T02:58:18.354 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-10-06T02:58:18.522 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2023-10-06T02:58:18.796 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2023-10-06T02:58:18.873 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-logutils (0.3.3-7) ... 2023-10-06T02:58:19.231 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up socat (1.7.3.3-2) ... 2023-10-06T02:58:19.232 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2023-10-06T02:58:19.357 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-ceph-common (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:19.358 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-10-06T02:58:19.709 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-prettytable (0.7.2-5) ... 2023-10-06T02:58:19.817 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-06T02:58:19.959 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-html5lib (1.0.1-2) ... 2023-10-06T02:58:20.077 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2023-10-06T02:58:20.386 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-10-06T02:58:20.462 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2023-10-06T02:58:20.537 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2023-10-06T02:58:20.663 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-pluggy (0.13.0-2) ... 2023-10-06T02:58:20.834 INFO:teuthology.orchestra.run.smithi057.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2023-10-06T02:58:21.014 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-10-06T02:58:21.148 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2023-10-06T02:58:21.307 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-10-06T02:58:21.407 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-06T02:58:21.533 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-10-06T02:58:21.683 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2023-10-06T02:58:21.692 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2023-10-06T02:58:22.085 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2023-10-06T02:58:22.174 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-10-06T02:58:22.311 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-10-06T02:58:22.428 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-logutils (0.3.3-7) ... 2023-10-06T02:58:22.437 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-webob (1:1.8.5-2) ... 2023-10-06T02:58:22.779 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2023-10-06T02:58:22.838 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-10-06T02:58:22.905 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-10-06T02:58:23.190 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up librados2 (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:23.248 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-prettytable (0.7.2-5) ... 2023-10-06T02:58:23.315 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2023-10-06T02:58:23.599 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2023-10-06T02:58:23.967 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2023-10-06T02:58:24.335 INFO:teuthology.orchestra.run.smithi105.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2023-10-06T02:58:24.653 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2023-10-06T02:58:24.779 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-10-06T02:58:25.147 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libsqlite3-mod-ceph (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:25.155 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2023-10-06T02:58:25.273 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-10-06T02:58:25.399 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-pytest (4.6.9-1) ... 2023-10-06T02:58:25.656 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-10-06T02:58:25.782 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-10-06T02:58:25.859 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2023-10-06T02:58:25.908 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-webob (1:1.8.5-2) ... 2023-10-06T02:58:26.243 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2023-10-06T02:58:26.358 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-10-06T02:58:26.595 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-06T02:58:26.702 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up librados2 (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:26.724 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-bs4 (4.8.2-1) ... 2023-10-06T02:58:26.862 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2023-10-06T02:58:27.133 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libcephfs2 (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:27.259 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2023-10-06T02:58:27.681 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libradosstriper1 (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:27.813 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-10-06T02:58:28.231 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-10-06T02:58:28.678 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libsqlite3-mod-ceph (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:28.804 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-10-06T02:58:28.930 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-pytest (4.6.9-1) ... 2023-10-06T02:58:29.423 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2023-10-06T02:58:29.511 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up librbd1 (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:29.637 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-10-06T02:58:29.764 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2023-10-06T02:58:29.808 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2023-10-06T02:58:29.892 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2023-10-06T02:58:30.043 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-rsa (4.0-3) ... 2023-10-06T02:58:30.193 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-06T02:58:30.318 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-bs4 (4.8.2-1) ... 2023-10-06T02:58:30.403 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2023-10-06T02:58:30.520 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-webtest (2.0.32-2) ... 2023-10-06T02:58:30.720 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libcephfs2 (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:30.845 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2023-10-06T02:58:30.982 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-mgr-modules-core (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:31.108 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-fuse (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:31.320 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libradosstriper1 (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:31.365 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-10-06T02:58:31.365 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-10-06T02:58:31.448 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-10-06T02:58:31.858 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-10-06T02:58:32.235 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libcephfs-dev (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:32.361 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-10-06T02:58:32.698 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-10-06T02:58:33.083 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2023-10-06T02:58:33.116 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up librbd1 (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:33.241 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-10-06T02:58:33.367 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2023-10-06T02:58:33.518 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2023-10-06T02:58:33.535 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-rados (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:33.653 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-rsa (4.0-3) ... 2023-10-06T02:58:33.661 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up librgw2 (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:33.787 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up cephfs-top (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:33.922 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-rbd (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:34.004 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2023-10-06T02:58:34.048 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up rbd-fuse (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:34.130 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-webtest (2.0.32-2) ... 2023-10-06T02:58:34.174 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-routes (2.4.1-2) ... 2023-10-06T02:58:34.559 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-google-auth (1.5.1-2) ... 2023-10-06T02:58:34.626 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up ceph-mgr-modules-core (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:34.744 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up ceph-fuse (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:34.928 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-rgw (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:35.001 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-10-06T02:58:35.001 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-10-06T02:58:35.053 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-cephfs (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:35.204 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up cephfs-shell (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:35.330 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2023-10-06T02:58:35.804 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libcephfs-dev (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:35.930 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-10-06T02:58:36.273 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-10-06T02:58:36.500 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-common (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:36.649 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2023-10-06T02:58:37.093 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-rados (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:37.261 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up librgw2 (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:37.413 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up cephfs-top (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:37.442 INFO:teuthology.orchestra.run.smithi057.stdout:Adding group ceph....done 2023-10-06T02:58:37.847 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-rbd (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:37.918 INFO:teuthology.orchestra.run.smithi057.stdout:Adding system user ceph....done 2023-10-06T02:58:38.006 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up rbd-fuse (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:38.132 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-routes (2.4.1-2) ... 2023-10-06T02:58:38.145 INFO:teuthology.orchestra.run.smithi057.stdout:Setting system user ceph properties....done 2023-10-06T02:58:38.187 INFO:teuthology.orchestra.run.smithi057.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-10-06T02:58:38.391 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-10-06T02:58:38.483 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-google-auth (1.5.1-2) ... 2023-10-06T02:58:38.835 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-rgw (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:38.960 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-cephfs (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:38.963 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-10-06T02:58:39.120 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up cephfs-shell (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:39.246 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2023-10-06T02:58:39.928 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up cephfs-mirror (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:40.199 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-10-06T02:58:40.199 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-10-06T02:58:40.366 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up ceph-common (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:41.005 INFO:teuthology.orchestra.run.smithi105.stdout:Adding group ceph....done 2023-10-06T02:58:41.063 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-test (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:41.189 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up radosgw (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:41.474 INFO:teuthology.orchestra.run.smithi105.stdout:Adding system user ceph....done 2023-10-06T02:58:41.506 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-10-06T02:58:41.506 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-10-06T02:58:41.717 INFO:teuthology.orchestra.run.smithi105.stdout:Setting system user ceph properties....done 2023-10-06T02:58:41.756 INFO:teuthology.orchestra.run.smithi105.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-10-06T02:58:41.952 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-10-06T02:58:42.521 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-10-06T02:58:42.808 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-base (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:43.310 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-10-06T02:58:43.476 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up cephfs-mirror (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:43.732 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-10-06T02:58:43.732 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-10-06T02:58:44.210 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-mds (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:44.490 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-10-06T02:58:44.490 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-10-06T02:58:44.552 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up ceph-test (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:44.678 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up radosgw (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:44.993 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-10-06T02:58:44.993 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-10-06T02:58:45.378 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-mgr (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:45.652 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-10-06T02:58:45.652 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-10-06T02:58:46.230 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up ceph-base (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:46.513 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-osd (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:46.738 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-10-06T02:58:47.338 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-10-06T02:58:47.338 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-10-06T02:58:47.623 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up ceph-mds (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:47.917 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-10-06T02:58:47.918 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-10-06T02:58:48.282 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-mgr-k8sevents (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:48.416 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-mgr-diskprediction-local (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:48.567 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-mon (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:48.785 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up ceph-mgr (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:48.827 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-10-06T02:58:48.827 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-10-06T02:58:49.054 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-10-06T02:58:49.054 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-10-06T02:58:49.685 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-mgr-cephadm (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:49.861 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:49.868 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up ceph-osd (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:50.004 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-mgr-dashboard (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:50.146 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-volume (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:50.273 INFO:teuthology.orchestra.run.smithi057.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-10-06T02:58:50.425 INFO:teuthology.orchestra.run.smithi057.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-10-06T02:58:50.707 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-10-06T02:58:50.707 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-10-06T02:58:50.928 INFO:teuthology.orchestra.run.smithi057.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-10-06T02:58:51.553 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up ceph-mgr-k8sevents (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:51.679 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up ceph-mgr-diskprediction-local (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:51.874 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up ceph-mon (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:52.138 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-10-06T02:58:52.138 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-10-06T02:58:53.049 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up ceph-mgr-cephadm (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:53.200 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up ceph (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:53.326 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up ceph-mgr-dashboard (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:53.510 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up ceph-volume (17.2.6-1296-g736ac5ba-1focal) ... 2023-10-06T02:58:53.637 INFO:teuthology.orchestra.run.smithi105.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-10-06T02:58:53.822 INFO:teuthology.orchestra.run.smithi105.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-10-06T02:58:54.298 INFO:teuthology.orchestra.run.smithi105.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-10-06T02:58:56.163 INFO:teuthology.orchestra.run.smithi057.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2023-10-06T02:58:56.943 INFO:teuthology.orchestra.run.smithi057.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-10-06T02:58:56.949 DEBUG:teuthology.orchestra.run.smithi057:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev 2023-10-06T02:58:57.073 INFO:teuthology.orchestra.run.smithi057.stdout:Reading package lists... 2023-10-06T02:58:57.280 INFO:teuthology.orchestra.run.smithi057.stdout:Building dependency tree... 2023-10-06T02:58:57.281 INFO:teuthology.orchestra.run.smithi057.stdout:Reading state information... 2023-10-06T02:58:57.495 INFO:teuthology.orchestra.run.smithi057.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2023-10-06T02:58:57.495 INFO:teuthology.orchestra.run.smithi057.stdout:flex is already the newest version (2.6.4-6.2). 2023-10-06T02:58:57.495 INFO:teuthology.orchestra.run.smithi057.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2023-10-06T02:58:57.495 INFO:teuthology.orchestra.run.smithi057.stdout:libtool-bin is already the newest version (2.4.6-14). 2023-10-06T02:58:57.495 INFO:teuthology.orchestra.run.smithi057.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2023-10-06T02:58:57.495 INFO:teuthology.orchestra.run.smithi057.stdout:The following packages were automatically installed and are no longer required: 2023-10-06T02:58:57.496 INFO:teuthology.orchestra.run.smithi057.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-10-06T02:58:57.496 INFO:teuthology.orchestra.run.smithi057.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-06T02:58:57.496 INFO:teuthology.orchestra.run.smithi057.stdout:The following additional packages will be installed: 2023-10-06T02:58:57.497 INFO:teuthology.orchestra.run.smithi057.stdout: libbluetooth3 libdw1 libelf1 liblzo2-2 libmbim-glib4 libmbim-proxy 2023-10-06T02:58:57.497 INFO:teuthology.orchestra.run.smithi057.stdout: libmm-glib0 libndp0 libnm0 libqmi-glib5 libqmi-proxy libssl1.1 libteamdctl0 2023-10-06T02:58:57.497 INFO:teuthology.orchestra.run.smithi057.stdout: libuuid1 modemmanager network-manager-pptp ppp pptp-linux usb-modeswitch 2023-10-06T02:58:57.497 INFO:teuthology.orchestra.run.smithi057.stdout: usb-modeswitch-data wpasupplicant 2023-10-06T02:58:57.498 INFO:teuthology.orchestra.run.smithi057.stdout:Suggested packages: 2023-10-06T02:58:57.498 INFO:teuthology.orchestra.run.smithi057.stdout: indent-doc libssl-doc avahi-autoipd libteam-utils comgt wvdial 2023-10-06T02:58:57.498 INFO:teuthology.orchestra.run.smithi057.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2023-10-06T02:58:57.586 INFO:teuthology.orchestra.run.smithi057.stdout:The following NEW packages will be installed: 2023-10-06T02:58:57.586 INFO:teuthology.orchestra.run.smithi057.stdout: dump indent libaio-dev libbluetooth3 libelf-dev liblzo2-2 libmbim-glib4 2023-10-06T02:58:57.586 INFO:teuthology.orchestra.run.smithi057.stdout: libmbim-proxy libmm-glib0 libndp0 libnm0 libqmi-glib5 libqmi-proxy 2023-10-06T02:58:57.587 INFO:teuthology.orchestra.run.smithi057.stdout: libssl-dev libteamdctl0 modemmanager network-manager network-manager-pptp 2023-10-06T02:58:57.587 INFO:teuthology.orchestra.run.smithi057.stdout: ppp pptp-linux usb-modeswitch usb-modeswitch-data wpasupplicant 2023-10-06T02:58:57.587 INFO:teuthology.orchestra.run.smithi057.stdout:The following packages will be upgraded: 2023-10-06T02:58:57.588 INFO:teuthology.orchestra.run.smithi057.stdout: libdw1 libelf1 libssl1.1 libuuid1 util-linux uuid-dev 2023-10-06T02:58:57.680 INFO:teuthology.orchestra.run.smithi057.stdout:6 upgraded, 23 newly installed, 0 to remove and 250 not upgraded. 2023-10-06T02:58:57.680 INFO:teuthology.orchestra.run.smithi057.stdout:Need to get 10.4 MB of archives. 2023-10-06T02:58:57.680 INFO:teuthology.orchestra.run.smithi057.stdout:After this operation, 33.5 MB of additional disk space will be used. 2023-10-06T02:58:57.680 INFO:teuthology.orchestra.run.smithi057.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 util-linux amd64 2.34-0.1ubuntu9.4 [1,021 kB] 2023-10-06T02:58:57.810 INFO:teuthology.orchestra.run.smithi057.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.4 [33.6 kB] 2023-10-06T02:58:57.812 INFO:teuthology.orchestra.run.smithi057.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.4 [20.0 kB] 2023-10-06T02:58:57.813 INFO:teuthology.orchestra.run.smithi057.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libdw1 amd64 0.176-1.1ubuntu0.1 [226 kB] 2023-10-06T02:58:57.820 INFO:teuthology.orchestra.run.smithi057.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf1 amd64 0.176-1.1ubuntu0.1 [44.2 kB] 2023-10-06T02:58:57.821 INFO:teuthology.orchestra.run.smithi057.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.19 [1,321 kB] 2023-10-06T02:58:57.837 INFO:teuthology.orchestra.run.smithi057.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2023-10-06T02:58:57.837 INFO:teuthology.orchestra.run.smithi057.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2023-10-06T02:58:57.839 INFO:teuthology.orchestra.run.smithi057.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 indent amd64 2.2.12-1ubuntu0.20.04.1 [86.6 kB] 2023-10-06T02:58:57.841 INFO:teuthology.orchestra.run.smithi057.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2023-10-06T02:58:57.841 INFO:teuthology.orchestra.run.smithi057.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libbluetooth3 amd64 5.53-0ubuntu3.6 [60.6 kB] 2023-10-06T02:58:57.844 INFO:teuthology.orchestra.run.smithi057.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf-dev amd64 0.176-1.1ubuntu0.1 [57.1 kB] 2023-10-06T02:58:57.845 INFO:teuthology.orchestra.run.smithi057.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-glib4 amd64 1.26.2-1~ubuntu20.04.1 [123 kB] 2023-10-06T02:58:57.846 INFO:teuthology.orchestra.run.smithi057.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-proxy amd64 1.26.2-1~ubuntu20.04.1 [6,012 B] 2023-10-06T02:58:57.847 INFO:teuthology.orchestra.run.smithi057.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmm-glib0 amd64 1.18.6-1~ubuntu20.04.1 [203 kB] 2023-10-06T02:58:57.861 INFO:teuthology.orchestra.run.smithi057.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 libndp0 amd64 1.7-0ubuntu1 [10.9 kB] 2023-10-06T02:58:57.862 INFO:teuthology.orchestra.run.smithi057.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libnm0 amd64 1.22.10-1ubuntu2.3 [370 kB] 2023-10-06T02:58:57.873 INFO:teuthology.orchestra.run.smithi057.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-glib5 amd64 1.30.4-1~ubuntu20.04.1 [642 kB] 2023-10-06T02:58:57.882 INFO:teuthology.orchestra.run.smithi057.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-proxy amd64 1.30.4-1~ubuntu20.04.1 [5,908 B] 2023-10-06T02:58:57.882 INFO:teuthology.orchestra.run.smithi057.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.19 [1,584 kB] 2023-10-06T02:58:57.901 INFO:teuthology.orchestra.run.smithi057.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 libteamdctl0 amd64 1.30-1 [11.8 kB] 2023-10-06T02:58:57.901 INFO:teuthology.orchestra.run.smithi057.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 modemmanager amd64 1.18.6-1~ubuntu20.04.1 [895 kB] 2023-10-06T02:58:57.911 INFO:teuthology.orchestra.run.smithi057.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 wpasupplicant amd64 2:2.9-1ubuntu4.3 [1,183 kB] 2023-10-06T02:58:57.925 INFO:teuthology.orchestra.run.smithi057.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 network-manager amd64 1.22.10-1ubuntu2.3 [1,855 kB] 2023-10-06T02:58:57.944 INFO:teuthology.orchestra.run.smithi057.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 ppp amd64 2.4.7-2+4.1ubuntu5.1 [328 kB] 2023-10-06T02:58:57.947 INFO:teuthology.orchestra.run.smithi057.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 pptp-linux amd64 1.10.0-1build1 [42.0 kB] 2023-10-06T02:58:57.948 INFO:teuthology.orchestra.run.smithi057.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 network-manager-pptp amd64 1.2.8-2 [30.1 kB] 2023-10-06T02:58:57.948 INFO:teuthology.orchestra.run.smithi057.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch-data all 20191128-3 [32.3 kB] 2023-10-06T02:58:57.949 INFO:teuthology.orchestra.run.smithi057.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch amd64 2.5.2+repack0-2ubuntu3 [53.1 kB] 2023-10-06T02:58:58.376 INFO:teuthology.orchestra.run.smithi057.stdout:Preconfiguring packages ... 2023-10-06T02:58:58.563 INFO:teuthology.orchestra.run.smithi057.stdout:Fetched 10.4 MB in 0s (29.6 MB/s) 2023-10-06T02:58:58.884 INFO:teuthology.orchestra.run.smithi057.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 118690 files and directories currently installed.) 2023-10-06T02:58:58.888 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../util-linux_2.34-0.1ubuntu9.4_amd64.deb ... 2023-10-06T02:58:59.061 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking util-linux (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-10-06T02:58:59.234 INFO:teuthology.orchestra.run.smithi105.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2023-10-06T02:59:00.025 INFO:teuthology.orchestra.run.smithi105.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-10-06T02:59:00.030 DEBUG:teuthology.orchestra.run.smithi105:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev 2023-10-06T02:59:00.152 INFO:teuthology.orchestra.run.smithi105.stdout:Reading package lists... 2023-10-06T02:59:00.360 INFO:teuthology.orchestra.run.smithi105.stdout:Building dependency tree... 2023-10-06T02:59:00.361 INFO:teuthology.orchestra.run.smithi105.stdout:Reading state information... 2023-10-06T02:59:00.563 INFO:teuthology.orchestra.run.smithi105.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2023-10-06T02:59:00.563 INFO:teuthology.orchestra.run.smithi105.stdout:flex is already the newest version (2.6.4-6.2). 2023-10-06T02:59:00.563 INFO:teuthology.orchestra.run.smithi105.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2023-10-06T02:59:00.563 INFO:teuthology.orchestra.run.smithi105.stdout:libtool-bin is already the newest version (2.4.6-14). 2023-10-06T02:59:00.563 INFO:teuthology.orchestra.run.smithi105.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2023-10-06T02:59:00.564 INFO:teuthology.orchestra.run.smithi105.stdout:The following packages were automatically installed and are no longer required: 2023-10-06T02:59:00.564 INFO:teuthology.orchestra.run.smithi105.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-10-06T02:59:00.564 INFO:teuthology.orchestra.run.smithi105.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-06T02:59:00.564 INFO:teuthology.orchestra.run.smithi105.stdout:The following additional packages will be installed: 2023-10-06T02:59:00.564 INFO:teuthology.orchestra.run.smithi105.stdout: libbluetooth3 libdw1 libelf1 liblzo2-2 libmbim-glib4 libmbim-proxy 2023-10-06T02:59:00.565 INFO:teuthology.orchestra.run.smithi105.stdout: libmm-glib0 libndp0 libnm0 libqmi-glib5 libqmi-proxy libssl1.1 libteamdctl0 2023-10-06T02:59:00.565 INFO:teuthology.orchestra.run.smithi105.stdout: libuuid1 modemmanager network-manager-pptp ppp pptp-linux usb-modeswitch 2023-10-06T02:59:00.565 INFO:teuthology.orchestra.run.smithi105.stdout: usb-modeswitch-data wpasupplicant 2023-10-06T02:59:00.567 INFO:teuthology.orchestra.run.smithi105.stdout:Suggested packages: 2023-10-06T02:59:00.567 INFO:teuthology.orchestra.run.smithi105.stdout: indent-doc libssl-doc avahi-autoipd libteam-utils comgt wvdial 2023-10-06T02:59:00.567 INFO:teuthology.orchestra.run.smithi105.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2023-10-06T02:59:00.650 INFO:teuthology.orchestra.run.smithi105.stdout:The following NEW packages will be installed: 2023-10-06T02:59:00.651 INFO:teuthology.orchestra.run.smithi105.stdout: dump indent libaio-dev libbluetooth3 libelf-dev liblzo2-2 libmbim-glib4 2023-10-06T02:59:00.651 INFO:teuthology.orchestra.run.smithi105.stdout: libmbim-proxy libmm-glib0 libndp0 libnm0 libqmi-glib5 libqmi-proxy 2023-10-06T02:59:00.651 INFO:teuthology.orchestra.run.smithi105.stdout: libssl-dev libteamdctl0 modemmanager network-manager network-manager-pptp 2023-10-06T02:59:00.651 INFO:teuthology.orchestra.run.smithi105.stdout: ppp pptp-linux usb-modeswitch usb-modeswitch-data wpasupplicant 2023-10-06T02:59:00.652 INFO:teuthology.orchestra.run.smithi105.stdout:The following packages will be upgraded: 2023-10-06T02:59:00.653 INFO:teuthology.orchestra.run.smithi105.stdout: libdw1 libelf1 libssl1.1 libuuid1 util-linux uuid-dev 2023-10-06T02:59:00.692 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up util-linux (2.34-0.1ubuntu9.4) ... 2023-10-06T02:59:00.847 INFO:teuthology.orchestra.run.smithi105.stdout:6 upgraded, 23 newly installed, 0 to remove and 250 not upgraded. 2023-10-06T02:59:00.848 INFO:teuthology.orchestra.run.smithi105.stdout:Need to get 10.4 MB of archives. 2023-10-06T02:59:00.848 INFO:teuthology.orchestra.run.smithi105.stdout:After this operation, 33.5 MB of additional disk space will be used. 2023-10-06T02:59:00.848 INFO:teuthology.orchestra.run.smithi105.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 util-linux amd64 2.34-0.1ubuntu9.4 [1,021 kB] 2023-10-06T02:59:01.471 INFO:teuthology.orchestra.run.smithi105.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.4 [33.6 kB] 2023-10-06T02:59:01.473 INFO:teuthology.orchestra.run.smithi105.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.4 [20.0 kB] 2023-10-06T02:59:01.474 INFO:teuthology.orchestra.run.smithi105.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libdw1 amd64 0.176-1.1ubuntu0.1 [226 kB] 2023-10-06T02:59:01.487 INFO:teuthology.orchestra.run.smithi105.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf1 amd64 0.176-1.1ubuntu0.1 [44.2 kB] 2023-10-06T02:59:01.489 INFO:teuthology.orchestra.run.smithi105.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.19 [1,321 kB] 2023-10-06T02:59:01.588 INFO:teuthology.orchestra.run.smithi105.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2023-10-06T02:59:01.590 INFO:teuthology.orchestra.run.smithi105.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2023-10-06T02:59:01.597 INFO:teuthology.orchestra.run.smithi105.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 indent amd64 2.2.12-1ubuntu0.20.04.1 [86.6 kB] 2023-10-06T02:59:01.602 INFO:teuthology.orchestra.run.smithi105.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2023-10-06T02:59:01.603 INFO:teuthology.orchestra.run.smithi105.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libbluetooth3 amd64 5.53-0ubuntu3.6 [60.6 kB] 2023-10-06T02:59:01.770 INFO:teuthology.orchestra.run.smithi105.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf-dev amd64 0.176-1.1ubuntu0.1 [57.1 kB] 2023-10-06T02:59:02.042 INFO:teuthology.orchestra.run.smithi105.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-glib4 amd64 1.26.2-1~ubuntu20.04.1 [123 kB] 2023-10-06T02:59:02.171 INFO:teuthology.orchestra.run.smithi105.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-proxy amd64 1.26.2-1~ubuntu20.04.1 [6,012 B] 2023-10-06T02:59:02.177 INFO:teuthology.orchestra.run.smithi105.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmm-glib0 amd64 1.18.6-1~ubuntu20.04.1 [203 kB] 2023-10-06T02:59:02.272 INFO:teuthology.orchestra.run.smithi105.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 libndp0 amd64 1.7-0ubuntu1 [10.9 kB] 2023-10-06T02:59:02.276 INFO:teuthology.orchestra.run.smithi105.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libnm0 amd64 1.22.10-1ubuntu2.3 [370 kB] 2023-10-06T02:59:02.359 INFO:teuthology.orchestra.run.smithi105.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-glib5 amd64 1.30.4-1~ubuntu20.04.1 [642 kB] 2023-10-06T02:59:02.432 INFO:teuthology.orchestra.run.smithi105.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-proxy amd64 1.30.4-1~ubuntu20.04.1 [5,908 B] 2023-10-06T02:59:02.433 INFO:teuthology.orchestra.run.smithi105.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.19 [1,584 kB] 2023-10-06T02:59:02.523 INFO:teuthology.orchestra.run.smithi105.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 libteamdctl0 amd64 1.30-1 [11.8 kB] 2023-10-06T02:59:02.524 INFO:teuthology.orchestra.run.smithi105.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 modemmanager amd64 1.18.6-1~ubuntu20.04.1 [895 kB] 2023-10-06T02:59:02.717 INFO:teuthology.orchestra.run.smithi105.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 wpasupplicant amd64 2:2.9-1ubuntu4.3 [1,183 kB] 2023-10-06T02:59:02.765 INFO:teuthology.orchestra.run.smithi057.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 118690 files and directories currently installed.) 2023-10-06T02:59:02.769 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.4_amd64.deb ... 2023-10-06T02:59:02.900 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-10-06T02:59:03.357 INFO:teuthology.orchestra.run.smithi105.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 network-manager amd64 1.22.10-1ubuntu2.3 [1,855 kB] 2023-10-06T02:59:03.377 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.4_amd64.deb ... 2023-10-06T02:59:03.471 INFO:teuthology.orchestra.run.smithi105.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 ppp amd64 2.4.7-2+4.1ubuntu5.1 [328 kB] 2023-10-06T02:59:03.486 INFO:teuthology.orchestra.run.smithi105.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 pptp-linux amd64 1.10.0-1build1 [42.0 kB] 2023-10-06T02:59:03.487 INFO:teuthology.orchestra.run.smithi105.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 network-manager-pptp amd64 1.2.8-2 [30.1 kB] 2023-10-06T02:59:03.488 INFO:teuthology.orchestra.run.smithi105.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch-data all 20191128-3 [32.3 kB] 2023-10-06T02:59:03.490 INFO:teuthology.orchestra.run.smithi105.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch amd64 2.5.2+repack0-2ubuntu3 [53.1 kB] 2023-10-06T02:59:03.548 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-10-06T02:59:03.916 INFO:teuthology.orchestra.run.smithi105.stdout:Preconfiguring packages ... 2023-10-06T02:59:03.922 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.4) ... 2023-10-06T02:59:04.095 INFO:teuthology.orchestra.run.smithi105.stdout:Fetched 10.4 MB in 3s (3,687 kB/s) 2023-10-06T02:59:04.456 INFO:teuthology.orchestra.run.smithi105.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 118690 files and directories currently installed.) 2023-10-06T02:59:04.460 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../util-linux_2.34-0.1ubuntu9.4_amd64.deb ... 2023-10-06T02:59:04.539 INFO:teuthology.orchestra.run.smithi057.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 118690 files and directories currently installed.) 2023-10-06T02:59:04.542 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../00-libdw1_0.176-1.1ubuntu0.1_amd64.deb ... 2023-10-06T02:59:04.650 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking util-linux (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-10-06T02:59:04.682 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libdw1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2023-10-06T02:59:05.158 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../01-libelf1_0.176-1.1ubuntu0.1_amd64.deb ... 2023-10-06T02:59:05.295 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libelf1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2023-10-06T02:59:05.822 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../02-libssl1.1_1.1.1f-1ubuntu2.19_amd64.deb ... 2023-10-06T02:59:05.950 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.19) over (1.1.1f-1ubuntu2.16) ... 2023-10-06T02:59:06.290 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up util-linux (2.34-0.1ubuntu9.4) ... 2023-10-06T02:59:06.513 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-10-06T02:59:06.534 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../03-liblzo2-2_2.10-2_amd64.deb ... 2023-10-06T02:59:06.580 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2023-10-06T02:59:06.958 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package dump. 2023-10-06T02:59:06.979 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../04-dump_0.4b46-6_amd64.deb ... 2023-10-06T02:59:07.016 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking dump (0.4b46-6) ... 2023-10-06T02:59:07.379 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package indent. 2023-10-06T02:59:07.399 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../05-indent_2.2.12-1ubuntu0.20.04.1_amd64.deb ... 2023-10-06T02:59:07.437 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking indent (2.2.12-1ubuntu0.20.04.1) ... 2023-10-06T02:59:08.318 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-10-06T02:59:08.339 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../06-libaio-dev_0.3.112-5_amd64.deb ... 2023-10-06T02:59:08.384 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2023-10-06T02:59:08.618 INFO:teuthology.orchestra.run.smithi105.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 118690 files and directories currently installed.) 2023-10-06T02:59:08.621 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.4_amd64.deb ... 2023-10-06T02:59:08.730 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-10-06T02:59:08.750 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../07-libbluetooth3_5.53-0ubuntu3.6_amd64.deb ... 2023-10-06T02:59:08.753 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-10-06T02:59:08.788 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-10-06T02:59:09.094 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-10-06T02:59:09.111 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../08-libelf-dev_0.176-1.1ubuntu0.1_amd64.deb ... 2023-10-06T02:59:09.157 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-06T02:59:09.277 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.4_amd64.deb ... 2023-10-06T02:59:09.450 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-10-06T02:59:09.536 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-10-06T02:59:09.557 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../09-libmbim-glib4_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-10-06T02:59:09.594 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-10-06T02:59:09.865 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.4) ... 2023-10-06T02:59:09.889 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libmbim-proxy. 2023-10-06T02:59:09.909 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../10-libmbim-proxy_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-10-06T02:59:09.972 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-10-06T02:59:10.309 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-10-06T02:59:10.329 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../11-libmm-glib0_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-10-06T02:59:10.374 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-10-06T02:59:10.384 INFO:teuthology.orchestra.run.smithi105.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 118690 files and directories currently installed.) 2023-10-06T02:59:10.387 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../00-libdw1_0.176-1.1ubuntu0.1_amd64.deb ... 2023-10-06T02:59:10.525 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libdw1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2023-10-06T02:59:10.753 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libndp0:amd64. 2023-10-06T02:59:10.774 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../12-libndp0_1.7-0ubuntu1_amd64.deb ... 2023-10-06T02:59:10.853 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libndp0:amd64 (1.7-0ubuntu1) ... 2023-10-06T02:59:11.019 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../01-libelf1_0.176-1.1ubuntu0.1_amd64.deb ... 2023-10-06T02:59:11.189 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libelf1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2023-10-06T02:59:11.215 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libnm0:amd64. 2023-10-06T02:59:11.234 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../13-libnm0_1.22.10-1ubuntu2.3_amd64.deb ... 2023-10-06T02:59:11.272 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-10-06T02:59:11.734 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-10-06T02:59:11.738 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../02-libssl1.1_1.1.1f-1ubuntu2.19_amd64.deb ... 2023-10-06T02:59:11.755 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../14-libqmi-glib5_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-10-06T02:59:11.792 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-10-06T02:59:11.893 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.19) over (1.1.1f-1ubuntu2.16) ... 2023-10-06T02:59:12.162 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libqmi-proxy. 2023-10-06T02:59:12.183 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../15-libqmi-proxy_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-10-06T02:59:12.220 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-10-06T02:59:12.439 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-10-06T02:59:12.458 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../03-liblzo2-2_2.10-2_amd64.deb ... 2023-10-06T02:59:12.506 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-10-06T02:59:12.519 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2023-10-06T02:59:12.527 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../16-libssl-dev_1.1.1f-1ubuntu2.19_amd64.deb ... 2023-10-06T02:59:12.589 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.19) ... 2023-10-06T02:59:12.934 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package dump. 2023-10-06T02:59:12.953 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../04-dump_0.4b46-6_amd64.deb ... 2023-10-06T02:59:12.992 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking dump (0.4b46-6) ... 2023-10-06T02:59:13.110 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-10-06T02:59:13.130 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../17-libteamdctl0_1.30-1_amd64.deb ... 2023-10-06T02:59:13.168 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libteamdctl0:amd64 (1.30-1) ... 2023-10-06T02:59:13.597 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package indent. 2023-10-06T02:59:13.605 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package modemmanager. 2023-10-06T02:59:13.617 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../05-indent_2.2.12-1ubuntu0.20.04.1_amd64.deb ... 2023-10-06T02:59:13.619 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../18-modemmanager_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-10-06T02:59:13.680 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking indent (2.2.12-1ubuntu0.20.04.1) ... 2023-10-06T02:59:13.685 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-10-06T02:59:14.050 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-10-06T02:59:14.069 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../06-libaio-dev_0.3.112-5_amd64.deb ... 2023-10-06T02:59:14.107 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2023-10-06T02:59:14.345 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package wpasupplicant. 2023-10-06T02:59:14.365 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../19-wpasupplicant_2%3a2.9-1ubuntu4.3_amd64.deb ... 2023-10-06T02:59:14.403 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-10-06T02:59:14.486 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-10-06T02:59:14.500 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../07-libbluetooth3_5.53-0ubuntu3.6_amd64.deb ... 2023-10-06T02:59:14.544 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-10-06T02:59:14.872 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-10-06T02:59:14.892 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../08-libelf-dev_0.176-1.1ubuntu0.1_amd64.deb ... 2023-10-06T02:59:14.930 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-06T02:59:14.984 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package network-manager. 2023-10-06T02:59:15.004 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../20-network-manager_1.22.10-1ubuntu2.3_amd64.deb ... 2023-10-06T02:59:15.091 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking network-manager (1.22.10-1ubuntu2.3) ... 2023-10-06T02:59:15.334 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-10-06T02:59:15.352 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../09-libmbim-glib4_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-10-06T02:59:15.392 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-10-06T02:59:15.720 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package libmbim-proxy. 2023-10-06T02:59:15.740 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../10-libmbim-proxy_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-10-06T02:59:15.778 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-10-06T02:59:15.858 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ppp. 2023-10-06T02:59:15.878 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../21-ppp_2.4.7-2+4.1ubuntu5.1_amd64.deb ... 2023-10-06T02:59:16.164 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-10-06T02:59:16.184 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../11-libmm-glib0_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-10-06T02:59:16.222 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-10-06T02:59:16.372 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-10-06T02:59:16.658 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package libndp0:amd64. 2023-10-06T02:59:16.679 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../12-libndp0_1.7-0ubuntu1_amd64.deb ... 2023-10-06T02:59:16.716 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libndp0:amd64 (1.7-0ubuntu1) ... 2023-10-06T02:59:16.749 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package pptp-linux. 2023-10-06T02:59:16.770 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../22-pptp-linux_1.10.0-1build1_amd64.deb ... 2023-10-06T02:59:16.815 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking pptp-linux (1.10.0-1build1) ... 2023-10-06T02:59:17.103 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package libnm0:amd64. 2023-10-06T02:59:17.123 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../13-libnm0_1.22.10-1ubuntu2.3_amd64.deb ... 2023-10-06T02:59:17.161 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-10-06T02:59:17.227 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package network-manager-pptp. 2023-10-06T02:59:17.247 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../23-network-manager-pptp_1.2.8-2_amd64.deb ... 2023-10-06T02:59:17.322 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking network-manager-pptp (1.2.8-2) ... 2023-10-06T02:59:17.589 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-10-06T02:59:17.596 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-10-06T02:59:17.609 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../14-libqmi-glib5_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-10-06T02:59:17.617 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../24-usb-modeswitch-data_20191128-3_all.deb ... 2023-10-06T02:59:17.654 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking usb-modeswitch-data (20191128-3) ... 2023-10-06T02:59:17.679 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-10-06T02:59:18.050 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package libqmi-proxy. 2023-10-06T02:59:18.071 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../15-libqmi-proxy_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-10-06T02:59:18.099 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package usb-modeswitch. 2023-10-06T02:59:18.108 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-10-06T02:59:18.119 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../25-usb-modeswitch_2.5.2+repack0-2ubuntu3_amd64.deb ... 2023-10-06T02:59:18.179 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-10-06T02:59:18.421 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-10-06T02:59:18.441 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../16-libssl-dev_1.1.1f-1ubuntu2.19_amd64.deb ... 2023-10-06T02:59:18.479 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.19) ... 2023-10-06T02:59:18.542 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.19) ... 2023-10-06T02:59:19.013 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2023-10-06T02:59:19.058 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-10-06T02:59:19.078 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../17-libteamdctl0_1.30-1_amd64.deb ... 2023-10-06T02:59:19.116 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libteamdctl0:amd64 (1.30-1) ... 2023-10-06T02:59:19.138 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2023-10-06T02:59:19.273 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-10-06T02:59:19.603 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package modemmanager. 2023-10-06T02:59:19.623 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../18-modemmanager_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-10-06T02:59:19.682 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-10-06T02:59:19.740 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-10-06T02:59:19.740 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-10-06T02:59:20.375 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package wpasupplicant. 2023-10-06T02:59:20.394 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../19-wpasupplicant_2%3a2.9-1ubuntu4.3_amd64.deb ... 2023-10-06T02:59:20.433 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-10-06T02:59:20.676 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.4) ... 2023-10-06T02:59:20.794 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libteamdctl0:amd64 (1.30-1) ... 2023-10-06T02:59:20.919 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.19) ... 2023-10-06T02:59:21.045 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up usb-modeswitch-data (20191128-3) ... 2023-10-06T02:59:21.122 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package network-manager. 2023-10-06T02:59:21.142 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../20-network-manager_1.22.10-1ubuntu2.3_amd64.deb ... 2023-10-06T02:59:21.221 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-10-06T02:59:21.231 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking network-manager (1.22.10-1ubuntu2.3) ... 2023-10-06T02:59:21.356 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-10-06T02:59:22.045 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package ppp. 2023-10-06T02:59:22.065 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../21-ppp_2.4.7-2+4.1ubuntu5.1_amd64.deb ... 2023-10-06T02:59:22.534 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-10-06T02:59:22.590 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/pppd-dns.service -> /lib/systemd/system/pppd-dns.service. 2023-10-06T02:59:22.973 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package pptp-linux. 2023-10-06T02:59:22.986 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../22-pptp-linux_1.10.0-1build1_amd64.deb ... 2023-10-06T02:59:23.011 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up dump (0.4b46-6) ... 2023-10-06T02:59:23.033 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking pptp-linux (1.10.0-1build1) ... 2023-10-06T02:59:23.117 INFO:teuthology.orchestra.run.smithi057.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-10-06T02:59:23.188 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-10-06T02:59:23.314 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-10-06T02:59:23.437 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package network-manager-pptp. 2023-10-06T02:59:23.440 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up indent (2.2.12-1ubuntu0.20.04.1) ... 2023-10-06T02:59:23.450 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../23-network-manager-pptp_1.2.8-2_amd64.deb ... 2023-10-06T02:59:23.530 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking network-manager-pptp (1.2.8-2) ... 2023-10-06T02:59:23.566 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-10-06T02:59:23.751 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libndp0:amd64 (1.7-0ubuntu1) ... 2023-10-06T02:59:23.848 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-10-06T02:59:23.868 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../24-usb-modeswitch-data_20191128-3_all.deb ... 2023-10-06T02:59:23.902 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libelf1:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-06T02:59:23.906 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking usb-modeswitch-data (20191128-3) ... 2023-10-06T02:59:24.028 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-10-06T02:59:24.154 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up pptp-linux (1.10.0-1build1) ... 2023-10-06T02:59:24.318 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package usb-modeswitch. 2023-10-06T02:59:24.321 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libdw1:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-06T02:59:24.337 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../25-usb-modeswitch_2.5.2+repack0-2ubuntu3_amd64.deb ... 2023-10-06T02:59:24.423 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-10-06T02:59:24.448 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up network-manager (1.22.10-1ubuntu2.3) ... 2023-10-06T02:59:24.772 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.19) ... 2023-10-06T02:59:25.181 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2023-10-06T02:59:25.299 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2023-10-06T02:59:25.425 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-10-06T02:59:25.658 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T02:59:25.658 INFO:teuthology.orchestra.run.smithi057.stdout:The following network interfaces were found in /etc/network/interfaces 2023-10-06T02:59:25.658 INFO:teuthology.orchestra.run.smithi057.stdout:which means they are currently configured by ifupdown: 2023-10-06T02:59:25.659 INFO:teuthology.orchestra.run.smithi057.stdout:- ens1f0 2023-10-06T02:59:25.659 INFO:teuthology.orchestra.run.smithi057.stdout:If you want to manage those interfaces with NetworkManager instead 2023-10-06T02:59:25.659 INFO:teuthology.orchestra.run.smithi057.stdout:remove their configuration from /etc/network/interfaces. 2023-10-06T02:59:25.659 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T02:59:25.895 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-10-06T02:59:25.901 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-10-06T02:59:25.902 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-10-06T02:59:26.433 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-10-06T02:59:26.803 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.4) ... 2023-10-06T02:59:26.938 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libteamdctl0:amd64 (1.30-1) ... 2023-10-06T02:59:27.089 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.19) ... 2023-10-06T02:59:27.215 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up usb-modeswitch-data (20191128-3) ... 2023-10-06T02:59:27.352 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-10-06T02:59:27.366 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-10-06T02:59:27.492 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-10-06T02:59:28.309 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-10-06T02:59:28.435 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up network-manager-pptp (1.2.8-2) ... 2023-10-06T02:59:28.603 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-06T02:59:28.792 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/pppd-dns.service -> /lib/systemd/system/pppd-dns.service. 2023-10-06T02:59:29.104 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-10-06T02:59:29.231 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-10-06T02:59:29.239 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up dump (0.4b46-6) ... 2023-10-06T02:59:29.343 INFO:teuthology.orchestra.run.smithi105.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-10-06T02:59:29.356 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-10-06T02:59:29.408 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-10-06T02:59:29.592 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-10-06T02:59:29.686 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-10-06T02:59:29.686 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-10-06T02:59:29.718 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up indent (2.2.12-1ubuntu0.20.04.1) ... 2023-10-06T02:59:29.844 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-10-06T02:59:30.062 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libndp0:amd64 (1.7-0ubuntu1) ... 2023-10-06T02:59:30.188 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libelf1:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-06T02:59:30.356 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-10-06T02:59:30.482 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up pptp-linux (1.10.0-1build1) ... 2023-10-06T02:59:30.634 INFO:teuthology.orchestra.run.smithi057.stdout:Processing triggers for mime-support (3.64ubuntu1) ... 2023-10-06T02:59:30.650 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libdw1:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-06T02:59:30.765 INFO:teuthology.orchestra.run.smithi057.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-10-06T02:59:30.809 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up network-manager (1.22.10-1ubuntu2.3) ... 2023-10-06T02:59:30.903 INFO:teuthology.orchestra.run.smithi057.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-10-06T02:59:31.062 INFO:teuthology.orchestra.run.smithi057.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-10-06T02:59:31.555 INFO:teuthology.orchestra.run.smithi057.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-10-06T02:59:32.042 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T02:59:32.042 INFO:teuthology.orchestra.run.smithi105.stdout:The following network interfaces were found in /etc/network/interfaces 2023-10-06T02:59:32.042 INFO:teuthology.orchestra.run.smithi105.stdout:which means they are currently configured by ifupdown: 2023-10-06T02:59:32.042 INFO:teuthology.orchestra.run.smithi105.stdout:- enp3s0f1 2023-10-06T02:59:32.042 INFO:teuthology.orchestra.run.smithi105.stdout:If you want to manage those interfaces with NetworkManager instead 2023-10-06T02:59:32.042 INFO:teuthology.orchestra.run.smithi105.stdout:remove their configuration from /etc/network/interfaces. 2023-10-06T02:59:32.043 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T02:59:32.274 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-10-06T02:59:32.805 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-10-06T02:59:33.803 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-10-06T02:59:34.846 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-10-06T02:59:34.981 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up network-manager-pptp (1.2.8-2) ... 2023-10-06T02:59:35.157 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-06T02:59:35.283 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-10-06T02:59:35.451 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-10-06T02:59:35.585 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-10-06T02:59:35.901 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-10-06T02:59:35.901 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-10-06T02:59:36.904 INFO:teuthology.orchestra.run.smithi105.stdout:Processing triggers for mime-support (3.64ubuntu1) ... 2023-10-06T02:59:37.064 INFO:teuthology.orchestra.run.smithi105.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-10-06T02:59:37.198 INFO:teuthology.orchestra.run.smithi105.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-10-06T02:59:37.383 INFO:teuthology.orchestra.run.smithi105.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-10-06T02:59:37.859 INFO:teuthology.orchestra.run.smithi105.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-10-06T02:59:38.499 INFO:teuthology.orchestra.run.smithi057.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2023-10-06T02:59:38.641 INFO:teuthology.orchestra.run.smithi057.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2023-10-06T02:59:40.097 INFO:teuthology.orchestra.run.smithi057.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-10-06T02:59:40.103 DEBUG:teuthology.parallel:result is None 2023-10-06T02:59:44.528 INFO:teuthology.orchestra.run.smithi105.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2023-10-06T02:59:44.636 INFO:teuthology.orchestra.run.smithi105.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2023-10-06T02:59:45.947 INFO:teuthology.orchestra.run.smithi105.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-10-06T02:59:45.952 DEBUG:teuthology.parallel:result is None 2023-10-06T02:59:45.953 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 2023-10-06T02:59:46.098 DEBUG:teuthology.orchestra.run.smithi057:> dpkg-query -W -f '${Version}' ceph 2023-10-06T02:59:46.135 INFO:teuthology.orchestra.run.smithi057.stdout:17.2.6-1296-g736ac5ba-1focal 2023-10-06T02:59:46.136 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-1296-g736ac5ba-1focal 2023-10-06T02:59:46.136 INFO:teuthology.task.install:The correct ceph version 17.2.6-1296-g736ac5ba-1focal is installed. 2023-10-06T02:59:46.136 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 2023-10-06T02:59:46.350 DEBUG:teuthology.orchestra.run.smithi105:> dpkg-query -W -f '${Version}' ceph 2023-10-06T02:59:46.385 INFO:teuthology.orchestra.run.smithi105.stdout:17.2.6-1296-g736ac5ba-1focal 2023-10-06T02:59:46.385 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-1296-g736ac5ba-1focal 2023-10-06T02:59:46.386 INFO:teuthology.task.install:The correct ceph version 17.2.6-1296-g736ac5ba-1focal is installed. 2023-10-06T02:59:46.386 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-10-06T02:59:46.386 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-10-06T02:59:46.386 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-06T02:59:46.420 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2023-10-06T02:59:46.420 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-06T02:59:46.464 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-10-06T02:59:46.464 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-10-06T02:59:46.464 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/usr/bin/daemon-helper 2023-10-06T02:59:46.501 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-06T02:59:46.577 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2023-10-06T02:59:46.577 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd of=/usr/bin/daemon-helper 2023-10-06T02:59:46.611 DEBUG:teuthology.orchestra.run.smithi105:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-06T02:59:46.689 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-10-06T02:59:46.690 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-10-06T02:59:46.690 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-06T02:59:46.724 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-06T02:59:46.804 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2023-10-06T02:59:46.804 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-06T02:59:46.838 DEBUG:teuthology.orchestra.run.smithi105:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-06T02:59:46.918 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-10-06T02:59:46.918 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-10-06T02:59:46.918 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/usr/bin/stdin-killer 2023-10-06T02:59:46.952 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-06T02:59:47.029 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2023-10-06T02:59:47.029 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd of=/usr/bin/stdin-killer 2023-10-06T02:59:47.063 DEBUG:teuthology.orchestra.run.smithi105:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-06T02:59:47.143 INFO:teuthology.run_tasks:Running task ceph... 2023-10-06T02:59:47.207 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-10-06T02:59:47.207 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 777 /var/log/ceph 2023-10-06T02:59:47.215 DEBUG:teuthology.orchestra.run.smithi105:> sudo chmod 777 /var/log/ceph 2023-10-06T02:59:47.247 INFO:tasks.ceph:Disabling ceph logrotate... 2023-10-06T02:59:47.247 DEBUG:teuthology.orchestra.run.smithi057:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-06T02:59:47.290 DEBUG:teuthology.orchestra.run.smithi105:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-06T02:59:47.322 INFO:tasks.ceph:Creating extra log directories... 2023-10-06T02:59:47.323 DEBUG:teuthology.orchestra.run.smithi057:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-06T02:59:47.366 DEBUG:teuthology.orchestra.run.smithi105:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-06T02:59:47.412 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-10-06T02:59:47.412 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-10-06T02:59:47.412 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-10-06T02:59:47.413 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-10-06T02:59:47.413 DEBUG:teuthology.orchestra.run.smithi057:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-06T02:59:47.461 DEBUG:teuthology.orchestra.run.smithi057:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-06T02:59:47.595 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2023-10-06T02:59:47.595 DEBUG:teuthology.orchestra.run.smithi105:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-06T02:59:47.613 DEBUG:teuthology.orchestra.run.smithi105:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-06T02:59:47.747 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-10-06T02:59:47.747 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-10-06T02:59:47.748 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412172', 'branch': 'wip-yuri-testing-2023-10-05-0730-quincy', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/openfiletable}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'job_id': '7412172', 'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '20.04', 'overrides': {'admin_socket': {'branch': 'wip-yuri-testing-2023-10-05-0730-quincy'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2'}}, 'kclient': {'syntax': 'v1'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri-testing-2023-10-05-0730-quincy', 'sha1': 'f1e315a9732d36c05ec316678e2397dc58561c7f'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 75, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 7519, 'sha1': '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2', 'sleep_before_teardown': 0, 'subset': '111/12000', 'suite': 'fs', 'suite_branch': 'wip-yuri-testing-2023-10-05-0730-quincy', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_f1e315a9732d36c05ec316678e2397dc58561c7f/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': 'f1e315a9732d36c05ec316678e2397dc58561c7f', 'targets': {'smithi057.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM=', 'smithi105.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2'}}, {'ceph': None}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_openfiletable']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '54e62bcbac4e53d9685e08328b790d3b20d71cae', 'timestamp': '2023-10-05_23:52:50', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2830'} 2023-10-06T02:59:47.748 DEBUG:teuthology.orchestra.run.smithi057:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-06T02:59:47.755 DEBUG:teuthology.orchestra.run.smithi105:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-06T02:59:47.773 DEBUG:teuthology.orchestra.run.smithi057:> sudo install -d -m0777 -- /var/run/ceph 2023-10-06T02:59:47.818 DEBUG:teuthology.orchestra.run.smithi105:> sudo install -d -m0777 -- /var/run/ceph 2023-10-06T02:59:47.854 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-10-06T02:59:47.854 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/scratch_devs of=/dev/stdout 2023-10-06T02:59:47.906 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-06T02:59:47.906 DEBUG:teuthology.orchestra.run.smithi057:> stat /dev/vg_nvme/lv_1 2023-10-06T02:59:47.970 INFO:teuthology.orchestra.run.smithi057.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-06T02:59:47.970 INFO:teuthology.orchestra.run.smithi057.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T02:59:47.970 INFO:teuthology.orchestra.run.smithi057.stdout:Device: 5h/5d Inode: 496 Links: 1 2023-10-06T02:59:47.970 INFO:teuthology.orchestra.run.smithi057.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T02:59:47.970 INFO:teuthology.orchestra.run.smithi057.stdout:Access: 2023-10-06 02:54:34.091272181 +0000 2023-10-06T02:59:47.970 INFO:teuthology.orchestra.run.smithi057.stdout:Modify: 2023-10-06 02:54:33.631282784 +0000 2023-10-06T02:59:47.970 INFO:teuthology.orchestra.run.smithi057.stdout:Change: 2023-10-06 02:54:33.631282784 +0000 2023-10-06T02:59:47.970 INFO:teuthology.orchestra.run.smithi057.stdout: Birth: - 2023-10-06T02:59:47.971 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-06T02:59:48.044 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records in 2023-10-06T02:59:48.044 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records out 2023-10-06T02:59:48.044 INFO:teuthology.orchestra.run.smithi057.stderr:512 bytes copied, 0.000741251 s, 691 kB/s 2023-10-06T02:59:48.047 DEBUG:teuthology.orchestra.run.smithi057:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-06T02:59:48.112 DEBUG:teuthology.orchestra.run.smithi057:> stat /dev/vg_nvme/lv_2 2023-10-06T02:59:48.174 INFO:teuthology.orchestra.run.smithi057.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-06T02:59:48.174 INFO:teuthology.orchestra.run.smithi057.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T02:59:48.174 INFO:teuthology.orchestra.run.smithi057.stdout:Device: 5h/5d Inode: 503 Links: 1 2023-10-06T02:59:48.174 INFO:teuthology.orchestra.run.smithi057.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T02:59:48.174 INFO:teuthology.orchestra.run.smithi057.stdout:Access: 2023-10-06 02:54:34.855254572 +0000 2023-10-06T02:59:48.174 INFO:teuthology.orchestra.run.smithi057.stdout:Modify: 2023-10-06 02:54:34.387265359 +0000 2023-10-06T02:59:48.174 INFO:teuthology.orchestra.run.smithi057.stdout:Change: 2023-10-06 02:54:34.387265359 +0000 2023-10-06T02:59:48.174 INFO:teuthology.orchestra.run.smithi057.stdout: Birth: - 2023-10-06T02:59:48.175 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-06T02:59:48.248 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records in 2023-10-06T02:59:48.249 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records out 2023-10-06T02:59:48.249 INFO:teuthology.orchestra.run.smithi057.stderr:512 bytes copied, 0.000830152 s, 617 kB/s 2023-10-06T02:59:48.251 DEBUG:teuthology.orchestra.run.smithi057:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-06T02:59:48.319 DEBUG:teuthology.orchestra.run.smithi057:> stat /dev/vg_nvme/lv_3 2023-10-06T02:59:48.382 INFO:teuthology.orchestra.run.smithi057.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-06T02:59:48.383 INFO:teuthology.orchestra.run.smithi057.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T02:59:48.383 INFO:teuthology.orchestra.run.smithi057.stdout:Device: 5h/5d Inode: 507 Links: 1 2023-10-06T02:59:48.383 INFO:teuthology.orchestra.run.smithi057.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T02:59:48.383 INFO:teuthology.orchestra.run.smithi057.stdout:Access: 2023-10-06 02:54:35.599237422 +0000 2023-10-06T02:59:48.383 INFO:teuthology.orchestra.run.smithi057.stdout:Modify: 2023-10-06 02:54:35.135248118 +0000 2023-10-06T02:59:48.383 INFO:teuthology.orchestra.run.smithi057.stdout:Change: 2023-10-06 02:54:35.135248118 +0000 2023-10-06T02:59:48.383 INFO:teuthology.orchestra.run.smithi057.stdout: Birth: - 2023-10-06T02:59:48.383 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-06T02:59:48.453 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records in 2023-10-06T02:59:48.454 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records out 2023-10-06T02:59:48.454 INFO:teuthology.orchestra.run.smithi057.stderr:512 bytes copied, 0.000738409 s, 693 kB/s 2023-10-06T02:59:48.456 DEBUG:teuthology.orchestra.run.smithi057:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-06T02:59:48.525 DEBUG:teuthology.orchestra.run.smithi057:> stat /dev/vg_nvme/lv_4 2023-10-06T02:59:48.585 INFO:teuthology.orchestra.run.smithi057.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-06T02:59:48.585 INFO:teuthology.orchestra.run.smithi057.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T02:59:48.585 INFO:teuthology.orchestra.run.smithi057.stdout:Device: 5h/5d Inode: 513 Links: 1 2023-10-06T02:59:48.585 INFO:teuthology.orchestra.run.smithi057.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T02:59:48.585 INFO:teuthology.orchestra.run.smithi057.stdout:Access: 2023-10-06 02:54:36.395219074 +0000 2023-10-06T02:59:48.585 INFO:teuthology.orchestra.run.smithi057.stdout:Modify: 2023-10-06 02:54:35.911230231 +0000 2023-10-06T02:59:48.585 INFO:teuthology.orchestra.run.smithi057.stdout:Change: 2023-10-06 02:54:35.911230231 +0000 2023-10-06T02:59:48.585 INFO:teuthology.orchestra.run.smithi057.stdout: Birth: - 2023-10-06T02:59:48.586 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-06T02:59:48.660 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records in 2023-10-06T02:59:48.660 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records out 2023-10-06T02:59:48.660 INFO:teuthology.orchestra.run.smithi057.stderr:512 bytes copied, 0.000760836 s, 673 kB/s 2023-10-06T02:59:48.662 DEBUG:teuthology.orchestra.run.smithi057:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-06T02:59:48.727 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T02:59:48.727 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2023-10-06T02:59:48.728 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/scratch_devs of=/dev/stdout 2023-10-06T02:59:48.747 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-06T02:59:48.748 DEBUG:teuthology.orchestra.run.smithi105:> stat /dev/vg_nvme/lv_1 2023-10-06T02:59:48.813 INFO:teuthology.orchestra.run.smithi105.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-06T02:59:48.813 INFO:teuthology.orchestra.run.smithi105.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T02:59:48.813 INFO:teuthology.orchestra.run.smithi105.stdout:Device: 5h/5d Inode: 494 Links: 1 2023-10-06T02:59:48.813 INFO:teuthology.orchestra.run.smithi105.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T02:59:48.813 INFO:teuthology.orchestra.run.smithi105.stdout:Access: 2023-10-06 02:54:34.324269754 +0000 2023-10-06T02:59:48.813 INFO:teuthology.orchestra.run.smithi105.stdout:Modify: 2023-10-06 02:54:33.868263716 +0000 2023-10-06T02:59:48.813 INFO:teuthology.orchestra.run.smithi105.stdout:Change: 2023-10-06 02:54:33.868263716 +0000 2023-10-06T02:59:48.813 INFO:teuthology.orchestra.run.smithi105.stdout: Birth: - 2023-10-06T02:59:48.814 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-06T02:59:48.889 INFO:teuthology.orchestra.run.smithi105.stderr:1+0 records in 2023-10-06T02:59:48.889 INFO:teuthology.orchestra.run.smithi105.stderr:1+0 records out 2023-10-06T02:59:48.889 INFO:teuthology.orchestra.run.smithi105.stderr:512 bytes copied, 0.000699934 s, 731 kB/s 2023-10-06T02:59:48.891 DEBUG:teuthology.orchestra.run.smithi105:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-06T02:59:48.959 DEBUG:teuthology.orchestra.run.smithi105:> stat /dev/vg_nvme/lv_2 2023-10-06T02:59:49.024 INFO:teuthology.orchestra.run.smithi105.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-06T02:59:49.025 INFO:teuthology.orchestra.run.smithi105.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T02:59:49.025 INFO:teuthology.orchestra.run.smithi105.stdout:Device: 5h/5d Inode: 499 Links: 1 2023-10-06T02:59:49.025 INFO:teuthology.orchestra.run.smithi105.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T02:59:49.025 INFO:teuthology.orchestra.run.smithi105.stdout:Access: 2023-10-06 02:54:35.080279385 +0000 2023-10-06T02:59:49.025 INFO:teuthology.orchestra.run.smithi105.stdout:Modify: 2023-10-06 02:54:34.624273640 +0000 2023-10-06T02:59:49.025 INFO:teuthology.orchestra.run.smithi105.stdout:Change: 2023-10-06 02:54:34.624273640 +0000 2023-10-06T02:59:49.025 INFO:teuthology.orchestra.run.smithi105.stdout: Birth: - 2023-10-06T02:59:49.025 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-06T02:59:49.101 INFO:teuthology.orchestra.run.smithi105.stderr:1+0 records in 2023-10-06T02:59:49.101 INFO:teuthology.orchestra.run.smithi105.stderr:1+0 records out 2023-10-06T02:59:49.101 INFO:teuthology.orchestra.run.smithi105.stderr:512 bytes copied, 0.000721658 s, 709 kB/s 2023-10-06T02:59:49.103 DEBUG:teuthology.orchestra.run.smithi105:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-06T02:59:49.172 DEBUG:teuthology.orchestra.run.smithi105:> stat /dev/vg_nvme/lv_3 2023-10-06T02:59:49.233 INFO:teuthology.orchestra.run.smithi105.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-06T02:59:49.233 INFO:teuthology.orchestra.run.smithi105.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T02:59:49.233 INFO:teuthology.orchestra.run.smithi105.stdout:Device: 5h/5d Inode: 505 Links: 1 2023-10-06T02:59:49.233 INFO:teuthology.orchestra.run.smithi105.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T02:59:49.233 INFO:teuthology.orchestra.run.smithi105.stdout:Access: 2023-10-06 02:54:35.380282671 +0000 2023-10-06T02:59:49.233 INFO:teuthology.orchestra.run.smithi105.stdout:Modify: 2023-10-06 02:54:35.376282627 +0000 2023-10-06T02:59:49.233 INFO:teuthology.orchestra.run.smithi105.stdout:Change: 2023-10-06 02:54:35.376282627 +0000 2023-10-06T02:59:49.233 INFO:teuthology.orchestra.run.smithi105.stdout: Birth: - 2023-10-06T02:59:49.234 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-06T02:59:49.309 INFO:teuthology.orchestra.run.smithi105.stderr:1+0 records in 2023-10-06T02:59:49.309 INFO:teuthology.orchestra.run.smithi105.stderr:1+0 records out 2023-10-06T02:59:49.309 INFO:teuthology.orchestra.run.smithi105.stderr:512 bytes copied, 0.000703387 s, 728 kB/s 2023-10-06T02:59:49.311 DEBUG:teuthology.orchestra.run.smithi105:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-06T02:59:49.382 DEBUG:teuthology.orchestra.run.smithi105:> stat /dev/vg_nvme/lv_4 2023-10-06T02:59:49.443 INFO:teuthology.orchestra.run.smithi105.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-06T02:59:49.444 INFO:teuthology.orchestra.run.smithi105.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T02:59:49.444 INFO:teuthology.orchestra.run.smithi105.stdout:Device: 5h/5d Inode: 512 Links: 1 2023-10-06T02:59:49.444 INFO:teuthology.orchestra.run.smithi105.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T02:59:49.444 INFO:teuthology.orchestra.run.smithi105.stdout:Access: 2023-10-06 02:54:36.612296162 +0000 2023-10-06T02:59:49.444 INFO:teuthology.orchestra.run.smithi105.stdout:Modify: 2023-10-06 02:54:36.152291125 +0000 2023-10-06T02:59:49.444 INFO:teuthology.orchestra.run.smithi105.stdout:Change: 2023-10-06 02:54:36.152291125 +0000 2023-10-06T02:59:49.444 INFO:teuthology.orchestra.run.smithi105.stdout: Birth: - 2023-10-06T02:59:49.444 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-06T02:59:49.517 INFO:teuthology.orchestra.run.smithi105.stderr:1+0 records in 2023-10-06T02:59:49.517 INFO:teuthology.orchestra.run.smithi105.stderr:1+0 records out 2023-10-06T02:59:49.517 INFO:teuthology.orchestra.run.smithi105.stderr:512 bytes copied, 0.000625151 s, 819 kB/s 2023-10-06T02:59:49.519 DEBUG:teuthology.orchestra.run.smithi105:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-06T02:59:49.586 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T02:59:49.586 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi057.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi105.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-06T02:59:49.587 INFO:tasks.ceph:Generating config... 2023-10-06T02:59:49.588 INFO:tasks.ceph:[client] client mount timeout = 600 2023-10-06T02:59:49.588 INFO:tasks.ceph:[client] debug client = 20 2023-10-06T02:59:49.588 INFO:tasks.ceph:[client] debug ms = 1 2023-10-06T02:59:49.588 INFO:tasks.ceph:[client] pid file = 2023-10-06T02:59:49.588 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-10-06T02:59:49.588 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-10-06T02:59:49.589 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-10-06T02:59:49.589 INFO:tasks.ceph:[mds] debug mds = 20 2023-10-06T02:59:49.589 INFO:tasks.ceph:[mds] debug ms = 1 2023-10-06T02:59:49.589 INFO:tasks.ceph:[mds] mds debug frag = True 2023-10-06T02:59:49.589 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-10-06T02:59:49.589 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-10-06T02:59:49.589 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-10-06T02:59:49.589 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-10-06T02:59:49.589 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-10-06T02:59:49.589 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-10-06T02:59:49.590 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-10-06T02:59:49.590 INFO:tasks.ceph:[mgr] debug ms = 1 2023-10-06T02:59:49.590 INFO:tasks.ceph:[mon] debug mon = 20 2023-10-06T02:59:49.590 INFO:tasks.ceph:[mon] debug ms = 1 2023-10-06T02:59:49.590 INFO:tasks.ceph:[mon] debug paxos = 20 2023-10-06T02:59:49.590 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-10-06T02:59:49.590 INFO:tasks.ceph:[osd] bdev async discard = True 2023-10-06T02:59:49.590 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-10-06T02:59:49.590 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-10-06T02:59:49.590 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-10-06T02:59:49.590 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-10-06T02:59:49.591 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-10-06T02:59:49.591 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-10-06T02:59:49.591 INFO:tasks.ceph:[osd] debug ms = 1 2023-10-06T02:59:49.591 INFO:tasks.ceph:[osd] debug osd = 20 2023-10-06T02:59:49.591 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-10-06T02:59:49.591 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-10-06T02:59:49.591 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-10-06T02:59:49.591 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-10-06T02:59:49.591 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-10-06T02:59:49.591 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-10-06T02:59:49.592 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-10-06T02:59:49.592 INFO:tasks.ceph:Setting up mon.a... 2023-10-06T02:59:49.592 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-10-06T02:59:49.652 INFO:teuthology.orchestra.run.smithi057.stdout:creating /etc/ceph/ceph.keyring 2023-10-06T02:59:49.659 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-10-06T02:59:49.717 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-06T02:59:49.749 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.57'), ('mon.b', '172.21.15.105'), ('mon.c', '[v2:172.21.15.105:3301,v1:172.21.15.105:6790]')] 2023-10-06T02:59:49.749 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.57,172.21.15.105,[v2:172.21.15.105:3301,v1:172.21.15.105:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-10-06T02:59:49.750 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-10-06T02:59:49.750 DEBUG:teuthology.orchestra.run.smithi057:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-10-06T02:59:49.809 DEBUG:teuthology.orchestra.run.smithi057:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.57 --add b 172.21.15.105 --addv c '[v2:172.21.15.105:3301,v1:172.21.15.105:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-10-06T02:59:49.911 INFO:teuthology.orchestra.run.smithi057.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-10-06T02:59:49.911 INFO:teuthology.orchestra.run.smithi057.stdout:monmaptool: generated fsid eb56dc0f-9213-41cb-9aad-8ade6c802e98 2023-10-06T02:59:49.912 INFO:teuthology.orchestra.run.smithi057.stdout:setting min_mon_release = octopus 2023-10-06T02:59:49.912 INFO:teuthology.orchestra.run.smithi057.stdout:epoch 0 2023-10-06T02:59:49.912 INFO:teuthology.orchestra.run.smithi057.stdout:fsid eb56dc0f-9213-41cb-9aad-8ade6c802e98 2023-10-06T02:59:49.912 INFO:teuthology.orchestra.run.smithi057.stdout:last_changed 2023-10-06T02:59:49.909876+0000 2023-10-06T02:59:49.912 INFO:teuthology.orchestra.run.smithi057.stdout:created 2023-10-06T02:59:49.909876+0000 2023-10-06T02:59:49.912 INFO:teuthology.orchestra.run.smithi057.stdout:min_mon_release 15 (octopus) 2023-10-06T02:59:49.912 INFO:teuthology.orchestra.run.smithi057.stdout:election_strategy: 1 2023-10-06T02:59:49.912 INFO:teuthology.orchestra.run.smithi057.stdout:0: [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] mon.a 2023-10-06T02:59:49.912 INFO:teuthology.orchestra.run.smithi057.stdout:1: [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] mon.b 2023-10-06T02:59:49.912 INFO:teuthology.orchestra.run.smithi057.stdout:2: [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] mon.c 2023-10-06T02:59:49.912 INFO:teuthology.orchestra.run.smithi057.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-10-06T02:59:49.914 DEBUG:teuthology.orchestra.run.smithi057:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-10-06T02:59:49.932 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID eb56dc0f-9213-41cb-9aad-8ade6c802e98... 2023-10-06T02:59:49.934 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-06T02:59:49.982 DEBUG:teuthology.orchestra.run.smithi105:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-06T02:59:50.057 INFO:teuthology.orchestra.run.smithi057.stdout:[global] 2023-10-06T02:59:50.057 INFO:teuthology.orchestra.run.smithi057.stdout: chdir = "" 2023-10-06T02:59:50.057 INFO:teuthology.orchestra.run.smithi057.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-06T02:59:50.057 INFO:teuthology.orchestra.run.smithi057.stdout: auth supported = cephx 2023-10-06T02:59:50.057 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T02:59:50.057 INFO:teuthology.orchestra.run.smithi057.stdout: filestore xattr use omap = true 2023-10-06T02:59:50.057 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T02:59:50.057 INFO:teuthology.orchestra.run.smithi057.stdout: mon clock drift allowed = 1.000 2023-10-06T02:59:50.057 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T02:59:50.058 INFO:teuthology.orchestra.run.smithi057.stdout: osd crush chooseleaf type = 0 2023-10-06T02:59:50.058 INFO:teuthology.orchestra.run.smithi057.stdout: auth debug = true 2023-10-06T02:59:50.058 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T02:59:50.058 INFO:teuthology.orchestra.run.smithi057.stdout: ms die on old message = true 2023-10-06T02:59:50.058 INFO:teuthology.orchestra.run.smithi057.stdout: ms die on bug = true 2023-10-06T02:59:50.058 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T02:59:50.058 INFO:teuthology.orchestra.run.smithi057.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-06T02:59:50.061 INFO:teuthology.orchestra.run.smithi057.stdout: mon pg warn max object skew = 0 2023-10-06T02:59:50.061 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T02:59:50.061 INFO:teuthology.orchestra.run.smithi057.stdout: # disable pg_autoscaler by default for new pools 2023-10-06T02:59:50.061 INFO:teuthology.orchestra.run.smithi057.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-06T02:59:50.061 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T02:59:50.061 INFO:teuthology.orchestra.run.smithi057.stdout: osd pool default size = 2 2023-10-06T02:59:50.061 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T02:59:50.061 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd allow primary affinity = true 2023-10-06T02:59:50.062 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd allow pg remap = true 2023-10-06T02:59:50.062 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on legacy crush tunables = false 2023-10-06T02:59:50.062 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on crush straw calc version zero = false 2023-10-06T02:59:50.062 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on no sortbitwise = false 2023-10-06T02:59:50.062 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on osd down out interval zero = false 2023-10-06T02:59:50.062 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on too few osds = false 2023-10-06T02:59:50.062 INFO:teuthology.orchestra.run.smithi057.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-06T02:59:50.062 INFO:teuthology.orchestra.run.smithi057.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-06T02:59:50.062 INFO:teuthology.orchestra.run.smithi057.stdout: mon_allow_pool_size_one = true 2023-10-06T02:59:50.062 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T02:59:50.062 INFO:teuthology.orchestra.run.smithi057.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-06T02:59:50.062 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T02:59:50.063 INFO:teuthology.orchestra.run.smithi057.stdout: osd default data pool replay window = 5 2023-10-06T02:59:50.063 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T02:59:50.063 INFO:teuthology.orchestra.run.smithi057.stdout: mon allow pool delete = true 2023-10-06T02:59:50.063 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T02:59:50.063 INFO:teuthology.orchestra.run.smithi057.stdout: mon cluster log file level = debug 2023-10-06T02:59:50.063 INFO:teuthology.orchestra.run.smithi057.stdout: debug asserts on shutdown = true 2023-10-06T02:59:50.063 INFO:teuthology.orchestra.run.smithi057.stdout: mon health detail to clog = false 2023-10-06T02:59:50.063 INFO:teuthology.orchestra.run.smithi057.stdout: mon host = "172.21.15.57,172.21.15.105,[v2:172.21.15.105:3301,v1:172.21.15.105:6790]" 2023-10-06T02:59:50.063 INFO:teuthology.orchestra.run.smithi057.stdout: ms die on skipped message = False 2023-10-06T02:59:50.064 INFO:teuthology.orchestra.run.smithi057.stdout: fsid = eb56dc0f-9213-41cb-9aad-8ade6c802e98 2023-10-06T02:59:50.064 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T02:59:50.064 INFO:teuthology.orchestra.run.smithi057.stdout:[osd] 2023-10-06T02:59:50.064 INFO:teuthology.orchestra.run.smithi057.stdout: osd journal size = 100 2023-10-06T02:59:50.064 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T02:59:50.064 INFO:teuthology.orchestra.run.smithi057.stdout: osd scrub load threshold = 5.0 2023-10-06T02:59:50.064 INFO:teuthology.orchestra.run.smithi057.stdout: osd scrub max interval = 600 2023-10-06T02:59:50.064 INFO:teuthology.orchestra.run.smithi057.stdout: osd mclock profile = high_recovery_ops 2023-10-06T02:59:50.064 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T02:59:50.064 INFO:teuthology.orchestra.run.smithi057.stdout: osd recover clone overlap = true 2023-10-06T02:59:50.064 INFO:teuthology.orchestra.run.smithi057.stdout: osd recovery max chunk = 1048576 2023-10-06T02:59:50.065 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T02:59:50.065 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug shutdown = true 2023-10-06T02:59:50.065 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug op order = true 2023-10-06T02:59:50.065 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug verify stray on activate = true 2023-10-06T02:59:50.065 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T02:59:50.065 INFO:teuthology.orchestra.run.smithi057.stdout: osd open classes on start = true 2023-10-06T02:59:50.065 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug pg log writeout = true 2023-10-06T02:59:50.065 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T02:59:50.065 INFO:teuthology.orchestra.run.smithi057.stdout: osd deep scrub update digest min age = 30 2023-10-06T02:59:50.065 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T02:59:50.066 INFO:teuthology.orchestra.run.smithi057.stdout: osd map max advance = 10 2023-10-06T02:59:50.066 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T02:59:50.066 INFO:teuthology.orchestra.run.smithi057.stdout: journal zero on create = true 2023-10-06T02:59:50.066 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T02:59:50.066 INFO:teuthology.orchestra.run.smithi057.stdout: filestore ondisk finisher threads = 3 2023-10-06T02:59:50.066 INFO:teuthology.orchestra.run.smithi057.stdout: filestore apply finisher threads = 3 2023-10-06T02:59:50.066 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T02:59:50.066 INFO:teuthology.orchestra.run.smithi057.stdout: bdev debug aio = true 2023-10-06T02:59:50.066 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug misdirected ops = true 2023-10-06T02:59:50.066 INFO:teuthology.orchestra.run.smithi057.stdout: bdev async discard = True 2023-10-06T02:59:50.066 INFO:teuthology.orchestra.run.smithi057.stdout: bdev enable discard = True 2023-10-06T02:59:50.066 INFO:teuthology.orchestra.run.smithi057.stdout: bluestore allocator = bitmap 2023-10-06T02:59:50.067 INFO:teuthology.orchestra.run.smithi057.stdout: bluestore block size = 96636764160 2023-10-06T02:59:50.067 INFO:teuthology.orchestra.run.smithi057.stdout: bluestore fsck on mount = True 2023-10-06T02:59:50.067 INFO:teuthology.orchestra.run.smithi057.stdout: debug bluefs = 1/20 2023-10-06T02:59:50.067 INFO:teuthology.orchestra.run.smithi057.stdout: debug bluestore = 1/20 2023-10-06T02:59:50.067 INFO:teuthology.orchestra.run.smithi057.stdout: debug ms = 1 2023-10-06T02:59:50.067 INFO:teuthology.orchestra.run.smithi057.stdout: debug osd = 20 2023-10-06T02:59:50.067 INFO:teuthology.orchestra.run.smithi057.stdout: debug rocksdb = 4/10 2023-10-06T02:59:50.067 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd backfillfull_ratio = 0.85 2023-10-06T02:59:50.067 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd full ratio = 0.9 2023-10-06T02:59:50.067 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd nearfull ratio = 0.8 2023-10-06T02:59:50.067 INFO:teuthology.orchestra.run.smithi057.stdout: osd failsafe full ratio = 0.95 2023-10-06T02:59:50.067 INFO:teuthology.orchestra.run.smithi057.stdout: osd objectstore = bluestore 2023-10-06T02:59:50.067 INFO:teuthology.orchestra.run.smithi057.stdout: osd op complaint time = 180 2023-10-06T02:59:50.068 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T02:59:50.068 INFO:teuthology.orchestra.run.smithi057.stdout:[mgr] 2023-10-06T02:59:50.068 INFO:teuthology.orchestra.run.smithi057.stdout: debug ms = 1 2023-10-06T02:59:50.068 INFO:teuthology.orchestra.run.smithi057.stdout: debug mgr = 20 2023-10-06T02:59:50.068 INFO:teuthology.orchestra.run.smithi057.stdout: debug mon = 20 2023-10-06T02:59:50.068 INFO:teuthology.orchestra.run.smithi057.stdout: debug auth = 20 2023-10-06T02:59:50.068 INFO:teuthology.orchestra.run.smithi057.stdout: mon reweight min pgs per osd = 4 2023-10-06T02:59:50.068 INFO:teuthology.orchestra.run.smithi057.stdout: mon reweight min bytes per osd = 10 2023-10-06T02:59:50.068 INFO:teuthology.orchestra.run.smithi057.stdout: mgr/telemetry/nag = false 2023-10-06T02:59:50.068 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T02:59:50.068 INFO:teuthology.orchestra.run.smithi057.stdout:[mon] 2023-10-06T02:59:50.068 INFO:teuthology.orchestra.run.smithi057.stdout: debug ms = 1 2023-10-06T02:59:50.069 INFO:teuthology.orchestra.run.smithi057.stdout: debug mon = 20 2023-10-06T02:59:50.069 INFO:teuthology.orchestra.run.smithi057.stdout: debug paxos = 20 2023-10-06T02:59:50.069 INFO:teuthology.orchestra.run.smithi057.stdout: debug auth = 20 2023-10-06T02:59:50.069 INFO:teuthology.orchestra.run.smithi057.stdout: mon data avail warn = 5 2023-10-06T02:59:50.069 INFO:teuthology.orchestra.run.smithi057.stdout: mon mgr mkfs grace = 240 2023-10-06T02:59:50.069 INFO:teuthology.orchestra.run.smithi057.stdout: mon reweight min pgs per osd = 4 2023-10-06T02:59:50.069 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd reporter subtree level = osd 2023-10-06T02:59:50.069 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd prime pg temp = true 2023-10-06T02:59:50.069 INFO:teuthology.orchestra.run.smithi057.stdout: mon reweight min bytes per osd = 10 2023-10-06T02:59:50.069 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T02:59:50.069 INFO:teuthology.orchestra.run.smithi057.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-06T02:59:50.070 INFO:teuthology.orchestra.run.smithi057.stdout: auth mon ticket ttl = 660 # 11m 2023-10-06T02:59:50.070 INFO:teuthology.orchestra.run.smithi057.stdout: auth service ticket ttl = 240 # 4m 2023-10-06T02:59:50.070 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T02:59:50.070 INFO:teuthology.orchestra.run.smithi057.stdout: # don't complain about insecure global_id in the test suite 2023-10-06T02:59:50.070 INFO:teuthology.orchestra.run.smithi057.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-06T02:59:50.070 INFO:teuthology.orchestra.run.smithi057.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-06T02:59:50.070 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T02:59:50.070 INFO:teuthology.orchestra.run.smithi057.stdout: # 1m isn't quite enough 2023-10-06T02:59:50.070 INFO:teuthology.orchestra.run.smithi057.stdout: mon_down_mkfs_grace = 2m 2023-10-06T02:59:50.070 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T02:59:50.070 INFO:teuthology.orchestra.run.smithi057.stdout: mon_warn_on_filestore_osds = false 2023-10-06T02:59:50.071 INFO:teuthology.orchestra.run.smithi057.stdout: mon op complaint time = 120 2023-10-06T02:59:50.071 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T02:59:50.071 INFO:teuthology.orchestra.run.smithi057.stdout:[client] 2023-10-06T02:59:50.071 INFO:teuthology.orchestra.run.smithi057.stdout: rgw cache enabled = true 2023-10-06T02:59:50.071 INFO:teuthology.orchestra.run.smithi057.stdout: rgw enable ops log = true 2023-10-06T02:59:50.071 INFO:teuthology.orchestra.run.smithi057.stdout: rgw enable usage log = true 2023-10-06T02:59:50.071 INFO:teuthology.orchestra.run.smithi057.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-06T02:59:50.071 INFO:teuthology.orchestra.run.smithi057.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-06T02:59:50.071 INFO:teuthology.orchestra.run.smithi057.stdout: client mount timeout = 600 2023-10-06T02:59:50.071 INFO:teuthology.orchestra.run.smithi057.stdout: debug client = 20 2023-10-06T02:59:50.071 INFO:teuthology.orchestra.run.smithi057.stdout: debug ms = 1 2023-10-06T02:59:50.071 INFO:teuthology.orchestra.run.smithi057.stdout: pid file = "" 2023-10-06T02:59:50.072 INFO:teuthology.orchestra.run.smithi057.stdout: rados mon op timeout = 900 2023-10-06T02:59:50.072 INFO:teuthology.orchestra.run.smithi057.stdout: rados osd op timeout = 900 2023-10-06T02:59:50.072 INFO:teuthology.orchestra.run.smithi057.stdout:[mon.a] 2023-10-06T02:59:50.072 INFO:teuthology.orchestra.run.smithi057.stdout:[mon.b] 2023-10-06T02:59:50.072 INFO:teuthology.orchestra.run.smithi057.stdout:[mon.c] 2023-10-06T02:59:50.072 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.a] 2023-10-06T02:59:50.072 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.c] 2023-10-06T02:59:50.072 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.b] 2023-10-06T02:59:50.072 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.d] 2023-10-06T02:59:50.072 INFO:teuthology.orchestra.run.smithi057.stdout:[mds] 2023-10-06T02:59:50.072 INFO:teuthology.orchestra.run.smithi057.stdout: debug mds = 20 2023-10-06T02:59:50.073 INFO:teuthology.orchestra.run.smithi057.stdout: debug ms = 1 2023-10-06T02:59:50.073 INFO:teuthology.orchestra.run.smithi057.stdout: mds debug frag = True 2023-10-06T02:59:50.073 INFO:teuthology.orchestra.run.smithi057.stdout: mds debug scatterstat = True 2023-10-06T02:59:50.073 INFO:teuthology.orchestra.run.smithi057.stdout: mds op complaint time = 180 2023-10-06T02:59:50.073 INFO:teuthology.orchestra.run.smithi057.stdout: mds verify scatter = True 2023-10-06T02:59:50.073 INFO:teuthology.orchestra.run.smithi057.stdout: osd op complaint time = 180 2023-10-06T02:59:50.073 INFO:teuthology.orchestra.run.smithi057.stdout: rados mon op timeout = 900 2023-10-06T02:59:50.073 INFO:teuthology.orchestra.run.smithi057.stdout: rados osd op timeout = 900 2023-10-06T02:59:50.074 INFO:teuthology.orchestra.run.smithi105.stdout:[global] 2023-10-06T02:59:50.074 INFO:teuthology.orchestra.run.smithi105.stdout: chdir = "" 2023-10-06T02:59:50.074 INFO:teuthology.orchestra.run.smithi105.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-06T02:59:50.074 INFO:teuthology.orchestra.run.smithi105.stdout: auth supported = cephx 2023-10-06T02:59:50.074 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T02:59:50.074 INFO:teuthology.orchestra.run.smithi105.stdout: filestore xattr use omap = true 2023-10-06T02:59:50.074 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T02:59:50.074 INFO:teuthology.orchestra.run.smithi105.stdout: mon clock drift allowed = 1.000 2023-10-06T02:59:50.074 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T02:59:50.074 INFO:teuthology.orchestra.run.smithi105.stdout: osd crush chooseleaf type = 0 2023-10-06T02:59:50.075 INFO:teuthology.orchestra.run.smithi105.stdout: auth debug = true 2023-10-06T02:59:50.075 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T02:59:50.075 INFO:teuthology.orchestra.run.smithi105.stdout: ms die on old message = true 2023-10-06T02:59:50.075 INFO:teuthology.orchestra.run.smithi105.stdout: ms die on bug = true 2023-10-06T02:59:50.075 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T02:59:50.075 INFO:teuthology.orchestra.run.smithi105.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-06T02:59:50.075 INFO:teuthology.orchestra.run.smithi105.stdout: mon pg warn max object skew = 0 2023-10-06T02:59:50.075 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T02:59:50.075 INFO:teuthology.orchestra.run.smithi105.stdout: # disable pg_autoscaler by default for new pools 2023-10-06T02:59:50.075 INFO:teuthology.orchestra.run.smithi105.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-06T02:59:50.075 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T02:59:50.076 INFO:teuthology.orchestra.run.smithi105.stdout: osd pool default size = 2 2023-10-06T02:59:50.076 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T02:59:50.076 INFO:teuthology.orchestra.run.smithi105.stdout: mon osd allow primary affinity = true 2023-10-06T02:59:50.076 INFO:teuthology.orchestra.run.smithi105.stdout: mon osd allow pg remap = true 2023-10-06T02:59:50.076 INFO:teuthology.orchestra.run.smithi105.stdout: mon warn on legacy crush tunables = false 2023-10-06T02:59:50.076 INFO:teuthology.orchestra.run.smithi105.stdout: mon warn on crush straw calc version zero = false 2023-10-06T02:59:50.076 INFO:teuthology.orchestra.run.smithi105.stdout: mon warn on no sortbitwise = false 2023-10-06T02:59:50.076 INFO:teuthology.orchestra.run.smithi105.stdout: mon warn on osd down out interval zero = false 2023-10-06T02:59:50.076 INFO:teuthology.orchestra.run.smithi105.stdout: mon warn on too few osds = false 2023-10-06T02:59:50.076 INFO:teuthology.orchestra.run.smithi105.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-06T02:59:50.076 INFO:teuthology.orchestra.run.smithi105.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-06T02:59:50.076 INFO:teuthology.orchestra.run.smithi105.stdout: mon_allow_pool_size_one = true 2023-10-06T02:59:50.077 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T02:59:50.077 INFO:teuthology.orchestra.run.smithi105.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-06T02:59:50.077 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T02:59:50.077 INFO:teuthology.orchestra.run.smithi105.stdout: osd default data pool replay window = 5 2023-10-06T02:59:50.077 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T02:59:50.077 INFO:teuthology.orchestra.run.smithi105.stdout: mon allow pool delete = true 2023-10-06T02:59:50.077 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T02:59:50.077 INFO:teuthology.orchestra.run.smithi105.stdout: mon cluster log file level = debug 2023-10-06T02:59:50.077 INFO:teuthology.orchestra.run.smithi105.stdout: debug asserts on shutdown = true 2023-10-06T02:59:50.077 INFO:teuthology.orchestra.run.smithi105.stdout: mon health detail to clog = false 2023-10-06T02:59:50.077 INFO:teuthology.orchestra.run.smithi105.stdout: mon host = "172.21.15.57,172.21.15.105,[v2:172.21.15.105:3301,v1:172.21.15.105:6790]" 2023-10-06T02:59:50.077 INFO:teuthology.orchestra.run.smithi105.stdout: ms die on skipped message = False 2023-10-06T02:59:50.078 INFO:teuthology.orchestra.run.smithi105.stdout: fsid = eb56dc0f-9213-41cb-9aad-8ade6c802e98 2023-10-06T02:59:50.078 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T02:59:50.078 INFO:teuthology.orchestra.run.smithi105.stdout:[osd] 2023-10-06T02:59:50.078 INFO:teuthology.orchestra.run.smithi105.stdout: osd journal size = 100 2023-10-06T02:59:50.078 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T02:59:50.078 INFO:teuthology.orchestra.run.smithi105.stdout: osd scrub load threshold = 5.0 2023-10-06T02:59:50.078 INFO:teuthology.orchestra.run.smithi105.stdout: osd scrub max interval = 600 2023-10-06T02:59:50.078 INFO:teuthology.orchestra.run.smithi105.stdout: osd mclock profile = high_recovery_ops 2023-10-06T02:59:50.078 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T02:59:50.078 INFO:teuthology.orchestra.run.smithi105.stdout: osd recover clone overlap = true 2023-10-06T02:59:50.078 INFO:teuthology.orchestra.run.smithi105.stdout: osd recovery max chunk = 1048576 2023-10-06T02:59:50.078 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T02:59:50.078 INFO:teuthology.orchestra.run.smithi105.stdout: osd debug shutdown = true 2023-10-06T02:59:50.079 INFO:teuthology.orchestra.run.smithi105.stdout: osd debug op order = true 2023-10-06T02:59:50.079 INFO:teuthology.orchestra.run.smithi105.stdout: osd debug verify stray on activate = true 2023-10-06T02:59:50.079 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T02:59:50.079 INFO:teuthology.orchestra.run.smithi105.stdout: osd open classes on start = true 2023-10-06T02:59:50.079 INFO:teuthology.orchestra.run.smithi105.stdout: osd debug pg log writeout = true 2023-10-06T02:59:50.079 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T02:59:50.079 INFO:teuthology.orchestra.run.smithi105.stdout: osd deep scrub update digest min age = 30 2023-10-06T02:59:50.079 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T02:59:50.079 INFO:teuthology.orchestra.run.smithi105.stdout: osd map max advance = 10 2023-10-06T02:59:50.079 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T02:59:50.079 INFO:teuthology.orchestra.run.smithi105.stdout: journal zero on create = true 2023-10-06T02:59:50.079 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T02:59:50.080 INFO:teuthology.orchestra.run.smithi105.stdout: filestore ondisk finisher threads = 3 2023-10-06T02:59:50.080 INFO:teuthology.orchestra.run.smithi105.stdout: filestore apply finisher threads = 3 2023-10-06T02:59:50.080 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T02:59:50.080 INFO:teuthology.orchestra.run.smithi105.stdout: bdev debug aio = true 2023-10-06T02:59:50.080 INFO:teuthology.orchestra.run.smithi105.stdout: osd debug misdirected ops = true 2023-10-06T02:59:50.080 INFO:teuthology.orchestra.run.smithi105.stdout: bdev async discard = True 2023-10-06T02:59:50.080 INFO:teuthology.orchestra.run.smithi105.stdout: bdev enable discard = True 2023-10-06T02:59:50.080 INFO:teuthology.orchestra.run.smithi105.stdout: bluestore allocator = bitmap 2023-10-06T02:59:50.080 INFO:teuthology.orchestra.run.smithi105.stdout: bluestore block size = 96636764160 2023-10-06T02:59:50.080 INFO:teuthology.orchestra.run.smithi105.stdout: bluestore fsck on mount = True 2023-10-06T02:59:50.080 INFO:teuthology.orchestra.run.smithi105.stdout: debug bluefs = 1/20 2023-10-06T02:59:50.080 INFO:teuthology.orchestra.run.smithi105.stdout: debug bluestore = 1/20 2023-10-06T02:59:50.081 INFO:teuthology.orchestra.run.smithi105.stdout: debug ms = 1 2023-10-06T02:59:50.081 INFO:teuthology.orchestra.run.smithi105.stdout: debug osd = 20 2023-10-06T02:59:50.081 INFO:teuthology.orchestra.run.smithi105.stdout: debug rocksdb = 4/10 2023-10-06T02:59:50.081 INFO:teuthology.orchestra.run.smithi105.stdout: mon osd backfillfull_ratio = 0.85 2023-10-06T02:59:50.081 INFO:teuthology.orchestra.run.smithi105.stdout: mon osd full ratio = 0.9 2023-10-06T02:59:50.081 INFO:teuthology.orchestra.run.smithi105.stdout: mon osd nearfull ratio = 0.8 2023-10-06T02:59:50.081 INFO:teuthology.orchestra.run.smithi105.stdout: osd failsafe full ratio = 0.95 2023-10-06T02:59:50.081 INFO:teuthology.orchestra.run.smithi105.stdout: osd objectstore = bluestore 2023-10-06T02:59:50.081 INFO:teuthology.orchestra.run.smithi105.stdout: osd op complaint time = 180 2023-10-06T02:59:50.081 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T02:59:50.081 INFO:teuthology.orchestra.run.smithi105.stdout:[mgr] 2023-10-06T02:59:50.081 INFO:teuthology.orchestra.run.smithi105.stdout: debug ms = 1 2023-10-06T02:59:50.081 INFO:teuthology.orchestra.run.smithi105.stdout: debug mgr = 20 2023-10-06T02:59:50.082 INFO:teuthology.orchestra.run.smithi105.stdout: debug mon = 20 2023-10-06T02:59:50.082 INFO:teuthology.orchestra.run.smithi105.stdout: debug auth = 20 2023-10-06T02:59:50.082 INFO:teuthology.orchestra.run.smithi105.stdout: mon reweight min pgs per osd = 4 2023-10-06T02:59:50.082 INFO:teuthology.orchestra.run.smithi105.stdout: mon reweight min bytes per osd = 10 2023-10-06T02:59:50.082 INFO:teuthology.orchestra.run.smithi105.stdout: mgr/telemetry/nag = false 2023-10-06T02:59:50.082 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T02:59:50.082 INFO:teuthology.orchestra.run.smithi105.stdout:[mon] 2023-10-06T02:59:50.082 INFO:teuthology.orchestra.run.smithi105.stdout: debug ms = 1 2023-10-06T02:59:50.082 INFO:teuthology.orchestra.run.smithi105.stdout: debug mon = 20 2023-10-06T02:59:50.082 INFO:teuthology.orchestra.run.smithi105.stdout: debug paxos = 20 2023-10-06T02:59:50.082 INFO:teuthology.orchestra.run.smithi105.stdout: debug auth = 20 2023-10-06T02:59:50.083 INFO:teuthology.orchestra.run.smithi105.stdout: mon data avail warn = 5 2023-10-06T02:59:50.083 INFO:teuthology.orchestra.run.smithi105.stdout: mon mgr mkfs grace = 240 2023-10-06T02:59:50.083 INFO:teuthology.orchestra.run.smithi105.stdout: mon reweight min pgs per osd = 4 2023-10-06T02:59:50.083 INFO:teuthology.orchestra.run.smithi105.stdout: mon osd reporter subtree level = osd 2023-10-06T02:59:50.083 INFO:teuthology.orchestra.run.smithi105.stdout: mon osd prime pg temp = true 2023-10-06T02:59:50.083 INFO:teuthology.orchestra.run.smithi105.stdout: mon reweight min bytes per osd = 10 2023-10-06T02:59:50.083 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T02:59:50.083 INFO:teuthology.orchestra.run.smithi105.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-06T02:59:50.083 INFO:teuthology.orchestra.run.smithi105.stdout: auth mon ticket ttl = 660 # 11m 2023-10-06T02:59:50.083 INFO:teuthology.orchestra.run.smithi105.stdout: auth service ticket ttl = 240 # 4m 2023-10-06T02:59:50.083 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T02:59:50.083 INFO:teuthology.orchestra.run.smithi105.stdout: # don't complain about insecure global_id in the test suite 2023-10-06T02:59:50.083 INFO:teuthology.orchestra.run.smithi105.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-06T02:59:50.084 INFO:teuthology.orchestra.run.smithi105.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-06T02:59:50.084 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T02:59:50.084 INFO:teuthology.orchestra.run.smithi105.stdout: # 1m isn't quite enough 2023-10-06T02:59:50.084 INFO:teuthology.orchestra.run.smithi105.stdout: mon_down_mkfs_grace = 2m 2023-10-06T02:59:50.084 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T02:59:50.084 INFO:teuthology.orchestra.run.smithi105.stdout: mon_warn_on_filestore_osds = false 2023-10-06T02:59:50.084 INFO:teuthology.orchestra.run.smithi105.stdout: mon op complaint time = 120 2023-10-06T02:59:50.084 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T02:59:50.084 INFO:teuthology.orchestra.run.smithi105.stdout:[client] 2023-10-06T02:59:50.084 INFO:teuthology.orchestra.run.smithi105.stdout: rgw cache enabled = true 2023-10-06T02:59:50.084 INFO:teuthology.orchestra.run.smithi105.stdout: rgw enable ops log = true 2023-10-06T02:59:50.084 INFO:teuthology.orchestra.run.smithi105.stdout: rgw enable usage log = true 2023-10-06T02:59:50.084 INFO:teuthology.orchestra.run.smithi105.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-06T02:59:50.085 INFO:teuthology.orchestra.run.smithi105.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-06T02:59:50.085 INFO:teuthology.orchestra.run.smithi105.stdout: client mount timeout = 600 2023-10-06T02:59:50.085 INFO:teuthology.orchestra.run.smithi105.stdout: debug client = 20 2023-10-06T02:59:50.085 INFO:teuthology.orchestra.run.smithi105.stdout: debug ms = 1 2023-10-06T02:59:50.085 INFO:teuthology.orchestra.run.smithi105.stdout: pid file = "" 2023-10-06T02:59:50.085 INFO:teuthology.orchestra.run.smithi105.stdout: rados mon op timeout = 900 2023-10-06T02:59:50.085 INFO:teuthology.orchestra.run.smithi105.stdout: rados osd op timeout = 900 2023-10-06T02:59:50.085 INFO:teuthology.orchestra.run.smithi105.stdout:[mon.a] 2023-10-06T02:59:50.085 INFO:teuthology.orchestra.run.smithi105.stdout:[mon.b] 2023-10-06T02:59:50.085 INFO:teuthology.orchestra.run.smithi105.stdout:[mon.c] 2023-10-06T02:59:50.085 INFO:teuthology.orchestra.run.smithi105.stdout:[mds.a] 2023-10-06T02:59:50.085 INFO:teuthology.orchestra.run.smithi105.stdout:[mds.c] 2023-10-06T02:59:50.086 INFO:teuthology.orchestra.run.smithi105.stdout:[mds.b] 2023-10-06T02:59:50.086 INFO:teuthology.orchestra.run.smithi105.stdout:[mds.d] 2023-10-06T02:59:50.086 INFO:teuthology.orchestra.run.smithi105.stdout:[mds] 2023-10-06T02:59:50.086 INFO:teuthology.orchestra.run.smithi105.stdout: debug mds = 20 2023-10-06T02:59:50.086 INFO:teuthology.orchestra.run.smithi105.stdout: debug ms = 1 2023-10-06T02:59:50.086 INFO:teuthology.orchestra.run.smithi105.stdout: mds debug frag = True 2023-10-06T02:59:50.086 INFO:teuthology.orchestra.run.smithi105.stdout: mds debug scatterstat = True 2023-10-06T02:59:50.086 INFO:teuthology.orchestra.run.smithi105.stdout: mds op complaint time = 180 2023-10-06T02:59:50.086 INFO:teuthology.orchestra.run.smithi105.stdout: mds verify scatter = True 2023-10-06T02:59:50.086 INFO:teuthology.orchestra.run.smithi105.stdout: osd op complaint time = 180 2023-10-06T02:59:50.086 INFO:teuthology.orchestra.run.smithi105.stdout: rados mon op timeout = 900 2023-10-06T02:59:50.086 INFO:teuthology.orchestra.run.smithi105.stdout: rados osd op timeout = 900 2023-10-06T02:59:50.088 INFO:tasks.ceph:Creating admin key on mon.a... 2023-10-06T02:59:50.088 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-10-06T02:59:50.165 INFO:tasks.ceph:Copying monmap to all nodes... 2023-10-06T02:59:50.166 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-10-06T02:59:50.166 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-10-06T02:59:50.181 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-10-06T02:59:50.181 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-10-06T02:59:50.240 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi057.front.sepia.ceph.com 2023-10-06T02:59:50.240 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-10-06T02:59:50.240 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-06T02:59:50.240 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-06T02:59:50.345 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-10-06T02:59:50.345 DEBUG:teuthology.orchestra.run.smithi057:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-06T02:59:50.409 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi105.front.sepia.ceph.com 2023-10-06T02:59:50.409 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2023-10-06T02:59:50.409 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-06T02:59:50.409 DEBUG:teuthology.orchestra.run.smithi105:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-06T02:59:50.470 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2023-10-06T02:59:50.470 DEBUG:teuthology.orchestra.run.smithi105:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-06T02:59:50.532 INFO:tasks.ceph:Setting up mon nodes... 2023-10-06T02:59:50.532 INFO:tasks.ceph:Setting up mgr nodes... 2023-10-06T02:59:50.532 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-10-06T02:59:50.627 INFO:teuthology.orchestra.run.smithi057.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-10-06T02:59:50.634 DEBUG:teuthology.orchestra.run.smithi105:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-10-06T02:59:50.722 INFO:teuthology.orchestra.run.smithi105.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-10-06T02:59:50.729 INFO:tasks.ceph:Setting up mds nodes... 2023-10-06T02:59:50.729 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-10-06T02:59:50.823 INFO:teuthology.orchestra.run.smithi057.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-10-06T02:59:50.829 DEBUG:teuthology.orchestra.run.smithi057:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-10-06T02:59:50.864 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-10-06T02:59:50.997 INFO:teuthology.orchestra.run.smithi057.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-10-06T02:59:51.003 DEBUG:teuthology.orchestra.run.smithi057:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-10-06T02:59:51.037 DEBUG:teuthology.orchestra.run.smithi105:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-10-06T02:59:51.130 INFO:teuthology.orchestra.run.smithi105.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-10-06T02:59:51.135 DEBUG:teuthology.orchestra.run.smithi105:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-10-06T02:59:51.168 DEBUG:teuthology.orchestra.run.smithi105:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-10-06T02:59:51.299 INFO:teuthology.orchestra.run.smithi105.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-10-06T02:59:51.305 DEBUG:teuthology.orchestra.run.smithi105:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-10-06T02:59:51.335 INFO:tasks.ceph_client:Setting up client nodes... 2023-10-06T02:59:51.336 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-10-06T02:59:51.404 INFO:teuthology.orchestra.run.smithi057.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-10-06T02:59:51.432 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-10-06T02:59:51.497 INFO:teuthology.orchestra.run.smithi057.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-10-06T02:59:51.532 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-10-06T02:59:51.598 INFO:teuthology.orchestra.run.smithi105.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-10-06T02:59:51.627 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-10-06T02:59:51.687 INFO:teuthology.orchestra.run.smithi105.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-10-06T02:59:51.713 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-10-06T02:59:51.714 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi057.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi105.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-06T02:59:51.714 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-10-06T02:59:51.749 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T02:59:51.749 INFO:tasks.ceph:role: osd.0 2023-10-06T02:59:51.749 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi057.front.sepia.ceph.com 2023-10-06T02:59:51.749 DEBUG:teuthology.orchestra.run.smithi057:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-06T02:59:53.156 INFO:teuthology.orchestra.run.smithi057.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T02:59:53.157 INFO:teuthology.orchestra.run.smithi057.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T02:59:53.157 INFO:teuthology.orchestra.run.smithi057.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T02:59:53.157 INFO:teuthology.orchestra.run.smithi057.stdout: = reflink=1 2023-10-06T02:59:53.157 INFO:teuthology.orchestra.run.smithi057.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T02:59:53.157 INFO:teuthology.orchestra.run.smithi057.stdout: = sunit=0 swidth=0 blks 2023-10-06T02:59:53.157 INFO:teuthology.orchestra.run.smithi057.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T02:59:53.157 INFO:teuthology.orchestra.run.smithi057.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T02:59:53.157 INFO:teuthology.orchestra.run.smithi057.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T02:59:53.157 INFO:teuthology.orchestra.run.smithi057.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T02:59:53.163 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi057.front.sepia.ceph.com -o noatime 2023-10-06T02:59:53.163 DEBUG:teuthology.orchestra.run.smithi057:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-10-06T02:59:53.225 DEBUG:teuthology.orchestra.run.smithi057:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-10-06T02:59:53.245 INFO:teuthology.orchestra.run.smithi057.stderr:sudo: /sbin/restorecon: command not found 2023-10-06T02:59:53.246 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:59:53.247 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-10-06T02:59:53.326 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T02:59:53.326 INFO:tasks.ceph:role: osd.1 2023-10-06T02:59:53.326 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi057.front.sepia.ceph.com 2023-10-06T02:59:53.326 DEBUG:teuthology.orchestra.run.smithi057:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-06T02:59:54.742 INFO:teuthology.orchestra.run.smithi057.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T02:59:54.742 INFO:teuthology.orchestra.run.smithi057.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T02:59:54.742 INFO:teuthology.orchestra.run.smithi057.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T02:59:54.742 INFO:teuthology.orchestra.run.smithi057.stdout: = reflink=1 2023-10-06T02:59:54.742 INFO:teuthology.orchestra.run.smithi057.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T02:59:54.742 INFO:teuthology.orchestra.run.smithi057.stdout: = sunit=0 swidth=0 blks 2023-10-06T02:59:54.742 INFO:teuthology.orchestra.run.smithi057.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T02:59:54.742 INFO:teuthology.orchestra.run.smithi057.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T02:59:54.742 INFO:teuthology.orchestra.run.smithi057.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T02:59:54.742 INFO:teuthology.orchestra.run.smithi057.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T02:59:54.748 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi057.front.sepia.ceph.com -o noatime 2023-10-06T02:59:54.748 DEBUG:teuthology.orchestra.run.smithi057:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-10-06T02:59:54.784 DEBUG:teuthology.orchestra.run.smithi057:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-10-06T02:59:54.853 INFO:teuthology.orchestra.run.smithi057.stderr:sudo: /sbin/restorecon: command not found 2023-10-06T02:59:54.854 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:59:54.854 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-10-06T02:59:54.931 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T02:59:54.931 INFO:tasks.ceph:role: osd.2 2023-10-06T02:59:54.931 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi057.front.sepia.ceph.com 2023-10-06T02:59:54.932 DEBUG:teuthology.orchestra.run.smithi057:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-06T02:59:56.344 INFO:teuthology.orchestra.run.smithi057.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T02:59:56.344 INFO:teuthology.orchestra.run.smithi057.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T02:59:56.344 INFO:teuthology.orchestra.run.smithi057.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T02:59:56.344 INFO:teuthology.orchestra.run.smithi057.stdout: = reflink=1 2023-10-06T02:59:56.344 INFO:teuthology.orchestra.run.smithi057.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T02:59:56.344 INFO:teuthology.orchestra.run.smithi057.stdout: = sunit=0 swidth=0 blks 2023-10-06T02:59:56.344 INFO:teuthology.orchestra.run.smithi057.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T02:59:56.344 INFO:teuthology.orchestra.run.smithi057.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T02:59:56.345 INFO:teuthology.orchestra.run.smithi057.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T02:59:56.345 INFO:teuthology.orchestra.run.smithi057.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T02:59:56.349 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi057.front.sepia.ceph.com -o noatime 2023-10-06T02:59:56.349 DEBUG:teuthology.orchestra.run.smithi057:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-10-06T02:59:56.394 DEBUG:teuthology.orchestra.run.smithi057:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-10-06T02:59:56.459 INFO:teuthology.orchestra.run.smithi057.stderr:sudo: /sbin/restorecon: command not found 2023-10-06T02:59:56.460 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:59:56.460 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-10-06T02:59:56.544 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T02:59:56.544 INFO:tasks.ceph:role: osd.3 2023-10-06T02:59:56.544 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi057.front.sepia.ceph.com 2023-10-06T02:59:56.544 DEBUG:teuthology.orchestra.run.smithi057:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-06T02:59:57.960 INFO:teuthology.orchestra.run.smithi057.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T02:59:57.960 INFO:teuthology.orchestra.run.smithi057.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T02:59:57.961 INFO:teuthology.orchestra.run.smithi057.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T02:59:57.961 INFO:teuthology.orchestra.run.smithi057.stdout: = reflink=1 2023-10-06T02:59:57.961 INFO:teuthology.orchestra.run.smithi057.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T02:59:57.961 INFO:teuthology.orchestra.run.smithi057.stdout: = sunit=0 swidth=0 blks 2023-10-06T02:59:57.961 INFO:teuthology.orchestra.run.smithi057.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T02:59:57.961 INFO:teuthology.orchestra.run.smithi057.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T02:59:57.961 INFO:teuthology.orchestra.run.smithi057.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T02:59:57.961 INFO:teuthology.orchestra.run.smithi057.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T02:59:57.966 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi057.front.sepia.ceph.com -o noatime 2023-10-06T02:59:57.967 DEBUG:teuthology.orchestra.run.smithi057:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-10-06T02:59:58.007 DEBUG:teuthology.orchestra.run.smithi057:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-10-06T02:59:58.072 INFO:teuthology.orchestra.run.smithi057.stderr:sudo: /sbin/restorecon: command not found 2023-10-06T02:59:58.072 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:59:58.073 DEBUG:teuthology.orchestra.run.smithi057:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T02:59:58.221 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T02:59:58.215+0000 7f827c8e83c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-10-06T02:59:58.223 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T02:59:58.215+0000 7f827c8e83c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-10-06T02:59:58.223 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T02:59:58.215+0000 7f827c8e83c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-06T02:59:58.223 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T02:59:58.215+0000 7f827c8e83c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-06T02:59:58.223 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T02:59:58.215+0000 7f827c8e83c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-06T02:59:58.226 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T02:59:58.219+0000 7f827c8e83c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-10-06T02:59:58.805 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T02:59:58.799+0000 7f827c8e83c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T02:59:59.593 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T02:59:59.587+0000 7f827c8e83c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:00:00.391 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:00.383+0000 7f827c8e83c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:00:01.291 DEBUG:teuthology.orchestra.run.smithi057:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-10-06T03:00:01.326 DEBUG:teuthology.orchestra.run.smithi057:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T03:00:01.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:01.439+0000 7f86600ec3c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-10-06T03:00:01.446 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:01.439+0000 7f86600ec3c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-10-06T03:00:01.446 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:01.439+0000 7f86600ec3c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-06T03:00:01.446 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:01.439+0000 7f86600ec3c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-06T03:00:01.446 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:01.439+0000 7f86600ec3c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-06T03:00:01.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:01.443+0000 7f86600ec3c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-10-06T03:00:02.024 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:02.019+0000 7f86600ec3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:00:02.808 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:02.803+0000 7f86600ec3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:00:03.603 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:03.595+0000 7f86600ec3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:00:04.509 DEBUG:teuthology.orchestra.run.smithi057:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-10-06T03:00:04.545 DEBUG:teuthology.orchestra.run.smithi057:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T03:00:04.654 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:04.647+0000 7f622f5063c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-10-06T03:00:04.655 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:04.647+0000 7f622f5063c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-10-06T03:00:04.655 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:04.647+0000 7f622f5063c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-06T03:00:04.655 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:04.647+0000 7f622f5063c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-06T03:00:04.655 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:04.647+0000 7f622f5063c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-06T03:00:04.657 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:04.651+0000 7f622f5063c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-10-06T03:00:05.236 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:05.231+0000 7f622f5063c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:00:06.030 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:06.023+0000 7f622f5063c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:00:06.819 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:06.811+0000 7f622f5063c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:00:07.722 DEBUG:teuthology.orchestra.run.smithi057:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-10-06T03:00:07.759 DEBUG:teuthology.orchestra.run.smithi057:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T03:00:07.880 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:07.875+0000 7fcd114d93c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-10-06T03:00:07.881 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:07.875+0000 7fcd114d93c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-10-06T03:00:07.881 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:07.875+0000 7fcd114d93c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-06T03:00:07.881 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:07.875+0000 7fcd114d93c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-06T03:00:07.881 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:07.875+0000 7fcd114d93c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-06T03:00:07.883 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:07.879+0000 7fcd114d93c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-10-06T03:00:08.454 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:08.447+0000 7fcd114d93c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:00:09.252 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:09.247+0000 7fcd114d93c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:00:10.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:10.027+0000 7fcd114d93c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:00:10.933 DEBUG:teuthology.orchestra.run.smithi057:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-10-06T03:00:10.966 DEBUG:teuthology.orchestra.run.smithi105:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-10-06T03:00:11.001 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T03:00:11.001 INFO:tasks.ceph:role: osd.4 2023-10-06T03:00:11.002 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi105.front.sepia.ceph.com 2023-10-06T03:00:11.002 DEBUG:teuthology.orchestra.run.smithi105:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-06T03:00:11.594 INFO:teuthology.orchestra.run.smithi105.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T03:00:11.594 INFO:teuthology.orchestra.run.smithi105.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T03:00:11.594 INFO:teuthology.orchestra.run.smithi105.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T03:00:11.594 INFO:teuthology.orchestra.run.smithi105.stdout: = reflink=1 2023-10-06T03:00:11.594 INFO:teuthology.orchestra.run.smithi105.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T03:00:11.595 INFO:teuthology.orchestra.run.smithi105.stdout: = sunit=0 swidth=0 blks 2023-10-06T03:00:11.595 INFO:teuthology.orchestra.run.smithi105.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T03:00:11.595 INFO:teuthology.orchestra.run.smithi105.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T03:00:11.595 INFO:teuthology.orchestra.run.smithi105.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T03:00:11.595 INFO:teuthology.orchestra.run.smithi105.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T03:00:11.599 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi105.front.sepia.ceph.com -o noatime 2023-10-06T03:00:11.599 DEBUG:teuthology.orchestra.run.smithi105:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-10-06T03:00:11.740 DEBUG:teuthology.orchestra.run.smithi105:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-10-06T03:00:11.758 INFO:teuthology.orchestra.run.smithi105.stderr:sudo: /sbin/restorecon: command not found 2023-10-06T03:00:11.759 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T03:00:11.759 DEBUG:teuthology.orchestra.run.smithi105:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-10-06T03:00:11.835 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T03:00:11.835 INFO:tasks.ceph:role: osd.5 2023-10-06T03:00:11.835 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi105.front.sepia.ceph.com 2023-10-06T03:00:11.836 DEBUG:teuthology.orchestra.run.smithi105:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-06T03:00:12.358 INFO:teuthology.orchestra.run.smithi105.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T03:00:12.359 INFO:teuthology.orchestra.run.smithi105.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T03:00:12.359 INFO:teuthology.orchestra.run.smithi105.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T03:00:12.359 INFO:teuthology.orchestra.run.smithi105.stdout: = reflink=1 2023-10-06T03:00:12.359 INFO:teuthology.orchestra.run.smithi105.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T03:00:12.359 INFO:teuthology.orchestra.run.smithi105.stdout: = sunit=0 swidth=0 blks 2023-10-06T03:00:12.359 INFO:teuthology.orchestra.run.smithi105.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T03:00:12.359 INFO:teuthology.orchestra.run.smithi105.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T03:00:12.359 INFO:teuthology.orchestra.run.smithi105.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T03:00:12.359 INFO:teuthology.orchestra.run.smithi105.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T03:00:12.363 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi105.front.sepia.ceph.com -o noatime 2023-10-06T03:00:12.363 DEBUG:teuthology.orchestra.run.smithi105:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-10-06T03:00:12.434 DEBUG:teuthology.orchestra.run.smithi105:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-10-06T03:00:12.456 INFO:teuthology.orchestra.run.smithi105.stderr:sudo: /sbin/restorecon: command not found 2023-10-06T03:00:12.457 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T03:00:12.458 DEBUG:teuthology.orchestra.run.smithi105:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-10-06T03:00:12.535 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T03:00:12.535 INFO:tasks.ceph:role: osd.6 2023-10-06T03:00:12.536 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi105.front.sepia.ceph.com 2023-10-06T03:00:12.536 DEBUG:teuthology.orchestra.run.smithi105:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-06T03:00:13.102 INFO:teuthology.orchestra.run.smithi105.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T03:00:13.102 INFO:teuthology.orchestra.run.smithi105.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T03:00:13.102 INFO:teuthology.orchestra.run.smithi105.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T03:00:13.102 INFO:teuthology.orchestra.run.smithi105.stdout: = reflink=1 2023-10-06T03:00:13.102 INFO:teuthology.orchestra.run.smithi105.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T03:00:13.102 INFO:teuthology.orchestra.run.smithi105.stdout: = sunit=0 swidth=0 blks 2023-10-06T03:00:13.102 INFO:teuthology.orchestra.run.smithi105.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T03:00:13.102 INFO:teuthology.orchestra.run.smithi105.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T03:00:13.102 INFO:teuthology.orchestra.run.smithi105.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T03:00:13.103 INFO:teuthology.orchestra.run.smithi105.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T03:00:13.107 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi105.front.sepia.ceph.com -o noatime 2023-10-06T03:00:13.107 DEBUG:teuthology.orchestra.run.smithi105:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-10-06T03:00:13.241 DEBUG:teuthology.orchestra.run.smithi105:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-10-06T03:00:13.260 INFO:teuthology.orchestra.run.smithi105.stderr:sudo: /sbin/restorecon: command not found 2023-10-06T03:00:13.261 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T03:00:13.261 DEBUG:teuthology.orchestra.run.smithi105:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-10-06T03:00:13.339 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T03:00:13.339 INFO:tasks.ceph:role: osd.7 2023-10-06T03:00:13.339 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi105.front.sepia.ceph.com 2023-10-06T03:00:13.339 DEBUG:teuthology.orchestra.run.smithi105:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-06T03:00:13.938 INFO:teuthology.orchestra.run.smithi105.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T03:00:13.938 INFO:teuthology.orchestra.run.smithi105.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T03:00:13.938 INFO:teuthology.orchestra.run.smithi105.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T03:00:13.939 INFO:teuthology.orchestra.run.smithi105.stdout: = reflink=1 2023-10-06T03:00:13.939 INFO:teuthology.orchestra.run.smithi105.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T03:00:13.939 INFO:teuthology.orchestra.run.smithi105.stdout: = sunit=0 swidth=0 blks 2023-10-06T03:00:13.939 INFO:teuthology.orchestra.run.smithi105.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T03:00:13.939 INFO:teuthology.orchestra.run.smithi105.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T03:00:13.939 INFO:teuthology.orchestra.run.smithi105.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T03:00:13.939 INFO:teuthology.orchestra.run.smithi105.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T03:00:13.943 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi105.front.sepia.ceph.com -o noatime 2023-10-06T03:00:13.943 DEBUG:teuthology.orchestra.run.smithi105:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-10-06T03:00:14.100 DEBUG:teuthology.orchestra.run.smithi105:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-10-06T03:00:14.120 INFO:teuthology.orchestra.run.smithi105.stderr:sudo: /sbin/restorecon: command not found 2023-10-06T03:00:14.121 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T03:00:14.122 DEBUG:teuthology.orchestra.run.smithi105:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T03:00:14.279 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:14.273+0000 7ff9c270e3c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-10-06T03:00:14.281 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:14.273+0000 7ff9c270e3c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-10-06T03:00:14.282 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:14.273+0000 7ff9c270e3c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-06T03:00:14.282 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:14.273+0000 7ff9c270e3c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-06T03:00:14.282 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:14.277+0000 7ff9c270e3c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-06T03:00:14.284 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:14.277+0000 7ff9c270e3c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-10-06T03:00:14.863 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:14.857+0000 7ff9c270e3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:00:15.649 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:15.641+0000 7ff9c270e3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:00:16.453 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:16.445+0000 7ff9c270e3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:00:17.365 DEBUG:teuthology.orchestra.run.smithi105:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-10-06T03:00:17.401 DEBUG:teuthology.orchestra.run.smithi105:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T03:00:17.520 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:17.513+0000 7f7bcc2e23c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-10-06T03:00:17.522 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:17.517+0000 7f7bcc2e23c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-10-06T03:00:17.522 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:17.517+0000 7f7bcc2e23c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-06T03:00:17.522 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:17.517+0000 7f7bcc2e23c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-06T03:00:17.522 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:17.517+0000 7f7bcc2e23c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-06T03:00:17.524 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:17.517+0000 7f7bcc2e23c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-10-06T03:00:17.750 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:00:17.757 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:00:18.095 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:18.089+0000 7f7bcc2e23c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:00:18.884 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:18.877+0000 7f7bcc2e23c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:00:19.679 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:19.673+0000 7f7bcc2e23c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:00:20.569 DEBUG:teuthology.orchestra.run.smithi105:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-10-06T03:00:20.614 DEBUG:teuthology.orchestra.run.smithi105:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T03:00:20.731 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:20.725+0000 7fdc3b8f03c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-10-06T03:00:20.732 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:20.725+0000 7fdc3b8f03c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-10-06T03:00:20.732 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:20.725+0000 7fdc3b8f03c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-06T03:00:20.732 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:20.725+0000 7fdc3b8f03c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-06T03:00:20.732 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:20.725+0000 7fdc3b8f03c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-06T03:00:20.735 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:20.729+0000 7fdc3b8f03c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-10-06T03:00:21.311 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:21.301+0000 7fdc3b8f03c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:00:22.108 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:22.101+0000 7fdc3b8f03c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:00:22.902 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:22.897+0000 7fdc3b8f03c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:00:23.785 DEBUG:teuthology.orchestra.run.smithi105:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-10-06T03:00:23.820 DEBUG:teuthology.orchestra.run.smithi105:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T03:00:23.936 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:23.929+0000 7fd8f40b23c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-10-06T03:00:23.937 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:23.929+0000 7fd8f40b23c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-10-06T03:00:23.937 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:23.933+0000 7fd8f40b23c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-06T03:00:23.937 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:23.933+0000 7fd8f40b23c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-06T03:00:23.937 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:23.933+0000 7fd8f40b23c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-06T03:00:23.940 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:23.933+0000 7fd8f40b23c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-10-06T03:00:24.511 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:24.505+0000 7fd8f40b23c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:00:25.297 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:25.289+0000 7fd8f40b23c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:00:26.086 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:26.081+0000 7fd8f40b23c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:00:26.969 DEBUG:teuthology.orchestra.run.smithi105:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-10-06T03:00:27.002 INFO:tasks.ceph:Reading keys from all nodes... 2023-10-06T03:00:27.002 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-10-06T03:00:27.002 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-10-06T03:00:27.037 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-10-06T03:00:27.037 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-10-06T03:00:27.113 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-10-06T03:00:27.114 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-10-06T03:00:27.192 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-10-06T03:00:27.192 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-10-06T03:00:27.268 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-10-06T03:00:27.268 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-10-06T03:00:27.348 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-10-06T03:00:27.348 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-10-06T03:00:27.425 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-10-06T03:00:27.425 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-10-06T03:00:27.501 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2023-10-06T03:00:27.501 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-10-06T03:00:27.535 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2023-10-06T03:00:27.535 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-10-06T03:00:27.608 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2023-10-06T03:00:27.608 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-10-06T03:00:27.680 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2023-10-06T03:00:27.680 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-10-06T03:00:27.758 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2023-10-06T03:00:27.758 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-10-06T03:00:27.834 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2023-10-06T03:00:27.834 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-10-06T03:00:27.910 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2023-10-06T03:00:27.910 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-10-06T03:00:27.989 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-10-06T03:00:27.989 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-10-06T03:00:28.010 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-10-06T03:00:28.010 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-10-06T03:00:28.069 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2023-10-06T03:00:28.069 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-10-06T03:00:28.087 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2023-10-06T03:00:28.087 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-10-06T03:00:28.147 INFO:tasks.ceph:Adding keys to all mons... 2023-10-06T03:00:28.147 DEBUG:teuthology.orchestra.run.smithi057:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-06T03:00:28.155 DEBUG:teuthology.orchestra.run.smithi105:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-06T03:00:28.196 INFO:teuthology.orchestra.run.smithi057.stdout:[mgr.y] 2023-10-06T03:00:28.197 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQAmeB9lwOhTJRAAeQ+9At86XOHzhFNQPNQa5g== 2023-10-06T03:00:28.197 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.a] 2023-10-06T03:00:28.197 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQAmeB9lDqECMRAAhzW3Orr26rDBr/eQWsWeUw== 2023-10-06T03:00:28.197 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.c] 2023-10-06T03:00:28.197 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQAmeB9lfIxXOxAAMEjLV/EclZMH8LJnne8HpQ== 2023-10-06T03:00:28.197 INFO:teuthology.orchestra.run.smithi057.stdout:[osd.0] 2023-10-06T03:00:28.197 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQAueB9l1QweDRAAQOi85Hl7CxwynZ/2juWCDQ== 2023-10-06T03:00:28.197 INFO:teuthology.orchestra.run.smithi057.stdout:[osd.1] 2023-10-06T03:00:28.197 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQAxeB9l8TFyGhAANcAhbFzZWvou0nJxAAqB4g== 2023-10-06T03:00:28.197 INFO:teuthology.orchestra.run.smithi057.stdout:[osd.2] 2023-10-06T03:00:28.197 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQA0eB9lmivnJhAA+YySNbp4IJmZM+sQE3d7QA== 2023-10-06T03:00:28.197 INFO:teuthology.orchestra.run.smithi057.stdout:[osd.3] 2023-10-06T03:00:28.198 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQA3eB9lk0RkNBAAbD3gSyHwErEXlJUs84h15w== 2023-10-06T03:00:28.198 INFO:teuthology.orchestra.run.smithi057.stdout:[mgr.x] 2023-10-06T03:00:28.198 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQAmeB9l9rLvKhAA/gcq8fCI3ZFihu9r1HGTlQ== 2023-10-06T03:00:28.198 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.b] 2023-10-06T03:00:28.198 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQAneB9lMQOrBxAA14XFhuZexpkxXWbava72Lg== 2023-10-06T03:00:28.198 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.d] 2023-10-06T03:00:28.198 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQAneB9lxuy7ERAAhOixOLVBW+kzwcR/I2stMA== 2023-10-06T03:00:28.198 INFO:teuthology.orchestra.run.smithi057.stdout:[osd.4] 2023-10-06T03:00:28.198 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQA+eB9lAPSdEBAAKd8VkbfnUNVRzObt7KuAWA== 2023-10-06T03:00:28.198 INFO:teuthology.orchestra.run.smithi057.stdout:[osd.5] 2023-10-06T03:00:28.198 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQBBeB9lyBkAHxAAxDWxeDfTrM3HByhyw5sVlQ== 2023-10-06T03:00:28.198 INFO:teuthology.orchestra.run.smithi057.stdout:[osd.6] 2023-10-06T03:00:28.198 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQBEeB9lMveJKxAA/obatGTtFXAPoaXP7O+qbw== 2023-10-06T03:00:28.198 INFO:teuthology.orchestra.run.smithi057.stdout:[osd.7] 2023-10-06T03:00:28.199 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQBHeB9lePjINxAAlsT5e6FfWebTYG66oT+naw== 2023-10-06T03:00:28.199 INFO:teuthology.orchestra.run.smithi057.stdout:[client.0] 2023-10-06T03:00:28.199 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQAneB9lXov9FxAA0z65F9trriebBUZKVxOUUA== 2023-10-06T03:00:28.199 INFO:teuthology.orchestra.run.smithi057.stdout:[client.2] 2023-10-06T03:00:28.199 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQAneB9lLCCVHRAA1mt8Mz7VVvX/2SyuqFq3NQ== 2023-10-06T03:00:28.199 INFO:teuthology.orchestra.run.smithi057.stdout:[client.1] 2023-10-06T03:00:28.199 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQAneB9lRjCaIxAAI3gVmEJaBGQiBGfYbTOfvA== 2023-10-06T03:00:28.199 INFO:teuthology.orchestra.run.smithi057.stdout:[client.3] 2023-10-06T03:00:28.199 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQAneB9l5x/eKBAAQGb0VEfdnXA5BaUfbEJDOA== 2023-10-06T03:00:28.219 INFO:teuthology.orchestra.run.smithi105.stdout:[mgr.y] 2023-10-06T03:00:28.219 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQAmeB9lwOhTJRAAeQ+9At86XOHzhFNQPNQa5g== 2023-10-06T03:00:28.220 INFO:teuthology.orchestra.run.smithi105.stdout:[mds.a] 2023-10-06T03:00:28.220 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQAmeB9lDqECMRAAhzW3Orr26rDBr/eQWsWeUw== 2023-10-06T03:00:28.220 INFO:teuthology.orchestra.run.smithi105.stdout:[mds.c] 2023-10-06T03:00:28.220 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQAmeB9lfIxXOxAAMEjLV/EclZMH8LJnne8HpQ== 2023-10-06T03:00:28.220 INFO:teuthology.orchestra.run.smithi105.stdout:[osd.0] 2023-10-06T03:00:28.220 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQAueB9l1QweDRAAQOi85Hl7CxwynZ/2juWCDQ== 2023-10-06T03:00:28.220 INFO:teuthology.orchestra.run.smithi105.stdout:[osd.1] 2023-10-06T03:00:28.220 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQAxeB9l8TFyGhAANcAhbFzZWvou0nJxAAqB4g== 2023-10-06T03:00:28.220 INFO:teuthology.orchestra.run.smithi105.stdout:[osd.2] 2023-10-06T03:00:28.220 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQA0eB9lmivnJhAA+YySNbp4IJmZM+sQE3d7QA== 2023-10-06T03:00:28.220 INFO:teuthology.orchestra.run.smithi105.stdout:[osd.3] 2023-10-06T03:00:28.221 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQA3eB9lk0RkNBAAbD3gSyHwErEXlJUs84h15w== 2023-10-06T03:00:28.221 INFO:teuthology.orchestra.run.smithi105.stdout:[mgr.x] 2023-10-06T03:00:28.221 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQAmeB9l9rLvKhAA/gcq8fCI3ZFihu9r1HGTlQ== 2023-10-06T03:00:28.221 INFO:teuthology.orchestra.run.smithi105.stdout:[mds.b] 2023-10-06T03:00:28.221 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQAneB9lMQOrBxAA14XFhuZexpkxXWbava72Lg== 2023-10-06T03:00:28.221 INFO:teuthology.orchestra.run.smithi105.stdout:[mds.d] 2023-10-06T03:00:28.221 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQAneB9lxuy7ERAAhOixOLVBW+kzwcR/I2stMA== 2023-10-06T03:00:28.221 INFO:teuthology.orchestra.run.smithi105.stdout:[osd.4] 2023-10-06T03:00:28.221 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQA+eB9lAPSdEBAAKd8VkbfnUNVRzObt7KuAWA== 2023-10-06T03:00:28.221 INFO:teuthology.orchestra.run.smithi105.stdout:[osd.5] 2023-10-06T03:00:28.221 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQBBeB9lyBkAHxAAxDWxeDfTrM3HByhyw5sVlQ== 2023-10-06T03:00:28.221 INFO:teuthology.orchestra.run.smithi105.stdout:[osd.6] 2023-10-06T03:00:28.222 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQBEeB9lMveJKxAA/obatGTtFXAPoaXP7O+qbw== 2023-10-06T03:00:28.222 INFO:teuthology.orchestra.run.smithi105.stdout:[osd.7] 2023-10-06T03:00:28.222 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQBHeB9lePjINxAAlsT5e6FfWebTYG66oT+naw== 2023-10-06T03:00:28.222 INFO:teuthology.orchestra.run.smithi105.stdout:[client.0] 2023-10-06T03:00:28.222 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQAneB9lXov9FxAA0z65F9trriebBUZKVxOUUA== 2023-10-06T03:00:28.222 INFO:teuthology.orchestra.run.smithi105.stdout:[client.2] 2023-10-06T03:00:28.222 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQAneB9lLCCVHRAA1mt8Mz7VVvX/2SyuqFq3NQ== 2023-10-06T03:00:28.222 INFO:teuthology.orchestra.run.smithi105.stdout:[client.1] 2023-10-06T03:00:28.222 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQAneB9lRjCaIxAAI3gVmEJaBGQiBGfYbTOfvA== 2023-10-06T03:00:28.222 INFO:teuthology.orchestra.run.smithi105.stdout:[client.3] 2023-10-06T03:00:28.222 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQAneB9l5x/eKBAAQGb0VEfdnXA5BaUfbEJDOA== 2023-10-06T03:00:28.223 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-06T03:00:28.253 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-06T03:00:28.337 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T03:00:28.344 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T03:00:28.416 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T03:00:28.423 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T03:00:28.497 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T03:00:28.503 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T03:00:28.573 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T03:00:28.579 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T03:00:28.651 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T03:00:28.657 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T03:00:28.729 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T03:00:28.736 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T03:00:28.806 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-06T03:00:28.812 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-06T03:00:28.880 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T03:00:28.886 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T03:00:28.961 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T03:00:28.968 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T03:00:29.039 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T03:00:29.046 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T03:00:29.115 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T03:00:29.121 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T03:00:29.192 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T03:00:29.199 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T03:00:29.269 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T03:00:29.277 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T03:00:29.348 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T03:00:29.354 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T03:00:29.429 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T03:00:29.436 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T03:00:29.510 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T03:00:29.516 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T03:00:29.590 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T03:00:29.595 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T03:00:29.667 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-10-06T03:00:29.667 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-10-06T03:00:29.702 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-06T03:00:29.863 DEBUG:teuthology.orchestra.run.smithi057:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-10-06T03:00:29.900 DEBUG:teuthology.orchestra.run.smithi105:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-10-06T03:00:29.936 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-06T03:00:30.072 DEBUG:teuthology.orchestra.run.smithi105:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-10-06T03:00:30.107 DEBUG:teuthology.orchestra.run.smithi105:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-10-06T03:00:30.182 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-06T03:00:30.319 DEBUG:teuthology.orchestra.run.smithi105:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-10-06T03:00:30.351 DEBUG:teuthology.orchestra.run.smithi057:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-06T03:00:30.356 DEBUG:teuthology.orchestra.run.smithi105:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-06T03:00:30.409 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-10-06T03:00:30.410 INFO:tasks.ceph.mon.a:Restarting daemon 2023-10-06T03:00:30.410 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-10-06T03:00:30.417 INFO:tasks.ceph.mon.a:Started 2023-10-06T03:00:30.417 INFO:tasks.ceph.mon.b:Restarting daemon 2023-10-06T03:00:30.417 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-10-06T03:00:30.463 INFO:tasks.ceph.mon.b:Started 2023-10-06T03:00:30.464 INFO:tasks.ceph.mon.c:Restarting daemon 2023-10-06T03:00:30.464 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-10-06T03:00:30.468 INFO:tasks.ceph.mon.c:Started 2023-10-06T03:00:30.468 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-10-06T03:00:30.469 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-10-06T03:00:30.469 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-10-06T03:00:30.476 INFO:tasks.ceph.mgr.y:Started 2023-10-06T03:00:30.476 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-10-06T03:00:30.476 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-10-06T03:00:30.481 INFO:tasks.ceph.mgr.x:Started 2023-10-06T03:00:30.481 INFO:tasks.ceph:Setting crush tunables to default 2023-10-06T03:00:30.482 DEBUG:teuthology.orchestra.run.smithi057:> sudo ceph --cluster ceph osd crush tunables default 2023-10-06T03:00:30.636 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:30.631+0000 7f315ac2e700 1 Processor -- start 2023-10-06T03:00:30.636 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:30.631+0000 7f315ac2e700 1 -- start start 2023-10-06T03:00:30.638 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:30.631+0000 7f315ac2e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f315415cd50 0x7f315415d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:30.638 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:30.631+0000 7f315ac2e700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f315414fd10 0x7f31541501b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:30.638 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:30.631+0000 7f315ac2e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f315415d660 con 0x7f3154159750 2023-10-06T03:00:30.638 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:30.631+0000 7f315ac2e700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31541506f0 con 0x7f315415cd50 2023-10-06T03:00:30.638 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:30.631+0000 7f315ac2e700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f315406e300 con 0x7f315414fd10 2023-10-06T03:00:30.639 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:30.631+0000 7f31589ca700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f315415cd50 0x7f315415d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:30.639 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:30.631+0000 7f31589ca700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f315415cd50 0x7f315415d120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33756/0 (socket says 172.21.15.57:33756) 2023-10-06T03:00:30.639 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:30.631+0000 7f31589ca700 1 -- 172.21.15.57:0/2372238131 learned_addr learned my addr 172.21.15.57:0/2372238131 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:00:30.639 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:30.631+0000 7f31591cb700 1 --1- 172.21.15.57:0/2372238131 >> v1:172.21.15.57:6789/0 conn(0x7f3154159750 0x7f3154159bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:57580/0 (socket says 172.21.15.57:57580) 2023-10-06T03:00:30.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:30.631+0000 7f31589ca700 1 -- 172.21.15.57:0/2372238131 >> v2:172.21.15.57:3300/0 conn(0x7f315415cd50 msgr2=0x7f315415d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-06T03:00:30.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:30.631+0000 7f31589ca700 1 -- 172.21.15.57:0/2372238131 >> v2:172.21.15.57:3300/0 conn(0x7f315415cd50 msgr2=0x7f315415d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T03:00:30.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:30.631+0000 7f31589ca700 1 --2- 172.21.15.57:0/2372238131 >> v2:172.21.15.57:3300/0 conn(0x7f315415cd50 0x7f315415d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T03:00:30.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:30.631+0000 7f3153fff700 1 --2- 172.21.15.57:0/2372238131 >> v2:172.21.15.105:3300/0 conn(0x7f315414fd10 0x7f31541501b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:30.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:30.631+0000 7f31589ca700 1 --2- 172.21.15.57:0/2372238131 >> v2:172.21.15.57:3300/0 conn(0x7f315415cd50 0x7f315415d120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-06T03:00:30.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:30.635+0000 7f3153fff700 1 -- 172.21.15.57:0/2372238131 >> v2:172.21.15.105:3300/0 conn(0x7f315414fd10 msgr2=0x7f31541501b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-06T03:00:30.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:30.635+0000 7f3153fff700 1 -- 172.21.15.57:0/2372238131 >> v2:172.21.15.105:3300/0 conn(0x7f315414fd10 msgr2=0x7f31541501b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T03:00:30.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:30.635+0000 7f3153fff700 1 --2- 172.21.15.57:0/2372238131 >> v2:172.21.15.105:3300/0 conn(0x7f315414fd10 0x7f31541501b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T03:00:30.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:30.635+0000 7f3153fff700 1 --2- 172.21.15.57:0/2372238131 >> v2:172.21.15.105:3300/0 conn(0x7f315414fd10 0x7f31541501b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-06T03:00:30.831 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:30.827+0000 7f31537fe700 1 -- 172.21.15.57:0/2372238131 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2446263546 0 0) 0x7f315415d660 con 0x7f3154159750 2023-10-06T03:00:30.831 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:30.827+0000 7f31537fe700 1 -- 172.21.15.57:0/2372238131 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3144003570 con 0x7f3154159750 2023-10-06T03:00:30.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:30.827+0000 7f31537fe700 1 -- 172.21.15.57:0/2372238131 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1008176594 0 0) 0x7f3144003570 con 0x7f3154159750 2023-10-06T03:00:30.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:30.827+0000 7f31537fe700 1 -- 172.21.15.57:0/2372238131 >> v2:172.21.15.105:3300/0 conn(0x7f315414fd10 msgr2=0x7f31541501b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T03:00:30.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:30.827+0000 7f31537fe700 1 --2- 172.21.15.57:0/2372238131 >> v2:172.21.15.105:3300/0 conn(0x7f315414fd10 0x7f31541501b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:30.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:30.827+0000 7f31537fe700 1 -- 172.21.15.57:0/2372238131 >> v2:172.21.15.57:3300/0 conn(0x7f315415cd50 msgr2=0x7f315415d120 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T03:00:30.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:30.827+0000 7f31537fe700 1 --2- 172.21.15.57:0/2372238131 >> v2:172.21.15.57:3300/0 conn(0x7f315415cd50 0x7f315415d120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:30.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:30.827+0000 7f31537fe700 1 -- 172.21.15.57:0/2372238131 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f315406afb0 con 0x7f3154159750 2023-10-06T03:00:30.834 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:30.827+0000 7f31537fe700 1 -- 172.21.15.57:0/2372238131 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2482400018 0 0) 0x7f314c0017f0 con 0x7f3154159750 2023-10-06T03:00:30.834 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:30.827+0000 7f31537fe700 1 -- 172.21.15.57:0/2372238131 >> v1:172.21.15.57:6789/0 conn(0x7f3154159750 legacy=0x7f3154159bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:30.835 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:30.827+0000 7f31537fe700 1 --2- 172.21.15.57:0/2372238131 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3144003a60 0x7f3144003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:30.835 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:30.827+0000 7f31537fe700 1 --2- 172.21.15.57:0/2372238131 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3144004810 0x7f3144004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:30.835 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:30.827+0000 7f31537fe700 1 --2- 172.21.15.57:0/2372238131 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f31440051c0 0x7f314400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:30.835 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:30.827+0000 7f31537fe700 1 -- 172.21.15.57:0/2372238131 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31541506f0 con 0x7f3144003a60 2023-10-06T03:00:30.835 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:30.827+0000 7f31537fe700 1 -- 172.21.15.57:0/2372238131 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f315406e300 con 0x7f3144004810 2023-10-06T03:00:30.835 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:30.827+0000 7f31537fe700 1 -- 172.21.15.57:0/2372238131 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f314400c1b0 con 0x7f31440051c0 2023-10-06T03:00:30.835 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:30.827+0000 7f3153fff700 1 --2- 172.21.15.57:0/2372238131 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3144004810 0x7f3144004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:30.835 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:30.827+0000 7f31589ca700 1 --2- 172.21.15.57:0/2372238131 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3144003a60 0x7f3144003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:30.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:30.831+0000 7f31591cb700 1 --2- 172.21.15.57:0/2372238131 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f31440051c0 0x7f314400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:30.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:30.831+0000 7f31589ca700 1 -- 172.21.15.57:0/2372238131 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f31440051c0 msgr2=0x7f314400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:30.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:30.831+0000 7f31589ca700 1 --2- 172.21.15.57:0/2372238131 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f31440051c0 0x7f314400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:30.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:30.831+0000 7f31589ca700 1 -- 172.21.15.57:0/2372238131 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3144004810 msgr2=0x7f3144004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:30.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:30.831+0000 7f31589ca700 1 --2- 172.21.15.57:0/2372238131 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3144004810 0x7f3144004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:30.837 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:30.831+0000 7f31589ca700 1 -- 172.21.15.57:0/2372238131 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3144003570 con 0x7f3144003a60 2023-10-06T03:00:30.837 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:30.831+0000 7f31591cb700 1 -- 172.21.15.57:0/2372238131 reap_dead start 2023-10-06T03:00:30.837 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:30.831+0000 7f3153fff700 1 --2- 172.21.15.57:0/2372238131 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3144004810 0x7f3144004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:00:30.837 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:30.831+0000 7f31589ca700 1 --2- 172.21.15.57:0/2372238131 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3144003a60 0x7f3144003e70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3148009060 tx=0x7f3148008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65b2e9b3f3505a98 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:30.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:30.835+0000 7f31537fe700 1 -- 172.21.15.57:0/2372238131 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f314800c070 con 0x7f3144003a60 2023-10-06T03:00:30.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:30.835+0000 7f31537fe700 1 -- 172.21.15.57:0/2372238131 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f314800e5e0 con 0x7f3144003a60 2023-10-06T03:00:30.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:30.835+0000 7f31537fe700 1 -- 172.21.15.57:0/2372238131 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f314800e770 con 0x7f3144003a60 2023-10-06T03:00:30.841 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:30.835+0000 7f315ac2e700 1 -- 172.21.15.57:0/2372238131 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3144003a60 msgr2=0x7f3144003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:30.841 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:30.835+0000 7f315ac2e700 1 --2- 172.21.15.57:0/2372238131 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3144003a60 0x7f3144003e70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3148009060 tx=0x7f3148008040 comp rx=0 tx=0).stop 2023-10-06T03:00:30.841 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:30.835+0000 7f315ac2e700 1 -- 172.21.15.57:0/2372238131 shutdown_connections 2023-10-06T03:00:30.842 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:30.835+0000 7f315ac2e700 1 --2- 172.21.15.57:0/2372238131 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3144003a60 0x7f3144003e70 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:30.842 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:30.835+0000 7f315ac2e700 1 -- 172.21.15.57:0/2372238131 >> 172.21.15.57:0/2372238131 conn(0x7f31540ccbc0 msgr2=0x7f31540ccfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:30.842 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:30.835+0000 7f315ac2e700 1 -- 172.21.15.57:0/2372238131 shutdown_connections 2023-10-06T03:00:30.842 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:30.835+0000 7f315ac2e700 1 -- 172.21.15.57:0/2372238131 wait complete. 2023-10-06T03:00:30.844 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:30.839+0000 7f315ac2e700 1 Processor -- start 2023-10-06T03:00:30.845 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:30.839+0000 7f315ac2e700 1 -- start start 2023-10-06T03:00:30.846 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:30.839+0000 7f315ac2e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3144003a60 0x7f31540c9a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:30.846 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:30.839+0000 7f315ac2e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f315414d730 0x7f31540b3860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:30.847 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:30.839+0000 7f315ac2e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f315414f030 0x7f315414f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:30.847 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:30.839+0000 7f315ac2e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31540c93f0 con 0x7f3144003a60 2023-10-06T03:00:30.847 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:30.839+0000 7f315ac2e700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f315414f9e0 con 0x7f315414d730 2023-10-06T03:00:30.847 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:30.839+0000 7f315ac2e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31540c9580 con 0x7f315414f030 2023-10-06T03:00:30.847 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:30.839+0000 7f31589ca700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3144003a60 0x7f31540c9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:30.847 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:30.839+0000 7f31589ca700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3144003a60 0x7f31540c9a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33788/0 (socket says 172.21.15.57:33788) 2023-10-06T03:00:30.847 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:30.839+0000 7f31589ca700 1 -- 172.21.15.57:0/1544306881 learned_addr learned my addr 172.21.15.57:0/1544306881 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:00:30.847 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:30.839+0000 7f3153fff700 1 --2- 172.21.15.57:0/1544306881 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f315414d730 0x7f31540b3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:30.847 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:30.839+0000 7f31591cb700 1 --2- 172.21.15.57:0/1544306881 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f315414f030 0x7f315414f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:30.848 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:30.843+0000 7f3153fff700 1 -- 172.21.15.57:0/1544306881 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f315414f030 msgr2=0x7f315414f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:30.848 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:30.843+0000 7f3153fff700 1 --2- 172.21.15.57:0/1544306881 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f315414f030 0x7f315414f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:30.848 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:30.843+0000 7f3153fff700 1 -- 172.21.15.57:0/1544306881 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3144003a60 msgr2=0x7f31540c9a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:30.849 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:30.843+0000 7f3153fff700 1 --2- 172.21.15.57:0/1544306881 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3144003a60 0x7f31540c9a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:30.849 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:30.843+0000 7f3153fff700 1 -- 172.21.15.57:0/1544306881 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31540c7530 con 0x7f315414d730 2023-10-06T03:00:30.849 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:30.843+0000 7f31591cb700 1 --2- 172.21.15.57:0/1544306881 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f315414f030 0x7f315414f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:00:30.849 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:30.843+0000 7f31589ca700 1 --2- 172.21.15.57:0/1544306881 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3144003a60 0x7f31540c9a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:00:30.849 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:30.843+0000 7f3153fff700 1 --2- 172.21.15.57:0/1544306881 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f315414d730 0x7f31540b3860 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3140006f30 tx=0x7f3140008040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:30.849 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:30.843+0000 7f3150ff9700 1 -- 172.21.15.57:0/1544306881 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f314000e870 con 0x7f315414d730 2023-10-06T03:00:30.849 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:30.843+0000 7f3150ff9700 1 -- 172.21.15.57:0/1544306881 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f314000e9d0 con 0x7f315414d730 2023-10-06T03:00:30.849 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:30.843+0000 7f315ac2e700 1 -- 172.21.15.57:0/1544306881 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31540c77d0 con 0x7f315414d730 2023-10-06T03:00:30.849 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:30.843+0000 7f3150ff9700 1 -- 172.21.15.57:0/1544306881 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f314000ed70 con 0x7f315414d730 2023-10-06T03:00:30.849 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:30.843+0000 7f315ac2e700 1 -- 172.21.15.57:0/1544306881 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31540c7d90 con 0x7f315414d730 2023-10-06T03:00:30.850 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:30.843+0000 7f3150ff9700 1 -- 172.21.15.57:0/1544306881 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f3140016690 con 0x7f315414d730 2023-10-06T03:00:30.850 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:30.843+0000 7f3150ff9700 1 -- 172.21.15.57:0/1544306881 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f3140014780 con 0x7f315414d730 2023-10-06T03:00:30.850 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:30.843+0000 7f315ac2e700 1 -- 172.21.15.57:0/1544306881 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31540689c0 con 0x7f315414d730 2023-10-06T03:00:30.854 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:30.847+0000 7f3150ff9700 1 -- 172.21.15.57:0/1544306881 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f314003e6d0 con 0x7f315414d730 2023-10-06T03:00:30.958 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:30.951+0000 7f315ac2e700 1 -- 172.21.15.57:0/1544306881 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f31540c7fb0 con 0x7f315414d730 2023-10-06T03:00:30.973 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:30.967+0000 7f3150ff9700 1 -- 172.21.15.57:0/1544306881 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f314002d070 con 0x7f315414d730 2023-10-06T03:00:30.974 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:30.967+0000 7f315ac2e700 1 -- 172.21.15.57:0/1544306881 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f315414d730 msgr2=0x7f31540b3860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:30.975 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:30.967+0000 7f315ac2e700 1 --2- 172.21.15.57:0/1544306881 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f315414d730 0x7f31540b3860 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3140006f30 tx=0x7f3140008040 comp rx=0 tx=0).stop 2023-10-06T03:00:30.975 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:30.967+0000 7f315ac2e700 1 -- 172.21.15.57:0/1544306881 shutdown_connections 2023-10-06T03:00:30.975 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:30.967+0000 7f315ac2e700 1 --2- 172.21.15.57:0/1544306881 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f315414f030 0x7f315414f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:30.975 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:30.967+0000 7f315ac2e700 1 --2- 172.21.15.57:0/1544306881 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f315414d730 0x7f31540b3860 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:30.975 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:30.967+0000 7f315ac2e700 1 --2- 172.21.15.57:0/1544306881 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3144003a60 0x7f31540c9a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:30.975 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:30.967+0000 7f315ac2e700 1 -- 172.21.15.57:0/1544306881 >> 172.21.15.57:0/1544306881 conn(0x7f31540ccbc0 msgr2=0x7f315414e730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:30.976 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:30.971+0000 7f315ac2e700 1 -- 172.21.15.57:0/1544306881 shutdown_connections 2023-10-06T03:00:30.976 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:30.971+0000 7f315ac2e700 1 -- 172.21.15.57:0/1544306881 wait complete. 2023-10-06T03:00:30.977 INFO:teuthology.orchestra.run.smithi057.stderr:adjusted tunables profile to default 2023-10-06T03:00:30.996 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-10-06T03:00:30.996 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-10-06T03:00:30.996 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-10-06T03:00:31.027 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-10-06T03:00:31.028 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-10-06T03:00:31.085 INFO:tasks.ceph.mgr.y.smithi057.stderr:2023-10-06T03:00:31.079+0000 7f64df3c7000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-06T03:00:31.090 INFO:tasks.ceph.mgr.x.smithi105.stderr:2023-10-06T03:00:31.085+0000 7fb6d0aeb000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-06T03:00:31.102 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-10-06T03:00:31.102 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-10-06T03:00:31.181 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-10-06T03:00:31.181 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-10-06T03:00:31.254 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2023-10-06T03:00:31.254 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-10-06T03:00:31.286 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2023-10-06T03:00:31.287 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-10-06T03:00:31.364 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2023-10-06T03:00:31.365 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-10-06T03:00:31.438 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2023-10-06T03:00:31.438 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-10-06T03:00:31.514 DEBUG:teuthology.orchestra.run.smithi105:> sudo ceph --cluster ceph osd new 58cf6c90-d704-43e0-b2db-dffe526d5e8f 0 2023-10-06T03:00:31.707 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.701+0000 7fe269ae3700 1 Processor -- start 2023-10-06T03:00:31.707 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.701+0000 7fe269ae3700 1 -- start start 2023-10-06T03:00:31.710 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.705+0000 7fe269ae3700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe2641571e0 0x7fe2640ac800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:31.710 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.705+0000 7fe269ae3700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe264157640 con 0x7fe2640acd40 2023-10-06T03:00:31.710 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.705+0000 7fe269ae3700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2640c9c50 con 0x7fe264156e10 2023-10-06T03:00:31.710 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.705+0000 7fe269ae3700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe26406d3d0 con 0x7fe2641571e0 2023-10-06T03:00:31.711 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.705+0000 7fe268ae1700 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7fe264156e10 0x7fe2640afd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.105:42668/0 (socket says 172.21.15.105:42668) 2023-10-06T03:00:31.711 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.705+0000 7fe268ae1700 1 -- 172.21.15.105:0/2729916762 learned_addr learned my addr 172.21.15.105:0/2729916762 (peer_addr_for_me v1:172.21.15.105:0/0) 2023-10-06T03:00:31.713 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.705+0000 7fe263fff700 1 --2- 172.21.15.105:0/2729916762 >> v2:172.21.15.57:3300/0 conn(0x7fe2641571e0 0x7fe2640ac800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:31.714 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.705+0000 7fe2637fe700 1 -- 172.21.15.105:0/2729916762 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1057959056 0 0) 0x7fe2640c9c50 con 0x7fe264156e10 2023-10-06T03:00:31.714 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.705+0000 7fe2637fe700 1 -- 172.21.15.105:0/2729916762 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe254003570 con 0x7fe264156e10 2023-10-06T03:00:31.714 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.705+0000 7fe2637fe700 1 -- 172.21.15.105:0/2729916762 <== mon.1 v1:172.21.15.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1073631560 0 0) 0x7fe254003570 con 0x7fe264156e10 2023-10-06T03:00:31.714 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.705+0000 7fe2637fe700 1 -- 172.21.15.105:0/2729916762 >> v2:172.21.15.57:3300/0 conn(0x7fe2641571e0 msgr2=0x7fe2640ac800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:31.714 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.705+0000 7fe2637fe700 1 --2- 172.21.15.105:0/2729916762 >> v2:172.21.15.57:3300/0 conn(0x7fe2641571e0 0x7fe2640ac800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:31.714 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.705+0000 7fe2637fe700 1 -- 172.21.15.105:0/2729916762 >> v1:172.21.15.57:6789/0 conn(0x7fe2640acd40 legacy=0x7fe2640ad9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:31.715 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.705+0000 7fe2637fe700 1 -- 172.21.15.105:0/2729916762 --> v1:172.21.15.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe26406d670 con 0x7fe264156e10 2023-10-06T03:00:31.715 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.705+0000 7fe2637fe700 1 -- 172.21.15.105:0/2729916762 <== mon.1 v1:172.21.15.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2482400018 0 0) 0x7fe258001470 con 0x7fe264156e10 2023-10-06T03:00:31.715 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.705+0000 7fe2637fe700 1 -- 172.21.15.105:0/2729916762 >> v1:172.21.15.105:6789/0 conn(0x7fe264156e10 legacy=0x7fe2640afd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:31.715 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.705+0000 7fe2637fe700 1 --2- 172.21.15.105:0/2729916762 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe254003a60 0x7fe254003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:31.715 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.705+0000 7fe2637fe700 1 --2- 172.21.15.105:0/2729916762 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe254004810 0x7fe254004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:31.716 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.705+0000 7fe2637fe700 1 --2- 172.21.15.105:0/2729916762 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe2540051c0 0x7fe25400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:31.716 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.705+0000 7fe2637fe700 1 -- 172.21.15.105:0/2729916762 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe26406d3d0 con 0x7fe254003a60 2023-10-06T03:00:31.716 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.705+0000 7fe2637fe700 1 -- 172.21.15.105:0/2729916762 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe25400c0d0 con 0x7fe254004810 2023-10-06T03:00:31.716 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.705+0000 7fe2637fe700 1 -- 172.21.15.105:0/2729916762 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe25400c290 con 0x7fe2540051c0 2023-10-06T03:00:31.716 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.705+0000 7fe263fff700 1 --2- 172.21.15.105:0/2729916762 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe254004810 0x7fe254004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:31.716 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.705+0000 7fe2692e2700 1 --2- 172.21.15.105:0/2729916762 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe2540051c0 0x7fe25400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:31.717 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.705+0000 7fe268ae1700 1 --2- 172.21.15.105:0/2729916762 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe254003a60 0x7fe254003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:31.717 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.705+0000 7fe263fff700 1 -- 172.21.15.105:0/2729916762 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe2540051c0 msgr2=0x7fe25400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:31.717 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.705+0000 7fe263fff700 1 --2- 172.21.15.105:0/2729916762 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe2540051c0 0x7fe25400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:31.717 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.705+0000 7fe263fff700 1 -- 172.21.15.105:0/2729916762 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe254003a60 msgr2=0x7fe254003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:31.717 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.705+0000 7fe263fff700 1 --2- 172.21.15.105:0/2729916762 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe254003a60 0x7fe254003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:31.717 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.705+0000 7fe263fff700 1 -- 172.21.15.105:0/2729916762 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe254003570 con 0x7fe254004810 2023-10-06T03:00:31.718 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.705+0000 7fe268ae1700 1 --2- 172.21.15.105:0/2729916762 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe254003a60 0x7fe254003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:00:31.718 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.705+0000 7fe2692e2700 1 -- 172.21.15.105:0/2729916762 reap_dead start 2023-10-06T03:00:31.718 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.705+0000 7fe263fff700 1 --2- 172.21.15.105:0/2729916762 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe254004810 0x7fe254004c80 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fe250009c00 tx=0x7fe2500091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=77dd1932c9d024f0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:31.718 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.709+0000 7fe2637fe700 1 -- 172.21.15.105:0/2729916762 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe25000e710 con 0x7fe254004810 2023-10-06T03:00:31.718 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.709+0000 7fe2637fe700 1 -- 172.21.15.105:0/2729916762 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe25000e870 con 0x7fe254004810 2023-10-06T03:00:31.718 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.709+0000 7fe2637fe700 1 -- 172.21.15.105:0/2729916762 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe25000ec30 con 0x7fe254004810 2023-10-06T03:00:31.723 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.709+0000 7fe269ae3700 1 -- 172.21.15.105:0/2729916762 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe254004810 msgr2=0x7fe254004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:31.723 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.709+0000 7fe269ae3700 1 --2- 172.21.15.105:0/2729916762 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe254004810 0x7fe254004c80 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fe250009c00 tx=0x7fe2500091a0 comp rx=0 tx=0).stop 2023-10-06T03:00:31.723 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.709+0000 7fe269ae3700 1 -- 172.21.15.105:0/2729916762 shutdown_connections 2023-10-06T03:00:31.724 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.709+0000 7fe269ae3700 1 --2- 172.21.15.105:0/2729916762 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe254004810 0x7fe254004c80 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:31.724 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.709+0000 7fe269ae3700 1 -- 172.21.15.105:0/2729916762 >> 172.21.15.105:0/2729916762 conn(0x7fe2640ca860 msgr2=0x7fe2640cac60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:31.724 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.709+0000 7fe269ae3700 1 -- 172.21.15.105:0/2729916762 shutdown_connections 2023-10-06T03:00:31.724 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.709+0000 7fe269ae3700 1 -- 172.21.15.105:0/2729916762 wait complete. 2023-10-06T03:00:31.724 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.713+0000 7fe269ae3700 1 Processor -- start 2023-10-06T03:00:31.724 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.713+0000 7fe269ae3700 1 -- start start 2023-10-06T03:00:31.724 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.713+0000 7fe269ae3700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe254004810 0x7fe2640c5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:31.725 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.713+0000 7fe269ae3700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe26415cb40 0x7fe26415cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:31.725 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.713+0000 7fe269ae3700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2640c62c0 0x7fe2640c6730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:31.725 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.713+0000 7fe269ae3700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2640c5140 con 0x7fe26415cb40 2023-10-06T03:00:31.725 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.713+0000 7fe269ae3700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe26415d4f0 con 0x7fe2640c62c0 2023-10-06T03:00:31.725 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.713+0000 7fe269ae3700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2640c6c70 con 0x7fe254004810 2023-10-06T03:00:31.725 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.713+0000 7fe268ae1700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe254004810 0x7fe2640c5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:31.726 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.713+0000 7fe2692e2700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2640c62c0 0x7fe2640c6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:31.726 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.713+0000 7fe268ae1700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe254004810 0x7fe2640c5c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.105:53504/0 (socket says 172.21.15.105:53504) 2023-10-06T03:00:31.726 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.713+0000 7fe268ae1700 1 -- 172.21.15.105:0/2683959153 learned_addr learned my addr 172.21.15.105:0/2683959153 (peer_addr_for_me v2:172.21.15.105:0/0) 2023-10-06T03:00:31.726 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.713+0000 7fe263fff700 1 --2- 172.21.15.105:0/2683959153 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe26415cb40 0x7fe26415cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:31.726 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.713+0000 7fe268ae1700 1 -- 172.21.15.105:0/2683959153 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2640c62c0 msgr2=0x7fe2640c6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:31.726 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.713+0000 7fe268ae1700 1 --2- 172.21.15.105:0/2683959153 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2640c62c0 0x7fe2640c6730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:31.726 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.713+0000 7fe268ae1700 1 -- 172.21.15.105:0/2683959153 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe26415cb40 msgr2=0x7fe26415cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:31.727 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.713+0000 7fe268ae1700 1 --2- 172.21.15.105:0/2683959153 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe26415cb40 0x7fe26415cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:31.727 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.713+0000 7fe268ae1700 1 -- 172.21.15.105:0/2683959153 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe264067380 con 0x7fe254004810 2023-10-06T03:00:31.727 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.717+0000 7fe268ae1700 1 --2- 172.21.15.105:0/2683959153 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe254004810 0x7fe2640c5c40 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe25800dbe0 tx=0x7fe258009040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:31.727 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.717+0000 7fe260ff9700 1 -- 172.21.15.105:0/2683959153 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe258007430 con 0x7fe254004810 2023-10-06T03:00:31.727 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.717+0000 7fe260ff9700 1 -- 172.21.15.105:0/2683959153 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe258007590 con 0x7fe254004810 2023-10-06T03:00:31.727 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.717+0000 7fe260ff9700 1 -- 172.21.15.105:0/2683959153 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe258004a60 con 0x7fe254004810 2023-10-06T03:00:31.728 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.717+0000 7fe269ae3700 1 -- 172.21.15.105:0/2683959153 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe264067050 con 0x7fe254004810 2023-10-06T03:00:31.728 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.717+0000 7fe269ae3700 1 -- 172.21.15.105:0/2683959153 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe26415da00 con 0x7fe254004810 2023-10-06T03:00:31.728 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.717+0000 7fe260ff9700 1 -- 172.21.15.105:0/2683959153 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fe25800b840 con 0x7fe254004810 2023-10-06T03:00:31.728 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.717+0000 7fe260ff9700 1 -- 172.21.15.105:0/2683959153 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 721+0+0 (secure 0 0 0) 0x7fe25801e790 con 0x7fe254004810 2023-10-06T03:00:31.729 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.717+0000 7fe269ae3700 1 -- 172.21.15.105:0/2683959153 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe26404be40 con 0x7fe254004810 2023-10-06T03:00:31.729 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.721+0000 7fe260ff9700 1 -- 172.21.15.105:0/2683959153 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fe258023060 con 0x7fe254004810 2023-10-06T03:00:31.804 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.797+0000 7fe269ae3700 1 -- 172.21.15.105:0/2683959153 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "osd new", "uuid": "58cf6c90-d704-43e0-b2db-dffe526d5e8f", "id": 0} v 0) v1 -- 0x7fe2640c85d0 con 0x7fe254004810 2023-10-06T03:00:31.805 INFO:tasks.ceph.mgr.y.smithi057.stderr:2023-10-06T03:00:31.799+0000 7f64df3c7000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-06T03:00:31.816 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.809+0000 7fe260ff9700 1 -- 172.21.15.105:0/2683959153 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "58cf6c90-d704-43e0-b2db-dffe526d5e8f", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe258019070 con 0x7fe254004810 2023-10-06T03:00:31.817 INFO:teuthology.orchestra.run.smithi105.stdout:0 2023-10-06T03:00:31.818 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.813+0000 7fe269ae3700 1 -- 172.21.15.105:0/2683959153 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe254004810 msgr2=0x7fe2640c5c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:31.818 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.813+0000 7fe269ae3700 1 --2- 172.21.15.105:0/2683959153 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe254004810 0x7fe2640c5c40 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe25800dbe0 tx=0x7fe258009040 comp rx=0 tx=0).stop 2023-10-06T03:00:31.818 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.813+0000 7fe269ae3700 1 -- 172.21.15.105:0/2683959153 shutdown_connections 2023-10-06T03:00:31.818 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.813+0000 7fe269ae3700 1 --2- 172.21.15.105:0/2683959153 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2640c62c0 0x7fe2640c6730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:31.819 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.813+0000 7fe269ae3700 1 --2- 172.21.15.105:0/2683959153 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe26415cb40 0x7fe26415cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:31.819 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.813+0000 7fe269ae3700 1 --2- 172.21.15.105:0/2683959153 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe254004810 0x7fe2640c5c40 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:31.819 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.813+0000 7fe269ae3700 1 -- 172.21.15.105:0/2683959153 >> 172.21.15.105:0/2683959153 conn(0x7fe2640ca860 msgr2=0x7fe2640b3800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:31.819 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.813+0000 7fe269ae3700 1 -- 172.21.15.105:0/2683959153 shutdown_connections 2023-10-06T03:00:31.819 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.813+0000 7fe269ae3700 1 -- 172.21.15.105:0/2683959153 wait complete. 2023-10-06T03:00:31.837 INFO:tasks.ceph.mgr.x.smithi105.stderr:2023-10-06T03:00:31.829+0000 7fb6d0aeb000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-06T03:00:31.840 DEBUG:teuthology.orchestra.run.smithi105:> sudo ceph --cluster ceph osd new 16afbe70-7f9e-4568-9c92-763e6e348119 1 2023-10-06T03:00:31.888 INFO:tasks.ceph.mgr.y.smithi057.stderr:2023-10-06T03:00:31.883+0000 7f64df3c7000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-06T03:00:31.921 INFO:tasks.ceph.mgr.x.smithi105.stderr:2023-10-06T03:00:31.913+0000 7fb6d0aeb000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-06T03:00:31.982 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.977+0000 7fa2dca6e700 1 Processor -- start 2023-10-06T03:00:31.982 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.977+0000 7fa2dca6e700 1 -- start start 2023-10-06T03:00:31.983 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.977+0000 7fa2dca6e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa2d80aeb10 0x7fa2d80adf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:31.983 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.977+0000 7fa2dca6e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2d806afd0 con 0x7fa2d81571f0 2023-10-06T03:00:31.983 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.977+0000 7fa2dca6e700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2d806d740 con 0x7fa2d8156e20 2023-10-06T03:00:31.983 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.977+0000 7fa2dca6e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d80ac6c0 con 0x7fa2d80aeb10 2023-10-06T03:00:31.984 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.977+0000 7fa2d659c700 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7fa2d8156e20 0x7fa2d806c920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.105:42674/0 (socket says 172.21.15.105:42674) 2023-10-06T03:00:31.984 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.977+0000 7fa2d659c700 1 -- 172.21.15.105:0/2264768952 learned_addr learned my addr 172.21.15.105:0/2264768952 (peer_addr_for_me v1:172.21.15.105:0/0) 2023-10-06T03:00:31.984 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.977+0000 7fa2cffff700 1 --2- 172.21.15.105:0/2264768952 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa2d80aeb10 0x7fa2d80adf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:31.984 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.977+0000 7fa2cffff700 1 -- 172.21.15.105:0/2264768952 >> v1:172.21.15.105:6789/0 conn(0x7fa2d8156e20 legacy=0x7fa2d806c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:31.984 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.977+0000 7fa2cffff700 1 -- 172.21.15.105:0/2264768952 >> v1:172.21.15.57:6789/0 conn(0x7fa2d81571f0 legacy=0x7fa2d806d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:31.985 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.977+0000 7fa2cffff700 1 -- 172.21.15.105:0/2264768952 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2d80ac9a0 con 0x7fa2d80aeb10 2023-10-06T03:00:31.985 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.977+0000 7fa2cffff700 1 --2- 172.21.15.105:0/2264768952 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa2d80aeb10 0x7fa2d80adf80 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa2c0009910 tx=0x7fa2c00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=68362fb65a159fbf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:31.985 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.977+0000 7fa2d5d9b700 1 -- 172.21.15.105:0/2264768952 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c000b820 con 0x7fa2d80aeb10 2023-10-06T03:00:31.985 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.977+0000 7fa2d5d9b700 1 -- 172.21.15.105:0/2264768952 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2c000b980 con 0x7fa2d80aeb10 2023-10-06T03:00:31.986 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.977+0000 7fa2d5d9b700 1 -- 172.21.15.105:0/2264768952 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c000bd20 con 0x7fa2d80aeb10 2023-10-06T03:00:31.986 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.981+0000 7fa2dca6e700 1 -- 172.21.15.105:0/2264768952 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa2d80aeb10 msgr2=0x7fa2d80adf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:31.986 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.981+0000 7fa2dca6e700 1 --2- 172.21.15.105:0/2264768952 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa2d80aeb10 0x7fa2d80adf80 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa2c0009910 tx=0x7fa2c00091a0 comp rx=0 tx=0).stop 2023-10-06T03:00:31.986 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.981+0000 7fa2dca6e700 1 -- 172.21.15.105:0/2264768952 shutdown_connections 2023-10-06T03:00:31.987 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.981+0000 7fa2dca6e700 1 --2- 172.21.15.105:0/2264768952 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa2d80aeb10 0x7fa2d80adf80 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:31.987 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.981+0000 7fa2dca6e700 1 -- 172.21.15.105:0/2264768952 >> 172.21.15.105:0/2264768952 conn(0x7fa2d80c87b0 msgr2=0x7fa2d80c8bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:31.987 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.981+0000 7fa2dca6e700 1 -- 172.21.15.105:0/2264768952 shutdown_connections 2023-10-06T03:00:31.987 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.981+0000 7fa2dca6e700 1 -- 172.21.15.105:0/2264768952 wait complete. 2023-10-06T03:00:31.988 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.981+0000 7fa2dca6e700 1 Processor -- start 2023-10-06T03:00:31.989 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.985+0000 7fa2dca6e700 1 -- start start 2023-10-06T03:00:31.991 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.985+0000 7fa2dca6e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa2d80aeb10 0x7fa2d815a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:31.991 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.985+0000 7fa2dca6e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa2d8156e20 0x7fa2d80c2d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:31.991 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.985+0000 7fa2dca6e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa2d81571f0 0x7fa2d8167310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:31.991 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.985+0000 7fa2dca6e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d81594b0 con 0x7fa2d80aeb10 2023-10-06T03:00:31.991 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.985+0000 7fa2dca6e700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d8159790 con 0x7fa2d8156e20 2023-10-06T03:00:31.992 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.985+0000 7fa2dca6e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d8159a70 con 0x7fa2d81571f0 2023-10-06T03:00:31.992 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.985+0000 7fa2cffff700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa2d8156e20 0x7fa2d80c2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:31.992 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.985+0000 7fa2d6d9d700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa2d81571f0 0x7fa2d8167310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:31.992 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.985+0000 7fa2cffff700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa2d8156e20 0x7fa2d80c2d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:55164/0 (socket says 172.21.15.105:55164) 2023-10-06T03:00:31.992 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.985+0000 7fa2cffff700 1 -- 172.21.15.105:0/2972182840 learned_addr learned my addr 172.21.15.105:0/2972182840 (peer_addr_for_me v2:172.21.15.105:0/0) 2023-10-06T03:00:31.993 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.985+0000 7fa2d659c700 1 --2- 172.21.15.105:0/2972182840 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa2d80aeb10 0x7fa2d815a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:31.993 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.985+0000 7fa2cffff700 1 -- 172.21.15.105:0/2972182840 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa2d81571f0 msgr2=0x7fa2d8167310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:31.993 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.985+0000 7fa2cffff700 1 --2- 172.21.15.105:0/2972182840 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa2d81571f0 0x7fa2d8167310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:31.993 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.985+0000 7fa2cffff700 1 -- 172.21.15.105:0/2972182840 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa2d80aeb10 msgr2=0x7fa2d815a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:31.993 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.985+0000 7fa2cffff700 1 --2- 172.21.15.105:0/2972182840 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa2d80aeb10 0x7fa2d815a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:31.993 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.985+0000 7fa2cffff700 1 -- 172.21.15.105:0/2972182840 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2c0009420 con 0x7fa2d8156e20 2023-10-06T03:00:31.993 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.985+0000 7fa2d6d9d700 1 --2- 172.21.15.105:0/2972182840 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa2d81571f0 0x7fa2d8167310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:00:31.993 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.985+0000 7fa2d659c700 1 --2- 172.21.15.105:0/2972182840 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa2d80aeb10 0x7fa2d815a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:00:31.993 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.985+0000 7fa2cffff700 1 --2- 172.21.15.105:0/2972182840 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa2d8156e20 0x7fa2d80c2d90 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa2c00030c0 tx=0x7fa2c0016000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:31.993 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.985+0000 7fa2ce7fc700 1 -- 172.21.15.105:0/2972182840 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c0011c10 con 0x7fa2d8156e20 2023-10-06T03:00:31.993 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.985+0000 7fa2ce7fc700 1 -- 172.21.15.105:0/2972182840 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2c0028070 con 0x7fa2d8156e20 2023-10-06T03:00:31.994 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.985+0000 7fa2ce7fc700 1 -- 172.21.15.105:0/2972182840 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c001b450 con 0x7fa2d8156e20 2023-10-06T03:00:31.994 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.985+0000 7fa2dca6e700 1 -- 172.21.15.105:0/2972182840 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2d8159d50 con 0x7fa2d8156e20 2023-10-06T03:00:31.994 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.989+0000 7fa2dca6e700 1 -- 172.21.15.105:0/2972182840 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2d80c32d0 con 0x7fa2d8156e20 2023-10-06T03:00:31.994 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.989+0000 7fa2ce7fc700 1 -- 172.21.15.105:0/2972182840 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fa2c002a030 con 0x7fa2d8156e20 2023-10-06T03:00:31.994 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.989+0000 7fa2ce7fc700 1 -- 172.21.15.105:0/2972182840 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 836+0+0 (secure 0 0 0) 0x7fa2c00368e0 con 0x7fa2d8156e20 2023-10-06T03:00:31.995 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.989+0000 7fa2dca6e700 1 -- 172.21.15.105:0/2972182840 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2d80c9a80 con 0x7fa2d8156e20 2023-10-06T03:00:31.999 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:31.993+0000 7fa2ce7fc700 1 -- 172.21.15.105:0/2972182840 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fa2d80c9a80 con 0x7fa2d8156e20 2023-10-06T03:00:32.023 INFO:tasks.ceph.mgr.y.smithi057.stderr:2023-10-06T03:00:32.019+0000 7f64df3c7000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-06T03:00:32.125 INFO:tasks.ceph.mgr.x.smithi105.stderr:2023-10-06T03:00:32.121+0000 7fb6d0aeb000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-06T03:00:32.149 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.145+0000 7fa2dca6e700 1 -- 172.21.15.105:0/2972182840 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd new", "uuid": "16afbe70-7f9e-4568-9c92-763e6e348119", "id": 1} v 0) v1 -- 0x7fa2d80c34c0 con 0x7fa2d8156e20 2023-10-06T03:00:32.165 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.157+0000 7fa2ce7fc700 1 -- 172.21.15.105:0/2972182840 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "16afbe70-7f9e-4568-9c92-763e6e348119", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa2c001bbd0 con 0x7fa2d8156e20 2023-10-06T03:00:32.165 INFO:teuthology.orchestra.run.smithi105.stdout:1 2023-10-06T03:00:32.167 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.161+0000 7fa2dca6e700 1 -- 172.21.15.105:0/2972182840 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa2d8156e20 msgr2=0x7fa2d80c2d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:32.167 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.161+0000 7fa2dca6e700 1 --2- 172.21.15.105:0/2972182840 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa2d8156e20 0x7fa2d80c2d90 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa2c00030c0 tx=0x7fa2c0016000 comp rx=0 tx=0).stop 2023-10-06T03:00:32.167 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.161+0000 7fa2dca6e700 1 -- 172.21.15.105:0/2972182840 shutdown_connections 2023-10-06T03:00:32.167 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.161+0000 7fa2dca6e700 1 --2- 172.21.15.105:0/2972182840 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa2d81571f0 0x7fa2d8167310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:32.167 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.161+0000 7fa2dca6e700 1 --2- 172.21.15.105:0/2972182840 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa2d8156e20 0x7fa2d80c2d90 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:32.167 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.161+0000 7fa2dca6e700 1 --2- 172.21.15.105:0/2972182840 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa2d80aeb10 0x7fa2d815a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:32.167 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.161+0000 7fa2dca6e700 1 -- 172.21.15.105:0/2972182840 >> 172.21.15.105:0/2972182840 conn(0x7fa2d80c87b0 msgr2=0x7fa2d80cb0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:32.167 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.161+0000 7fa2dca6e700 1 -- 172.21.15.105:0/2972182840 shutdown_connections 2023-10-06T03:00:32.168 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.161+0000 7fa2dca6e700 1 -- 172.21.15.105:0/2972182840 wait complete. 2023-10-06T03:00:32.186 DEBUG:teuthology.orchestra.run.smithi105:> sudo ceph --cluster ceph osd new 7255c62e-f92f-470f-a5ce-30228920d9f4 2 2023-10-06T03:00:32.314 INFO:tasks.ceph.mgr.y.smithi057.stderr:2023-10-06T03:00:32.307+0000 7f64df3c7000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-06T03:00:32.334 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.329+0000 7fb22a0e3700 1 Processor -- start 2023-10-06T03:00:32.335 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.329+0000 7fb22a0e3700 1 -- start start 2023-10-06T03:00:32.336 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.329+0000 7fb22a0e3700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb224140540 0x7fb224067490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:32.336 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.329+0000 7fb22a0e3700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb224140910 0x7fb2240679d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:32.337 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.329+0000 7fb22a0e3700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fb2240c6b20 0x7fb2240c6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:32.337 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.329+0000 7fb22a0e3700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2240c74e0 con 0x7fb224140910 2023-10-06T03:00:32.337 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.329+0000 7fb22a0e3700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb224157740 con 0x7fb2240c6b20 2023-10-06T03:00:32.337 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.329+0000 7fb22a0e3700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb224068070 con 0x7fb224140540 2023-10-06T03:00:32.337 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.329+0000 7fb2298e2700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fb2240c6b20 0x7fb2240c6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:32.337 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.329+0000 7fb2290e1700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb224140540 0x7fb224067490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:32.337 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.329+0000 7fb2298e2700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fb2240c6b20 0x7fb2240c6fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:55168/0 (socket says 172.21.15.105:55168) 2023-10-06T03:00:32.337 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.329+0000 7fb2298e2700 1 -- 172.21.15.105:0/3814853762 learned_addr learned my addr 172.21.15.105:0/3814853762 (peer_addr_for_me v2:172.21.15.105:0/0) 2023-10-06T03:00:32.338 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.329+0000 7fb2288e0700 1 --2- 172.21.15.105:0/3814853762 >> v2:172.21.15.57:3300/0 conn(0x7fb224140910 0x7fb2240679d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:32.338 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.333+0000 7fb2290e1700 1 -- 172.21.15.105:0/3814853762 >> v2:172.21.15.105:3300/0 conn(0x7fb2240c6b20 msgr2=0x7fb2240c6fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:32.338 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.333+0000 7fb2290e1700 1 --2- 172.21.15.105:0/3814853762 >> v2:172.21.15.105:3300/0 conn(0x7fb2240c6b20 0x7fb2240c6fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:32.339 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.333+0000 7fb2290e1700 1 -- 172.21.15.105:0/3814853762 >> v2:172.21.15.57:3300/0 conn(0x7fb224140910 msgr2=0x7fb2240679d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:32.339 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.333+0000 7fb2290e1700 1 --2- 172.21.15.105:0/3814853762 >> v2:172.21.15.57:3300/0 conn(0x7fb224140910 0x7fb2240679d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:32.339 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.333+0000 7fb2290e1700 1 -- 172.21.15.105:0/3814853762 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb224068350 con 0x7fb224140540 2023-10-06T03:00:32.339 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.333+0000 7fb2298e2700 1 --2- 172.21.15.105:0/3814853762 >> v2:172.21.15.105:3300/0 conn(0x7fb2240c6b20 0x7fb2240c6fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:00:32.339 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.333+0000 7fb2288e0700 1 --2- 172.21.15.105:0/3814853762 >> v2:172.21.15.57:3300/0 conn(0x7fb224140910 0x7fb2240679d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:00:32.339 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.333+0000 7fb2290e1700 1 --2- 172.21.15.105:0/3814853762 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb224140540 0x7fb224067490 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb2240c61c0 tx=0x7fb2200091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3525dedb3dfd77c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:32.339 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.333+0000 7fb21bfff700 1 -- 172.21.15.105:0/3814853762 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb220011630 con 0x7fb224140540 2023-10-06T03:00:32.339 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.333+0000 7fb21bfff700 1 -- 172.21.15.105:0/3814853762 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb220011790 con 0x7fb224140540 2023-10-06T03:00:32.339 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.333+0000 7fb21bfff700 1 -- 172.21.15.105:0/3814853762 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb220011b30 con 0x7fb224140540 2023-10-06T03:00:32.340 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.333+0000 7fb22a0e3700 1 -- 172.21.15.105:0/3814853762 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb224140540 msgr2=0x7fb224067490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:32.340 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.333+0000 7fb22a0e3700 1 --2- 172.21.15.105:0/3814853762 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb224140540 0x7fb224067490 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb2240c61c0 tx=0x7fb2200091a0 comp rx=0 tx=0).stop 2023-10-06T03:00:32.340 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.333+0000 7fb22a0e3700 1 -- 172.21.15.105:0/3814853762 shutdown_connections 2023-10-06T03:00:32.340 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.333+0000 7fb22a0e3700 1 --2- 172.21.15.105:0/3814853762 >> v2:172.21.15.105:3300/0 conn(0x7fb2240c6b20 0x7fb2240c6fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:32.340 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.333+0000 7fb22a0e3700 1 --2- 172.21.15.105:0/3814853762 >> v2:172.21.15.57:3300/0 conn(0x7fb224140910 0x7fb2240679d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:32.341 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.333+0000 7fb22a0e3700 1 --2- 172.21.15.105:0/3814853762 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb224140540 0x7fb224067490 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:32.341 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.333+0000 7fb22a0e3700 1 -- 172.21.15.105:0/3814853762 >> 172.21.15.105:0/3814853762 conn(0x7fb2240c8660 msgr2=0x7fb2240c8a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:32.341 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.333+0000 7fb22a0e3700 1 -- 172.21.15.105:0/3814853762 shutdown_connections 2023-10-06T03:00:32.341 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.333+0000 7fb22a0e3700 1 -- 172.21.15.105:0/3814853762 wait complete. 2023-10-06T03:00:32.341 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.337+0000 7fb22a0e3700 1 Processor -- start 2023-10-06T03:00:32.341 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.337+0000 7fb22a0e3700 1 -- start start 2023-10-06T03:00:32.343 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.337+0000 7fb22a0e3700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb2240c6b20 0x7fb224156680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:32.343 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.337+0000 7fb22a0e3700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb224140540 0x7fb224067330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:32.343 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.337+0000 7fb22a0e3700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb224140910 0x7fb224067870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:32.343 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.337+0000 7fb22a0e3700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2241681d0 con 0x7fb224140910 2023-10-06T03:00:32.343 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.337+0000 7fb22a0e3700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2240b0450 con 0x7fb2240c6b20 2023-10-06T03:00:32.343 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.337+0000 7fb22a0e3700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2240af7d0 con 0x7fb224140540 2023-10-06T03:00:32.345 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.337+0000 7fb2290e1700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb2240c6b20 0x7fb224156680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:32.345 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.337+0000 7fb2288e0700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb224140540 0x7fb224067330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:32.345 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.337+0000 7fb2288e0700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb224140540 0x7fb224067330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.105:53552/0 (socket says 172.21.15.105:53552) 2023-10-06T03:00:32.345 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.337+0000 7fb2290e1700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb2240c6b20 0x7fb224156680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:55180/0 (socket says 172.21.15.105:55180) 2023-10-06T03:00:32.345 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.337+0000 7fb2288e0700 1 -- 172.21.15.105:0/1395913762 learned_addr learned my addr 172.21.15.105:0/1395913762 (peer_addr_for_me v2:172.21.15.105:0/0) 2023-10-06T03:00:32.345 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.337+0000 7fb2298e2700 1 --2- 172.21.15.105:0/1395913762 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb224140910 0x7fb224067870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:32.345 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.337+0000 7fb2290e1700 1 -- 172.21.15.105:0/1395913762 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb224140540 msgr2=0x7fb224067330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:32.345 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.337+0000 7fb2290e1700 1 --2- 172.21.15.105:0/1395913762 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb224140540 0x7fb224067330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:32.346 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.337+0000 7fb2290e1700 1 -- 172.21.15.105:0/1395913762 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb224140910 msgr2=0x7fb224067870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:32.346 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.337+0000 7fb2290e1700 1 --2- 172.21.15.105:0/1395913762 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb224140910 0x7fb224067870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:32.346 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.337+0000 7fb2290e1700 1 -- 172.21.15.105:0/1395913762 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb21c009ae0 con 0x7fb2240c6b20 2023-10-06T03:00:32.346 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.337+0000 7fb2298e2700 1 --2- 172.21.15.105:0/1395913762 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb224140910 0x7fb224067870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:00:32.346 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.337+0000 7fb2288e0700 1 --2- 172.21.15.105:0/1395913762 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb224140540 0x7fb224067330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:00:32.346 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.337+0000 7fb2290e1700 1 --2- 172.21.15.105:0/1395913762 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb2240c6b20 0x7fb224156680 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fb220016000 tx=0x7fb220017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:32.346 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.337+0000 7fb2197fa700 1 -- 172.21.15.105:0/1395913762 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb220000d10 con 0x7fb2240c6b20 2023-10-06T03:00:32.346 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.337+0000 7fb2197fa700 1 -- 172.21.15.105:0/1395913762 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb220011b10 con 0x7fb2240c6b20 2023-10-06T03:00:32.346 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.337+0000 7fb2197fa700 1 -- 172.21.15.105:0/1395913762 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb220025640 con 0x7fb2240c6b20 2023-10-06T03:00:32.346 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.337+0000 7fb22a0e3700 1 -- 172.21.15.105:0/1395913762 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb220009420 con 0x7fb2240c6b20 2023-10-06T03:00:32.346 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.341+0000 7fb22a0e3700 1 -- 172.21.15.105:0/1395913762 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2240afd90 con 0x7fb2240c6b20 2023-10-06T03:00:32.347 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.341+0000 7fb2197fa700 1 -- 172.21.15.105:0/1395913762 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fb220025c70 con 0x7fb2240c6b20 2023-10-06T03:00:32.347 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.341+0000 7fb2197fa700 1 -- 172.21.15.105:0/1395913762 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 951+0+0 (secure 0 0 0) 0x7fb22002e400 con 0x7fb2240c6b20 2023-10-06T03:00:32.347 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.341+0000 7fb22a0e3700 1 -- 172.21.15.105:0/1395913762 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2240b0590 con 0x7fb2240c6b20 2023-10-06T03:00:32.351 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.345+0000 7fb2197fa700 1 -- 172.21.15.105:0/1395913762 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fb220015020 con 0x7fb2240c6b20 2023-10-06T03:00:32.386 INFO:tasks.ceph.mgr.y.smithi057.stderr:2023-10-06T03:00:32.379+0000 7f64df3c7000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-06T03:00:32.501 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.493+0000 7fb22a0e3700 1 -- 172.21.15.105:0/1395913762 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7255c62e-f92f-470f-a5ce-30228920d9f4", "id": 2} v 0) v1 -- 0x7fb22404be40 con 0x7fb2240c6b20 2023-10-06T03:00:32.506 INFO:tasks.ceph.mgr.x.smithi105.stderr:2023-10-06T03:00:32.501+0000 7fb6d0aeb000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-06T03:00:32.516 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.509+0000 7fb2197fa700 1 -- 172.21.15.105:0/1395913762 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7255c62e-f92f-470f-a5ce-30228920d9f4", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb22002e860 con 0x7fb2240c6b20 2023-10-06T03:00:32.517 INFO:teuthology.orchestra.run.smithi105.stdout:2 2023-10-06T03:00:32.519 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.513+0000 7fb22a0e3700 1 -- 172.21.15.105:0/1395913762 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb2240c6b20 msgr2=0x7fb224156680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:32.519 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.513+0000 7fb22a0e3700 1 --2- 172.21.15.105:0/1395913762 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb2240c6b20 0x7fb224156680 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fb220016000 tx=0x7fb220017000 comp rx=0 tx=0).stop 2023-10-06T03:00:32.519 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.513+0000 7fb22a0e3700 1 -- 172.21.15.105:0/1395913762 shutdown_connections 2023-10-06T03:00:32.519 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.513+0000 7fb22a0e3700 1 --2- 172.21.15.105:0/1395913762 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb224140910 0x7fb224067870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:32.520 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.513+0000 7fb22a0e3700 1 --2- 172.21.15.105:0/1395913762 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb224140540 0x7fb224067330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:32.520 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.513+0000 7fb22a0e3700 1 --2- 172.21.15.105:0/1395913762 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb2240c6b20 0x7fb224156680 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:32.520 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.513+0000 7fb22a0e3700 1 -- 172.21.15.105:0/1395913762 >> 172.21.15.105:0/1395913762 conn(0x7fb2240c8660 msgr2=0x7fb22413f520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:32.520 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.513+0000 7fb22a0e3700 1 -- 172.21.15.105:0/1395913762 shutdown_connections 2023-10-06T03:00:32.520 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.513+0000 7fb22a0e3700 1 -- 172.21.15.105:0/1395913762 wait complete. 2023-10-06T03:00:32.540 DEBUG:teuthology.orchestra.run.smithi105:> sudo ceph --cluster ceph osd new 152a236d-f799-4888-8544-74865508d5a9 3 2023-10-06T03:00:32.594 INFO:tasks.ceph.mgr.x.smithi105.stderr:2023-10-06T03:00:32.589+0000 7fb6d0aeb000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-06T03:00:32.610 INFO:tasks.ceph.mgr.y.smithi057.stderr:2023-10-06T03:00:32.603+0000 7f64df3c7000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-06T03:00:32.692 INFO:tasks.ceph.mgr.y.smithi057.stderr:2023-10-06T03:00:32.687+0000 7f64df3c7000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-06T03:00:32.695 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.689+0000 7f16a2f85700 1 Processor -- start 2023-10-06T03:00:32.695 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.689+0000 7f16a2f85700 1 -- start start 2023-10-06T03:00:32.697 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.693+0000 7f16a2f85700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f169c15cd50 0x7f169c15d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:32.697 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.693+0000 7f16a2f85700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f169c1501b0 0x7f169c159e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:32.698 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.693+0000 7f16a2f85700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f169c15d660 con 0x7f169c14fd10 2023-10-06T03:00:32.698 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.693+0000 7f16a2f85700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f169c06e300 con 0x7f169c15cd50 2023-10-06T03:00:32.698 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.693+0000 7f16a2f85700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f169c06afb0 con 0x7f169c1501b0 2023-10-06T03:00:32.699 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.693+0000 7f16a1522700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f169c1501b0 0x7f169c159e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:32.699 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.693+0000 7f169bfff700 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f169c14fd10 0x7f169c159750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.105:42684/0 (socket says 172.21.15.105:42684) 2023-10-06T03:00:32.699 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.693+0000 7f169bfff700 1 -- 172.21.15.105:0/2851028199 learned_addr learned my addr 172.21.15.105:0/2851028199 (peer_addr_for_me v1:172.21.15.105:0/0) 2023-10-06T03:00:32.699 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.693+0000 7f16a0d21700 1 --2- 172.21.15.105:0/2851028199 >> v2:172.21.15.57:3300/0 conn(0x7f169c15cd50 0x7f169c15d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:32.699 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.693+0000 7f16a1522700 1 -- 172.21.15.105:0/2851028199 >> v2:172.21.15.57:3300/0 conn(0x7f169c15cd50 msgr2=0x7f169c15d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:32.699 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.693+0000 7f16a1522700 1 --2- 172.21.15.105:0/2851028199 >> v2:172.21.15.57:3300/0 conn(0x7f169c15cd50 0x7f169c15d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:32.700 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.693+0000 7f16a1522700 1 -- 172.21.15.105:0/2851028199 >> v1:172.21.15.105:6789/0 conn(0x7f169c14fd10 legacy=0x7f169c159750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:32.700 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.693+0000 7f16a1522700 1 -- 172.21.15.105:0/2851028199 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f169c06b290 con 0x7f169c1501b0 2023-10-06T03:00:32.700 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.693+0000 7f169b7fe700 1 -- 172.21.15.105:0/2851028199 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1022534623 0 0) 0x7f169c15d660 con 0x7f169c14fd10 2023-10-06T03:00:32.700 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.693+0000 7f16a1522700 1 --2- 172.21.15.105:0/2851028199 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f169c1501b0 0x7f169c159e60 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f1694009e60 tx=0x7f1694009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0286956f99867f9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:32.701 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.693+0000 7f169b7fe700 1 -- 172.21.15.105:0/2851028199 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f169400e070 con 0x7f169c1501b0 2023-10-06T03:00:32.701 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.693+0000 7f169b7fe700 1 -- 172.21.15.105:0/2851028199 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f169400bb20 con 0x7f169c1501b0 2023-10-06T03:00:32.701 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.693+0000 7f169b7fe700 1 -- 172.21.15.105:0/2851028199 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1694012430 con 0x7f169c1501b0 2023-10-06T03:00:32.702 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.693+0000 7f16a2f85700 1 -- 172.21.15.105:0/2851028199 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f169c1501b0 msgr2=0x7f169c159e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:32.702 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.693+0000 7f16a2f85700 1 --2- 172.21.15.105:0/2851028199 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f169c1501b0 0x7f169c159e60 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f1694009e60 tx=0x7f1694009780 comp rx=0 tx=0).stop 2023-10-06T03:00:32.702 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.693+0000 7f16a2f85700 1 -- 172.21.15.105:0/2851028199 shutdown_connections 2023-10-06T03:00:32.702 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.693+0000 7f16a2f85700 1 --2- 172.21.15.105:0/2851028199 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f169c1501b0 0x7f169c159e60 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:32.702 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.693+0000 7f16a2f85700 1 --2- 172.21.15.105:0/2851028199 >> v2:172.21.15.57:3300/0 conn(0x7f169c15cd50 0x7f169c15d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:32.702 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.693+0000 7f16a2f85700 1 -- 172.21.15.105:0/2851028199 >> 172.21.15.105:0/2851028199 conn(0x7f169c0ccbc0 msgr2=0x7f169c0ccfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:32.702 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.693+0000 7f16a2f85700 1 -- 172.21.15.105:0/2851028199 shutdown_connections 2023-10-06T03:00:32.702 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.693+0000 7f16a2f85700 1 -- 172.21.15.105:0/2851028199 wait complete. 2023-10-06T03:00:32.703 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.697+0000 7f16a2f85700 1 Processor -- start 2023-10-06T03:00:32.703 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.697+0000 7f16a2f85700 1 -- start start 2023-10-06T03:00:32.705 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.697+0000 7f16a2f85700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f169c14fd10 0x7f169c155ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:32.705 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.701+0000 7f16a2f85700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f169c1501b0 0x7f169c157300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:32.705 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.701+0000 7f16a2f85700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f169c15cd50 0x7f169c14f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:32.706 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.701+0000 7f16a2f85700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f169c0c78c0 con 0x7f169c15cd50 2023-10-06T03:00:32.706 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.701+0000 7f16a2f85700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f169c1564c0 con 0x7f169c14fd10 2023-10-06T03:00:32.706 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.701+0000 7f16a2f85700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f169c0ca0b0 con 0x7f169c1501b0 2023-10-06T03:00:32.706 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.701+0000 7f16a0d21700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f169c14fd10 0x7f169c155ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:32.706 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.701+0000 7f16a0d21700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f169c14fd10 0x7f169c155ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:55202/0 (socket says 172.21.15.105:55202) 2023-10-06T03:00:32.706 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.701+0000 7f16a0d21700 1 -- 172.21.15.105:0/3491173493 learned_addr learned my addr 172.21.15.105:0/3491173493 (peer_addr_for_me v2:172.21.15.105:0/0) 2023-10-06T03:00:32.709 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.701+0000 7f169bfff700 1 --2- 172.21.15.105:0/3491173493 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f169c1501b0 0x7f169c157300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:32.710 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.701+0000 7f16a1522700 1 --2- 172.21.15.105:0/3491173493 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f169c15cd50 0x7f169c14f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:32.710 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.701+0000 7f16a0d21700 1 -- 172.21.15.105:0/3491173493 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f169c1501b0 msgr2=0x7f169c157300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:32.710 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.701+0000 7f16a0d21700 1 --2- 172.21.15.105:0/3491173493 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f169c1501b0 0x7f169c157300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:32.710 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.701+0000 7f16a0d21700 1 -- 172.21.15.105:0/3491173493 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f169c15cd50 msgr2=0x7f169c14f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:32.710 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.701+0000 7f16a0d21700 1 --2- 172.21.15.105:0/3491173493 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f169c15cd50 0x7f169c14f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:32.710 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.701+0000 7f16a0d21700 1 -- 172.21.15.105:0/3491173493 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1694009a20 con 0x7f169c14fd10 2023-10-06T03:00:32.710 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.701+0000 7f16a1522700 1 --2- 172.21.15.105:0/3491173493 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f169c15cd50 0x7f169c14f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:00:32.710 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.701+0000 7f16a0d21700 1 --2- 172.21.15.105:0/3491173493 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f169c14fd10 0x7f169c155ae0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f169000ec80 tx=0x7f16900091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:32.711 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.701+0000 7f1698ff9700 1 -- 172.21.15.105:0/3491173493 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f169000c9d0 con 0x7f169c14fd10 2023-10-06T03:00:32.711 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.701+0000 7f1698ff9700 1 -- 172.21.15.105:0/3491173493 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f169000cb50 con 0x7f169c14fd10 2023-10-06T03:00:32.711 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.701+0000 7f16a2f85700 1 -- 172.21.15.105:0/3491173493 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f169c1561e0 con 0x7f169c14fd10 2023-10-06T03:00:32.711 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.701+0000 7f1698ff9700 1 -- 172.21.15.105:0/3491173493 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1690013470 con 0x7f169c14fd10 2023-10-06T03:00:32.711 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.701+0000 7f16a2f85700 1 -- 172.21.15.105:0/3491173493 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f169c0c7550 con 0x7f169c14fd10 2023-10-06T03:00:32.711 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.701+0000 7f1698ff9700 1 -- 172.21.15.105:0/3491173493 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f1690005c80 con 0x7f169c14fd10 2023-10-06T03:00:32.711 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.701+0000 7f1698ff9700 1 -- 172.21.15.105:0/3491173493 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1066+0+0 (secure 0 0 0) 0x7f1690013860 con 0x7f169c14fd10 2023-10-06T03:00:32.711 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.701+0000 7f16a2f85700 1 -- 172.21.15.105:0/3491173493 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f169c06df90 con 0x7f169c14fd10 2023-10-06T03:00:32.712 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.705+0000 7f1698ff9700 1 -- 172.21.15.105:0/3491173493 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f169c06df90 con 0x7f169c14fd10 2023-10-06T03:00:32.777 INFO:tasks.ceph.mgr.y.smithi057.stderr:2023-10-06T03:00:32.771+0000 7f64df3c7000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-06T03:00:32.790 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.785+0000 7f16a2f85700 1 -- 172.21.15.105:0/3491173493 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd new", "uuid": "152a236d-f799-4888-8544-74865508d5a9", "id": 3} v 0) v1 -- 0x7f169c0712e0 con 0x7f169c14fd10 2023-10-06T03:00:32.802 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.797+0000 7f1698ff9700 1 -- 172.21.15.105:0/3491173493 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "152a236d-f799-4888-8544-74865508d5a9", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f1690029020 con 0x7f169c14fd10 2023-10-06T03:00:32.802 INFO:teuthology.orchestra.run.smithi105.stdout:3 2023-10-06T03:00:32.803 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.797+0000 7f16a2f85700 1 -- 172.21.15.105:0/3491173493 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f169c14fd10 msgr2=0x7f169c155ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:32.803 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.797+0000 7f16a2f85700 1 --2- 172.21.15.105:0/3491173493 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f169c14fd10 0x7f169c155ae0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f169000ec80 tx=0x7f16900091a0 comp rx=0 tx=0).stop 2023-10-06T03:00:32.804 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.797+0000 7f16a2f85700 1 -- 172.21.15.105:0/3491173493 shutdown_connections 2023-10-06T03:00:32.804 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.797+0000 7f16a2f85700 1 --2- 172.21.15.105:0/3491173493 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f169c15cd50 0x7f169c14f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:32.804 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.797+0000 7f16a2f85700 1 --2- 172.21.15.105:0/3491173493 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f169c1501b0 0x7f169c157300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:32.804 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.797+0000 7f16a2f85700 1 --2- 172.21.15.105:0/3491173493 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f169c14fd10 0x7f169c155ae0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:32.804 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.797+0000 7f16a2f85700 1 -- 172.21.15.105:0/3491173493 >> 172.21.15.105:0/3491173493 conn(0x7f169c0ccbc0 msgr2=0x7f169c15d250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:32.805 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.797+0000 7f16a2f85700 1 -- 172.21.15.105:0/3491173493 shutdown_connections 2023-10-06T03:00:32.805 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.797+0000 7f16a2f85700 1 -- 172.21.15.105:0/3491173493 wait complete. 2023-10-06T03:00:32.825 DEBUG:teuthology.orchestra.run.smithi105:> sudo ceph --cluster ceph osd new 37db2a65-3566-41d0-9d60-e66c49e1e68e 4 2023-10-06T03:00:32.857 INFO:tasks.ceph.mgr.x.smithi105.stderr:2023-10-06T03:00:32.849+0000 7fb6d0aeb000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-06T03:00:32.945 INFO:tasks.ceph.mgr.x.smithi105.stderr:2023-10-06T03:00:32.937+0000 7fb6d0aeb000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-06T03:00:32.967 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.961+0000 7fa02e425700 1 Processor -- start 2023-10-06T03:00:32.967 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.961+0000 7fa02e425700 1 -- start start 2023-10-06T03:00:32.970 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.965+0000 7fa02e425700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0281539d0 0x7fa0280cc7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:32.970 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.965+0000 7fa02e425700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa02815cd70 0x7fa02815d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:32.970 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.965+0000 7fa02e425700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0280c87e0 con 0x7fa028153600 2023-10-06T03:00:32.970 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.965+0000 7fa02e425700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa02815d730 con 0x7fa02815cd70 2023-10-06T03:00:32.970 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.965+0000 7fa02e425700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa02806e240 con 0x7fa0281539d0 2023-10-06T03:00:32.971 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.965+0000 7fa0277fe700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0281539d0 0x7fa0280cc7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:32.971 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.965+0000 7fa0277fe700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0281539d0 0x7fa0280cc7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.105:53572/0 (socket says 172.21.15.105:53572) 2023-10-06T03:00:32.971 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.965+0000 7fa0277fe700 1 -- 172.21.15.105:0/2704721866 learned_addr learned my addr 172.21.15.105:0/2704721866 (peer_addr_for_me v2:172.21.15.105:0/0) 2023-10-06T03:00:32.971 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.965+0000 7fa02c9c2700 1 --2- 172.21.15.105:0/2704721866 >> v2:172.21.15.57:3300/0 conn(0x7fa02815cd70 0x7fa02815d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:32.972 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.965+0000 7fa0277fe700 1 -- 172.21.15.105:0/2704721866 >> v2:172.21.15.57:3300/0 conn(0x7fa02815cd70 msgr2=0x7fa02815d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:32.972 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.965+0000 7fa0277fe700 1 --2- 172.21.15.105:0/2704721866 >> v2:172.21.15.57:3300/0 conn(0x7fa02815cd70 0x7fa02815d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:32.972 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.965+0000 7fa0277fe700 1 -- 172.21.15.105:0/2704721866 >> v1:172.21.15.57:6789/0 conn(0x7fa028153600 legacy=0x7fa02806d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:32.972 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.965+0000 7fa0277fe700 1 -- 172.21.15.105:0/2704721866 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa028067480 con 0x7fa0281539d0 2023-10-06T03:00:32.973 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.965+0000 7fa0277fe700 1 --2- 172.21.15.105:0/2704721866 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0281539d0 0x7fa0280cc7c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa01c0099b0 tx=0x7fa01c009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b764a9a005e8b18e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:32.973 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.965+0000 7fa026ffd700 1 -- 172.21.15.105:0/2704721866 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa01c00b860 con 0x7fa0281539d0 2023-10-06T03:00:32.973 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.965+0000 7fa026ffd700 1 -- 172.21.15.105:0/2704721866 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa01c00b9c0 con 0x7fa0281539d0 2023-10-06T03:00:32.973 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.965+0000 7fa026ffd700 1 -- 172.21.15.105:0/2704721866 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa01c00bd60 con 0x7fa0281539d0 2023-10-06T03:00:32.973 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.965+0000 7fa02e425700 1 -- 172.21.15.105:0/2704721866 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0281539d0 msgr2=0x7fa0280cc7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:32.973 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.965+0000 7fa02e425700 1 --2- 172.21.15.105:0/2704721866 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0281539d0 0x7fa0280cc7c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa01c0099b0 tx=0x7fa01c009250 comp rx=0 tx=0).stop 2023-10-06T03:00:32.974 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.969+0000 7fa02e425700 1 -- 172.21.15.105:0/2704721866 shutdown_connections 2023-10-06T03:00:32.974 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.969+0000 7fa02e425700 1 --2- 172.21.15.105:0/2704721866 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0281539d0 0x7fa0280cc7c0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:32.974 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.969+0000 7fa02e425700 1 --2- 172.21.15.105:0/2704721866 >> v2:172.21.15.57:3300/0 conn(0x7fa02815cd70 0x7fa02815d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:32.974 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.969+0000 7fa02e425700 1 -- 172.21.15.105:0/2704721866 >> 172.21.15.105:0/2704721866 conn(0x7fa0280caa00 msgr2=0x7fa0280cae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:32.974 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.969+0000 7fa02e425700 1 -- 172.21.15.105:0/2704721866 shutdown_connections 2023-10-06T03:00:32.974 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.969+0000 7fa02e425700 1 -- 172.21.15.105:0/2704721866 wait complete. 2023-10-06T03:00:32.976 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.969+0000 7fa02e425700 1 Processor -- start 2023-10-06T03:00:32.976 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.969+0000 7fa02e425700 1 -- start start 2023-10-06T03:00:32.979 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.973+0000 7fa02e425700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa028153600 0x7fa02815a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:32.979 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.973+0000 7fa02e425700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0281539d0 0x7fa028151f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:32.979 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.973+0000 7fa02e425700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa02815cd70 0x7fa0280af3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:32.979 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.973+0000 7fa02e425700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0280aef50 con 0x7fa02815cd70 2023-10-06T03:00:32.979 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.973+0000 7fa02e425700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0280c7c50 con 0x7fa028153600 2023-10-06T03:00:32.979 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.973+0000 7fa02e425700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0280c7f30 con 0x7fa0281539d0 2023-10-06T03:00:32.980 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.973+0000 7fa0277fe700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0281539d0 0x7fa028151f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:32.981 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.973+0000 7fa0277fe700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0281539d0 0x7fa028151f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.105:53576/0 (socket says 172.21.15.105:53576) 2023-10-06T03:00:32.981 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.973+0000 7fa0277fe700 1 -- 172.21.15.105:0/3688612909 learned_addr learned my addr 172.21.15.105:0/3688612909 (peer_addr_for_me v2:172.21.15.105:0/0) 2023-10-06T03:00:32.981 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.973+0000 7fa027fff700 1 --2- 172.21.15.105:0/3688612909 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa028153600 0x7fa02815a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:32.981 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.973+0000 7fa02c9c2700 1 --2- 172.21.15.105:0/3688612909 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa02815cd70 0x7fa0280af3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:32.981 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.973+0000 7fa0277fe700 1 -- 172.21.15.105:0/3688612909 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa028153600 msgr2=0x7fa02815a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:32.981 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.973+0000 7fa0277fe700 1 --2- 172.21.15.105:0/3688612909 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa028153600 0x7fa02815a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:32.981 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.973+0000 7fa0277fe700 1 -- 172.21.15.105:0/3688612909 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa02815cd70 msgr2=0x7fa0280af3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:32.981 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.973+0000 7fa0277fe700 1 --2- 172.21.15.105:0/3688612909 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa02815cd70 0x7fa0280af3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:32.981 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.973+0000 7fa0277fe700 1 -- 172.21.15.105:0/3688612909 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa01c0094f0 con 0x7fa0281539d0 2023-10-06T03:00:32.982 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.973+0000 7fa0277fe700 1 --2- 172.21.15.105:0/3688612909 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0281539d0 0x7fa028151f00 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa028067430 tx=0x7fa01c017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:32.982 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.977+0000 7fa00ffff700 1 -- 172.21.15.105:0/3688612909 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa01c011e40 con 0x7fa0281539d0 2023-10-06T03:00:32.982 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.977+0000 7fa00ffff700 1 -- 172.21.15.105:0/3688612909 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa01c024440 con 0x7fa0281539d0 2023-10-06T03:00:32.983 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.977+0000 7fa02e425700 1 -- 172.21.15.105:0/3688612909 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0280aebe0 con 0x7fa0281539d0 2023-10-06T03:00:32.983 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.977+0000 7fa00ffff700 1 -- 172.21.15.105:0/3688612909 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa01c0247e0 con 0x7fa0281539d0 2023-10-06T03:00:32.983 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.977+0000 7fa02e425700 1 -- 172.21.15.105:0/3688612909 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0280c7820 con 0x7fa0281539d0 2023-10-06T03:00:32.983 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.977+0000 7fa00ffff700 1 -- 172.21.15.105:0/3688612909 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fa01c01a6a0 con 0x7fa0281539d0 2023-10-06T03:00:32.983 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.977+0000 7fa00ffff700 1 -- 172.21.15.105:0/3688612909 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7fa01c0233e0 con 0x7fa0281539d0 2023-10-06T03:00:32.983 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.977+0000 7fa02e425700 1 -- 172.21.15.105:0/3688612909 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0280aea30 con 0x7fa0281539d0 2023-10-06T03:00:32.987 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:32.981+0000 7fa00ffff700 1 -- 172.21.15.105:0/3688612909 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fa01c015020 con 0x7fa0281539d0 2023-10-06T03:00:33.041 INFO:tasks.ceph.mgr.x.smithi105.stderr:2023-10-06T03:00:33.033+0000 7fb6d0aeb000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-06T03:00:33.062 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.057+0000 7fa02e425700 1 -- 172.21.15.105:0/3688612909 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "osd new", "uuid": "37db2a65-3566-41d0-9d60-e66c49e1e68e", "id": 4} v 0) v1 -- 0x7fa0280af0c0 con 0x7fa0281539d0 2023-10-06T03:00:33.077 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.069+0000 7fa00ffff700 1 -- 172.21.15.105:0/3688612909 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "37db2a65-3566-41d0-9d60-e66c49e1e68e", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa01c01a950 con 0x7fa0281539d0 2023-10-06T03:00:33.077 INFO:teuthology.orchestra.run.smithi105.stdout:4 2023-10-06T03:00:33.079 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.073+0000 7fa02e425700 1 -- 172.21.15.105:0/3688612909 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0281539d0 msgr2=0x7fa028151f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:33.079 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.073+0000 7fa02e425700 1 --2- 172.21.15.105:0/3688612909 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0281539d0 0x7fa028151f00 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa028067430 tx=0x7fa01c017000 comp rx=0 tx=0).stop 2023-10-06T03:00:33.079 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.073+0000 7fa02e425700 1 -- 172.21.15.105:0/3688612909 shutdown_connections 2023-10-06T03:00:33.080 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.073+0000 7fa02e425700 1 --2- 172.21.15.105:0/3688612909 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa02815cd70 0x7fa0280af3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:33.080 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.073+0000 7fa02e425700 1 --2- 172.21.15.105:0/3688612909 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0281539d0 0x7fa028151f00 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:33.080 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.073+0000 7fa02e425700 1 --2- 172.21.15.105:0/3688612909 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa028153600 0x7fa02815a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:33.080 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.073+0000 7fa02e425700 1 -- 172.21.15.105:0/3688612909 >> 172.21.15.105:0/3688612909 conn(0x7fa0280caa00 msgr2=0x7fa028152b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:33.080 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.073+0000 7fa02e425700 1 -- 172.21.15.105:0/3688612909 shutdown_connections 2023-10-06T03:00:33.080 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.073+0000 7fa02e425700 1 -- 172.21.15.105:0/3688612909 wait complete. 2023-10-06T03:00:33.097 DEBUG:teuthology.orchestra.run.smithi105:> sudo ceph --cluster ceph osd new 35e77918-1bb4-42ca-9b20-f3c14eaa0c04 5 2023-10-06T03:00:33.263 INFO:tasks.ceph.mgr.y.smithi057.stderr:2023-10-06T03:00:33.259+0000 7f64df3c7000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-06T03:00:33.292 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.285+0000 7fc3de785700 1 Processor -- start 2023-10-06T03:00:33.292 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.285+0000 7fc3de785700 1 -- start start 2023-10-06T03:00:33.295 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.289+0000 7fc3de785700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc3d815cd50 0x7fc3d815d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:33.295 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.289+0000 7fc3de785700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc3d814fd10 0x7fc3d8150180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:33.295 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.289+0000 7fc3de785700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fc3d8159750 0x7fc3d8159bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:33.295 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.289+0000 7fc3de785700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3d806e300 con 0x7fc3d815cd50 2023-10-06T03:00:33.295 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.289+0000 7fc3de785700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3d81506c0 con 0x7fc3d8159750 2023-10-06T03:00:33.295 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.289+0000 7fc3de785700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d815d660 con 0x7fc3d814fd10 2023-10-06T03:00:33.296 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.289+0000 7fc3cffff700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc3d814fd10 0x7fc3d8150180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:33.296 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.289+0000 7fc3dcd22700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fc3d8159750 0x7fc3d8159bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:33.296 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.289+0000 7fc3cffff700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc3d814fd10 0x7fc3d8150180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.105:53592/0 (socket says 172.21.15.105:53592) 2023-10-06T03:00:33.296 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.289+0000 7fc3cffff700 1 -- 172.21.15.105:0/3883948568 learned_addr learned my addr 172.21.15.105:0/3883948568 (peer_addr_for_me v2:172.21.15.105:0/0) 2023-10-06T03:00:33.296 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.289+0000 7fc3d7fff700 1 --2- 172.21.15.105:0/3883948568 >> v2:172.21.15.57:3300/0 conn(0x7fc3d815cd50 0x7fc3d815d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:33.297 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.289+0000 7fc3dcd22700 1 -- 172.21.15.105:0/3883948568 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc3d814fd10 msgr2=0x7fc3d8150180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:33.298 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.289+0000 7fc3dcd22700 1 --2- 172.21.15.105:0/3883948568 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc3d814fd10 0x7fc3d8150180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:33.298 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.289+0000 7fc3dcd22700 1 -- 172.21.15.105:0/3883948568 >> v2:172.21.15.57:3300/0 conn(0x7fc3d815cd50 msgr2=0x7fc3d815d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:33.298 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.289+0000 7fc3dcd22700 1 --2- 172.21.15.105:0/3883948568 >> v2:172.21.15.57:3300/0 conn(0x7fc3d815cd50 0x7fc3d815d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:33.298 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.289+0000 7fc3dcd22700 1 -- 172.21.15.105:0/3883948568 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3d806afb0 con 0x7fc3d8159750 2023-10-06T03:00:33.298 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.289+0000 7fc3d7fff700 1 --2- 172.21.15.105:0/3883948568 >> v2:172.21.15.57:3300/0 conn(0x7fc3d815cd50 0x7fc3d815d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:00:33.298 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.289+0000 7fc3dcd22700 1 --2- 172.21.15.105:0/3883948568 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc3d8159750 0x7fc3d8159bb0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fc3d80afd60 tx=0x7fc3d0009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e7eab3bca3d52a03 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:33.298 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.289+0000 7fc3d77fe700 1 -- 172.21.15.105:0/3883948568 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3d000e070 con 0x7fc3d8159750 2023-10-06T03:00:33.298 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.289+0000 7fc3d77fe700 1 -- 172.21.15.105:0/3883948568 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3d000bb60 con 0x7fc3d8159750 2023-10-06T03:00:33.298 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.289+0000 7fc3d77fe700 1 -- 172.21.15.105:0/3883948568 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3d0012430 con 0x7fc3d8159750 2023-10-06T03:00:33.298 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.293+0000 7fc3de785700 1 -- 172.21.15.105:0/3883948568 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc3d8159750 msgr2=0x7fc3d8159bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:33.298 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.293+0000 7fc3de785700 1 --2- 172.21.15.105:0/3883948568 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc3d8159750 0x7fc3d8159bb0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fc3d80afd60 tx=0x7fc3d0009780 comp rx=0 tx=0).stop 2023-10-06T03:00:33.299 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.293+0000 7fc3de785700 1 -- 172.21.15.105:0/3883948568 shutdown_connections 2023-10-06T03:00:33.299 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.293+0000 7fc3de785700 1 --2- 172.21.15.105:0/3883948568 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc3d8159750 0x7fc3d8159bb0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:33.299 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.293+0000 7fc3de785700 1 --2- 172.21.15.105:0/3883948568 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc3d814fd10 0x7fc3d8150180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:33.299 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.293+0000 7fc3de785700 1 --2- 172.21.15.105:0/3883948568 >> v2:172.21.15.57:3300/0 conn(0x7fc3d815cd50 0x7fc3d815d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:33.299 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.293+0000 7fc3de785700 1 -- 172.21.15.105:0/3883948568 >> 172.21.15.105:0/3883948568 conn(0x7fc3d80ccbc0 msgr2=0x7fc3d80ccfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:33.299 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.293+0000 7fc3de785700 1 -- 172.21.15.105:0/3883948568 shutdown_connections 2023-10-06T03:00:33.299 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.293+0000 7fc3de785700 1 -- 172.21.15.105:0/3883948568 wait complete. 2023-10-06T03:00:33.299 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.293+0000 7fc3de785700 1 Processor -- start 2023-10-06T03:00:33.300 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.293+0000 7fc3de785700 1 -- start start 2023-10-06T03:00:33.301 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.293+0000 7fc3de785700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc3d814fd10 0x7fc3d814f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:33.301 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.293+0000 7fc3de785700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc3d8159750 0x7fc3d80c9a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:33.301 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.293+0000 7fc3de785700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3d815cd50 0x7fc3d81694d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:33.301 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.293+0000 7fc3de785700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d814fae0 con 0x7fc3d815cd50 2023-10-06T03:00:33.301 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.293+0000 7fc3de785700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d80b3d90 con 0x7fc3d814fd10 2023-10-06T03:00:33.301 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.293+0000 7fc3de785700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d80b4070 con 0x7fc3d8159750 2023-10-06T03:00:33.302 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.293+0000 7fc3cffff700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc3d8159750 0x7fc3d80c9a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:33.302 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.293+0000 7fc3cffff700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc3d8159750 0x7fc3d80c9a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.105:53602/0 (socket says 172.21.15.105:53602) 2023-10-06T03:00:33.302 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.293+0000 7fc3cffff700 1 -- 172.21.15.105:0/1671811924 learned_addr learned my addr 172.21.15.105:0/1671811924 (peer_addr_for_me v2:172.21.15.105:0/0) 2023-10-06T03:00:33.302 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.293+0000 7fc3d7fff700 1 --2- 172.21.15.105:0/1671811924 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc3d814fd10 0x7fc3d814f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:33.302 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.293+0000 7fc3dcd22700 1 --2- 172.21.15.105:0/1671811924 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3d815cd50 0x7fc3d81694d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:33.302 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.293+0000 7fc3cffff700 1 -- 172.21.15.105:0/1671811924 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc3d814fd10 msgr2=0x7fc3d814f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:33.302 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.293+0000 7fc3cffff700 1 --2- 172.21.15.105:0/1671811924 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc3d814fd10 0x7fc3d814f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:33.302 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.293+0000 7fc3cffff700 1 -- 172.21.15.105:0/1671811924 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3d815cd50 msgr2=0x7fc3d81694d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:33.302 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.293+0000 7fc3cffff700 1 --2- 172.21.15.105:0/1671811924 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3d815cd50 0x7fc3d81694d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:33.302 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.293+0000 7fc3cffff700 1 -- 172.21.15.105:0/1671811924 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3d0009a20 con 0x7fc3d8159750 2023-10-06T03:00:33.302 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.297+0000 7fc3cffff700 1 --2- 172.21.15.105:0/1671811924 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc3d8159750 0x7fc3d80c9a30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc3c000e980 tx=0x7fc3c0009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:33.303 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.297+0000 7fc3d4ff9700 1 -- 172.21.15.105:0/1671811924 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c000c850 con 0x7fc3d8159750 2023-10-06T03:00:33.303 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.297+0000 7fc3d4ff9700 1 -- 172.21.15.105:0/1671811924 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3c000c9b0 con 0x7fc3d8159750 2023-10-06T03:00:33.304 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.297+0000 7fc3de785700 1 -- 172.21.15.105:0/1671811924 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3d80b4350 con 0x7fc3d8159750 2023-10-06T03:00:33.304 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.297+0000 7fc3d4ff9700 1 -- 172.21.15.105:0/1671811924 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c000cd30 con 0x7fc3d8159750 2023-10-06T03:00:33.304 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.297+0000 7fc3de785700 1 -- 172.21.15.105:0/1671811924 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3d80b4910 con 0x7fc3d8159750 2023-10-06T03:00:33.304 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.297+0000 7fc3d4ff9700 1 -- 172.21.15.105:0/1671811924 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fc3c0005c80 con 0x7fc3d8159750 2023-10-06T03:00:33.304 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.297+0000 7fc3d4ff9700 1 -- 172.21.15.105:0/1671811924 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1296+0+0 (secure 0 0 0) 0x7fc3c00065a0 con 0x7fc3d8159750 2023-10-06T03:00:33.304 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.297+0000 7fc3de785700 1 -- 172.21.15.105:0/1671811924 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3d80712e0 con 0x7fc3d8159750 2023-10-06T03:00:33.307 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.301+0000 7fc3d4ff9700 1 -- 172.21.15.105:0/1671811924 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fc3c0021060 con 0x7fc3d8159750 2023-10-06T03:00:33.385 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.377+0000 7fc3de785700 1 -- 172.21.15.105:0/1671811924 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "osd new", "uuid": "35e77918-1bb4-42ca-9b20-f3c14eaa0c04", "id": 5} v 0) v1 -- 0x7fc3d806b290 con 0x7fc3d8159750 2023-10-06T03:00:33.399 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.393+0000 7fc3d4ff9700 1 -- 172.21.15.105:0/1671811924 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "35e77918-1bb4-42ca-9b20-f3c14eaa0c04", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc3c0017070 con 0x7fc3d8159750 2023-10-06T03:00:33.400 INFO:teuthology.orchestra.run.smithi105.stdout:5 2023-10-06T03:00:33.401 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.397+0000 7fc3de785700 1 -- 172.21.15.105:0/1671811924 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc3d8159750 msgr2=0x7fc3d80c9a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:33.401 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.397+0000 7fc3de785700 1 --2- 172.21.15.105:0/1671811924 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc3d8159750 0x7fc3d80c9a30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc3c000e980 tx=0x7fc3c0009250 comp rx=0 tx=0).stop 2023-10-06T03:00:33.401 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.397+0000 7fc3de785700 1 -- 172.21.15.105:0/1671811924 shutdown_connections 2023-10-06T03:00:33.402 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.397+0000 7fc3de785700 1 --2- 172.21.15.105:0/1671811924 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3d815cd50 0x7fc3d81694d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:33.402 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.397+0000 7fc3de785700 1 --2- 172.21.15.105:0/1671811924 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc3d8159750 0x7fc3d80c9a30 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:33.402 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.397+0000 7fc3de785700 1 --2- 172.21.15.105:0/1671811924 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc3d814fd10 0x7fc3d814f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:33.402 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.397+0000 7fc3de785700 1 -- 172.21.15.105:0/1671811924 >> 172.21.15.105:0/1671811924 conn(0x7fc3d80ccbc0 msgr2=0x7fc3d815bed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:33.402 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.397+0000 7fc3de785700 1 -- 172.21.15.105:0/1671811924 shutdown_connections 2023-10-06T03:00:33.402 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.397+0000 7fc3de785700 1 -- 172.21.15.105:0/1671811924 wait complete. 2023-10-06T03:00:33.421 DEBUG:teuthology.orchestra.run.smithi105:> sudo ceph --cluster ceph osd new b4d9d510-7a45-4173-8287-c6c8d6547f2b 6 2023-10-06T03:00:33.431 INFO:tasks.ceph.mgr.y.smithi057.stderr:2023-10-06T03:00:33.427+0000 7f64df3c7000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-06T03:00:33.546 INFO:tasks.ceph.mgr.x.smithi105.stderr:2023-10-06T03:00:33.541+0000 7fb6d0aeb000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-06T03:00:33.571 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.565+0000 7fdb28877700 1 Processor -- start 2023-10-06T03:00:33.571 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.565+0000 7fdb28877700 1 -- start start 2023-10-06T03:00:33.573 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.565+0000 7fdb28877700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fdb241549e0 0x7fdb240b38a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:33.573 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.569+0000 7fdb28877700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fdb241574a0 0x7fdb240aeee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:33.573 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.569+0000 7fdb28877700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb241586c0 con 0x7fdb240af420 2023-10-06T03:00:33.574 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.569+0000 7fdb28877700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb240af880 con 0x7fdb241574a0 2023-10-06T03:00:33.574 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.569+0000 7fdb28877700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb240cc620 con 0x7fdb241549e0 2023-10-06T03:00:33.575 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.569+0000 7fdb22d9d700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fdb241549e0 0x7fdb240b38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:33.575 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.569+0000 7fdb2259c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fdb241574a0 0x7fdb240aeee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:33.575 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.569+0000 7fdb22d9d700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fdb241549e0 0x7fdb240b38a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:55236/0 (socket says 172.21.15.105:55236) 2023-10-06T03:00:33.575 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.569+0000 7fdb22d9d700 1 -- 172.21.15.105:0/245122240 learned_addr learned my addr 172.21.15.105:0/245122240 (peer_addr_for_me v2:172.21.15.105:0/0) 2023-10-06T03:00:33.575 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.569+0000 7fdb22d9d700 1 -- 172.21.15.105:0/245122240 >> v2:172.21.15.57:3300/0 conn(0x7fdb241574a0 msgr2=0x7fdb240aeee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:33.575 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.569+0000 7fdb22d9d700 1 --2- 172.21.15.105:0/245122240 >> v2:172.21.15.57:3300/0 conn(0x7fdb241574a0 0x7fdb240aeee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:33.575 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.569+0000 7fdb22d9d700 1 -- 172.21.15.105:0/245122240 >> v1:172.21.15.57:6789/0 conn(0x7fdb240af420 legacy=0x7fdb2415aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:33.575 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.569+0000 7fdb22d9d700 1 -- 172.21.15.105:0/245122240 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb24157d20 con 0x7fdb241549e0 2023-10-06T03:00:33.575 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.569+0000 7fdb22d9d700 1 --2- 172.21.15.105:0/245122240 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdb241549e0 0x7fdb240b38a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fdb2406edc0 tx=0x7fdb14009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e43e6d196be3107b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:33.577 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.569+0000 7fdb21d9b700 1 -- 172.21.15.105:0/245122240 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb14009e70 con 0x7fdb241549e0 2023-10-06T03:00:33.577 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.569+0000 7fdb21d9b700 1 -- 172.21.15.105:0/245122240 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb1400b820 con 0x7fdb241549e0 2023-10-06T03:00:33.577 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.569+0000 7fdb21d9b700 1 -- 172.21.15.105:0/245122240 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb1400bbe0 con 0x7fdb241549e0 2023-10-06T03:00:33.577 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.569+0000 7fdb28877700 1 -- 172.21.15.105:0/245122240 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdb241549e0 msgr2=0x7fdb240b38a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:33.577 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.569+0000 7fdb28877700 1 --2- 172.21.15.105:0/245122240 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdb241549e0 0x7fdb240b38a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fdb2406edc0 tx=0x7fdb14009250 comp rx=0 tx=0).stop 2023-10-06T03:00:33.577 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.569+0000 7fdb28877700 1 -- 172.21.15.105:0/245122240 shutdown_connections 2023-10-06T03:00:33.577 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.569+0000 7fdb28877700 1 --2- 172.21.15.105:0/245122240 >> v2:172.21.15.57:3300/0 conn(0x7fdb241574a0 0x7fdb240aeee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:33.577 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.569+0000 7fdb28877700 1 --2- 172.21.15.105:0/245122240 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdb241549e0 0x7fdb240b38a0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:33.577 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.569+0000 7fdb28877700 1 -- 172.21.15.105:0/245122240 >> 172.21.15.105:0/245122240 conn(0x7fdb2406de80 msgr2=0x7fdb240ad7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:33.577 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.569+0000 7fdb28877700 1 -- 172.21.15.105:0/245122240 shutdown_connections 2023-10-06T03:00:33.577 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.569+0000 7fdb28877700 1 -- 172.21.15.105:0/245122240 wait complete. 2023-10-06T03:00:33.579 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.573+0000 7fdb28877700 1 Processor -- start 2023-10-06T03:00:33.579 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.573+0000 7fdb28877700 1 -- start start 2023-10-06T03:00:33.581 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.573+0000 7fdb28877700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb240af420 0x7fdb240c9660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:33.581 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.573+0000 7fdb28877700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb241549e0 0x7fdb24155760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:33.581 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.573+0000 7fdb28877700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdb241574a0 0x7fdb240c2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:33.581 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.573+0000 7fdb28877700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb240b1860 con 0x7fdb240af420 2023-10-06T03:00:33.581 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.573+0000 7fdb28877700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb24155f80 con 0x7fdb241574a0 2023-10-06T03:00:33.581 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.573+0000 7fdb28877700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb24156260 con 0x7fdb241549e0 2023-10-06T03:00:33.582 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.577+0000 7fdb2259c700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb241549e0 0x7fdb24155760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:33.582 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.577+0000 7fdb2359e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdb241574a0 0x7fdb240c2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:33.583 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.577+0000 7fdb22d9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb240af420 0x7fdb240c9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:33.583 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.577+0000 7fdb22d9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb240af420 0x7fdb240c9660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.105:59240/0 (socket says 172.21.15.105:59240) 2023-10-06T03:00:33.583 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.577+0000 7fdb22d9d700 1 -- 172.21.15.105:0/937332166 learned_addr learned my addr 172.21.15.105:0/937332166 (peer_addr_for_me v2:172.21.15.105:0/0) 2023-10-06T03:00:33.583 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.577+0000 7fdb22d9d700 1 -- 172.21.15.105:0/937332166 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb241549e0 msgr2=0x7fdb24155760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:33.583 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.577+0000 7fdb22d9d700 1 --2- 172.21.15.105:0/937332166 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb241549e0 0x7fdb24155760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:33.583 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.577+0000 7fdb22d9d700 1 -- 172.21.15.105:0/937332166 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdb241574a0 msgr2=0x7fdb240c2ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:33.583 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.577+0000 7fdb22d9d700 1 --2- 172.21.15.105:0/937332166 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdb241574a0 0x7fdb240c2ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:33.583 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.577+0000 7fdb22d9d700 1 -- 172.21.15.105:0/937332166 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb140094f0 con 0x7fdb240af420 2023-10-06T03:00:33.583 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.577+0000 7fdb22d9d700 1 --2- 172.21.15.105:0/937332166 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb240af420 0x7fdb240c9660 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fdb1400c010 tx=0x7fdb14016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:33.584 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.577+0000 7fdb0affd700 1 -- 172.21.15.105:0/937332166 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb14006b60 con 0x7fdb240af420 2023-10-06T03:00:33.584 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.577+0000 7fdb0affd700 1 -- 172.21.15.105:0/937332166 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb14020070 con 0x7fdb240af420 2023-10-06T03:00:33.584 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.577+0000 7fdb0affd700 1 -- 172.21.15.105:0/937332166 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb14011c70 con 0x7fdb240af420 2023-10-06T03:00:33.585 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.577+0000 7fdb28877700 1 -- 172.21.15.105:0/937332166 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb24156540 con 0x7fdb240af420 2023-10-06T03:00:33.585 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.577+0000 7fdb28877700 1 -- 172.21.15.105:0/937332166 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb24151fb0 con 0x7fdb240af420 2023-10-06T03:00:33.585 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.577+0000 7fdb0affd700 1 -- 172.21.15.105:0/937332166 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fdb14022030 con 0x7fdb240af420 2023-10-06T03:00:33.585 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.577+0000 7fdb0affd700 1 -- 172.21.15.105:0/937332166 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1411+0+0 (secure 0 0 0) 0x7fdb14011dd0 con 0x7fdb240af420 2023-10-06T03:00:33.585 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.577+0000 7fdb28877700 1 -- 172.21.15.105:0/937332166 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb24153320 con 0x7fdb240af420 2023-10-06T03:00:33.592 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.585+0000 7fdb0affd700 1 -- 172.21.15.105:0/937332166 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fdb1401b8e0 con 0x7fdb240af420 2023-10-06T03:00:33.672 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.665+0000 7fdb28877700 1 -- 172.21.15.105:0/937332166 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b4d9d510-7a45-4173-8287-c6c8d6547f2b", "id": 6} v 0) v1 -- 0x7fdb24153320 con 0x7fdb240af420 2023-10-06T03:00:33.684 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.677+0000 7fdb0affd700 1 -- 172.21.15.105:0/937332166 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b4d9d510-7a45-4173-8287-c6c8d6547f2b", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fdb14034020 con 0x7fdb240af420 2023-10-06T03:00:33.684 INFO:teuthology.orchestra.run.smithi105.stdout:6 2023-10-06T03:00:33.685 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.677+0000 7fdb28877700 1 -- 172.21.15.105:0/937332166 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb240af420 msgr2=0x7fdb240c9660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:33.685 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.677+0000 7fdb28877700 1 --2- 172.21.15.105:0/937332166 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb240af420 0x7fdb240c9660 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fdb1400c010 tx=0x7fdb14016000 comp rx=0 tx=0).stop 2023-10-06T03:00:33.685 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.677+0000 7fdb28877700 1 -- 172.21.15.105:0/937332166 shutdown_connections 2023-10-06T03:00:33.685 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.677+0000 7fdb28877700 1 --2- 172.21.15.105:0/937332166 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdb241574a0 0x7fdb240c2ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:33.685 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.677+0000 7fdb28877700 1 --2- 172.21.15.105:0/937332166 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb241549e0 0x7fdb24155760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:33.686 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.677+0000 7fdb28877700 1 --2- 172.21.15.105:0/937332166 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb240af420 0x7fdb240c9660 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:33.686 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.677+0000 7fdb28877700 1 -- 172.21.15.105:0/937332166 >> 172.21.15.105:0/937332166 conn(0x7fdb2406de80 msgr2=0x7fdb241539d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:33.686 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.681+0000 7fdb28877700 1 -- 172.21.15.105:0/937332166 shutdown_connections 2023-10-06T03:00:33.686 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.681+0000 7fdb28877700 1 -- 172.21.15.105:0/937332166 wait complete. 2023-10-06T03:00:33.705 DEBUG:teuthology.orchestra.run.smithi105:> sudo ceph --cluster ceph osd new 74266fb0-cd84-463f-8bf0-092652a71dc5 7 2023-10-06T03:00:33.711 INFO:tasks.ceph.mgr.x.smithi105.stderr:2023-10-06T03:00:33.705+0000 7fb6d0aeb000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-06T03:00:33.835 INFO:tasks.ceph.mgr.y.smithi057.stderr:2023-10-06T03:00:33.831+0000 7f64df3c7000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-06T03:00:33.849 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.841+0000 7f3361dcc700 1 Processor -- start 2023-10-06T03:00:33.849 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.841+0000 7f3361dcc700 1 -- start start 2023-10-06T03:00:33.851 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.845+0000 7f3361dcc700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f335c06afc0 0x7f335c163df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:33.851 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.845+0000 7f3361dcc700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f335c06d030 con 0x7f335c15a380 2023-10-06T03:00:33.851 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.845+0000 7f3361dcc700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f335c0b3250 con 0x7f335c156b60 2023-10-06T03:00:33.851 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.845+0000 7f3361dcc700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f335c06d270 con 0x7f335c06afc0 2023-10-06T03:00:33.851 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.845+0000 7f33615cb700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f335c06afc0 0x7f335c163df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:33.851 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.845+0000 7f3360dca700 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f335c156b60 0x7f335c06c920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.105:42686/0 (socket says 172.21.15.105:42686) 2023-10-06T03:00:33.852 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.845+0000 7f3360dca700 1 -- 172.21.15.105:0/3979514475 learned_addr learned my addr 172.21.15.105:0/3979514475 (peer_addr_for_me v1:172.21.15.105:0/0) 2023-10-06T03:00:33.853 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.845+0000 7f33615cb700 1 -- 172.21.15.105:0/3979514475 >> v1:172.21.15.105:6789/0 conn(0x7f335c156b60 legacy=0x7f335c06c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:33.853 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.845+0000 7f33615cb700 1 -- 172.21.15.105:0/3979514475 >> v1:172.21.15.57:6789/0 conn(0x7f335c15a380 legacy=0x7f335c06a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:33.853 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.845+0000 7f33615cb700 1 -- 172.21.15.105:0/3979514475 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f335c06d550 con 0x7f335c06afc0 2023-10-06T03:00:33.853 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.845+0000 7f335b7fe700 1 -- 172.21.15.105:0/3979514475 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4176593237 0 0) 0x7f335c0b3250 con 0x7f335c156b60 2023-10-06T03:00:33.853 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.845+0000 7f33615cb700 1 --2- 172.21.15.105:0/3979514475 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f335c06afc0 0x7f335c163df0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3354009e90 tx=0x7f3354009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=45a527cea51d7b3a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:33.853 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.845+0000 7f335b7fe700 1 -- 172.21.15.105:0/3979514475 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f335400e070 con 0x7f335c06afc0 2023-10-06T03:00:33.853 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.845+0000 7f335b7fe700 1 -- 172.21.15.105:0/3979514475 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f335400bc30 con 0x7f335c06afc0 2023-10-06T03:00:33.853 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.845+0000 7f335b7fe700 1 -- 172.21.15.105:0/3979514475 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3354012430 con 0x7f335c06afc0 2023-10-06T03:00:33.854 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.849+0000 7f3361dcc700 1 -- 172.21.15.105:0/3979514475 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f335c06afc0 msgr2=0x7f335c163df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:33.854 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.849+0000 7f3361dcc700 1 --2- 172.21.15.105:0/3979514475 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f335c06afc0 0x7f335c163df0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3354009e90 tx=0x7f3354009780 comp rx=0 tx=0).stop 2023-10-06T03:00:33.854 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.849+0000 7f3361dcc700 1 -- 172.21.15.105:0/3979514475 shutdown_connections 2023-10-06T03:00:33.854 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.849+0000 7f3361dcc700 1 --2- 172.21.15.105:0/3979514475 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f335c06afc0 0x7f335c163df0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:33.855 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.849+0000 7f3361dcc700 1 -- 172.21.15.105:0/3979514475 >> 172.21.15.105:0/3979514475 conn(0x7f335c067050 msgr2=0x7f335c0b1ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:33.855 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.849+0000 7f3361dcc700 1 -- 172.21.15.105:0/3979514475 shutdown_connections 2023-10-06T03:00:33.855 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.849+0000 7f3361dcc700 1 -- 172.21.15.105:0/3979514475 wait complete. 2023-10-06T03:00:33.856 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.849+0000 7f3361dcc700 1 Processor -- start 2023-10-06T03:00:33.856 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.849+0000 7f3361dcc700 1 -- start start 2023-10-06T03:00:33.858 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.853+0000 7f3361dcc700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f335c06afc0 0x7f335c0a88c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:33.858 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.853+0000 7f3361dcc700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f335c156b60 0x7f335c16ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:33.858 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.853+0000 7f3361dcc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f335c15a380 0x7f335c16cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:33.859 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.853+0000 7f3361dcc700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f335c0a8e00 con 0x7f335c15a380 2023-10-06T03:00:33.859 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.853+0000 7f3361dcc700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f335c159870 con 0x7f335c06afc0 2023-10-06T03:00:33.859 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.853+0000 7f3361dcc700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f335c158cf0 con 0x7f335c156b60 2023-10-06T03:00:33.859 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.853+0000 7f3360dca700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f335c06afc0 0x7f335c0a88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:33.859 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.853+0000 7f335bfff700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f335c156b60 0x7f335c16ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:33.859 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.853+0000 7f3360dca700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f335c06afc0 0x7f335c0a88c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:55252/0 (socket says 172.21.15.105:55252) 2023-10-06T03:00:33.859 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.853+0000 7f3360dca700 1 -- 172.21.15.105:0/1659867948 learned_addr learned my addr 172.21.15.105:0/1659867948 (peer_addr_for_me v2:172.21.15.105:0/0) 2023-10-06T03:00:33.859 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.853+0000 7f335bfff700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f335c156b60 0x7f335c16ca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.105:53628/0 (socket says 172.21.15.105:53628) 2023-10-06T03:00:33.859 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.853+0000 7f33615cb700 1 --2- 172.21.15.105:0/1659867948 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f335c15a380 0x7f335c16cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:33.860 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.853+0000 7f3360dca700 1 -- 172.21.15.105:0/1659867948 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f335c156b60 msgr2=0x7f335c16ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:33.860 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.853+0000 7f3360dca700 1 --2- 172.21.15.105:0/1659867948 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f335c156b60 0x7f335c16ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:33.861 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.853+0000 7f3360dca700 1 -- 172.21.15.105:0/1659867948 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f335c15a380 msgr2=0x7f335c16cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:33.861 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.853+0000 7f3360dca700 1 --2- 172.21.15.105:0/1659867948 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f335c15a380 0x7f335c16cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:33.861 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.853+0000 7f3360dca700 1 -- 172.21.15.105:0/1659867948 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3354009a20 con 0x7f335c06afc0 2023-10-06T03:00:33.861 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.853+0000 7f335bfff700 1 --2- 172.21.15.105:0/1659867948 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f335c156b60 0x7f335c16ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:00:33.861 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.853+0000 7f3360dca700 1 --2- 172.21.15.105:0/1659867948 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f335c06afc0 0x7f335c0a88c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f335000c810 tx=0x7f3350007d90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:33.861 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.853+0000 7f3358ff9700 1 -- 172.21.15.105:0/1659867948 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3350005c00 con 0x7f335c06afc0 2023-10-06T03:00:33.861 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.853+0000 7f3358ff9700 1 -- 172.21.15.105:0/1659867948 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3350005d60 con 0x7f335c06afc0 2023-10-06T03:00:33.861 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.853+0000 7f3361dcc700 1 -- 172.21.15.105:0/1659867948 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f335c158fd0 con 0x7f335c06afc0 2023-10-06T03:00:33.861 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.853+0000 7f3358ff9700 1 -- 172.21.15.105:0/1659867948 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3350007320 con 0x7f335c06afc0 2023-10-06T03:00:33.861 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.853+0000 7f3361dcc700 1 -- 172.21.15.105:0/1659867948 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f335c159590 con 0x7f335c06afc0 2023-10-06T03:00:33.861 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.853+0000 7f3358ff9700 1 -- 172.21.15.105:0/1659867948 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f335001c6c0 con 0x7f335c06afc0 2023-10-06T03:00:33.862 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.853+0000 7f3358ff9700 1 -- 172.21.15.105:0/1659867948 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1526+0+0 (secure 0 0 0) 0x7f3350007750 con 0x7f335c06afc0 2023-10-06T03:00:33.862 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.853+0000 7f3361dcc700 1 -- 172.21.15.105:0/1659867948 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f335c04be40 con 0x7f335c06afc0 2023-10-06T03:00:33.865 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.857+0000 7f3358ff9700 1 -- 172.21.15.105:0/1659867948 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f3350017070 con 0x7f335c06afc0 2023-10-06T03:00:33.942 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.937+0000 7f3361dcc700 1 -- 172.21.15.105:0/1659867948 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd new", "uuid": "74266fb0-cd84-463f-8bf0-092652a71dc5", "id": 7} v 0) v1 -- 0x7f335c16a5a0 con 0x7f335c06afc0 2023-10-06T03:00:33.958 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.953+0000 7f3358ff9700 1 -- 172.21.15.105:0/1659867948 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "74266fb0-cd84-463f-8bf0-092652a71dc5", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f335001c970 con 0x7f335c06afc0 2023-10-06T03:00:33.959 INFO:teuthology.orchestra.run.smithi105.stdout:7 2023-10-06T03:00:33.960 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.953+0000 7f3361dcc700 1 -- 172.21.15.105:0/1659867948 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f335c06afc0 msgr2=0x7f335c0a88c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:33.960 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.953+0000 7f3361dcc700 1 --2- 172.21.15.105:0/1659867948 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f335c06afc0 0x7f335c0a88c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f335000c810 tx=0x7f3350007d90 comp rx=0 tx=0).stop 2023-10-06T03:00:33.960 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.953+0000 7f3361dcc700 1 -- 172.21.15.105:0/1659867948 shutdown_connections 2023-10-06T03:00:33.960 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.953+0000 7f3361dcc700 1 --2- 172.21.15.105:0/1659867948 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f335c15a380 0x7f335c16cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:33.960 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.953+0000 7f3361dcc700 1 --2- 172.21.15.105:0/1659867948 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f335c156b60 0x7f335c16ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:33.960 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.953+0000 7f3361dcc700 1 --2- 172.21.15.105:0/1659867948 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f335c06afc0 0x7f335c0a88c0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:33.960 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.953+0000 7f3361dcc700 1 -- 172.21.15.105:0/1659867948 >> 172.21.15.105:0/1659867948 conn(0x7f335c067050 msgr2=0x7f335c067b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:33.961 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.953+0000 7f3361dcc700 1 -- 172.21.15.105:0/1659867948 shutdown_connections 2023-10-06T03:00:33.961 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:00:33.953+0000 7f3361dcc700 1 -- 172.21.15.105:0/1659867948 wait complete. 2023-10-06T03:00:33.979 INFO:tasks.ceph.osd.0:Restarting daemon 2023-10-06T03:00:33.980 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-10-06T03:00:33.987 INFO:tasks.ceph.osd.0:Started 2023-10-06T03:00:33.987 INFO:tasks.ceph.osd.1:Restarting daemon 2023-10-06T03:00:33.987 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-10-06T03:00:33.993 INFO:tasks.ceph.osd.1:Started 2023-10-06T03:00:33.993 INFO:tasks.ceph.osd.2:Restarting daemon 2023-10-06T03:00:33.993 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-10-06T03:00:33.999 INFO:tasks.ceph.osd.2:Started 2023-10-06T03:00:33.999 INFO:tasks.ceph.osd.3:Restarting daemon 2023-10-06T03:00:33.999 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-10-06T03:00:34.005 INFO:tasks.ceph.osd.3:Started 2023-10-06T03:00:34.005 INFO:tasks.ceph.osd.4:Restarting daemon 2023-10-06T03:00:34.005 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-10-06T03:00:34.027 INFO:tasks.ceph.osd.4:Started 2023-10-06T03:00:34.027 INFO:tasks.ceph.osd.5:Restarting daemon 2023-10-06T03:00:34.027 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-10-06T03:00:34.034 INFO:tasks.ceph.osd.5:Started 2023-10-06T03:00:34.034 INFO:tasks.ceph.osd.6:Restarting daemon 2023-10-06T03:00:34.034 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-10-06T03:00:34.038 INFO:tasks.ceph.osd.6:Started 2023-10-06T03:00:34.039 INFO:tasks.ceph.osd.7:Restarting daemon 2023-10-06T03:00:34.039 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-10-06T03:00:34.046 INFO:tasks.ceph.osd.7:Started 2023-10-06T03:00:34.046 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:00:34.097 INFO:tasks.ceph.mgr.y.smithi057.stderr:2023-10-06T03:00:34.091+0000 7f64df3c7000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-06T03:00:34.126 INFO:tasks.ceph.mgr.x.smithi105.stderr:2023-10-06T03:00:34.121+0000 7fb6d0aeb000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-06T03:00:34.198 INFO:tasks.ceph.mgr.y.smithi057.stderr:2023-10-06T03:00:34.191+0000 7f64df3c7000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-06T03:00:34.210 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:34.203+0000 7ff3298cd700 1 Processor -- start 2023-10-06T03:00:34.211 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:34.207+0000 7ff3298cd700 1 -- start start 2023-10-06T03:00:34.213 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:34.207+0000 7ff3298cd700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff324157ce0 0x7ff32415b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:34.213 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:34.207+0000 7ff3298cd700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff324158530 con 0x7ff3240b10c0 2023-10-06T03:00:34.213 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:34.207+0000 7ff3298cd700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff324158250 con 0x7ff324154d90 2023-10-06T03:00:34.213 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:34.207+0000 7ff3298cd700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff32406bb10 con 0x7ff324157ce0 2023-10-06T03:00:34.214 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:34.207+0000 7ff322ffd700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7ff3240b10c0 0x7ff324154680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:57618/0 (socket says 172.21.15.57:57618) 2023-10-06T03:00:34.214 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:34.207+0000 7ff322ffd700 1 -- 172.21.15.57:0/2300402992 learned_addr learned my addr 172.21.15.57:0/2300402992 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:00:34.214 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:34.207+0000 7ff3237fe700 1 --2- 172.21.15.57:0/2300402992 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff324157ce0 0x7ff32415b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:34.215 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:34.211+0000 7ff321ffb700 1 -- 172.21.15.57:0/2300402992 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3106623250 0 0) 0x7ff324158530 con 0x7ff3240b10c0 2023-10-06T03:00:34.215 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:34.211+0000 7ff321ffb700 1 -- 172.21.15.57:0/2300402992 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff30c003570 con 0x7ff3240b10c0 2023-10-06T03:00:34.215 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:34.211+0000 7ff321ffb700 1 -- 172.21.15.57:0/2300402992 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1935035182 0 0) 0x7ff324158250 con 0x7ff324154d90 2023-10-06T03:00:34.215 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:34.211+0000 7ff3237fe700 1 -- 172.21.15.57:0/2300402992 >> v1:172.21.15.105:6789/0 conn(0x7ff324154d90 legacy=0x7ff3241575d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:34.215 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:34.211+0000 7ff3237fe700 1 -- 172.21.15.57:0/2300402992 >> v1:172.21.15.57:6789/0 conn(0x7ff3240b10c0 legacy=0x7ff324154680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:34.215 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:34.211+0000 7ff3237fe700 1 -- 172.21.15.57:0/2300402992 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff32415ac70 con 0x7ff324157ce0 2023-10-06T03:00:34.216 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:34.211+0000 7ff3237fe700 1 --2- 172.21.15.57:0/2300402992 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff324157ce0 0x7ff32415b750 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff31c009e90 tx=0x7ff31c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa02bb450aa12c86 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:34.216 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:34.211+0000 7ff321ffb700 1 -- 172.21.15.57:0/2300402992 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff31c00e070 con 0x7ff324157ce0 2023-10-06T03:00:34.216 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:34.211+0000 7ff321ffb700 1 -- 172.21.15.57:0/2300402992 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff31c00bc30 con 0x7ff324157ce0 2023-10-06T03:00:34.216 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:34.211+0000 7ff321ffb700 1 -- 172.21.15.57:0/2300402992 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff31c012430 con 0x7ff324157ce0 2023-10-06T03:00:34.217 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:34.211+0000 7ff3298cd700 1 -- 172.21.15.57:0/2300402992 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff324157ce0 msgr2=0x7ff32415b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:34.217 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:34.211+0000 7ff3298cd700 1 --2- 172.21.15.57:0/2300402992 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff324157ce0 0x7ff32415b750 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff31c009e90 tx=0x7ff31c009780 comp rx=0 tx=0).stop 2023-10-06T03:00:34.217 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:34.211+0000 7ff3298cd700 1 -- 172.21.15.57:0/2300402992 shutdown_connections 2023-10-06T03:00:34.217 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:34.211+0000 7ff3298cd700 1 --2- 172.21.15.57:0/2300402992 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff324157ce0 0x7ff32415b750 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:34.218 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:34.211+0000 7ff3298cd700 1 -- 172.21.15.57:0/2300402992 >> 172.21.15.57:0/2300402992 conn(0x7ff3240cbdd0 msgr2=0x7ff3240cc1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:34.218 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:34.211+0000 7ff3298cd700 1 -- 172.21.15.57:0/2300402992 shutdown_connections 2023-10-06T03:00:34.218 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:34.211+0000 7ff3298cd700 1 -- 172.21.15.57:0/2300402992 wait complete. 2023-10-06T03:00:34.220 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:34.215+0000 7ff3298cd700 1 Processor -- start 2023-10-06T03:00:34.220 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:34.215+0000 7ff3298cd700 1 -- start start 2023-10-06T03:00:34.222 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:34.215+0000 7ff3298cd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3240b10c0 0x7ff3240c7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:34.222 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:34.215+0000 7ff3298cd700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff324154d90 0x7ff3240ac230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:34.222 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:34.215+0000 7ff3298cd700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff324157ce0 0x7ff32416c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:34.222 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:34.215+0000 7ff3298cd700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3240acbf0 con 0x7ff3240b10c0 2023-10-06T03:00:34.223 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:34.215+0000 7ff3298cd700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3240aced0 con 0x7ff324154d90 2023-10-06T03:00:34.223 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:34.215+0000 7ff3298cd700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3240ad1b0 con 0x7ff324157ce0 2023-10-06T03:00:34.223 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:34.215+0000 7ff322ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3240b10c0 0x7ff3240c7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:34.223 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:34.215+0000 7ff322ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3240b10c0 0x7ff3240c7fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33818/0 (socket says 172.21.15.57:33818) 2023-10-06T03:00:34.223 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:34.215+0000 7ff322ffd700 1 -- 172.21.15.57:0/1464073776 learned_addr learned my addr 172.21.15.57:0/1464073776 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:00:34.223 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:34.215+0000 7ff3237fe700 1 --2- 172.21.15.57:0/1464073776 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff324157ce0 0x7ff32416c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:34.224 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:34.219+0000 7ff3227fc700 1 --2- 172.21.15.57:0/1464073776 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff324154d90 0x7ff3240ac230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:34.224 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:34.219+0000 7ff322ffd700 1 -- 172.21.15.57:0/1464073776 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff324157ce0 msgr2=0x7ff32416c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:34.224 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:34.219+0000 7ff322ffd700 1 --2- 172.21.15.57:0/1464073776 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff324157ce0 0x7ff32416c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:34.224 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:34.219+0000 7ff322ffd700 1 -- 172.21.15.57:0/1464073776 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff324154d90 msgr2=0x7ff3240ac230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:34.224 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:34.219+0000 7ff322ffd700 1 --2- 172.21.15.57:0/1464073776 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff324154d90 0x7ff3240ac230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:34.225 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:34.219+0000 7ff322ffd700 1 -- 172.21.15.57:0/1464073776 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff31c009a20 con 0x7ff3240b10c0 2023-10-06T03:00:34.225 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:34.219+0000 7ff322ffd700 1 --2- 172.21.15.57:0/1464073776 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3240b10c0 0x7ff3240c7fb0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff31400c7c0 tx=0x7ff314007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:34.225 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:34.219+0000 7ff30affd700 1 -- 172.21.15.57:0/1464073776 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff314005c00 con 0x7ff3240b10c0 2023-10-06T03:00:34.225 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:34.219+0000 7ff30affd700 1 -- 172.21.15.57:0/1464073776 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff314005d80 con 0x7ff3240b10c0 2023-10-06T03:00:34.225 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:34.219+0000 7ff3298cd700 1 -- 172.21.15.57:0/1464073776 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff324166bc0 con 0x7ff3240b10c0 2023-10-06T03:00:34.225 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:34.219+0000 7ff30affd700 1 -- 172.21.15.57:0/1464073776 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff314007320 con 0x7ff3240b10c0 2023-10-06T03:00:34.225 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:34.219+0000 7ff3298cd700 1 -- 172.21.15.57:0/1464073776 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3240c84f0 con 0x7ff3240b10c0 2023-10-06T03:00:34.226 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:34.219+0000 7ff30affd700 1 -- 172.21.15.57:0/1464073776 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7ff31401c440 con 0x7ff3240b10c0 2023-10-06T03:00:34.226 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:34.219+0000 7ff30affd700 1 -- 172.21.15.57:0/1464073776 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7ff314012ae0 con 0x7ff3240b10c0 2023-10-06T03:00:34.226 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:34.219+0000 7ff3298cd700 1 -- 172.21.15.57:0/1464073776 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3240712e0 con 0x7ff3240b10c0 2023-10-06T03:00:34.231 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:34.223+0000 7ff30affd700 1 -- 172.21.15.57:0/1464073776 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7ff314017070 con 0x7ff3240b10c0 2023-10-06T03:00:34.284 INFO:tasks.ceph.mgr.y.smithi057.stderr:2023-10-06T03:00:34.279+0000 7f64df3c7000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-06T03:00:34.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:34.291+0000 7ff3298cd700 1 -- 172.21.15.57:0/1464073776 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff32415af50 con 0x7ff3240b10c0 2023-10-06T03:00:34.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:34.291+0000 7ff30affd700 1 -- 172.21.15.57:0/1464073776 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7ff31401c880 con 0x7ff3240b10c0 2023-10-06T03:00:34.297 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:00:34.297 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":10,"fsid":"eb56dc0f-9213-41cb-9aad-8ade6c802e98","created":"2023-10-06T03:00:30.806197+0000","modified":"2023-10-06T03:00:33.943513+0000","last_up_change":"0.000000","last_in_change":"2023-10-06T03:00:33.943513+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"58cf6c90-d704-43e0-b2db-dffe526d5e8f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"16afbe70-7f9e-4568-9c92-763e6e348119","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"7255c62e-f92f-470f-a5ce-30228920d9f4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"152a236d-f799-4888-8544-74865508d5a9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"37db2a65-3566-41d0-9d60-e66c49e1e68e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"35e77918-1bb4-42ca-9b20-f3c14eaa0c04","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"b4d9d510-7a45-4173-8287-c6c8d6547f2b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"74266fb0-cd84-463f-8bf0-092652a71dc5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:00:34.298 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:34.291+0000 7ff3298cd700 1 -- 172.21.15.57:0/1464073776 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3240b10c0 msgr2=0x7ff3240c7fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:34.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:34.291+0000 7ff3298cd700 1 --2- 172.21.15.57:0/1464073776 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3240b10c0 0x7ff3240c7fb0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff31400c7c0 tx=0x7ff314007dd0 comp rx=0 tx=0).stop 2023-10-06T03:00:34.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:34.291+0000 7ff3298cd700 1 -- 172.21.15.57:0/1464073776 shutdown_connections 2023-10-06T03:00:34.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:34.291+0000 7ff3298cd700 1 --2- 172.21.15.57:0/1464073776 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff324157ce0 0x7ff32416c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:34.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:34.291+0000 7ff3298cd700 1 --2- 172.21.15.57:0/1464073776 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff324154d90 0x7ff3240ac230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:34.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:34.291+0000 7ff3298cd700 1 --2- 172.21.15.57:0/1464073776 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3240b10c0 0x7ff3240c7fb0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:34.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:34.291+0000 7ff3298cd700 1 -- 172.21.15.57:0/1464073776 >> 172.21.15.57:0/1464073776 conn(0x7ff3240cbdd0 msgr2=0x7ff324159c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:34.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:34.295+0000 7ff3298cd700 1 -- 172.21.15.57:0/1464073776 shutdown_connections 2023-10-06T03:00:34.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:34.295+0000 7ff3298cd700 1 -- 172.21.15.57:0/1464073776 wait complete. 2023-10-06T03:00:34.317 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-10-06T03:00:34.317 INFO:tasks.ceph:Waiting for OSDs to come up 2023-10-06T03:00:34.355 INFO:tasks.ceph.mgr.x.smithi105.stderr:2023-10-06T03:00:34.349+0000 7fb6d0aeb000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-06T03:00:34.373 INFO:tasks.ceph.mgr.y.smithi057.stderr:2023-10-06T03:00:34.367+0000 7f64df3c7000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-06T03:00:34.454 INFO:tasks.ceph.mgr.x.smithi105.stderr:2023-10-06T03:00:34.449+0000 7fb6d0aeb000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-06T03:00:34.532 INFO:tasks.ceph.mgr.x.smithi105.stderr:2023-10-06T03:00:34.525+0000 7fb6d0aeb000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-06T03:00:34.615 INFO:tasks.ceph.mgr.x.smithi105.stderr:2023-10-06T03:00:34.609+0000 7fb6d0aeb000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-06T03:00:34.652 INFO:tasks.ceph.osd.0.smithi057.stderr:2023-10-06T03:00:34.647+0000 7f76f50e53c0 -1 Falling back to public interface 2023-10-06T03:00:34.661 INFO:tasks.ceph.osd.3.smithi057.stderr:2023-10-06T03:00:34.655+0000 7fbcd7ce73c0 -1 Falling back to public interface 2023-10-06T03:00:34.662 INFO:tasks.ceph.osd.1.smithi057.stderr:2023-10-06T03:00:34.655+0000 7f2f968e23c0 -1 Falling back to public interface 2023-10-06T03:00:34.680 INFO:tasks.ceph.osd.4.smithi105.stderr:2023-10-06T03:00:34.673+0000 7fe6dd4ee3c0 -1 Falling back to public interface 2023-10-06T03:00:34.684 INFO:tasks.ceph.osd.2.smithi057.stderr:2023-10-06T03:00:34.679+0000 7fcf806f93c0 -1 Falling back to public interface 2023-10-06T03:00:34.691 INFO:tasks.ceph.osd.7.smithi105.stderr:2023-10-06T03:00:34.685+0000 7f9caf0d93c0 -1 Falling back to public interface 2023-10-06T03:00:34.699 INFO:tasks.ceph.osd.5.smithi105.stderr:2023-10-06T03:00:34.693+0000 7fe26b32e3c0 -1 Falling back to public interface 2023-10-06T03:00:34.700 INFO:tasks.ceph.osd.6.smithi105.stderr:2023-10-06T03:00:34.693+0000 7f70efcf83c0 -1 Falling back to public interface 2023-10-06T03:00:34.710 INFO:tasks.ceph.mgr.y.smithi057.stderr:2023-10-06T03:00:34.703+0000 7f64df3c7000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-06T03:00:34.792 INFO:tasks.ceph.mgr.y.smithi057.stderr:2023-10-06T03:00:34.787+0000 7f64df3c7000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-06T03:00:34.886 INFO:tasks.ceph.mgr.y.smithi057.stderr:2023-10-06T03:00:34.879+0000 7f64df3c7000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-06T03:00:34.951 INFO:tasks.ceph.mgr.x.smithi105.stderr:2023-10-06T03:00:34.945+0000 7fb6d0aeb000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-06T03:00:35.034 INFO:tasks.ceph.mgr.x.smithi105.stderr:2023-10-06T03:00:35.029+0000 7fb6d0aeb000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-06T03:00:35.115 INFO:tasks.ceph.mgr.y.smithi057.stderr:2023-10-06T03:00:35.107+0000 7f64df3c7000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-06T03:00:35.124 DEBUG:teuthology.orchestra.run.smithi057:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-06T03:00:35.125 INFO:tasks.ceph.mgr.x.smithi105.stderr:2023-10-06T03:00:35.121+0000 7fb6d0aeb000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-06T03:00:35.215 INFO:tasks.ceph.mgr.y.smithi057.stderr:2023-10-06T03:00:35.211+0000 7f64df3c7000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-06T03:00:35.265 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:35.259+0000 7f49af59e700 1 Processor -- start 2023-10-06T03:00:35.265 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:35.259+0000 7f49af59e700 1 -- start start 2023-10-06T03:00:35.267 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:35.263+0000 7f49af59e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f49b01534b0 0x7f49b006c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:35.267 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:35.263+0000 7f49af59e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49b006d320 con 0x7f49b006ced0 2023-10-06T03:00:35.267 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:35.263+0000 7f49af59e700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49b006b700 con 0x7f49b006b0e0 2023-10-06T03:00:35.267 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:35.263+0000 7f49af59e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49b006b9e0 con 0x7f49b01534b0 2023-10-06T03:00:35.268 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:35.263+0000 7f49ae59c700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f49b01534b0 0x7f49b006c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:35.268 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:35.263+0000 7f49add9b700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f49b006ced0 0x7f49b006a9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:48096/0 (socket says 172.21.15.57:48096) 2023-10-06T03:00:35.268 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:35.263+0000 7f49add9b700 1 -- 172.21.15.57:0/3034889503 learned_addr learned my addr 172.21.15.57:0/3034889503 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:00:35.268 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:35.263+0000 7f49ae59c700 1 -- 172.21.15.57:0/3034889503 >> v1:172.21.15.105:6789/0 conn(0x7f49b006b0e0 legacy=0x7f49b00a90c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:35.268 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:35.263+0000 7f49ad59a700 1 -- 172.21.15.57:0/3034889503 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 232803141 0 0) 0x7f49b006d320 con 0x7f49b006ced0 2023-10-06T03:00:35.268 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:35.263+0000 7f49ae59c700 1 -- 172.21.15.57:0/3034889503 >> v1:172.21.15.57:6789/0 conn(0x7f49b006ced0 legacy=0x7f49b006a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:35.268 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:35.263+0000 7f49ae59c700 1 -- 172.21.15.57:0/3034889503 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49b006bcc0 con 0x7f49b01534b0 2023-10-06T03:00:35.269 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:35.263+0000 7f49ae59c700 1 --2- 172.21.15.57:0/3034889503 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f49b01534b0 0x7f49b006c990 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f49a0009910 tx=0x7f49a00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7010819e571b4e83 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:35.269 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:35.263+0000 7f49ad59a700 1 -- 172.21.15.57:0/3034889503 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49a000b860 con 0x7f49b01534b0 2023-10-06T03:00:35.269 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:35.263+0000 7f49ad59a700 1 -- 172.21.15.57:0/3034889503 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49a000b9c0 con 0x7f49b01534b0 2023-10-06T03:00:35.270 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:35.263+0000 7f49ad59a700 1 -- 172.21.15.57:0/3034889503 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49a000bd60 con 0x7f49b01534b0 2023-10-06T03:00:35.270 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:35.263+0000 7f49af59e700 1 -- 172.21.15.57:0/3034889503 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f49b01534b0 msgr2=0x7f49b006c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:35.270 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:35.263+0000 7f49af59e700 1 --2- 172.21.15.57:0/3034889503 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f49b01534b0 0x7f49b006c990 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f49a0009910 tx=0x7f49a00091a0 comp rx=0 tx=0).stop 2023-10-06T03:00:35.271 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:35.267+0000 7f49af59e700 1 -- 172.21.15.57:0/3034889503 shutdown_connections 2023-10-06T03:00:35.271 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:35.267+0000 7f49af59e700 1 --2- 172.21.15.57:0/3034889503 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f49b01534b0 0x7f49b006c990 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:35.271 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:35.267+0000 7f49af59e700 1 -- 172.21.15.57:0/3034889503 >> 172.21.15.57:0/3034889503 conn(0x7f49b0067050 msgr2=0x7f49b0067450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:35.271 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:35.267+0000 7f49af59e700 1 -- 172.21.15.57:0/3034889503 shutdown_connections 2023-10-06T03:00:35.271 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:35.267+0000 7f49af59e700 1 -- 172.21.15.57:0/3034889503 wait complete. 2023-10-06T03:00:35.273 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:35.267+0000 7f49af59e700 1 Processor -- start 2023-10-06T03:00:35.273 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:35.267+0000 7f49af59e700 1 -- start start 2023-10-06T03:00:35.275 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:35.271+0000 7f49af59e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f49b006b0e0 0x7f49b0149c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:35.275 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:35.271+0000 7f49af59e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f49b006ced0 0x7f49b00c8630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:35.275 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:35.271+0000 7f49af59e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f49b01534b0 0x7f49b00c8b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:35.276 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:35.271+0000 7f49af59e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49b00c9760 con 0x7f49b01534b0 2023-10-06T03:00:35.276 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:35.271+0000 7f49af59e700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49b014a180 con 0x7f49b006b0e0 2023-10-06T03:00:35.276 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:35.271+0000 7f49af59e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49b00ab810 con 0x7f49b006ced0 2023-10-06T03:00:35.276 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:35.271+0000 7f49aed9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f49b01534b0 0x7f49b00c8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:35.276 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:35.271+0000 7f49add9b700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f49b006ced0 0x7f49b00c8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:35.276 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:35.271+0000 7f49aed9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f49b01534b0 0x7f49b00c8b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:59008/0 (socket says 172.21.15.57:59008) 2023-10-06T03:00:35.276 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:35.271+0000 7f49aed9d700 1 -- 172.21.15.57:0/1446062652 learned_addr learned my addr 172.21.15.57:0/1446062652 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:00:35.276 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:35.271+0000 7f49ae59c700 1 --2- 172.21.15.57:0/1446062652 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f49b006b0e0 0x7f49b0149c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:35.278 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:35.271+0000 7f49aed9d700 1 -- 172.21.15.57:0/1446062652 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f49b006ced0 msgr2=0x7f49b00c8630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:35.278 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:35.271+0000 7f49aed9d700 1 --2- 172.21.15.57:0/1446062652 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f49b006ced0 0x7f49b00c8630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:35.278 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:35.271+0000 7f49aed9d700 1 -- 172.21.15.57:0/1446062652 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f49b006b0e0 msgr2=0x7f49b0149c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:35.278 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:35.271+0000 7f49aed9d700 1 --2- 172.21.15.57:0/1446062652 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f49b006b0e0 0x7f49b0149c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:35.278 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:35.271+0000 7f49aed9d700 1 -- 172.21.15.57:0/1446062652 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49a0009420 con 0x7f49b01534b0 2023-10-06T03:00:35.278 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:35.271+0000 7f49aed9d700 1 --2- 172.21.15.57:0/1446062652 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f49b01534b0 0x7f49b00c8b70 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f49a800c870 tx=0x7f49a8001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:35.278 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:35.271+0000 7f499e7fc700 1 -- 172.21.15.57:0/1446062652 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49a8012630 con 0x7f49b01534b0 2023-10-06T03:00:35.278 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:35.271+0000 7f499e7fc700 1 -- 172.21.15.57:0/1446062652 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49a80127b0 con 0x7f49b01534b0 2023-10-06T03:00:35.278 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:35.271+0000 7f499e7fc700 1 -- 172.21.15.57:0/1446062652 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49a8012b70 con 0x7f49b01534b0 2023-10-06T03:00:35.278 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:35.271+0000 7f49af59e700 1 -- 172.21.15.57:0/1446062652 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49b00acbc0 con 0x7f49b01534b0 2023-10-06T03:00:35.278 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:35.271+0000 7f49af59e700 1 -- 172.21.15.57:0/1446062652 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49b00c9480 con 0x7f49b01534b0 2023-10-06T03:00:35.278 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:35.271+0000 7f499e7fc700 1 -- 172.21.15.57:0/1446062652 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f49a8003030 con 0x7f49b01534b0 2023-10-06T03:00:35.279 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:35.271+0000 7f499e7fc700 1 -- 172.21.15.57:0/1446062652 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7f49a801a3a0 con 0x7f49b01534b0 2023-10-06T03:00:35.279 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:35.275+0000 7f49af59e700 1 -- 172.21.15.57:0/1446062652 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49b00acd50 con 0x7f49b01534b0 2023-10-06T03:00:35.281 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:35.275+0000 7f499e7fc700 1 -- 172.21.15.57:0/1446062652 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f49a801b680 con 0x7f49b01534b0 2023-10-06T03:00:35.344 INFO:tasks.ceph.mgr.x.smithi105.stderr:2023-10-06T03:00:35.337+0000 7fb6d0aeb000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-06T03:00:35.419 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:35.411+0000 7f49af59e700 1 -- 172.21.15.57:0/1446062652 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f49b004be40 con 0x7f49b01534b0 2023-10-06T03:00:35.420 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:35.415+0000 7f499e7fc700 1 -- 172.21.15.57:0/1446062652 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7f49a801b820 con 0x7f49b01534b0 2023-10-06T03:00:35.420 INFO:teuthology.misc.health.smithi057.stdout: 2023-10-06T03:00:35.420 INFO:teuthology.misc.health.smithi057.stdout:{"epoch":10,"fsid":"eb56dc0f-9213-41cb-9aad-8ade6c802e98","created":"2023-10-06T03:00:30.806197+0000","modified":"2023-10-06T03:00:33.943513+0000","last_up_change":"0.000000","last_in_change":"2023-10-06T03:00:33.943513+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"58cf6c90-d704-43e0-b2db-dffe526d5e8f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"16afbe70-7f9e-4568-9c92-763e6e348119","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"7255c62e-f92f-470f-a5ce-30228920d9f4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"152a236d-f799-4888-8544-74865508d5a9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"37db2a65-3566-41d0-9d60-e66c49e1e68e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"35e77918-1bb4-42ca-9b20-f3c14eaa0c04","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"b4d9d510-7a45-4173-8287-c6c8d6547f2b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"74266fb0-cd84-463f-8bf0-092652a71dc5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:00:35.422 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:35.415+0000 7f49af59e700 1 -- 172.21.15.57:0/1446062652 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f49b01534b0 msgr2=0x7f49b00c8b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:35.422 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:35.415+0000 7f49af59e700 1 --2- 172.21.15.57:0/1446062652 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f49b01534b0 0x7f49b00c8b70 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f49a800c870 tx=0x7f49a8001670 comp rx=0 tx=0).stop 2023-10-06T03:00:35.422 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:35.415+0000 7f49af59e700 1 -- 172.21.15.57:0/1446062652 shutdown_connections 2023-10-06T03:00:35.422 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:35.415+0000 7f49af59e700 1 --2- 172.21.15.57:0/1446062652 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f49b01534b0 0x7f49b00c8b70 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:35.422 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:35.415+0000 7f49af59e700 1 --2- 172.21.15.57:0/1446062652 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f49b006ced0 0x7f49b00c8630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:35.423 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:35.415+0000 7f49af59e700 1 --2- 172.21.15.57:0/1446062652 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f49b006b0e0 0x7f49b0149c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:35.423 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:35.415+0000 7f49af59e700 1 -- 172.21.15.57:0/1446062652 >> 172.21.15.57:0/1446062652 conn(0x7f49b0067050 msgr2=0x7f49b015a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:35.423 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:35.415+0000 7f49af59e700 1 -- 172.21.15.57:0/1446062652 shutdown_connections 2023-10-06T03:00:35.423 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:35.415+0000 7f49af59e700 1 -- 172.21.15.57:0/1446062652 wait complete. 2023-10-06T03:00:35.438 INFO:tasks.ceph.mgr.x.smithi105.stderr:2023-10-06T03:00:35.433+0000 7fb6d0aeb000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-06T03:00:35.442 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-10-06T03:00:36.240 INFO:tasks.ceph.mgr.y.smithi057.stderr:2023-10-06T03:00:36.235+0000 7f64df3c7000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-06T03:00:36.326 INFO:tasks.ceph.mgr.x.smithi105.stderr:2023-10-06T03:00:36.321+0000 7fb6d0aeb000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-06T03:00:37.284 INFO:tasks.ceph.mgr.y.smithi057.stderr:2023-10-06T03:00:37.279+0000 7f64c6d3e700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-10-06T03:00:37.284 INFO:tasks.ceph.mgr.y.smithi057.stderr:2023-10-06T03:00:37.279+0000 7f64c6d3e700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-10-06T03:00:38.550 INFO:tasks.ceph.osd.3.smithi057.stderr:2023-10-06T03:00:38.543+0000 7fbcd7ce73c0 -1 osd.3 0 log_to_monitors true 2023-10-06T03:00:38.593 INFO:tasks.ceph.osd.0.smithi057.stderr:2023-10-06T03:00:38.587+0000 7f76f50e53c0 -1 osd.0 0 log_to_monitors true 2023-10-06T03:00:38.599 INFO:tasks.ceph.osd.4.smithi105.stderr:2023-10-06T03:00:38.593+0000 7fe6dd4ee3c0 -1 osd.4 0 log_to_monitors true 2023-10-06T03:00:38.623 INFO:tasks.ceph.osd.7.smithi105.stderr:2023-10-06T03:00:38.617+0000 7f9caf0d93c0 -1 osd.7 0 log_to_monitors true 2023-10-06T03:00:38.642 INFO:tasks.ceph.osd.1.smithi057.stderr:2023-10-06T03:00:38.635+0000 7f2f968e23c0 -1 osd.1 0 log_to_monitors true 2023-10-06T03:00:38.662 INFO:tasks.ceph.osd.2.smithi057.stderr:2023-10-06T03:00:38.655+0000 7fcf806f93c0 -1 osd.2 0 log_to_monitors true 2023-10-06T03:00:38.669 INFO:tasks.ceph.osd.5.smithi105.stderr:2023-10-06T03:00:38.661+0000 7fe26b32e3c0 -1 osd.5 0 log_to_monitors true 2023-10-06T03:00:38.686 INFO:tasks.ceph.osd.6.smithi105.stderr:2023-10-06T03:00:38.681+0000 7f70efcf83c0 -1 osd.6 0 log_to_monitors true 2023-10-06T03:00:42.249 DEBUG:teuthology.orchestra.run.smithi057:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-06T03:00:42.446 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:42.439+0000 7fa7e62e3700 1 Processor -- start 2023-10-06T03:00:42.447 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:42.443+0000 7fa7e62e3700 1 -- start start 2023-10-06T03:00:42.449 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:42.443+0000 7fa7e62e3700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa7e015ab50 0x7fa7e015af20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:42.449 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:42.443+0000 7fa7e62e3700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa7e00ac980 0x7fa7e00acdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:42.449 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:42.443+0000 7fa7e62e3700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7e006a190 con 0x7fa7e0069420 2023-10-06T03:00:42.449 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:42.443+0000 7fa7e62e3700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7e00b0430 con 0x7fa7e015ab50 2023-10-06T03:00:42.450 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:42.443+0000 7fa7e62e3700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e0069fb0 con 0x7fa7e00ac980 2023-10-06T03:00:42.450 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:42.443+0000 7fa7e52e1700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa7e015ab50 0x7fa7e015af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:42.451 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:42.443+0000 7fa7e5ae2700 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7fa7e0069420 0x7fa7e00698a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.57:38428/0 (socket says 172.21.15.57:38428) 2023-10-06T03:00:42.451 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:42.443+0000 7fa7e5ae2700 1 -- 172.21.15.57:0/2059244401 learned_addr learned my addr 172.21.15.57:0/2059244401 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:00:42.451 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:42.443+0000 7fa7e4ae0700 1 --2- 172.21.15.57:0/2059244401 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa7e00ac980 0x7fa7e00acdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:42.451 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:42.443+0000 7fa7e52e1700 1 -- 172.21.15.57:0/2059244401 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa7e00ac980 msgr2=0x7fa7e00acdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:42.452 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:42.443+0000 7fa7e52e1700 1 --2- 172.21.15.57:0/2059244401 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa7e00ac980 0x7fa7e00acdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:42.452 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:42.443+0000 7fa7e52e1700 1 -- 172.21.15.57:0/2059244401 >> v1:172.21.15.105:6789/0 conn(0x7fa7e0069420 legacy=0x7fa7e00698a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:42.452 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:42.443+0000 7fa7dffff700 1 -- 172.21.15.57:0/2059244401 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2108912935 0 0) 0x7fa7e006a190 con 0x7fa7e0069420 2023-10-06T03:00:42.452 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:42.443+0000 7fa7e52e1700 1 -- 172.21.15.57:0/2059244401 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7e006a470 con 0x7fa7e015ab50 2023-10-06T03:00:42.452 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:42.447+0000 7fa7e4ae0700 1 --2- 172.21.15.57:0/2059244401 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa7e00ac980 0x7fa7e00acdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:00:42.453 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:42.447+0000 7fa7e52e1700 1 --2- 172.21.15.57:0/2059244401 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7e015ab50 0x7fa7e015af20 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fa7d0009e60 tx=0x7fa7d0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf45fd1d9ac45610 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:42.453 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:42.447+0000 7fa7dffff700 1 -- 172.21.15.57:0/2059244401 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d000bb60 con 0x7fa7e015ab50 2023-10-06T03:00:42.453 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:42.447+0000 7fa7dffff700 1 -- 172.21.15.57:0/2059244401 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7d000bcc0 con 0x7fa7e015ab50 2023-10-06T03:00:42.453 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:42.447+0000 7fa7dffff700 1 -- 172.21.15.57:0/2059244401 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d0014b20 con 0x7fa7e015ab50 2023-10-06T03:00:42.453 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:42.447+0000 7fa7e62e3700 1 -- 172.21.15.57:0/2059244401 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7e015ab50 msgr2=0x7fa7e015af20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:42.453 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:42.447+0000 7fa7e62e3700 1 --2- 172.21.15.57:0/2059244401 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7e015ab50 0x7fa7e015af20 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fa7d0009e60 tx=0x7fa7d0009780 comp rx=0 tx=0).stop 2023-10-06T03:00:42.453 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:42.447+0000 7fa7e62e3700 1 -- 172.21.15.57:0/2059244401 shutdown_connections 2023-10-06T03:00:42.454 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:42.447+0000 7fa7e62e3700 1 --2- 172.21.15.57:0/2059244401 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa7e00ac980 0x7fa7e00acdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:42.454 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:42.447+0000 7fa7e62e3700 1 --2- 172.21.15.57:0/2059244401 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7e015ab50 0x7fa7e015af20 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:42.454 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:42.447+0000 7fa7e62e3700 1 -- 172.21.15.57:0/2059244401 >> 172.21.15.57:0/2059244401 conn(0x7fa7e00ca7c0 msgr2=0x7fa7e00cabc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:42.454 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:42.447+0000 7fa7e62e3700 1 -- 172.21.15.57:0/2059244401 shutdown_connections 2023-10-06T03:00:42.454 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:42.447+0000 7fa7e62e3700 1 -- 172.21.15.57:0/2059244401 wait complete. 2023-10-06T03:00:42.456 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:42.451+0000 7fa7e62e3700 1 Processor -- start 2023-10-06T03:00:42.457 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:42.451+0000 7fa7e62e3700 1 -- start start 2023-10-06T03:00:42.459 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:42.455+0000 7fa7e62e3700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa7e0069420 0x7fa7e00b36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:42.459 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:42.455+0000 7fa7e62e3700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa7e00ac980 0x7fa7e0152c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:42.459 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:42.455+0000 7fa7e62e3700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7e0175cf0 0x7fa7e0155640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:42.459 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:42.455+0000 7fa7e62e3700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e0153910 con 0x7fa7e0175cf0 2023-10-06T03:00:42.459 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:42.455+0000 7fa7e62e3700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e00b1c70 con 0x7fa7e00ac980 2023-10-06T03:00:42.459 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:42.455+0000 7fa7e62e3700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e0152830 con 0x7fa7e0069420 2023-10-06T03:00:42.461 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:42.455+0000 7fa7e5ae2700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7e0175cf0 0x7fa7e0155640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:42.461 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:42.455+0000 7fa7e5ae2700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7e0175cf0 0x7fa7e0155640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:59150/0 (socket says 172.21.15.57:59150) 2023-10-06T03:00:42.461 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:42.455+0000 7fa7e5ae2700 1 -- 172.21.15.57:0/1732344892 learned_addr learned my addr 172.21.15.57:0/1732344892 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:00:42.461 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:42.455+0000 7fa7e4ae0700 1 --2- 172.21.15.57:0/1732344892 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa7e00ac980 0x7fa7e0152c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:42.461 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:42.455+0000 7fa7e52e1700 1 --2- 172.21.15.57:0/1732344892 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa7e0069420 0x7fa7e00b36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:42.461 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:42.455+0000 7fa7e5ae2700 1 -- 172.21.15.57:0/1732344892 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa7e0069420 msgr2=0x7fa7e00b36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:42.461 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:42.455+0000 7fa7e5ae2700 1 --2- 172.21.15.57:0/1732344892 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa7e0069420 0x7fa7e00b36f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:42.461 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:42.455+0000 7fa7e5ae2700 1 -- 172.21.15.57:0/1732344892 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa7e00ac980 msgr2=0x7fa7e0152c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:42.461 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:42.455+0000 7fa7e5ae2700 1 --2- 172.21.15.57:0/1732344892 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa7e00ac980 0x7fa7e0152c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:42.461 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:42.455+0000 7fa7e5ae2700 1 -- 172.21.15.57:0/1732344892 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7d8009420 con 0x7fa7e0175cf0 2023-10-06T03:00:42.461 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:42.455+0000 7fa7e4ae0700 1 --2- 172.21.15.57:0/1732344892 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa7e00ac980 0x7fa7e0152c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:00:42.461 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:42.455+0000 7fa7e5ae2700 1 --2- 172.21.15.57:0/1732344892 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7e0175cf0 0x7fa7e0155640 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fa7d400c7e0 tx=0x7fa7d4007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:42.462 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:42.455+0000 7fa7dd7fa700 1 -- 172.21.15.57:0/1732344892 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d4005c00 con 0x7fa7e0175cf0 2023-10-06T03:00:42.462 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:42.455+0000 7fa7dd7fa700 1 -- 172.21.15.57:0/1732344892 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7d4005d80 con 0x7fa7e0175cf0 2023-10-06T03:00:42.462 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:42.455+0000 7fa7dd7fa700 1 -- 172.21.15.57:0/1732344892 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d4007320 con 0x7fa7e0175cf0 2023-10-06T03:00:42.462 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:42.455+0000 7fa7e62e3700 1 -- 172.21.15.57:0/1732344892 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7d0009a20 con 0x7fa7e0175cf0 2023-10-06T03:00:42.463 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:42.459+0000 7fa7e62e3700 1 -- 172.21.15.57:0/1732344892 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7e01523a0 con 0x7fa7e0175cf0 2023-10-06T03:00:42.465 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:42.459+0000 7fa7dd7fa700 1 -- 172.21.15.57:0/1732344892 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 4) v1 ==== 79903+0+0 (secure 0 0 0) 0x7fa7d401b3b0 con 0x7fa7e0175cf0 2023-10-06T03:00:42.465 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:42.459+0000 7fa7e62e3700 1 -- 172.21.15.57:0/1732344892 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7e0152530 con 0x7fa7e0175cf0 2023-10-06T03:00:42.470 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:42.459+0000 7fa7dd7fa700 1 --2- 172.21.15.57:0/1732344892 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fa7cc060590 0x7fa7cc062a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:42.471 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:42.467+0000 7fa7dd7fa700 1 -- 172.21.15.57:0/1732344892 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2227+0+0 (secure 0 0 0) 0x7fa7d4082d70 con 0x7fa7e0175cf0 2023-10-06T03:00:42.477 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:42.471+0000 7fa7e52e1700 1 --2- 172.21.15.57:0/1732344892 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fa7cc060590 0x7fa7cc062a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:42.477 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:42.471+0000 7fa7dd7fa700 1 -- 172.21.15.57:0/1732344892 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fa7d404bfa0 con 0x7fa7e0175cf0 2023-10-06T03:00:42.478 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:42.471+0000 7fa7e52e1700 1 --2- 172.21.15.57:0/1732344892 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fa7cc060590 0x7fa7cc062a40 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fa7e006bf70 tx=0x7fa7d001f000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:42.605 INFO:tasks.ceph.osd.6.smithi105.stderr:2023-10-06T03:00:42.597+0000 7f70eac2c700 -1 osd.6 0 waiting for initial osdmap 2023-10-06T03:00:42.616 INFO:tasks.ceph.osd.6.smithi105.stderr:2023-10-06T03:00:42.609+0000 7f70e39d0700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T03:00:42.638 INFO:tasks.ceph.osd.5.smithi105.stderr:2023-10-06T03:00:42.633+0000 7fe266ace700 -1 osd.5 0 waiting for initial osdmap 2023-10-06T03:00:42.651 INFO:tasks.ceph.osd.5.smithi105.stderr:2023-10-06T03:00:42.645+0000 7fe25f872700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T03:00:42.786 INFO:tasks.ceph.osd.4.smithi105.stderr:2023-10-06T03:00:42.781+0000 7fe6d841b700 -1 osd.4 0 waiting for initial osdmap 2023-10-06T03:00:42.800 INFO:tasks.ceph.osd.4.smithi105.stderr:2023-10-06T03:00:42.793+0000 7fe6d11bf700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T03:00:42.843 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:42.839+0000 7fa7e62e3700 1 -- 172.21.15.57:0/1732344892 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa7e004be40 con 0x7fa7e0175cf0 2023-10-06T03:00:42.844 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:42.839+0000 7fa7dd7fa700 1 -- 172.21.15.57:0/1732344892 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7013 (secure 0 0 0) 0x7fa7d4017090 con 0x7fa7e0175cf0 2023-10-06T03:00:42.845 INFO:teuthology.misc.health.smithi057.stdout: 2023-10-06T03:00:42.845 INFO:teuthology.misc.health.smithi057.stdout:{"epoch":12,"fsid":"eb56dc0f-9213-41cb-9aad-8ade6c802e98","created":"2023-10-06T03:00:30.806197+0000","modified":"2023-10-06T03:00:40.297436+0000","last_up_change":"0.000000","last_in_change":"2023-10-06T03:00:33.943513+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"58cf6c90-d704-43e0-b2db-dffe526d5e8f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"16afbe70-7f9e-4568-9c92-763e6e348119","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"7255c62e-f92f-470f-a5ce-30228920d9f4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"152a236d-f799-4888-8544-74865508d5a9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"37db2a65-3566-41d0-9d60-e66c49e1e68e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"35e77918-1bb4-42ca-9b20-f3c14eaa0c04","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"b4d9d510-7a45-4173-8287-c6c8d6547f2b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"74266fb0-cd84-463f-8bf0-092652a71dc5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:00:42.848 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:42.843+0000 7fa7e62e3700 1 -- 172.21.15.57:0/1732344892 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fa7cc060590 msgr2=0x7fa7cc062a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:42.848 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:42.843+0000 7fa7e62e3700 1 --2- 172.21.15.57:0/1732344892 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fa7cc060590 0x7fa7cc062a40 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fa7e006bf70 tx=0x7fa7d001f000 comp rx=0 tx=0).stop 2023-10-06T03:00:42.848 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:42.843+0000 7fa7e62e3700 1 -- 172.21.15.57:0/1732344892 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7e0175cf0 msgr2=0x7fa7e0155640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:42.848 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:42.843+0000 7fa7e62e3700 1 --2- 172.21.15.57:0/1732344892 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7e0175cf0 0x7fa7e0155640 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fa7d400c7e0 tx=0x7fa7d4007d90 comp rx=0 tx=0).stop 2023-10-06T03:00:42.849 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:42.843+0000 7fa7e62e3700 1 -- 172.21.15.57:0/1732344892 shutdown_connections 2023-10-06T03:00:42.849 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:42.843+0000 7fa7e62e3700 1 --2- 172.21.15.57:0/1732344892 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7e0175cf0 0x7fa7e0155640 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:42.849 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:42.843+0000 7fa7e62e3700 1 --2- 172.21.15.57:0/1732344892 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa7e00ac980 0x7fa7e0152c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:42.849 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:42.843+0000 7fa7e62e3700 1 --2- 172.21.15.57:0/1732344892 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fa7cc060590 0x7fa7cc062a40 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:42.849 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:42.843+0000 7fa7e62e3700 1 --2- 172.21.15.57:0/1732344892 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa7e0069420 0x7fa7e00b36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:42.849 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:42.843+0000 7fa7e62e3700 1 -- 172.21.15.57:0/1732344892 >> 172.21.15.57:0/1732344892 conn(0x7fa7e00ca7c0 msgr2=0x7fa7e0153c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:42.849 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:42.843+0000 7fa7e62e3700 1 -- 172.21.15.57:0/1732344892 shutdown_connections 2023-10-06T03:00:42.850 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:42.843+0000 7fa7e62e3700 1 -- 172.21.15.57:0/1732344892 wait complete. 2023-10-06T03:00:42.857 INFO:tasks.ceph.osd.7.smithi105.stderr:2023-10-06T03:00:42.853+0000 7f9ca9f65700 -1 osd.7 0 waiting for initial osdmap 2023-10-06T03:00:42.871 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-10-06T03:00:42.872 INFO:tasks.ceph.osd.7.smithi105.stderr:2023-10-06T03:00:42.865+0000 7f9ca2d09700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T03:00:43.285 INFO:tasks.ceph.osd.3.smithi057.stderr:2023-10-06T03:00:43.279+0000 7fbcd2b6a700 -1 osd.3 0 waiting for initial osdmap 2023-10-06T03:00:43.301 INFO:tasks.ceph.osd.3.smithi057.stderr:2023-10-06T03:00:43.295+0000 7fbccb90e700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T03:00:43.312 INFO:tasks.ceph.osd.0.smithi057.stderr:2023-10-06T03:00:43.307+0000 7f76f00d8700 -1 osd.0 0 waiting for initial osdmap 2023-10-06T03:00:43.326 INFO:tasks.ceph.osd.0.smithi057.stderr:2023-10-06T03:00:43.319+0000 7f76e8e7c700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T03:00:43.329 INFO:tasks.ceph.osd.2.smithi057.stderr:2023-10-06T03:00:43.323+0000 7fcf7b62c700 -1 osd.2 0 waiting for initial osdmap 2023-10-06T03:00:43.334 INFO:tasks.ceph.osd.1.smithi057.stderr:2023-10-06T03:00:43.327+0000 7f2f92f8f700 -1 osd.1 0 waiting for initial osdmap 2023-10-06T03:00:43.341 INFO:tasks.ceph.osd.2.smithi057.stderr:2023-10-06T03:00:43.335+0000 7fcf743d0700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T03:00:43.345 INFO:tasks.ceph.osd.1.smithi057.stderr:2023-10-06T03:00:43.339+0000 7f2f8a50e700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T03:00:47.851 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:00:47.857 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:00:49.678 DEBUG:teuthology.orchestra.run.smithi057:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-06T03:00:49.827 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:49.823+0000 7fdae6a78700 1 Processor -- start 2023-10-06T03:00:49.827 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:49.823+0000 7fdae6a78700 1 -- start start 2023-10-06T03:00:49.829 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:49.823+0000 7fdae6a78700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdae006cbc0 0x7fdae006cf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:49.829 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:49.823+0000 7fdae6a78700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fdae00ca9d0 0x7fdae00cd850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:49.829 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:49.823+0000 7fdae6a78700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdae00cae00 con 0x7fdae0158f90 2023-10-06T03:00:49.829 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:49.823+0000 7fdae6a78700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdae00c3cd0 con 0x7fdae00ca9d0 2023-10-06T03:00:49.830 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:49.823+0000 7fdae6a78700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdae00cc330 con 0x7fdae006cbc0 2023-10-06T03:00:49.830 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:49.823+0000 7fdadffff700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fdae00ca9d0 0x7fdae00cd850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:49.830 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:49.823+0000 7fdae4814700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdae006cbc0 0x7fdae006cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:49.830 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:49.823+0000 7fdadffff700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fdae00ca9d0 0x7fdae00cd850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.57:37686/0 (socket says 172.21.15.57:37686) 2023-10-06T03:00:49.830 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:49.823+0000 7fdadffff700 1 -- 172.21.15.57:0/2397023981 learned_addr learned my addr 172.21.15.57:0/2397023981 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:00:49.831 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:49.827+0000 7fdadffff700 1 -- 172.21.15.57:0/2397023981 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdae006cbc0 msgr2=0x7fdae006cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:49.831 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:49.827+0000 7fdadffff700 1 --2- 172.21.15.57:0/2397023981 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdae006cbc0 0x7fdae006cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:49.831 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:49.827+0000 7fdadffff700 1 -- 172.21.15.57:0/2397023981 >> v1:172.21.15.105:6789/0 conn(0x7fdae0158f90 legacy=0x7fdae01593d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:49.831 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:49.827+0000 7fdadffff700 1 -- 172.21.15.57:0/2397023981 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdae00cc8b0 con 0x7fdae00ca9d0 2023-10-06T03:00:49.832 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:49.827+0000 7fdadffff700 1 --2- 172.21.15.57:0/2397023981 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdae00ca9d0 0x7fdae00cd850 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fdacc0099b0 tx=0x7fdacc009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8317e2ca1df73e67 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:49.832 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:49.827+0000 7fdadf7fe700 1 -- 172.21.15.57:0/2397023981 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdacc009ea0 con 0x7fdae00ca9d0 2023-10-06T03:00:49.833 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:49.827+0000 7fdadf7fe700 1 -- 172.21.15.57:0/2397023981 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdacc00b8f0 con 0x7fdae00ca9d0 2023-10-06T03:00:49.833 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:49.827+0000 7fdadf7fe700 1 -- 172.21.15.57:0/2397023981 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdacc00bc90 con 0x7fdae00ca9d0 2023-10-06T03:00:49.834 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:49.827+0000 7fdae6a78700 1 -- 172.21.15.57:0/2397023981 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdae00ca9d0 msgr2=0x7fdae00cd850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:49.834 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:49.827+0000 7fdae6a78700 1 --2- 172.21.15.57:0/2397023981 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdae00ca9d0 0x7fdae00cd850 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fdacc0099b0 tx=0x7fdacc009250 comp rx=0 tx=0).stop 2023-10-06T03:00:49.834 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:49.827+0000 7fdae6a78700 1 -- 172.21.15.57:0/2397023981 shutdown_connections 2023-10-06T03:00:49.834 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:49.827+0000 7fdae6a78700 1 --2- 172.21.15.57:0/2397023981 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdae00ca9d0 0x7fdae00cd850 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:49.834 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:49.827+0000 7fdae6a78700 1 --2- 172.21.15.57:0/2397023981 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdae006cbc0 0x7fdae006cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:49.834 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:49.827+0000 7fdae6a78700 1 -- 172.21.15.57:0/2397023981 >> 172.21.15.57:0/2397023981 conn(0x7fdae006e280 msgr2=0x7fdae00cce00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:49.834 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:49.827+0000 7fdae6a78700 1 -- 172.21.15.57:0/2397023981 shutdown_connections 2023-10-06T03:00:49.834 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:49.827+0000 7fdae6a78700 1 -- 172.21.15.57:0/2397023981 wait complete. 2023-10-06T03:00:49.836 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:49.831+0000 7fdae6a78700 1 Processor -- start 2023-10-06T03:00:49.837 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:49.831+0000 7fdae6a78700 1 -- start start 2023-10-06T03:00:49.839 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:49.835+0000 7fdae6a78700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdae006cbc0 0x7fdae0153140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:49.839 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:49.835+0000 7fdae6a78700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdae0158f90 0x7fdae00c4900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:49.839 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:49.835+0000 7fdae6a78700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdae00c4e40 0x7fdae00b0e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:49.839 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:49.835+0000 7fdae6a78700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdae00c5fb0 con 0x7fdae006cbc0 2023-10-06T03:00:49.839 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:49.835+0000 7fdae6a78700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdae00c3eb0 con 0x7fdae00c4e40 2023-10-06T03:00:49.839 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:49.835+0000 7fdae6a78700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdae00c4470 con 0x7fdae0158f90 2023-10-06T03:00:49.840 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:49.835+0000 7fdae4814700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdae006cbc0 0x7fdae0153140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:49.840 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:49.835+0000 7fdae4814700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdae006cbc0 0x7fdae0153140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:57894/0 (socket says 172.21.15.57:57894) 2023-10-06T03:00:49.840 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:49.835+0000 7fdae4814700 1 -- 172.21.15.57:0/4164173245 learned_addr learned my addr 172.21.15.57:0/4164173245 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:00:49.840 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:49.835+0000 7fdadffff700 1 --2- 172.21.15.57:0/4164173245 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdae0158f90 0x7fdae00c4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:49.840 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:49.835+0000 7fdae5015700 1 --2- 172.21.15.57:0/4164173245 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdae00c4e40 0x7fdae00b0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:49.841 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:49.835+0000 7fdae4814700 1 -- 172.21.15.57:0/4164173245 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdae0158f90 msgr2=0x7fdae00c4900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:49.841 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:49.835+0000 7fdae4814700 1 --2- 172.21.15.57:0/4164173245 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdae0158f90 0x7fdae00c4900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:49.841 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:49.835+0000 7fdae4814700 1 -- 172.21.15.57:0/4164173245 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdae00c4e40 msgr2=0x7fdae00b0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:49.841 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:49.835+0000 7fdae4814700 1 --2- 172.21.15.57:0/4164173245 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdae00c4e40 0x7fdae00b0e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:49.841 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:49.835+0000 7fdae4814700 1 -- 172.21.15.57:0/4164173245 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdacc0094f0 con 0x7fdae006cbc0 2023-10-06T03:00:49.841 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:49.835+0000 7fdae5015700 1 --2- 172.21.15.57:0/4164173245 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdae00c4e40 0x7fdae00b0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:00:49.841 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:49.835+0000 7fdadffff700 1 --2- 172.21.15.57:0/4164173245 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdae0158f90 0x7fdae00c4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:00:49.842 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:49.835+0000 7fdae4814700 1 --2- 172.21.15.57:0/4164173245 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdae006cbc0 0x7fdae0153140 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fdad400ecb0 tx=0x7fdad4009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:49.842 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:49.835+0000 7fdadcff9700 1 -- 172.21.15.57:0/4164173245 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad400c9d0 con 0x7fdae006cbc0 2023-10-06T03:00:49.842 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:49.835+0000 7fdadcff9700 1 -- 172.21.15.57:0/4164173245 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdad400cb30 con 0x7fdae006cbc0 2023-10-06T03:00:49.842 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:49.835+0000 7fdadcff9700 1 -- 172.21.15.57:0/4164173245 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad400ceb0 con 0x7fdae006cbc0 2023-10-06T03:00:49.842 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:49.835+0000 7fdae6a78700 1 -- 172.21.15.57:0/4164173245 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdae015dc70 con 0x7fdae006cbc0 2023-10-06T03:00:49.842 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:49.835+0000 7fdae6a78700 1 -- 172.21.15.57:0/4164173245 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdae00c4100 con 0x7fdae006cbc0 2023-10-06T03:00:49.843 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:49.839+0000 7fdae6a78700 1 -- 172.21.15.57:0/4164173245 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdae00c5240 con 0x7fdae006cbc0 2023-10-06T03:00:49.845 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:49.839+0000 7fdadcff9700 1 -- 172.21.15.57:0/4164173245 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fdad4013680 con 0x7fdae006cbc0 2023-10-06T03:00:49.847 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:49.843+0000 7fdadcff9700 1 --2- 172.21.15.57:0/4164173245 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fdac4060580 0x7fdac4062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:49.848 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:49.843+0000 7fdadcff9700 1 -- 172.21.15.57:0/4164173245 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fdad407cbb0 con 0x7fdae006cbc0 2023-10-06T03:00:49.848 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:49.843+0000 7fdadffff700 1 --2- 172.21.15.57:0/4164173245 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fdac4060580 0x7fdac4062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:49.849 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:49.843+0000 7fdadffff700 1 --2- 172.21.15.57:0/4164173245 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fdac4060580 0x7fdac4062a30 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fdacc0099b0 tx=0x7fdacc017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:49.855 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:49.851+0000 7fdadcff9700 1 -- 172.21.15.57:0/4164173245 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fdad404d450 con 0x7fdae006cbc0 2023-10-06T03:00:50.029 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:50.023+0000 7fdae6a78700 1 -- 172.21.15.57:0/4164173245 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdae004be40 con 0x7fdae006cbc0 2023-10-06T03:00:50.030 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:50.023+0000 7fdadcff9700 1 -- 172.21.15.57:0/4164173245 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12127 (secure 0 0 0) 0x7fdad4021090 con 0x7fdae006cbc0 2023-10-06T03:00:50.031 INFO:teuthology.misc.health.smithi057.stdout: 2023-10-06T03:00:50.031 INFO:teuthology.misc.health.smithi057.stdout:{"epoch":16,"fsid":"eb56dc0f-9213-41cb-9aad-8ade6c802e98","created":"2023-10-06T03:00:30.806197+0000","modified":"2023-10-06T03:00:46.650595+0000","last_up_change":"2023-10-06T03:00:43.607454+0000","last_in_change":"2023-10-06T03:00:33.943513+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T03:00:44.360651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"58cf6c90-d704-43e0-b2db-dffe526d5e8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":33053},{"type":"v1","addr":"172.21.15.57:6801","nonce":33053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":33053},{"type":"v1","addr":"172.21.15.57:6803","nonce":33053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":33053},{"type":"v1","addr":"172.21.15.57:6807","nonce":33053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":33053},{"type":"v1","addr":"172.21.15.57:6805","nonce":33053}]},"public_addr":"172.21.15.57:6801/33053","cluster_addr":"172.21.15.57:6803/33053","heartbeat_back_addr":"172.21.15.57:6807/33053","heartbeat_front_addr":"172.21.15.57:6805/33053","state":["exists","up"]},{"osd":1,"uuid":"16afbe70-7f9e-4568-9c92-763e6e348119","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6809","nonce":33052},{"type":"v1","addr":"172.21.15.57:6810","nonce":33052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":33052},{"type":"v1","addr":"172.21.15.57:6813","nonce":33052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":33052},{"type":"v1","addr":"172.21.15.57:6822","nonce":33052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6815","nonce":33052},{"type":"v1","addr":"172.21.15.57:6818","nonce":33052}]},"public_addr":"172.21.15.57:6810/33052","cluster_addr":"172.21.15.57:6813/33052","heartbeat_back_addr":"172.21.15.57:6822/33052","heartbeat_front_addr":"172.21.15.57:6818/33052","state":["exists","up"]},{"osd":2,"uuid":"7255c62e-f92f-470f-a5ce-30228920d9f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":33058},{"type":"v1","addr":"172.21.15.57:6825","nonce":33058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":33058},{"type":"v1","addr":"172.21.15.57:6827","nonce":33058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":33058},{"type":"v1","addr":"172.21.15.57:6831","nonce":33058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":33058},{"type":"v1","addr":"172.21.15.57:6829","nonce":33058}]},"public_addr":"172.21.15.57:6825/33058","cluster_addr":"172.21.15.57:6827/33058","heartbeat_back_addr":"172.21.15.57:6831/33058","heartbeat_front_addr":"172.21.15.57:6829/33058","state":["exists","up"]},{"osd":3,"uuid":"152a236d-f799-4888-8544-74865508d5a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":33057},{"type":"v1","addr":"172.21.15.57:6811","nonce":33057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":33057},{"type":"v1","addr":"172.21.15.57:6816","nonce":33057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6821","nonce":33057},{"type":"v1","addr":"172.21.15.57:6823","nonce":33057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6817","nonce":33057},{"type":"v1","addr":"172.21.15.57:6819","nonce":33057}]},"public_addr":"172.21.15.57:6811/33057","cluster_addr":"172.21.15.57:6816/33057","heartbeat_back_addr":"172.21.15.57:6823/33057","heartbeat_front_addr":"172.21.15.57:6819/33057","state":["exists","up"]},{"osd":4,"uuid":"37db2a65-3566-41d0-9d60-e66c49e1e68e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":33368},{"type":"v1","addr":"172.21.15.105:6801","nonce":33368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":33368},{"type":"v1","addr":"172.21.15.105:6803","nonce":33368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":33368},{"type":"v1","addr":"172.21.15.105:6807","nonce":33368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":33368},{"type":"v1","addr":"172.21.15.105:6805","nonce":33368}]},"public_addr":"172.21.15.105:6801/33368","cluster_addr":"172.21.15.105:6803/33368","heartbeat_back_addr":"172.21.15.105:6807/33368","heartbeat_front_addr":"172.21.15.105:6805/33368","state":["exists","up"]},{"osd":5,"uuid":"35e77918-1bb4-42ca-9b20-f3c14eaa0c04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":33379},{"type":"v1","addr":"172.21.15.105:6818","nonce":33379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":33379},{"type":"v1","addr":"172.21.15.105:6823","nonce":33379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":33379},{"type":"v1","addr":"172.21.15.105:6831","nonce":33379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":33379},{"type":"v1","addr":"172.21.15.105:6827","nonce":33379}]},"public_addr":"172.21.15.105:6818/33379","cluster_addr":"172.21.15.105:6823/33379","heartbeat_back_addr":"172.21.15.105:6831/33379","heartbeat_front_addr":"172.21.15.105:6827/33379","state":["exists","up"]},{"osd":6,"uuid":"b4d9d510-7a45-4173-8287-c6c8d6547f2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":33369},{"type":"v1","addr":"172.21.15.105:6819","nonce":33369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":33369},{"type":"v1","addr":"172.21.15.105:6822","nonce":33369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":33369},{"type":"v1","addr":"172.21.15.105:6830","nonce":33369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":33369},{"type":"v1","addr":"172.21.15.105:6826","nonce":33369}]},"public_addr":"172.21.15.105:6819/33369","cluster_addr":"172.21.15.105:6822/33369","heartbeat_back_addr":"172.21.15.105:6830/33369","heartbeat_front_addr":"172.21.15.105:6826/33369","state":["exists","up"]},{"osd":7,"uuid":"74266fb0-cd84-463f-8bf0-092652a71dc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":33370},{"type":"v1","addr":"172.21.15.105:6809","nonce":33370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":33370},{"type":"v1","addr":"172.21.15.105:6811","nonce":33370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":33370},{"type":"v1","addr":"172.21.15.105:6815","nonce":33370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":33370},{"type":"v1","addr":"172.21.15.105:6813","nonce":33370}]},"public_addr":"172.21.15.105:6809/33370","cluster_addr":"172.21.15.105:6811/33370","heartbeat_back_addr":"172.21.15.105:6815/33370","heartbeat_front_addr":"172.21.15.105:6813/33370","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.596864+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.633851+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.636993+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.529681+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.608601+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.659752+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.661717+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.642221+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:00:50.033 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:50.027+0000 7fdae6a78700 1 -- 172.21.15.57:0/4164173245 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fdac4060580 msgr2=0x7fdac4062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:50.034 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:50.027+0000 7fdae6a78700 1 --2- 172.21.15.57:0/4164173245 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fdac4060580 0x7fdac4062a30 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fdacc0099b0 tx=0x7fdacc017000 comp rx=0 tx=0).stop 2023-10-06T03:00:50.034 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:50.027+0000 7fdae6a78700 1 -- 172.21.15.57:0/4164173245 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdae006cbc0 msgr2=0x7fdae0153140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:50.034 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:50.027+0000 7fdae6a78700 1 --2- 172.21.15.57:0/4164173245 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdae006cbc0 0x7fdae0153140 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fdad400ecb0 tx=0x7fdad4009120 comp rx=0 tx=0).stop 2023-10-06T03:00:50.034 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:50.027+0000 7fdae6a78700 1 -- 172.21.15.57:0/4164173245 shutdown_connections 2023-10-06T03:00:50.034 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:50.027+0000 7fdae6a78700 1 --2- 172.21.15.57:0/4164173245 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdae00c4e40 0x7fdae00b0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:50.034 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:50.027+0000 7fdae6a78700 1 --2- 172.21.15.57:0/4164173245 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fdac4060580 0x7fdac4062a30 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:50.034 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:50.027+0000 7fdae6a78700 1 --2- 172.21.15.57:0/4164173245 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdae0158f90 0x7fdae00c4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:50.034 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:50.027+0000 7fdae6a78700 1 --2- 172.21.15.57:0/4164173245 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdae006cbc0 0x7fdae0153140 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:50.035 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:50.027+0000 7fdae6a78700 1 -- 172.21.15.57:0/4164173245 >> 172.21.15.57:0/4164173245 conn(0x7fdae006e280 msgr2=0x7fdae00cd550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:50.035 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:50.027+0000 7fdae6a78700 1 -- 172.21.15.57:0/4164173245 shutdown_connections 2023-10-06T03:00:50.035 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:00:50.027+0000 7fdae6a78700 1 -- 172.21.15.57:0/4164173245 wait complete. 2023-10-06T03:00:50.052 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-10-06T03:00:50.052 INFO:tasks.ceph:Creating RBD pool 2023-10-06T03:00:50.053 DEBUG:teuthology.orchestra.run.smithi057:> sudo ceph --cluster ceph osd pool create rbd 8 2023-10-06T03:00:50.211 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:50.207+0000 7f2805c8e700 1 Processor -- start 2023-10-06T03:00:50.211 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:50.207+0000 7f2805c8e700 1 -- start start 2023-10-06T03:00:50.215 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:50.211+0000 7f2805c8e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f280006e040 0x7f280006b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:50.215 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:50.211+0000 7f2805c8e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f280006c920 con 0x7f28000cb140 2023-10-06T03:00:50.216 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:50.211+0000 7f2805c8e700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f280006d4a0 con 0x7f28000cb510 2023-10-06T03:00:50.216 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:50.211+0000 7f2805c8e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28000cb960 con 0x7f280006e040 2023-10-06T03:00:50.216 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:50.211+0000 7f2804c8c700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f28000cb140 0x7f28000b0080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:36224/0 (socket says 172.21.15.57:36224) 2023-10-06T03:00:50.216 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:50.211+0000 7f2804c8c700 1 -- 172.21.15.57:0/3835076535 learned_addr learned my addr 172.21.15.57:0/3835076535 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:00:50.218 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:50.211+0000 7f280548d700 1 --2- 172.21.15.57:0/3835076535 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f280006e040 0x7f280006b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:50.218 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:50.211+0000 7f27ff7fe700 1 -- 172.21.15.57:0/3835076535 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 361414898 0 0) 0x7f280006c920 con 0x7f28000cb140 2023-10-06T03:00:50.218 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:50.211+0000 7f27ff7fe700 1 -- 172.21.15.57:0/3835076535 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27f0003570 con 0x7f28000cb140 2023-10-06T03:00:50.218 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:50.211+0000 7f27ff7fe700 1 -- 172.21.15.57:0/3835076535 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 38256573 0 0) 0x7f280006d4a0 con 0x7f28000cb510 2023-10-06T03:00:50.219 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:50.211+0000 7f27ff7fe700 1 -- 172.21.15.57:0/3835076535 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f280006c920 con 0x7f28000cb510 2023-10-06T03:00:50.219 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:50.211+0000 7f27ff7fe700 1 -- 172.21.15.57:0/3835076535 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2726554992 0 0) 0x7f27f0003570 con 0x7f28000cb140 2023-10-06T03:00:50.219 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:50.211+0000 7f27ff7fe700 1 -- 172.21.15.57:0/3835076535 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f280006e040 msgr2=0x7f280006b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:50.219 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:50.211+0000 7f27ff7fe700 1 --2- 172.21.15.57:0/3835076535 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f280006e040 0x7f280006b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:50.219 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:50.211+0000 7f27ff7fe700 1 -- 172.21.15.57:0/3835076535 >> v1:172.21.15.105:6789/0 conn(0x7f28000cb510 legacy=0x7f280006d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:50.220 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:50.211+0000 7f27ff7fe700 1 -- 172.21.15.57:0/3835076535 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f280006cb70 con 0x7f28000cb140 2023-10-06T03:00:50.220 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:50.211+0000 7f27ff7fe700 1 -- 172.21.15.57:0/3835076535 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2482400018 0 0) 0x7f27f4001470 con 0x7f28000cb140 2023-10-06T03:00:50.220 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:50.211+0000 7f27ff7fe700 1 -- 172.21.15.57:0/3835076535 >> v1:172.21.15.57:6789/0 conn(0x7f28000cb140 legacy=0x7f28000b0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:50.220 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:50.211+0000 7f27ff7fe700 1 --2- 172.21.15.57:0/3835076535 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f27f0003c20 0x7f27f0004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:50.220 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:50.211+0000 7f27ff7fe700 1 --2- 172.21.15.57:0/3835076535 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f280006e040 0x7f27f0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:50.220 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:50.211+0000 7f27ff7fe700 1 --2- 172.21.15.57:0/3835076535 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27f0004d50 0x7f27f00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:50.220 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:50.211+0000 7f27ff7fe700 1 -- 172.21.15.57:0/3835076535 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28000cb960 con 0x7f27f0003c20 2023-10-06T03:00:50.220 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:50.211+0000 7f27ff7fe700 1 -- 172.21.15.57:0/3835076535 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27f000bb40 con 0x7f27f0004d50 2023-10-06T03:00:50.221 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:50.211+0000 7f27ff7fe700 1 -- 172.21.15.57:0/3835076535 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27f000bd00 con 0x7f280006e040 2023-10-06T03:00:50.221 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:50.211+0000 7f2804c8c700 1 --2- 172.21.15.57:0/3835076535 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f27f0003c20 0x7f27f0004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:50.221 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:50.211+0000 7f27fffff700 1 --2- 172.21.15.57:0/3835076535 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f280006e040 0x7f27f0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:50.221 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:50.211+0000 7f280548d700 1 --2- 172.21.15.57:0/3835076535 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27f0004d50 0x7f27f00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:50.222 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:50.211+0000 7f2804c8c700 1 -- 172.21.15.57:0/3835076535 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f280006e040 msgr2=0x7f27f0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:50.223 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:50.211+0000 7f2804c8c700 1 --2- 172.21.15.57:0/3835076535 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f280006e040 0x7f27f0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:50.223 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:50.211+0000 7f2804c8c700 1 -- 172.21.15.57:0/3835076535 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27f0004d50 msgr2=0x7f27f00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:50.223 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:50.211+0000 7f2804c8c700 1 --2- 172.21.15.57:0/3835076535 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27f0004d50 0x7f27f00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:50.223 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:50.215+0000 7f2804c8c700 1 -- 172.21.15.57:0/3835076535 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27f0003570 con 0x7f27f0003c20 2023-10-06T03:00:50.223 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:50.215+0000 7f27fffff700 1 --2- 172.21.15.57:0/3835076535 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f280006e040 0x7f27f0004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:00:50.223 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:50.215+0000 7f2804c8c700 1 --2- 172.21.15.57:0/3835076535 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f27f0003c20 0x7f27f0004010 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f27f400c2d0 tx=0x7f27f4001e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f79a6cc618509359 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:50.223 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:50.215+0000 7f27ff7fe700 1 -- 172.21.15.57:0/3835076535 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f400cbc0 con 0x7f27f0003c20 2023-10-06T03:00:50.223 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:50.215+0000 7f27ff7fe700 1 -- 172.21.15.57:0/3835076535 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27f400cd20 con 0x7f27f0003c20 2023-10-06T03:00:50.223 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:50.215+0000 7f27ff7fe700 1 -- 172.21.15.57:0/3835076535 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f4005b70 con 0x7f27f0003c20 2023-10-06T03:00:50.224 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:50.215+0000 7f2805c8e700 1 -- 172.21.15.57:0/3835076535 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f27f0003c20 msgr2=0x7f27f0004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:50.224 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:50.215+0000 7f2805c8e700 1 --2- 172.21.15.57:0/3835076535 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f27f0003c20 0x7f27f0004010 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f27f400c2d0 tx=0x7f27f4001e10 comp rx=0 tx=0).stop 2023-10-06T03:00:50.224 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:50.215+0000 7f280548d700 1 -- 172.21.15.57:0/3835076535 reap_dead start 2023-10-06T03:00:50.224 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:50.215+0000 7f2805c8e700 1 -- 172.21.15.57:0/3835076535 shutdown_connections 2023-10-06T03:00:50.224 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:50.215+0000 7f2805c8e700 1 -- 172.21.15.57:0/3835076535 >> 172.21.15.57:0/3835076535 conn(0x7f28000d0a50 msgr2=0x7f28000cca60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:50.224 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:50.215+0000 7f2805c8e700 1 -- 172.21.15.57:0/3835076535 shutdown_connections 2023-10-06T03:00:50.224 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:50.215+0000 7f2805c8e700 1 -- 172.21.15.57:0/3835076535 wait complete. 2023-10-06T03:00:50.225 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:50.219+0000 7f2805c8e700 1 Processor -- start 2023-10-06T03:00:50.225 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:50.219+0000 7f2805c8e700 1 -- start start 2023-10-06T03:00:50.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:50.219+0000 7f2805c8e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f280014b5d0 0x7f28000b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:50.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:50.219+0000 7f2805c8e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f280015bd50 0x7f280015c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:50.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:50.219+0000 7f2805c8e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f28000b2da0 0x7f28000b3210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:50.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:50.219+0000 7f2805c8e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f280015c700 con 0x7f280014b5d0 2023-10-06T03:00:50.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:50.219+0000 7f2805c8e700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28000c3a50 con 0x7f280015bd50 2023-10-06T03:00:50.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:50.219+0000 7f2805c8e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28000c48b0 con 0x7f28000b2da0 2023-10-06T03:00:50.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:50.219+0000 7f2804c8c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f280014b5d0 0x7f28000b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:50.231 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:50.223+0000 7f2804c8c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f280014b5d0 0x7f28000b4dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:57918/0 (socket says 172.21.15.57:57918) 2023-10-06T03:00:50.231 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:50.223+0000 7f2804c8c700 1 -- 172.21.15.57:0/467899311 learned_addr learned my addr 172.21.15.57:0/467899311 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:00:50.231 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:50.223+0000 7f280548d700 1 --2- 172.21.15.57:0/467899311 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f28000b2da0 0x7f28000b3210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:50.231 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:50.223+0000 7f27fffff700 1 --2- 172.21.15.57:0/467899311 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f280015bd50 0x7f280015c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:50.231 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:50.223+0000 7f2804c8c700 1 -- 172.21.15.57:0/467899311 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f28000b2da0 msgr2=0x7f28000b3210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:50.231 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:50.223+0000 7f2804c8c700 1 --2- 172.21.15.57:0/467899311 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f28000b2da0 0x7f28000b3210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:50.231 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:50.223+0000 7f2804c8c700 1 -- 172.21.15.57:0/467899311 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f280015bd50 msgr2=0x7f280015c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:50.232 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:50.223+0000 7f2804c8c700 1 --2- 172.21.15.57:0/467899311 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f280015bd50 0x7f280015c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:50.232 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:50.223+0000 7f2804c8c700 1 -- 172.21.15.57:0/467899311 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28000c4d40 con 0x7f280014b5d0 2023-10-06T03:00:50.232 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:50.223+0000 7f280548d700 1 --2- 172.21.15.57:0/467899311 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f28000b2da0 0x7f28000b3210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:00:50.232 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:50.223+0000 7f2804c8c700 1 --2- 172.21.15.57:0/467899311 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f280014b5d0 0x7f28000b4dc0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f27f0004790 tx=0x7f27f4015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:50.232 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:50.223+0000 7f27fcff9700 1 -- 172.21.15.57:0/467899311 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f400cbc0 con 0x7f280014b5d0 2023-10-06T03:00:50.232 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:50.223+0000 7f27fcff9700 1 -- 172.21.15.57:0/467899311 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27f4004e70 con 0x7f280014b5d0 2023-10-06T03:00:50.233 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:50.223+0000 7f2805c8e700 1 -- 172.21.15.57:0/467899311 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28000c3ca0 con 0x7f280014b5d0 2023-10-06T03:00:50.233 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:50.223+0000 7f27fcff9700 1 -- 172.21.15.57:0/467899311 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f4007510 con 0x7f280014b5d0 2023-10-06T03:00:50.233 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:50.223+0000 7f2805c8e700 1 -- 172.21.15.57:0/467899311 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28000c4260 con 0x7f280014b5d0 2023-10-06T03:00:50.234 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:50.227+0000 7f2805c8e700 1 -- 172.21.15.57:0/467899311 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f280004be40 con 0x7f280014b5d0 2023-10-06T03:00:50.234 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:50.227+0000 7f27fcff9700 1 -- 172.21.15.57:0/467899311 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f27f4028460 con 0x7f280014b5d0 2023-10-06T03:00:50.235 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:50.227+0000 7f27fcff9700 1 --2- 172.21.15.57:0/467899311 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f27e4060550 0x7f27e4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:50.235 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:50.227+0000 7f27fcff9700 1 -- 172.21.15.57:0/467899311 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f27f407d880 con 0x7f280014b5d0 2023-10-06T03:00:50.235 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:50.227+0000 7f27fffff700 1 --2- 172.21.15.57:0/467899311 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f27e4060550 0x7f27e4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:50.235 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:50.231+0000 7f27fffff700 1 --2- 172.21.15.57:0/467899311 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f27e4060550 0x7f27e4062a00 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f27ec0014d0 tx=0x7f27ec007d30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:50.240 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:50.235+0000 7f27fcff9700 1 -- 172.21.15.57:0/467899311 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f27f40acbe0 con 0x7f280014b5d0 2023-10-06T03:00:50.408 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:50.403+0000 7f2805c8e700 1 -- 172.21.15.57:0/467899311 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f28000cd670 con 0x7f280014b5d0 2023-10-06T03:00:50.885 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:50.879+0000 7f27fcff9700 1 -- 172.21.15.57:0/467899311 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v17) v1 ==== 109+0+0 (secure 0 0 0) 0x7f27f404e280 con 0x7f280014b5d0 2023-10-06T03:00:50.890 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:50.883+0000 7f2805c8e700 1 -- 172.21.15.57:0/467899311 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f27e4060550 msgr2=0x7f27e4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:50.890 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:50.883+0000 7f2805c8e700 1 --2- 172.21.15.57:0/467899311 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f27e4060550 0x7f27e4062a00 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f27ec0014d0 tx=0x7f27ec007d30 comp rx=0 tx=0).stop 2023-10-06T03:00:50.890 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:50.883+0000 7f2805c8e700 1 -- 172.21.15.57:0/467899311 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f280014b5d0 msgr2=0x7f28000b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:50.890 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:50.883+0000 7f2805c8e700 1 --2- 172.21.15.57:0/467899311 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f280014b5d0 0x7f28000b4dc0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f27f0004790 tx=0x7f27f4015000 comp rx=0 tx=0).stop 2023-10-06T03:00:50.890 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:50.883+0000 7f2805c8e700 1 -- 172.21.15.57:0/467899311 shutdown_connections 2023-10-06T03:00:50.890 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:50.883+0000 7f2805c8e700 1 --2- 172.21.15.57:0/467899311 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f27e4060550 0x7f27e4062a00 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:50.890 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:50.883+0000 7f2805c8e700 1 --2- 172.21.15.57:0/467899311 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f28000b2da0 0x7f28000b3210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:50.890 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:50.883+0000 7f2805c8e700 1 --2- 172.21.15.57:0/467899311 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f280015bd50 0x7f280015c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:50.890 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:50.883+0000 7f2805c8e700 1 --2- 172.21.15.57:0/467899311 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f280014b5d0 0x7f28000b4dc0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:50.890 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:50.883+0000 7f2805c8e700 1 -- 172.21.15.57:0/467899311 >> 172.21.15.57:0/467899311 conn(0x7f28000d0a50 msgr2=0x7f28000ce1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:50.891 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:50.883+0000 7f2805c8e700 1 -- 172.21.15.57:0/467899311 shutdown_connections 2023-10-06T03:00:50.891 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:50.883+0000 7f2805c8e700 1 -- 172.21.15.57:0/467899311 wait complete. 2023-10-06T03:00:50.893 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'rbd' created 2023-10-06T03:00:50.913 DEBUG:teuthology.orchestra.run.smithi057:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-10-06T03:00:51.074 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:51.067+0000 7f2add545700 1 Processor -- start 2023-10-06T03:00:51.074 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:51.067+0000 7f2add545700 1 -- start start 2023-10-06T03:00:51.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:51.071+0000 7f2add545700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2ad8142800 0x7f2ad80cc930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:51.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:51.071+0000 7f2add545700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2ad80ceb60 0x7f2ad80cce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:51.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:51.071+0000 7f2add545700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ad806b170 con 0x7f2ad8142bd0 2023-10-06T03:00:51.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:51.071+0000 7f2add545700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ad806b600 con 0x7f2ad80ceb60 2023-10-06T03:00:51.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:51.071+0000 7f2add545700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad806a880 con 0x7f2ad8142800 2023-10-06T03:00:51.079 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:51.071+0000 7f2ad67fc700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f2ad8142bd0 0x7f2ad80ce450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:36240/0 (socket says 172.21.15.57:36240) 2023-10-06T03:00:51.079 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:51.071+0000 7f2ad67fc700 1 -- 172.21.15.57:0/3828857445 learned_addr learned my addr 172.21.15.57:0/3828857445 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:00:51.079 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:51.071+0000 7f2ad77fe700 1 --2- 172.21.15.57:0/3828857445 >> v2:172.21.15.57:3300/0 conn(0x7f2ad80ceb60 0x7f2ad80cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:51.080 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:51.071+0000 7f2ad6ffd700 1 --2- 172.21.15.57:0/3828857445 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2ad8142800 0x7f2ad80cc930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:51.080 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:51.075+0000 7f2ad5ffb700 1 -- 172.21.15.57:0/3828857445 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3585969670 0 0) 0x7f2ad806b170 con 0x7f2ad8142bd0 2023-10-06T03:00:51.081 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:51.075+0000 7f2ad5ffb700 1 -- 172.21.15.57:0/3828857445 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ac0003570 con 0x7f2ad8142bd0 2023-10-06T03:00:51.081 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:51.075+0000 7f2ad77fe700 1 -- 172.21.15.57:0/3828857445 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2ad8142800 msgr2=0x7f2ad80cc930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:51.081 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:51.075+0000 7f2ad77fe700 1 --2- 172.21.15.57:0/3828857445 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2ad8142800 0x7f2ad80cc930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:51.081 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:51.075+0000 7f2ad77fe700 1 -- 172.21.15.57:0/3828857445 >> v1:172.21.15.57:6789/0 conn(0x7f2ad8142bd0 legacy=0x7f2ad80ce450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:51.081 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:51.075+0000 7f2ad5ffb700 1 -- 172.21.15.57:0/3828857445 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2595671869 0 0) 0x7f2ac0003570 con 0x7f2ad8142bd0 2023-10-06T03:00:51.082 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:51.075+0000 7f2ad77fe700 1 -- 172.21.15.57:0/3828857445 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ad80cf180 con 0x7f2ad80ceb60 2023-10-06T03:00:51.082 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:51.075+0000 7f2ad77fe700 1 --2- 172.21.15.57:0/3828857445 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2ad80ceb60 0x7f2ad80cce70 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2ad0009e60 tx=0x7f2ad0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=504cab7ff1ed6bf7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:51.082 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:51.075+0000 7f2ad5ffb700 1 -- 172.21.15.57:0/3828857445 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad000e070 con 0x7f2ad80ceb60 2023-10-06T03:00:51.082 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:51.075+0000 7f2ad5ffb700 1 -- 172.21.15.57:0/3828857445 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ad000b7a0 con 0x7f2ad80ceb60 2023-10-06T03:00:51.082 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:51.075+0000 7f2ad5ffb700 1 -- 172.21.15.57:0/3828857445 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2acc0015f0 con 0x7f2ad80ceb60 2023-10-06T03:00:51.083 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:51.075+0000 7f2add545700 1 -- 172.21.15.57:0/3828857445 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2ad80ceb60 msgr2=0x7f2ad80cce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:51.083 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:51.075+0000 7f2add545700 1 --2- 172.21.15.57:0/3828857445 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2ad80ceb60 0x7f2ad80cce70 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2ad0009e60 tx=0x7f2ad0009780 comp rx=0 tx=0).stop 2023-10-06T03:00:51.083 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:51.075+0000 7f2add545700 1 -- 172.21.15.57:0/3828857445 shutdown_connections 2023-10-06T03:00:51.083 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:51.075+0000 7f2add545700 1 --2- 172.21.15.57:0/3828857445 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2ad80ceb60 0x7f2ad80cce70 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:51.083 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:51.075+0000 7f2add545700 1 --2- 172.21.15.57:0/3828857445 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2ad8142800 0x7f2ad80cc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:51.084 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:51.075+0000 7f2add545700 1 -- 172.21.15.57:0/3828857445 >> 172.21.15.57:0/3828857445 conn(0x7f2ad8067050 msgr2=0x7f2ad8067450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:51.084 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:51.075+0000 7f2add545700 1 -- 172.21.15.57:0/3828857445 shutdown_connections 2023-10-06T03:00:51.084 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:51.079+0000 7f2add545700 1 -- 172.21.15.57:0/3828857445 wait complete. 2023-10-06T03:00:51.086 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:51.079+0000 7f2add545700 1 Processor -- start 2023-10-06T03:00:51.086 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:51.079+0000 7f2add545700 1 -- start start 2023-10-06T03:00:51.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:51.083+0000 7f2add545700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2ad80ceb60 0x7f2ad815e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:51.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:51.083+0000 7f2add545700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2ad8142800 0x7f2ad80c89b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:51.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:51.083+0000 7f2add545700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2ad8142bd0 0x7f2ad8158450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:51.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:51.083+0000 7f2add545700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad80c91c0 con 0x7f2ad80ceb60 2023-10-06T03:00:51.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:51.083+0000 7f2add545700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad815a050 con 0x7f2ad8142800 2023-10-06T03:00:51.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:51.083+0000 7f2add545700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad80c8ef0 con 0x7f2ad8142bd0 2023-10-06T03:00:51.089 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:51.083+0000 7f2ad6ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2ad80ceb60 0x7f2ad815e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:51.089 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:51.083+0000 7f2ad6ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2ad80ceb60 0x7f2ad815e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:57940/0 (socket says 172.21.15.57:57940) 2023-10-06T03:00:51.089 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:51.083+0000 7f2ad6ffd700 1 -- 172.21.15.57:0/1840105874 learned_addr learned my addr 172.21.15.57:0/1840105874 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:00:51.090 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:51.083+0000 7f2ad67fc700 1 --2- 172.21.15.57:0/1840105874 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2ad8142800 0x7f2ad80c89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:51.090 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:51.083+0000 7f2ad77fe700 1 --2- 172.21.15.57:0/1840105874 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2ad8142bd0 0x7f2ad8158450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:51.090 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:51.083+0000 7f2ad6ffd700 1 -- 172.21.15.57:0/1840105874 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2ad8142bd0 msgr2=0x7f2ad8158450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:51.090 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:51.083+0000 7f2ad6ffd700 1 --2- 172.21.15.57:0/1840105874 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2ad8142bd0 0x7f2ad8158450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:51.090 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:51.083+0000 7f2ad6ffd700 1 -- 172.21.15.57:0/1840105874 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2ad8142800 msgr2=0x7f2ad80c89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:51.090 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:51.083+0000 7f2ad6ffd700 1 --2- 172.21.15.57:0/1840105874 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2ad8142800 0x7f2ad80c89b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:51.090 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:51.083+0000 7f2ad6ffd700 1 -- 172.21.15.57:0/1840105874 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ad0009a20 con 0x7f2ad80ceb60 2023-10-06T03:00:51.091 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:51.083+0000 7f2ad6ffd700 1 --2- 172.21.15.57:0/1840105874 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2ad80ceb60 0x7f2ad815e090 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2ac800ec80 tx=0x7f2ac80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:51.091 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:51.083+0000 7f2abeffd700 1 -- 172.21.15.57:0/1840105874 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac800c850 con 0x7f2ad80ceb60 2023-10-06T03:00:51.091 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:51.083+0000 7f2abeffd700 1 -- 172.21.15.57:0/1840105874 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ac800c9b0 con 0x7f2ad80ceb60 2023-10-06T03:00:51.091 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:51.083+0000 7f2add545700 1 -- 172.21.15.57:0/1840105874 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ad8159720 con 0x7f2ad80ceb60 2023-10-06T03:00:51.091 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:51.083+0000 7f2abeffd700 1 -- 172.21.15.57:0/1840105874 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac800cd50 con 0x7f2ad80ceb60 2023-10-06T03:00:51.092 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:51.083+0000 7f2add545700 1 -- 172.21.15.57:0/1840105874 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ad8159ce0 con 0x7f2ad80ceb60 2023-10-06T03:00:51.092 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:51.087+0000 7f2add545700 1 -- 172.21.15.57:0/1840105874 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ad804be40 con 0x7f2ad80ceb60 2023-10-06T03:00:51.094 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:51.087+0000 7f2abeffd700 1 -- 172.21.15.57:0/1840105874 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f2ac8013680 con 0x7f2ad80ceb60 2023-10-06T03:00:51.095 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:51.091+0000 7f2abeffd700 1 --2- 172.21.15.57:0/1840105874 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f2ac4060550 0x7f2ac4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:51.096 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:51.091+0000 7f2abeffd700 1 -- 172.21.15.57:0/1840105874 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5195+0+0 (secure 0 0 0) 0x7f2ac807c8d0 con 0x7f2ad80ceb60 2023-10-06T03:00:51.096 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:51.091+0000 7f2ad67fc700 1 --2- 172.21.15.57:0/1840105874 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f2ac4060550 0x7f2ac4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:51.097 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:51.091+0000 7f2ad67fc700 1 --2- 172.21.15.57:0/1840105874 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f2ac4060550 0x7f2ac4062a00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2ad80c64f0 tx=0x7f2acc002ea0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:51.103 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:51.099+0000 7f2abeffd700 1 -- 172.21.15.57:0/1840105874 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f2ac804d020 con 0x7f2ad80ceb60 2023-10-06T03:00:51.276 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:51.271+0000 7f2add545700 1 -- 172.21.15.57:0/1840105874 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f2ad806ab20 con 0x7f2ad80ceb60 2023-10-06T03:00:51.896 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:51.891+0000 7f2abeffd700 1 -- 172.21.15.57:0/1840105874 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v18) v1 ==== 173+0+0 (secure 0 0 0) 0x7f2ac8050640 con 0x7f2ad80ceb60 2023-10-06T03:00:51.902 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:51.895+0000 7f2add545700 1 -- 172.21.15.57:0/1840105874 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f2ac4060550 msgr2=0x7f2ac4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:51.902 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:51.895+0000 7f2add545700 1 --2- 172.21.15.57:0/1840105874 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f2ac4060550 0x7f2ac4062a00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2ad80c64f0 tx=0x7f2acc002ea0 comp rx=0 tx=0).stop 2023-10-06T03:00:51.903 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:51.895+0000 7f2add545700 1 -- 172.21.15.57:0/1840105874 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2ad80ceb60 msgr2=0x7f2ad815e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:51.903 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:51.895+0000 7f2add545700 1 --2- 172.21.15.57:0/1840105874 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2ad80ceb60 0x7f2ad815e090 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2ac800ec80 tx=0x7f2ac80091a0 comp rx=0 tx=0).stop 2023-10-06T03:00:51.903 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:51.899+0000 7f2add545700 1 -- 172.21.15.57:0/1840105874 shutdown_connections 2023-10-06T03:00:51.903 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:51.899+0000 7f2add545700 1 --2- 172.21.15.57:0/1840105874 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f2ac4060550 0x7f2ac4062a00 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:51.903 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:51.899+0000 7f2add545700 1 --2- 172.21.15.57:0/1840105874 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2ad8142bd0 0x7f2ad8158450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:51.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:51.899+0000 7f2add545700 1 --2- 172.21.15.57:0/1840105874 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2ad8142800 0x7f2ad80c89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:51.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:51.899+0000 7f2add545700 1 --2- 172.21.15.57:0/1840105874 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2ad80ceb60 0x7f2ad815e090 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:51.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:51.899+0000 7f2add545700 1 -- 172.21.15.57:0/1840105874 >> 172.21.15.57:0/1840105874 conn(0x7f2ad8067050 msgr2=0x7f2ad8141870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:51.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:51.899+0000 7f2add545700 1 -- 172.21.15.57:0/1840105874 shutdown_connections 2023-10-06T03:00:51.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:51.899+0000 7f2add545700 1 -- 172.21.15.57:0/1840105874 wait complete. 2023-10-06T03:00:51.907 INFO:teuthology.orchestra.run.smithi057.stderr:enabled application 'rbd' on pool 'rbd' 2023-10-06T03:00:51.923 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-10-06T03:00:51.924 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-06T03:00:51.924 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-06T03:00:51.928 INFO:tasks.ceph.mds.a:Started 2023-10-06T03:00:51.928 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-06T03:00:51.928 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-06T03:00:51.932 INFO:tasks.ceph.mds.c:Started 2023-10-06T03:00:51.932 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-06T03:00:51.932 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-06T03:00:51.936 INFO:tasks.ceph.mds.b:Started 2023-10-06T03:00:51.936 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-06T03:00:51.936 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-06T03:00:51.940 INFO:tasks.ceph.mds.d:Started 2023-10-06T03:00:51.940 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-10-06T03:00:51.941 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:00:52.034 INFO:tasks.ceph.mds.c.smithi057.stdout:starting mds.c at 2023-10-06T03:00:52.034 INFO:tasks.ceph.mds.a.smithi057.stdout:starting mds.a at 2023-10-06T03:00:52.041 INFO:tasks.ceph.mds.d.smithi105.stdout:starting mds.d at 2023-10-06T03:00:52.044 INFO:tasks.ceph.mds.b.smithi105.stdout:starting mds.b at 2023-10-06T03:00:52.103 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.099+0000 7f500fd45700 1 Processor -- start 2023-10-06T03:00:52.103 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.099+0000 7f500fd45700 1 -- start start 2023-10-06T03:00:52.106 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.099+0000 7f500fd45700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f500806deb0 0x7f50080675c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:52.106 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.099+0000 7f500fd45700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f500815cee0 0x7f500815d340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:52.106 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.099+0000 7f500fd45700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f500806da20 con 0x7f50080671f0 2023-10-06T03:00:52.106 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.099+0000 7f500fd45700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50080b0650 con 0x7f500815cee0 2023-10-06T03:00:52.106 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.099+0000 7f500fd45700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f500806ce10 con 0x7f500806deb0 2023-10-06T03:00:52.107 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.099+0000 7f500dae1700 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f50080671f0 0x7f50080aff40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.57:35526/0 (socket says 172.21.15.57:35526) 2023-10-06T03:00:52.107 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.099+0000 7f500dae1700 1 -- 172.21.15.57:0/2103438692 learned_addr learned my addr 172.21.15.57:0/2103438692 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:00:52.108 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.099+0000 7f500e2e2700 1 --2- 172.21.15.57:0/2103438692 >> v2:172.21.15.57:3300/0 conn(0x7f500815cee0 0x7f500815d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:52.108 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.099+0000 7f500d2e0700 1 --2- 172.21.15.57:0/2103438692 >> v2:172.21.15.105:3300/0 conn(0x7f500806deb0 0x7f50080675c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:52.108 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.103+0000 7f500cadf700 1 -- 172.21.15.57:0/2103438692 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4002520917 0 0) 0x7f500806da20 con 0x7f50080671f0 2023-10-06T03:00:52.108 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.103+0000 7f500cadf700 1 -- 172.21.15.57:0/2103438692 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ff4003570 con 0x7f50080671f0 2023-10-06T03:00:52.108 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.103+0000 7f500e2e2700 1 -- 172.21.15.57:0/2103438692 >> v2:172.21.15.105:3300/0 conn(0x7f500806deb0 msgr2=0x7f50080675c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:52.108 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.103+0000 7f500e2e2700 1 --2- 172.21.15.57:0/2103438692 >> v2:172.21.15.105:3300/0 conn(0x7f500806deb0 0x7f50080675c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:52.108 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.103+0000 7f500e2e2700 1 -- 172.21.15.57:0/2103438692 >> v1:172.21.15.105:6789/0 conn(0x7f50080671f0 legacy=0x7f50080aff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:52.108 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.103+0000 7f500e2e2700 1 -- 172.21.15.57:0/2103438692 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f500806d0f0 con 0x7f500815cee0 2023-10-06T03:00:52.109 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.103+0000 7f500e2e2700 1 --2- 172.21.15.57:0/2103438692 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f500815cee0 0x7f500815d340 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f500806e330 tx=0x7f5000009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db93ff7e348907ca server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:52.109 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.103+0000 7f500cadf700 1 -- 172.21.15.57:0/2103438692 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f500000e070 con 0x7f500815cee0 2023-10-06T03:00:52.109 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.103+0000 7f500cadf700 1 -- 172.21.15.57:0/2103438692 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f500000bab0 con 0x7f500815cee0 2023-10-06T03:00:52.109 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.103+0000 7f500cadf700 1 -- 172.21.15.57:0/2103438692 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f500000be70 con 0x7f500815cee0 2023-10-06T03:00:52.109 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.103+0000 7f500fd45700 1 -- 172.21.15.57:0/2103438692 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f500815cee0 msgr2=0x7f500815d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:52.110 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.103+0000 7f500fd45700 1 --2- 172.21.15.57:0/2103438692 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f500815cee0 0x7f500815d340 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f500806e330 tx=0x7f5000009780 comp rx=0 tx=0).stop 2023-10-06T03:00:52.110 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.103+0000 7f500fd45700 1 -- 172.21.15.57:0/2103438692 shutdown_connections 2023-10-06T03:00:52.110 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.103+0000 7f500fd45700 1 --2- 172.21.15.57:0/2103438692 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f500815cee0 0x7f500815d340 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:52.111 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.103+0000 7f500fd45700 1 --2- 172.21.15.57:0/2103438692 >> v2:172.21.15.105:3300/0 conn(0x7f500806deb0 0x7f50080675c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:52.111 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.103+0000 7f500fd45700 1 -- 172.21.15.57:0/2103438692 >> 172.21.15.57:0/2103438692 conn(0x7f50080cbdd0 msgr2=0x7f50080cc1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:52.111 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.103+0000 7f500fd45700 1 -- 172.21.15.57:0/2103438692 shutdown_connections 2023-10-06T03:00:52.111 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.103+0000 7f500fd45700 1 -- 172.21.15.57:0/2103438692 wait complete. 2023-10-06T03:00:52.112 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.107+0000 7f500fd45700 1 Processor -- start 2023-10-06T03:00:52.112 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.107+0000 7f500fd45700 1 -- start start 2023-10-06T03:00:52.115 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.107+0000 7f500fd45700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f50080671f0 0x7f50080aac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:52.115 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.107+0000 7f500fd45700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f500806deb0 0x7f50080ac820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:52.115 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.107+0000 7f500fd45700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f500815cee0 0x7f500815feb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:52.115 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.107+0000 7f500fd45700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50080ab150 con 0x7f500806deb0 2023-10-06T03:00:52.115 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.107+0000 7f500fd45700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f500815d990 con 0x7f500815cee0 2023-10-06T03:00:52.115 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.107+0000 7f500fd45700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50080ad8d0 con 0x7f50080671f0 2023-10-06T03:00:52.115 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.107+0000 7f500d2e0700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f500806deb0 0x7f50080ac820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:52.116 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.107+0000 7f500d2e0700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f500806deb0 0x7f50080ac820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:57994/0 (socket says 172.21.15.57:57994) 2023-10-06T03:00:52.116 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.107+0000 7f500d2e0700 1 -- 172.21.15.57:0/2163986531 learned_addr learned my addr 172.21.15.57:0/2163986531 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:00:52.116 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.111+0000 7f500e2e2700 1 --2- 172.21.15.57:0/2163986531 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f500815cee0 0x7f500815feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:52.116 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.111+0000 7f500dae1700 1 --2- 172.21.15.57:0/2163986531 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f50080671f0 0x7f50080aac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:52.117 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.111+0000 7f500d2e0700 1 -- 172.21.15.57:0/2163986531 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f50080671f0 msgr2=0x7f50080aac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:52.117 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.111+0000 7f500d2e0700 1 --2- 172.21.15.57:0/2163986531 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f50080671f0 0x7f50080aac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:52.117 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.111+0000 7f500d2e0700 1 -- 172.21.15.57:0/2163986531 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f500815cee0 msgr2=0x7f500815feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:52.118 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.111+0000 7f500d2e0700 1 --2- 172.21.15.57:0/2163986531 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f500815cee0 0x7f500815feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:52.118 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.111+0000 7f500d2e0700 1 -- 172.21.15.57:0/2163986531 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5000009a20 con 0x7f500806deb0 2023-10-06T03:00:52.118 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.111+0000 7f500e2e2700 1 --2- 172.21.15.57:0/2163986531 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f500815cee0 0x7f500815feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:00:52.118 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.111+0000 7f500d2e0700 1 --2- 172.21.15.57:0/2163986531 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f500806deb0 0x7f50080ac820 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4ff800ecb0 tx=0x7f4ff80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:52.118 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.111+0000 7f4ffdffb700 1 -- 172.21.15.57:0/2163986531 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff800c920 con 0x7f500806deb0 2023-10-06T03:00:52.118 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.111+0000 7f4ffdffb700 1 -- 172.21.15.57:0/2163986531 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ff800ca80 con 0x7f500806deb0 2023-10-06T03:00:52.119 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.111+0000 7f500fd45700 1 -- 172.21.15.57:0/2163986531 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50080ad310 con 0x7f500806deb0 2023-10-06T03:00:52.120 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.111+0000 7f4ffdffb700 1 -- 172.21.15.57:0/2163986531 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff800ce20 con 0x7f500806deb0 2023-10-06T03:00:52.120 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.111+0000 7f500fd45700 1 -- 172.21.15.57:0/2163986531 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f500815d620 con 0x7f500806deb0 2023-10-06T03:00:52.120 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.111+0000 7f500fd45700 1 -- 172.21.15.57:0/2163986531 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50080712e0 con 0x7f500806deb0 2023-10-06T03:00:52.121 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.115+0000 7f4ffdffb700 1 -- 172.21.15.57:0/2163986531 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f4ff8013680 con 0x7f500806deb0 2023-10-06T03:00:52.121 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.115+0000 7f4ffdffb700 1 --2- 172.21.15.57:0/2163986531 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f4fec060550 0x7f4fec062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:52.122 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.115+0000 7f4ffdffb700 1 -- 172.21.15.57:0/2163986531 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f4ff807ca10 con 0x7f500806deb0 2023-10-06T03:00:52.122 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.115+0000 7f500dae1700 1 --2- 172.21.15.57:0/2163986531 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f4fec060550 0x7f4fec062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:52.123 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.119+0000 7f500dae1700 1 --2- 172.21.15.57:0/2163986531 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f4fec060550 0x7f4fec062a00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5004007fd0 tx=0x7f5004009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:52.129 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.123+0000 7f4ffdffb700 1 -- 172.21.15.57:0/2163986531 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f4ff804d150 con 0x7f500806deb0 2023-10-06T03:00:52.302 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.295+0000 7f500fd45700 1 -- 172.21.15.57:0/2163986531 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f500815dad0 con 0x7f500806deb0 2023-10-06T03:00:52.303 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.299+0000 7f4ffdffb700 1 -- 172.21.15.57:0/2163986531 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+13660 (secure 0 0 0) 0x7f4ff8050770 con 0x7f500806deb0 2023-10-06T03:00:52.304 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:00:52.304 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":18,"fsid":"eb56dc0f-9213-41cb-9aad-8ade6c802e98","created":"2023-10-06T03:00:30.806197+0000","modified":"2023-10-06T03:00:51.881472+0000","last_up_change":"2023-10-06T03:00:43.607454+0000","last_in_change":"2023-10-06T03:00:33.943513+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T03:00:44.360651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T03:00:50.466601+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"58cf6c90-d704-43e0-b2db-dffe526d5e8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":33053},{"type":"v1","addr":"172.21.15.57:6801","nonce":33053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":33053},{"type":"v1","addr":"172.21.15.57:6803","nonce":33053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":33053},{"type":"v1","addr":"172.21.15.57:6807","nonce":33053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":33053},{"type":"v1","addr":"172.21.15.57:6805","nonce":33053}]},"public_addr":"172.21.15.57:6801/33053","cluster_addr":"172.21.15.57:6803/33053","heartbeat_back_addr":"172.21.15.57:6807/33053","heartbeat_front_addr":"172.21.15.57:6805/33053","state":["exists","up"]},{"osd":1,"uuid":"16afbe70-7f9e-4568-9c92-763e6e348119","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6809","nonce":33052},{"type":"v1","addr":"172.21.15.57:6810","nonce":33052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":33052},{"type":"v1","addr":"172.21.15.57:6813","nonce":33052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":33052},{"type":"v1","addr":"172.21.15.57:6822","nonce":33052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6815","nonce":33052},{"type":"v1","addr":"172.21.15.57:6818","nonce":33052}]},"public_addr":"172.21.15.57:6810/33052","cluster_addr":"172.21.15.57:6813/33052","heartbeat_back_addr":"172.21.15.57:6822/33052","heartbeat_front_addr":"172.21.15.57:6818/33052","state":["exists","up"]},{"osd":2,"uuid":"7255c62e-f92f-470f-a5ce-30228920d9f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":33058},{"type":"v1","addr":"172.21.15.57:6825","nonce":33058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":33058},{"type":"v1","addr":"172.21.15.57:6827","nonce":33058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":33058},{"type":"v1","addr":"172.21.15.57:6831","nonce":33058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":33058},{"type":"v1","addr":"172.21.15.57:6829","nonce":33058}]},"public_addr":"172.21.15.57:6825/33058","cluster_addr":"172.21.15.57:6827/33058","heartbeat_back_addr":"172.21.15.57:6831/33058","heartbeat_front_addr":"172.21.15.57:6829/33058","state":["exists","up"]},{"osd":3,"uuid":"152a236d-f799-4888-8544-74865508d5a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":33057},{"type":"v1","addr":"172.21.15.57:6811","nonce":33057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":33057},{"type":"v1","addr":"172.21.15.57:6816","nonce":33057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6821","nonce":33057},{"type":"v1","addr":"172.21.15.57:6823","nonce":33057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6817","nonce":33057},{"type":"v1","addr":"172.21.15.57:6819","nonce":33057}]},"public_addr":"172.21.15.57:6811/33057","cluster_addr":"172.21.15.57:6816/33057","heartbeat_back_addr":"172.21.15.57:6823/33057","heartbeat_front_addr":"172.21.15.57:6819/33057","state":["exists","up"]},{"osd":4,"uuid":"37db2a65-3566-41d0-9d60-e66c49e1e68e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":33368},{"type":"v1","addr":"172.21.15.105:6801","nonce":33368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":33368},{"type":"v1","addr":"172.21.15.105:6803","nonce":33368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":33368},{"type":"v1","addr":"172.21.15.105:6807","nonce":33368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":33368},{"type":"v1","addr":"172.21.15.105:6805","nonce":33368}]},"public_addr":"172.21.15.105:6801/33368","cluster_addr":"172.21.15.105:6803/33368","heartbeat_back_addr":"172.21.15.105:6807/33368","heartbeat_front_addr":"172.21.15.105:6805/33368","state":["exists","up"]},{"osd":5,"uuid":"35e77918-1bb4-42ca-9b20-f3c14eaa0c04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":33379},{"type":"v1","addr":"172.21.15.105:6818","nonce":33379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":33379},{"type":"v1","addr":"172.21.15.105:6823","nonce":33379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":33379},{"type":"v1","addr":"172.21.15.105:6831","nonce":33379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":33379},{"type":"v1","addr":"172.21.15.105:6827","nonce":33379}]},"public_addr":"172.21.15.105:6818/33379","cluster_addr":"172.21.15.105:6823/33379","heartbeat_back_addr":"172.21.15.105:6831/33379","heartbeat_front_addr":"172.21.15.105:6827/33379","state":["exists","up"]},{"osd":6,"uuid":"b4d9d510-7a45-4173-8287-c6c8d6547f2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":33369},{"type":"v1","addr":"172.21.15.105:6819","nonce":33369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":33369},{"type":"v1","addr":"172.21.15.105:6822","nonce":33369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":33369},{"type":"v1","addr":"172.21.15.105:6830","nonce":33369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":33369},{"type":"v1","addr":"172.21.15.105:6826","nonce":33369}]},"public_addr":"172.21.15.105:6819/33369","cluster_addr":"172.21.15.105:6822/33369","heartbeat_back_addr":"172.21.15.105:6830/33369","heartbeat_front_addr":"172.21.15.105:6826/33369","state":["exists","up"]},{"osd":7,"uuid":"74266fb0-cd84-463f-8bf0-092652a71dc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":33370},{"type":"v1","addr":"172.21.15.105:6809","nonce":33370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":33370},{"type":"v1","addr":"172.21.15.105:6811","nonce":33370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":33370},{"type":"v1","addr":"172.21.15.105:6815","nonce":33370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":33370},{"type":"v1","addr":"172.21.15.105:6813","nonce":33370}]},"public_addr":"172.21.15.105:6809/33370","cluster_addr":"172.21.15.105:6811/33370","heartbeat_back_addr":"172.21.15.105:6815/33370","heartbeat_front_addr":"172.21.15.105:6813/33370","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.596864+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.633851+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.636993+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.529681+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.608601+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.659752+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.661717+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.642221+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:00:52.306 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.299+0000 7f500fd45700 1 -- 172.21.15.57:0/2163986531 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f4fec060550 msgr2=0x7f4fec062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:52.306 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.299+0000 7f500fd45700 1 --2- 172.21.15.57:0/2163986531 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f4fec060550 0x7f4fec062a00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5004007fd0 tx=0x7f5004009040 comp rx=0 tx=0).stop 2023-10-06T03:00:52.306 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.299+0000 7f500fd45700 1 -- 172.21.15.57:0/2163986531 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f500806deb0 msgr2=0x7f50080ac820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:52.306 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.299+0000 7f500fd45700 1 --2- 172.21.15.57:0/2163986531 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f500806deb0 0x7f50080ac820 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4ff800ecb0 tx=0x7f4ff80091a0 comp rx=0 tx=0).stop 2023-10-06T03:00:52.307 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.299+0000 7f500fd45700 1 -- 172.21.15.57:0/2163986531 shutdown_connections 2023-10-06T03:00:52.307 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.299+0000 7f500fd45700 1 --2- 172.21.15.57:0/2163986531 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f500815cee0 0x7f500815feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:52.307 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.299+0000 7f500fd45700 1 --2- 172.21.15.57:0/2163986531 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f500806deb0 0x7f50080ac820 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:52.307 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.299+0000 7f500fd45700 1 --2- 172.21.15.57:0/2163986531 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f4fec060550 0x7f4fec062a00 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:52.307 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.299+0000 7f500fd45700 1 --2- 172.21.15.57:0/2163986531 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f50080671f0 0x7f50080aac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:52.307 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.299+0000 7f500fd45700 1 -- 172.21.15.57:0/2163986531 >> 172.21.15.57:0/2163986531 conn(0x7f50080cbdd0 msgr2=0x7f50080aeec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:52.307 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.299+0000 7f500fd45700 1 -- 172.21.15.57:0/2163986531 shutdown_connections 2023-10-06T03:00:52.308 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.303+0000 7f500fd45700 1 -- 172.21.15.57:0/2163986531 wait complete. 2023-10-06T03:00:52.325 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T03:00:44.360651+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T03:00:50.466601+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-10-06T03:00:52.325 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T03:00:52.492 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.487+0000 7fe6bc985700 1 Processor -- start 2023-10-06T03:00:52.492 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.487+0000 7fe6bc985700 1 -- start start 2023-10-06T03:00:52.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.487+0000 7fe6bc985700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe6b815cd50 0x7fe6b815d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:52.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.487+0000 7fe6bc985700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe6b814fd10 0x7fe6b8150180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:52.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.487+0000 7fe6bc985700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6b81506c0 con 0x7fe6b8159750 2023-10-06T03:00:52.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.487+0000 7fe6bc985700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6b806e300 con 0x7fe6b814fd10 2023-10-06T03:00:52.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.487+0000 7fe6bc985700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6b815d660 con 0x7fe6b815cd50 2023-10-06T03:00:52.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.487+0000 7fe6affff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe6b814fd10 0x7fe6b8150180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:52.495 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.487+0000 7fe6affff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe6b814fd10 0x7fe6b8150180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58002/0 (socket says 172.21.15.57:58002) 2023-10-06T03:00:52.495 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.487+0000 7fe6affff700 1 -- 172.21.15.57:0/3816059390 learned_addr learned my addr 172.21.15.57:0/3816059390 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:00:52.496 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.487+0000 7fe6b659c700 1 --2- 172.21.15.57:0/3816059390 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe6b815cd50 0x7fe6b815d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:52.496 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.491+0000 7fe6affff700 1 -- 172.21.15.57:0/3816059390 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe6b815cd50 msgr2=0x7fe6b815d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:52.496 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.491+0000 7fe6affff700 1 --2- 172.21.15.57:0/3816059390 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe6b815cd50 0x7fe6b815d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:52.496 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.491+0000 7fe6affff700 1 -- 172.21.15.57:0/3816059390 >> v1:172.21.15.105:6789/0 conn(0x7fe6b8159750 legacy=0x7fe6b8159bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:52.496 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.491+0000 7fe6affff700 1 -- 172.21.15.57:0/3816059390 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6b806afb0 con 0x7fe6b814fd10 2023-10-06T03:00:52.496 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.491+0000 7fe6affff700 1 --2- 172.21.15.57:0/3816059390 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe6b814fd10 0x7fe6b8150180 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe6a00099b0 tx=0x7fe6a0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37189c3f851264ab server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:52.497 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.491+0000 7fe6b5d9b700 1 -- 172.21.15.57:0/3816059390 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6a000b860 con 0x7fe6b814fd10 2023-10-06T03:00:52.497 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.491+0000 7fe6b5d9b700 1 -- 172.21.15.57:0/3816059390 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6a000b9c0 con 0x7fe6b814fd10 2023-10-06T03:00:52.497 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.491+0000 7fe6b5d9b700 1 -- 172.21.15.57:0/3816059390 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6a000bd60 con 0x7fe6b814fd10 2023-10-06T03:00:52.498 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.491+0000 7fe6bc985700 1 -- 172.21.15.57:0/3816059390 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe6b814fd10 msgr2=0x7fe6b8150180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:52.498 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.491+0000 7fe6bc985700 1 --2- 172.21.15.57:0/3816059390 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe6b814fd10 0x7fe6b8150180 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe6a00099b0 tx=0x7fe6a0009250 comp rx=0 tx=0).stop 2023-10-06T03:00:52.498 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.491+0000 7fe6bc985700 1 -- 172.21.15.57:0/3816059390 shutdown_connections 2023-10-06T03:00:52.499 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.491+0000 7fe6bc985700 1 --2- 172.21.15.57:0/3816059390 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe6b814fd10 0x7fe6b8150180 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:52.499 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.491+0000 7fe6bc985700 1 --2- 172.21.15.57:0/3816059390 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe6b815cd50 0x7fe6b815d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:52.499 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.491+0000 7fe6bc985700 1 -- 172.21.15.57:0/3816059390 >> 172.21.15.57:0/3816059390 conn(0x7fe6b80ccbc0 msgr2=0x7fe6b80ccfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:52.499 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.491+0000 7fe6bc985700 1 -- 172.21.15.57:0/3816059390 shutdown_connections 2023-10-06T03:00:52.499 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.491+0000 7fe6bc985700 1 -- 172.21.15.57:0/3816059390 wait complete. 2023-10-06T03:00:52.500 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.495+0000 7fe6bc985700 1 Processor -- start 2023-10-06T03:00:52.500 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.495+0000 7fe6bc985700 1 -- start start 2023-10-06T03:00:52.503 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.495+0000 7fe6bc985700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe6b814fd10 0x7fe6b814ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:52.503 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.495+0000 7fe6bc985700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe6b8159750 0x7fe6b8150850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:52.503 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.495+0000 7fe6bc985700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe6b815cd50 0x7fe6b80cec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:52.503 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.495+0000 7fe6bc985700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6b8154010 con 0x7fe6b814fd10 2023-10-06T03:00:52.503 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.495+0000 7fe6bc985700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6b80b0a70 con 0x7fe6b8159750 2023-10-06T03:00:52.503 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.495+0000 7fe6bc985700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6b816a1e0 con 0x7fe6b815cd50 2023-10-06T03:00:52.503 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.499+0000 7fe6b659c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe6b814fd10 0x7fe6b814ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:52.504 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.499+0000 7fe6b659c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe6b814fd10 0x7fe6b814ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58004/0 (socket says 172.21.15.57:58004) 2023-10-06T03:00:52.504 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.499+0000 7fe6b659c700 1 -- 172.21.15.57:0/1889782842 learned_addr learned my addr 172.21.15.57:0/1889782842 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:00:52.504 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.499+0000 7fe6affff700 1 --2- 172.21.15.57:0/1889782842 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe6b8159750 0x7fe6b8150850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:52.505 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.499+0000 7fe6b6d9d700 1 --2- 172.21.15.57:0/1889782842 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe6b815cd50 0x7fe6b80cec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:52.505 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.499+0000 7fe6b659c700 1 -- 172.21.15.57:0/1889782842 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe6b815cd50 msgr2=0x7fe6b80cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:52.505 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.499+0000 7fe6b659c700 1 --2- 172.21.15.57:0/1889782842 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe6b815cd50 0x7fe6b80cec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:52.505 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.499+0000 7fe6b659c700 1 -- 172.21.15.57:0/1889782842 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe6b8159750 msgr2=0x7fe6b8150850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:52.505 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.499+0000 7fe6b659c700 1 --2- 172.21.15.57:0/1889782842 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe6b8159750 0x7fe6b8150850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:52.505 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.499+0000 7fe6b659c700 1 -- 172.21.15.57:0/1889782842 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6a00094f0 con 0x7fe6b814fd10 2023-10-06T03:00:52.506 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.499+0000 7fe6b6d9d700 1 --2- 172.21.15.57:0/1889782842 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe6b815cd50 0x7fe6b80cec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:00:52.506 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.499+0000 7fe6b659c700 1 --2- 172.21.15.57:0/1889782842 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe6b814fd10 0x7fe6b814ce80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe6a800d890 tx=0x7fe6a8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:52.506 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.499+0000 7fe6ae7fc700 1 -- 172.21.15.57:0/1889782842 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6a80125f0 con 0x7fe6b814fd10 2023-10-06T03:00:52.506 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.499+0000 7fe6ae7fc700 1 -- 172.21.15.57:0/1889782842 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6a8012750 con 0x7fe6b814fd10 2023-10-06T03:00:52.506 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.499+0000 7fe6ae7fc700 1 -- 172.21.15.57:0/1889782842 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6a8012ad0 con 0x7fe6b814fd10 2023-10-06T03:00:52.506 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.499+0000 7fe6bc985700 1 -- 172.21.15.57:0/1889782842 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6b80b0420 con 0x7fe6b814fd10 2023-10-06T03:00:52.506 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.499+0000 7fe6bc985700 1 -- 172.21.15.57:0/1889782842 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6b814d3c0 con 0x7fe6b814fd10 2023-10-06T03:00:52.506 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.503+0000 7fe6bc985700 1 -- 172.21.15.57:0/1889782842 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6b80b0280 con 0x7fe6b814fd10 2023-10-06T03:00:52.508 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.503+0000 7fe6ae7fc700 1 -- 172.21.15.57:0/1889782842 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fe6a801e460 con 0x7fe6b814fd10 2023-10-06T03:00:52.510 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.507+0000 7fe6ae7fc700 1 --2- 172.21.15.57:0/1889782842 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fe698060550 0x7fe698062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:52.511 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.507+0000 7fe6ae7fc700 1 -- 172.21.15.57:0/1889782842 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fe6a807cd20 con 0x7fe6b814fd10 2023-10-06T03:00:52.511 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.507+0000 7fe6affff700 1 --2- 172.21.15.57:0/1889782842 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fe698060550 0x7fe698062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:52.512 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.507+0000 7fe6affff700 1 --2- 172.21.15.57:0/1889782842 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fe698060550 0x7fe698062a00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe6a00099b0 tx=0x7fe6a0017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:52.517 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.511+0000 7fe6ae7fc700 1 -- 172.21.15.57:0/1889782842 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fe6b80b0280 con 0x7fe6b814fd10 2023-10-06T03:00:52.689 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.683+0000 7fe6bc985700 1 -- 172.21.15.57:0/1889782842 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe6b80b0280 con 0x7fe6b814fd10 2023-10-06T03:00:52.690 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.683+0000 7fe6ae7fc700 1 -- 172.21.15.57:0/1889782842 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe6b80b0280 con 0x7fe6b814fd10 2023-10-06T03:00:52.691 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2023-10-06T03:00:52.693 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.687+0000 7fe6bc985700 1 -- 172.21.15.57:0/1889782842 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fe698060550 msgr2=0x7fe698062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:52.694 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.687+0000 7fe6bc985700 1 --2- 172.21.15.57:0/1889782842 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fe698060550 0x7fe698062a00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe6a00099b0 tx=0x7fe6a0017000 comp rx=0 tx=0).stop 2023-10-06T03:00:52.694 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.687+0000 7fe6bc985700 1 -- 172.21.15.57:0/1889782842 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe6b814fd10 msgr2=0x7fe6b814ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:52.694 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.687+0000 7fe6bc985700 1 --2- 172.21.15.57:0/1889782842 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe6b814fd10 0x7fe6b814ce80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe6a800d890 tx=0x7fe6a8008040 comp rx=0 tx=0).stop 2023-10-06T03:00:52.694 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.687+0000 7fe6bc985700 1 -- 172.21.15.57:0/1889782842 shutdown_connections 2023-10-06T03:00:52.694 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.687+0000 7fe6bc985700 1 --2- 172.21.15.57:0/1889782842 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fe698060550 0x7fe698062a00 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:52.694 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.687+0000 7fe6bc985700 1 --2- 172.21.15.57:0/1889782842 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe6b815cd50 0x7fe6b80cec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:52.695 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.687+0000 7fe6bc985700 1 --2- 172.21.15.57:0/1889782842 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe6b8159750 0x7fe6b8150850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:52.695 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.687+0000 7fe6bc985700 1 --2- 172.21.15.57:0/1889782842 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe6b814fd10 0x7fe6b814ce80 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:52.695 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.687+0000 7fe6bc985700 1 -- 172.21.15.57:0/1889782842 >> 172.21.15.57:0/1889782842 conn(0x7fe6b80ccbc0 msgr2=0x7fe6b806bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:52.695 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.687+0000 7fe6bc985700 1 -- 172.21.15.57:0/1889782842 shutdown_connections 2023-10-06T03:00:52.695 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.687+0000 7fe6bc985700 1 -- 172.21.15.57:0/1889782842 wait complete. 2023-10-06T03:00:52.714 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T03:00:52.880 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.875+0000 7f24e1123700 1 Processor -- start 2023-10-06T03:00:52.880 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.875+0000 7f24e1123700 1 -- start start 2023-10-06T03:00:52.881 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.875+0000 7f24e1123700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f24dc0cb140 0x7f24dc0cb510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:52.882 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.875+0000 7f24e1123700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f24dc0b0080 0x7f24dc0b04d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:52.882 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.875+0000 7f24e1123700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f24dc06d930 0x7f24dc06ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:52.882 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.875+0000 7f24e1123700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24dc06e2f0 con 0x7f24dc06d930 2023-10-06T03:00:52.882 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.875+0000 7f24e1123700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24dc06c920 con 0x7f24dc0b0080 2023-10-06T03:00:52.882 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.875+0000 7f24e1123700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24dc06d4a0 con 0x7f24dc0cb140 2023-10-06T03:00:52.883 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.875+0000 7f24e0922700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f24dc06d930 0x7f24dc06ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:52.883 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.875+0000 7f24db7fe700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f24dc0b0080 0x7f24dc0b04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:52.883 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.875+0000 7f24e0922700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f24dc06d930 0x7f24dc06ddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58012/0 (socket says 172.21.15.57:58012) 2023-10-06T03:00:52.883 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.875+0000 7f24e0922700 1 -- 172.21.15.57:0/2495335909 learned_addr learned my addr 172.21.15.57:0/2495335909 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:00:52.883 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.875+0000 7f24dbfff700 1 --2- 172.21.15.57:0/2495335909 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f24dc0cb140 0x7f24dc0cb510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:52.883 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.879+0000 7f24db7fe700 1 -- 172.21.15.57:0/2495335909 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f24dc0cb140 msgr2=0x7f24dc0cb510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:52.884 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.879+0000 7f24db7fe700 1 --2- 172.21.15.57:0/2495335909 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f24dc0cb140 0x7f24dc0cb510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:52.884 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.879+0000 7f24db7fe700 1 -- 172.21.15.57:0/2495335909 >> v2:172.21.15.57:3300/0 conn(0x7f24dc06d930 msgr2=0x7f24dc06ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:52.884 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.879+0000 7f24db7fe700 1 --2- 172.21.15.57:0/2495335909 >> v2:172.21.15.57:3300/0 conn(0x7f24dc06d930 0x7f24dc06ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:52.884 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.879+0000 7f24db7fe700 1 -- 172.21.15.57:0/2495335909 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24dc06cb70 con 0x7f24dc0b0080 2023-10-06T03:00:52.885 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.879+0000 7f24db7fe700 1 --2- 172.21.15.57:0/2495335909 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f24dc0b0080 0x7f24dc0b04d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f24dc06a550 tx=0x7f24d00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c91be70c694f8de4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:52.886 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.879+0000 7f24daffd700 1 -- 172.21.15.57:0/2495335909 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24d0011630 con 0x7f24dc0b0080 2023-10-06T03:00:52.886 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.879+0000 7f24daffd700 1 -- 172.21.15.57:0/2495335909 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24d0011790 con 0x7f24dc0b0080 2023-10-06T03:00:52.886 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.879+0000 7f24daffd700 1 -- 172.21.15.57:0/2495335909 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24d0011b30 con 0x7f24dc0b0080 2023-10-06T03:00:52.886 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.879+0000 7f24e1123700 1 -- 172.21.15.57:0/2495335909 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f24dc0b0080 msgr2=0x7f24dc0b04d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:52.886 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.879+0000 7f24e1123700 1 --2- 172.21.15.57:0/2495335909 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f24dc0b0080 0x7f24dc0b04d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f24dc06a550 tx=0x7f24d00091a0 comp rx=0 tx=0).stop 2023-10-06T03:00:52.886 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.879+0000 7f24e1123700 1 -- 172.21.15.57:0/2495335909 shutdown_connections 2023-10-06T03:00:52.886 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.879+0000 7f24e1123700 1 --2- 172.21.15.57:0/2495335909 >> v2:172.21.15.57:3300/0 conn(0x7f24dc06d930 0x7f24dc06ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:52.887 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.879+0000 7f24e1123700 1 --2- 172.21.15.57:0/2495335909 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f24dc0b0080 0x7f24dc0b04d0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:52.887 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.879+0000 7f24e1123700 1 --2- 172.21.15.57:0/2495335909 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f24dc0cb140 0x7f24dc0cb510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:52.887 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.879+0000 7f24e1123700 1 -- 172.21.15.57:0/2495335909 >> 172.21.15.57:0/2495335909 conn(0x7f24dc0d0a50 msgr2=0x7f24dc0cca60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:52.887 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.879+0000 7f24e1123700 1 -- 172.21.15.57:0/2495335909 shutdown_connections 2023-10-06T03:00:52.887 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.879+0000 7f24e1123700 1 -- 172.21.15.57:0/2495335909 wait complete. 2023-10-06T03:00:52.888 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.883+0000 7f24e1123700 1 Processor -- start 2023-10-06T03:00:52.888 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.883+0000 7f24e1123700 1 -- start start 2023-10-06T03:00:52.890 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.883+0000 7f24e1123700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f24dc06d930 0x7f24dc1482a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:52.890 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.883+0000 7f24e1123700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f24dc0b0080 0x7f24dc0b4050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:52.890 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.883+0000 7f24e1123700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f24dc0cb140 0x7f24dc148c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:52.890 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.883+0000 7f24e1123700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24dc0b2da0 con 0x7f24dc0b0080 2023-10-06T03:00:52.890 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.883+0000 7f24e1123700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24dc0b2fb0 con 0x7f24dc06d930 2023-10-06T03:00:52.890 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.883+0000 7f24e1123700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24dc0b3290 con 0x7f24dc0cb140 2023-10-06T03:00:52.890 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.883+0000 7f24db7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f24dc0b0080 0x7f24dc0b4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:52.891 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.883+0000 7f24db7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f24dc0b0080 0x7f24dc0b4050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58018/0 (socket says 172.21.15.57:58018) 2023-10-06T03:00:52.891 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.883+0000 7f24db7fe700 1 -- 172.21.15.57:0/414727574 learned_addr learned my addr 172.21.15.57:0/414727574 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:00:52.891 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.883+0000 7f24e0922700 1 --2- 172.21.15.57:0/414727574 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f24dc0cb140 0x7f24dc148c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:52.891 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.883+0000 7f24dbfff700 1 --2- 172.21.15.57:0/414727574 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f24dc06d930 0x7f24dc1482a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:52.892 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.883+0000 7f24db7fe700 1 -- 172.21.15.57:0/414727574 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f24dc0cb140 msgr2=0x7f24dc148c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:52.892 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.883+0000 7f24db7fe700 1 --2- 172.21.15.57:0/414727574 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f24dc0cb140 0x7f24dc148c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:52.892 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.883+0000 7f24db7fe700 1 -- 172.21.15.57:0/414727574 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f24dc06d930 msgr2=0x7f24dc1482a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:52.892 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.883+0000 7f24db7fe700 1 --2- 172.21.15.57:0/414727574 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f24dc06d930 0x7f24dc1482a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:52.892 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.883+0000 7f24db7fe700 1 -- 172.21.15.57:0/414727574 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24d0009420 con 0x7f24dc0b0080 2023-10-06T03:00:52.892 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.887+0000 7f24db7fe700 1 --2- 172.21.15.57:0/414727574 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f24dc0b0080 0x7f24dc0b4050 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f24dc06ca60 tx=0x7f24d0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:52.892 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.887+0000 7f24c3fff700 1 -- 172.21.15.57:0/414727574 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24d001f070 con 0x7f24dc0b0080 2023-10-06T03:00:52.893 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.887+0000 7f24c3fff700 1 -- 172.21.15.57:0/414727574 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24d0002f30 con 0x7f24dc0b0080 2023-10-06T03:00:52.893 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.887+0000 7f24c3fff700 1 -- 172.21.15.57:0/414727574 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24d0011900 con 0x7f24dc0b0080 2023-10-06T03:00:52.893 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.887+0000 7f24e1123700 1 -- 172.21.15.57:0/414727574 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24dc0b3570 con 0x7f24dc0b0080 2023-10-06T03:00:52.893 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.887+0000 7f24e1123700 1 -- 172.21.15.57:0/414727574 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24dc0b3b30 con 0x7f24dc0b0080 2023-10-06T03:00:52.893 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.887+0000 7f24e1123700 1 -- 172.21.15.57:0/414727574 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24dc0b3d40 con 0x7f24dc0b0080 2023-10-06T03:00:52.895 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.891+0000 7f24c3fff700 1 -- 172.21.15.57:0/414727574 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f24d0023070 con 0x7f24dc0b0080 2023-10-06T03:00:52.896 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.891+0000 7f24c3fff700 1 --2- 172.21.15.57:0/414727574 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f24c8060550 0x7f24c8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:52.896 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.891+0000 7f24c3fff700 1 -- 172.21.15.57:0/414727574 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f24d007d860 con 0x7f24dc0b0080 2023-10-06T03:00:52.896 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.891+0000 7f24dbfff700 1 --2- 172.21.15.57:0/414727574 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f24c8060550 0x7f24c8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:52.897 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.891+0000 7f24dbfff700 1 --2- 172.21.15.57:0/414727574 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f24c8060550 0x7f24c8062a00 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f24dc0c6eb0 tx=0x7f24cc0097e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:52.902 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:52.895+0000 7f24c3fff700 1 -- 172.21.15.57:0/414727574 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f24d004dfa0 con 0x7f24dc0b0080 2023-10-06T03:00:53.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.071+0000 7f24e1123700 1 -- 172.21.15.57:0/414727574 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f24dc04be40 con 0x7f24dc0b0080 2023-10-06T03:00:53.079 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.075+0000 7f24c3fff700 1 -- 172.21.15.57:0/414727574 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v19) v1 ==== 92+0+10 (secure 0 0 0) 0x7f24d00515c0 con 0x7f24dc0b0080 2023-10-06T03:00:53.079 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2023-10-06T03:00:53.082 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.075+0000 7f24e1123700 1 -- 172.21.15.57:0/414727574 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f24c8060550 msgr2=0x7f24c8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:53.082 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.075+0000 7f24e1123700 1 --2- 172.21.15.57:0/414727574 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f24c8060550 0x7f24c8062a00 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f24dc0c6eb0 tx=0x7f24cc0097e0 comp rx=0 tx=0).stop 2023-10-06T03:00:53.082 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.075+0000 7f24e1123700 1 -- 172.21.15.57:0/414727574 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f24dc0b0080 msgr2=0x7f24dc0b4050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:53.082 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.075+0000 7f24e1123700 1 --2- 172.21.15.57:0/414727574 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f24dc0b0080 0x7f24dc0b4050 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f24dc06ca60 tx=0x7f24d0017000 comp rx=0 tx=0).stop 2023-10-06T03:00:53.083 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.075+0000 7f24e1123700 1 -- 172.21.15.57:0/414727574 shutdown_connections 2023-10-06T03:00:53.083 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.075+0000 7f24e1123700 1 --2- 172.21.15.57:0/414727574 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f24c8060550 0x7f24c8062a00 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:53.083 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.075+0000 7f24e1123700 1 --2- 172.21.15.57:0/414727574 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f24dc0cb140 0x7f24dc148c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:53.083 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.075+0000 7f24e1123700 1 --2- 172.21.15.57:0/414727574 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f24dc0b0080 0x7f24dc0b4050 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:53.083 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.075+0000 7f24e1123700 1 --2- 172.21.15.57:0/414727574 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f24dc06d930 0x7f24dc1482a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:53.083 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.075+0000 7f24e1123700 1 -- 172.21.15.57:0/414727574 >> 172.21.15.57:0/414727574 conn(0x7f24dc0d0a50 msgr2=0x7f24dc06b060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:53.083 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.075+0000 7f24e1123700 1 -- 172.21.15.57:0/414727574 shutdown_connections 2023-10-06T03:00:53.083 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.075+0000 7f24e1123700 1 -- 172.21.15.57:0/414727574 wait complete. 2023-10-06T03:00:53.101 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:00:53.255 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.251+0000 7f3dfdce3700 1 Processor -- start 2023-10-06T03:00:53.256 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.251+0000 7f3dfdce3700 1 -- start start 2023-10-06T03:00:53.257 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.251+0000 7f3dfdce3700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f3df806c920 0x7f3df806ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:53.258 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.251+0000 7f3dfdce3700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3df80af0d0 0x7f3df80af550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:53.258 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.251+0000 7f3dfdce3700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3df806b4a0 con 0x7f3df806d230 2023-10-06T03:00:53.258 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.251+0000 7f3dfdce3700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3df806a890 con 0x7f3df806c920 2023-10-06T03:00:53.258 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.251+0000 7f3dfdce3700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3df806ab70 con 0x7f3df80af0d0 2023-10-06T03:00:53.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.255+0000 7f3dfcce1700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f3df806c920 0x7f3df806ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:53.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.255+0000 7f3dfd4e2700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3df80af0d0 0x7f3df80af550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:53.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.255+0000 7f3deffff700 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f3df806d230 0x7f3df80ae9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.57:35544/0 (socket says 172.21.15.57:35544) 2023-10-06T03:00:53.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.255+0000 7f3deffff700 1 -- 172.21.15.57:0/2725970652 learned_addr learned my addr 172.21.15.57:0/2725970652 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:00:53.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.255+0000 7f3dfcce1700 1 -- 172.21.15.57:0/2725970652 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3df80af0d0 msgr2=0x7f3df80af550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:53.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.255+0000 7f3dfcce1700 1 --2- 172.21.15.57:0/2725970652 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3df80af0d0 0x7f3df80af550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:53.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.255+0000 7f3dfcce1700 1 -- 172.21.15.57:0/2725970652 >> v1:172.21.15.105:6789/0 conn(0x7f3df806d230 legacy=0x7f3df80ae9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:53.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.255+0000 7f3dfcce1700 1 -- 172.21.15.57:0/2725970652 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3df806ae50 con 0x7f3df806c920 2023-10-06T03:00:53.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.255+0000 7f3dfcce1700 1 --2- 172.21.15.57:0/2725970652 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3df806c920 0x7f3df806ccf0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3df4009e60 tx=0x7f3df4009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=60e4c032107ad016 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:53.262 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.255+0000 7f3def7fe700 1 -- 172.21.15.57:0/2725970652 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df400e070 con 0x7f3df806c920 2023-10-06T03:00:53.262 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.255+0000 7f3def7fe700 1 -- 172.21.15.57:0/2725970652 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3df400bb60 con 0x7f3df806c920 2023-10-06T03:00:53.262 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.255+0000 7f3def7fe700 1 -- 172.21.15.57:0/2725970652 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df4012430 con 0x7f3df806c920 2023-10-06T03:00:53.262 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.255+0000 7f3dfdce3700 1 -- 172.21.15.57:0/2725970652 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3df806c920 msgr2=0x7f3df806ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:53.263 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.255+0000 7f3dfdce3700 1 --2- 172.21.15.57:0/2725970652 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3df806c920 0x7f3df806ccf0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3df4009e60 tx=0x7f3df4009780 comp rx=0 tx=0).stop 2023-10-06T03:00:53.263 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.255+0000 7f3dfdce3700 1 -- 172.21.15.57:0/2725970652 shutdown_connections 2023-10-06T03:00:53.263 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.255+0000 7f3dfdce3700 1 --2- 172.21.15.57:0/2725970652 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3df80af0d0 0x7f3df80af550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:53.263 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.255+0000 7f3dfdce3700 1 --2- 172.21.15.57:0/2725970652 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3df806c920 0x7f3df806ccf0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:53.263 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.255+0000 7f3dfdce3700 1 -- 172.21.15.57:0/2725970652 >> 172.21.15.57:0/2725970652 conn(0x7f3df80c85e0 msgr2=0x7f3df80c89e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:53.263 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.255+0000 7f3dfdce3700 1 -- 172.21.15.57:0/2725970652 shutdown_connections 2023-10-06T03:00:53.263 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.255+0000 7f3dfdce3700 1 -- 172.21.15.57:0/2725970652 wait complete. 2023-10-06T03:00:53.264 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.259+0000 7f3dfdce3700 1 Processor -- start 2023-10-06T03:00:53.265 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.259+0000 7f3dfdce3700 1 -- start start 2023-10-06T03:00:53.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.259+0000 7f3dfdce3700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3df806c920 0x7f3df8168fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:53.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.259+0000 7f3dfdce3700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3df806d230 0x7f3df80c7e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:53.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.259+0000 7f3dfdce3700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3df80af0d0 0x7f3df8159250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:53.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.263+0000 7f3dfdce3700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3df80c5b20 con 0x7f3df806d230 2023-10-06T03:00:53.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.263+0000 7f3dfdce3700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3df80c2b80 con 0x7f3df806c920 2023-10-06T03:00:53.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.263+0000 7f3dfdce3700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3df80c2e20 con 0x7f3df80af0d0 2023-10-06T03:00:53.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.263+0000 7f3deffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3df806d230 0x7f3df80c7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:53.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.263+0000 7f3deffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3df806d230 0x7f3df80c7e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58026/0 (socket says 172.21.15.57:58026) 2023-10-06T03:00:53.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.263+0000 7f3deffff700 1 -- 172.21.15.57:0/721739835 learned_addr learned my addr 172.21.15.57:0/721739835 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:00:53.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.263+0000 7f3dfd4e2700 1 --2- 172.21.15.57:0/721739835 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3df80af0d0 0x7f3df8159250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:53.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.263+0000 7f3dfcce1700 1 --2- 172.21.15.57:0/721739835 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3df806c920 0x7f3df8168fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:53.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.263+0000 7f3deffff700 1 -- 172.21.15.57:0/721739835 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3df80af0d0 msgr2=0x7f3df8159250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:53.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.263+0000 7f3deffff700 1 --2- 172.21.15.57:0/721739835 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3df80af0d0 0x7f3df8159250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:53.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.263+0000 7f3deffff700 1 -- 172.21.15.57:0/721739835 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3df806c920 msgr2=0x7f3df8168fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:53.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.263+0000 7f3deffff700 1 --2- 172.21.15.57:0/721739835 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3df806c920 0x7f3df8168fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:53.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.263+0000 7f3deffff700 1 -- 172.21.15.57:0/721739835 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3df4009a20 con 0x7f3df806d230 2023-10-06T03:00:53.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.263+0000 7f3deffff700 1 --2- 172.21.15.57:0/721739835 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3df806d230 0x7f3df80c7e90 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3de800c7c0 tx=0x7f3de8007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:53.270 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.263+0000 7f3decff9700 1 -- 172.21.15.57:0/721739835 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de8005b30 con 0x7f3df806d230 2023-10-06T03:00:53.270 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.263+0000 7f3decff9700 1 -- 172.21.15.57:0/721739835 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3de8005c90 con 0x7f3df806d230 2023-10-06T03:00:53.270 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.263+0000 7f3dfdce3700 1 -- 172.21.15.57:0/721739835 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3df80c83d0 con 0x7f3df806d230 2023-10-06T03:00:53.270 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.263+0000 7f3decff9700 1 -- 172.21.15.57:0/721739835 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de8004a80 con 0x7f3df806d230 2023-10-06T03:00:53.270 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.263+0000 7f3dfdce3700 1 -- 172.21.15.57:0/721739835 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3df80c5840 con 0x7f3df806d230 2023-10-06T03:00:53.271 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.267+0000 7f3dfdce3700 1 -- 172.21.15.57:0/721739835 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3df80c2fb0 con 0x7f3df806d230 2023-10-06T03:00:53.273 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.267+0000 7f3decff9700 1 -- 172.21.15.57:0/721739835 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f3de80070d0 con 0x7f3df806d230 2023-10-06T03:00:53.275 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.271+0000 7f3decff9700 1 --2- 172.21.15.57:0/721739835 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f3de4060550 0x7f3de4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:53.275 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.271+0000 7f3decff9700 1 -- 172.21.15.57:0/721739835 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f3de807b980 con 0x7f3df806d230 2023-10-06T03:00:53.275 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.271+0000 7f3dfcce1700 1 --2- 172.21.15.57:0/721739835 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f3de4060550 0x7f3de4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:53.276 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.271+0000 7f3dfcce1700 1 --2- 172.21.15.57:0/721739835 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f3de4060550 0x7f3de4062a00 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3df40097c0 tx=0x7f3df4019000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:53.281 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.275+0000 7f3decff9700 1 -- 172.21.15.57:0/721739835 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f3de8049be0 con 0x7f3df806d230 2023-10-06T03:00:53.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.483+0000 7f3dfdce3700 1 -- 172.21.15.57:0/721739835 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3df804be40 con 0x7f3df806d230 2023-10-06T03:00:53.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.483+0000 7f3decff9700 1 -- 172.21.15.57:0/721739835 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3527 (secure 0 0 0) 0x7f3de804c0c0 con 0x7f3df806d230 2023-10-06T03:00:53.489 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:00:53.489 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6834/1042131376","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":1042131376},{"type":"v1","addr":"172.21.15.105:6834","nonce":1042131376}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4287,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6836/3619570714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":3619570714},{"type":"v1","addr":"172.21.15.57:6836","nonce":3619570714}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6837/645924568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6835","nonce":645924568},{"type":"v1","addr":"172.21.15.57:6837","nonce":645924568}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4303,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/1286071598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":1286071598},{"type":"v1","addr":"172.21.15.105:6835","nonce":1286071598}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-10-06T03:00:53.492 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.487+0000 7f3dfdce3700 1 -- 172.21.15.57:0/721739835 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f3de4060550 msgr2=0x7f3de4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:53.492 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.487+0000 7f3dfdce3700 1 --2- 172.21.15.57:0/721739835 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f3de4060550 0x7f3de4062a00 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3df40097c0 tx=0x7f3df4019000 comp rx=0 tx=0).stop 2023-10-06T03:00:53.492 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.487+0000 7f3dfdce3700 1 -- 172.21.15.57:0/721739835 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3df806d230 msgr2=0x7f3df80c7e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:53.492 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.487+0000 7f3dfdce3700 1 --2- 172.21.15.57:0/721739835 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3df806d230 0x7f3df80c7e90 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3de800c7c0 tx=0x7f3de8007f70 comp rx=0 tx=0).stop 2023-10-06T03:00:53.492 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.487+0000 7f3dfdce3700 1 -- 172.21.15.57:0/721739835 shutdown_connections 2023-10-06T03:00:53.493 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.487+0000 7f3dfdce3700 1 --2- 172.21.15.57:0/721739835 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f3de4060550 0x7f3de4062a00 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:53.493 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.487+0000 7f3dfdce3700 1 --2- 172.21.15.57:0/721739835 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3df80af0d0 0x7f3df8159250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:53.493 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.487+0000 7f3dfdce3700 1 --2- 172.21.15.57:0/721739835 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3df806d230 0x7f3df80c7e90 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:53.493 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.487+0000 7f3dfdce3700 1 --2- 172.21.15.57:0/721739835 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3df806c920 0x7f3df8168fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:53.493 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.487+0000 7f3dfdce3700 1 -- 172.21.15.57:0/721739835 >> 172.21.15.57:0/721739835 conn(0x7f3df80c85e0 msgr2=0x7f3df80cb190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:53.493 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.487+0000 7f3dfdce3700 1 -- 172.21.15.57:0/721739835 shutdown_connections 2023-10-06T03:00:53.493 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.487+0000 7f3dfdce3700 1 -- 172.21.15.57:0/721739835 wait complete. 2023-10-06T03:00:53.494 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 3 2023-10-06T03:00:53.512 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:00:53.669 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.663+0000 7f4662fcc700 1 Processor -- start 2023-10-06T03:00:53.670 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.663+0000 7f4662fcc700 1 -- start start 2023-10-06T03:00:53.672 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.667+0000 7f4662fcc700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f465c158dc0 0x7f465c0cc660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:53.673 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.667+0000 7f4662fcc700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f465c06b020 con 0x7f465c06b4b0 2023-10-06T03:00:53.673 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.667+0000 7f4662fcc700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f465c06a6f0 con 0x7f465c159190 2023-10-06T03:00:53.673 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.667+0000 7f4662fcc700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f465c06a9d0 con 0x7f465c158dc0 2023-10-06T03:00:53.673 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.667+0000 7f4661fca700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f465c158dc0 0x7f465c0cc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:53.673 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.667+0000 7f46617c9700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f465c06b4b0 0x7f465c15ccb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:36266/0 (socket says 172.21.15.57:36266) 2023-10-06T03:00:53.673 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.667+0000 7f46617c9700 1 -- 172.21.15.57:0/2585693447 learned_addr learned my addr 172.21.15.57:0/2585693447 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:00:53.674 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.667+0000 7f4660fc8700 1 -- 172.21.15.57:0/2585693447 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3723847362 0 0) 0x7f465c06b020 con 0x7f465c06b4b0 2023-10-06T03:00:53.674 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.667+0000 7f4660fc8700 1 -- 172.21.15.57:0/2585693447 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4648003570 con 0x7f465c06b4b0 2023-10-06T03:00:53.674 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.667+0000 7f4661fca700 1 -- 172.21.15.57:0/2585693447 >> v1:172.21.15.105:6789/0 conn(0x7f465c159190 legacy=0x7f465c0ca4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:53.674 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.667+0000 7f4661fca700 1 -- 172.21.15.57:0/2585693447 >> v1:172.21.15.57:6789/0 conn(0x7f465c06b4b0 legacy=0x7f465c15ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:53.674 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.667+0000 7f4661fca700 1 -- 172.21.15.57:0/2585693447 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f465c06acb0 con 0x7f465c158dc0 2023-10-06T03:00:53.675 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.671+0000 7f4661fca700 1 --2- 172.21.15.57:0/2585693447 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f465c158dc0 0x7f465c0cc660 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f46580098e0 tx=0x7f46580091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=695a19290eecf529 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:53.675 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.671+0000 7f4660fc8700 1 -- 172.21.15.57:0/2585693447 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f465800b640 con 0x7f465c158dc0 2023-10-06T03:00:53.675 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.671+0000 7f4660fc8700 1 -- 172.21.15.57:0/2585693447 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f465800b7a0 con 0x7f465c158dc0 2023-10-06T03:00:53.675 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.671+0000 7f4660fc8700 1 -- 172.21.15.57:0/2585693447 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f465800bb40 con 0x7f465c158dc0 2023-10-06T03:00:53.676 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.671+0000 7f4662fcc700 1 -- 172.21.15.57:0/2585693447 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f465c158dc0 msgr2=0x7f465c0cc660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:53.676 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.671+0000 7f4662fcc700 1 --2- 172.21.15.57:0/2585693447 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f465c158dc0 0x7f465c0cc660 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f46580098e0 tx=0x7f46580091a0 comp rx=0 tx=0).stop 2023-10-06T03:00:53.676 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.671+0000 7f4662fcc700 1 -- 172.21.15.57:0/2585693447 shutdown_connections 2023-10-06T03:00:53.676 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.671+0000 7f4662fcc700 1 --2- 172.21.15.57:0/2585693447 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f465c158dc0 0x7f465c0cc660 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:53.676 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.671+0000 7f4662fcc700 1 -- 172.21.15.57:0/2585693447 >> 172.21.15.57:0/2585693447 conn(0x7f465c067050 msgr2=0x7f465c067450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:53.677 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.671+0000 7f4662fcc700 1 -- 172.21.15.57:0/2585693447 shutdown_connections 2023-10-06T03:00:53.677 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.671+0000 7f4662fcc700 1 -- 172.21.15.57:0/2585693447 wait complete. 2023-10-06T03:00:53.678 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.671+0000 7f4662fcc700 1 Processor -- start 2023-10-06T03:00:53.678 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.671+0000 7f4662fcc700 1 -- start start 2023-10-06T03:00:53.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.675+0000 7f4662fcc700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f465c06b4b0 0x7f465c1492e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:53.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.675+0000 7f4662fcc700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f465c158dc0 0x7f465c15a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:53.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.675+0000 7f4662fcc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f465c159190 0x7f465c15c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:53.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.675+0000 7f4662fcc700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f465c15b150 con 0x7f465c159190 2023-10-06T03:00:53.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.675+0000 7f4662fcc700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f465c0caa60 con 0x7f465c158dc0 2023-10-06T03:00:53.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.675+0000 7f4662fcc700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f465c15ab90 con 0x7f465c06b4b0 2023-10-06T03:00:53.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.675+0000 7f46627cb700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f465c159190 0x7f465c15c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:53.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.675+0000 7f46627cb700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f465c159190 0x7f465c15c1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58040/0 (socket says 172.21.15.57:58040) 2023-10-06T03:00:53.681 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.675+0000 7f46627cb700 1 -- 172.21.15.57:0/1731650348 learned_addr learned my addr 172.21.15.57:0/1731650348 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:00:53.681 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.675+0000 7f4661fca700 1 --2- 172.21.15.57:0/1731650348 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f465c06b4b0 0x7f465c1492e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:53.681 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.675+0000 7f46617c9700 1 --2- 172.21.15.57:0/1731650348 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f465c158dc0 0x7f465c15a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:53.682 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.675+0000 7f46627cb700 1 -- 172.21.15.57:0/1731650348 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f465c06b4b0 msgr2=0x7f465c1492e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:53.682 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.675+0000 7f46627cb700 1 --2- 172.21.15.57:0/1731650348 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f465c06b4b0 0x7f465c1492e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:53.682 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.675+0000 7f46627cb700 1 -- 172.21.15.57:0/1731650348 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f465c158dc0 msgr2=0x7f465c15a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:53.682 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.675+0000 7f46627cb700 1 --2- 172.21.15.57:0/1731650348 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f465c158dc0 0x7f465c15a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:53.682 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.675+0000 7f46627cb700 1 -- 172.21.15.57:0/1731650348 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4658009420 con 0x7f465c159190 2023-10-06T03:00:53.682 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.675+0000 7f46617c9700 1 --2- 172.21.15.57:0/1731650348 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f465c158dc0 0x7f465c15a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:00:53.682 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.675+0000 7f4661fca700 1 --2- 172.21.15.57:0/1731650348 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f465c06b4b0 0x7f465c1492e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:00:53.682 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.675+0000 7f46627cb700 1 --2- 172.21.15.57:0/1731650348 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f465c159190 0x7f465c15c1e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f465400c840 tx=0x7f4654001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:53.683 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.675+0000 7f4651ffb700 1 -- 172.21.15.57:0/1731650348 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4654012630 con 0x7f465c159190 2023-10-06T03:00:53.683 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.675+0000 7f4651ffb700 1 -- 172.21.15.57:0/1731650348 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46540127b0 con 0x7f465c159190 2023-10-06T03:00:53.683 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.675+0000 7f4662fcc700 1 -- 172.21.15.57:0/1731650348 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f465c15ae70 con 0x7f465c159190 2023-10-06T03:00:53.683 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.675+0000 7f4651ffb700 1 -- 172.21.15.57:0/1731650348 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4654012b70 con 0x7f465c159190 2023-10-06T03:00:53.683 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.675+0000 7f4662fcc700 1 -- 172.21.15.57:0/1731650348 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f465c0c73b0 con 0x7f465c159190 2023-10-06T03:00:53.684 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.679+0000 7f4662fcc700 1 -- 172.21.15.57:0/1731650348 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f465c06ded0 con 0x7f465c159190 2023-10-06T03:00:53.684 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.679+0000 7f4651ffb700 1 -- 172.21.15.57:0/1731650348 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f4654003030 con 0x7f465c159190 2023-10-06T03:00:53.685 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.679+0000 7f4651ffb700 1 --2- 172.21.15.57:0/1731650348 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f4640060550 0x7f4640062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:53.685 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.679+0000 7f4651ffb700 1 -- 172.21.15.57:0/1731650348 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f465407c650 con 0x7f465c159190 2023-10-06T03:00:53.685 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.679+0000 7f4661fca700 1 --2- 172.21.15.57:0/1731650348 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f4640060550 0x7f4640062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:53.687 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.683+0000 7f4661fca700 1 --2- 172.21.15.57:0/1731650348 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f4640060550 0x7f4640062a00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f46580093f0 tx=0x7f4658017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:53.692 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.687+0000 7f4651ffb700 1 -- 172.21.15.57:0/1731650348 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f465c06ded0 con 0x7f465c159190 2023-10-06T03:00:53.865 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.859+0000 7f4662fcc700 1 -- 172.21.15.57:0/1731650348 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f465c06ded0 con 0x7f465c159190 2023-10-06T03:00:53.867 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.863+0000 7f4651ffb700 1 -- 172.21.15.57:0/1731650348 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+13647 (secure 0 0 0) 0x7f465c06ded0 con 0x7f465c159190 2023-10-06T03:00:53.868 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:00:53.868 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":19,"fsid":"eb56dc0f-9213-41cb-9aad-8ade6c802e98","created":"2023-10-06T03:00:30.806197+0000","modified":"2023-10-06T03:00:52.892527+0000","last_up_change":"2023-10-06T03:00:43.607454+0000","last_in_change":"2023-10-06T03:00:33.943513+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T03:00:44.360651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T03:00:50.466601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"58cf6c90-d704-43e0-b2db-dffe526d5e8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":33053},{"type":"v1","addr":"172.21.15.57:6801","nonce":33053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":33053},{"type":"v1","addr":"172.21.15.57:6803","nonce":33053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":33053},{"type":"v1","addr":"172.21.15.57:6807","nonce":33053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":33053},{"type":"v1","addr":"172.21.15.57:6805","nonce":33053}]},"public_addr":"172.21.15.57:6801/33053","cluster_addr":"172.21.15.57:6803/33053","heartbeat_back_addr":"172.21.15.57:6807/33053","heartbeat_front_addr":"172.21.15.57:6805/33053","state":["exists","up"]},{"osd":1,"uuid":"16afbe70-7f9e-4568-9c92-763e6e348119","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6809","nonce":33052},{"type":"v1","addr":"172.21.15.57:6810","nonce":33052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":33052},{"type":"v1","addr":"172.21.15.57:6813","nonce":33052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":33052},{"type":"v1","addr":"172.21.15.57:6822","nonce":33052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6815","nonce":33052},{"type":"v1","addr":"172.21.15.57:6818","nonce":33052}]},"public_addr":"172.21.15.57:6810/33052","cluster_addr":"172.21.15.57:6813/33052","heartbeat_back_addr":"172.21.15.57:6822/33052","heartbeat_front_addr":"172.21.15.57:6818/33052","state":["exists","up"]},{"osd":2,"uuid":"7255c62e-f92f-470f-a5ce-30228920d9f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":33058},{"type":"v1","addr":"172.21.15.57:6825","nonce":33058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":33058},{"type":"v1","addr":"172.21.15.57:6827","nonce":33058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":33058},{"type":"v1","addr":"172.21.15.57:6831","nonce":33058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":33058},{"type":"v1","addr":"172.21.15.57:6829","nonce":33058}]},"public_addr":"172.21.15.57:6825/33058","cluster_addr":"172.21.15.57:6827/33058","heartbeat_back_addr":"172.21.15.57:6831/33058","heartbeat_front_addr":"172.21.15.57:6829/33058","state":["exists","up"]},{"osd":3,"uuid":"152a236d-f799-4888-8544-74865508d5a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":33057},{"type":"v1","addr":"172.21.15.57:6811","nonce":33057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":33057},{"type":"v1","addr":"172.21.15.57:6816","nonce":33057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6821","nonce":33057},{"type":"v1","addr":"172.21.15.57:6823","nonce":33057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6817","nonce":33057},{"type":"v1","addr":"172.21.15.57:6819","nonce":33057}]},"public_addr":"172.21.15.57:6811/33057","cluster_addr":"172.21.15.57:6816/33057","heartbeat_back_addr":"172.21.15.57:6823/33057","heartbeat_front_addr":"172.21.15.57:6819/33057","state":["exists","up"]},{"osd":4,"uuid":"37db2a65-3566-41d0-9d60-e66c49e1e68e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":33368},{"type":"v1","addr":"172.21.15.105:6801","nonce":33368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":33368},{"type":"v1","addr":"172.21.15.105:6803","nonce":33368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":33368},{"type":"v1","addr":"172.21.15.105:6807","nonce":33368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":33368},{"type":"v1","addr":"172.21.15.105:6805","nonce":33368}]},"public_addr":"172.21.15.105:6801/33368","cluster_addr":"172.21.15.105:6803/33368","heartbeat_back_addr":"172.21.15.105:6807/33368","heartbeat_front_addr":"172.21.15.105:6805/33368","state":["exists","up"]},{"osd":5,"uuid":"35e77918-1bb4-42ca-9b20-f3c14eaa0c04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":33379},{"type":"v1","addr":"172.21.15.105:6818","nonce":33379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":33379},{"type":"v1","addr":"172.21.15.105:6823","nonce":33379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":33379},{"type":"v1","addr":"172.21.15.105:6831","nonce":33379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":33379},{"type":"v1","addr":"172.21.15.105:6827","nonce":33379}]},"public_addr":"172.21.15.105:6818/33379","cluster_addr":"172.21.15.105:6823/33379","heartbeat_back_addr":"172.21.15.105:6831/33379","heartbeat_front_addr":"172.21.15.105:6827/33379","state":["exists","up"]},{"osd":6,"uuid":"b4d9d510-7a45-4173-8287-c6c8d6547f2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":33369},{"type":"v1","addr":"172.21.15.105:6819","nonce":33369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":33369},{"type":"v1","addr":"172.21.15.105:6822","nonce":33369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":33369},{"type":"v1","addr":"172.21.15.105:6830","nonce":33369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":33369},{"type":"v1","addr":"172.21.15.105:6826","nonce":33369}]},"public_addr":"172.21.15.105:6819/33369","cluster_addr":"172.21.15.105:6822/33369","heartbeat_back_addr":"172.21.15.105:6830/33369","heartbeat_front_addr":"172.21.15.105:6826/33369","state":["exists","up"]},{"osd":7,"uuid":"74266fb0-cd84-463f-8bf0-092652a71dc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":33370},{"type":"v1","addr":"172.21.15.105:6809","nonce":33370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":33370},{"type":"v1","addr":"172.21.15.105:6811","nonce":33370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":33370},{"type":"v1","addr":"172.21.15.105:6815","nonce":33370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":33370},{"type":"v1","addr":"172.21.15.105:6813","nonce":33370}]},"public_addr":"172.21.15.105:6809/33370","cluster_addr":"172.21.15.105:6811/33370","heartbeat_back_addr":"172.21.15.105:6815/33370","heartbeat_front_addr":"172.21.15.105:6813/33370","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.596864+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.633851+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.636993+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.529681+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.608601+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.659752+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.661717+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.642221+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:00:53.871 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.863+0000 7f4662fcc700 1 -- 172.21.15.57:0/1731650348 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f4640060550 msgr2=0x7f4640062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:53.872 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.863+0000 7f4662fcc700 1 --2- 172.21.15.57:0/1731650348 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f4640060550 0x7f4640062a00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f46580093f0 tx=0x7f4658017000 comp rx=0 tx=0).stop 2023-10-06T03:00:53.872 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.863+0000 7f4662fcc700 1 -- 172.21.15.57:0/1731650348 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f465c159190 msgr2=0x7f465c15c1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:53.872 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.863+0000 7f4662fcc700 1 --2- 172.21.15.57:0/1731650348 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f465c159190 0x7f465c15c1e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f465400c840 tx=0x7f4654001670 comp rx=0 tx=0).stop 2023-10-06T03:00:53.872 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.863+0000 7f4662fcc700 1 -- 172.21.15.57:0/1731650348 shutdown_connections 2023-10-06T03:00:53.872 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.863+0000 7f4662fcc700 1 --2- 172.21.15.57:0/1731650348 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f465c159190 0x7f465c15c1e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:53.873 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.863+0000 7f4662fcc700 1 --2- 172.21.15.57:0/1731650348 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f465c158dc0 0x7f465c15a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:53.873 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.863+0000 7f4662fcc700 1 --2- 172.21.15.57:0/1731650348 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f4640060550 0x7f4640062a00 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:53.873 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.863+0000 7f4662fcc700 1 --2- 172.21.15.57:0/1731650348 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f465c06b4b0 0x7f465c1492e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:53.873 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.863+0000 7f4662fcc700 1 -- 172.21.15.57:0/1731650348 >> 172.21.15.57:0/1731650348 conn(0x7f465c067050 msgr2=0x7f465c0cb1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:53.873 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.867+0000 7f4662fcc700 1 -- 172.21.15.57:0/1731650348 shutdown_connections 2023-10-06T03:00:53.873 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:53.867+0000 7f4662fcc700 1 -- 172.21.15.57:0/1731650348 wait complete. 2023-10-06T03:00:53.890 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T03:00:44.360651+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T03:00:50.466601+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-10-06T03:00:53.891 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T03:00:54.054 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.047+0000 7fc6b00f0700 1 Processor -- start 2023-10-06T03:00:54.054 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.047+0000 7fc6b00f0700 1 -- start start 2023-10-06T03:00:54.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.051+0000 7fc6b00f0700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc6a80bef40 0x7fc6a80c6a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:54.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.051+0000 7fc6b00f0700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6a80ac530 con 0x7fc6a80bf310 2023-10-06T03:00:54.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.051+0000 7fc6b00f0700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6a806bed0 con 0x7fc6a806b9b0 2023-10-06T03:00:54.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.051+0000 7fc6b00f0700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6a806dc60 con 0x7fc6a80bef40 2023-10-06T03:00:54.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.051+0000 7fc6ade8c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc6a80bef40 0x7fc6a80c6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:54.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.051+0000 7fc6ade8c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc6a80bef40 0x7fc6a80c6a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58056/0 (socket says 172.21.15.57:58056) 2023-10-06T03:00:54.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.051+0000 7fc6ade8c700 1 -- 172.21.15.57:0/897527151 learned_addr learned my addr 172.21.15.57:0/897527151 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:00:54.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.051+0000 7fc6ad68b700 1 --1- 172.21.15.57:0/897527151 >> v1:172.21.15.57:6789/0 conn(0x7fc6a80bf310 0x7fc6a806b2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:36276/0 (socket says 172.21.15.57:36276) 2023-10-06T03:00:54.062 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.055+0000 7fc6ade8c700 1 -- 172.21.15.57:0/897527151 >> v1:172.21.15.105:6789/0 conn(0x7fc6a806b9b0 legacy=0x7fc6a80ac9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:54.062 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.055+0000 7fc6ade8c700 1 -- 172.21.15.57:0/897527151 >> v1:172.21.15.57:6789/0 conn(0x7fc6a80bf310 legacy=0x7fc6a806b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:54.062 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.055+0000 7fc6ace8a700 1 -- 172.21.15.57:0/897527151 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2461871445 0 0) 0x7fc6a806bed0 con 0x7fc6a806b9b0 2023-10-06T03:00:54.062 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.055+0000 7fc6ade8c700 1 -- 172.21.15.57:0/897527151 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6a806c1b0 con 0x7fc6a80bef40 2023-10-06T03:00:54.063 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.055+0000 7fc6ade8c700 1 --2- 172.21.15.57:0/897527151 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc6a80bef40 0x7fc6a80c6a50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc6a40099b0 tx=0x7fc6a4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bafa587227af031 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:54.063 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.055+0000 7fc6ace8a700 1 -- 172.21.15.57:0/897527151 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a400b8f0 con 0x7fc6a80bef40 2023-10-06T03:00:54.063 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.055+0000 7fc6ace8a700 1 -- 172.21.15.57:0/897527151 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6a400ba50 con 0x7fc6a80bef40 2023-10-06T03:00:54.063 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.055+0000 7fc6ace8a700 1 -- 172.21.15.57:0/897527151 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a400bdf0 con 0x7fc6a80bef40 2023-10-06T03:00:54.063 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.055+0000 7fc6b00f0700 1 -- 172.21.15.57:0/897527151 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc6a80bef40 msgr2=0x7fc6a80c6a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:54.063 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.055+0000 7fc6b00f0700 1 --2- 172.21.15.57:0/897527151 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc6a80bef40 0x7fc6a80c6a50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc6a40099b0 tx=0x7fc6a4009250 comp rx=0 tx=0).stop 2023-10-06T03:00:54.064 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.055+0000 7fc6b00f0700 1 -- 172.21.15.57:0/897527151 shutdown_connections 2023-10-06T03:00:54.064 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.055+0000 7fc6b00f0700 1 --2- 172.21.15.57:0/897527151 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc6a80bef40 0x7fc6a80c6a50 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:54.064 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.055+0000 7fc6b00f0700 1 -- 172.21.15.57:0/897527151 >> 172.21.15.57:0/897527151 conn(0x7fc6a80c87b0 msgr2=0x7fc6a80c8bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:54.064 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.055+0000 7fc6b00f0700 1 -- 172.21.15.57:0/897527151 shutdown_connections 2023-10-06T03:00:54.064 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.055+0000 7fc6b00f0700 1 -- 172.21.15.57:0/897527151 wait complete. 2023-10-06T03:00:54.068 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.059+0000 7fc6b00f0700 1 Processor -- start 2023-10-06T03:00:54.068 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.059+0000 7fc6b00f0700 1 -- start start 2023-10-06T03:00:54.068 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.059+0000 7fc6b00f0700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc6a806b9b0 0x7fc6a80c26e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:54.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.059+0000 7fc6b00f0700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc6a80bef40 0x7fc6a8159430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:54.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.059+0000 7fc6b00f0700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc6a80bf310 0x7fc6a815df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:54.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.059+0000 7fc6b00f0700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a815ef20 con 0x7fc6a806b9b0 2023-10-06T03:00:54.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.059+0000 7fc6b00f0700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a815e450 con 0x7fc6a80bef40 2023-10-06T03:00:54.070 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.059+0000 7fc6b00f0700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a815e680 con 0x7fc6a80bf310 2023-10-06T03:00:54.070 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.059+0000 7fc6ade8c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc6a806b9b0 0x7fc6a80c26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:54.070 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.059+0000 7fc6ade8c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc6a806b9b0 0x7fc6a80c26e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58068/0 (socket says 172.21.15.57:58068) 2023-10-06T03:00:54.070 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.059+0000 7fc6ade8c700 1 -- 172.21.15.57:0/2908852335 learned_addr learned my addr 172.21.15.57:0/2908852335 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:00:54.070 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.059+0000 7fc6ad68b700 1 --2- 172.21.15.57:0/2908852335 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc6a80bef40 0x7fc6a8159430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:54.071 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.059+0000 7fc6ae68d700 1 --2- 172.21.15.57:0/2908852335 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc6a80bf310 0x7fc6a815df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:54.071 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.059+0000 7fc6ade8c700 1 -- 172.21.15.57:0/2908852335 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc6a80bf310 msgr2=0x7fc6a815df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:54.071 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.059+0000 7fc6ade8c700 1 --2- 172.21.15.57:0/2908852335 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc6a80bf310 0x7fc6a815df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:54.071 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.059+0000 7fc6ade8c700 1 -- 172.21.15.57:0/2908852335 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc6a80bef40 msgr2=0x7fc6a8159430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:54.071 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.059+0000 7fc6ade8c700 1 --2- 172.21.15.57:0/2908852335 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc6a80bef40 0x7fc6a8159430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:54.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.059+0000 7fc6ade8c700 1 -- 172.21.15.57:0/2908852335 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6a40094f0 con 0x7fc6a806b9b0 2023-10-06T03:00:54.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.059+0000 7fc6ad68b700 1 --2- 172.21.15.57:0/2908852335 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc6a80bef40 0x7fc6a8159430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:00:54.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.063+0000 7fc6ade8c700 1 --2- 172.21.15.57:0/2908852335 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc6a806b9b0 0x7fc6a80c26e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc6a4009290 tx=0x7fc6a4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:54.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.063+0000 7fc69dffb700 1 -- 172.21.15.57:0/2908852335 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a4011e10 con 0x7fc6a806b9b0 2023-10-06T03:00:54.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.063+0000 7fc69dffb700 1 -- 172.21.15.57:0/2908852335 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6a401a630 con 0x7fc6a806b9b0 2023-10-06T03:00:54.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.063+0000 7fc6b00f0700 1 -- 172.21.15.57:0/2908852335 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6a815e960 con 0x7fc6a806b9b0 2023-10-06T03:00:54.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.063+0000 7fc69dffb700 1 -- 172.21.15.57:0/2908852335 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a401a9f0 con 0x7fc6a806b9b0 2023-10-06T03:00:54.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.063+0000 7fc6b00f0700 1 -- 172.21.15.57:0/2908852335 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6a81614c0 con 0x7fc6a806b9b0 2023-10-06T03:00:54.074 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.063+0000 7fc6b00f0700 1 -- 172.21.15.57:0/2908852335 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6a81616b0 con 0x7fc6a806b9b0 2023-10-06T03:00:54.074 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.067+0000 7fc69dffb700 1 -- 172.21.15.57:0/2908852335 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fc6a402e450 con 0x7fc6a806b9b0 2023-10-06T03:00:54.074 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.067+0000 7fc69dffb700 1 --2- 172.21.15.57:0/2908852335 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fc68c060550 0x7fc68c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:54.075 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.067+0000 7fc69dffb700 1 -- 172.21.15.57:0/2908852335 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fc6a407e130 con 0x7fc6a806b9b0 2023-10-06T03:00:54.075 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.067+0000 7fc6ad68b700 1 --2- 172.21.15.57:0/2908852335 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fc68c060550 0x7fc68c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:54.075 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.067+0000 7fc6ad68b700 1 --2- 172.21.15.57:0/2908852335 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fc68c060550 0x7fc68c062a00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc698007fd0 tx=0x7fc698007e10 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:54.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.071+0000 7fc69dffb700 1 -- 172.21.15.57:0/2908852335 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fc6a404e870 con 0x7fc6a806b9b0 2023-10-06T03:00:54.248 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.243+0000 7fc6b00f0700 1 -- 172.21.15.57:0/2908852335 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc6a80712e0 con 0x7fc6a806b9b0 2023-10-06T03:00:54.249 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.243+0000 7fc69dffb700 1 -- 172.21.15.57:0/2908852335 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc6a4051e90 con 0x7fc6a806b9b0 2023-10-06T03:00:54.249 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2023-10-06T03:00:54.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.247+0000 7fc6b00f0700 1 -- 172.21.15.57:0/2908852335 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fc68c060550 msgr2=0x7fc68c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:54.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.247+0000 7fc6b00f0700 1 --2- 172.21.15.57:0/2908852335 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fc68c060550 0x7fc68c062a00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc698007fd0 tx=0x7fc698007e10 comp rx=0 tx=0).stop 2023-10-06T03:00:54.255 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.247+0000 7fc6b00f0700 1 -- 172.21.15.57:0/2908852335 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc6a806b9b0 msgr2=0x7fc6a80c26e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:54.255 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.247+0000 7fc6b00f0700 1 --2- 172.21.15.57:0/2908852335 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc6a806b9b0 0x7fc6a80c26e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc6a4009290 tx=0x7fc6a4017000 comp rx=0 tx=0).stop 2023-10-06T03:00:54.255 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.247+0000 7fc6b00f0700 1 -- 172.21.15.57:0/2908852335 shutdown_connections 2023-10-06T03:00:54.255 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.247+0000 7fc6b00f0700 1 --2- 172.21.15.57:0/2908852335 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fc68c060550 0x7fc68c062a00 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:54.255 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.247+0000 7fc6b00f0700 1 --2- 172.21.15.57:0/2908852335 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc6a80bf310 0x7fc6a815df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:54.256 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.247+0000 7fc6b00f0700 1 --2- 172.21.15.57:0/2908852335 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc6a80bef40 0x7fc6a8159430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:54.256 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.247+0000 7fc6b00f0700 1 --2- 172.21.15.57:0/2908852335 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc6a806b9b0 0x7fc6a80c26e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:54.256 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.247+0000 7fc6b00f0700 1 -- 172.21.15.57:0/2908852335 >> 172.21.15.57:0/2908852335 conn(0x7fc6a80c87b0 msgr2=0x7fc6a806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:54.256 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.247+0000 7fc6b00f0700 1 -- 172.21.15.57:0/2908852335 shutdown_connections 2023-10-06T03:00:54.256 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.247+0000 7fc6b00f0700 1 -- 172.21.15.57:0/2908852335 wait complete. 2023-10-06T03:00:54.275 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T03:00:54.440 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.435+0000 7f59692ae700 1 Processor -- start 2023-10-06T03:00:54.440 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.435+0000 7f59692ae700 1 -- start start 2023-10-06T03:00:54.443 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.439+0000 7f59692ae700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f596406c920 0x7f596406de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:54.443 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.439+0000 7f59692ae700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5964147140 0x7f59640ca1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:54.443 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.439+0000 7f59692ae700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5964068c80 con 0x7f5964146d70 2023-10-06T03:00:54.443 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.439+0000 7f59692ae700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f596406cdb0 con 0x7f596406c920 2023-10-06T03:00:54.443 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.439+0000 7f59692ae700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f596406d090 con 0x7f5964147140 2023-10-06T03:00:54.443 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.439+0000 7f5962ffd700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f5964146d70 0x7f5964068570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:36282/0 (socket says 172.21.15.57:36282) 2023-10-06T03:00:54.443 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.439+0000 7f5962ffd700 1 -- 172.21.15.57:0/1268335072 learned_addr learned my addr 172.21.15.57:0/1268335072 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:00:54.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.439+0000 7f59627fc700 1 --2- 172.21.15.57:0/1268335072 >> v2:172.21.15.105:3300/0 conn(0x7f596406c920 0x7f596406de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:54.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.439+0000 7f59637fe700 1 --2- 172.21.15.57:0/1268335072 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5964147140 0x7f59640ca1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:54.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.439+0000 7f5961ffb700 1 -- 172.21.15.57:0/1268335072 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1838119158 0 0) 0x7f5964068c80 con 0x7f5964146d70 2023-10-06T03:00:54.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.439+0000 7f5961ffb700 1 -- 172.21.15.57:0/1268335072 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f594c003570 con 0x7f5964146d70 2023-10-06T03:00:54.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.439+0000 7f59627fc700 1 -- 172.21.15.57:0/1268335072 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5964147140 msgr2=0x7f59640ca1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:54.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.439+0000 7f59627fc700 1 --2- 172.21.15.57:0/1268335072 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5964147140 0x7f59640ca1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:54.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.439+0000 7f59627fc700 1 -- 172.21.15.57:0/1268335072 >> v1:172.21.15.57:6789/0 conn(0x7f5964146d70 legacy=0x7f5964068570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:54.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.439+0000 7f59627fc700 1 -- 172.21.15.57:0/1268335072 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f596406d370 con 0x7f596406c920 2023-10-06T03:00:54.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.439+0000 7f59627fc700 1 --2- 172.21.15.57:0/1268335072 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f596406c920 0x7f596406de50 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f59580098e0 tx=0x7f59580091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=226bf9c03404181b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:54.446 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.439+0000 7f5961ffb700 1 -- 172.21.15.57:0/1268335072 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5958011630 con 0x7f596406c920 2023-10-06T03:00:54.446 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.439+0000 7f5961ffb700 1 -- 172.21.15.57:0/1268335072 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5958011790 con 0x7f596406c920 2023-10-06T03:00:54.446 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.439+0000 7f5961ffb700 1 -- 172.21.15.57:0/1268335072 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5958011b30 con 0x7f596406c920 2023-10-06T03:00:54.447 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.443+0000 7f59692ae700 1 -- 172.21.15.57:0/1268335072 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f596406c920 msgr2=0x7f596406de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:54.447 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.443+0000 7f59692ae700 1 --2- 172.21.15.57:0/1268335072 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f596406c920 0x7f596406de50 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f59580098e0 tx=0x7f59580091a0 comp rx=0 tx=0).stop 2023-10-06T03:00:54.447 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.443+0000 7f59692ae700 1 -- 172.21.15.57:0/1268335072 shutdown_connections 2023-10-06T03:00:54.447 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.443+0000 7f59692ae700 1 --2- 172.21.15.57:0/1268335072 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5964147140 0x7f59640ca1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:54.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.443+0000 7f59692ae700 1 --2- 172.21.15.57:0/1268335072 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f596406c920 0x7f596406de50 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:54.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.443+0000 7f59692ae700 1 -- 172.21.15.57:0/1268335072 >> 172.21.15.57:0/1268335072 conn(0x7f59640c86c0 msgr2=0x7f59640c8ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:54.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.443+0000 7f59692ae700 1 -- 172.21.15.57:0/1268335072 shutdown_connections 2023-10-06T03:00:54.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.443+0000 7f59692ae700 1 -- 172.21.15.57:0/1268335072 wait complete. 2023-10-06T03:00:54.450 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.443+0000 7f59692ae700 1 Processor -- start 2023-10-06T03:00:54.451 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.447+0000 7f59692ae700 1 -- start start 2023-10-06T03:00:54.455 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.447+0000 7f59692ae700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f596406c920 0x7f596415dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:54.455 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.447+0000 7f59692ae700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5964146d70 0x7f596415cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:54.455 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.447+0000 7f59692ae700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5964147140 0x7f59640afa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:54.455 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.447+0000 7f59692ae700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f596415e170 con 0x7f5964147140 2023-10-06T03:00:54.455 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.447+0000 7f59692ae700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5964161500 con 0x7f5964146d70 2023-10-06T03:00:54.455 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.447+0000 7f59692ae700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5964161ac0 con 0x7f596406c920 2023-10-06T03:00:54.455 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.447+0000 7f59637fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5964147140 0x7f59640afa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:54.455 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.447+0000 7f59637fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5964147140 0x7f59640afa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58078/0 (socket says 172.21.15.57:58078) 2023-10-06T03:00:54.456 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.447+0000 7f59637fe700 1 -- 172.21.15.57:0/2043962184 learned_addr learned my addr 172.21.15.57:0/2043962184 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:00:54.456 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.447+0000 7f59627fc700 1 --2- 172.21.15.57:0/2043962184 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5964146d70 0x7f596415cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:54.456 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.447+0000 7f5962ffd700 1 --2- 172.21.15.57:0/2043962184 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f596406c920 0x7f596415dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:54.456 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.447+0000 7f59637fe700 1 -- 172.21.15.57:0/2043962184 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f596406c920 msgr2=0x7f596415dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:54.456 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.447+0000 7f59637fe700 1 --2- 172.21.15.57:0/2043962184 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f596406c920 0x7f596415dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:54.456 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.447+0000 7f59637fe700 1 -- 172.21.15.57:0/2043962184 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5964146d70 msgr2=0x7f596415cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:54.456 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.447+0000 7f59637fe700 1 --2- 172.21.15.57:0/2043962184 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5964146d70 0x7f596415cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:54.456 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.447+0000 7f59637fe700 1 -- 172.21.15.57:0/2043962184 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5958009420 con 0x7f5964147140 2023-10-06T03:00:54.456 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.447+0000 7f59637fe700 1 --2- 172.21.15.57:0/2043962184 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5964147140 0x7f59640afa00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f595c009da0 tx=0x7f595c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:54.456 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.447+0000 7f594affd700 1 -- 172.21.15.57:0/2043962184 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f595c00caa0 con 0x7f5964147140 2023-10-06T03:00:54.456 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.447+0000 7f594affd700 1 -- 172.21.15.57:0/2043962184 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f595c00f040 con 0x7f5964147140 2023-10-06T03:00:54.456 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.447+0000 7f59692ae700 1 -- 172.21.15.57:0/2043962184 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5964160940 con 0x7f5964147140 2023-10-06T03:00:54.457 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.447+0000 7f594affd700 1 -- 172.21.15.57:0/2043962184 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f595c00ce50 con 0x7f5964147140 2023-10-06T03:00:54.457 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.451+0000 7f59692ae700 1 -- 172.21.15.57:0/2043962184 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5964161750 con 0x7f5964147140 2023-10-06T03:00:54.457 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.451+0000 7f59692ae700 1 -- 172.21.15.57:0/2043962184 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f596404be40 con 0x7f5964147140 2023-10-06T03:00:54.457 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.451+0000 7f594affd700 1 -- 172.21.15.57:0/2043962184 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f595c014690 con 0x7f5964147140 2023-10-06T03:00:54.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.455+0000 7f594affd700 1 --2- 172.21.15.57:0/2043962184 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f5950060550 0x7f5950062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:54.459 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.455+0000 7f594affd700 1 -- 172.21.15.57:0/2043962184 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f595c07d0f0 con 0x7f5964147140 2023-10-06T03:00:54.459 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.455+0000 7f5962ffd700 1 --2- 172.21.15.57:0/2043962184 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f5950060550 0x7f5950062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:54.460 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.455+0000 7f5962ffd700 1 --2- 172.21.15.57:0/2043962184 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f5950060550 0x7f5950062a00 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5954007fd0 tx=0x7f5954009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:54.465 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.459+0000 7f594affd700 1 -- 172.21.15.57:0/2043962184 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f595c04d830 con 0x7f5964147140 2023-10-06T03:00:54.633 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.627+0000 7f59692ae700 1 -- 172.21.15.57:0/2043962184 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f596406d650 con 0x7f5964147140 2023-10-06T03:00:54.634 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.627+0000 7f594affd700 1 -- 172.21.15.57:0/2043962184 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v19) v1 ==== 92+0+10 (secure 0 0 0) 0x7f595c050e50 con 0x7f5964147140 2023-10-06T03:00:54.635 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2023-10-06T03:00:54.637 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.631+0000 7f59692ae700 1 -- 172.21.15.57:0/2043962184 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f5950060550 msgr2=0x7f5950062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:54.638 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.631+0000 7f59692ae700 1 --2- 172.21.15.57:0/2043962184 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f5950060550 0x7f5950062a00 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5954007fd0 tx=0x7f5954009040 comp rx=0 tx=0).stop 2023-10-06T03:00:54.638 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.631+0000 7f59692ae700 1 -- 172.21.15.57:0/2043962184 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5964147140 msgr2=0x7f59640afa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:54.638 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.631+0000 7f59692ae700 1 --2- 172.21.15.57:0/2043962184 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5964147140 0x7f59640afa00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f595c009da0 tx=0x7f595c00b040 comp rx=0 tx=0).stop 2023-10-06T03:00:54.638 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.631+0000 7f59692ae700 1 -- 172.21.15.57:0/2043962184 shutdown_connections 2023-10-06T03:00:54.638 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.631+0000 7f59692ae700 1 --2- 172.21.15.57:0/2043962184 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5964147140 0x7f59640afa00 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:54.638 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.631+0000 7f59692ae700 1 --2- 172.21.15.57:0/2043962184 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5964146d70 0x7f596415cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:54.638 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.631+0000 7f59692ae700 1 --2- 172.21.15.57:0/2043962184 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f5950060550 0x7f5950062a00 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:54.638 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.631+0000 7f59692ae700 1 --2- 172.21.15.57:0/2043962184 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f596406c920 0x7f596415dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:54.638 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.631+0000 7f59692ae700 1 -- 172.21.15.57:0/2043962184 >> 172.21.15.57:0/2043962184 conn(0x7f59640c86c0 msgr2=0x7f59640c9800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:54.638 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.631+0000 7f59692ae700 1 -- 172.21.15.57:0/2043962184 shutdown_connections 2023-10-06T03:00:54.638 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.631+0000 7f59692ae700 1 -- 172.21.15.57:0/2043962184 wait complete. 2023-10-06T03:00:54.658 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-06T03:00:54.820 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.815+0000 7ff099d85700 1 Processor -- start 2023-10-06T03:00:54.820 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.815+0000 7ff099d85700 1 -- start start 2023-10-06T03:00:54.822 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.815+0000 7ff099d85700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7ff0940671f0 0x7ff0940675c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:54.822 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.815+0000 7ff099d85700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff09406dc70 0x7ff09414fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:54.823 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.819+0000 7ff099d85700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff09406d7e0 con 0x7ff094150180 2023-10-06T03:00:54.823 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.819+0000 7ff099d85700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff094150600 con 0x7ff0940671f0 2023-10-06T03:00:54.823 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.819+0000 7ff099d85700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff09415dc00 con 0x7ff09406dc70 2023-10-06T03:00:54.823 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.819+0000 7ff093fff700 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7ff094150180 0x7ff09415ce90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.57:41182/0 (socket says 172.21.15.57:41182) 2023-10-06T03:00:54.824 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.819+0000 7ff093fff700 1 -- 172.21.15.57:0/1884741243 learned_addr learned my addr 172.21.15.57:0/1884741243 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:00:54.824 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.819+0000 7ff0937fe700 1 --2- 172.21.15.57:0/1884741243 >> v2:172.21.15.105:3300/0 conn(0x7ff0940671f0 0x7ff0940675c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:54.824 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.819+0000 7ff092ffd700 1 --2- 172.21.15.57:0/1884741243 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff09406dc70 0x7ff09414fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:54.825 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.819+0000 7ff0927fc700 1 -- 172.21.15.57:0/1884741243 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4226825264 0 0) 0x7ff09406d7e0 con 0x7ff094150180 2023-10-06T03:00:54.825 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.819+0000 7ff0927fc700 1 -- 172.21.15.57:0/1884741243 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff07c003570 con 0x7ff094150180 2023-10-06T03:00:54.825 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.819+0000 7ff0937fe700 1 -- 172.21.15.57:0/1884741243 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff09406dc70 msgr2=0x7ff09414fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:54.825 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.819+0000 7ff0937fe700 1 --2- 172.21.15.57:0/1884741243 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff09406dc70 0x7ff09414fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:54.825 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.819+0000 7ff0937fe700 1 -- 172.21.15.57:0/1884741243 >> v1:172.21.15.105:6789/0 conn(0x7ff094150180 legacy=0x7ff09415ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:54.825 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.819+0000 7ff0937fe700 1 -- 172.21.15.57:0/1884741243 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff09406ceb0 con 0x7ff0940671f0 2023-10-06T03:00:54.825 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.819+0000 7ff092ffd700 1 --2- 172.21.15.57:0/1884741243 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff09406dc70 0x7ff09414fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:00:54.825 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.819+0000 7ff0937fe700 1 --2- 172.21.15.57:0/1884741243 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff0940671f0 0x7ff0940675c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff0840098e0 tx=0x7ff0840091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2526d7751d7bd03a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:54.826 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.819+0000 7ff0927fc700 1 -- 172.21.15.57:0/1884741243 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff084011630 con 0x7ff0940671f0 2023-10-06T03:00:54.826 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.819+0000 7ff0927fc700 1 -- 172.21.15.57:0/1884741243 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff084011790 con 0x7ff0940671f0 2023-10-06T03:00:54.826 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.819+0000 7ff0927fc700 1 -- 172.21.15.57:0/1884741243 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff084011b30 con 0x7ff0940671f0 2023-10-06T03:00:54.827 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.823+0000 7ff099d85700 1 -- 172.21.15.57:0/1884741243 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff0940671f0 msgr2=0x7ff0940675c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:54.827 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.823+0000 7ff099d85700 1 --2- 172.21.15.57:0/1884741243 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff0940671f0 0x7ff0940675c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff0840098e0 tx=0x7ff0840091a0 comp rx=0 tx=0).stop 2023-10-06T03:00:54.827 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.823+0000 7ff099d85700 1 -- 172.21.15.57:0/1884741243 shutdown_connections 2023-10-06T03:00:54.828 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.823+0000 7ff099d85700 1 --2- 172.21.15.57:0/1884741243 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff09406dc70 0x7ff09414fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:54.828 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.823+0000 7ff099d85700 1 --2- 172.21.15.57:0/1884741243 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff0940671f0 0x7ff0940675c0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:54.828 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.823+0000 7ff099d85700 1 -- 172.21.15.57:0/1884741243 >> 172.21.15.57:0/1884741243 conn(0x7ff0940cbdd0 msgr2=0x7ff0940cc1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:54.828 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.823+0000 7ff099d85700 1 -- 172.21.15.57:0/1884741243 shutdown_connections 2023-10-06T03:00:54.828 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.823+0000 7ff099d85700 1 -- 172.21.15.57:0/1884741243 wait complete. 2023-10-06T03:00:54.830 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.823+0000 7ff099d85700 1 Processor -- start 2023-10-06T03:00:54.830 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.823+0000 7ff099d85700 1 -- start start 2023-10-06T03:00:54.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.827+0000 7ff099d85700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff0940671f0 0x7ff09414c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:54.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.827+0000 7ff099d85700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff09406dc70 0x7ff09414a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:54.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.827+0000 7ff099d85700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff094150180 0x7ff094169af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:54.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.827+0000 7ff099d85700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff09414a260 con 0x7ff0940671f0 2023-10-06T03:00:54.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.827+0000 7ff099d85700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff09416a3f0 con 0x7ff09406dc70 2023-10-06T03:00:54.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.827+0000 7ff099d85700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff09416a6d0 con 0x7ff094150180 2023-10-06T03:00:54.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.827+0000 7ff0937fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff0940671f0 0x7ff09414c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:54.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.827+0000 7ff0937fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff0940671f0 0x7ff09414c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44860/0 (socket says 172.21.15.57:44860) 2023-10-06T03:00:54.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.827+0000 7ff0937fe700 1 -- 172.21.15.57:0/1797878855 learned_addr learned my addr 172.21.15.57:0/1797878855 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:00:54.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.827+0000 7ff092ffd700 1 --2- 172.21.15.57:0/1797878855 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff09406dc70 0x7ff09414a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:54.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.827+0000 7ff093fff700 1 --2- 172.21.15.57:0/1797878855 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff094150180 0x7ff094169af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:54.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.827+0000 7ff0937fe700 1 -- 172.21.15.57:0/1797878855 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff094150180 msgr2=0x7ff094169af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:54.834 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.827+0000 7ff0937fe700 1 --2- 172.21.15.57:0/1797878855 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff094150180 0x7ff094169af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:54.834 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.827+0000 7ff0937fe700 1 -- 172.21.15.57:0/1797878855 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff09406dc70 msgr2=0x7ff09414a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:54.834 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.827+0000 7ff0937fe700 1 --2- 172.21.15.57:0/1797878855 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff09406dc70 0x7ff09414a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:54.834 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.827+0000 7ff0937fe700 1 -- 172.21.15.57:0/1797878855 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff088009420 con 0x7ff0940671f0 2023-10-06T03:00:54.834 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.827+0000 7ff093fff700 1 --2- 172.21.15.57:0/1797878855 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff094150180 0x7ff094169af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:00:54.834 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.827+0000 7ff0937fe700 1 --2- 172.21.15.57:0/1797878855 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff0940671f0 0x7ff09414c6f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff0940ccab0 tx=0x7ff084017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:54.835 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.827+0000 7ff07b7fe700 1 -- 172.21.15.57:0/1797878855 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff084011b10 con 0x7ff0940671f0 2023-10-06T03:00:54.835 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.827+0000 7ff07b7fe700 1 -- 172.21.15.57:0/1797878855 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0840253f0 con 0x7ff0940671f0 2023-10-06T03:00:54.835 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.827+0000 7ff099d85700 1 -- 172.21.15.57:0/1797878855 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff084009420 con 0x7ff0940671f0 2023-10-06T03:00:54.835 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.827+0000 7ff07b7fe700 1 -- 172.21.15.57:0/1797878855 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0840257b0 con 0x7ff0940671f0 2023-10-06T03:00:54.835 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.827+0000 7ff099d85700 1 -- 172.21.15.57:0/1797878855 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff094149e80 con 0x7ff0940671f0 2023-10-06T03:00:54.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.831+0000 7ff099d85700 1 -- 172.21.15.57:0/1797878855 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0940712e0 con 0x7ff0940671f0 2023-10-06T03:00:54.838 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.831+0000 7ff07b7fe700 1 -- 172.21.15.57:0/1797878855 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7ff084025ba0 con 0x7ff0940671f0 2023-10-06T03:00:54.839 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.835+0000 7ff07b7fe700 1 --2- 172.21.15.57:0/1797878855 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7ff080060550 0x7ff080062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:54.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.835+0000 7ff07b7fe700 1 -- 172.21.15.57:0/1797878855 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5206+0+0 (secure 0 0 0) 0x7ff08407dfa0 con 0x7ff0940671f0 2023-10-06T03:00:54.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.835+0000 7ff092ffd700 1 --2- 172.21.15.57:0/1797878855 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7ff080060550 0x7ff080062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:54.841 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.835+0000 7ff092ffd700 1 --2- 172.21.15.57:0/1797878855 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7ff080060550 0x7ff080062a00 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff0880093f0 tx=0x7ff088008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:54.845 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:54.839+0000 7ff07b7fe700 1 -- 172.21.15.57:0/1797878855 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7ff08404e6e0 con 0x7ff0940671f0 2023-10-06T03:00:55.022 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:55.015+0000 7ff099d85700 1 -- 172.21.15.57:0/1797878855 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7ff09406d190 con 0x7ff0940671f0 2023-10-06T03:00:55.023 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:55.019+0000 7ff07b7fe700 1 -- 172.21.15.57:0/1797878855 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v19) v1 ==== 84+0+126 (secure 0 0 0) 0x7ff084015090 con 0x7ff0940671f0 2023-10-06T03:00:55.024 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:00:55.024 INFO:teuthology.orchestra.run.smithi057.stdout:[ 2023-10-06T03:00:55.024 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-10-06T03:00:55.024 INFO:teuthology.orchestra.run.smithi057.stdout: "poolnum": 1, 2023-10-06T03:00:55.024 INFO:teuthology.orchestra.run.smithi057.stdout: "poolname": ".mgr" 2023-10-06T03:00:55.024 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-06T03:00:55.024 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-10-06T03:00:55.024 INFO:teuthology.orchestra.run.smithi057.stdout: "poolnum": 2, 2023-10-06T03:00:55.024 INFO:teuthology.orchestra.run.smithi057.stdout: "poolname": "rbd" 2023-10-06T03:00:55.024 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-10-06T03:00:55.025 INFO:teuthology.orchestra.run.smithi057.stdout:] 2023-10-06T03:00:55.028 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:55.023+0000 7ff099d85700 1 -- 172.21.15.57:0/1797878855 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7ff080060550 msgr2=0x7ff080062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:55.028 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:55.023+0000 7ff099d85700 1 --2- 172.21.15.57:0/1797878855 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7ff080060550 0x7ff080062a00 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff0880093f0 tx=0x7ff088008040 comp rx=0 tx=0).stop 2023-10-06T03:00:55.028 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:55.023+0000 7ff099d85700 1 -- 172.21.15.57:0/1797878855 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff0940671f0 msgr2=0x7ff09414c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:55.029 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:55.023+0000 7ff099d85700 1 --2- 172.21.15.57:0/1797878855 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff0940671f0 0x7ff09414c6f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff0940ccab0 tx=0x7ff084017000 comp rx=0 tx=0).stop 2023-10-06T03:00:55.029 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:55.023+0000 7ff099d85700 1 -- 172.21.15.57:0/1797878855 shutdown_connections 2023-10-06T03:00:55.029 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:55.023+0000 7ff099d85700 1 --2- 172.21.15.57:0/1797878855 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7ff080060550 0x7ff080062a00 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:55.029 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:55.023+0000 7ff099d85700 1 --2- 172.21.15.57:0/1797878855 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff094150180 0x7ff094169af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:55.029 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:55.023+0000 7ff099d85700 1 --2- 172.21.15.57:0/1797878855 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff09406dc70 0x7ff09414a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:55.029 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:55.023+0000 7ff099d85700 1 --2- 172.21.15.57:0/1797878855 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff0940671f0 0x7ff09414c6f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:55.029 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:55.023+0000 7ff099d85700 1 -- 172.21.15.57:0/1797878855 >> 172.21.15.57:0/1797878855 conn(0x7ff0940cbdd0 msgr2=0x7ff0940b16f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:55.029 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:55.023+0000 7ff099d85700 1 -- 172.21.15.57:0/1797878855 shutdown_connections 2023-10-06T03:00:55.029 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:55.023+0000 7ff099d85700 1 -- 172.21.15.57:0/1797878855 wait complete. 2023-10-06T03:00:55.049 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-06T03:00:55.049 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-06T03:00:55.219 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:55.215+0000 7f4265f85700 1 Processor -- start 2023-10-06T03:00:55.219 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:55.215+0000 7f4265f85700 1 -- start start 2023-10-06T03:00:55.223 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:55.219+0000 7f4265f85700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4260067280 0x7f4260067650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:55.223 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:55.219+0000 7f4265f85700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f4260158ae0 0x7f4260158f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:55.223 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:55.219+0000 7f4265f85700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42600cb540 con 0x7f42600cb0f0 2023-10-06T03:00:55.223 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:55.219+0000 7f4265f85700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42600cecd0 con 0x7f4260067280 2023-10-06T03:00:55.223 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:55.219+0000 7f4265f85700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42600cb7b0 con 0x7f4260158ae0 2023-10-06T03:00:55.224 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:55.219+0000 7f425effd700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f42600cb0f0 0x7f426006d680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:43252/0 (socket says 172.21.15.57:43252) 2023-10-06T03:00:55.224 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:55.219+0000 7f425effd700 1 -- 172.21.15.57:0/62905610 learned_addr learned my addr 172.21.15.57:0/62905610 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:00:55.224 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:55.219+0000 7f425f7fe700 1 --2- 172.21.15.57:0/62905610 >> v2:172.21.15.57:3300/0 conn(0x7f4260067280 0x7f4260067650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:55.225 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:55.219+0000 7f425ffff700 1 --2- 172.21.15.57:0/62905610 >> v2:172.21.15.105:3300/0 conn(0x7f4260158ae0 0x7f4260158f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:55.225 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:55.219+0000 7f425e7fc700 1 -- 172.21.15.57:0/62905610 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3917322667 0 0) 0x7f42600cb540 con 0x7f42600cb0f0 2023-10-06T03:00:55.225 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:55.219+0000 7f425e7fc700 1 -- 172.21.15.57:0/62905610 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4248003570 con 0x7f42600cb0f0 2023-10-06T03:00:55.225 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:55.219+0000 7f425f7fe700 1 -- 172.21.15.57:0/62905610 >> v2:172.21.15.105:3300/0 conn(0x7f4260158ae0 msgr2=0x7f4260158f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:55.225 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:55.219+0000 7f425f7fe700 1 --2- 172.21.15.57:0/62905610 >> v2:172.21.15.105:3300/0 conn(0x7f4260158ae0 0x7f4260158f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:55.225 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:55.219+0000 7f425f7fe700 1 -- 172.21.15.57:0/62905610 >> v1:172.21.15.57:6789/0 conn(0x7f42600cb0f0 legacy=0x7f426006d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:55.225 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:55.219+0000 7f425f7fe700 1 -- 172.21.15.57:0/62905610 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42600cba90 con 0x7f4260067280 2023-10-06T03:00:55.226 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:55.219+0000 7f425f7fe700 1 --2- 172.21.15.57:0/62905610 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4260067280 0x7f4260067650 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f426006dd90 tx=0x7f42500091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90ee8bab766f8248 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:55.226 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:55.219+0000 7f425e7fc700 1 -- 172.21.15.57:0/62905610 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4250011630 con 0x7f4260067280 2023-10-06T03:00:55.226 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:55.219+0000 7f425e7fc700 1 -- 172.21.15.57:0/62905610 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42500117b0 con 0x7f4260067280 2023-10-06T03:00:55.226 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:55.219+0000 7f425e7fc700 1 -- 172.21.15.57:0/62905610 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4250011b70 con 0x7f4260067280 2023-10-06T03:00:55.227 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:55.223+0000 7f4265f85700 1 -- 172.21.15.57:0/62905610 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4260067280 msgr2=0x7f4260067650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:55.227 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:55.223+0000 7f4265f85700 1 --2- 172.21.15.57:0/62905610 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4260067280 0x7f4260067650 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f426006dd90 tx=0x7f42500091a0 comp rx=0 tx=0).stop 2023-10-06T03:00:55.227 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:55.223+0000 7f4265f85700 1 -- 172.21.15.57:0/62905610 shutdown_connections 2023-10-06T03:00:55.227 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:55.223+0000 7f4265f85700 1 --2- 172.21.15.57:0/62905610 >> v2:172.21.15.105:3300/0 conn(0x7f4260158ae0 0x7f4260158f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:55.227 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:55.223+0000 7f4265f85700 1 --2- 172.21.15.57:0/62905610 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4260067280 0x7f4260067650 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:55.227 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:55.223+0000 7f4265f85700 1 -- 172.21.15.57:0/62905610 >> 172.21.15.57:0/62905610 conn(0x7f42600d0bc0 msgr2=0x7f42600ccb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:55.228 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:55.223+0000 7f4265f85700 1 -- 172.21.15.57:0/62905610 shutdown_connections 2023-10-06T03:00:55.228 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:55.223+0000 7f4265f85700 1 -- 172.21.15.57:0/62905610 wait complete. 2023-10-06T03:00:55.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:55.223+0000 7f4265f85700 1 Processor -- start 2023-10-06T03:00:55.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:55.223+0000 7f4265f85700 1 -- start start 2023-10-06T03:00:55.232 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:55.227+0000 7f4265f85700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4260067280 0x7f42600afa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:55.232 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:55.227+0000 7f4265f85700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f42600cb0f0 0x7f4260143a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:55.232 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:55.227+0000 7f4265f85700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4260158ae0 0x7f42600b4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:55.232 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:55.227+0000 7f4265f85700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42600aff90 con 0x7f4260158ae0 2023-10-06T03:00:55.232 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:55.227+0000 7f4265f85700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42600c7f30 con 0x7f42600cb0f0 2023-10-06T03:00:55.232 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:55.227+0000 7f4265f85700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42600c7320 con 0x7f4260067280 2023-10-06T03:00:55.233 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:55.227+0000 7f425ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4260158ae0 0x7f42600b4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:55.234 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:55.227+0000 7f425ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4260158ae0 0x7f42600b4ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44864/0 (socket says 172.21.15.57:44864) 2023-10-06T03:00:55.234 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:55.227+0000 7f425ffff700 1 -- 172.21.15.57:0/4056716695 learned_addr learned my addr 172.21.15.57:0/4056716695 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:00:55.234 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:55.227+0000 7f425f7fe700 1 --2- 172.21.15.57:0/4056716695 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4260067280 0x7f42600afa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:55.234 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:55.227+0000 7f425effd700 1 --2- 172.21.15.57:0/4056716695 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f42600cb0f0 0x7f4260143a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:55.234 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:55.227+0000 7f425ffff700 1 -- 172.21.15.57:0/4056716695 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4260067280 msgr2=0x7f42600afa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:55.234 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:55.227+0000 7f425ffff700 1 --2- 172.21.15.57:0/4056716695 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4260067280 0x7f42600afa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:55.234 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:55.227+0000 7f425ffff700 1 -- 172.21.15.57:0/4056716695 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f42600cb0f0 msgr2=0x7f4260143a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:55.234 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:55.227+0000 7f425ffff700 1 --2- 172.21.15.57:0/4056716695 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f42600cb0f0 0x7f4260143a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:55.234 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:55.227+0000 7f425ffff700 1 -- 172.21.15.57:0/4056716695 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4250009420 con 0x7f4260158ae0 2023-10-06T03:00:55.235 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:55.227+0000 7f425ffff700 1 --2- 172.21.15.57:0/4056716695 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4260158ae0 0x7f42600b4ab0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4258009df0 tx=0x7f425800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:55.235 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:55.231+0000 7f42477fe700 1 -- 172.21.15.57:0/4056716695 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f425800caa0 con 0x7f4260158ae0 2023-10-06T03:00:55.235 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:55.231+0000 7f42477fe700 1 -- 172.21.15.57:0/4056716695 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f425800f040 con 0x7f4260158ae0 2023-10-06T03:00:55.236 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:55.231+0000 7f4265f85700 1 -- 172.21.15.57:0/4056716695 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42600c7600 con 0x7f4260158ae0 2023-10-06T03:00:55.236 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:55.231+0000 7f42477fe700 1 -- 172.21.15.57:0/4056716695 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f425800ce70 con 0x7f4260158ae0 2023-10-06T03:00:55.236 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:55.231+0000 7f4265f85700 1 -- 172.21.15.57:0/4056716695 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42600c7bc0 con 0x7f4260158ae0 2023-10-06T03:00:55.237 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:55.231+0000 7f4265f85700 1 -- 172.21.15.57:0/4056716695 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42600c80c0 con 0x7f4260158ae0 2023-10-06T03:00:55.238 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:55.231+0000 7f42477fe700 1 -- 172.21.15.57:0/4056716695 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f4258014690 con 0x7f4260158ae0 2023-10-06T03:00:55.240 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:55.235+0000 7f42477fe700 1 --2- 172.21.15.57:0/4056716695 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f424c060550 0x7f424c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:55.240 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:55.235+0000 7f42477fe700 1 -- 172.21.15.57:0/4056716695 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f425807d1a0 con 0x7f4260158ae0 2023-10-06T03:00:55.240 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:55.235+0000 7f425f7fe700 1 --2- 172.21.15.57:0/4056716695 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f424c060550 0x7f424c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:55.241 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:55.235+0000 7f425f7fe700 1 --2- 172.21.15.57:0/4056716695 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f424c060550 0x7f424c062a00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f426006dd90 tx=0x7f4250017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:55.244 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:55.239+0000 7f42477fe700 1 -- 172.21.15.57:0/4056716695 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f4258051370 con 0x7f4260158ae0 2023-10-06T03:00:55.415 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:55.411+0000 7f4265f85700 1 -- 172.21.15.57:0/4056716695 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f42600712e0 con 0x7f4260158ae0 2023-10-06T03:00:55.941 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:55.935+0000 7f42477fe700 1 -- 172.21.15.57:0/4056716695 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v20) v1 ==== 138+0+0 (secure 0 0 0) 0x7f4258050f00 con 0x7f4260158ae0 2023-10-06T03:00:55.947 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:55.943+0000 7f4265f85700 1 -- 172.21.15.57:0/4056716695 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f424c060550 msgr2=0x7f424c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:55.947 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:55.943+0000 7f4265f85700 1 --2- 172.21.15.57:0/4056716695 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f424c060550 0x7f424c062a00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f426006dd90 tx=0x7f4250017000 comp rx=0 tx=0).stop 2023-10-06T03:00:55.948 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:55.943+0000 7f4265f85700 1 -- 172.21.15.57:0/4056716695 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4260158ae0 msgr2=0x7f42600b4ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:55.948 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:55.943+0000 7f4265f85700 1 --2- 172.21.15.57:0/4056716695 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4260158ae0 0x7f42600b4ab0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4258009df0 tx=0x7f425800b040 comp rx=0 tx=0).stop 2023-10-06T03:00:55.948 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:55.943+0000 7f4265f85700 1 -- 172.21.15.57:0/4056716695 shutdown_connections 2023-10-06T03:00:55.948 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:55.943+0000 7f4265f85700 1 --2- 172.21.15.57:0/4056716695 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4260158ae0 0x7f42600b4ab0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:55.948 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:55.943+0000 7f4265f85700 1 --2- 172.21.15.57:0/4056716695 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f42600cb0f0 0x7f4260143a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:55.948 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:55.943+0000 7f4265f85700 1 --2- 172.21.15.57:0/4056716695 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f424c060550 0x7f424c062a00 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:55.949 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:55.943+0000 7f4265f85700 1 --2- 172.21.15.57:0/4056716695 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4260067280 0x7f42600afa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:55.949 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:55.943+0000 7f4265f85700 1 -- 172.21.15.57:0/4056716695 >> 172.21.15.57:0/4056716695 conn(0x7f42600d0bc0 msgr2=0x7f4260154e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:55.949 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:55.943+0000 7f4265f85700 1 -- 172.21.15.57:0/4056716695 shutdown_connections 2023-10-06T03:00:55.950 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:55.943+0000 7f4265f85700 1 -- 172.21.15.57:0/4056716695 wait complete. 2023-10-06T03:00:55.954 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_metadata' created 2023-10-06T03:00:55.972 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-06T03:00:56.139 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:56.135+0000 7f048ff45700 1 Processor -- start 2023-10-06T03:00:56.140 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:56.135+0000 7f048ff45700 1 -- start start 2023-10-06T03:00:56.142 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:56.135+0000 7f048ff45700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f04880bef40 0x7f04880c6a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:56.142 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:56.135+0000 7f048ff45700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f04880bf310 0x7f04880c6f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:56.142 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:56.135+0000 7f048ff45700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f048806b2a0 0x7f048806b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:56.142 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:56.135+0000 7f048ff45700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f048806dc60 con 0x7f04880bef40 2023-10-06T03:00:56.142 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:56.135+0000 7f048ff45700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04880ac530 con 0x7f04880bf310 2023-10-06T03:00:56.142 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:56.135+0000 7f048ff45700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f048806bc60 con 0x7f048806b2a0 2023-10-06T03:00:56.143 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:56.135+0000 7f048dce1700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f04880bef40 0x7f04880c6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:56.143 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:56.135+0000 7f048dce1700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f04880bef40 0x7f04880c6a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44872/0 (socket says 172.21.15.57:44872) 2023-10-06T03:00:56.143 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:56.135+0000 7f048dce1700 1 -- 172.21.15.57:0/195573410 learned_addr learned my addr 172.21.15.57:0/195573410 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:00:56.144 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:56.139+0000 7f048e4e2700 1 --2- 172.21.15.57:0/195573410 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f048806b2a0 0x7f048806b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:56.144 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:56.139+0000 7f048d4e0700 1 --2- 172.21.15.57:0/195573410 >> v2:172.21.15.105:3300/0 conn(0x7f04880bf310 0x7f04880c6f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:56.144 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:56.139+0000 7f048dce1700 1 -- 172.21.15.57:0/195573410 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f048806b2a0 msgr2=0x7f048806b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:56.144 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:56.139+0000 7f048dce1700 1 --2- 172.21.15.57:0/195573410 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f048806b2a0 0x7f048806b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:56.145 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:56.139+0000 7f048dce1700 1 -- 172.21.15.57:0/195573410 >> v2:172.21.15.105:3300/0 conn(0x7f04880bf310 msgr2=0x7f04880c6f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:56.145 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:56.139+0000 7f048dce1700 1 --2- 172.21.15.57:0/195573410 >> v2:172.21.15.105:3300/0 conn(0x7f04880bf310 0x7f04880c6f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:56.145 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:56.139+0000 7f048dce1700 1 -- 172.21.15.57:0/195573410 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f048806bed0 con 0x7f04880bef40 2023-10-06T03:00:56.145 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:56.139+0000 7f048dce1700 1 --2- 172.21.15.57:0/195573410 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f04880bef40 0x7f04880c6a50 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f048806e330 tx=0x7f0484009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dca44107d4d74a9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:56.145 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:56.139+0000 7f048ccdf700 1 -- 172.21.15.57:0/195573410 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f048400b8f0 con 0x7f04880bef40 2023-10-06T03:00:56.145 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:56.139+0000 7f048ccdf700 1 -- 172.21.15.57:0/195573410 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f048400ba50 con 0x7f04880bef40 2023-10-06T03:00:56.145 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:56.139+0000 7f048ccdf700 1 -- 172.21.15.57:0/195573410 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f048400bdf0 con 0x7f04880bef40 2023-10-06T03:00:56.146 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:56.139+0000 7f048ff45700 1 -- 172.21.15.57:0/195573410 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f04880bef40 msgr2=0x7f04880c6a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:56.146 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:56.139+0000 7f048ff45700 1 --2- 172.21.15.57:0/195573410 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f04880bef40 0x7f04880c6a50 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f048806e330 tx=0x7f0484009250 comp rx=0 tx=0).stop 2023-10-06T03:00:56.147 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:56.139+0000 7f048ff45700 1 -- 172.21.15.57:0/195573410 shutdown_connections 2023-10-06T03:00:56.147 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:56.139+0000 7f048ff45700 1 --2- 172.21.15.57:0/195573410 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f048806b2a0 0x7f048806b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:56.147 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:56.139+0000 7f048ff45700 1 --2- 172.21.15.57:0/195573410 >> v2:172.21.15.105:3300/0 conn(0x7f04880bf310 0x7f04880c6f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:56.147 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:56.139+0000 7f048ff45700 1 --2- 172.21.15.57:0/195573410 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f04880bef40 0x7f04880c6a50 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:56.147 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:56.139+0000 7f048ff45700 1 -- 172.21.15.57:0/195573410 >> 172.21.15.57:0/195573410 conn(0x7f04880c87b0 msgr2=0x7f04880c8bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:56.147 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:56.139+0000 7f048ff45700 1 -- 172.21.15.57:0/195573410 shutdown_connections 2023-10-06T03:00:56.147 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:56.139+0000 7f048ff45700 1 -- 172.21.15.57:0/195573410 wait complete. 2023-10-06T03:00:56.149 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:56.143+0000 7f048ff45700 1 Processor -- start 2023-10-06T03:00:56.149 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:56.143+0000 7f048ff45700 1 -- start start 2023-10-06T03:00:56.151 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:56.147+0000 7f048ff45700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f048806b2a0 0x7f04881573a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:56.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:56.147+0000 7f048ff45700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f04880bef40 0x7f04880c1180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:56.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:56.147+0000 7f048ff45700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f04880bf310 0x7f048815f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:56.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:56.147+0000 7f048ff45700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04881578e0 con 0x7f04880bef40 2023-10-06T03:00:56.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:56.147+0000 7f048ff45700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04880c2810 con 0x7f048806b2a0 2023-10-06T03:00:56.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:56.147+0000 7f048ff45700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04880c1c00 con 0x7f04880bf310 2023-10-06T03:00:56.154 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:56.147+0000 7f048d4e0700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f04880bef40 0x7f04880c1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:56.154 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:56.147+0000 7f048d4e0700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f04880bef40 0x7f04880c1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44882/0 (socket says 172.21.15.57:44882) 2023-10-06T03:00:56.154 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:56.147+0000 7f048d4e0700 1 -- 172.21.15.57:0/1498524232 learned_addr learned my addr 172.21.15.57:0/1498524232 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:00:56.154 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:56.147+0000 7f048e4e2700 1 --2- 172.21.15.57:0/1498524232 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f04880bf310 0x7f048815f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:56.154 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:56.147+0000 7f048dce1700 1 --2- 172.21.15.57:0/1498524232 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f048806b2a0 0x7f04881573a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:56.155 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:56.147+0000 7f048d4e0700 1 -- 172.21.15.57:0/1498524232 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f04880bf310 msgr2=0x7f048815f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:56.155 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:56.147+0000 7f048d4e0700 1 --2- 172.21.15.57:0/1498524232 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f04880bf310 0x7f048815f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:56.155 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:56.147+0000 7f048d4e0700 1 -- 172.21.15.57:0/1498524232 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f048806b2a0 msgr2=0x7f04881573a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:56.155 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:56.147+0000 7f048d4e0700 1 --2- 172.21.15.57:0/1498524232 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f048806b2a0 0x7f04881573a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:56.155 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:56.147+0000 7f048d4e0700 1 -- 172.21.15.57:0/1498524232 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04840094f0 con 0x7f04880bef40 2023-10-06T03:00:56.155 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:56.147+0000 7f048e4e2700 1 --2- 172.21.15.57:0/1498524232 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f04880bf310 0x7f048815f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:00:56.155 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:56.147+0000 7f048dce1700 1 --2- 172.21.15.57:0/1498524232 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f048806b2a0 0x7f04881573a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:00:56.155 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:56.147+0000 7f048d4e0700 1 --2- 172.21.15.57:0/1498524232 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f04880bef40 0x7f04880c1180 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f047800d860 tx=0x7f0478008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:56.155 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:56.147+0000 7f047dffb700 1 -- 172.21.15.57:0/1498524232 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0478012630 con 0x7f04880bef40 2023-10-06T03:00:56.155 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:56.147+0000 7f047dffb700 1 -- 172.21.15.57:0/1498524232 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0478012790 con 0x7f04880bef40 2023-10-06T03:00:56.155 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:56.147+0000 7f048ff45700 1 -- 172.21.15.57:0/1498524232 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04880c1ee0 con 0x7f04880bef40 2023-10-06T03:00:56.156 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:56.147+0000 7f047dffb700 1 -- 172.21.15.57:0/1498524232 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0478012b50 con 0x7f04880bef40 2023-10-06T03:00:56.156 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:56.147+0000 7f048ff45700 1 -- 172.21.15.57:0/1498524232 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04880c24a0 con 0x7f04880bef40 2023-10-06T03:00:56.156 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:56.151+0000 7f048ff45700 1 -- 172.21.15.57:0/1498524232 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04880c29c0 con 0x7f04880bef40 2023-10-06T03:00:56.157 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:56.151+0000 7f047dffb700 1 -- 172.21.15.57:0/1498524232 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f047801d400 con 0x7f04880bef40 2023-10-06T03:00:56.160 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:56.155+0000 7f047dffb700 1 --2- 172.21.15.57:0/1498524232 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f046c060550 0x7f046c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:56.161 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:56.155+0000 7f047dffb700 1 -- 172.21.15.57:0/1498524232 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5576+0+0 (secure 0 0 0) 0x7f047807cc10 con 0x7f04880bef40 2023-10-06T03:00:56.161 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:56.155+0000 7f048dce1700 1 --2- 172.21.15.57:0/1498524232 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f046c060550 0x7f046c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:56.162 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:56.155+0000 7f048dce1700 1 --2- 172.21.15.57:0/1498524232 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f046c060550 0x7f046c062a00 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f048806e330 tx=0x7f0484017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:56.169 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:56.163+0000 7f047dffb700 1 -- 172.21.15.57:0/1498524232 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f04880c29c0 con 0x7f04880bef40 2023-10-06T03:00:56.344 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:56.339+0000 7f048ff45700 1 -- 172.21.15.57:0/1498524232 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f04880712e0 con 0x7f04880bef40 2023-10-06T03:00:56.960 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:56.955+0000 7f047dffb700 1 -- 172.21.15.57:0/1498524232 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v21) v1 ==== 170+0+0 (secure 0 0 0) 0x7f047804d1e0 con 0x7f04880bef40 2023-10-06T03:00:56.967 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:56.963+0000 7f048ff45700 1 -- 172.21.15.57:0/1498524232 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f046c060550 msgr2=0x7f046c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:56.967 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:56.963+0000 7f048ff45700 1 --2- 172.21.15.57:0/1498524232 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f046c060550 0x7f046c062a00 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f048806e330 tx=0x7f0484017000 comp rx=0 tx=0).stop 2023-10-06T03:00:56.967 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:56.963+0000 7f048ff45700 1 -- 172.21.15.57:0/1498524232 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f04880bef40 msgr2=0x7f04880c1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:56.967 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:56.963+0000 7f048ff45700 1 --2- 172.21.15.57:0/1498524232 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f04880bef40 0x7f04880c1180 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f047800d860 tx=0x7f0478008040 comp rx=0 tx=0).stop 2023-10-06T03:00:56.972 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:56.967+0000 7f048ff45700 1 -- 172.21.15.57:0/1498524232 shutdown_connections 2023-10-06T03:00:56.972 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:56.967+0000 7f048ff45700 1 --2- 172.21.15.57:0/1498524232 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f046c060550 0x7f046c062a00 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:56.973 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:56.967+0000 7f048ff45700 1 --2- 172.21.15.57:0/1498524232 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f04880bf310 0x7f048815f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:56.973 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:56.967+0000 7f048ff45700 1 --2- 172.21.15.57:0/1498524232 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f04880bef40 0x7f04880c1180 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:56.973 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:56.967+0000 7f048ff45700 1 --2- 172.21.15.57:0/1498524232 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f048806b2a0 0x7f04881573a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:56.973 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:56.967+0000 7f048ff45700 1 -- 172.21.15.57:0/1498524232 >> 172.21.15.57:0/1498524232 conn(0x7f04880c87b0 msgr2=0x7f0488067050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:56.974 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:56.967+0000 7f048ff45700 1 -- 172.21.15.57:0/1498524232 shutdown_connections 2023-10-06T03:00:56.974 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:56.967+0000 7f048ff45700 1 -- 172.21.15.57:0/1498524232 wait complete. 2023-10-06T03:00:56.982 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_data' created 2023-10-06T03:00:57.003 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-06T03:00:57.177 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:57.171+0000 7fcaa24ae700 1 Processor -- start 2023-10-06T03:00:57.177 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:57.171+0000 7fcaa24ae700 1 -- start start 2023-10-06T03:00:57.180 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:57.175+0000 7fcaa24ae700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fca9c0c5ce0 0x7fca9c0c60b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:57.180 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:57.175+0000 7fcaa24ae700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fca9c0cb0f0 0x7fca9c06bca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:57.180 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:57.175+0000 7fcaa24ae700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca9c142630 0x7fca9c142ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:57.180 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:57.175+0000 7fcaa24ae700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca9c06b0e0 con 0x7fca9c0cb0f0 2023-10-06T03:00:57.180 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:57.175+0000 7fcaa24ae700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca9c0cb560 con 0x7fca9c0c5ce0 2023-10-06T03:00:57.181 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:57.175+0000 7fcaa24ae700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca9c0cc3a0 con 0x7fca9c142630 2023-10-06T03:00:57.182 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:57.175+0000 7fca9b7fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fca9c0cb0f0 0x7fca9c06bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:57.182 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:57.175+0000 7fca9b7fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fca9c0cb0f0 0x7fca9c06bca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44888/0 (socket says 172.21.15.57:44888) 2023-10-06T03:00:57.182 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:57.175+0000 7fca9b7fe700 1 -- 172.21.15.57:0/2544004890 learned_addr learned my addr 172.21.15.57:0/2544004890 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:00:57.182 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:57.175+0000 7fca9bfff700 1 --2- 172.21.15.57:0/2544004890 >> v2:172.21.15.105:3300/0 conn(0x7fca9c0c5ce0 0x7fca9c0c60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:57.182 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:57.175+0000 7fcaa0a4b700 1 --2- 172.21.15.57:0/2544004890 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca9c142630 0x7fca9c142ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:57.182 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:57.175+0000 7fca9b7fe700 1 -- 172.21.15.57:0/2544004890 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca9c142630 msgr2=0x7fca9c142ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:57.182 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:57.175+0000 7fca9b7fe700 1 --2- 172.21.15.57:0/2544004890 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca9c142630 0x7fca9c142ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:57.182 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:57.175+0000 7fca9b7fe700 1 -- 172.21.15.57:0/2544004890 >> v2:172.21.15.105:3300/0 conn(0x7fca9c0c5ce0 msgr2=0x7fca9c0c60b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:57.183 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:57.175+0000 7fca9b7fe700 1 --2- 172.21.15.57:0/2544004890 >> v2:172.21.15.105:3300/0 conn(0x7fca9c0c5ce0 0x7fca9c0c60b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:57.183 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:57.175+0000 7fca9b7fe700 1 -- 172.21.15.57:0/2544004890 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca9c0cb790 con 0x7fca9c0cb0f0 2023-10-06T03:00:57.183 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:57.175+0000 7fca9bfff700 1 --2- 172.21.15.57:0/2544004890 >> v2:172.21.15.105:3300/0 conn(0x7fca9c0c5ce0 0x7fca9c0c60b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:00:57.183 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:57.175+0000 7fca9b7fe700 1 --2- 172.21.15.57:0/2544004890 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca9c0cb0f0 0x7fca9c06bca0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fca9c0cdce0 tx=0x7fca90009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ab4ad0a8cc9c50 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:57.184 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:57.175+0000 7fca9affd700 1 -- 172.21.15.57:0/2544004890 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca9000b860 con 0x7fca9c0cb0f0 2023-10-06T03:00:57.184 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:57.179+0000 7fca9affd700 1 -- 172.21.15.57:0/2544004890 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca9000b9c0 con 0x7fca9c0cb0f0 2023-10-06T03:00:57.184 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:57.179+0000 7fca9affd700 1 -- 172.21.15.57:0/2544004890 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca9000bd60 con 0x7fca9c0cb0f0 2023-10-06T03:00:57.184 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:57.179+0000 7fcaa24ae700 1 -- 172.21.15.57:0/2544004890 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca9c0cb0f0 msgr2=0x7fca9c06bca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:57.184 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:57.179+0000 7fcaa24ae700 1 --2- 172.21.15.57:0/2544004890 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca9c0cb0f0 0x7fca9c06bca0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fca9c0cdce0 tx=0x7fca90009250 comp rx=0 tx=0).stop 2023-10-06T03:00:57.184 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:57.179+0000 7fcaa24ae700 1 -- 172.21.15.57:0/2544004890 shutdown_connections 2023-10-06T03:00:57.184 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:57.179+0000 7fcaa24ae700 1 --2- 172.21.15.57:0/2544004890 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca9c142630 0x7fca9c142ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:57.184 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:57.179+0000 7fcaa24ae700 1 --2- 172.21.15.57:0/2544004890 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca9c0cb0f0 0x7fca9c06bca0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:57.185 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:57.179+0000 7fcaa24ae700 1 --2- 172.21.15.57:0/2544004890 >> v2:172.21.15.105:3300/0 conn(0x7fca9c0c5ce0 0x7fca9c0c60b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:57.185 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:57.179+0000 7fcaa24ae700 1 -- 172.21.15.57:0/2544004890 >> 172.21.15.57:0/2544004890 conn(0x7fca9c0ccbd0 msgr2=0x7fca9c0ccfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:57.185 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:57.179+0000 7fcaa24ae700 1 -- 172.21.15.57:0/2544004890 shutdown_connections 2023-10-06T03:00:57.185 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:57.179+0000 7fcaa24ae700 1 -- 172.21.15.57:0/2544004890 wait complete. 2023-10-06T03:00:57.185 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:57.179+0000 7fcaa24ae700 1 Processor -- start 2023-10-06T03:00:57.186 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:57.179+0000 7fcaa24ae700 1 -- start start 2023-10-06T03:00:57.188 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:57.183+0000 7fcaa24ae700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca9c0c5ce0 0x7fca9c16e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:57.188 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:57.183+0000 7fcaa24ae700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca9c0cb0f0 0x7fca9c1719b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:57.188 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:57.183+0000 7fcaa24ae700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca9c142630 0x7fca9c16d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:57.188 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:57.183+0000 7fcaa24ae700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca9c0b1490 con 0x7fca9c0c5ce0 2023-10-06T03:00:57.188 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:57.183+0000 7fcaa24ae700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca9c0b1770 con 0x7fca9c142630 2023-10-06T03:00:57.188 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:57.183+0000 7fcaa24ae700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca9c0b1a50 con 0x7fca9c0cb0f0 2023-10-06T03:00:57.188 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:57.183+0000 7fca9bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca9c0c5ce0 0x7fca9c16e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:57.188 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:57.183+0000 7fca9bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca9c0c5ce0 0x7fca9c16e7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44896/0 (socket says 172.21.15.57:44896) 2023-10-06T03:00:57.188 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:57.183+0000 7fca9bfff700 1 -- 172.21.15.57:0/2663116447 learned_addr learned my addr 172.21.15.57:0/2663116447 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:00:57.190 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:57.183+0000 7fcaa0a4b700 1 --2- 172.21.15.57:0/2663116447 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca9c142630 0x7fca9c16d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:57.190 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:57.183+0000 7fca9b7fe700 1 --2- 172.21.15.57:0/2663116447 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca9c0cb0f0 0x7fca9c1719b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:57.190 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:57.183+0000 7fca9bfff700 1 -- 172.21.15.57:0/2663116447 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca9c0cb0f0 msgr2=0x7fca9c1719b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:57.190 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:57.183+0000 7fca9bfff700 1 --2- 172.21.15.57:0/2663116447 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca9c0cb0f0 0x7fca9c1719b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:57.190 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:57.183+0000 7fca9bfff700 1 -- 172.21.15.57:0/2663116447 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca9c142630 msgr2=0x7fca9c16d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:57.190 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:57.183+0000 7fca9bfff700 1 --2- 172.21.15.57:0/2663116447 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca9c142630 0x7fca9c16d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:57.190 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:57.183+0000 7fca9bfff700 1 -- 172.21.15.57:0/2663116447 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca900094f0 con 0x7fca9c0c5ce0 2023-10-06T03:00:57.190 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:57.183+0000 7fca9b7fe700 1 --2- 172.21.15.57:0/2663116447 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca9c0cb0f0 0x7fca9c1719b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:00:57.190 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:57.183+0000 7fcaa0a4b700 1 --2- 172.21.15.57:0/2663116447 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca9c142630 0x7fca9c16d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:00:57.190 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:57.183+0000 7fca9bfff700 1 --2- 172.21.15.57:0/2663116447 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca9c0c5ce0 0x7fca9c16e7c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fca8c00e8d0 tx=0x7fca8c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:57.191 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:57.183+0000 7fca83fff700 1 -- 172.21.15.57:0/2663116447 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca8c00ee70 con 0x7fca9c0c5ce0 2023-10-06T03:00:57.191 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:57.183+0000 7fca83fff700 1 -- 172.21.15.57:0/2663116447 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca8c00c5e0 con 0x7fca9c0c5ce0 2023-10-06T03:00:57.191 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:57.183+0000 7fcaa24ae700 1 -- 172.21.15.57:0/2663116447 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca9c0b1d30 con 0x7fca9c0c5ce0 2023-10-06T03:00:57.191 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:57.183+0000 7fca83fff700 1 -- 172.21.15.57:0/2663116447 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca8c00c980 con 0x7fca9c0c5ce0 2023-10-06T03:00:57.191 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:57.183+0000 7fcaa24ae700 1 -- 172.21.15.57:0/2663116447 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca9c0b10d0 con 0x7fca9c0c5ce0 2023-10-06T03:00:57.191 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:57.187+0000 7fcaa24ae700 1 -- 172.21.15.57:0/2663116447 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca9c0712e0 con 0x7fca9c0c5ce0 2023-10-06T03:00:57.193 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:57.187+0000 7fca83fff700 1 -- 172.21.15.57:0/2663116447 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fca8c013410 con 0x7fca9c0c5ce0 2023-10-06T03:00:57.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:57.187+0000 7fca83fff700 1 --2- 172.21.15.57:0/2663116447 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fca88060550 0x7fca88062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:57.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:57.191+0000 7fca83fff700 1 -- 172.21.15.57:0/2663116447 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5958+0+0 (secure 0 0 0) 0x7fca8c07c750 con 0x7fca9c0c5ce0 2023-10-06T03:00:57.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:57.191+0000 7fca9b7fe700 1 --2- 172.21.15.57:0/2663116447 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fca88060550 0x7fca88062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:57.196 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:57.191+0000 7fca9b7fe700 1 --2- 172.21.15.57:0/2663116447 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fca88060550 0x7fca88062a00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fca9c0cdce0 tx=0x7fca90017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:57.202 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:57.195+0000 7fca83fff700 1 -- 172.21.15.57:0/2663116447 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fca8c04cba0 con 0x7fca9c0c5ce0 2023-10-06T03:00:57.410 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:57.403+0000 7fcaa24ae700 1 -- 172.21.15.57:0/2663116447 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fca9c06ab90 con 0x7fca9c0c5ce0 2023-10-06T03:00:57.980 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:57.975+0000 7fca83fff700 1 -- 172.21.15.57:0/2663116447 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fca8c0501c0 con 0x7fca9c0c5ce0 2023-10-06T03:00:57.994 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:57.987+0000 7fcaa24ae700 1 -- 172.21.15.57:0/2663116447 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fca88060550 msgr2=0x7fca88062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:57.994 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:57.987+0000 7fcaa24ae700 1 --2- 172.21.15.57:0/2663116447 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fca88060550 0x7fca88062a00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fca9c0cdce0 tx=0x7fca90017000 comp rx=0 tx=0).stop 2023-10-06T03:00:57.994 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:57.987+0000 7fcaa24ae700 1 -- 172.21.15.57:0/2663116447 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca9c0c5ce0 msgr2=0x7fca9c16e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:57.994 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:57.987+0000 7fcaa24ae700 1 --2- 172.21.15.57:0/2663116447 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca9c0c5ce0 0x7fca9c16e7c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fca8c00e8d0 tx=0x7fca8c008040 comp rx=0 tx=0).stop 2023-10-06T03:00:57.994 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:57.987+0000 7fcaa24ae700 1 -- 172.21.15.57:0/2663116447 shutdown_connections 2023-10-06T03:00:57.995 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:57.987+0000 7fcaa24ae700 1 --2- 172.21.15.57:0/2663116447 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca9c142630 0x7fca9c16d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:57.995 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:57.987+0000 7fcaa24ae700 1 --2- 172.21.15.57:0/2663116447 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fca88060550 0x7fca88062a00 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:57.995 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:57.987+0000 7fcaa24ae700 1 --2- 172.21.15.57:0/2663116447 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca9c0cb0f0 0x7fca9c1719b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:57.995 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:57.987+0000 7fcaa24ae700 1 --2- 172.21.15.57:0/2663116447 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca9c0c5ce0 0x7fca9c16e7c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:57.995 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:57.987+0000 7fcaa24ae700 1 -- 172.21.15.57:0/2663116447 >> 172.21.15.57:0/2663116447 conn(0x7fca9c0ccbd0 msgr2=0x7fca9c0ce060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:57.995 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:57.991+0000 7fcaa24ae700 1 -- 172.21.15.57:0/2663116447 shutdown_connections 2023-10-06T03:00:57.996 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:57.991+0000 7fcaa24ae700 1 -- 172.21.15.57:0/2663116447 wait complete. 2023-10-06T03:00:58.002 INFO:teuthology.orchestra.run.smithi057.stderr:new fs with metadata pool 3 and data pool 4 2023-10-06T03:00:58.021 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:00:58.180 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.175+0000 7fbeada0c700 1 Processor -- start 2023-10-06T03:00:58.181 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.175+0000 7fbeada0c700 1 -- start start 2023-10-06T03:00:58.184 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.179+0000 7fbeada0c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fbea80aae90 0x7fbea80aa7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:58.184 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.179+0000 7fbeada0c700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fbea806bba0 0x7fbea80ab970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:58.184 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.179+0000 7fbeada0c700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbea806de50 con 0x7fbea806c920 2023-10-06T03:00:58.184 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.179+0000 7fbeada0c700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbea806bff0 con 0x7fbea80aae90 2023-10-06T03:00:58.184 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.179+0000 7fbeada0c700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbea806e130 con 0x7fbea806bba0 2023-10-06T03:00:58.185 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.179+0000 7fbe9ffff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fbea80aae90 0x7fbea80aa7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:58.185 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.179+0000 7fbeaca0a700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fbea806c920 0x7fbea806ccf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:43264/0 (socket says 172.21.15.57:43264) 2023-10-06T03:00:58.185 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.179+0000 7fbeaca0a700 1 -- 172.21.15.57:0/1024464771 learned_addr learned my addr 172.21.15.57:0/1024464771 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:00:58.185 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.179+0000 7fbead20b700 1 --2- 172.21.15.57:0/1024464771 >> v2:172.21.15.105:3300/0 conn(0x7fbea806bba0 0x7fbea80ab970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:58.186 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.179+0000 7fbe9ffff700 1 -- 172.21.15.57:0/1024464771 >> v2:172.21.15.105:3300/0 conn(0x7fbea806bba0 msgr2=0x7fbea80ab970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:58.186 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.179+0000 7fbe9ffff700 1 --2- 172.21.15.57:0/1024464771 >> v2:172.21.15.105:3300/0 conn(0x7fbea806bba0 0x7fbea80ab970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:58.186 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.179+0000 7fbe9ffff700 1 -- 172.21.15.57:0/1024464771 >> v1:172.21.15.57:6789/0 conn(0x7fbea806c920 legacy=0x7fbea806ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:58.186 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.179+0000 7fbe9ffff700 1 -- 172.21.15.57:0/1024464771 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbea806b3a0 con 0x7fbea80aae90 2023-10-06T03:00:58.186 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.179+0000 7fbead20b700 1 --2- 172.21.15.57:0/1024464771 >> v2:172.21.15.105:3300/0 conn(0x7fbea806bba0 0x7fbea80ab970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:00:58.187 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.179+0000 7fbe9ffff700 1 --2- 172.21.15.57:0/1024464771 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbea80aae90 0x7fbea80aa7e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fbea80ab730 tx=0x7fbe980091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=960a971a4a64a29c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:58.187 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.179+0000 7fbe9f7fe700 1 -- 172.21.15.57:0/1024464771 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe9800b6b0 con 0x7fbea80aae90 2023-10-06T03:00:58.187 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.179+0000 7fbe9f7fe700 1 -- 172.21.15.57:0/1024464771 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe9800b810 con 0x7fbea80aae90 2023-10-06T03:00:58.187 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.179+0000 7fbe9f7fe700 1 -- 172.21.15.57:0/1024464771 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe9800bbb0 con 0x7fbea80aae90 2023-10-06T03:00:58.188 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.183+0000 7fbeada0c700 1 -- 172.21.15.57:0/1024464771 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbea80aae90 msgr2=0x7fbea80aa7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:58.188 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.183+0000 7fbeada0c700 1 --2- 172.21.15.57:0/1024464771 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbea80aae90 0x7fbea80aa7e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fbea80ab730 tx=0x7fbe980091a0 comp rx=0 tx=0).stop 2023-10-06T03:00:58.188 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.183+0000 7fbeada0c700 1 -- 172.21.15.57:0/1024464771 shutdown_connections 2023-10-06T03:00:58.188 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.183+0000 7fbeada0c700 1 --2- 172.21.15.57:0/1024464771 >> v2:172.21.15.105:3300/0 conn(0x7fbea806bba0 0x7fbea80ab970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:58.188 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.183+0000 7fbeada0c700 1 --2- 172.21.15.57:0/1024464771 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbea80aae90 0x7fbea80aa7e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:58.188 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.183+0000 7fbeada0c700 1 -- 172.21.15.57:0/1024464771 >> 172.21.15.57:0/1024464771 conn(0x7fbea80c85e0 msgr2=0x7fbea80c89e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:58.188 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.183+0000 7fbeada0c700 1 -- 172.21.15.57:0/1024464771 shutdown_connections 2023-10-06T03:00:58.188 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.183+0000 7fbeada0c700 1 -- 172.21.15.57:0/1024464771 wait complete. 2023-10-06T03:00:58.190 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.183+0000 7fbeada0c700 1 Processor -- start 2023-10-06T03:00:58.191 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.183+0000 7fbeada0c700 1 -- start start 2023-10-06T03:00:58.192 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.187+0000 7fbeada0c700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbea806bba0 0x7fbea81709f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:58.192 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.187+0000 7fbeada0c700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbea806c920 0x7fbea80ca6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:58.192 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.187+0000 7fbeada0c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbea80aae90 0x7fbea80cabe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:58.192 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.187+0000 7fbeada0c700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbea8171ea0 con 0x7fbea80aae90 2023-10-06T03:00:58.192 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.187+0000 7fbeada0c700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbea8170f30 con 0x7fbea806c920 2023-10-06T03:00:58.192 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.187+0000 7fbeada0c700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbea8171290 con 0x7fbea806bba0 2023-10-06T03:00:58.193 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.187+0000 7fbead20b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbea80aae90 0x7fbea80cabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:58.193 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.187+0000 7fbead20b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbea80aae90 0x7fbea80cabe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44918/0 (socket says 172.21.15.57:44918) 2023-10-06T03:00:58.193 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.187+0000 7fbead20b700 1 -- 172.21.15.57:0/1697460041 learned_addr learned my addr 172.21.15.57:0/1697460041 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:00:58.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.187+0000 7fbeaca0a700 1 --2- 172.21.15.57:0/1697460041 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbea806bba0 0x7fbea81709f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:58.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.187+0000 7fbe9ffff700 1 --2- 172.21.15.57:0/1697460041 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbea806c920 0x7fbea80ca6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:58.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.187+0000 7fbead20b700 1 -- 172.21.15.57:0/1697460041 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbea806bba0 msgr2=0x7fbea81709f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:58.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.187+0000 7fbead20b700 1 --2- 172.21.15.57:0/1697460041 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbea806bba0 0x7fbea81709f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:58.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.187+0000 7fbead20b700 1 -- 172.21.15.57:0/1697460041 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbea806c920 msgr2=0x7fbea80ca6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:58.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.187+0000 7fbead20b700 1 --2- 172.21.15.57:0/1697460041 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbea806c920 0x7fbea80ca6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:58.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.187+0000 7fbead20b700 1 -- 172.21.15.57:0/1697460041 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe98009420 con 0x7fbea80aae90 2023-10-06T03:00:58.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.187+0000 7fbe9ffff700 1 --2- 172.21.15.57:0/1697460041 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbea806c920 0x7fbea80ca6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:00:58.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.187+0000 7fbead20b700 1 --2- 172.21.15.57:0/1697460041 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbea80aae90 0x7fbea80cabe0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fbea0009fc0 tx=0x7fbea00099b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:58.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.187+0000 7fbe9cff9700 1 -- 172.21.15.57:0/1697460041 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbea000dd40 con 0x7fbea80aae90 2023-10-06T03:00:58.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.187+0000 7fbe9cff9700 1 -- 172.21.15.57:0/1697460041 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbea000f040 con 0x7fbea80aae90 2023-10-06T03:00:58.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.187+0000 7fbeada0c700 1 -- 172.21.15.57:0/1697460041 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbea8171570 con 0x7fbea80aae90 2023-10-06T03:00:58.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.187+0000 7fbe9cff9700 1 -- 172.21.15.57:0/1697460041 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbea0015690 con 0x7fbea80aae90 2023-10-06T03:00:58.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.187+0000 7fbeada0c700 1 -- 172.21.15.57:0/1697460041 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbea8171b30 con 0x7fbea80aae90 2023-10-06T03:00:58.196 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.191+0000 7fbeada0c700 1 -- 172.21.15.57:0/1697460041 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbea8172010 con 0x7fbea80aae90 2023-10-06T03:00:58.197 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.191+0000 7fbe9cff9700 1 -- 172.21.15.57:0/1697460041 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fbea001e3b0 con 0x7fbea80aae90 2023-10-06T03:00:58.199 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.195+0000 7fbe9cff9700 1 --2- 172.21.15.57:0/1697460041 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fbe94060550 0x7fbe94062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:58.199 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.195+0000 7fbe9cff9700 1 -- 172.21.15.57:0/1697460041 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fbea007cf80 con 0x7fbea80aae90 2023-10-06T03:00:58.199 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.195+0000 7fbeaca0a700 1 --2- 172.21.15.57:0/1697460041 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fbe94060550 0x7fbe94062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:58.201 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.195+0000 7fbeaca0a700 1 --2- 172.21.15.57:0/1697460041 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fbe94060550 0x7fbe94062a00 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fbea80c7590 tx=0x7fbea4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:58.206 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.199+0000 7fbe9cff9700 1 -- 172.21.15.57:0/1697460041 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fbea004d370 con 0x7fbea80aae90 2023-10-06T03:00:58.381 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.375+0000 7fbeada0c700 1 -- 172.21.15.57:0/1697460041 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbea804be40 con 0x7fbea80aae90 2023-10-06T03:00:58.383 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.379+0000 7fbe9cff9700 1 -- 172.21.15.57:0/1697460041 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16879 (secure 0 0 0) 0x7fbea0050990 con 0x7fbea80aae90 2023-10-06T03:00:58.383 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:00:58.384 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":22,"fsid":"eb56dc0f-9213-41cb-9aad-8ade6c802e98","created":"2023-10-06T03:00:30.806197+0000","modified":"2023-10-06T03:00:57.410456+0000","last_up_change":"2023-10-06T03:00:43.607454+0000","last_in_change":"2023-10-06T03:00:33.943513+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T03:00:44.360651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T03:00:50.466601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:00:55.472586+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T03:00:56.400884+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"58cf6c90-d704-43e0-b2db-dffe526d5e8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":33053},{"type":"v1","addr":"172.21.15.57:6801","nonce":33053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":33053},{"type":"v1","addr":"172.21.15.57:6803","nonce":33053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":33053},{"type":"v1","addr":"172.21.15.57:6807","nonce":33053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":33053},{"type":"v1","addr":"172.21.15.57:6805","nonce":33053}]},"public_addr":"172.21.15.57:6801/33053","cluster_addr":"172.21.15.57:6803/33053","heartbeat_back_addr":"172.21.15.57:6807/33053","heartbeat_front_addr":"172.21.15.57:6805/33053","state":["exists","up"]},{"osd":1,"uuid":"16afbe70-7f9e-4568-9c92-763e6e348119","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6809","nonce":33052},{"type":"v1","addr":"172.21.15.57:6810","nonce":33052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":33052},{"type":"v1","addr":"172.21.15.57:6813","nonce":33052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":33052},{"type":"v1","addr":"172.21.15.57:6822","nonce":33052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6815","nonce":33052},{"type":"v1","addr":"172.21.15.57:6818","nonce":33052}]},"public_addr":"172.21.15.57:6810/33052","cluster_addr":"172.21.15.57:6813/33052","heartbeat_back_addr":"172.21.15.57:6822/33052","heartbeat_front_addr":"172.21.15.57:6818/33052","state":["exists","up"]},{"osd":2,"uuid":"7255c62e-f92f-470f-a5ce-30228920d9f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":33058},{"type":"v1","addr":"172.21.15.57:6825","nonce":33058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":33058},{"type":"v1","addr":"172.21.15.57:6827","nonce":33058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":33058},{"type":"v1","addr":"172.21.15.57:6831","nonce":33058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":33058},{"type":"v1","addr":"172.21.15.57:6829","nonce":33058}]},"public_addr":"172.21.15.57:6825/33058","cluster_addr":"172.21.15.57:6827/33058","heartbeat_back_addr":"172.21.15.57:6831/33058","heartbeat_front_addr":"172.21.15.57:6829/33058","state":["exists","up"]},{"osd":3,"uuid":"152a236d-f799-4888-8544-74865508d5a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":33057},{"type":"v1","addr":"172.21.15.57:6811","nonce":33057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":33057},{"type":"v1","addr":"172.21.15.57:6816","nonce":33057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6821","nonce":33057},{"type":"v1","addr":"172.21.15.57:6823","nonce":33057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6817","nonce":33057},{"type":"v1","addr":"172.21.15.57:6819","nonce":33057}]},"public_addr":"172.21.15.57:6811/33057","cluster_addr":"172.21.15.57:6816/33057","heartbeat_back_addr":"172.21.15.57:6823/33057","heartbeat_front_addr":"172.21.15.57:6819/33057","state":["exists","up"]},{"osd":4,"uuid":"37db2a65-3566-41d0-9d60-e66c49e1e68e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":33368},{"type":"v1","addr":"172.21.15.105:6801","nonce":33368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":33368},{"type":"v1","addr":"172.21.15.105:6803","nonce":33368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":33368},{"type":"v1","addr":"172.21.15.105:6807","nonce":33368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":33368},{"type":"v1","addr":"172.21.15.105:6805","nonce":33368}]},"public_addr":"172.21.15.105:6801/33368","cluster_addr":"172.21.15.105:6803/33368","heartbeat_back_addr":"172.21.15.105:6807/33368","heartbeat_front_addr":"172.21.15.105:6805/33368","state":["exists","up"]},{"osd":5,"uuid":"35e77918-1bb4-42ca-9b20-f3c14eaa0c04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":33379},{"type":"v1","addr":"172.21.15.105:6818","nonce":33379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":33379},{"type":"v1","addr":"172.21.15.105:6823","nonce":33379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":33379},{"type":"v1","addr":"172.21.15.105:6831","nonce":33379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":33379},{"type":"v1","addr":"172.21.15.105:6827","nonce":33379}]},"public_addr":"172.21.15.105:6818/33379","cluster_addr":"172.21.15.105:6823/33379","heartbeat_back_addr":"172.21.15.105:6831/33379","heartbeat_front_addr":"172.21.15.105:6827/33379","state":["exists","up"]},{"osd":6,"uuid":"b4d9d510-7a45-4173-8287-c6c8d6547f2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":33369},{"type":"v1","addr":"172.21.15.105:6819","nonce":33369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":33369},{"type":"v1","addr":"172.21.15.105:6822","nonce":33369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":33369},{"type":"v1","addr":"172.21.15.105:6830","nonce":33369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":33369},{"type":"v1","addr":"172.21.15.105:6826","nonce":33369}]},"public_addr":"172.21.15.105:6819/33369","cluster_addr":"172.21.15.105:6822/33369","heartbeat_back_addr":"172.21.15.105:6830/33369","heartbeat_front_addr":"172.21.15.105:6826/33369","state":["exists","up"]},{"osd":7,"uuid":"74266fb0-cd84-463f-8bf0-092652a71dc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":33370},{"type":"v1","addr":"172.21.15.105:6809","nonce":33370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":33370},{"type":"v1","addr":"172.21.15.105:6811","nonce":33370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":33370},{"type":"v1","addr":"172.21.15.105:6815","nonce":33370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":33370},{"type":"v1","addr":"172.21.15.105:6813","nonce":33370}]},"public_addr":"172.21.15.105:6809/33370","cluster_addr":"172.21.15.105:6811/33370","heartbeat_back_addr":"172.21.15.105:6815/33370","heartbeat_front_addr":"172.21.15.105:6813/33370","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.596864+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.633851+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.636993+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.529681+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.608601+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.659752+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.661717+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.642221+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:00:58.385 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.379+0000 7fbeada0c700 1 -- 172.21.15.57:0/1697460041 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fbe94060550 msgr2=0x7fbe94062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:58.385 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.379+0000 7fbeada0c700 1 --2- 172.21.15.57:0/1697460041 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fbe94060550 0x7fbe94062a00 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fbea80c7590 tx=0x7fbea4009040 comp rx=0 tx=0).stop 2023-10-06T03:00:58.386 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.379+0000 7fbeada0c700 1 -- 172.21.15.57:0/1697460041 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbea80aae90 msgr2=0x7fbea80cabe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:58.386 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.379+0000 7fbeada0c700 1 --2- 172.21.15.57:0/1697460041 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbea80aae90 0x7fbea80cabe0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fbea0009fc0 tx=0x7fbea00099b0 comp rx=0 tx=0).stop 2023-10-06T03:00:58.386 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.379+0000 7fbeada0c700 1 -- 172.21.15.57:0/1697460041 shutdown_connections 2023-10-06T03:00:58.386 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.379+0000 7fbeada0c700 1 --2- 172.21.15.57:0/1697460041 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbea80aae90 0x7fbea80cabe0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:58.387 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.379+0000 7fbeada0c700 1 --2- 172.21.15.57:0/1697460041 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbea806c920 0x7fbea80ca6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:58.387 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.379+0000 7fbeada0c700 1 --2- 172.21.15.57:0/1697460041 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fbe94060550 0x7fbe94062a00 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:58.387 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.379+0000 7fbeada0c700 1 --2- 172.21.15.57:0/1697460041 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbea806bba0 0x7fbea81709f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:58.387 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.379+0000 7fbeada0c700 1 -- 172.21.15.57:0/1697460041 >> 172.21.15.57:0/1697460041 conn(0x7fbea80c85e0 msgr2=0x7fbea815ef60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:58.387 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.379+0000 7fbeada0c700 1 -- 172.21.15.57:0/1697460041 shutdown_connections 2023-10-06T03:00:58.387 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.379+0000 7fbeada0c700 1 -- 172.21.15.57:0/1697460041 wait complete. 2023-10-06T03:00:58.407 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:00:58.571 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.563+0000 7fc194cae700 1 Processor -- start 2023-10-06T03:00:58.571 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.567+0000 7fc194cae700 1 -- start start 2023-10-06T03:00:58.573 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.567+0000 7fc194cae700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fc1900675c0 0x7fc19014fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:58.573 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.567+0000 7fc194cae700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc190150180 0x7fc19015ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:58.573 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.567+0000 7fc194cae700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc190067a00 con 0x7fc1900671f0 2023-10-06T03:00:58.573 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.567+0000 7fc194cae700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc19006d7e0 con 0x7fc1900675c0 2023-10-06T03:00:58.573 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.567+0000 7fc194cae700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc190150600 con 0x7fc190150180 2023-10-06T03:00:58.574 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.567+0000 7fc18ed9d700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc190150180 0x7fc19015ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:58.574 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.567+0000 7fc18e59c700 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7fc1900671f0 0x7fc19006dc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.57:41186/0 (socket says 172.21.15.57:41186) 2023-10-06T03:00:58.574 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.567+0000 7fc18e59c700 1 -- 172.21.15.57:0/3682293224 learned_addr learned my addr 172.21.15.57:0/3682293224 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:00:58.574 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.567+0000 7fc18dd9b700 1 --2- 172.21.15.57:0/3682293224 >> v2:172.21.15.105:3300/0 conn(0x7fc1900675c0 0x7fc19014fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:58.575 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.571+0000 7fc18dd9b700 1 -- 172.21.15.57:0/3682293224 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc190150180 msgr2=0x7fc19015ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:58.575 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.571+0000 7fc18dd9b700 1 --2- 172.21.15.57:0/3682293224 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc190150180 0x7fc19015ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:58.575 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.571+0000 7fc18dd9b700 1 -- 172.21.15.57:0/3682293224 >> v1:172.21.15.105:6789/0 conn(0x7fc1900671f0 legacy=0x7fc19006dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:58.575 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.571+0000 7fc18dd9b700 1 -- 172.21.15.57:0/3682293224 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc19015dc00 con 0x7fc1900675c0 2023-10-06T03:00:58.575 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.571+0000 7fc18ed9d700 1 --2- 172.21.15.57:0/3682293224 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc190150180 0x7fc19015ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:00:58.576 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.571+0000 7fc18dd9b700 1 --2- 172.21.15.57:0/3682293224 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc1900675c0 0x7fc19014fc40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc1840098e0 tx=0x7fc1840091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8971db1efe0c8c7d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:58.576 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.571+0000 7fc18d59a700 1 -- 172.21.15.57:0/3682293224 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc184011630 con 0x7fc1900675c0 2023-10-06T03:00:58.576 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.571+0000 7fc18d59a700 1 -- 172.21.15.57:0/3682293224 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc184011790 con 0x7fc1900675c0 2023-10-06T03:00:58.577 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.571+0000 7fc18d59a700 1 -- 172.21.15.57:0/3682293224 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc184011b30 con 0x7fc1900675c0 2023-10-06T03:00:58.577 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.571+0000 7fc194cae700 1 -- 172.21.15.57:0/3682293224 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc1900675c0 msgr2=0x7fc19014fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:58.577 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.571+0000 7fc194cae700 1 --2- 172.21.15.57:0/3682293224 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc1900675c0 0x7fc19014fc40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc1840098e0 tx=0x7fc1840091a0 comp rx=0 tx=0).stop 2023-10-06T03:00:58.578 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.571+0000 7fc194cae700 1 -- 172.21.15.57:0/3682293224 shutdown_connections 2023-10-06T03:00:58.578 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.571+0000 7fc194cae700 1 --2- 172.21.15.57:0/3682293224 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc190150180 0x7fc19015ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:58.578 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.571+0000 7fc194cae700 1 --2- 172.21.15.57:0/3682293224 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc1900675c0 0x7fc19014fc40 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:58.578 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.571+0000 7fc194cae700 1 -- 172.21.15.57:0/3682293224 >> 172.21.15.57:0/3682293224 conn(0x7fc1900cbdd0 msgr2=0x7fc1900cc1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:58.578 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.571+0000 7fc194cae700 1 -- 172.21.15.57:0/3682293224 shutdown_connections 2023-10-06T03:00:58.578 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.571+0000 7fc194cae700 1 -- 172.21.15.57:0/3682293224 wait complete. 2023-10-06T03:00:58.580 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.575+0000 7fc194cae700 1 Processor -- start 2023-10-06T03:00:58.581 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.575+0000 7fc194cae700 1 -- start start 2023-10-06T03:00:58.582 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.575+0000 7fc194cae700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc1900671f0 0x7fc190148bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:58.582 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.575+0000 7fc194cae700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc1900675c0 0x7fc190159120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:58.582 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.575+0000 7fc194cae700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc190150180 0x7fc1900ad0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:58.582 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.575+0000 7fc194cae700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1900ad610 con 0x7fc1900671f0 2023-10-06T03:00:58.582 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.575+0000 7fc194cae700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1900abe60 con 0x7fc1900675c0 2023-10-06T03:00:58.582 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.575+0000 7fc194cae700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1900ad820 con 0x7fc190150180 2023-10-06T03:00:58.583 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.575+0000 7fc18e59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc1900671f0 0x7fc190148bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:58.584 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.575+0000 7fc18e59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc1900671f0 0x7fc190148bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44924/0 (socket says 172.21.15.57:44924) 2023-10-06T03:00:58.584 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.579+0000 7fc18e59c700 1 -- 172.21.15.57:0/3490625409 learned_addr learned my addr 172.21.15.57:0/3490625409 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:00:58.584 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.579+0000 7fc18dd9b700 1 --2- 172.21.15.57:0/3490625409 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc1900675c0 0x7fc190159120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:58.584 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.579+0000 7fc18ed9d700 1 --2- 172.21.15.57:0/3490625409 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc190150180 0x7fc1900ad0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:58.584 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.579+0000 7fc18e59c700 1 -- 172.21.15.57:0/3490625409 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc190150180 msgr2=0x7fc1900ad0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:58.584 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.579+0000 7fc18e59c700 1 --2- 172.21.15.57:0/3490625409 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc190150180 0x7fc1900ad0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:58.584 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.579+0000 7fc18e59c700 1 -- 172.21.15.57:0/3490625409 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc1900675c0 msgr2=0x7fc190159120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:58.584 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.579+0000 7fc18e59c700 1 --2- 172.21.15.57:0/3490625409 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc1900675c0 0x7fc190159120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:58.584 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.579+0000 7fc18e59c700 1 -- 172.21.15.57:0/3490625409 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc188009a20 con 0x7fc1900671f0 2023-10-06T03:00:58.584 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.579+0000 7fc18ed9d700 1 --2- 172.21.15.57:0/3490625409 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc190150180 0x7fc1900ad0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:00:58.584 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.579+0000 7fc18e59c700 1 --2- 172.21.15.57:0/3490625409 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc1900671f0 0x7fc190148bd0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc18000c760 tx=0x7fc180007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:58.585 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.579+0000 7fc17e7fc700 1 -- 172.21.15.57:0/3490625409 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc180005b30 con 0x7fc1900671f0 2023-10-06T03:00:58.585 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.579+0000 7fc17e7fc700 1 -- 172.21.15.57:0/3490625409 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc180005cb0 con 0x7fc1900671f0 2023-10-06T03:00:58.585 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.579+0000 7fc194cae700 1 -- 172.21.15.57:0/3490625409 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc184009420 con 0x7fc1900671f0 2023-10-06T03:00:58.586 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.579+0000 7fc17e7fc700 1 -- 172.21.15.57:0/3490625409 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc180007340 con 0x7fc1900671f0 2023-10-06T03:00:58.586 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.579+0000 7fc194cae700 1 -- 172.21.15.57:0/3490625409 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1900abaf0 con 0x7fc1900671f0 2023-10-06T03:00:58.586 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.579+0000 7fc194cae700 1 -- 172.21.15.57:0/3490625409 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1900712e0 con 0x7fc1900671f0 2023-10-06T03:00:58.587 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.583+0000 7fc17e7fc700 1 -- 172.21.15.57:0/3490625409 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fc18001b400 con 0x7fc1900671f0 2023-10-06T03:00:58.589 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.583+0000 7fc17e7fc700 1 --2- 172.21.15.57:0/3490625409 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fc170060550 0x7fc170062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:58.589 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.583+0000 7fc17e7fc700 1 -- 172.21.15.57:0/3490625409 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc18007c550 con 0x7fc1900671f0 2023-10-06T03:00:58.589 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.583+0000 7fc18dd9b700 1 --2- 172.21.15.57:0/3490625409 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fc170060550 0x7fc170062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:58.590 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.583+0000 7fc18dd9b700 1 --2- 172.21.15.57:0/3490625409 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fc170060550 0x7fc170062a00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc1840093f0 tx=0x7fc184016000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:58.595 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.591+0000 7fc17e7fc700 1 -- 172.21.15.57:0/3490625409 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fc18004c9c0 con 0x7fc1900671f0 2023-10-06T03:00:58.766 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.759+0000 7fc194cae700 1 -- 172.21.15.57:0/3490625409 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc19006ceb0 con 0x7fc1900671f0 2023-10-06T03:00:58.768 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.763+0000 7fc17e7fc700 1 -- 172.21.15.57:0/3490625409 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16879 (secure 0 0 0) 0x7fc18004ffe0 con 0x7fc1900671f0 2023-10-06T03:00:58.769 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:00:58.769 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":22,"fsid":"eb56dc0f-9213-41cb-9aad-8ade6c802e98","created":"2023-10-06T03:00:30.806197+0000","modified":"2023-10-06T03:00:57.410456+0000","last_up_change":"2023-10-06T03:00:43.607454+0000","last_in_change":"2023-10-06T03:00:33.943513+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T03:00:44.360651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T03:00:50.466601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:00:55.472586+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T03:00:56.400884+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"58cf6c90-d704-43e0-b2db-dffe526d5e8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":33053},{"type":"v1","addr":"172.21.15.57:6801","nonce":33053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":33053},{"type":"v1","addr":"172.21.15.57:6803","nonce":33053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":33053},{"type":"v1","addr":"172.21.15.57:6807","nonce":33053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":33053},{"type":"v1","addr":"172.21.15.57:6805","nonce":33053}]},"public_addr":"172.21.15.57:6801/33053","cluster_addr":"172.21.15.57:6803/33053","heartbeat_back_addr":"172.21.15.57:6807/33053","heartbeat_front_addr":"172.21.15.57:6805/33053","state":["exists","up"]},{"osd":1,"uuid":"16afbe70-7f9e-4568-9c92-763e6e348119","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6809","nonce":33052},{"type":"v1","addr":"172.21.15.57:6810","nonce":33052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":33052},{"type":"v1","addr":"172.21.15.57:6813","nonce":33052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":33052},{"type":"v1","addr":"172.21.15.57:6822","nonce":33052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6815","nonce":33052},{"type":"v1","addr":"172.21.15.57:6818","nonce":33052}]},"public_addr":"172.21.15.57:6810/33052","cluster_addr":"172.21.15.57:6813/33052","heartbeat_back_addr":"172.21.15.57:6822/33052","heartbeat_front_addr":"172.21.15.57:6818/33052","state":["exists","up"]},{"osd":2,"uuid":"7255c62e-f92f-470f-a5ce-30228920d9f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":33058},{"type":"v1","addr":"172.21.15.57:6825","nonce":33058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":33058},{"type":"v1","addr":"172.21.15.57:6827","nonce":33058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":33058},{"type":"v1","addr":"172.21.15.57:6831","nonce":33058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":33058},{"type":"v1","addr":"172.21.15.57:6829","nonce":33058}]},"public_addr":"172.21.15.57:6825/33058","cluster_addr":"172.21.15.57:6827/33058","heartbeat_back_addr":"172.21.15.57:6831/33058","heartbeat_front_addr":"172.21.15.57:6829/33058","state":["exists","up"]},{"osd":3,"uuid":"152a236d-f799-4888-8544-74865508d5a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":33057},{"type":"v1","addr":"172.21.15.57:6811","nonce":33057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":33057},{"type":"v1","addr":"172.21.15.57:6816","nonce":33057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6821","nonce":33057},{"type":"v1","addr":"172.21.15.57:6823","nonce":33057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6817","nonce":33057},{"type":"v1","addr":"172.21.15.57:6819","nonce":33057}]},"public_addr":"172.21.15.57:6811/33057","cluster_addr":"172.21.15.57:6816/33057","heartbeat_back_addr":"172.21.15.57:6823/33057","heartbeat_front_addr":"172.21.15.57:6819/33057","state":["exists","up"]},{"osd":4,"uuid":"37db2a65-3566-41d0-9d60-e66c49e1e68e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":33368},{"type":"v1","addr":"172.21.15.105:6801","nonce":33368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":33368},{"type":"v1","addr":"172.21.15.105:6803","nonce":33368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":33368},{"type":"v1","addr":"172.21.15.105:6807","nonce":33368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":33368},{"type":"v1","addr":"172.21.15.105:6805","nonce":33368}]},"public_addr":"172.21.15.105:6801/33368","cluster_addr":"172.21.15.105:6803/33368","heartbeat_back_addr":"172.21.15.105:6807/33368","heartbeat_front_addr":"172.21.15.105:6805/33368","state":["exists","up"]},{"osd":5,"uuid":"35e77918-1bb4-42ca-9b20-f3c14eaa0c04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":33379},{"type":"v1","addr":"172.21.15.105:6818","nonce":33379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":33379},{"type":"v1","addr":"172.21.15.105:6823","nonce":33379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":33379},{"type":"v1","addr":"172.21.15.105:6831","nonce":33379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":33379},{"type":"v1","addr":"172.21.15.105:6827","nonce":33379}]},"public_addr":"172.21.15.105:6818/33379","cluster_addr":"172.21.15.105:6823/33379","heartbeat_back_addr":"172.21.15.105:6831/33379","heartbeat_front_addr":"172.21.15.105:6827/33379","state":["exists","up"]},{"osd":6,"uuid":"b4d9d510-7a45-4173-8287-c6c8d6547f2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":33369},{"type":"v1","addr":"172.21.15.105:6819","nonce":33369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":33369},{"type":"v1","addr":"172.21.15.105:6822","nonce":33369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":33369},{"type":"v1","addr":"172.21.15.105:6830","nonce":33369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":33369},{"type":"v1","addr":"172.21.15.105:6826","nonce":33369}]},"public_addr":"172.21.15.105:6819/33369","cluster_addr":"172.21.15.105:6822/33369","heartbeat_back_addr":"172.21.15.105:6830/33369","heartbeat_front_addr":"172.21.15.105:6826/33369","state":["exists","up"]},{"osd":7,"uuid":"74266fb0-cd84-463f-8bf0-092652a71dc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":33370},{"type":"v1","addr":"172.21.15.105:6809","nonce":33370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":33370},{"type":"v1","addr":"172.21.15.105:6811","nonce":33370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":33370},{"type":"v1","addr":"172.21.15.105:6815","nonce":33370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":33370},{"type":"v1","addr":"172.21.15.105:6813","nonce":33370}]},"public_addr":"172.21.15.105:6809/33370","cluster_addr":"172.21.15.105:6811/33370","heartbeat_back_addr":"172.21.15.105:6815/33370","heartbeat_front_addr":"172.21.15.105:6813/33370","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.596864+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.633851+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.636993+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.529681+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.608601+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.659752+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.661717+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.642221+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:00:58.772 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.767+0000 7fc194cae700 1 -- 172.21.15.57:0/3490625409 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fc170060550 msgr2=0x7fc170062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:58.773 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.767+0000 7fc194cae700 1 --2- 172.21.15.57:0/3490625409 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fc170060550 0x7fc170062a00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc1840093f0 tx=0x7fc184016000 comp rx=0 tx=0).stop 2023-10-06T03:00:58.773 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.767+0000 7fc194cae700 1 -- 172.21.15.57:0/3490625409 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc1900671f0 msgr2=0x7fc190148bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:58.773 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.767+0000 7fc194cae700 1 --2- 172.21.15.57:0/3490625409 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc1900671f0 0x7fc190148bd0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc18000c760 tx=0x7fc180007ef0 comp rx=0 tx=0).stop 2023-10-06T03:00:58.773 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.767+0000 7fc194cae700 1 -- 172.21.15.57:0/3490625409 shutdown_connections 2023-10-06T03:00:58.773 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.767+0000 7fc194cae700 1 --2- 172.21.15.57:0/3490625409 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fc170060550 0x7fc170062a00 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:58.773 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.767+0000 7fc194cae700 1 --2- 172.21.15.57:0/3490625409 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc190150180 0x7fc1900ad0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:58.773 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.767+0000 7fc194cae700 1 --2- 172.21.15.57:0/3490625409 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc1900675c0 0x7fc190159120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:58.773 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.767+0000 7fc194cae700 1 --2- 172.21.15.57:0/3490625409 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc1900671f0 0x7fc190148bd0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:58.773 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.767+0000 7fc194cae700 1 -- 172.21.15.57:0/3490625409 >> 172.21.15.57:0/3490625409 conn(0x7fc1900cbdd0 msgr2=0x7fc190149580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:58.773 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.767+0000 7fc194cae700 1 -- 172.21.15.57:0/3490625409 shutdown_connections 2023-10-06T03:00:58.773 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.767+0000 7fc194cae700 1 -- 172.21.15.57:0/3490625409 wait complete. 2023-10-06T03:00:58.796 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-06T03:00:58.965 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.959+0000 7f4be10f0700 1 Processor -- start 2023-10-06T03:00:58.966 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.959+0000 7f4be10f0700 1 -- start start 2023-10-06T03:00:58.967 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.963+0000 7f4be10f0700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4bdc155780 0x7f4bdc0acdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:58.968 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.963+0000 7f4be10f0700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f4bdc06d560 0x7f4bdc06d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:58.968 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.963+0000 7f4be10f0700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bdc06d0d0 con 0x7f4bdc1553b0 2023-10-06T03:00:58.968 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.963+0000 7f4be10f0700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bdc0ad330 con 0x7f4bdc155780 2023-10-06T03:00:58.968 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.963+0000 7f4be10f0700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bdc06b850 con 0x7f4bdc06d560 2023-10-06T03:00:58.968 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.963+0000 7f4bdad9d700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f4bdc1553b0 0x7f4bdc06b140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:43268/0 (socket says 172.21.15.57:43268) 2023-10-06T03:00:58.968 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.963+0000 7f4bdad9d700 1 -- 172.21.15.57:0/2803571535 learned_addr learned my addr 172.21.15.57:0/2803571535 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:00:58.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.963+0000 7f4bda59c700 1 --2- 172.21.15.57:0/2803571535 >> v2:172.21.15.57:3300/0 conn(0x7f4bdc155780 0x7f4bdc0acdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:58.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.963+0000 7f4bdb59e700 1 --2- 172.21.15.57:0/2803571535 >> v2:172.21.15.105:3300/0 conn(0x7f4bdc06d560 0x7f4bdc06d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:58.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.963+0000 7f4bda59c700 1 -- 172.21.15.57:0/2803571535 >> v2:172.21.15.105:3300/0 conn(0x7f4bdc06d560 msgr2=0x7f4bdc06d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:00:58.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.963+0000 7f4bda59c700 1 --2- 172.21.15.57:0/2803571535 >> v2:172.21.15.105:3300/0 conn(0x7f4bdc06d560 0x7f4bdc06d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:58.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.963+0000 7f4bda59c700 1 -- 172.21.15.57:0/2803571535 >> v1:172.21.15.57:6789/0 conn(0x7f4bdc1553b0 legacy=0x7f4bdc06b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:58.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.963+0000 7f4bda59c700 1 -- 172.21.15.57:0/2803571535 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bdc06cac0 con 0x7f4bdc155780 2023-10-06T03:00:58.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.963+0000 7f4bda59c700 1 --2- 172.21.15.57:0/2803571535 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4bdc155780 0x7f4bdc0acdf0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc0bfd70 tx=0x7f4bd00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20029c5616c1d6fe server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:58.971 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.963+0000 7f4bd9d9b700 1 -- 172.21.15.57:0/2803571535 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd0011630 con 0x7f4bdc155780 2023-10-06T03:00:58.971 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.967+0000 7f4bd9d9b700 1 -- 172.21.15.57:0/2803571535 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bd0011790 con 0x7f4bdc155780 2023-10-06T03:00:58.971 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.967+0000 7f4bd9d9b700 1 -- 172.21.15.57:0/2803571535 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd0011b30 con 0x7f4bdc155780 2023-10-06T03:00:58.972 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.967+0000 7f4be10f0700 1 -- 172.21.15.57:0/2803571535 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4bdc155780 msgr2=0x7f4bdc0acdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:58.972 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.967+0000 7f4be10f0700 1 --2- 172.21.15.57:0/2803571535 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4bdc155780 0x7f4bdc0acdf0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc0bfd70 tx=0x7f4bd00091a0 comp rx=0 tx=0).stop 2023-10-06T03:00:58.972 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.967+0000 7f4be10f0700 1 -- 172.21.15.57:0/2803571535 shutdown_connections 2023-10-06T03:00:58.972 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.967+0000 7f4be10f0700 1 --2- 172.21.15.57:0/2803571535 >> v2:172.21.15.105:3300/0 conn(0x7f4bdc06d560 0x7f4bdc06d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:58.972 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.967+0000 7f4be10f0700 1 --2- 172.21.15.57:0/2803571535 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4bdc155780 0x7f4bdc0acdf0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:58.972 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.967+0000 7f4be10f0700 1 -- 172.21.15.57:0/2803571535 >> 172.21.15.57:0/2803571535 conn(0x7f4bdc067fb0 msgr2=0x7f4bdc0cc5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:00:58.972 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.967+0000 7f4be10f0700 1 -- 172.21.15.57:0/2803571535 shutdown_connections 2023-10-06T03:00:58.972 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.967+0000 7f4be10f0700 1 -- 172.21.15.57:0/2803571535 wait complete. 2023-10-06T03:00:58.974 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.967+0000 7f4be10f0700 1 Processor -- start 2023-10-06T03:00:58.974 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.967+0000 7f4be10f0700 1 -- start start 2023-10-06T03:00:58.975 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.971+0000 7f4be10f0700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4bdc06d560 0x7f4bdc166510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:58.975 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.971+0000 7f4be10f0700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4bdc1553b0 0x7f4bdc169100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:58.975 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.971+0000 7f4be10f0700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4bdc155780 0x7f4bdc169640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:58.975 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.971+0000 7f4be10f0700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bdc158610 con 0x7f4bdc155780 2023-10-06T03:00:58.975 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.971+0000 7f4be10f0700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bdc169ca0 con 0x7f4bdc06d560 2023-10-06T03:00:58.976 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.971+0000 7f4be10f0700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bdc169f80 con 0x7f4bdc1553b0 2023-10-06T03:00:58.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.971+0000 7f4bdb59e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4bdc155780 0x7f4bdc169640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:58.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.971+0000 7f4bdb59e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4bdc155780 0x7f4bdc169640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44946/0 (socket says 172.21.15.57:44946) 2023-10-06T03:00:58.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.971+0000 7f4bdb59e700 1 -- 172.21.15.57:0/3723055704 learned_addr learned my addr 172.21.15.57:0/3723055704 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:00:58.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.971+0000 7f4bda59c700 1 --2- 172.21.15.57:0/3723055704 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4bdc1553b0 0x7f4bdc169100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:58.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.971+0000 7f4bdad9d700 1 --2- 172.21.15.57:0/3723055704 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4bdc06d560 0x7f4bdc166510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:58.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.971+0000 7f4bdb59e700 1 -- 172.21.15.57:0/3723055704 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4bdc1553b0 msgr2=0x7f4bdc169100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:58.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.971+0000 7f4bdb59e700 1 --2- 172.21.15.57:0/3723055704 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4bdc1553b0 0x7f4bdc169100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:58.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.971+0000 7f4bdb59e700 1 -- 172.21.15.57:0/3723055704 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4bdc06d560 msgr2=0x7f4bdc166510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:00:58.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.971+0000 7f4bdb59e700 1 --2- 172.21.15.57:0/3723055704 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4bdc06d560 0x7f4bdc166510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:00:58.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.971+0000 7f4bdb59e700 1 -- 172.21.15.57:0/3723055704 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bd0009420 con 0x7f4bdc155780 2023-10-06T03:00:58.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.971+0000 7f4bdad9d700 1 --2- 172.21.15.57:0/3723055704 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4bdc06d560 0x7f4bdc166510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:00:58.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.971+0000 7f4bdb59e700 1 --2- 172.21.15.57:0/3723055704 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4bdc155780 0x7f4bdc169640 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4bd4009e90 tx=0x7f4bd400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:58.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.971+0000 7f4bc2ffd700 1 -- 172.21.15.57:0/3723055704 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd400cc20 con 0x7f4bdc155780 2023-10-06T03:00:58.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.971+0000 7f4bc2ffd700 1 -- 172.21.15.57:0/3723055704 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bd400f040 con 0x7f4bdc155780 2023-10-06T03:00:58.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.971+0000 7f4bc2ffd700 1 -- 172.21.15.57:0/3723055704 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd4014480 con 0x7f4bdc155780 2023-10-06T03:00:58.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.971+0000 7f4be10f0700 1 -- 172.21.15.57:0/3723055704 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bdc16a2d0 con 0x7f4bdc155780 2023-10-06T03:00:58.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.971+0000 7f4be10f0700 1 -- 172.21.15.57:0/3723055704 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bdc16a890 con 0x7f4bdc155780 2023-10-06T03:00:58.980 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.975+0000 7f4be10f0700 1 -- 172.21.15.57:0/3723055704 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bdc16aa80 con 0x7f4bdc155780 2023-10-06T03:00:58.981 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.975+0000 7f4bc2ffd700 1 -- 172.21.15.57:0/3723055704 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f4bd4014830 con 0x7f4bdc155780 2023-10-06T03:00:58.982 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.975+0000 7f4bc2ffd700 1 --2- 172.21.15.57:0/3723055704 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f4bc8060550 0x7f4bc8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:00:58.983 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.979+0000 7f4bc2ffd700 1 -- 172.21.15.57:0/3723055704 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4bd407d400 con 0x7f4bdc155780 2023-10-06T03:00:58.983 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.979+0000 7f4bdad9d700 1 --2- 172.21.15.57:0/3723055704 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f4bc8060550 0x7f4bc8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:00:58.984 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.979+0000 7f4bdad9d700 1 --2- 172.21.15.57:0/3723055704 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f4bc8060550 0x7f4bc8062a00 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4bcc0018c0 tx=0x7f4bcc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:00:58.992 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:58.987+0000 7f4bc2ffd700 1 -- 172.21.15.57:0/3723055704 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f4bd4051280 con 0x7f4bdc155780 2023-10-06T03:00:59.198 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:59.191+0000 7f4be10f0700 1 -- 172.21.15.57:0/3723055704 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f4bdc0712e0 con 0x7f4bdc155780 2023-10-06T03:01:00.003 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:00:59.999+0000 7f4bc2ffd700 1 -- 172.21.15.57:0/3723055704 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7f4bd4050e10 con 0x7f4bdc155780 2023-10-06T03:01:00.008 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:00.003+0000 7f4be10f0700 1 -- 172.21.15.57:0/3723055704 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f4bc8060550 msgr2=0x7f4bc8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:00.008 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:00.003+0000 7f4be10f0700 1 --2- 172.21.15.57:0/3723055704 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f4bc8060550 0x7f4bc8062a00 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4bcc0018c0 tx=0x7f4bcc009040 comp rx=0 tx=0).stop 2023-10-06T03:01:00.008 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:00.003+0000 7f4be10f0700 1 -- 172.21.15.57:0/3723055704 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4bdc155780 msgr2=0x7f4bdc169640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:00.008 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:00.003+0000 7f4be10f0700 1 --2- 172.21.15.57:0/3723055704 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4bdc155780 0x7f4bdc169640 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4bd4009e90 tx=0x7f4bd400b040 comp rx=0 tx=0).stop 2023-10-06T03:01:00.009 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:00.003+0000 7f4be10f0700 1 -- 172.21.15.57:0/3723055704 shutdown_connections 2023-10-06T03:01:00.009 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:00.003+0000 7f4be10f0700 1 --2- 172.21.15.57:0/3723055704 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4bdc155780 0x7f4bdc169640 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:00.009 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:00.003+0000 7f4be10f0700 1 --2- 172.21.15.57:0/3723055704 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f4bc8060550 0x7f4bc8062a00 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:00.009 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:00.003+0000 7f4be10f0700 1 --2- 172.21.15.57:0/3723055704 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4bdc1553b0 0x7f4bdc169100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:00.010 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:00.003+0000 7f4be10f0700 1 --2- 172.21.15.57:0/3723055704 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4bdc06d560 0x7f4bdc166510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:00.010 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:00.003+0000 7f4be10f0700 1 -- 172.21.15.57:0/3723055704 >> 172.21.15.57:0/3723055704 conn(0x7f4bdc067fb0 msgr2=0x7f4bdc0c1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:00.010 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:00.003+0000 7f4be10f0700 1 -- 172.21.15.57:0/3723055704 shutdown_connections 2023-10-06T03:01:00.010 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:00.003+0000 7f4be10f0700 1 -- 172.21.15.57:0/3723055704 wait complete. 2023-10-06T03:01:00.031 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-06T03:01:00.204 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:00.199+0000 7f5d8a545700 1 Processor -- start 2023-10-06T03:01:00.205 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:00.199+0000 7f5d8a545700 1 -- start start 2023-10-06T03:01:00.208 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:00.203+0000 7f5d8a545700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5d84155bd0 0x7f5d84155fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:00.208 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:00.203+0000 7f5d8a545700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5d840acf50 0x7f5d8415a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:00.208 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:00.203+0000 7f5d8a545700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d840ae040 con 0x7f5d840c7830 2023-10-06T03:01:00.208 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:00.203+0000 7f5d8a545700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d8406aba0 con 0x7f5d84155bd0 2023-10-06T03:01:00.208 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:00.203+0000 7f5d8a545700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d840ad430 con 0x7f5d840acf50 2023-10-06T03:01:00.209 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:00.203+0000 7f5d83fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5d84155bd0 0x7f5d84155fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:00.209 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:00.203+0000 7f5d83fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5d84155bd0 0x7f5d84155fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44948/0 (socket says 172.21.15.57:44948) 2023-10-06T03:01:00.209 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:00.203+0000 7f5d88ae2700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f5d840c7830 0x7f5d840c62e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:43270/0 (socket says 172.21.15.57:43270) 2023-10-06T03:01:00.209 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:00.203+0000 7f5d83fff700 1 -- 172.21.15.57:0/439773109 learned_addr learned my addr 172.21.15.57:0/439773109 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:00.210 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:00.203+0000 7f5d837fe700 1 --2- 172.21.15.57:0/439773109 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5d840acf50 0x7f5d8415a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:00.210 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:00.203+0000 7f5d83fff700 1 -- 172.21.15.57:0/439773109 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5d840acf50 msgr2=0x7f5d8415a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:00.210 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:00.203+0000 7f5d83fff700 1 --2- 172.21.15.57:0/439773109 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5d840acf50 0x7f5d8415a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:00.210 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:00.203+0000 7f5d83fff700 1 -- 172.21.15.57:0/439773109 >> v1:172.21.15.57:6789/0 conn(0x7f5d840c7830 legacy=0x7f5d840c62e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:00.210 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:00.203+0000 7f5d83fff700 1 -- 172.21.15.57:0/439773109 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d840ad710 con 0x7f5d84155bd0 2023-10-06T03:01:00.211 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:00.203+0000 7f5d83fff700 1 --2- 172.21.15.57:0/439773109 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5d84155bd0 0x7f5d84155fa0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5d7400bc50 tx=0x7f5d7400b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67928591eab604b0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:00.211 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:00.203+0000 7f5d82ffd700 1 -- 172.21.15.57:0/439773109 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d7400dbf0 con 0x7f5d84155bd0 2023-10-06T03:01:00.211 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:00.203+0000 7f5d82ffd700 1 -- 172.21.15.57:0/439773109 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d7400dd50 con 0x7f5d84155bd0 2023-10-06T03:01:00.211 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:00.203+0000 7f5d82ffd700 1 -- 172.21.15.57:0/439773109 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d740196b0 con 0x7f5d84155bd0 2023-10-06T03:01:00.212 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:00.207+0000 7f5d8a545700 1 -- 172.21.15.57:0/439773109 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5d84155bd0 msgr2=0x7f5d84155fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:00.212 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:00.207+0000 7f5d8a545700 1 --2- 172.21.15.57:0/439773109 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5d84155bd0 0x7f5d84155fa0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5d7400bc50 tx=0x7f5d7400b4f0 comp rx=0 tx=0).stop 2023-10-06T03:01:00.212 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:00.207+0000 7f5d8a545700 1 -- 172.21.15.57:0/439773109 shutdown_connections 2023-10-06T03:01:00.212 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:00.207+0000 7f5d8a545700 1 --2- 172.21.15.57:0/439773109 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5d840acf50 0x7f5d8415a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:00.212 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:00.207+0000 7f5d8a545700 1 --2- 172.21.15.57:0/439773109 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5d84155bd0 0x7f5d84155fa0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:00.212 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:00.207+0000 7f5d8a545700 1 -- 172.21.15.57:0/439773109 >> 172.21.15.57:0/439773109 conn(0x7f5d840c87b0 msgr2=0x7f5d840c8bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:00.212 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:00.207+0000 7f5d8a545700 1 -- 172.21.15.57:0/439773109 shutdown_connections 2023-10-06T03:01:00.212 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:00.207+0000 7f5d8a545700 1 -- 172.21.15.57:0/439773109 wait complete. 2023-10-06T03:01:00.214 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:00.207+0000 7f5d8a545700 1 Processor -- start 2023-10-06T03:01:00.214 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:00.211+0000 7f5d8a545700 1 -- start start 2023-10-06T03:01:00.217 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:00.211+0000 7f5d8a545700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5d840acf50 0x7f5d840b1420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:00.217 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:00.211+0000 7f5d8a545700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5d840c7830 0x7f5d84154110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:00.217 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:00.211+0000 7f5d8a545700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5d84155bd0 0x7f5d840c31e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:00.217 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:00.211+0000 7f5d8a545700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d84158480 con 0x7f5d840c7830 2023-10-06T03:01:00.217 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:00.211+0000 7f5d8a545700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d84158760 con 0x7f5d84155bd0 2023-10-06T03:01:00.217 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:00.211+0000 7f5d8a545700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d84158a40 con 0x7f5d840acf50 2023-10-06T03:01:00.217 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:00.211+0000 7f5d837fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5d840c7830 0x7f5d84154110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:00.217 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:00.211+0000 7f5d837fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5d840c7830 0x7f5d84154110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44960/0 (socket says 172.21.15.57:44960) 2023-10-06T03:01:00.218 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:00.211+0000 7f5d837fe700 1 -- 172.21.15.57:0/654029679 learned_addr learned my addr 172.21.15.57:0/654029679 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:00.218 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:00.211+0000 7f5d83fff700 1 --2- 172.21.15.57:0/654029679 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5d840acf50 0x7f5d840b1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:00.218 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:00.211+0000 7f5d88ae2700 1 --2- 172.21.15.57:0/654029679 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5d84155bd0 0x7f5d840c31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:00.219 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:00.211+0000 7f5d837fe700 1 -- 172.21.15.57:0/654029679 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5d840acf50 msgr2=0x7f5d840b1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:00.219 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:00.211+0000 7f5d837fe700 1 --2- 172.21.15.57:0/654029679 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5d840acf50 0x7f5d840b1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:00.219 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:00.211+0000 7f5d837fe700 1 -- 172.21.15.57:0/654029679 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5d84155bd0 msgr2=0x7f5d840c31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:00.219 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:00.211+0000 7f5d837fe700 1 --2- 172.21.15.57:0/654029679 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5d84155bd0 0x7f5d840c31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:00.219 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:00.211+0000 7f5d837fe700 1 -- 172.21.15.57:0/654029679 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d7400b790 con 0x7f5d840c7830 2023-10-06T03:01:00.219 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:00.211+0000 7f5d837fe700 1 --2- 172.21.15.57:0/654029679 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5d840c7830 0x7f5d84154110 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5d7800ec50 tx=0x7f5d780091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:00.220 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:00.211+0000 7f5d6bfff700 1 -- 172.21.15.57:0/654029679 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d7800c850 con 0x7f5d840c7830 2023-10-06T03:01:00.220 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:00.215+0000 7f5d6bfff700 1 -- 172.21.15.57:0/654029679 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d7800c9b0 con 0x7f5d840c7830 2023-10-06T03:01:00.220 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:00.215+0000 7f5d6bfff700 1 -- 172.21.15.57:0/654029679 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d7800cd70 con 0x7f5d840c7830 2023-10-06T03:01:00.220 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:00.215+0000 7f5d8a545700 1 -- 172.21.15.57:0/654029679 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d84158d20 con 0x7f5d840c7830 2023-10-06T03:01:00.220 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:00.215+0000 7f5d8a545700 1 -- 172.21.15.57:0/654029679 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d841580e0 con 0x7f5d840c7830 2023-10-06T03:01:00.220 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:00.215+0000 7f5d8a545700 1 -- 172.21.15.57:0/654029679 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d840c2b20 con 0x7f5d840c7830 2023-10-06T03:01:00.222 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:00.215+0000 7f5d6bfff700 1 -- 172.21.15.57:0/654029679 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f5d78013680 con 0x7f5d840c7830 2023-10-06T03:01:00.223 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:00.219+0000 7f5d6bfff700 1 --2- 172.21.15.57:0/654029679 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f5d70060550 0x7f5d70062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:00.224 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:00.219+0000 7f5d6bfff700 1 -- 172.21.15.57:0/654029679 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5d7807cc20 con 0x7f5d840c7830 2023-10-06T03:01:00.224 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:00.219+0000 7f5d83fff700 1 --2- 172.21.15.57:0/654029679 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f5d70060550 0x7f5d70062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:00.225 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:00.219+0000 7f5d83fff700 1 --2- 172.21.15.57:0/654029679 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f5d70060550 0x7f5d70062a00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5d7400bc50 tx=0x7f5d7401b000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:00.229 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:00.223+0000 7f5d6bfff700 1 -- 172.21.15.57:0/654029679 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f5d840c2b20 con 0x7f5d840c7830 2023-10-06T03:01:00.437 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:00.431+0000 7f5d8a545700 1 -- 172.21.15.57:0/654029679 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f5d840c9c10 con 0x7f5d840c7830 2023-10-06T03:01:01.021 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.015+0000 7f5d6bfff700 1 -- 172.21.15.57:0/654029679 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f5d840c9c10 con 0x7f5d840c7830 2023-10-06T03:01:01.025 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.019+0000 7f5d8a545700 1 -- 172.21.15.57:0/654029679 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f5d70060550 msgr2=0x7f5d70062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:01.025 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.019+0000 7f5d8a545700 1 --2- 172.21.15.57:0/654029679 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f5d70060550 0x7f5d70062a00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5d7400bc50 tx=0x7f5d7401b000 comp rx=0 tx=0).stop 2023-10-06T03:01:01.025 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.019+0000 7f5d8a545700 1 -- 172.21.15.57:0/654029679 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5d840c7830 msgr2=0x7f5d84154110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:01.025 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.019+0000 7f5d8a545700 1 --2- 172.21.15.57:0/654029679 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5d840c7830 0x7f5d84154110 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5d7800ec50 tx=0x7f5d780091a0 comp rx=0 tx=0).stop 2023-10-06T03:01:01.025 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.019+0000 7f5d8a545700 1 -- 172.21.15.57:0/654029679 shutdown_connections 2023-10-06T03:01:01.025 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.019+0000 7f5d8a545700 1 --2- 172.21.15.57:0/654029679 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5d84155bd0 0x7f5d840c31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:01.025 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.019+0000 7f5d8a545700 1 --2- 172.21.15.57:0/654029679 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5d840c7830 0x7f5d84154110 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:01.026 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.019+0000 7f5d8a545700 1 --2- 172.21.15.57:0/654029679 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f5d70060550 0x7f5d70062a00 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:01.026 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.019+0000 7f5d8a545700 1 --2- 172.21.15.57:0/654029679 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5d840acf50 0x7f5d840b1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:01.026 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.019+0000 7f5d8a545700 1 -- 172.21.15.57:0/654029679 >> 172.21.15.57:0/654029679 conn(0x7f5d840c87b0 msgr2=0x7f5d840ca790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:01.026 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.019+0000 7f5d8a545700 1 -- 172.21.15.57:0/654029679 shutdown_connections 2023-10-06T03:01:01.026 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.019+0000 7f5d8a545700 1 -- 172.21.15.57:0/654029679 wait complete. 2023-10-06T03:01:01.043 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:01:01.208 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.203+0000 7f5195c6b700 1 Processor -- start 2023-10-06T03:01:01.208 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.203+0000 7f5195c6b700 1 -- start start 2023-10-06T03:01:01.217 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.207+0000 7f5195c6b700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f519006c920 0x7f51900aa7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:01.217 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.207+0000 7f5195c6b700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f51900aae90 0x7f519006bba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:01.217 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.207+0000 7f5195c6b700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f519006de50 con 0x7f519006ccf0 2023-10-06T03:01:01.218 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.207+0000 7f5195c6b700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f519006e130 con 0x7f519006c920 2023-10-06T03:01:01.218 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.207+0000 7f5195c6b700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f519006b3a0 con 0x7f51900aae90 2023-10-06T03:01:01.218 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.207+0000 7f518ffff700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f51900aae90 0x7f519006bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:01.218 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.207+0000 7f518ffff700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f51900aae90 0x7f519006bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.57:42056/0 (socket says 172.21.15.57:42056) 2023-10-06T03:01:01.218 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.207+0000 7f518ffff700 1 -- 172.21.15.57:0/1686387664 learned_addr learned my addr 172.21.15.57:0/1686387664 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:01.219 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.207+0000 7f5194c69700 1 --2- 172.21.15.57:0/1686387664 >> v2:172.21.15.105:3300/0 conn(0x7f519006c920 0x7f51900aa7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:01.219 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.207+0000 7f518ffff700 1 -- 172.21.15.57:0/1686387664 >> v2:172.21.15.105:3300/0 conn(0x7f519006c920 msgr2=0x7f51900aa7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:01.219 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.207+0000 7f518ffff700 1 --2- 172.21.15.57:0/1686387664 >> v2:172.21.15.105:3300/0 conn(0x7f519006c920 0x7f51900aa7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:01.219 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.207+0000 7f518ffff700 1 -- 172.21.15.57:0/1686387664 >> v1:172.21.15.105:6789/0 conn(0x7f519006ccf0 legacy=0x7f51900c64c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:01.219 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.207+0000 7f518ffff700 1 -- 172.21.15.57:0/1686387664 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f519006b680 con 0x7f51900aae90 2023-10-06T03:01:01.219 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.207+0000 7f518ffff700 1 --2- 172.21.15.57:0/1686387664 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f51900aae90 0x7f519006bba0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f517c0099b0 tx=0x7f517c009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a996ed48410f29f5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:01.220 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.207+0000 7f518f7fe700 1 -- 172.21.15.57:0/1686387664 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f517c009ea0 con 0x7f51900aae90 2023-10-06T03:01:01.220 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.207+0000 7f518f7fe700 1 -- 172.21.15.57:0/1686387664 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f517c00b860 con 0x7f51900aae90 2023-10-06T03:01:01.220 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.207+0000 7f518f7fe700 1 -- 172.21.15.57:0/1686387664 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f517c00bc00 con 0x7f51900aae90 2023-10-06T03:01:01.220 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.211+0000 7f5195c6b700 1 -- 172.21.15.57:0/1686387664 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f51900aae90 msgr2=0x7f519006bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:01.220 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.211+0000 7f5195c6b700 1 --2- 172.21.15.57:0/1686387664 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f51900aae90 0x7f519006bba0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f517c0099b0 tx=0x7f517c009250 comp rx=0 tx=0).stop 2023-10-06T03:01:01.220 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.211+0000 7f5195c6b700 1 -- 172.21.15.57:0/1686387664 shutdown_connections 2023-10-06T03:01:01.220 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.211+0000 7f5195c6b700 1 --2- 172.21.15.57:0/1686387664 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f51900aae90 0x7f519006bba0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:01.221 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.211+0000 7f5195c6b700 1 --2- 172.21.15.57:0/1686387664 >> v2:172.21.15.105:3300/0 conn(0x7f519006c920 0x7f51900aa7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:01.221 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.211+0000 7f5195c6b700 1 -- 172.21.15.57:0/1686387664 >> 172.21.15.57:0/1686387664 conn(0x7f51900c85e0 msgr2=0x7f51900c89e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:01.221 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.211+0000 7f5195c6b700 1 -- 172.21.15.57:0/1686387664 shutdown_connections 2023-10-06T03:01:01.221 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.211+0000 7f5195c6b700 1 -- 172.21.15.57:0/1686387664 wait complete. 2023-10-06T03:01:01.224 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.211+0000 7f5195c6b700 1 Processor -- start 2023-10-06T03:01:01.224 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.215+0000 7f5195c6b700 1 -- start start 2023-10-06T03:01:01.225 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.215+0000 7f5195c6b700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f519006c920 0x7f51900af8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:01.225 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.215+0000 7f5195c6b700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f519006ccf0 0x7f519016d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:01.225 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.215+0000 7f5195c6b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f51900aae90 0x7f519016dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:01.225 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.215+0000 7f5195c6b700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51900c1c80 con 0x7f51900aae90 2023-10-06T03:01:01.225 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.215+0000 7f5195c6b700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51900c0be0 con 0x7f519006c920 2023-10-06T03:01:01.225 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.215+0000 7f5195c6b700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51900c0ec0 con 0x7f519006ccf0 2023-10-06T03:01:01.225 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.215+0000 7f519546a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f51900aae90 0x7f519016dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:01.226 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.215+0000 7f519546a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f51900aae90 0x7f519016dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44976/0 (socket says 172.21.15.57:44976) 2023-10-06T03:01:01.226 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.215+0000 7f519546a700 1 -- 172.21.15.57:0/3583758309 learned_addr learned my addr 172.21.15.57:0/3583758309 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:01.226 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.215+0000 7f5194c69700 1 --2- 172.21.15.57:0/3583758309 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f519006c920 0x7f51900af8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:01.226 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.215+0000 7f518ffff700 1 --2- 172.21.15.57:0/3583758309 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f519006ccf0 0x7f519016d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:01.226 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.215+0000 7f519546a700 1 -- 172.21.15.57:0/3583758309 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f519006ccf0 msgr2=0x7f519016d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:01.226 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.215+0000 7f519546a700 1 --2- 172.21.15.57:0/3583758309 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f519006ccf0 0x7f519016d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:01.226 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.215+0000 7f519546a700 1 -- 172.21.15.57:0/3583758309 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f519006c920 msgr2=0x7f51900af8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:01.227 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.215+0000 7f519546a700 1 --2- 172.21.15.57:0/3583758309 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f519006c920 0x7f51900af8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:01.227 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.215+0000 7f519546a700 1 -- 172.21.15.57:0/3583758309 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f517c0094f0 con 0x7f51900aae90 2023-10-06T03:01:01.227 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.215+0000 7f519546a700 1 --2- 172.21.15.57:0/3583758309 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f51900aae90 0x7f519016dbf0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f518800c8e0 tx=0x7f5188001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:01.227 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.215+0000 7f518cff9700 1 -- 172.21.15.57:0/3583758309 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5188012630 con 0x7f51900aae90 2023-10-06T03:01:01.227 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.215+0000 7f518cff9700 1 -- 172.21.15.57:0/3583758309 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5188012790 con 0x7f51900aae90 2023-10-06T03:01:01.227 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.215+0000 7f518cff9700 1 -- 172.21.15.57:0/3583758309 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5188012b50 con 0x7f51900aae90 2023-10-06T03:01:01.227 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.215+0000 7f5195c6b700 1 -- 172.21.15.57:0/3583758309 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51900c11a0 con 0x7f51900aae90 2023-10-06T03:01:01.228 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.219+0000 7f5195c6b700 1 -- 172.21.15.57:0/3583758309 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51900c1760 con 0x7f51900aae90 2023-10-06T03:01:01.228 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.219+0000 7f5195c6b700 1 -- 172.21.15.57:0/3583758309 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51900c1950 con 0x7f51900aae90 2023-10-06T03:01:01.229 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.219+0000 7f518cff9700 1 -- 172.21.15.57:0/3583758309 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f518801a3a0 con 0x7f51900aae90 2023-10-06T03:01:01.229 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.223+0000 7f518cff9700 1 --2- 172.21.15.57:0/3583758309 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f5174060550 0x7f5174062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:01.229 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.223+0000 7f518cff9700 1 -- 172.21.15.57:0/3583758309 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f518807cb40 con 0x7f51900aae90 2023-10-06T03:01:01.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.223+0000 7f5194c69700 1 --2- 172.21.15.57:0/3583758309 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f5174060550 0x7f5174062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:01.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.223+0000 7f5194c69700 1 --2- 172.21.15.57:0/3583758309 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f5174060550 0x7f5174062a00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f51900c0680 tx=0x7f51840091a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:01.236 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.231+0000 7f518cff9700 1 -- 172.21.15.57:0/3583758309 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f518804cf30 con 0x7f51900aae90 2023-10-06T03:01:01.443 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.439+0000 7f5195c6b700 1 -- 172.21.15.57:0/3583758309 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f519004be40 con 0x7f51900aae90 2023-10-06T03:01:01.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.439+0000 7f518cff9700 1 -- 172.21.15.57:0/3583758309 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4594 (secure 0 0 0) 0x7f5188050550 con 0x7f51900aae90 2023-10-06T03:01:01.445 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:01:01.445 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6834/1042131376","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":1042131376},{"type":"v1","addr":"172.21.15.105:6834","nonce":1042131376}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4287,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6836/3619570714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":3619570714},{"type":"v1","addr":"172.21.15.57:6836","nonce":3619570714}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6837/645924568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6835","nonce":645924568},{"type":"v1","addr":"172.21.15.57:6837","nonce":645924568}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:00:57.411689+0000","modified":"2023-10-06T03:01:00.999490+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4303},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4303":{"gid":4303,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6835/1286071598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":1286071598},{"type":"v1","addr":"172.21.15.105:6835","nonce":1286071598}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T03:01:01.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.443+0000 7f5195c6b700 1 -- 172.21.15.57:0/3583758309 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f5174060550 msgr2=0x7f5174062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:01.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.443+0000 7f5195c6b700 1 --2- 172.21.15.57:0/3583758309 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f5174060550 0x7f5174062a00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f51900c0680 tx=0x7f51840091a0 comp rx=0 tx=0).stop 2023-10-06T03:01:01.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.443+0000 7f5195c6b700 1 -- 172.21.15.57:0/3583758309 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f51900aae90 msgr2=0x7f519016dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:01.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.443+0000 7f5195c6b700 1 --2- 172.21.15.57:0/3583758309 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f51900aae90 0x7f519016dbf0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f518800c8e0 tx=0x7f5188001710 comp rx=0 tx=0).stop 2023-10-06T03:01:01.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.443+0000 7f5195c6b700 1 -- 172.21.15.57:0/3583758309 shutdown_connections 2023-10-06T03:01:01.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.443+0000 7f5195c6b700 1 --2- 172.21.15.57:0/3583758309 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f51900aae90 0x7f519016dbf0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:01.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.443+0000 7f5195c6b700 1 --2- 172.21.15.57:0/3583758309 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f5174060550 0x7f5174062a00 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:01.449 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.443+0000 7f5195c6b700 1 --2- 172.21.15.57:0/3583758309 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f519006ccf0 0x7f519016d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:01.449 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.443+0000 7f5195c6b700 1 --2- 172.21.15.57:0/3583758309 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f519006c920 0x7f51900af8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:01.449 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.443+0000 7f5195c6b700 1 -- 172.21.15.57:0/3583758309 >> 172.21.15.57:0/3583758309 conn(0x7f51900c85e0 msgr2=0x7f51900c89b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:01.449 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.443+0000 7f5195c6b700 1 -- 172.21.15.57:0/3583758309 shutdown_connections 2023-10-06T03:01:01.450 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.443+0000 7f5195c6b700 1 -- 172.21.15.57:0/3583758309 wait complete. 2023-10-06T03:01:01.451 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 8 2023-10-06T03:01:01.469 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:01:01.634 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.627+0000 7f9aa7945700 1 Processor -- start 2023-10-06T03:01:01.634 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.627+0000 7f9aa7945700 1 -- start start 2023-10-06T03:01:01.637 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.631+0000 7f9aa7945700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f9aa0159280 0x7f9aa00ca420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:01.637 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.631+0000 7f9aa7945700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9aa00c7420 con 0x7f9aa00cb180 2023-10-06T03:01:01.637 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.631+0000 7f9aa7945700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9aa015dd10 con 0x7f9aa00cad00 2023-10-06T03:01:01.637 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.631+0000 7f9aa7945700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9aa00ca960 con 0x7f9aa0159280 2023-10-06T03:01:01.638 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.631+0000 7f9aa5ee2700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f9aa00cb180 0x7f9aa00c7fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:43282/0 (socket says 172.21.15.57:43282) 2023-10-06T03:01:01.638 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.631+0000 7f9aa5ee2700 1 -- 172.21.15.57:0/4215559855 learned_addr learned my addr 172.21.15.57:0/4215559855 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:01:01.638 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.631+0000 7f9aa56e1700 1 --2- 172.21.15.57:0/4215559855 >> v2:172.21.15.105:3300/0 conn(0x7f9aa0159280 0x7f9aa00ca420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:01.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.631+0000 7f9a97fff700 1 -- 172.21.15.57:0/4215559855 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1568149090 0 0) 0x7f9aa00c7420 con 0x7f9aa00cb180 2023-10-06T03:01:01.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.631+0000 7f9a97fff700 1 -- 172.21.15.57:0/4215559855 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a8c003570 con 0x7f9aa00cb180 2023-10-06T03:01:01.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.631+0000 7f9a97fff700 1 -- 172.21.15.57:0/4215559855 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2056265803 0 0) 0x7f9aa015dd10 con 0x7f9aa00cad00 2023-10-06T03:01:01.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.631+0000 7f9a97fff700 1 -- 172.21.15.57:0/4215559855 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9aa00c7420 con 0x7f9aa00cad00 2023-10-06T03:01:01.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.631+0000 7f9a97fff700 1 -- 172.21.15.57:0/4215559855 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 619725921 0 0) 0x7f9a8c003570 con 0x7f9aa00cb180 2023-10-06T03:01:01.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.635+0000 7f9a97fff700 1 -- 172.21.15.57:0/4215559855 >> v2:172.21.15.105:3300/0 conn(0x7f9aa0159280 msgr2=0x7f9aa00ca420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:01.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.635+0000 7f9a97fff700 1 --2- 172.21.15.57:0/4215559855 >> v2:172.21.15.105:3300/0 conn(0x7f9aa0159280 0x7f9aa00ca420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:01.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.635+0000 7f9a97fff700 1 -- 172.21.15.57:0/4215559855 >> v1:172.21.15.105:6789/0 conn(0x7f9aa00cad00 legacy=0x7f9aa00c7890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:01.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.635+0000 7f9a97fff700 1 -- 172.21.15.57:0/4215559855 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9aa015a660 con 0x7f9aa00cb180 2023-10-06T03:01:01.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.635+0000 7f9a97fff700 1 -- 172.21.15.57:0/4215559855 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2482400018 0 0) 0x7f9a980017f0 con 0x7f9aa00cb180 2023-10-06T03:01:01.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.635+0000 7f9a97fff700 1 -- 172.21.15.57:0/4215559855 >> v1:172.21.15.57:6789/0 conn(0x7f9aa00cb180 legacy=0x7f9aa00c7fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:01.641 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.635+0000 7f9a97fff700 1 --2- 172.21.15.57:0/4215559855 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9a8c003bf0 0x7f9a8c003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:01.641 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.635+0000 7f9a97fff700 1 --2- 172.21.15.57:0/4215559855 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9a8c004810 0x7f9a8c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:01.641 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.635+0000 7f9a97fff700 1 --2- 172.21.15.57:0/4215559855 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a8c0051c0 0x7f9a8c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:01.641 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.635+0000 7f9a97fff700 1 -- 172.21.15.57:0/4215559855 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa00ca960 con 0x7f9a8c0051c0 2023-10-06T03:01:01.641 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.635+0000 7f9a97fff700 1 -- 172.21.15.57:0/4215559855 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a8c00c0b0 con 0x7f9a8c004810 2023-10-06T03:01:01.641 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.635+0000 7f9a97fff700 1 -- 172.21.15.57:0/4215559855 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a8c00c270 con 0x7f9a8c003bf0 2023-10-06T03:01:01.641 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.635+0000 7f9aa5ee2700 1 --2- 172.21.15.57:0/4215559855 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a8c0051c0 0x7f9a8c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:01.643 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.635+0000 7f9aa56e1700 1 --2- 172.21.15.57:0/4215559855 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9a8c003bf0 0x7f9a8c003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:01.643 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.635+0000 7f9aa4ee0700 1 --2- 172.21.15.57:0/4215559855 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9a8c004810 0x7f9a8c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:01.643 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.635+0000 7f9aa5ee2700 1 -- 172.21.15.57:0/4215559855 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9a8c003bf0 msgr2=0x7f9a8c003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:01.643 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.635+0000 7f9aa5ee2700 1 --2- 172.21.15.57:0/4215559855 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9a8c003bf0 0x7f9a8c003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:01.643 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.635+0000 7f9aa5ee2700 1 -- 172.21.15.57:0/4215559855 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9a8c004810 msgr2=0x7f9a8c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:01.643 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.635+0000 7f9aa5ee2700 1 --2- 172.21.15.57:0/4215559855 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9a8c004810 0x7f9a8c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:01.644 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.635+0000 7f9aa5ee2700 1 -- 172.21.15.57:0/4215559855 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a8c003570 con 0x7f9a8c0051c0 2023-10-06T03:01:01.644 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.635+0000 7f9aa56e1700 1 --2- 172.21.15.57:0/4215559855 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9a8c003bf0 0x7f9a8c003fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:01:01.644 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.635+0000 7f9aa4ee0700 1 --2- 172.21.15.57:0/4215559855 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9a8c004810 0x7f9a8c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:01:01.644 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.635+0000 7f9aa5ee2700 1 -- 172.21.15.57:0/4215559855 reap_dead start 2023-10-06T03:01:01.644 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.635+0000 7f9aa5ee2700 1 --2- 172.21.15.57:0/4215559855 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a8c0051c0 0x7f9a8c00ba60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9a9800a8f0 tx=0x7f9aa015dea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81a84ca699e4c00 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:01.644 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.635+0000 7f9a97fff700 1 -- 172.21.15.57:0/4215559855 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a980070d0 con 0x7f9a8c0051c0 2023-10-06T03:01:01.644 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.635+0000 7f9a97fff700 1 -- 172.21.15.57:0/4215559855 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a98007270 con 0x7f9a8c0051c0 2023-10-06T03:01:01.644 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.635+0000 7f9a97fff700 1 -- 172.21.15.57:0/4215559855 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a98007630 con 0x7f9a8c0051c0 2023-10-06T03:01:01.644 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.635+0000 7f9aa7945700 1 -- 172.21.15.57:0/4215559855 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a8c0051c0 msgr2=0x7f9a8c00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:01.644 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.635+0000 7f9aa7945700 1 --2- 172.21.15.57:0/4215559855 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a8c0051c0 0x7f9a8c00ba60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9a9800a8f0 tx=0x7f9aa015dea0 comp rx=0 tx=0).stop 2023-10-06T03:01:01.644 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.635+0000 7f9aa7945700 1 -- 172.21.15.57:0/4215559855 shutdown_connections 2023-10-06T03:01:01.644 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.635+0000 7f9aa7945700 1 --2- 172.21.15.57:0/4215559855 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a8c0051c0 0x7f9a8c00ba60 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:01.645 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.635+0000 7f9aa7945700 1 -- 172.21.15.57:0/4215559855 >> 172.21.15.57:0/4215559855 conn(0x7f9aa0067380 msgr2=0x7f9aa0067780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:01.645 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.639+0000 7f9aa7945700 1 -- 172.21.15.57:0/4215559855 shutdown_connections 2023-10-06T03:01:01.645 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.639+0000 7f9aa7945700 1 -- 172.21.15.57:0/4215559855 wait complete. 2023-10-06T03:01:01.645 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.639+0000 7f9aa7945700 1 Processor -- start 2023-10-06T03:01:01.646 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.639+0000 7f9aa7945700 1 -- start start 2023-10-06T03:01:01.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.643+0000 7f9aa7945700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a8c0051c0 0x7f9aa016d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:01.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.643+0000 7f9aa7945700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9aa00b1f80 0x7f9aa016d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:01.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.643+0000 7f9aa7945700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9aa0154f40 0x7f9aa01553b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:01.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.643+0000 7f9aa7945700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa014ddf0 con 0x7f9a8c0051c0 2023-10-06T03:01:01.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.643+0000 7f9aa7945700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa01558f0 con 0x7f9aa00b1f80 2023-10-06T03:01:01.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.643+0000 7f9aa7945700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa0155e60 con 0x7f9aa0154f40 2023-10-06T03:01:01.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.643+0000 7f9aa56e1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a8c0051c0 0x7f9aa016d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:01.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.643+0000 7f9aa56e1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a8c0051c0 0x7f9aa016d000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44984/0 (socket says 172.21.15.57:44984) 2023-10-06T03:01:01.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.643+0000 7f9aa56e1700 1 -- 172.21.15.57:0/339439887 learned_addr learned my addr 172.21.15.57:0/339439887 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:01.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.643+0000 7f9aa4ee0700 1 --2- 172.21.15.57:0/339439887 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9aa00b1f80 0x7f9aa016d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:01.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.643+0000 7f9aa5ee2700 1 --2- 172.21.15.57:0/339439887 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9aa0154f40 0x7f9aa01553b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:01.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.643+0000 7f9aa56e1700 1 -- 172.21.15.57:0/339439887 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9aa0154f40 msgr2=0x7f9aa01553b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:01.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.643+0000 7f9aa56e1700 1 --2- 172.21.15.57:0/339439887 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9aa0154f40 0x7f9aa01553b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:01.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.643+0000 7f9aa56e1700 1 -- 172.21.15.57:0/339439887 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9aa00b1f80 msgr2=0x7f9aa016d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:01.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.643+0000 7f9aa56e1700 1 --2- 172.21.15.57:0/339439887 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9aa00b1f80 0x7f9aa016d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:01.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.643+0000 7f9aa56e1700 1 -- 172.21.15.57:0/339439887 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9aa0155b80 con 0x7f9a8c0051c0 2023-10-06T03:01:01.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.643+0000 7f9aa56e1700 1 --2- 172.21.15.57:0/339439887 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a8c0051c0 0x7f9aa016d000 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9a9c009270 tx=0x7f9a9c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:01.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.643+0000 7f9a957fa700 1 -- 172.21.15.57:0/339439887 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a9c010e70 con 0x7f9a8c0051c0 2023-10-06T03:01:01.652 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.643+0000 7f9a957fa700 1 -- 172.21.15.57:0/339439887 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a9c00e870 con 0x7f9a8c0051c0 2023-10-06T03:01:01.652 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.643+0000 7f9aa7945700 1 -- 172.21.15.57:0/339439887 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9aa00af5a0 con 0x7f9a8c0051c0 2023-10-06T03:01:01.652 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.643+0000 7f9a957fa700 1 -- 172.21.15.57:0/339439887 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a9c00ec10 con 0x7f9a8c0051c0 2023-10-06T03:01:01.652 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.643+0000 7f9aa7945700 1 -- 172.21.15.57:0/339439887 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9aa00afb60 con 0x7f9a8c0051c0 2023-10-06T03:01:01.652 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.647+0000 7f9aa7945700 1 -- 172.21.15.57:0/339439887 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9aa006e4a0 con 0x7f9a8c0051c0 2023-10-06T03:01:01.653 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.647+0000 7f9a957fa700 1 -- 172.21.15.57:0/339439887 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f9a9c0143f0 con 0x7f9a8c0051c0 2023-10-06T03:01:01.655 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.651+0000 7f9a957fa700 1 --2- 172.21.15.57:0/339439887 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f9a84060580 0x7f9a84062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:01.655 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.651+0000 7f9a957fa700 1 -- 172.21.15.57:0/339439887 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9a9c07cc80 con 0x7f9a8c0051c0 2023-10-06T03:01:01.655 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.651+0000 7f9aa4ee0700 1 --2- 172.21.15.57:0/339439887 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f9a84060580 0x7f9a84062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:01.656 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.651+0000 7f9aa4ee0700 1 --2- 172.21.15.57:0/339439887 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f9a84060580 0x7f9a84062a30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9a90007fd0 tx=0x7f9a90009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:01.661 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.655+0000 7f9a957fa700 1 -- 172.21.15.57:0/339439887 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f9a9c04d070 con 0x7f9a8c0051c0 2023-10-06T03:01:01.834 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.827+0000 7f9aa7945700 1 -- 172.21.15.57:0/339439887 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9aa00712e0 con 0x7f9a8c0051c0 2023-10-06T03:01:01.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.831+0000 7f9a957fa700 1 -- 172.21.15.57:0/339439887 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16866 (secure 0 0 0) 0x7f9a9c050690 con 0x7f9a8c0051c0 2023-10-06T03:01:01.836 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:01:01.836 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":23,"fsid":"eb56dc0f-9213-41cb-9aad-8ade6c802e98","created":"2023-10-06T03:00:30.806197+0000","modified":"2023-10-06T03:00:58.975366+0000","last_up_change":"2023-10-06T03:00:43.607454+0000","last_in_change":"2023-10-06T03:00:33.943513+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T03:00:44.360651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T03:00:50.466601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:00:55.472586+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T03:00:56.400884+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"58cf6c90-d704-43e0-b2db-dffe526d5e8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":33053},{"type":"v1","addr":"172.21.15.57:6801","nonce":33053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":33053},{"type":"v1","addr":"172.21.15.57:6803","nonce":33053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":33053},{"type":"v1","addr":"172.21.15.57:6807","nonce":33053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":33053},{"type":"v1","addr":"172.21.15.57:6805","nonce":33053}]},"public_addr":"172.21.15.57:6801/33053","cluster_addr":"172.21.15.57:6803/33053","heartbeat_back_addr":"172.21.15.57:6807/33053","heartbeat_front_addr":"172.21.15.57:6805/33053","state":["exists","up"]},{"osd":1,"uuid":"16afbe70-7f9e-4568-9c92-763e6e348119","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6809","nonce":33052},{"type":"v1","addr":"172.21.15.57:6810","nonce":33052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":33052},{"type":"v1","addr":"172.21.15.57:6813","nonce":33052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":33052},{"type":"v1","addr":"172.21.15.57:6822","nonce":33052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6815","nonce":33052},{"type":"v1","addr":"172.21.15.57:6818","nonce":33052}]},"public_addr":"172.21.15.57:6810/33052","cluster_addr":"172.21.15.57:6813/33052","heartbeat_back_addr":"172.21.15.57:6822/33052","heartbeat_front_addr":"172.21.15.57:6818/33052","state":["exists","up"]},{"osd":2,"uuid":"7255c62e-f92f-470f-a5ce-30228920d9f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":33058},{"type":"v1","addr":"172.21.15.57:6825","nonce":33058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":33058},{"type":"v1","addr":"172.21.15.57:6827","nonce":33058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":33058},{"type":"v1","addr":"172.21.15.57:6831","nonce":33058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":33058},{"type":"v1","addr":"172.21.15.57:6829","nonce":33058}]},"public_addr":"172.21.15.57:6825/33058","cluster_addr":"172.21.15.57:6827/33058","heartbeat_back_addr":"172.21.15.57:6831/33058","heartbeat_front_addr":"172.21.15.57:6829/33058","state":["exists","up"]},{"osd":3,"uuid":"152a236d-f799-4888-8544-74865508d5a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":33057},{"type":"v1","addr":"172.21.15.57:6811","nonce":33057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":33057},{"type":"v1","addr":"172.21.15.57:6816","nonce":33057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6821","nonce":33057},{"type":"v1","addr":"172.21.15.57:6823","nonce":33057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6817","nonce":33057},{"type":"v1","addr":"172.21.15.57:6819","nonce":33057}]},"public_addr":"172.21.15.57:6811/33057","cluster_addr":"172.21.15.57:6816/33057","heartbeat_back_addr":"172.21.15.57:6823/33057","heartbeat_front_addr":"172.21.15.57:6819/33057","state":["exists","up"]},{"osd":4,"uuid":"37db2a65-3566-41d0-9d60-e66c49e1e68e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":33368},{"type":"v1","addr":"172.21.15.105:6801","nonce":33368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":33368},{"type":"v1","addr":"172.21.15.105:6803","nonce":33368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":33368},{"type":"v1","addr":"172.21.15.105:6807","nonce":33368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":33368},{"type":"v1","addr":"172.21.15.105:6805","nonce":33368}]},"public_addr":"172.21.15.105:6801/33368","cluster_addr":"172.21.15.105:6803/33368","heartbeat_back_addr":"172.21.15.105:6807/33368","heartbeat_front_addr":"172.21.15.105:6805/33368","state":["exists","up"]},{"osd":5,"uuid":"35e77918-1bb4-42ca-9b20-f3c14eaa0c04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":33379},{"type":"v1","addr":"172.21.15.105:6818","nonce":33379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":33379},{"type":"v1","addr":"172.21.15.105:6823","nonce":33379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":33379},{"type":"v1","addr":"172.21.15.105:6831","nonce":33379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":33379},{"type":"v1","addr":"172.21.15.105:6827","nonce":33379}]},"public_addr":"172.21.15.105:6818/33379","cluster_addr":"172.21.15.105:6823/33379","heartbeat_back_addr":"172.21.15.105:6831/33379","heartbeat_front_addr":"172.21.15.105:6827/33379","state":["exists","up"]},{"osd":6,"uuid":"b4d9d510-7a45-4173-8287-c6c8d6547f2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":33369},{"type":"v1","addr":"172.21.15.105:6819","nonce":33369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":33369},{"type":"v1","addr":"172.21.15.105:6822","nonce":33369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":33369},{"type":"v1","addr":"172.21.15.105:6830","nonce":33369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":33369},{"type":"v1","addr":"172.21.15.105:6826","nonce":33369}]},"public_addr":"172.21.15.105:6819/33369","cluster_addr":"172.21.15.105:6822/33369","heartbeat_back_addr":"172.21.15.105:6830/33369","heartbeat_front_addr":"172.21.15.105:6826/33369","state":["exists","up"]},{"osd":7,"uuid":"74266fb0-cd84-463f-8bf0-092652a71dc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":33370},{"type":"v1","addr":"172.21.15.105:6809","nonce":33370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":33370},{"type":"v1","addr":"172.21.15.105:6811","nonce":33370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":33370},{"type":"v1","addr":"172.21.15.105:6815","nonce":33370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":33370},{"type":"v1","addr":"172.21.15.105:6813","nonce":33370}]},"public_addr":"172.21.15.105:6809/33370","cluster_addr":"172.21.15.105:6811/33370","heartbeat_back_addr":"172.21.15.105:6815/33370","heartbeat_front_addr":"172.21.15.105:6813/33370","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.596864+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.633851+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.636993+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.529681+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.608601+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.659752+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.661717+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.642221+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:01:01.838 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.831+0000 7f9aa7945700 1 -- 172.21.15.57:0/339439887 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f9a84060580 msgr2=0x7f9a84062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:01.838 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.831+0000 7f9aa7945700 1 --2- 172.21.15.57:0/339439887 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f9a84060580 0x7f9a84062a30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9a90007fd0 tx=0x7f9a90009040 comp rx=0 tx=0).stop 2023-10-06T03:01:01.838 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.831+0000 7f9aa7945700 1 -- 172.21.15.57:0/339439887 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a8c0051c0 msgr2=0x7f9aa016d000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:01.838 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.831+0000 7f9aa7945700 1 --2- 172.21.15.57:0/339439887 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a8c0051c0 0x7f9aa016d000 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9a9c009270 tx=0x7f9a9c008040 comp rx=0 tx=0).stop 2023-10-06T03:01:01.839 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.835+0000 7f9aa7945700 1 -- 172.21.15.57:0/339439887 shutdown_connections 2023-10-06T03:01:01.839 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.835+0000 7f9aa7945700 1 --2- 172.21.15.57:0/339439887 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f9a84060580 0x7f9a84062a30 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:01.839 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.835+0000 7f9aa7945700 1 --2- 172.21.15.57:0/339439887 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9aa0154f40 0x7f9aa01553b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:01.839 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.835+0000 7f9aa7945700 1 --2- 172.21.15.57:0/339439887 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9aa00b1f80 0x7f9aa016d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:01.839 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.835+0000 7f9aa7945700 1 --2- 172.21.15.57:0/339439887 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a8c0051c0 0x7f9aa016d000 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:01.839 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.835+0000 7f9aa7945700 1 -- 172.21.15.57:0/339439887 >> 172.21.15.57:0/339439887 conn(0x7f9aa0067380 msgr2=0x7f9aa006d640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:01.839 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.835+0000 7f9aa7945700 1 -- 172.21.15.57:0/339439887 shutdown_connections 2023-10-06T03:01:01.839 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:01.835+0000 7f9aa7945700 1 -- 172.21.15.57:0/339439887 wait complete. 2023-10-06T03:01:01.859 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-06T03:01:01.859 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:01:02.024 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.019+0000 7f4c77145700 1 Processor -- start 2023-10-06T03:01:02.024 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.019+0000 7f4c77145700 1 -- start start 2023-10-06T03:01:02.026 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.019+0000 7f4c77145700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4c70159340 0x7f4c700cb2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:02.026 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.019+0000 7f4c77145700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4c700b01c0 0x7f4c7006dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:02.026 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.019+0000 7f4c77145700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c700b0640 con 0x7f4c70158f70 2023-10-06T03:01:02.027 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.019+0000 7f4c77145700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c700cb900 con 0x7f4c70159340 2023-10-06T03:01:02.027 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.019+0000 7f4c77145700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c700cbbe0 con 0x7f4c700b01c0 2023-10-06T03:01:02.027 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.019+0000 7f4c6ffff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4c70159340 0x7f4c700cb2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:02.027 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.019+0000 7f4c6ffff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4c70159340 0x7f4c700cb2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44998/0 (socket says 172.21.15.57:44998) 2023-10-06T03:01:02.027 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.019+0000 7f4c6ffff700 1 -- 172.21.15.57:0/620459154 learned_addr learned my addr 172.21.15.57:0/620459154 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:02.027 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.019+0000 7f4c756e2700 1 --2- 172.21.15.57:0/620459154 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4c700b01c0 0x7f4c7006dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:02.028 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.023+0000 7f4c6ffff700 1 -- 172.21.15.57:0/620459154 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4c700b01c0 msgr2=0x7f4c7006dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:02.028 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.023+0000 7f4c6ffff700 1 --2- 172.21.15.57:0/620459154 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4c700b01c0 0x7f4c7006dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:02.028 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.023+0000 7f4c6ffff700 1 -- 172.21.15.57:0/620459154 >> v1:172.21.15.57:6789/0 conn(0x7f4c70158f70 legacy=0x7f4c7006d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:02.028 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.023+0000 7f4c6ffff700 1 -- 172.21.15.57:0/620459154 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c7006c9c0 con 0x7f4c70159340 2023-10-06T03:01:02.028 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.023+0000 7f4c6ffff700 1 --2- 172.21.15.57:0/620459154 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4c70159340 0x7f4c700cb2f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4c5c0099b0 tx=0x7f4c5c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30138f0267d652d6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:02.028 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.023+0000 7f4c6f7fe700 1 -- 172.21.15.57:0/620459154 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c5c009ea0 con 0x7f4c70159340 2023-10-06T03:01:02.029 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.023+0000 7f4c6f7fe700 1 -- 172.21.15.57:0/620459154 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c5c00b860 con 0x7f4c70159340 2023-10-06T03:01:02.029 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.023+0000 7f4c6f7fe700 1 -- 172.21.15.57:0/620459154 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c5c00bc00 con 0x7f4c70159340 2023-10-06T03:01:02.029 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.023+0000 7f4c77145700 1 -- 172.21.15.57:0/620459154 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4c70159340 msgr2=0x7f4c700cb2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:02.030 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.023+0000 7f4c77145700 1 --2- 172.21.15.57:0/620459154 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4c70159340 0x7f4c700cb2f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4c5c0099b0 tx=0x7f4c5c009250 comp rx=0 tx=0).stop 2023-10-06T03:01:02.030 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.023+0000 7f4c77145700 1 -- 172.21.15.57:0/620459154 shutdown_connections 2023-10-06T03:01:02.030 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.023+0000 7f4c77145700 1 --2- 172.21.15.57:0/620459154 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4c700b01c0 0x7f4c7006dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:02.030 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.023+0000 7f4c77145700 1 --2- 172.21.15.57:0/620459154 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4c70159340 0x7f4c700cb2f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:02.030 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.023+0000 7f4c77145700 1 -- 172.21.15.57:0/620459154 >> 172.21.15.57:0/620459154 conn(0x7f4c700ccbf0 msgr2=0x7f4c700ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:02.030 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.023+0000 7f4c77145700 1 -- 172.21.15.57:0/620459154 shutdown_connections 2023-10-06T03:01:02.030 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.023+0000 7f4c77145700 1 -- 172.21.15.57:0/620459154 wait complete. 2023-10-06T03:01:02.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.027+0000 7f4c77145700 1 Processor -- start 2023-10-06T03:01:02.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.027+0000 7f4c77145700 1 -- start start 2023-10-06T03:01:02.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.027+0000 7f4c77145700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4c700b01c0 0x7f4c70155f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:02.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.027+0000 7f4c77145700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4c70158f70 0x7f4c7015dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:02.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.027+0000 7f4c77145700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4c70159340 0x7f4c700b50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:02.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.027+0000 7f4c77145700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c70156480 con 0x7f4c70158f70 2023-10-06T03:01:02.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.027+0000 7f4c77145700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c7015db20 con 0x7f4c700b01c0 2023-10-06T03:01:02.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.027+0000 7f4c77145700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c700b5d20 con 0x7f4c70159340 2023-10-06T03:01:02.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.027+0000 7f4c6ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4c70158f70 0x7f4c7015dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:02.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.027+0000 7f4c6ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4c70158f70 0x7f4c7015dfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:45002/0 (socket says 172.21.15.57:45002) 2023-10-06T03:01:02.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.027+0000 7f4c6ffff700 1 -- 172.21.15.57:0/1307316177 learned_addr learned my addr 172.21.15.57:0/1307316177 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:02.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.027+0000 7f4c74ee1700 1 --2- 172.21.15.57:0/1307316177 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4c700b01c0 0x7f4c70155f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:02.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.027+0000 7f4c756e2700 1 --2- 172.21.15.57:0/1307316177 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4c70159340 0x7f4c700b50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:02.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.027+0000 7f4c6ffff700 1 -- 172.21.15.57:0/1307316177 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4c70159340 msgr2=0x7f4c700b50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:02.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.027+0000 7f4c6ffff700 1 --2- 172.21.15.57:0/1307316177 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4c70159340 0x7f4c700b50d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:02.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.027+0000 7f4c6ffff700 1 -- 172.21.15.57:0/1307316177 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4c700b01c0 msgr2=0x7f4c70155f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:02.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.027+0000 7f4c6ffff700 1 --2- 172.21.15.57:0/1307316177 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4c700b01c0 0x7f4c70155f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:02.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.027+0000 7f4c6ffff700 1 -- 172.21.15.57:0/1307316177 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c5c0094f0 con 0x7f4c70158f70 2023-10-06T03:01:02.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.031+0000 7f4c6ffff700 1 --2- 172.21.15.57:0/1307316177 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4c70158f70 0x7f4c7015dfb0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4c5c009290 tx=0x7f4c5c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:02.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.031+0000 7f4c6cff9700 1 -- 172.21.15.57:0/1307316177 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c5c000d10 con 0x7f4c70158f70 2023-10-06T03:01:02.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.031+0000 7f4c6cff9700 1 -- 172.21.15.57:0/1307316177 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c5c00bbe0 con 0x7f4c70158f70 2023-10-06T03:01:02.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.031+0000 7f4c6cff9700 1 -- 172.21.15.57:0/1307316177 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c5c01a6a0 con 0x7f4c70158f70 2023-10-06T03:01:02.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.031+0000 7f4c77145700 1 -- 172.21.15.57:0/1307316177 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c700b5a40 con 0x7f4c70158f70 2023-10-06T03:01:02.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.031+0000 7f4c77145700 1 -- 172.21.15.57:0/1307316177 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c7015d7b0 con 0x7f4c70158f70 2023-10-06T03:01:02.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.031+0000 7f4c77145700 1 -- 172.21.15.57:0/1307316177 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c7015d330 con 0x7f4c70158f70 2023-10-06T03:01:02.038 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.031+0000 7f4c6cff9700 1 -- 172.21.15.57:0/1307316177 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f4c5c01aa10 con 0x7f4c70158f70 2023-10-06T03:01:02.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.035+0000 7f4c6cff9700 1 --2- 172.21.15.57:0/1307316177 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f4c54060550 0x7f4c54062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:02.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.035+0000 7f4c6cff9700 1 -- 172.21.15.57:0/1307316177 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4c5c07e370 con 0x7f4c70158f70 2023-10-06T03:01:02.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.035+0000 7f4c74ee1700 1 --2- 172.21.15.57:0/1307316177 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f4c54060550 0x7f4c54062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:02.040 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.035+0000 7f4c74ee1700 1 --2- 172.21.15.57:0/1307316177 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f4c54060550 0x7f4c54062a00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4c700cd980 tx=0x7f4c64007e80 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:02.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.039+0000 7f4c6cff9700 1 -- 172.21.15.57:0/1307316177 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f4c7015d330 con 0x7f4c70158f70 2023-10-06T03:01:02.217 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.211+0000 7f4c77145700 1 -- 172.21.15.57:0/1307316177 --> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4c7015d330 con 0x7f4c54060550 2023-10-06T03:01:02.237 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.227+0000 7f4c6cff9700 1 -- 172.21.15.57:0/1307316177 <== mgr.4103 v2:172.21.15.57:6832/32947 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286502 (secure 0 0 0) 0x7f4c7015d330 con 0x7f4c54060550 2023-10-06T03:01:02.241 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:01:02.243 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.235+0000 7f4c77145700 1 -- 172.21.15.57:0/1307316177 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f4c54060550 msgr2=0x7f4c54062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:02.243 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.235+0000 7f4c77145700 1 --2- 172.21.15.57:0/1307316177 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f4c54060550 0x7f4c54062a00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4c700cd980 tx=0x7f4c64007e80 comp rx=0 tx=0).stop 2023-10-06T03:01:02.243 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.235+0000 7f4c77145700 1 -- 172.21.15.57:0/1307316177 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4c70158f70 msgr2=0x7f4c7015dfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:02.243 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.235+0000 7f4c77145700 1 --2- 172.21.15.57:0/1307316177 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4c70158f70 0x7f4c7015dfb0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4c5c009290 tx=0x7f4c5c017000 comp rx=0 tx=0).stop 2023-10-06T03:01:02.243 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.235+0000 7f4c77145700 1 -- 172.21.15.57:0/1307316177 shutdown_connections 2023-10-06T03:01:02.243 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.235+0000 7f4c77145700 1 --2- 172.21.15.57:0/1307316177 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f4c54060550 0x7f4c54062a00 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:02.243 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.235+0000 7f4c77145700 1 --2- 172.21.15.57:0/1307316177 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4c70159340 0x7f4c700b50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:02.244 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.235+0000 7f4c77145700 1 --2- 172.21.15.57:0/1307316177 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4c70158f70 0x7f4c7015dfb0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:02.244 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.235+0000 7f4c77145700 1 --2- 172.21.15.57:0/1307316177 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4c700b01c0 0x7f4c70155f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:02.244 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.235+0000 7f4c77145700 1 -- 172.21.15.57:0/1307316177 >> 172.21.15.57:0/1307316177 conn(0x7f4c700ccbf0 msgr2=0x7f4c700cdcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:02.244 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.235+0000 7f4c77145700 1 -- 172.21.15.57:0/1307316177 shutdown_connections 2023-10-06T03:01:02.244 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.235+0000 7f4c77145700 1 -- 172.21.15.57:0/1307316177 wait complete. 2023-10-06T03:01:02.244 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2023-10-06T03:01:02.264 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-10-06T03:01:00.273592+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":97,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2397704,"kb_used_data":3016,"kb_used_omap":0,"kb_used_meta":2394624,"kb_avail":752577016,"statfs":{"total":773094113280,"available":770638864384,"internally_reserved":0,"allocated":3088384,"data_stored":1846772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2452094976},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":45,"apply_latency_ms":45,"commit_latency_ns":45000000,"apply_latency_ns":45000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.334200"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.980917+0000","last_change":"2023-10-06T03:00:57.980917+0000","last_active":"2023-10-06T03:00:57.980917+0000","last_peered":"2023-10-06T03:00:57.980917+0000","last_clean":"2023-10-06T03:00:57.980917+0000","last_became_active":"2023-10-06T03:00:57.980580+0000","last_became_peered":"2023-10-06T03:00:57.980580+0000","last_unstale":"2023-10-06T03:00:57.980917+0000","last_undegraded":"2023-10-06T03:00:57.980917+0000","last_fullsized":"2023-10-06T03:00:57.980917+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:30:16.978685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.994006+0000","last_change":"2023-10-06T03:00:57.990358+0000","last_active":"2023-10-06T03:00:57.994006+0000","last_peered":"2023-10-06T03:00:57.994006+0000","last_clean":"2023-10-06T03:00:57.994006+0000","last_became_active":"2023-10-06T03:00:57.990144+0000","last_became_peered":"2023-10-06T03:00:57.990144+0000","last_unstale":"2023-10-06T03:00:57.994006+0000","last_undegraded":"2023-10-06T03:00:57.994006+0000","last_fullsized":"2023-10-06T03:00:57.994006+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:32:39.801984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:58.006699+0000","last_change":"2023-10-06T03:00:58.006699+0000","last_active":"2023-10-06T03:00:58.006699+0000","last_peered":"2023-10-06T03:00:58.006699+0000","last_clean":"2023-10-06T03:00:58.006699+0000","last_became_active":"2023-10-06T03:00:58.005294+0000","last_became_peered":"2023-10-06T03:00:58.005294+0000","last_unstale":"2023-10-06T03:00:58.006699+0000","last_undegraded":"2023-10-06T03:00:58.006699+0000","last_fullsized":"2023-10-06T03:00:58.006699+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:35:56.006762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:58.006066+0000","last_change":"2023-10-06T03:00:57.994292+0000","last_active":"2023-10-06T03:00:58.006066+0000","last_peered":"2023-10-06T03:00:58.006066+0000","last_clean":"2023-10-06T03:00:58.006066+0000","last_became_active":"2023-10-06T03:00:57.994021+0000","last_became_peered":"2023-10-06T03:00:57.994021+0000","last_unstale":"2023-10-06T03:00:58.006066+0000","last_undegraded":"2023-10-06T03:00:58.006066+0000","last_fullsized":"2023-10-06T03:00:58.006066+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:04:36.988945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.992614+0000","last_change":"2023-10-06T03:00:57.992614+0000","last_active":"2023-10-06T03:00:57.992614+0000","last_peered":"2023-10-06T03:00:57.992614+0000","last_clean":"2023-10-06T03:00:57.992614+0000","last_became_active":"2023-10-06T03:00:57.992227+0000","last_became_peered":"2023-10-06T03:00:57.992227+0000","last_unstale":"2023-10-06T03:00:57.992614+0000","last_undegraded":"2023-10-06T03:00:57.992614+0000","last_fullsized":"2023-10-06T03:00:57.992614+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:41:47.568218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:58.005433+0000","last_change":"2023-10-06T03:00:58.005433+0000","last_active":"2023-10-06T03:00:58.005433+0000","last_peered":"2023-10-06T03:00:58.005433+0000","last_clean":"2023-10-06T03:00:58.005433+0000","last_became_active":"2023-10-06T03:00:58.005113+0000","last_became_peered":"2023-10-06T03:00:58.005113+0000","last_unstale":"2023-10-06T03:00:58.005433+0000","last_undegraded":"2023-10-06T03:00:58.005433+0000","last_fullsized":"2023-10-06T03:00:58.005433+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:49:14.009330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.998785+0000","last_change":"2023-10-06T03:00:57.998785+0000","last_active":"2023-10-06T03:00:57.998785+0000","last_peered":"2023-10-06T03:00:57.998785+0000","last_clean":"2023-10-06T03:00:57.998785+0000","last_became_active":"2023-10-06T03:00:57.997865+0000","last_became_peered":"2023-10-06T03:00:57.997865+0000","last_unstale":"2023-10-06T03:00:57.998785+0000","last_undegraded":"2023-10-06T03:00:57.998785+0000","last_fullsized":"2023-10-06T03:00:57.998785+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:32:39.801984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.993783+0000","last_change":"2023-10-06T03:00:57.985816+0000","last_active":"2023-10-06T03:00:57.993783+0000","last_peered":"2023-10-06T03:00:57.993783+0000","last_clean":"2023-10-06T03:00:57.993783+0000","last_became_active":"2023-10-06T03:00:57.985504+0000","last_became_peered":"2023-10-06T03:00:57.985504+0000","last_unstale":"2023-10-06T03:00:57.993783+0000","last_undegraded":"2023-10-06T03:00:57.993783+0000","last_fullsized":"2023-10-06T03:00:57.993783+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:12:21.523918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.991750+0000","last_change":"2023-10-06T03:00:57.991750+0000","last_active":"2023-10-06T03:00:57.991750+0000","last_peered":"2023-10-06T03:00:57.991750+0000","last_clean":"2023-10-06T03:00:57.991750+0000","last_became_active":"2023-10-06T03:00:57.991271+0000","last_became_peered":"2023-10-06T03:00:57.991271+0000","last_unstale":"2023-10-06T03:00:57.991750+0000","last_undegraded":"2023-10-06T03:00:57.991750+0000","last_fullsized":"2023-10-06T03:00:57.991750+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:32:20.183224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:58.001086+0000","last_change":"2023-10-06T03:00:57.997031+0000","last_active":"2023-10-06T03:00:58.001086+0000","last_peered":"2023-10-06T03:00:58.001086+0000","last_clean":"2023-10-06T03:00:58.001086+0000","last_became_active":"2023-10-06T03:00:57.996675+0000","last_became_peered":"2023-10-06T03:00:57.996675+0000","last_unstale":"2023-10-06T03:00:58.001086+0000","last_undegraded":"2023-10-06T03:00:58.001086+0000","last_fullsized":"2023-10-06T03:00:58.001086+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:49:14.009330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.978095+0000","last_change":"2023-10-06T03:00:57.978095+0000","last_active":"2023-10-06T03:00:57.978095+0000","last_peered":"2023-10-06T03:00:57.978095+0000","last_clean":"2023-10-06T03:00:57.978095+0000","last_became_active":"2023-10-06T03:00:57.977627+0000","last_became_peered":"2023-10-06T03:00:57.977627+0000","last_unstale":"2023-10-06T03:00:57.978095+0000","last_undegraded":"2023-10-06T03:00:57.978095+0000","last_fullsized":"2023-10-06T03:00:57.978095+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:41:47.568218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.981822+0000","last_change":"2023-10-06T03:00:57.981822+0000","last_active":"2023-10-06T03:00:57.981822+0000","last_peered":"2023-10-06T03:00:57.981822+0000","last_clean":"2023-10-06T03:00:57.981822+0000","last_became_active":"2023-10-06T03:00:57.981246+0000","last_became_peered":"2023-10-06T03:00:57.981246+0000","last_unstale":"2023-10-06T03:00:57.981822+0000","last_undegraded":"2023-10-06T03:00:57.981822+0000","last_fullsized":"2023-10-06T03:00:57.981822+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:11:32.949199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.979093+0000","last_change":"2023-10-06T03:00:57.979093+0000","last_active":"2023-10-06T03:00:57.979093+0000","last_peered":"2023-10-06T03:00:57.979093+0000","last_clean":"2023-10-06T03:00:57.979093+0000","last_became_active":"2023-10-06T03:00:57.978790+0000","last_became_peered":"2023-10-06T03:00:57.978790+0000","last_unstale":"2023-10-06T03:00:57.979093+0000","last_undegraded":"2023-10-06T03:00:57.979093+0000","last_fullsized":"2023-10-06T03:00:57.979093+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:04:36.988945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.996721+0000","last_change":"2023-10-06T03:00:57.992778+0000","last_active":"2023-10-06T03:00:57.996721+0000","last_peered":"2023-10-06T03:00:57.996721+0000","last_clean":"2023-10-06T03:00:57.996721+0000","last_became_active":"2023-10-06T03:00:57.992484+0000","last_became_peered":"2023-10-06T03:00:57.992484+0000","last_unstale":"2023-10-06T03:00:57.996721+0000","last_undegraded":"2023-10-06T03:00:57.996721+0000","last_fullsized":"2023-10-06T03:00:57.996721+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:32:20.183224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.999320+0000","last_change":"2023-10-06T03:00:57.999320+0000","last_active":"2023-10-06T03:00:57.999320+0000","last_peered":"2023-10-06T03:00:57.999320+0000","last_clean":"2023-10-06T03:00:57.999320+0000","last_became_active":"2023-10-06T03:00:57.998455+0000","last_became_peered":"2023-10-06T03:00:57.998455+0000","last_unstale":"2023-10-06T03:00:57.999320+0000","last_undegraded":"2023-10-06T03:00:57.999320+0000","last_fullsized":"2023-10-06T03:00:57.999320+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:14:29.859982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:58.005775+0000","last_change":"2023-10-06T03:00:58.005775+0000","last_active":"2023-10-06T03:00:58.005775+0000","last_peered":"2023-10-06T03:00:58.005775+0000","last_clean":"2023-10-06T03:00:58.005775+0000","last_became_active":"2023-10-06T03:00:58.005474+0000","last_became_peered":"2023-10-06T03:00:58.005474+0000","last_unstale":"2023-10-06T03:00:58.005775+0000","last_undegraded":"2023-10-06T03:00:58.005775+0000","last_fullsized":"2023-10-06T03:00:58.005775+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:28:58.179787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.993441+0000","last_change":"2023-10-06T03:00:57.993441+0000","last_active":"2023-10-06T03:00:57.993441+0000","last_peered":"2023-10-06T03:00:57.993441+0000","last_clean":"2023-10-06T03:00:57.993441+0000","last_became_active":"2023-10-06T03:00:57.993145+0000","last_became_peered":"2023-10-06T03:00:57.993145+0000","last_unstale":"2023-10-06T03:00:57.993441+0000","last_undegraded":"2023-10-06T03:00:57.993441+0000","last_fullsized":"2023-10-06T03:00:57.993441+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:49:14.009330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.989141+0000","last_change":"2023-10-06T03:00:57.989141+0000","last_active":"2023-10-06T03:00:57.989141+0000","last_peered":"2023-10-06T03:00:57.989141+0000","last_clean":"2023-10-06T03:00:57.989141+0000","last_became_active":"2023-10-06T03:00:57.988752+0000","last_became_peered":"2023-10-06T03:00:57.988752+0000","last_unstale":"2023-10-06T03:00:57.989141+0000","last_undegraded":"2023-10-06T03:00:57.989141+0000","last_fullsized":"2023-10-06T03:00:57.989141+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:48:42.435907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.982128+0000","last_change":"2023-10-06T03:00:57.982128+0000","last_active":"2023-10-06T03:00:57.982128+0000","last_peered":"2023-10-06T03:00:57.982128+0000","last_clean":"2023-10-06T03:00:57.982128+0000","last_became_active":"2023-10-06T03:00:57.981762+0000","last_became_peered":"2023-10-06T03:00:57.981762+0000","last_unstale":"2023-10-06T03:00:57.982128+0000","last_undegraded":"2023-10-06T03:00:57.982128+0000","last_fullsized":"2023-10-06T03:00:57.982128+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:50:24.543128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.980179+0000","last_change":"2023-10-06T03:00:57.980179+0000","last_active":"2023-10-06T03:00:57.980179+0000","last_peered":"2023-10-06T03:00:57.980179+0000","last_clean":"2023-10-06T03:00:57.980179+0000","last_became_active":"2023-10-06T03:00:57.979822+0000","last_became_peered":"2023-10-06T03:00:57.979822+0000","last_unstale":"2023-10-06T03:00:57.980179+0000","last_undegraded":"2023-10-06T03:00:57.980179+0000","last_fullsized":"2023-10-06T03:00:57.980179+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:56:45.815718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.987885+0000","last_change":"2023-10-06T03:00:57.987885+0000","last_active":"2023-10-06T03:00:57.987885+0000","last_peered":"2023-10-06T03:00:57.987885+0000","last_clean":"2023-10-06T03:00:57.987885+0000","last_became_active":"2023-10-06T03:00:57.987306+0000","last_became_peered":"2023-10-06T03:00:57.987306+0000","last_unstale":"2023-10-06T03:00:57.987885+0000","last_undegraded":"2023-10-06T03:00:57.987885+0000","last_fullsized":"2023-10-06T03:00:57.987885+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:16:06.528696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.997306+0000","last_change":"2023-10-06T03:00:57.997306+0000","last_active":"2023-10-06T03:00:57.997306+0000","last_peered":"2023-10-06T03:00:57.997306+0000","last_clean":"2023-10-06T03:00:57.997306+0000","last_became_active":"2023-10-06T03:00:57.996969+0000","last_became_peered":"2023-10-06T03:00:57.996969+0000","last_unstale":"2023-10-06T03:00:57.997306+0000","last_undegraded":"2023-10-06T03:00:57.997306+0000","last_fullsized":"2023-10-06T03:00:57.997306+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:12:21.523918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:58.002300+0000","last_change":"2023-10-06T03:00:57.997342+0000","last_active":"2023-10-06T03:00:58.002300+0000","last_peered":"2023-10-06T03:00:58.002300+0000","last_clean":"2023-10-06T03:00:58.002300+0000","last_became_active":"2023-10-06T03:00:57.996950+0000","last_became_peered":"2023-10-06T03:00:57.996950+0000","last_unstale":"2023-10-06T03:00:58.002300+0000","last_undegraded":"2023-10-06T03:00:58.002300+0000","last_fullsized":"2023-10-06T03:00:58.002300+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:54:01.471407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.997946+0000","last_change":"2023-10-06T03:00:57.997946+0000","last_active":"2023-10-06T03:00:57.997946+0000","last_peered":"2023-10-06T03:00:57.997946+0000","last_clean":"2023-10-06T03:00:57.997946+0000","last_became_active":"2023-10-06T03:00:57.997600+0000","last_became_peered":"2023-10-06T03:00:57.997600+0000","last_unstale":"2023-10-06T03:00:57.997946+0000","last_undegraded":"2023-10-06T03:00:57.997946+0000","last_fullsized":"2023-10-06T03:00:57.997946+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:12:21.523918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.989508+0000","last_change":"2023-10-06T03:00:57.989508+0000","last_active":"2023-10-06T03:00:57.989508+0000","last_peered":"2023-10-06T03:00:57.989508+0000","last_clean":"2023-10-06T03:00:57.989508+0000","last_became_active":"2023-10-06T03:00:57.989023+0000","last_became_peered":"2023-10-06T03:00:57.989023+0000","last_unstale":"2023-10-06T03:00:57.989508+0000","last_undegraded":"2023-10-06T03:00:57.989508+0000","last_fullsized":"2023-10-06T03:00:57.989508+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:14:29.859982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.987485+0000","last_change":"2023-10-06T03:00:57.987485+0000","last_active":"2023-10-06T03:00:57.987485+0000","last_peered":"2023-10-06T03:00:57.987485+0000","last_clean":"2023-10-06T03:00:57.987485+0000","last_became_active":"2023-10-06T03:00:57.983554+0000","last_became_peered":"2023-10-06T03:00:57.983554+0000","last_unstale":"2023-10-06T03:00:57.987485+0000","last_undegraded":"2023-10-06T03:00:57.987485+0000","last_fullsized":"2023-10-06T03:00:57.987485+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:18:57.339278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:58.006377+0000","last_change":"2023-10-06T03:00:58.003002+0000","last_active":"2023-10-06T03:00:58.006377+0000","last_peered":"2023-10-06T03:00:58.006377+0000","last_clean":"2023-10-06T03:00:58.006377+0000","last_became_active":"2023-10-06T03:00:58.002705+0000","last_became_peered":"2023-10-06T03:00:58.002705+0000","last_unstale":"2023-10-06T03:00:58.006377+0000","last_undegraded":"2023-10-06T03:00:58.006377+0000","last_fullsized":"2023-10-06T03:00:58.006377+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:14:29.859982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.991310+0000","last_change":"2023-10-06T03:00:57.991310+0000","last_active":"2023-10-06T03:00:57.991310+0000","last_peered":"2023-10-06T03:00:57.991310+0000","last_clean":"2023-10-06T03:00:57.991310+0000","last_became_active":"2023-10-06T03:00:57.990221+0000","last_became_peered":"2023-10-06T03:00:57.990221+0000","last_unstale":"2023-10-06T03:00:57.991310+0000","last_undegraded":"2023-10-06T03:00:57.991310+0000","last_fullsized":"2023-10-06T03:00:57.991310+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:39:00.112932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.995764+0000","last_change":"2023-10-06T03:00:57.991930+0000","last_active":"2023-10-06T03:00:57.995764+0000","last_peered":"2023-10-06T03:00:57.995764+0000","last_clean":"2023-10-06T03:00:57.995764+0000","last_became_active":"2023-10-06T03:00:57.991329+0000","last_became_peered":"2023-10-06T03:00:57.991329+0000","last_unstale":"2023-10-06T03:00:57.995764+0000","last_undegraded":"2023-10-06T03:00:57.995764+0000","last_fullsized":"2023-10-06T03:00:57.995764+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:10:20.444330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.985010+0000","last_change":"2023-10-06T03:00:57.985010+0000","last_active":"2023-10-06T03:00:57.985010+0000","last_peered":"2023-10-06T03:00:57.985010+0000","last_clean":"2023-10-06T03:00:57.985010+0000","last_became_active":"2023-10-06T03:00:57.983945+0000","last_became_peered":"2023-10-06T03:00:57.983945+0000","last_unstale":"2023-10-06T03:00:57.985010+0000","last_undegraded":"2023-10-06T03:00:57.985010+0000","last_fullsized":"2023-10-06T03:00:57.985010+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:16:07.773169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.978641+0000","last_change":"2023-10-06T03:00:57.976726+0000","last_active":"2023-10-06T03:00:57.978641+0000","last_peered":"2023-10-06T03:00:57.978641+0000","last_clean":"2023-10-06T03:00:57.978641+0000","last_became_active":"2023-10-06T03:00:57.976367+0000","last_became_peered":"2023-10-06T03:00:57.976367+0000","last_unstale":"2023-10-06T03:00:57.978641+0000","last_undegraded":"2023-10-06T03:00:57.978641+0000","last_fullsized":"2023-10-06T03:00:57.978641+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:49:14.009330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.997016+0000","last_change":"2023-10-06T03:00:57.992161+0000","last_active":"2023-10-06T03:00:57.997016+0000","last_peered":"2023-10-06T03:00:57.997016+0000","last_clean":"2023-10-06T03:00:57.997016+0000","last_became_active":"2023-10-06T03:00:57.991886+0000","last_became_peered":"2023-10-06T03:00:57.991886+0000","last_unstale":"2023-10-06T03:00:57.997016+0000","last_undegraded":"2023-10-06T03:00:57.997016+0000","last_fullsized":"2023-10-06T03:00:57.997016+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:57:10.332887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.987129+0000","last_change":"2023-10-06T03:00:57.984047+0000","last_active":"2023-10-06T03:00:57.987129+0000","last_peered":"2023-10-06T03:00:57.987129+0000","last_clean":"2023-10-06T03:00:57.987129+0000","last_became_active":"2023-10-06T03:00:57.983670+0000","last_became_peered":"2023-10-06T03:00:57.983670+0000","last_unstale":"2023-10-06T03:00:57.987129+0000","last_undegraded":"2023-10-06T03:00:57.987129+0000","last_fullsized":"2023-10-06T03:00:57.987129+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:12:21.523918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:58.015542+0000","last_change":"2023-10-06T03:00:56.987376+0000","last_active":"2023-10-06T03:00:58.015542+0000","last_peered":"2023-10-06T03:00:58.015542+0000","last_clean":"2023-10-06T03:00:58.015542+0000","last_became_active":"2023-10-06T03:00:56.986953+0000","last_became_peered":"2023-10-06T03:00:56.986953+0000","last_unstale":"2023-10-06T03:00:58.015542+0000","last_undegraded":"2023-10-06T03:00:58.015542+0000","last_fullsized":"2023-10-06T03:00:58.015542+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:39:00.208565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:58.003097+0000","last_change":"2023-10-06T03:00:57.998904+0000","last_active":"2023-10-06T03:00:58.003097+0000","last_peered":"2023-10-06T03:00:58.003097+0000","last_clean":"2023-10-06T03:00:58.003097+0000","last_became_active":"2023-10-06T03:00:57.998631+0000","last_became_peered":"2023-10-06T03:00:57.998631+0000","last_unstale":"2023-10-06T03:00:58.003097+0000","last_undegraded":"2023-10-06T03:00:58.003097+0000","last_fullsized":"2023-10-06T03:00:58.003097+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:41:47.568218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T03:00:56.985538+0000","last_change":"2023-10-06T03:00:56.977003+0000","last_active":"2023-10-06T03:00:56.985538+0000","last_peered":"2023-10-06T03:00:56.985538+0000","last_clean":"2023-10-06T03:00:56.985538+0000","last_became_active":"2023-10-06T03:00:56.976668+0000","last_became_peered":"2023-10-06T03:00:56.976668+0000","last_unstale":"2023-10-06T03:00:56.985538+0000","last_undegraded":"2023-10-06T03:00:56.985538+0000","last_fullsized":"2023-10-06T03:00:56.985538+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:08:59.306830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.995079+0000","last_change":"2023-10-06T03:00:57.995079+0000","last_active":"2023-10-06T03:00:57.995079+0000","last_peered":"2023-10-06T03:00:57.995079+0000","last_clean":"2023-10-06T03:00:57.995079+0000","last_became_active":"2023-10-06T03:00:57.994813+0000","last_became_peered":"2023-10-06T03:00:57.994813+0000","last_unstale":"2023-10-06T03:00:57.995079+0000","last_undegraded":"2023-10-06T03:00:57.995079+0000","last_fullsized":"2023-10-06T03:00:57.995079+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:28:58.179787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T03:00:56.990004+0000","last_change":"2023-10-06T03:00:56.987263+0000","last_active":"2023-10-06T03:00:56.990004+0000","last_peered":"2023-10-06T03:00:56.990004+0000","last_clean":"2023-10-06T03:00:56.990004+0000","last_became_active":"2023-10-06T03:00:56.986927+0000","last_became_peered":"2023-10-06T03:00:56.986927+0000","last_unstale":"2023-10-06T03:00:56.990004+0000","last_undegraded":"2023-10-06T03:00:56.990004+0000","last_fullsized":"2023-10-06T03:00:56.990004+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:01:20.300193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.988672+0000","last_change":"2023-10-06T03:00:57.985729+0000","last_active":"2023-10-06T03:00:57.988672+0000","last_peered":"2023-10-06T03:00:57.988672+0000","last_clean":"2023-10-06T03:00:57.988672+0000","last_became_active":"2023-10-06T03:00:57.985148+0000","last_became_peered":"2023-10-06T03:00:57.985148+0000","last_unstale":"2023-10-06T03:00:57.988672+0000","last_undegraded":"2023-10-06T03:00:57.988672+0000","last_fullsized":"2023-10-06T03:00:57.988672+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:01:50.001484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:58.017678+0000","last_change":"2023-10-06T03:00:56.981696+0000","last_active":"2023-10-06T03:00:58.017678+0000","last_peered":"2023-10-06T03:00:58.017678+0000","last_clean":"2023-10-06T03:00:58.017678+0000","last_became_active":"2023-10-06T03:00:56.981358+0000","last_became_peered":"2023-10-06T03:00:56.981358+0000","last_unstale":"2023-10-06T03:00:58.017678+0000","last_undegraded":"2023-10-06T03:00:58.017678+0000","last_fullsized":"2023-10-06T03:00:58.017678+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:39:17.918596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.980767+0000","last_change":"2023-10-06T03:00:56.987266+0000","last_active":"2023-10-06T03:00:57.980767+0000","last_peered":"2023-10-06T03:00:57.980767+0000","last_clean":"2023-10-06T03:00:57.980767+0000","last_became_active":"2023-10-06T03:00:56.986946+0000","last_became_peered":"2023-10-06T03:00:56.986946+0000","last_unstale":"2023-10-06T03:00:57.980767+0000","last_undegraded":"2023-10-06T03:00:57.980767+0000","last_fullsized":"2023-10-06T03:00:57.980767+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:34:15.780752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:58.002688+0000","last_change":"2023-10-06T03:00:57.999452+0000","last_active":"2023-10-06T03:00:58.002688+0000","last_peered":"2023-10-06T03:00:58.002688+0000","last_clean":"2023-10-06T03:00:58.002688+0000","last_became_active":"2023-10-06T03:00:57.999164+0000","last_became_peered":"2023-10-06T03:00:57.999164+0000","last_unstale":"2023-10-06T03:00:58.002688+0000","last_undegraded":"2023-10-06T03:00:58.002688+0000","last_fullsized":"2023-10-06T03:00:58.002688+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:28:58.179787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:58.015323+0000","last_change":"2023-10-06T03:00:56.987382+0000","last_active":"2023-10-06T03:00:58.015323+0000","last_peered":"2023-10-06T03:00:58.015323+0000","last_clean":"2023-10-06T03:00:58.015323+0000","last_became_active":"2023-10-06T03:00:56.987056+0000","last_became_peered":"2023-10-06T03:00:56.987056+0000","last_unstale":"2023-10-06T03:00:58.015323+0000","last_undegraded":"2023-10-06T03:00:58.015323+0000","last_fullsized":"2023-10-06T03:00:58.015323+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:57:09.321024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.975126+0000","last_change":"2023-10-06T03:00:57.975126+0000","last_active":"2023-10-06T03:00:57.975126+0000","last_peered":"2023-10-06T03:00:57.975126+0000","last_clean":"2023-10-06T03:00:57.975126+0000","last_became_active":"2023-10-06T03:00:57.974673+0000","last_became_peered":"2023-10-06T03:00:57.974673+0000","last_unstale":"2023-10-06T03:00:57.975126+0000","last_undegraded":"2023-10-06T03:00:57.975126+0000","last_fullsized":"2023-10-06T03:00:57.975126+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:12:21.523918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.979889+0000","last_change":"2023-10-06T03:00:56.976910+0000","last_active":"2023-10-06T03:00:57.979889+0000","last_peered":"2023-10-06T03:00:57.979889+0000","last_clean":"2023-10-06T03:00:57.979889+0000","last_became_active":"2023-10-06T03:00:56.976555+0000","last_became_peered":"2023-10-06T03:00:56.976555+0000","last_unstale":"2023-10-06T03:00:57.979889+0000","last_undegraded":"2023-10-06T03:00:57.979889+0000","last_fullsized":"2023-10-06T03:00:57.979889+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:27:56.469909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:58.007053+0000","last_change":"2023-10-06T03:00:58.004875+0000","last_active":"2023-10-06T03:00:58.007053+0000","last_peered":"2023-10-06T03:00:58.007053+0000","last_clean":"2023-10-06T03:00:58.007053+0000","last_became_active":"2023-10-06T03:00:57.997479+0000","last_became_peered":"2023-10-06T03:00:57.997479+0000","last_unstale":"2023-10-06T03:00:58.007053+0000","last_undegraded":"2023-10-06T03:00:58.007053+0000","last_fullsized":"2023-10-06T03:00:58.007053+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:39:01.220427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.972697+0000","last_change":"2023-10-06T03:00:56.979202+0000","last_active":"2023-10-06T03:00:57.972697+0000","last_peered":"2023-10-06T03:00:57.972697+0000","last_clean":"2023-10-06T03:00:57.972697+0000","last_became_active":"2023-10-06T03:00:56.978922+0000","last_became_peered":"2023-10-06T03:00:56.978922+0000","last_unstale":"2023-10-06T03:00:57.972697+0000","last_undegraded":"2023-10-06T03:00:57.972697+0000","last_fullsized":"2023-10-06T03:00:57.972697+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:04:35.977083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.998369+0000","last_change":"2023-10-06T03:00:57.998369+0000","last_active":"2023-10-06T03:00:57.998369+0000","last_peered":"2023-10-06T03:00:57.998369+0000","last_clean":"2023-10-06T03:00:57.998369+0000","last_became_active":"2023-10-06T03:00:57.997963+0000","last_became_peered":"2023-10-06T03:00:57.997963+0000","last_unstale":"2023-10-06T03:00:57.998369+0000","last_undegraded":"2023-10-06T03:00:57.998369+0000","last_fullsized":"2023-10-06T03:00:57.998369+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:32:39.801984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:58.005626+0000","last_change":"2023-10-06T03:00:56.986683+0000","last_active":"2023-10-06T03:00:58.005626+0000","last_peered":"2023-10-06T03:00:58.005626+0000","last_clean":"2023-10-06T03:00:58.005626+0000","last_became_active":"2023-10-06T03:00:56.986329+0000","last_became_peered":"2023-10-06T03:00:56.986329+0000","last_unstale":"2023-10-06T03:00:58.005626+0000","last_undegraded":"2023-10-06T03:00:58.005626+0000","last_fullsized":"2023-10-06T03:00:58.005626+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:41:07.693426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.981948+0000","last_change":"2023-10-06T03:00:57.981948+0000","last_active":"2023-10-06T03:00:57.981948+0000","last_peered":"2023-10-06T03:00:57.981948+0000","last_clean":"2023-10-06T03:00:57.981948+0000","last_became_active":"2023-10-06T03:00:57.980831+0000","last_became_peered":"2023-10-06T03:00:57.980831+0000","last_unstale":"2023-10-06T03:00:57.981948+0000","last_undegraded":"2023-10-06T03:00:57.981948+0000","last_fullsized":"2023-10-06T03:00:57.981948+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:05:44.036671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.978045+0000","last_change":"2023-10-06T03:00:56.981077+0000","last_active":"2023-10-06T03:00:57.978045+0000","last_peered":"2023-10-06T03:00:57.978045+0000","last_clean":"2023-10-06T03:00:57.978045+0000","last_became_active":"2023-10-06T03:00:56.980777+0000","last_became_peered":"2023-10-06T03:00:56.980777+0000","last_unstale":"2023-10-06T03:00:57.978045+0000","last_undegraded":"2023-10-06T03:00:57.978045+0000","last_fullsized":"2023-10-06T03:00:57.978045+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:41:33.554972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.984615+0000","last_change":"2023-10-06T03:00:57.984615+0000","last_active":"2023-10-06T03:00:57.984615+0000","last_peered":"2023-10-06T03:00:57.984615+0000","last_clean":"2023-10-06T03:00:57.984615+0000","last_became_active":"2023-10-06T03:00:57.984307+0000","last_became_peered":"2023-10-06T03:00:57.984307+0000","last_unstale":"2023-10-06T03:00:57.984615+0000","last_undegraded":"2023-10-06T03:00:57.984615+0000","last_fullsized":"2023-10-06T03:00:57.984615+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:35.377456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T03:00:56.991793+0000","last_change":"2023-10-06T03:00:56.987414+0000","last_active":"2023-10-06T03:00:56.991793+0000","last_peered":"2023-10-06T03:00:56.991793+0000","last_clean":"2023-10-06T03:00:56.991793+0000","last_became_active":"2023-10-06T03:00:56.987085+0000","last_became_peered":"2023-10-06T03:00:56.987085+0000","last_unstale":"2023-10-06T03:00:56.991793+0000","last_undegraded":"2023-10-06T03:00:56.991793+0000","last_fullsized":"2023-10-06T03:00:56.991793+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:04:31.750536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.984185+0000","last_change":"2023-10-06T03:00:57.984185+0000","last_active":"2023-10-06T03:00:57.984185+0000","last_peered":"2023-10-06T03:00:57.984185+0000","last_clean":"2023-10-06T03:00:57.984185+0000","last_became_active":"2023-10-06T03:00:57.983849+0000","last_became_peered":"2023-10-06T03:00:57.983849+0000","last_unstale":"2023-10-06T03:00:57.984185+0000","last_undegraded":"2023-10-06T03:00:57.984185+0000","last_fullsized":"2023-10-06T03:00:57.984185+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:32:39.801984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.963112+0000","last_change":"2023-10-06T03:00:56.985582+0000","last_active":"2023-10-06T03:00:57.963112+0000","last_peered":"2023-10-06T03:00:57.963112+0000","last_clean":"2023-10-06T03:00:57.963112+0000","last_became_active":"2023-10-06T03:00:56.985254+0000","last_became_peered":"2023-10-06T03:00:56.985254+0000","last_unstale":"2023-10-06T03:00:57.963112+0000","last_undegraded":"2023-10-06T03:00:57.963112+0000","last_fullsized":"2023-10-06T03:00:57.963112+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:08:59.306830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.975691+0000","last_change":"2023-10-06T03:00:57.975691+0000","last_active":"2023-10-06T03:00:57.975691+0000","last_peered":"2023-10-06T03:00:57.975691+0000","last_clean":"2023-10-06T03:00:57.975691+0000","last_became_active":"2023-10-06T03:00:57.975368+0000","last_became_peered":"2023-10-06T03:00:57.975368+0000","last_unstale":"2023-10-06T03:00:57.975691+0000","last_undegraded":"2023-10-06T03:00:57.975691+0000","last_fullsized":"2023-10-06T03:00:57.975691+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:12:21.523918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":165,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T03:00:56.970548+0000","last_change":"2023-10-06T03:00:45.709165+0000","last_active":"2023-10-06T03:00:56.970548+0000","last_peered":"2023-10-06T03:00:56.970548+0000","last_clean":"2023-10-06T03:00:56.970548+0000","last_became_active":"2023-10-06T03:00:45.707771+0000","last_became_peered":"2023-10-06T03:00:45.707771+0000","last_unstale":"2023-10-06T03:00:56.970548+0000","last_undegraded":"2023-10-06T03:00:56.970548+0000","last_fullsized":"2023-10-06T03:00:56.970548+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:44.625353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:44.625353+0000","last_clean_scrub_stamp":"2023-10-06T03:00:44.625353+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:31:31.774239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.972547+0000","last_change":"2023-10-06T03:00:51.905381+0000","last_active":"2023-10-06T03:00:57.972547+0000","last_peered":"2023-10-06T03:00:57.972547+0000","last_clean":"2023-10-06T03:00:57.972547+0000","last_became_active":"2023-10-06T03:00:51.904974+0000","last_became_peered":"2023-10-06T03:00:51.904974+0000","last_unstale":"2023-10-06T03:00:57.972547+0000","last_undegraded":"2023-10-06T03:00:57.972547+0000","last_fullsized":"2023-10-06T03:00:57.972547+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:15:19.182956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.961981+0000","last_change":"2023-10-06T03:00:56.977217+0000","last_active":"2023-10-06T03:00:57.961981+0000","last_peered":"2023-10-06T03:00:57.961981+0000","last_clean":"2023-10-06T03:00:57.961981+0000","last_became_active":"2023-10-06T03:00:56.976798+0000","last_became_peered":"2023-10-06T03:00:56.976798+0000","last_unstale":"2023-10-06T03:00:57.961981+0000","last_undegraded":"2023-10-06T03:00:57.961981+0000","last_fullsized":"2023-10-06T03:00:57.961981+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:11:31.937336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.985658+0000","last_change":"2023-10-06T03:00:57.979627+0000","last_active":"2023-10-06T03:00:57.985658+0000","last_peered":"2023-10-06T03:00:57.985658+0000","last_clean":"2023-10-06T03:00:57.985658+0000","last_became_active":"2023-10-06T03:00:57.979346+0000","last_became_peered":"2023-10-06T03:00:57.979346+0000","last_unstale":"2023-10-06T03:00:57.985658+0000","last_undegraded":"2023-10-06T03:00:57.985658+0000","last_fullsized":"2023-10-06T03:00:57.985658+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:34:16.792615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T03:00:56.970455+0000","last_change":"2023-10-06T03:00:51.906480+0000","last_active":"2023-10-06T03:00:56.970455+0000","last_peered":"2023-10-06T03:00:56.970455+0000","last_clean":"2023-10-06T03:00:56.970455+0000","last_became_active":"2023-10-06T03:00:51.905956+0000","last_became_peered":"2023-10-06T03:00:51.905956+0000","last_unstale":"2023-10-06T03:00:56.970455+0000","last_undegraded":"2023-10-06T03:00:56.970455+0000","last_fullsized":"2023-10-06T03:00:56.970455+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:15:19.182956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T03:00:56.984693+0000","last_change":"2023-10-06T03:00:56.977514+0000","last_active":"2023-10-06T03:00:56.984693+0000","last_peered":"2023-10-06T03:00:56.984693+0000","last_clean":"2023-10-06T03:00:56.984693+0000","last_became_active":"2023-10-06T03:00:56.977108+0000","last_became_peered":"2023-10-06T03:00:56.977108+0000","last_unstale":"2023-10-06T03:00:56.984693+0000","last_undegraded":"2023-10-06T03:00:56.984693+0000","last_fullsized":"2023-10-06T03:00:56.984693+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:11:31.937336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.997236+0000","last_change":"2023-10-06T03:00:57.997236+0000","last_active":"2023-10-06T03:00:57.997236+0000","last_peered":"2023-10-06T03:00:57.997236+0000","last_clean":"2023-10-06T03:00:57.997236+0000","last_became_active":"2023-10-06T03:00:57.996915+0000","last_became_peered":"2023-10-06T03:00:57.996915+0000","last_unstale":"2023-10-06T03:00:57.997236+0000","last_undegraded":"2023-10-06T03:00:57.997236+0000","last_fullsized":"2023-10-06T03:00:57.997236+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:16:06.528696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T03:00:56.975328+0000","last_change":"2023-10-06T03:00:51.902453+0000","last_active":"2023-10-06T03:00:56.975328+0000","last_peered":"2023-10-06T03:00:56.975328+0000","last_clean":"2023-10-06T03:00:56.975328+0000","last_became_active":"2023-10-06T03:00:51.901948+0000","last_became_peered":"2023-10-06T03:00:51.901948+0000","last_unstale":"2023-10-06T03:00:56.975328+0000","last_undegraded":"2023-10-06T03:00:56.975328+0000","last_fullsized":"2023-10-06T03:00:56.975328+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:13:30.721650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T03:00:56.995196+0000","last_change":"2023-10-06T03:00:56.986609+0000","last_active":"2023-10-06T03:00:56.995196+0000","last_peered":"2023-10-06T03:00:56.995196+0000","last_clean":"2023-10-06T03:00:56.995196+0000","last_became_active":"2023-10-06T03:00:56.986325+0000","last_became_peered":"2023-10-06T03:00:56.986325+0000","last_unstale":"2023-10-06T03:00:56.995196+0000","last_undegraded":"2023-10-06T03:00:56.995196+0000","last_fullsized":"2023-10-06T03:00:56.995196+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:50:23.531265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.987932+0000","last_change":"2023-10-06T03:00:57.987932+0000","last_active":"2023-10-06T03:00:57.987932+0000","last_peered":"2023-10-06T03:00:57.987932+0000","last_clean":"2023-10-06T03:00:57.987932+0000","last_became_active":"2023-10-06T03:00:57.982542+0000","last_became_peered":"2023-10-06T03:00:57.982542+0000","last_unstale":"2023-10-06T03:00:57.987932+0000","last_undegraded":"2023-10-06T03:00:57.987932+0000","last_fullsized":"2023-10-06T03:00:57.987932+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:51:29.997106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.974149+0000","last_change":"2023-10-06T03:00:51.904148+0000","last_active":"2023-10-06T03:00:57.974149+0000","last_peered":"2023-10-06T03:00:57.974149+0000","last_clean":"2023-10-06T03:00:57.974149+0000","last_became_active":"2023-10-06T03:00:51.903729+0000","last_became_peered":"2023-10-06T03:00:51.903729+0000","last_unstale":"2023-10-06T03:00:57.974149+0000","last_undegraded":"2023-10-06T03:00:57.974149+0000","last_fullsized":"2023-10-06T03:00:57.974149+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:17:25.070478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T03:00:56.991753+0000","last_change":"2023-10-06T03:00:56.986459+0000","last_active":"2023-10-06T03:00:56.991753+0000","last_peered":"2023-10-06T03:00:56.991753+0000","last_clean":"2023-10-06T03:00:56.991753+0000","last_became_active":"2023-10-06T03:00:56.986082+0000","last_became_peered":"2023-10-06T03:00:56.986082+0000","last_unstale":"2023-10-06T03:00:56.991753+0000","last_undegraded":"2023-10-06T03:00:56.991753+0000","last_fullsized":"2023-10-06T03:00:56.991753+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:41:07.693426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.989868+0000","last_change":"2023-10-06T03:00:57.989868+0000","last_active":"2023-10-06T03:00:57.989868+0000","last_peered":"2023-10-06T03:00:57.989868+0000","last_clean":"2023-10-06T03:00:57.989868+0000","last_became_active":"2023-10-06T03:00:57.988520+0000","last_became_peered":"2023-10-06T03:00:57.988520+0000","last_unstale":"2023-10-06T03:00:57.989868+0000","last_undegraded":"2023-10-06T03:00:57.989868+0000","last_fullsized":"2023-10-06T03:00:57.989868+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:32:39.801984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.973391+0000","last_change":"2023-10-06T03:00:56.979822+0000","last_active":"2023-10-06T03:00:57.973391+0000","last_peered":"2023-10-06T03:00:57.973391+0000","last_clean":"2023-10-06T03:00:57.973391+0000","last_became_active":"2023-10-06T03:00:56.978084+0000","last_became_peered":"2023-10-06T03:00:56.978084+0000","last_unstale":"2023-10-06T03:00:57.973391+0000","last_undegraded":"2023-10-06T03:00:57.973391+0000","last_fullsized":"2023-10-06T03:00:57.973391+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:39:00.208565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T03:00:56.957505+0000","last_change":"2023-10-06T03:00:52.484317+0000","last_active":"2023-10-06T03:00:56.957505+0000","last_peered":"2023-10-06T03:00:56.957505+0000","last_clean":"2023-10-06T03:00:56.957505+0000","last_became_active":"2023-10-06T03:00:52.483818+0000","last_became_peered":"2023-10-06T03:00:52.483818+0000","last_unstale":"2023-10-06T03:00:56.957505+0000","last_undegraded":"2023-10-06T03:00:56.957505+0000","last_fullsized":"2023-10-06T03:00:56.957505+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:17:24.136459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.991155+0000","last_change":"2023-10-06T03:00:57.991155+0000","last_active":"2023-10-06T03:00:57.991155+0000","last_peered":"2023-10-06T03:00:57.991155+0000","last_clean":"2023-10-06T03:00:57.991155+0000","last_became_active":"2023-10-06T03:00:57.990697+0000","last_became_peered":"2023-10-06T03:00:57.990697+0000","last_unstale":"2023-10-06T03:00:57.991155+0000","last_undegraded":"2023-10-06T03:00:57.991155+0000","last_fullsized":"2023-10-06T03:00:57.991155+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:01:50.001484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T03:00:56.995300+0000","last_change":"2023-10-06T03:00:56.987943+0000","last_active":"2023-10-06T03:00:56.995300+0000","last_peered":"2023-10-06T03:00:56.995300+0000","last_clean":"2023-10-06T03:00:56.995300+0000","last_became_active":"2023-10-06T03:00:56.987664+0000","last_became_peered":"2023-10-06T03:00:56.987664+0000","last_unstale":"2023-10-06T03:00:56.995300+0000","last_undegraded":"2023-10-06T03:00:56.995300+0000","last_fullsized":"2023-10-06T03:00:56.995300+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:32:00.864289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T03:00:56.971561+0000","last_change":"2023-10-06T03:00:52.485186+0000","last_active":"2023-10-06T03:00:56.971561+0000","last_peered":"2023-10-06T03:00:56.971561+0000","last_clean":"2023-10-06T03:00:56.971561+0000","last_became_active":"2023-10-06T03:00:52.484615+0000","last_became_peered":"2023-10-06T03:00:52.484615+0000","last_unstale":"2023-10-06T03:00:56.971561+0000","last_undegraded":"2023-10-06T03:00:56.971561+0000","last_fullsized":"2023-10-06T03:00:56.971561+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:17:25.070478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.993777+0000","last_change":"2023-10-06T03:00:57.993777+0000","last_active":"2023-10-06T03:00:57.993777+0000","last_peered":"2023-10-06T03:00:57.993777+0000","last_clean":"2023-10-06T03:00:57.993777+0000","last_became_active":"2023-10-06T03:00:57.993567+0000","last_became_peered":"2023-10-06T03:00:57.993567+0000","last_unstale":"2023-10-06T03:00:57.993777+0000","last_undegraded":"2023-10-06T03:00:57.993777+0000","last_fullsized":"2023-10-06T03:00:57.993777+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:14:29.859982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:58.012633+0000","last_change":"2023-10-06T03:00:56.980714+0000","last_active":"2023-10-06T03:00:58.012633+0000","last_peered":"2023-10-06T03:00:58.012633+0000","last_clean":"2023-10-06T03:00:58.012633+0000","last_became_active":"2023-10-06T03:00:56.979257+0000","last_became_peered":"2023-10-06T03:00:56.979257+0000","last_unstale":"2023-10-06T03:00:58.012633+0000","last_undegraded":"2023-10-06T03:00:58.012633+0000","last_fullsized":"2023-10-06T03:00:58.012633+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:30:15.966823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T03:00:56.956868+0000","last_change":"2023-10-06T03:00:51.903388+0000","last_active":"2023-10-06T03:00:56.956868+0000","last_peered":"2023-10-06T03:00:56.956868+0000","last_clean":"2023-10-06T03:00:56.956868+0000","last_became_active":"2023-10-06T03:00:51.902959+0000","last_became_peered":"2023-10-06T03:00:51.902959+0000","last_unstale":"2023-10-06T03:00:56.956868+0000","last_undegraded":"2023-10-06T03:00:56.956868+0000","last_fullsized":"2023-10-06T03:00:56.956868+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:30:16.907470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.988640+0000","last_change":"2023-10-06T03:00:57.985087+0000","last_active":"2023-10-06T03:00:57.988640+0000","last_peered":"2023-10-06T03:00:57.988640+0000","last_clean":"2023-10-06T03:00:57.988640+0000","last_became_active":"2023-10-06T03:00:57.984740+0000","last_became_peered":"2023-10-06T03:00:57.984740+0000","last_unstale":"2023-10-06T03:00:57.988640+0000","last_undegraded":"2023-10-06T03:00:57.988640+0000","last_fullsized":"2023-10-06T03:00:57.988640+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:34:39.364267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T03:00:56.995640+0000","last_change":"2023-10-06T03:00:56.985269+0000","last_active":"2023-10-06T03:00:56.995640+0000","last_peered":"2023-10-06T03:00:56.995640+0000","last_clean":"2023-10-06T03:00:56.995640+0000","last_became_active":"2023-10-06T03:00:56.984926+0000","last_became_peered":"2023-10-06T03:00:56.984926+0000","last_unstale":"2023-10-06T03:00:56.995640+0000","last_undegraded":"2023-10-06T03:00:56.995640+0000","last_fullsized":"2023-10-06T03:00:56.995640+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:32:00.864289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.977974+0000","last_change":"2023-10-06T03:00:51.903242+0000","last_active":"2023-10-06T03:00:57.977974+0000","last_peered":"2023-10-06T03:00:57.977974+0000","last_clean":"2023-10-06T03:00:57.977974+0000","last_became_active":"2023-10-06T03:00:51.902929+0000","last_became_peered":"2023-10-06T03:00:51.902929+0000","last_unstale":"2023-10-06T03:00:57.977974+0000","last_undegraded":"2023-10-06T03:00:57.977974+0000","last_fullsized":"2023-10-06T03:00:57.977974+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:34:12.274158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.986011+0000","last_change":"2023-10-06T03:00:57.986011+0000","last_active":"2023-10-06T03:00:57.986011+0000","last_peered":"2023-10-06T03:00:57.986011+0000","last_clean":"2023-10-06T03:00:57.986011+0000","last_became_active":"2023-10-06T03:00:57.985735+0000","last_became_peered":"2023-10-06T03:00:57.985735+0000","last_unstale":"2023-10-06T03:00:57.986011+0000","last_undegraded":"2023-10-06T03:00:57.986011+0000","last_fullsized":"2023-10-06T03:00:57.986011+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:14:29.859982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.981395+0000","last_change":"2023-10-06T03:00:57.981395+0000","last_active":"2023-10-06T03:00:57.981395+0000","last_peered":"2023-10-06T03:00:57.981395+0000","last_clean":"2023-10-06T03:00:57.981395+0000","last_became_active":"2023-10-06T03:00:57.981107+0000","last_became_peered":"2023-10-06T03:00:57.981107+0000","last_unstale":"2023-10-06T03:00:57.981395+0000","last_undegraded":"2023-10-06T03:00:57.981395+0000","last_fullsized":"2023-10-06T03:00:57.981395+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:32:20.183224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"22'6","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:58.018128+0000","last_change":"2023-10-06T03:00:56.979738+0000","last_active":"2023-10-06T03:00:58.018128+0000","last_peered":"2023-10-06T03:00:58.018128+0000","last_clean":"2023-10-06T03:00:58.018128+0000","last_became_active":"2023-10-06T03:00:56.979409+0000","last_became_peered":"2023-10-06T03:00:56.979409+0000","last_unstale":"2023-10-06T03:00:58.018128+0000","last_undegraded":"2023-10-06T03:00:58.018128+0000","last_fullsized":"2023-10-06T03:00:58.018128+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:41:33.554972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.990981+0000","last_change":"2023-10-06T03:00:57.990981+0000","last_active":"2023-10-06T03:00:57.990981+0000","last_peered":"2023-10-06T03:00:57.990981+0000","last_clean":"2023-10-06T03:00:57.990981+0000","last_became_active":"2023-10-06T03:00:57.990342+0000","last_became_peered":"2023-10-06T03:00:57.990342+0000","last_unstale":"2023-10-06T03:00:57.990981+0000","last_undegraded":"2023-10-06T03:00:57.990981+0000","last_fullsized":"2023-10-06T03:00:57.990981+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:16:06.528696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:58.012600+0000","last_change":"2023-10-06T03:00:56.983297+0000","last_active":"2023-10-06T03:00:58.012600+0000","last_peered":"2023-10-06T03:00:58.012600+0000","last_clean":"2023-10-06T03:00:58.012600+0000","last_became_active":"2023-10-06T03:00:56.983095+0000","last_became_peered":"2023-10-06T03:00:56.983095+0000","last_unstale":"2023-10-06T03:00:58.012600+0000","last_undegraded":"2023-10-06T03:00:58.012600+0000","last_fullsized":"2023-10-06T03:00:58.012600+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:49:02.389155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.976844+0000","last_change":"2023-10-06T03:00:56.976251+0000","last_active":"2023-10-06T03:00:57.976844+0000","last_peered":"2023-10-06T03:00:57.976844+0000","last_clean":"2023-10-06T03:00:57.976844+0000","last_became_active":"2023-10-06T03:00:56.975922+0000","last_became_peered":"2023-10-06T03:00:56.975922+0000","last_unstale":"2023-10-06T03:00:57.976844+0000","last_undegraded":"2023-10-06T03:00:57.976844+0000","last_fullsized":"2023-10-06T03:00:57.976844+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:34:15.780752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.995718+0000","last_change":"2023-10-06T03:00:57.989172+0000","last_active":"2023-10-06T03:00:57.995718+0000","last_peered":"2023-10-06T03:00:57.995718+0000","last_clean":"2023-10-06T03:00:57.995718+0000","last_became_active":"2023-10-06T03:00:57.988815+0000","last_became_peered":"2023-10-06T03:00:57.988815+0000","last_unstale":"2023-10-06T03:00:57.995718+0000","last_undegraded":"2023-10-06T03:00:57.995718+0000","last_fullsized":"2023-10-06T03:00:57.995718+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:41:47.568218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T03:00:56.990506+0000","last_change":"2023-10-06T03:00:56.981539+0000","last_active":"2023-10-06T03:00:56.990506+0000","last_peered":"2023-10-06T03:00:56.990506+0000","last_clean":"2023-10-06T03:00:56.990506+0000","last_became_active":"2023-10-06T03:00:56.980952+0000","last_became_peered":"2023-10-06T03:00:56.980952+0000","last_unstale":"2023-10-06T03:00:56.990506+0000","last_undegraded":"2023-10-06T03:00:56.990506+0000","last_fullsized":"2023-10-06T03:00:56.990506+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:30:15.966823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.987260+0000","last_change":"2023-10-06T03:00:57.984397+0000","last_active":"2023-10-06T03:00:57.987260+0000","last_peered":"2023-10-06T03:00:57.987260+0000","last_clean":"2023-10-06T03:00:57.987260+0000","last_became_active":"2023-10-06T03:00:57.983080+0000","last_became_peered":"2023-10-06T03:00:57.983080+0000","last_unstale":"2023-10-06T03:00:57.987260+0000","last_undegraded":"2023-10-06T03:00:57.987260+0000","last_fullsized":"2023-10-06T03:00:57.987260+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:14:29.859982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.987973+0000","last_change":"2023-10-06T03:00:57.986460+0000","last_active":"2023-10-06T03:00:57.987973+0000","last_peered":"2023-10-06T03:00:57.987973+0000","last_clean":"2023-10-06T03:00:57.987973+0000","last_became_active":"2023-10-06T03:00:57.985944+0000","last_became_peered":"2023-10-06T03:00:57.985944+0000","last_unstale":"2023-10-06T03:00:57.987973+0000","last_undegraded":"2023-10-06T03:00:57.987973+0000","last_fullsized":"2023-10-06T03:00:57.987973+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:01:21.312056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.962907+0000","last_change":"2023-10-06T03:00:56.986763+0000","last_active":"2023-10-06T03:00:57.962907+0000","last_peered":"2023-10-06T03:00:57.962907+0000","last_clean":"2023-10-06T03:00:57.962907+0000","last_became_active":"2023-10-06T03:00:56.986417+0000","last_became_peered":"2023-10-06T03:00:56.986417+0000","last_unstale":"2023-10-06T03:00:57.962907+0000","last_undegraded":"2023-10-06T03:00:57.962907+0000","last_fullsized":"2023-10-06T03:00:57.962907+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:50:23.531265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.996078+0000","last_change":"2023-10-06T03:00:57.996078+0000","last_active":"2023-10-06T03:00:57.996078+0000","last_peered":"2023-10-06T03:00:57.996078+0000","last_clean":"2023-10-06T03:00:57.996078+0000","last_became_active":"2023-10-06T03:00:57.995672+0000","last_became_peered":"2023-10-06T03:00:57.995672+0000","last_unstale":"2023-10-06T03:00:57.996078+0000","last_undegraded":"2023-10-06T03:00:57.996078+0000","last_fullsized":"2023-10-06T03:00:57.996078+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:18:57.339278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T03:00:56.990375+0000","last_change":"2023-10-06T03:00:56.983097+0000","last_active":"2023-10-06T03:00:56.990375+0000","last_peered":"2023-10-06T03:00:56.990375+0000","last_clean":"2023-10-06T03:00:56.990375+0000","last_became_active":"2023-10-06T03:00:56.982646+0000","last_became_peered":"2023-10-06T03:00:56.982646+0000","last_unstale":"2023-10-06T03:00:56.990375+0000","last_undegraded":"2023-10-06T03:00:56.990375+0000","last_fullsized":"2023-10-06T03:00:56.990375+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:11:31.937336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.978634+0000","last_change":"2023-10-06T03:00:57.976355+0000","last_active":"2023-10-06T03:00:57.978634+0000","last_peered":"2023-10-06T03:00:57.978634+0000","last_clean":"2023-10-06T03:00:57.978634+0000","last_became_active":"2023-10-06T03:00:57.976098+0000","last_became_peered":"2023-10-06T03:00:57.976098+0000","last_unstale":"2023-10-06T03:00:57.978634+0000","last_undegraded":"2023-10-06T03:00:57.978634+0000","last_fullsized":"2023-10-06T03:00:57.978634+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:32:20.183224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.968264+0000","last_change":"2023-10-06T03:00:56.979150+0000","last_active":"2023-10-06T03:00:57.968264+0000","last_peered":"2023-10-06T03:00:57.968264+0000","last_clean":"2023-10-06T03:00:57.968264+0000","last_became_active":"2023-10-06T03:00:56.977097+0000","last_became_peered":"2023-10-06T03:00:56.977097+0000","last_unstale":"2023-10-06T03:00:57.968264+0000","last_undegraded":"2023-10-06T03:00:57.968264+0000","last_fullsized":"2023-10-06T03:00:57.968264+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:39:17.918596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.986365+0000","last_change":"2023-10-06T03:00:57.986365+0000","last_active":"2023-10-06T03:00:57.986365+0000","last_peered":"2023-10-06T03:00:57.986365+0000","last_clean":"2023-10-06T03:00:57.986365+0000","last_became_active":"2023-10-06T03:00:57.985862+0000","last_became_peered":"2023-10-06T03:00:57.985862+0000","last_unstale":"2023-10-06T03:00:57.986365+0000","last_undegraded":"2023-10-06T03:00:57.986365+0000","last_fullsized":"2023-10-06T03:00:57.986365+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:32:01.876152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.982273+0000","last_change":"2023-10-06T03:00:56.983730+0000","last_active":"2023-10-06T03:00:57.982273+0000","last_peered":"2023-10-06T03:00:57.982273+0000","last_clean":"2023-10-06T03:00:57.982273+0000","last_became_active":"2023-10-06T03:00:56.983403+0000","last_became_peered":"2023-10-06T03:00:56.983403+0000","last_unstale":"2023-10-06T03:00:57.982273+0000","last_undegraded":"2023-10-06T03:00:57.982273+0000","last_fullsized":"2023-10-06T03:00:57.982273+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:50:23.531265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.981050+0000","last_change":"2023-10-06T03:00:57.981050+0000","last_active":"2023-10-06T03:00:57.981050+0000","last_peered":"2023-10-06T03:00:57.981050+0000","last_clean":"2023-10-06T03:00:57.981050+0000","last_became_active":"2023-10-06T03:00:57.980699+0000","last_became_peered":"2023-10-06T03:00:57.980699+0000","last_unstale":"2023-10-06T03:00:57.981050+0000","last_undegraded":"2023-10-06T03:00:57.981050+0000","last_fullsized":"2023-10-06T03:00:57.981050+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:54:01.471407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:58.015580+0000","last_change":"2023-10-06T03:00:56.980374+0000","last_active":"2023-10-06T03:00:58.015580+0000","last_peered":"2023-10-06T03:00:58.015580+0000","last_clean":"2023-10-06T03:00:58.015580+0000","last_became_active":"2023-10-06T03:00:56.980008+0000","last_became_peered":"2023-10-06T03:00:56.980008+0000","last_unstale":"2023-10-06T03:00:58.015580+0000","last_undegraded":"2023-10-06T03:00:58.015580+0000","last_fullsized":"2023-10-06T03:00:58.015580+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:01:20.300193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.981237+0000","last_change":"2023-10-06T03:00:57.981237+0000","last_active":"2023-10-06T03:00:57.981237+0000","last_peered":"2023-10-06T03:00:57.981237+0000","last_clean":"2023-10-06T03:00:57.981237+0000","last_became_active":"2023-10-06T03:00:57.980835+0000","last_became_peered":"2023-10-06T03:00:57.980835+0000","last_unstale":"2023-10-06T03:00:57.981237+0000","last_undegraded":"2023-10-06T03:00:57.981237+0000","last_fullsized":"2023-10-06T03:00:57.981237+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:34:39.099380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:58.015618+0000","last_change":"2023-10-06T03:00:56.982198+0000","last_active":"2023-10-06T03:00:58.015618+0000","last_peered":"2023-10-06T03:00:58.015618+0000","last_clean":"2023-10-06T03:00:58.015618+0000","last_became_active":"2023-10-06T03:00:56.981933+0000","last_became_peered":"2023-10-06T03:00:56.981933+0000","last_unstale":"2023-10-06T03:00:58.015618+0000","last_undegraded":"2023-10-06T03:00:58.015618+0000","last_fullsized":"2023-10-06T03:00:58.015618+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:57:09.321024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.987031+0000","last_change":"2023-10-06T03:00:57.984525+0000","last_active":"2023-10-06T03:00:57.987031+0000","last_peered":"2023-10-06T03:00:57.987031+0000","last_clean":"2023-10-06T03:00:57.987031+0000","last_became_active":"2023-10-06T03:00:57.984205+0000","last_became_peered":"2023-10-06T03:00:57.984205+0000","last_unstale":"2023-10-06T03:00:57.987031+0000","last_undegraded":"2023-10-06T03:00:57.987031+0000","last_fullsized":"2023-10-06T03:00:57.987031+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:28:58.179787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:58.006745+0000","last_change":"2023-10-06T03:00:56.978317+0000","last_active":"2023-10-06T03:00:58.006745+0000","last_peered":"2023-10-06T03:00:58.006745+0000","last_clean":"2023-10-06T03:00:58.006745+0000","last_became_active":"2023-10-06T03:00:56.977802+0000","last_became_peered":"2023-10-06T03:00:56.977802+0000","last_unstale":"2023-10-06T03:00:58.006745+0000","last_undegraded":"2023-10-06T03:00:58.006745+0000","last_fullsized":"2023-10-06T03:00:58.006745+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:04:35.977083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.984100+0000","last_change":"2023-10-06T03:00:57.984100+0000","last_active":"2023-10-06T03:00:57.984100+0000","last_peered":"2023-10-06T03:00:57.984100+0000","last_clean":"2023-10-06T03:00:57.984100+0000","last_became_active":"2023-10-06T03:00:57.983756+0000","last_became_peered":"2023-10-06T03:00:57.983756+0000","last_unstale":"2023-10-06T03:00:57.984100+0000","last_undegraded":"2023-10-06T03:00:57.984100+0000","last_fullsized":"2023-10-06T03:00:57.984100+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:10:20.444330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:58.007358+0000","last_change":"2023-10-06T03:00:56.981315+0000","last_active":"2023-10-06T03:00:58.007358+0000","last_peered":"2023-10-06T03:00:58.007358+0000","last_clean":"2023-10-06T03:00:58.007358+0000","last_became_active":"2023-10-06T03:00:56.980617+0000","last_became_peered":"2023-10-06T03:00:56.980617+0000","last_unstale":"2023-10-06T03:00:58.007358+0000","last_undegraded":"2023-10-06T03:00:58.007358+0000","last_fullsized":"2023-10-06T03:00:58.007358+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:04:35.977083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298120,"kb_used_data":832,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073720,"statfs":{"total":96636764160,"available":96331489280,"internally_reserved":0,"allocated":851968,"data_stored":674798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92700000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3680000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4870000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3420000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.157}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89400000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5549999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297512,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074328,"statfs":{"total":96636764160,"available":96332111872,"internally_reserved":0,"allocated":229376,"data_stored":82678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.083}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5229999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0469999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.129}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3540000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.647}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6060000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297520,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074320,"statfs":{"total":96636764160,"available":96332103680,"internally_reserved":0,"allocated":237568,"data_stored":83302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85099999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3080000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.331}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.353}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.214}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.163}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297532,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074308,"statfs":{"total":96636764160,"available":96332091392,"internally_reserved":0,"allocated":249856,"data_stored":84270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1080000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0660000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4239999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.383}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6719999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.776}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9059999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301612,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070228,"statfs":{"total":96636764160,"available":96327913472,"internally_reserved":0,"allocated":233472,"data_stored":82768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92200000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.173}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.361}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.123}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.532}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301608,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070232,"statfs":{"total":96636764160,"available":96327917568,"internally_reserved":0,"allocated":229376,"data_stored":82678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0149999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83099999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5189999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.794}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4359999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8420000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301608,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070232,"statfs":{"total":96636764160,"available":96327917568,"internally_reserved":0,"allocated":229376,"data_stored":82678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0149999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2430000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6319999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.702}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5529999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302192,"kb_used_data":808,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069648,"statfs":{"total":96636764160,"available":96327319552,"internally_reserved":0,"allocated":827392,"data_stored":673600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.075}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2310000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.246}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4179999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.46}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:01:02.271 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:01:02.474 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.467+0000 7fcfc49c5700 1 Processor -- start 2023-10-06T03:01:02.475 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.467+0000 7fcfc49c5700 1 -- start start 2023-10-06T03:01:02.477 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.471+0000 7fcfc49c5700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fcfc01557d0 0x7fcfc006b030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:02.477 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.471+0000 7fcfc49c5700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfc00aec10 con 0x7fcfc006d6b0 2023-10-06T03:01:02.477 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.471+0000 7fcfc49c5700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfc00af790 con 0x7fcfc006ac60 2023-10-06T03:01:02.477 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.471+0000 7fcfc49c5700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfc00aee60 con 0x7fcfc01557d0 2023-10-06T03:01:02.478 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.471+0000 7fcfbed9d700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fcfc006d6b0 0x7fcfc006db10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:43304/0 (socket says 172.21.15.57:43304) 2023-10-06T03:01:02.478 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.471+0000 7fcfbed9d700 1 -- 172.21.15.57:0/3520920229 learned_addr learned my addr 172.21.15.57:0/3520920229 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:01:02.478 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.471+0000 7fcfbdd9b700 1 -- 172.21.15.57:0/3520920229 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4106840257 0 0) 0x7fcfc00aec10 con 0x7fcfc006d6b0 2023-10-06T03:01:02.478 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.471+0000 7fcfbdd9b700 1 -- 172.21.15.57:0/3520920229 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcfac003570 con 0x7fcfc006d6b0 2023-10-06T03:01:02.478 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.471+0000 7fcfb7fff700 1 --2- 172.21.15.57:0/3520920229 >> v2:172.21.15.105:3300/0 conn(0x7fcfc01557d0 0x7fcfc006b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:02.479 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.475+0000 7fcfbdd9b700 1 -- 172.21.15.57:0/3520920229 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 286447448 0 0) 0x7fcfac003570 con 0x7fcfc006d6b0 2023-10-06T03:01:02.480 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.475+0000 7fcfbdd9b700 1 -- 172.21.15.57:0/3520920229 >> v2:172.21.15.105:3300/0 conn(0x7fcfc01557d0 msgr2=0x7fcfc006b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:02.480 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.475+0000 7fcfbdd9b700 1 --2- 172.21.15.57:0/3520920229 >> v2:172.21.15.105:3300/0 conn(0x7fcfc01557d0 0x7fcfc006b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:02.480 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.475+0000 7fcfbdd9b700 1 -- 172.21.15.57:0/3520920229 >> v1:172.21.15.105:6789/0 conn(0x7fcfc006ac60 legacy=0x7fcfc01550c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:02.480 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.475+0000 7fcfbdd9b700 1 -- 172.21.15.57:0/3520920229 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfc00af140 con 0x7fcfc006d6b0 2023-10-06T03:01:02.480 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.475+0000 7fcfbdd9b700 1 -- 172.21.15.57:0/3520920229 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2482400018 0 0) 0x7fcfb80017f0 con 0x7fcfc006d6b0 2023-10-06T03:01:02.480 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.475+0000 7fcfbdd9b700 1 -- 172.21.15.57:0/3520920229 >> v1:172.21.15.57:6789/0 conn(0x7fcfc006d6b0 legacy=0x7fcfc006db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:02.480 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.475+0000 7fcfbdd9b700 1 --2- 172.21.15.57:0/3520920229 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcfac003a60 0x7fcfac003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:02.480 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.475+0000 7fcfbdd9b700 1 --2- 172.21.15.57:0/3520920229 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcfac004810 0x7fcfac004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:02.480 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.475+0000 7fcfbdd9b700 1 --2- 172.21.15.57:0/3520920229 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcfac0051c0 0x7fcfac00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:02.480 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.475+0000 7fcfbdd9b700 1 -- 172.21.15.57:0/3520920229 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc00aee60 con 0x7fcfac0051c0 2023-10-06T03:01:02.480 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.475+0000 7fcfbdd9b700 1 -- 172.21.15.57:0/3520920229 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfac00c0e0 con 0x7fcfac003a60 2023-10-06T03:01:02.480 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.475+0000 7fcfbdd9b700 1 -- 172.21.15.57:0/3520920229 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfac00c2a0 con 0x7fcfac004810 2023-10-06T03:01:02.481 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.475+0000 7fcfbed9d700 1 --2- 172.21.15.57:0/3520920229 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcfac0051c0 0x7fcfac00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:02.482 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.475+0000 7fcfbe59c700 1 --2- 172.21.15.57:0/3520920229 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcfac003a60 0x7fcfac003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:02.482 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.475+0000 7fcfb7fff700 1 --2- 172.21.15.57:0/3520920229 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcfac004810 0x7fcfac004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:02.482 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.475+0000 7fcfbed9d700 1 -- 172.21.15.57:0/3520920229 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcfac004810 msgr2=0x7fcfac004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:02.482 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.475+0000 7fcfbed9d700 1 --2- 172.21.15.57:0/3520920229 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcfac004810 0x7fcfac004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:02.482 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.475+0000 7fcfbed9d700 1 -- 172.21.15.57:0/3520920229 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcfac003a60 msgr2=0x7fcfac003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:02.482 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.475+0000 7fcfbed9d700 1 --2- 172.21.15.57:0/3520920229 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcfac003a60 0x7fcfac003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:02.482 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.475+0000 7fcfbed9d700 1 -- 172.21.15.57:0/3520920229 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfac003570 con 0x7fcfac0051c0 2023-10-06T03:01:02.482 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.475+0000 7fcfbed9d700 1 -- 172.21.15.57:0/3520920229 reap_dead start 2023-10-06T03:01:02.482 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.475+0000 7fcfbed9d700 1 --2- 172.21.15.57:0/3520920229 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcfac0051c0 0x7fcfac00ba60 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fcfb800a950 tx=0x7fcfb80021f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c510e1041a0971c9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:02.482 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.475+0000 7fcfbdd9b700 1 -- 172.21.15.57:0/3520920229 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb80070d0 con 0x7fcfac0051c0 2023-10-06T03:01:02.482 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.475+0000 7fcfbdd9b700 1 -- 172.21.15.57:0/3520920229 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfb8007250 con 0x7fcfac0051c0 2023-10-06T03:01:02.482 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.475+0000 7fcfbdd9b700 1 -- 172.21.15.57:0/3520920229 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb8007610 con 0x7fcfac0051c0 2023-10-06T03:01:02.483 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.479+0000 7fcfc49c5700 1 -- 172.21.15.57:0/3520920229 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcfac0051c0 msgr2=0x7fcfac00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:02.483 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.479+0000 7fcfc49c5700 1 --2- 172.21.15.57:0/3520920229 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcfac0051c0 0x7fcfac00ba60 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fcfb800a950 tx=0x7fcfb80021f0 comp rx=0 tx=0).stop 2023-10-06T03:01:02.483 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.479+0000 7fcfc49c5700 1 -- 172.21.15.57:0/3520920229 shutdown_connections 2023-10-06T03:01:02.483 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.479+0000 7fcfc49c5700 1 --2- 172.21.15.57:0/3520920229 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcfac0051c0 0x7fcfac00ba60 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:02.483 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.479+0000 7fcfc49c5700 1 -- 172.21.15.57:0/3520920229 >> 172.21.15.57:0/3520920229 conn(0x7fcfc00cbdd0 msgr2=0x7fcfc00cc1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:02.484 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.479+0000 7fcfc49c5700 1 -- 172.21.15.57:0/3520920229 shutdown_connections 2023-10-06T03:01:02.484 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.479+0000 7fcfc49c5700 1 -- 172.21.15.57:0/3520920229 wait complete. 2023-10-06T03:01:02.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.479+0000 7fcfc49c5700 1 Processor -- start 2023-10-06T03:01:02.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.479+0000 7fcfc49c5700 1 -- start start 2023-10-06T03:01:02.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.483+0000 7fcfc49c5700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcfac0051c0 0x7fcfc0166540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:02.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.483+0000 7fcfc49c5700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcfc0168f90 0x7fcfc0153020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:02.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.483+0000 7fcfc49c5700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcfc0153560 0x7fcfc0145c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:02.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.483+0000 7fcfc49c5700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc0169490 con 0x7fcfac0051c0 2023-10-06T03:01:02.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.483+0000 7fcfc49c5700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc0169770 con 0x7fcfc0168f90 2023-10-06T03:01:02.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.483+0000 7fcfc49c5700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc0169a50 con 0x7fcfc0153560 2023-10-06T03:01:02.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.483+0000 7fcfbe59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcfac0051c0 0x7fcfc0166540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:02.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.483+0000 7fcfbe59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcfac0051c0 0x7fcfc0166540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:45018/0 (socket says 172.21.15.57:45018) 2023-10-06T03:01:02.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.483+0000 7fcfbe59c700 1 -- 172.21.15.57:0/1518157433 learned_addr learned my addr 172.21.15.57:0/1518157433 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:02.489 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.483+0000 7fcfb7fff700 1 --2- 172.21.15.57:0/1518157433 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcfc0168f90 0x7fcfc0153020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:02.489 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.483+0000 7fcfbed9d700 1 --2- 172.21.15.57:0/1518157433 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcfc0153560 0x7fcfc0145c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:02.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.483+0000 7fcfbe59c700 1 -- 172.21.15.57:0/1518157433 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcfc0153560 msgr2=0x7fcfc0145c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:02.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.483+0000 7fcfbe59c700 1 --2- 172.21.15.57:0/1518157433 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcfc0153560 0x7fcfc0145c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:02.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.483+0000 7fcfbe59c700 1 -- 172.21.15.57:0/1518157433 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcfc0168f90 msgr2=0x7fcfc0153020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:02.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.483+0000 7fcfbe59c700 1 --2- 172.21.15.57:0/1518157433 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcfc0168f90 0x7fcfc0153020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:02.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.483+0000 7fcfbe59c700 1 -- 172.21.15.57:0/1518157433 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfc0169d30 con 0x7fcfac0051c0 2023-10-06T03:01:02.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.483+0000 7fcfbe59c700 1 --2- 172.21.15.57:0/1518157433 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcfac0051c0 0x7fcfc0166540 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fcfb000e800 tx=0x7fcfb0009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:02.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.483+0000 7fcfb67fc700 1 -- 172.21.15.57:0/1518157433 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb0012500 con 0x7fcfac0051c0 2023-10-06T03:01:02.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.483+0000 7fcfb67fc700 1 -- 172.21.15.57:0/1518157433 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfb0010040 con 0x7fcfac0051c0 2023-10-06T03:01:02.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.483+0000 7fcfc49c5700 1 -- 172.21.15.57:0/1518157433 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfc01461a0 con 0x7fcfac0051c0 2023-10-06T03:01:02.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.483+0000 7fcfb67fc700 1 -- 172.21.15.57:0/1518157433 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb00128d0 con 0x7fcfac0051c0 2023-10-06T03:01:02.491 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.483+0000 7fcfc49c5700 1 -- 172.21.15.57:0/1518157433 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfc0146670 con 0x7fcfac0051c0 2023-10-06T03:01:02.492 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.487+0000 7fcfc49c5700 1 -- 172.21.15.57:0/1518157433 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfc00712e0 con 0x7fcfac0051c0 2023-10-06T03:01:02.493 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.487+0000 7fcfb67fc700 1 -- 172.21.15.57:0/1518157433 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fcfb0012c40 con 0x7fcfac0051c0 2023-10-06T03:01:02.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.487+0000 7fcfb67fc700 1 --2- 172.21.15.57:0/1518157433 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fcfa0060550 0x7fcfa0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:02.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.487+0000 7fcfb67fc700 1 -- 172.21.15.57:0/1518157433 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fcfb007c4f0 con 0x7fcfac0051c0 2023-10-06T03:01:02.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.487+0000 7fcfb7fff700 1 --2- 172.21.15.57:0/1518157433 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fcfa0060550 0x7fcfa0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:02.495 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.491+0000 7fcfb7fff700 1 --2- 172.21.15.57:0/1518157433 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fcfa0060550 0x7fcfa0062a00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fcfc00b10a0 tx=0x7fcfa8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:02.501 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.495+0000 7fcfb67fc700 1 -- 172.21.15.57:0/1518157433 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fcfb004c990 con 0x7fcfac0051c0 2023-10-06T03:01:02.670 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.663+0000 7fcfc49c5700 1 -- 172.21.15.57:0/1518157433 --> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcfc016a160 con 0x7fcfa0060550 2023-10-06T03:01:02.686 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.679+0000 7fcfb67fc700 1 -- 172.21.15.57:0/1518157433 <== mgr.4103 v2:172.21.15.57:6832/32947 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286502 (secure 0 0 0) 0x7fcfc016a160 con 0x7fcfa0060550 2023-10-06T03:01:02.689 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:01:02.695 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.691+0000 7fcfc49c5700 1 -- 172.21.15.57:0/1518157433 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fcfa0060550 msgr2=0x7fcfa0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:02.695 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.691+0000 7fcfc49c5700 1 --2- 172.21.15.57:0/1518157433 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fcfa0060550 0x7fcfa0062a00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fcfc00b10a0 tx=0x7fcfa8008040 comp rx=0 tx=0).stop 2023-10-06T03:01:02.695 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.691+0000 7fcfc49c5700 1 -- 172.21.15.57:0/1518157433 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcfac0051c0 msgr2=0x7fcfc0166540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:02.696 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.691+0000 7fcfc49c5700 1 --2- 172.21.15.57:0/1518157433 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcfac0051c0 0x7fcfc0166540 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fcfb000e800 tx=0x7fcfb0009040 comp rx=0 tx=0).stop 2023-10-06T03:01:02.696 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.691+0000 7fcfc49c5700 1 -- 172.21.15.57:0/1518157433 shutdown_connections 2023-10-06T03:01:02.696 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.691+0000 7fcfc49c5700 1 --2- 172.21.15.57:0/1518157433 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fcfa0060550 0x7fcfa0062a00 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:02.696 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.691+0000 7fcfc49c5700 1 --2- 172.21.15.57:0/1518157433 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcfc0153560 0x7fcfc0145c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:02.696 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.691+0000 7fcfc49c5700 1 --2- 172.21.15.57:0/1518157433 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcfc0168f90 0x7fcfc0153020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:02.696 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.691+0000 7fcfc49c5700 1 --2- 172.21.15.57:0/1518157433 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcfac0051c0 0x7fcfc0166540 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:02.696 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.691+0000 7fcfc49c5700 1 -- 172.21.15.57:0/1518157433 >> 172.21.15.57:0/1518157433 conn(0x7fcfc00cbdd0 msgr2=0x7fcfc0153f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:02.696 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.691+0000 7fcfc49c5700 1 -- 172.21.15.57:0/1518157433 shutdown_connections 2023-10-06T03:01:02.696 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.691+0000 7fcfc49c5700 1 -- 172.21.15.57:0/1518157433 wait complete. 2023-10-06T03:01:02.698 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2023-10-06T03:01:02.715 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-10-06T03:01:02.274597+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":97,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2397704,"kb_used_data":3016,"kb_used_omap":0,"kb_used_meta":2394624,"kb_avail":752577016,"statfs":{"total":773094113280,"available":770638864384,"internally_reserved":0,"allocated":3088384,"data_stored":1846772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2452094976},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":45,"apply_latency_ms":45,"commit_latency_ns":45000000,"apply_latency_ns":45000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002468"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.980917+0000","last_change":"2023-10-06T03:00:57.980917+0000","last_active":"2023-10-06T03:00:57.980917+0000","last_peered":"2023-10-06T03:00:57.980917+0000","last_clean":"2023-10-06T03:00:57.980917+0000","last_became_active":"2023-10-06T03:00:57.980580+0000","last_became_peered":"2023-10-06T03:00:57.980580+0000","last_unstale":"2023-10-06T03:00:57.980917+0000","last_undegraded":"2023-10-06T03:00:57.980917+0000","last_fullsized":"2023-10-06T03:00:57.980917+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:30:16.978685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.994006+0000","last_change":"2023-10-06T03:00:57.990358+0000","last_active":"2023-10-06T03:00:57.994006+0000","last_peered":"2023-10-06T03:00:57.994006+0000","last_clean":"2023-10-06T03:00:57.994006+0000","last_became_active":"2023-10-06T03:00:57.990144+0000","last_became_peered":"2023-10-06T03:00:57.990144+0000","last_unstale":"2023-10-06T03:00:57.994006+0000","last_undegraded":"2023-10-06T03:00:57.994006+0000","last_fullsized":"2023-10-06T03:00:57.994006+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:32:39.801984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:58.006699+0000","last_change":"2023-10-06T03:00:58.006699+0000","last_active":"2023-10-06T03:00:58.006699+0000","last_peered":"2023-10-06T03:00:58.006699+0000","last_clean":"2023-10-06T03:00:58.006699+0000","last_became_active":"2023-10-06T03:00:58.005294+0000","last_became_peered":"2023-10-06T03:00:58.005294+0000","last_unstale":"2023-10-06T03:00:58.006699+0000","last_undegraded":"2023-10-06T03:00:58.006699+0000","last_fullsized":"2023-10-06T03:00:58.006699+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:35:56.006762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:58.006066+0000","last_change":"2023-10-06T03:00:57.994292+0000","last_active":"2023-10-06T03:00:58.006066+0000","last_peered":"2023-10-06T03:00:58.006066+0000","last_clean":"2023-10-06T03:00:58.006066+0000","last_became_active":"2023-10-06T03:00:57.994021+0000","last_became_peered":"2023-10-06T03:00:57.994021+0000","last_unstale":"2023-10-06T03:00:58.006066+0000","last_undegraded":"2023-10-06T03:00:58.006066+0000","last_fullsized":"2023-10-06T03:00:58.006066+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:04:36.988945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.992614+0000","last_change":"2023-10-06T03:00:57.992614+0000","last_active":"2023-10-06T03:00:57.992614+0000","last_peered":"2023-10-06T03:00:57.992614+0000","last_clean":"2023-10-06T03:00:57.992614+0000","last_became_active":"2023-10-06T03:00:57.992227+0000","last_became_peered":"2023-10-06T03:00:57.992227+0000","last_unstale":"2023-10-06T03:00:57.992614+0000","last_undegraded":"2023-10-06T03:00:57.992614+0000","last_fullsized":"2023-10-06T03:00:57.992614+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:41:47.568218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:58.005433+0000","last_change":"2023-10-06T03:00:58.005433+0000","last_active":"2023-10-06T03:00:58.005433+0000","last_peered":"2023-10-06T03:00:58.005433+0000","last_clean":"2023-10-06T03:00:58.005433+0000","last_became_active":"2023-10-06T03:00:58.005113+0000","last_became_peered":"2023-10-06T03:00:58.005113+0000","last_unstale":"2023-10-06T03:00:58.005433+0000","last_undegraded":"2023-10-06T03:00:58.005433+0000","last_fullsized":"2023-10-06T03:00:58.005433+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:49:14.009330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.998785+0000","last_change":"2023-10-06T03:00:57.998785+0000","last_active":"2023-10-06T03:00:57.998785+0000","last_peered":"2023-10-06T03:00:57.998785+0000","last_clean":"2023-10-06T03:00:57.998785+0000","last_became_active":"2023-10-06T03:00:57.997865+0000","last_became_peered":"2023-10-06T03:00:57.997865+0000","last_unstale":"2023-10-06T03:00:57.998785+0000","last_undegraded":"2023-10-06T03:00:57.998785+0000","last_fullsized":"2023-10-06T03:00:57.998785+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:32:39.801984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.993783+0000","last_change":"2023-10-06T03:00:57.985816+0000","last_active":"2023-10-06T03:00:57.993783+0000","last_peered":"2023-10-06T03:00:57.993783+0000","last_clean":"2023-10-06T03:00:57.993783+0000","last_became_active":"2023-10-06T03:00:57.985504+0000","last_became_peered":"2023-10-06T03:00:57.985504+0000","last_unstale":"2023-10-06T03:00:57.993783+0000","last_undegraded":"2023-10-06T03:00:57.993783+0000","last_fullsized":"2023-10-06T03:00:57.993783+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:12:21.523918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.991750+0000","last_change":"2023-10-06T03:00:57.991750+0000","last_active":"2023-10-06T03:00:57.991750+0000","last_peered":"2023-10-06T03:00:57.991750+0000","last_clean":"2023-10-06T03:00:57.991750+0000","last_became_active":"2023-10-06T03:00:57.991271+0000","last_became_peered":"2023-10-06T03:00:57.991271+0000","last_unstale":"2023-10-06T03:00:57.991750+0000","last_undegraded":"2023-10-06T03:00:57.991750+0000","last_fullsized":"2023-10-06T03:00:57.991750+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:32:20.183224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:58.001086+0000","last_change":"2023-10-06T03:00:57.997031+0000","last_active":"2023-10-06T03:00:58.001086+0000","last_peered":"2023-10-06T03:00:58.001086+0000","last_clean":"2023-10-06T03:00:58.001086+0000","last_became_active":"2023-10-06T03:00:57.996675+0000","last_became_peered":"2023-10-06T03:00:57.996675+0000","last_unstale":"2023-10-06T03:00:58.001086+0000","last_undegraded":"2023-10-06T03:00:58.001086+0000","last_fullsized":"2023-10-06T03:00:58.001086+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:49:14.009330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.978095+0000","last_change":"2023-10-06T03:00:57.978095+0000","last_active":"2023-10-06T03:00:57.978095+0000","last_peered":"2023-10-06T03:00:57.978095+0000","last_clean":"2023-10-06T03:00:57.978095+0000","last_became_active":"2023-10-06T03:00:57.977627+0000","last_became_peered":"2023-10-06T03:00:57.977627+0000","last_unstale":"2023-10-06T03:00:57.978095+0000","last_undegraded":"2023-10-06T03:00:57.978095+0000","last_fullsized":"2023-10-06T03:00:57.978095+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:41:47.568218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.981822+0000","last_change":"2023-10-06T03:00:57.981822+0000","last_active":"2023-10-06T03:00:57.981822+0000","last_peered":"2023-10-06T03:00:57.981822+0000","last_clean":"2023-10-06T03:00:57.981822+0000","last_became_active":"2023-10-06T03:00:57.981246+0000","last_became_peered":"2023-10-06T03:00:57.981246+0000","last_unstale":"2023-10-06T03:00:57.981822+0000","last_undegraded":"2023-10-06T03:00:57.981822+0000","last_fullsized":"2023-10-06T03:00:57.981822+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:11:32.949199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.979093+0000","last_change":"2023-10-06T03:00:57.979093+0000","last_active":"2023-10-06T03:00:57.979093+0000","last_peered":"2023-10-06T03:00:57.979093+0000","last_clean":"2023-10-06T03:00:57.979093+0000","last_became_active":"2023-10-06T03:00:57.978790+0000","last_became_peered":"2023-10-06T03:00:57.978790+0000","last_unstale":"2023-10-06T03:00:57.979093+0000","last_undegraded":"2023-10-06T03:00:57.979093+0000","last_fullsized":"2023-10-06T03:00:57.979093+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:04:36.988945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.996721+0000","last_change":"2023-10-06T03:00:57.992778+0000","last_active":"2023-10-06T03:00:57.996721+0000","last_peered":"2023-10-06T03:00:57.996721+0000","last_clean":"2023-10-06T03:00:57.996721+0000","last_became_active":"2023-10-06T03:00:57.992484+0000","last_became_peered":"2023-10-06T03:00:57.992484+0000","last_unstale":"2023-10-06T03:00:57.996721+0000","last_undegraded":"2023-10-06T03:00:57.996721+0000","last_fullsized":"2023-10-06T03:00:57.996721+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:32:20.183224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.999320+0000","last_change":"2023-10-06T03:00:57.999320+0000","last_active":"2023-10-06T03:00:57.999320+0000","last_peered":"2023-10-06T03:00:57.999320+0000","last_clean":"2023-10-06T03:00:57.999320+0000","last_became_active":"2023-10-06T03:00:57.998455+0000","last_became_peered":"2023-10-06T03:00:57.998455+0000","last_unstale":"2023-10-06T03:00:57.999320+0000","last_undegraded":"2023-10-06T03:00:57.999320+0000","last_fullsized":"2023-10-06T03:00:57.999320+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:14:29.859982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:58.005775+0000","last_change":"2023-10-06T03:00:58.005775+0000","last_active":"2023-10-06T03:00:58.005775+0000","last_peered":"2023-10-06T03:00:58.005775+0000","last_clean":"2023-10-06T03:00:58.005775+0000","last_became_active":"2023-10-06T03:00:58.005474+0000","last_became_peered":"2023-10-06T03:00:58.005474+0000","last_unstale":"2023-10-06T03:00:58.005775+0000","last_undegraded":"2023-10-06T03:00:58.005775+0000","last_fullsized":"2023-10-06T03:00:58.005775+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:28:58.179787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.993441+0000","last_change":"2023-10-06T03:00:57.993441+0000","last_active":"2023-10-06T03:00:57.993441+0000","last_peered":"2023-10-06T03:00:57.993441+0000","last_clean":"2023-10-06T03:00:57.993441+0000","last_became_active":"2023-10-06T03:00:57.993145+0000","last_became_peered":"2023-10-06T03:00:57.993145+0000","last_unstale":"2023-10-06T03:00:57.993441+0000","last_undegraded":"2023-10-06T03:00:57.993441+0000","last_fullsized":"2023-10-06T03:00:57.993441+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:49:14.009330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.989141+0000","last_change":"2023-10-06T03:00:57.989141+0000","last_active":"2023-10-06T03:00:57.989141+0000","last_peered":"2023-10-06T03:00:57.989141+0000","last_clean":"2023-10-06T03:00:57.989141+0000","last_became_active":"2023-10-06T03:00:57.988752+0000","last_became_peered":"2023-10-06T03:00:57.988752+0000","last_unstale":"2023-10-06T03:00:57.989141+0000","last_undegraded":"2023-10-06T03:00:57.989141+0000","last_fullsized":"2023-10-06T03:00:57.989141+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:48:42.435907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.982128+0000","last_change":"2023-10-06T03:00:57.982128+0000","last_active":"2023-10-06T03:00:57.982128+0000","last_peered":"2023-10-06T03:00:57.982128+0000","last_clean":"2023-10-06T03:00:57.982128+0000","last_became_active":"2023-10-06T03:00:57.981762+0000","last_became_peered":"2023-10-06T03:00:57.981762+0000","last_unstale":"2023-10-06T03:00:57.982128+0000","last_undegraded":"2023-10-06T03:00:57.982128+0000","last_fullsized":"2023-10-06T03:00:57.982128+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:50:24.543128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.980179+0000","last_change":"2023-10-06T03:00:57.980179+0000","last_active":"2023-10-06T03:00:57.980179+0000","last_peered":"2023-10-06T03:00:57.980179+0000","last_clean":"2023-10-06T03:00:57.980179+0000","last_became_active":"2023-10-06T03:00:57.979822+0000","last_became_peered":"2023-10-06T03:00:57.979822+0000","last_unstale":"2023-10-06T03:00:57.980179+0000","last_undegraded":"2023-10-06T03:00:57.980179+0000","last_fullsized":"2023-10-06T03:00:57.980179+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:56:45.815718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.987885+0000","last_change":"2023-10-06T03:00:57.987885+0000","last_active":"2023-10-06T03:00:57.987885+0000","last_peered":"2023-10-06T03:00:57.987885+0000","last_clean":"2023-10-06T03:00:57.987885+0000","last_became_active":"2023-10-06T03:00:57.987306+0000","last_became_peered":"2023-10-06T03:00:57.987306+0000","last_unstale":"2023-10-06T03:00:57.987885+0000","last_undegraded":"2023-10-06T03:00:57.987885+0000","last_fullsized":"2023-10-06T03:00:57.987885+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:16:06.528696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.997306+0000","last_change":"2023-10-06T03:00:57.997306+0000","last_active":"2023-10-06T03:00:57.997306+0000","last_peered":"2023-10-06T03:00:57.997306+0000","last_clean":"2023-10-06T03:00:57.997306+0000","last_became_active":"2023-10-06T03:00:57.996969+0000","last_became_peered":"2023-10-06T03:00:57.996969+0000","last_unstale":"2023-10-06T03:00:57.997306+0000","last_undegraded":"2023-10-06T03:00:57.997306+0000","last_fullsized":"2023-10-06T03:00:57.997306+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:12:21.523918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:58.002300+0000","last_change":"2023-10-06T03:00:57.997342+0000","last_active":"2023-10-06T03:00:58.002300+0000","last_peered":"2023-10-06T03:00:58.002300+0000","last_clean":"2023-10-06T03:00:58.002300+0000","last_became_active":"2023-10-06T03:00:57.996950+0000","last_became_peered":"2023-10-06T03:00:57.996950+0000","last_unstale":"2023-10-06T03:00:58.002300+0000","last_undegraded":"2023-10-06T03:00:58.002300+0000","last_fullsized":"2023-10-06T03:00:58.002300+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:54:01.471407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.997946+0000","last_change":"2023-10-06T03:00:57.997946+0000","last_active":"2023-10-06T03:00:57.997946+0000","last_peered":"2023-10-06T03:00:57.997946+0000","last_clean":"2023-10-06T03:00:57.997946+0000","last_became_active":"2023-10-06T03:00:57.997600+0000","last_became_peered":"2023-10-06T03:00:57.997600+0000","last_unstale":"2023-10-06T03:00:57.997946+0000","last_undegraded":"2023-10-06T03:00:57.997946+0000","last_fullsized":"2023-10-06T03:00:57.997946+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:12:21.523918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.989508+0000","last_change":"2023-10-06T03:00:57.989508+0000","last_active":"2023-10-06T03:00:57.989508+0000","last_peered":"2023-10-06T03:00:57.989508+0000","last_clean":"2023-10-06T03:00:57.989508+0000","last_became_active":"2023-10-06T03:00:57.989023+0000","last_became_peered":"2023-10-06T03:00:57.989023+0000","last_unstale":"2023-10-06T03:00:57.989508+0000","last_undegraded":"2023-10-06T03:00:57.989508+0000","last_fullsized":"2023-10-06T03:00:57.989508+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:14:29.859982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.987485+0000","last_change":"2023-10-06T03:00:57.987485+0000","last_active":"2023-10-06T03:00:57.987485+0000","last_peered":"2023-10-06T03:00:57.987485+0000","last_clean":"2023-10-06T03:00:57.987485+0000","last_became_active":"2023-10-06T03:00:57.983554+0000","last_became_peered":"2023-10-06T03:00:57.983554+0000","last_unstale":"2023-10-06T03:00:57.987485+0000","last_undegraded":"2023-10-06T03:00:57.987485+0000","last_fullsized":"2023-10-06T03:00:57.987485+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:18:57.339278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:58.006377+0000","last_change":"2023-10-06T03:00:58.003002+0000","last_active":"2023-10-06T03:00:58.006377+0000","last_peered":"2023-10-06T03:00:58.006377+0000","last_clean":"2023-10-06T03:00:58.006377+0000","last_became_active":"2023-10-06T03:00:58.002705+0000","last_became_peered":"2023-10-06T03:00:58.002705+0000","last_unstale":"2023-10-06T03:00:58.006377+0000","last_undegraded":"2023-10-06T03:00:58.006377+0000","last_fullsized":"2023-10-06T03:00:58.006377+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:14:29.859982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.991310+0000","last_change":"2023-10-06T03:00:57.991310+0000","last_active":"2023-10-06T03:00:57.991310+0000","last_peered":"2023-10-06T03:00:57.991310+0000","last_clean":"2023-10-06T03:00:57.991310+0000","last_became_active":"2023-10-06T03:00:57.990221+0000","last_became_peered":"2023-10-06T03:00:57.990221+0000","last_unstale":"2023-10-06T03:00:57.991310+0000","last_undegraded":"2023-10-06T03:00:57.991310+0000","last_fullsized":"2023-10-06T03:00:57.991310+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:39:00.112932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.995764+0000","last_change":"2023-10-06T03:00:57.991930+0000","last_active":"2023-10-06T03:00:57.995764+0000","last_peered":"2023-10-06T03:00:57.995764+0000","last_clean":"2023-10-06T03:00:57.995764+0000","last_became_active":"2023-10-06T03:00:57.991329+0000","last_became_peered":"2023-10-06T03:00:57.991329+0000","last_unstale":"2023-10-06T03:00:57.995764+0000","last_undegraded":"2023-10-06T03:00:57.995764+0000","last_fullsized":"2023-10-06T03:00:57.995764+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:10:20.444330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.985010+0000","last_change":"2023-10-06T03:00:57.985010+0000","last_active":"2023-10-06T03:00:57.985010+0000","last_peered":"2023-10-06T03:00:57.985010+0000","last_clean":"2023-10-06T03:00:57.985010+0000","last_became_active":"2023-10-06T03:00:57.983945+0000","last_became_peered":"2023-10-06T03:00:57.983945+0000","last_unstale":"2023-10-06T03:00:57.985010+0000","last_undegraded":"2023-10-06T03:00:57.985010+0000","last_fullsized":"2023-10-06T03:00:57.985010+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:16:07.773169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.978641+0000","last_change":"2023-10-06T03:00:57.976726+0000","last_active":"2023-10-06T03:00:57.978641+0000","last_peered":"2023-10-06T03:00:57.978641+0000","last_clean":"2023-10-06T03:00:57.978641+0000","last_became_active":"2023-10-06T03:00:57.976367+0000","last_became_peered":"2023-10-06T03:00:57.976367+0000","last_unstale":"2023-10-06T03:00:57.978641+0000","last_undegraded":"2023-10-06T03:00:57.978641+0000","last_fullsized":"2023-10-06T03:00:57.978641+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:49:14.009330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.997016+0000","last_change":"2023-10-06T03:00:57.992161+0000","last_active":"2023-10-06T03:00:57.997016+0000","last_peered":"2023-10-06T03:00:57.997016+0000","last_clean":"2023-10-06T03:00:57.997016+0000","last_became_active":"2023-10-06T03:00:57.991886+0000","last_became_peered":"2023-10-06T03:00:57.991886+0000","last_unstale":"2023-10-06T03:00:57.997016+0000","last_undegraded":"2023-10-06T03:00:57.997016+0000","last_fullsized":"2023-10-06T03:00:57.997016+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:57:10.332887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.987129+0000","last_change":"2023-10-06T03:00:57.984047+0000","last_active":"2023-10-06T03:00:57.987129+0000","last_peered":"2023-10-06T03:00:57.987129+0000","last_clean":"2023-10-06T03:00:57.987129+0000","last_became_active":"2023-10-06T03:00:57.983670+0000","last_became_peered":"2023-10-06T03:00:57.983670+0000","last_unstale":"2023-10-06T03:00:57.987129+0000","last_undegraded":"2023-10-06T03:00:57.987129+0000","last_fullsized":"2023-10-06T03:00:57.987129+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:12:21.523918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:58.015542+0000","last_change":"2023-10-06T03:00:56.987376+0000","last_active":"2023-10-06T03:00:58.015542+0000","last_peered":"2023-10-06T03:00:58.015542+0000","last_clean":"2023-10-06T03:00:58.015542+0000","last_became_active":"2023-10-06T03:00:56.986953+0000","last_became_peered":"2023-10-06T03:00:56.986953+0000","last_unstale":"2023-10-06T03:00:58.015542+0000","last_undegraded":"2023-10-06T03:00:58.015542+0000","last_fullsized":"2023-10-06T03:00:58.015542+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:39:00.208565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:58.003097+0000","last_change":"2023-10-06T03:00:57.998904+0000","last_active":"2023-10-06T03:00:58.003097+0000","last_peered":"2023-10-06T03:00:58.003097+0000","last_clean":"2023-10-06T03:00:58.003097+0000","last_became_active":"2023-10-06T03:00:57.998631+0000","last_became_peered":"2023-10-06T03:00:57.998631+0000","last_unstale":"2023-10-06T03:00:58.003097+0000","last_undegraded":"2023-10-06T03:00:58.003097+0000","last_fullsized":"2023-10-06T03:00:58.003097+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:41:47.568218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T03:00:56.985538+0000","last_change":"2023-10-06T03:00:56.977003+0000","last_active":"2023-10-06T03:00:56.985538+0000","last_peered":"2023-10-06T03:00:56.985538+0000","last_clean":"2023-10-06T03:00:56.985538+0000","last_became_active":"2023-10-06T03:00:56.976668+0000","last_became_peered":"2023-10-06T03:00:56.976668+0000","last_unstale":"2023-10-06T03:00:56.985538+0000","last_undegraded":"2023-10-06T03:00:56.985538+0000","last_fullsized":"2023-10-06T03:00:56.985538+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:08:59.306830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.995079+0000","last_change":"2023-10-06T03:00:57.995079+0000","last_active":"2023-10-06T03:00:57.995079+0000","last_peered":"2023-10-06T03:00:57.995079+0000","last_clean":"2023-10-06T03:00:57.995079+0000","last_became_active":"2023-10-06T03:00:57.994813+0000","last_became_peered":"2023-10-06T03:00:57.994813+0000","last_unstale":"2023-10-06T03:00:57.995079+0000","last_undegraded":"2023-10-06T03:00:57.995079+0000","last_fullsized":"2023-10-06T03:00:57.995079+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:28:58.179787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T03:00:56.990004+0000","last_change":"2023-10-06T03:00:56.987263+0000","last_active":"2023-10-06T03:00:56.990004+0000","last_peered":"2023-10-06T03:00:56.990004+0000","last_clean":"2023-10-06T03:00:56.990004+0000","last_became_active":"2023-10-06T03:00:56.986927+0000","last_became_peered":"2023-10-06T03:00:56.986927+0000","last_unstale":"2023-10-06T03:00:56.990004+0000","last_undegraded":"2023-10-06T03:00:56.990004+0000","last_fullsized":"2023-10-06T03:00:56.990004+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:01:20.300193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.988672+0000","last_change":"2023-10-06T03:00:57.985729+0000","last_active":"2023-10-06T03:00:57.988672+0000","last_peered":"2023-10-06T03:00:57.988672+0000","last_clean":"2023-10-06T03:00:57.988672+0000","last_became_active":"2023-10-06T03:00:57.985148+0000","last_became_peered":"2023-10-06T03:00:57.985148+0000","last_unstale":"2023-10-06T03:00:57.988672+0000","last_undegraded":"2023-10-06T03:00:57.988672+0000","last_fullsized":"2023-10-06T03:00:57.988672+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:01:50.001484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:58.017678+0000","last_change":"2023-10-06T03:00:56.981696+0000","last_active":"2023-10-06T03:00:58.017678+0000","last_peered":"2023-10-06T03:00:58.017678+0000","last_clean":"2023-10-06T03:00:58.017678+0000","last_became_active":"2023-10-06T03:00:56.981358+0000","last_became_peered":"2023-10-06T03:00:56.981358+0000","last_unstale":"2023-10-06T03:00:58.017678+0000","last_undegraded":"2023-10-06T03:00:58.017678+0000","last_fullsized":"2023-10-06T03:00:58.017678+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:39:17.918596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.980767+0000","last_change":"2023-10-06T03:00:56.987266+0000","last_active":"2023-10-06T03:00:57.980767+0000","last_peered":"2023-10-06T03:00:57.980767+0000","last_clean":"2023-10-06T03:00:57.980767+0000","last_became_active":"2023-10-06T03:00:56.986946+0000","last_became_peered":"2023-10-06T03:00:56.986946+0000","last_unstale":"2023-10-06T03:00:57.980767+0000","last_undegraded":"2023-10-06T03:00:57.980767+0000","last_fullsized":"2023-10-06T03:00:57.980767+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:34:15.780752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:58.002688+0000","last_change":"2023-10-06T03:00:57.999452+0000","last_active":"2023-10-06T03:00:58.002688+0000","last_peered":"2023-10-06T03:00:58.002688+0000","last_clean":"2023-10-06T03:00:58.002688+0000","last_became_active":"2023-10-06T03:00:57.999164+0000","last_became_peered":"2023-10-06T03:00:57.999164+0000","last_unstale":"2023-10-06T03:00:58.002688+0000","last_undegraded":"2023-10-06T03:00:58.002688+0000","last_fullsized":"2023-10-06T03:00:58.002688+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:28:58.179787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:58.015323+0000","last_change":"2023-10-06T03:00:56.987382+0000","last_active":"2023-10-06T03:00:58.015323+0000","last_peered":"2023-10-06T03:00:58.015323+0000","last_clean":"2023-10-06T03:00:58.015323+0000","last_became_active":"2023-10-06T03:00:56.987056+0000","last_became_peered":"2023-10-06T03:00:56.987056+0000","last_unstale":"2023-10-06T03:00:58.015323+0000","last_undegraded":"2023-10-06T03:00:58.015323+0000","last_fullsized":"2023-10-06T03:00:58.015323+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:57:09.321024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.975126+0000","last_change":"2023-10-06T03:00:57.975126+0000","last_active":"2023-10-06T03:00:57.975126+0000","last_peered":"2023-10-06T03:00:57.975126+0000","last_clean":"2023-10-06T03:00:57.975126+0000","last_became_active":"2023-10-06T03:00:57.974673+0000","last_became_peered":"2023-10-06T03:00:57.974673+0000","last_unstale":"2023-10-06T03:00:57.975126+0000","last_undegraded":"2023-10-06T03:00:57.975126+0000","last_fullsized":"2023-10-06T03:00:57.975126+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:12:21.523918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.979889+0000","last_change":"2023-10-06T03:00:56.976910+0000","last_active":"2023-10-06T03:00:57.979889+0000","last_peered":"2023-10-06T03:00:57.979889+0000","last_clean":"2023-10-06T03:00:57.979889+0000","last_became_active":"2023-10-06T03:00:56.976555+0000","last_became_peered":"2023-10-06T03:00:56.976555+0000","last_unstale":"2023-10-06T03:00:57.979889+0000","last_undegraded":"2023-10-06T03:00:57.979889+0000","last_fullsized":"2023-10-06T03:00:57.979889+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:27:56.469909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:58.007053+0000","last_change":"2023-10-06T03:00:58.004875+0000","last_active":"2023-10-06T03:00:58.007053+0000","last_peered":"2023-10-06T03:00:58.007053+0000","last_clean":"2023-10-06T03:00:58.007053+0000","last_became_active":"2023-10-06T03:00:57.997479+0000","last_became_peered":"2023-10-06T03:00:57.997479+0000","last_unstale":"2023-10-06T03:00:58.007053+0000","last_undegraded":"2023-10-06T03:00:58.007053+0000","last_fullsized":"2023-10-06T03:00:58.007053+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:39:01.220427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.972697+0000","last_change":"2023-10-06T03:00:56.979202+0000","last_active":"2023-10-06T03:00:57.972697+0000","last_peered":"2023-10-06T03:00:57.972697+0000","last_clean":"2023-10-06T03:00:57.972697+0000","last_became_active":"2023-10-06T03:00:56.978922+0000","last_became_peered":"2023-10-06T03:00:56.978922+0000","last_unstale":"2023-10-06T03:00:57.972697+0000","last_undegraded":"2023-10-06T03:00:57.972697+0000","last_fullsized":"2023-10-06T03:00:57.972697+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:04:35.977083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.998369+0000","last_change":"2023-10-06T03:00:57.998369+0000","last_active":"2023-10-06T03:00:57.998369+0000","last_peered":"2023-10-06T03:00:57.998369+0000","last_clean":"2023-10-06T03:00:57.998369+0000","last_became_active":"2023-10-06T03:00:57.997963+0000","last_became_peered":"2023-10-06T03:00:57.997963+0000","last_unstale":"2023-10-06T03:00:57.998369+0000","last_undegraded":"2023-10-06T03:00:57.998369+0000","last_fullsized":"2023-10-06T03:00:57.998369+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:32:39.801984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:58.005626+0000","last_change":"2023-10-06T03:00:56.986683+0000","last_active":"2023-10-06T03:00:58.005626+0000","last_peered":"2023-10-06T03:00:58.005626+0000","last_clean":"2023-10-06T03:00:58.005626+0000","last_became_active":"2023-10-06T03:00:56.986329+0000","last_became_peered":"2023-10-06T03:00:56.986329+0000","last_unstale":"2023-10-06T03:00:58.005626+0000","last_undegraded":"2023-10-06T03:00:58.005626+0000","last_fullsized":"2023-10-06T03:00:58.005626+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:41:07.693426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.981948+0000","last_change":"2023-10-06T03:00:57.981948+0000","last_active":"2023-10-06T03:00:57.981948+0000","last_peered":"2023-10-06T03:00:57.981948+0000","last_clean":"2023-10-06T03:00:57.981948+0000","last_became_active":"2023-10-06T03:00:57.980831+0000","last_became_peered":"2023-10-06T03:00:57.980831+0000","last_unstale":"2023-10-06T03:00:57.981948+0000","last_undegraded":"2023-10-06T03:00:57.981948+0000","last_fullsized":"2023-10-06T03:00:57.981948+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:05:44.036671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.978045+0000","last_change":"2023-10-06T03:00:56.981077+0000","last_active":"2023-10-06T03:00:57.978045+0000","last_peered":"2023-10-06T03:00:57.978045+0000","last_clean":"2023-10-06T03:00:57.978045+0000","last_became_active":"2023-10-06T03:00:56.980777+0000","last_became_peered":"2023-10-06T03:00:56.980777+0000","last_unstale":"2023-10-06T03:00:57.978045+0000","last_undegraded":"2023-10-06T03:00:57.978045+0000","last_fullsized":"2023-10-06T03:00:57.978045+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:41:33.554972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.984615+0000","last_change":"2023-10-06T03:00:57.984615+0000","last_active":"2023-10-06T03:00:57.984615+0000","last_peered":"2023-10-06T03:00:57.984615+0000","last_clean":"2023-10-06T03:00:57.984615+0000","last_became_active":"2023-10-06T03:00:57.984307+0000","last_became_peered":"2023-10-06T03:00:57.984307+0000","last_unstale":"2023-10-06T03:00:57.984615+0000","last_undegraded":"2023-10-06T03:00:57.984615+0000","last_fullsized":"2023-10-06T03:00:57.984615+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:35.377456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T03:00:56.991793+0000","last_change":"2023-10-06T03:00:56.987414+0000","last_active":"2023-10-06T03:00:56.991793+0000","last_peered":"2023-10-06T03:00:56.991793+0000","last_clean":"2023-10-06T03:00:56.991793+0000","last_became_active":"2023-10-06T03:00:56.987085+0000","last_became_peered":"2023-10-06T03:00:56.987085+0000","last_unstale":"2023-10-06T03:00:56.991793+0000","last_undegraded":"2023-10-06T03:00:56.991793+0000","last_fullsized":"2023-10-06T03:00:56.991793+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:04:31.750536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.984185+0000","last_change":"2023-10-06T03:00:57.984185+0000","last_active":"2023-10-06T03:00:57.984185+0000","last_peered":"2023-10-06T03:00:57.984185+0000","last_clean":"2023-10-06T03:00:57.984185+0000","last_became_active":"2023-10-06T03:00:57.983849+0000","last_became_peered":"2023-10-06T03:00:57.983849+0000","last_unstale":"2023-10-06T03:00:57.984185+0000","last_undegraded":"2023-10-06T03:00:57.984185+0000","last_fullsized":"2023-10-06T03:00:57.984185+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:32:39.801984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.963112+0000","last_change":"2023-10-06T03:00:56.985582+0000","last_active":"2023-10-06T03:00:57.963112+0000","last_peered":"2023-10-06T03:00:57.963112+0000","last_clean":"2023-10-06T03:00:57.963112+0000","last_became_active":"2023-10-06T03:00:56.985254+0000","last_became_peered":"2023-10-06T03:00:56.985254+0000","last_unstale":"2023-10-06T03:00:57.963112+0000","last_undegraded":"2023-10-06T03:00:57.963112+0000","last_fullsized":"2023-10-06T03:00:57.963112+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:08:59.306830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.975691+0000","last_change":"2023-10-06T03:00:57.975691+0000","last_active":"2023-10-06T03:00:57.975691+0000","last_peered":"2023-10-06T03:00:57.975691+0000","last_clean":"2023-10-06T03:00:57.975691+0000","last_became_active":"2023-10-06T03:00:57.975368+0000","last_became_peered":"2023-10-06T03:00:57.975368+0000","last_unstale":"2023-10-06T03:00:57.975691+0000","last_undegraded":"2023-10-06T03:00:57.975691+0000","last_fullsized":"2023-10-06T03:00:57.975691+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:12:21.523918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":165,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T03:00:56.970548+0000","last_change":"2023-10-06T03:00:45.709165+0000","last_active":"2023-10-06T03:00:56.970548+0000","last_peered":"2023-10-06T03:00:56.970548+0000","last_clean":"2023-10-06T03:00:56.970548+0000","last_became_active":"2023-10-06T03:00:45.707771+0000","last_became_peered":"2023-10-06T03:00:45.707771+0000","last_unstale":"2023-10-06T03:00:56.970548+0000","last_undegraded":"2023-10-06T03:00:56.970548+0000","last_fullsized":"2023-10-06T03:00:56.970548+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:44.625353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:44.625353+0000","last_clean_scrub_stamp":"2023-10-06T03:00:44.625353+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:31:31.774239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.972547+0000","last_change":"2023-10-06T03:00:51.905381+0000","last_active":"2023-10-06T03:00:57.972547+0000","last_peered":"2023-10-06T03:00:57.972547+0000","last_clean":"2023-10-06T03:00:57.972547+0000","last_became_active":"2023-10-06T03:00:51.904974+0000","last_became_peered":"2023-10-06T03:00:51.904974+0000","last_unstale":"2023-10-06T03:00:57.972547+0000","last_undegraded":"2023-10-06T03:00:57.972547+0000","last_fullsized":"2023-10-06T03:00:57.972547+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:15:19.182956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.961981+0000","last_change":"2023-10-06T03:00:56.977217+0000","last_active":"2023-10-06T03:00:57.961981+0000","last_peered":"2023-10-06T03:00:57.961981+0000","last_clean":"2023-10-06T03:00:57.961981+0000","last_became_active":"2023-10-06T03:00:56.976798+0000","last_became_peered":"2023-10-06T03:00:56.976798+0000","last_unstale":"2023-10-06T03:00:57.961981+0000","last_undegraded":"2023-10-06T03:00:57.961981+0000","last_fullsized":"2023-10-06T03:00:57.961981+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:11:31.937336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.985658+0000","last_change":"2023-10-06T03:00:57.979627+0000","last_active":"2023-10-06T03:00:57.985658+0000","last_peered":"2023-10-06T03:00:57.985658+0000","last_clean":"2023-10-06T03:00:57.985658+0000","last_became_active":"2023-10-06T03:00:57.979346+0000","last_became_peered":"2023-10-06T03:00:57.979346+0000","last_unstale":"2023-10-06T03:00:57.985658+0000","last_undegraded":"2023-10-06T03:00:57.985658+0000","last_fullsized":"2023-10-06T03:00:57.985658+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:34:16.792615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T03:00:56.970455+0000","last_change":"2023-10-06T03:00:51.906480+0000","last_active":"2023-10-06T03:00:56.970455+0000","last_peered":"2023-10-06T03:00:56.970455+0000","last_clean":"2023-10-06T03:00:56.970455+0000","last_became_active":"2023-10-06T03:00:51.905956+0000","last_became_peered":"2023-10-06T03:00:51.905956+0000","last_unstale":"2023-10-06T03:00:56.970455+0000","last_undegraded":"2023-10-06T03:00:56.970455+0000","last_fullsized":"2023-10-06T03:00:56.970455+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:15:19.182956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T03:00:56.984693+0000","last_change":"2023-10-06T03:00:56.977514+0000","last_active":"2023-10-06T03:00:56.984693+0000","last_peered":"2023-10-06T03:00:56.984693+0000","last_clean":"2023-10-06T03:00:56.984693+0000","last_became_active":"2023-10-06T03:00:56.977108+0000","last_became_peered":"2023-10-06T03:00:56.977108+0000","last_unstale":"2023-10-06T03:00:56.984693+0000","last_undegraded":"2023-10-06T03:00:56.984693+0000","last_fullsized":"2023-10-06T03:00:56.984693+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:11:31.937336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.997236+0000","last_change":"2023-10-06T03:00:57.997236+0000","last_active":"2023-10-06T03:00:57.997236+0000","last_peered":"2023-10-06T03:00:57.997236+0000","last_clean":"2023-10-06T03:00:57.997236+0000","last_became_active":"2023-10-06T03:00:57.996915+0000","last_became_peered":"2023-10-06T03:00:57.996915+0000","last_unstale":"2023-10-06T03:00:57.997236+0000","last_undegraded":"2023-10-06T03:00:57.997236+0000","last_fullsized":"2023-10-06T03:00:57.997236+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:16:06.528696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T03:00:56.975328+0000","last_change":"2023-10-06T03:00:51.902453+0000","last_active":"2023-10-06T03:00:56.975328+0000","last_peered":"2023-10-06T03:00:56.975328+0000","last_clean":"2023-10-06T03:00:56.975328+0000","last_became_active":"2023-10-06T03:00:51.901948+0000","last_became_peered":"2023-10-06T03:00:51.901948+0000","last_unstale":"2023-10-06T03:00:56.975328+0000","last_undegraded":"2023-10-06T03:00:56.975328+0000","last_fullsized":"2023-10-06T03:00:56.975328+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:13:30.721650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T03:00:56.995196+0000","last_change":"2023-10-06T03:00:56.986609+0000","last_active":"2023-10-06T03:00:56.995196+0000","last_peered":"2023-10-06T03:00:56.995196+0000","last_clean":"2023-10-06T03:00:56.995196+0000","last_became_active":"2023-10-06T03:00:56.986325+0000","last_became_peered":"2023-10-06T03:00:56.986325+0000","last_unstale":"2023-10-06T03:00:56.995196+0000","last_undegraded":"2023-10-06T03:00:56.995196+0000","last_fullsized":"2023-10-06T03:00:56.995196+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:50:23.531265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.987932+0000","last_change":"2023-10-06T03:00:57.987932+0000","last_active":"2023-10-06T03:00:57.987932+0000","last_peered":"2023-10-06T03:00:57.987932+0000","last_clean":"2023-10-06T03:00:57.987932+0000","last_became_active":"2023-10-06T03:00:57.982542+0000","last_became_peered":"2023-10-06T03:00:57.982542+0000","last_unstale":"2023-10-06T03:00:57.987932+0000","last_undegraded":"2023-10-06T03:00:57.987932+0000","last_fullsized":"2023-10-06T03:00:57.987932+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:51:29.997106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.974149+0000","last_change":"2023-10-06T03:00:51.904148+0000","last_active":"2023-10-06T03:00:57.974149+0000","last_peered":"2023-10-06T03:00:57.974149+0000","last_clean":"2023-10-06T03:00:57.974149+0000","last_became_active":"2023-10-06T03:00:51.903729+0000","last_became_peered":"2023-10-06T03:00:51.903729+0000","last_unstale":"2023-10-06T03:00:57.974149+0000","last_undegraded":"2023-10-06T03:00:57.974149+0000","last_fullsized":"2023-10-06T03:00:57.974149+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:17:25.070478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T03:00:56.991753+0000","last_change":"2023-10-06T03:00:56.986459+0000","last_active":"2023-10-06T03:00:56.991753+0000","last_peered":"2023-10-06T03:00:56.991753+0000","last_clean":"2023-10-06T03:00:56.991753+0000","last_became_active":"2023-10-06T03:00:56.986082+0000","last_became_peered":"2023-10-06T03:00:56.986082+0000","last_unstale":"2023-10-06T03:00:56.991753+0000","last_undegraded":"2023-10-06T03:00:56.991753+0000","last_fullsized":"2023-10-06T03:00:56.991753+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:41:07.693426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.989868+0000","last_change":"2023-10-06T03:00:57.989868+0000","last_active":"2023-10-06T03:00:57.989868+0000","last_peered":"2023-10-06T03:00:57.989868+0000","last_clean":"2023-10-06T03:00:57.989868+0000","last_became_active":"2023-10-06T03:00:57.988520+0000","last_became_peered":"2023-10-06T03:00:57.988520+0000","last_unstale":"2023-10-06T03:00:57.989868+0000","last_undegraded":"2023-10-06T03:00:57.989868+0000","last_fullsized":"2023-10-06T03:00:57.989868+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:32:39.801984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.973391+0000","last_change":"2023-10-06T03:00:56.979822+0000","last_active":"2023-10-06T03:00:57.973391+0000","last_peered":"2023-10-06T03:00:57.973391+0000","last_clean":"2023-10-06T03:00:57.973391+0000","last_became_active":"2023-10-06T03:00:56.978084+0000","last_became_peered":"2023-10-06T03:00:56.978084+0000","last_unstale":"2023-10-06T03:00:57.973391+0000","last_undegraded":"2023-10-06T03:00:57.973391+0000","last_fullsized":"2023-10-06T03:00:57.973391+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:39:00.208565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T03:00:56.957505+0000","last_change":"2023-10-06T03:00:52.484317+0000","last_active":"2023-10-06T03:00:56.957505+0000","last_peered":"2023-10-06T03:00:56.957505+0000","last_clean":"2023-10-06T03:00:56.957505+0000","last_became_active":"2023-10-06T03:00:52.483818+0000","last_became_peered":"2023-10-06T03:00:52.483818+0000","last_unstale":"2023-10-06T03:00:56.957505+0000","last_undegraded":"2023-10-06T03:00:56.957505+0000","last_fullsized":"2023-10-06T03:00:56.957505+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:17:24.136459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.991155+0000","last_change":"2023-10-06T03:00:57.991155+0000","last_active":"2023-10-06T03:00:57.991155+0000","last_peered":"2023-10-06T03:00:57.991155+0000","last_clean":"2023-10-06T03:00:57.991155+0000","last_became_active":"2023-10-06T03:00:57.990697+0000","last_became_peered":"2023-10-06T03:00:57.990697+0000","last_unstale":"2023-10-06T03:00:57.991155+0000","last_undegraded":"2023-10-06T03:00:57.991155+0000","last_fullsized":"2023-10-06T03:00:57.991155+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:01:50.001484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T03:00:56.995300+0000","last_change":"2023-10-06T03:00:56.987943+0000","last_active":"2023-10-06T03:00:56.995300+0000","last_peered":"2023-10-06T03:00:56.995300+0000","last_clean":"2023-10-06T03:00:56.995300+0000","last_became_active":"2023-10-06T03:00:56.987664+0000","last_became_peered":"2023-10-06T03:00:56.987664+0000","last_unstale":"2023-10-06T03:00:56.995300+0000","last_undegraded":"2023-10-06T03:00:56.995300+0000","last_fullsized":"2023-10-06T03:00:56.995300+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:32:00.864289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T03:00:56.971561+0000","last_change":"2023-10-06T03:00:52.485186+0000","last_active":"2023-10-06T03:00:56.971561+0000","last_peered":"2023-10-06T03:00:56.971561+0000","last_clean":"2023-10-06T03:00:56.971561+0000","last_became_active":"2023-10-06T03:00:52.484615+0000","last_became_peered":"2023-10-06T03:00:52.484615+0000","last_unstale":"2023-10-06T03:00:56.971561+0000","last_undegraded":"2023-10-06T03:00:56.971561+0000","last_fullsized":"2023-10-06T03:00:56.971561+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:17:25.070478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.993777+0000","last_change":"2023-10-06T03:00:57.993777+0000","last_active":"2023-10-06T03:00:57.993777+0000","last_peered":"2023-10-06T03:00:57.993777+0000","last_clean":"2023-10-06T03:00:57.993777+0000","last_became_active":"2023-10-06T03:00:57.993567+0000","last_became_peered":"2023-10-06T03:00:57.993567+0000","last_unstale":"2023-10-06T03:00:57.993777+0000","last_undegraded":"2023-10-06T03:00:57.993777+0000","last_fullsized":"2023-10-06T03:00:57.993777+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:14:29.859982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:58.012633+0000","last_change":"2023-10-06T03:00:56.980714+0000","last_active":"2023-10-06T03:00:58.012633+0000","last_peered":"2023-10-06T03:00:58.012633+0000","last_clean":"2023-10-06T03:00:58.012633+0000","last_became_active":"2023-10-06T03:00:56.979257+0000","last_became_peered":"2023-10-06T03:00:56.979257+0000","last_unstale":"2023-10-06T03:00:58.012633+0000","last_undegraded":"2023-10-06T03:00:58.012633+0000","last_fullsized":"2023-10-06T03:00:58.012633+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:30:15.966823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T03:00:56.956868+0000","last_change":"2023-10-06T03:00:51.903388+0000","last_active":"2023-10-06T03:00:56.956868+0000","last_peered":"2023-10-06T03:00:56.956868+0000","last_clean":"2023-10-06T03:00:56.956868+0000","last_became_active":"2023-10-06T03:00:51.902959+0000","last_became_peered":"2023-10-06T03:00:51.902959+0000","last_unstale":"2023-10-06T03:00:56.956868+0000","last_undegraded":"2023-10-06T03:00:56.956868+0000","last_fullsized":"2023-10-06T03:00:56.956868+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:30:16.907470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.988640+0000","last_change":"2023-10-06T03:00:57.985087+0000","last_active":"2023-10-06T03:00:57.988640+0000","last_peered":"2023-10-06T03:00:57.988640+0000","last_clean":"2023-10-06T03:00:57.988640+0000","last_became_active":"2023-10-06T03:00:57.984740+0000","last_became_peered":"2023-10-06T03:00:57.984740+0000","last_unstale":"2023-10-06T03:00:57.988640+0000","last_undegraded":"2023-10-06T03:00:57.988640+0000","last_fullsized":"2023-10-06T03:00:57.988640+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:34:39.364267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T03:00:56.995640+0000","last_change":"2023-10-06T03:00:56.985269+0000","last_active":"2023-10-06T03:00:56.995640+0000","last_peered":"2023-10-06T03:00:56.995640+0000","last_clean":"2023-10-06T03:00:56.995640+0000","last_became_active":"2023-10-06T03:00:56.984926+0000","last_became_peered":"2023-10-06T03:00:56.984926+0000","last_unstale":"2023-10-06T03:00:56.995640+0000","last_undegraded":"2023-10-06T03:00:56.995640+0000","last_fullsized":"2023-10-06T03:00:56.995640+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:32:00.864289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.977974+0000","last_change":"2023-10-06T03:00:51.903242+0000","last_active":"2023-10-06T03:00:57.977974+0000","last_peered":"2023-10-06T03:00:57.977974+0000","last_clean":"2023-10-06T03:00:57.977974+0000","last_became_active":"2023-10-06T03:00:51.902929+0000","last_became_peered":"2023-10-06T03:00:51.902929+0000","last_unstale":"2023-10-06T03:00:57.977974+0000","last_undegraded":"2023-10-06T03:00:57.977974+0000","last_fullsized":"2023-10-06T03:00:57.977974+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:34:12.274158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.986011+0000","last_change":"2023-10-06T03:00:57.986011+0000","last_active":"2023-10-06T03:00:57.986011+0000","last_peered":"2023-10-06T03:00:57.986011+0000","last_clean":"2023-10-06T03:00:57.986011+0000","last_became_active":"2023-10-06T03:00:57.985735+0000","last_became_peered":"2023-10-06T03:00:57.985735+0000","last_unstale":"2023-10-06T03:00:57.986011+0000","last_undegraded":"2023-10-06T03:00:57.986011+0000","last_fullsized":"2023-10-06T03:00:57.986011+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:14:29.859982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.981395+0000","last_change":"2023-10-06T03:00:57.981395+0000","last_active":"2023-10-06T03:00:57.981395+0000","last_peered":"2023-10-06T03:00:57.981395+0000","last_clean":"2023-10-06T03:00:57.981395+0000","last_became_active":"2023-10-06T03:00:57.981107+0000","last_became_peered":"2023-10-06T03:00:57.981107+0000","last_unstale":"2023-10-06T03:00:57.981395+0000","last_undegraded":"2023-10-06T03:00:57.981395+0000","last_fullsized":"2023-10-06T03:00:57.981395+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:32:20.183224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"22'6","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:58.018128+0000","last_change":"2023-10-06T03:00:56.979738+0000","last_active":"2023-10-06T03:00:58.018128+0000","last_peered":"2023-10-06T03:00:58.018128+0000","last_clean":"2023-10-06T03:00:58.018128+0000","last_became_active":"2023-10-06T03:00:56.979409+0000","last_became_peered":"2023-10-06T03:00:56.979409+0000","last_unstale":"2023-10-06T03:00:58.018128+0000","last_undegraded":"2023-10-06T03:00:58.018128+0000","last_fullsized":"2023-10-06T03:00:58.018128+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:41:33.554972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.990981+0000","last_change":"2023-10-06T03:00:57.990981+0000","last_active":"2023-10-06T03:00:57.990981+0000","last_peered":"2023-10-06T03:00:57.990981+0000","last_clean":"2023-10-06T03:00:57.990981+0000","last_became_active":"2023-10-06T03:00:57.990342+0000","last_became_peered":"2023-10-06T03:00:57.990342+0000","last_unstale":"2023-10-06T03:00:57.990981+0000","last_undegraded":"2023-10-06T03:00:57.990981+0000","last_fullsized":"2023-10-06T03:00:57.990981+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:16:06.528696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:58.012600+0000","last_change":"2023-10-06T03:00:56.983297+0000","last_active":"2023-10-06T03:00:58.012600+0000","last_peered":"2023-10-06T03:00:58.012600+0000","last_clean":"2023-10-06T03:00:58.012600+0000","last_became_active":"2023-10-06T03:00:56.983095+0000","last_became_peered":"2023-10-06T03:00:56.983095+0000","last_unstale":"2023-10-06T03:00:58.012600+0000","last_undegraded":"2023-10-06T03:00:58.012600+0000","last_fullsized":"2023-10-06T03:00:58.012600+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:49:02.389155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.976844+0000","last_change":"2023-10-06T03:00:56.976251+0000","last_active":"2023-10-06T03:00:57.976844+0000","last_peered":"2023-10-06T03:00:57.976844+0000","last_clean":"2023-10-06T03:00:57.976844+0000","last_became_active":"2023-10-06T03:00:56.975922+0000","last_became_peered":"2023-10-06T03:00:56.975922+0000","last_unstale":"2023-10-06T03:00:57.976844+0000","last_undegraded":"2023-10-06T03:00:57.976844+0000","last_fullsized":"2023-10-06T03:00:57.976844+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:34:15.780752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.995718+0000","last_change":"2023-10-06T03:00:57.989172+0000","last_active":"2023-10-06T03:00:57.995718+0000","last_peered":"2023-10-06T03:00:57.995718+0000","last_clean":"2023-10-06T03:00:57.995718+0000","last_became_active":"2023-10-06T03:00:57.988815+0000","last_became_peered":"2023-10-06T03:00:57.988815+0000","last_unstale":"2023-10-06T03:00:57.995718+0000","last_undegraded":"2023-10-06T03:00:57.995718+0000","last_fullsized":"2023-10-06T03:00:57.995718+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:41:47.568218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T03:00:56.990506+0000","last_change":"2023-10-06T03:00:56.981539+0000","last_active":"2023-10-06T03:00:56.990506+0000","last_peered":"2023-10-06T03:00:56.990506+0000","last_clean":"2023-10-06T03:00:56.990506+0000","last_became_active":"2023-10-06T03:00:56.980952+0000","last_became_peered":"2023-10-06T03:00:56.980952+0000","last_unstale":"2023-10-06T03:00:56.990506+0000","last_undegraded":"2023-10-06T03:00:56.990506+0000","last_fullsized":"2023-10-06T03:00:56.990506+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:30:15.966823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.987260+0000","last_change":"2023-10-06T03:00:57.984397+0000","last_active":"2023-10-06T03:00:57.987260+0000","last_peered":"2023-10-06T03:00:57.987260+0000","last_clean":"2023-10-06T03:00:57.987260+0000","last_became_active":"2023-10-06T03:00:57.983080+0000","last_became_peered":"2023-10-06T03:00:57.983080+0000","last_unstale":"2023-10-06T03:00:57.987260+0000","last_undegraded":"2023-10-06T03:00:57.987260+0000","last_fullsized":"2023-10-06T03:00:57.987260+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:14:29.859982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.987973+0000","last_change":"2023-10-06T03:00:57.986460+0000","last_active":"2023-10-06T03:00:57.987973+0000","last_peered":"2023-10-06T03:00:57.987973+0000","last_clean":"2023-10-06T03:00:57.987973+0000","last_became_active":"2023-10-06T03:00:57.985944+0000","last_became_peered":"2023-10-06T03:00:57.985944+0000","last_unstale":"2023-10-06T03:00:57.987973+0000","last_undegraded":"2023-10-06T03:00:57.987973+0000","last_fullsized":"2023-10-06T03:00:57.987973+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:01:21.312056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.962907+0000","last_change":"2023-10-06T03:00:56.986763+0000","last_active":"2023-10-06T03:00:57.962907+0000","last_peered":"2023-10-06T03:00:57.962907+0000","last_clean":"2023-10-06T03:00:57.962907+0000","last_became_active":"2023-10-06T03:00:56.986417+0000","last_became_peered":"2023-10-06T03:00:56.986417+0000","last_unstale":"2023-10-06T03:00:57.962907+0000","last_undegraded":"2023-10-06T03:00:57.962907+0000","last_fullsized":"2023-10-06T03:00:57.962907+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:50:23.531265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.996078+0000","last_change":"2023-10-06T03:00:57.996078+0000","last_active":"2023-10-06T03:00:57.996078+0000","last_peered":"2023-10-06T03:00:57.996078+0000","last_clean":"2023-10-06T03:00:57.996078+0000","last_became_active":"2023-10-06T03:00:57.995672+0000","last_became_peered":"2023-10-06T03:00:57.995672+0000","last_unstale":"2023-10-06T03:00:57.996078+0000","last_undegraded":"2023-10-06T03:00:57.996078+0000","last_fullsized":"2023-10-06T03:00:57.996078+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:18:57.339278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-06T03:00:56.990375+0000","last_change":"2023-10-06T03:00:56.983097+0000","last_active":"2023-10-06T03:00:56.990375+0000","last_peered":"2023-10-06T03:00:56.990375+0000","last_clean":"2023-10-06T03:00:56.990375+0000","last_became_active":"2023-10-06T03:00:56.982646+0000","last_became_peered":"2023-10-06T03:00:56.982646+0000","last_unstale":"2023-10-06T03:00:56.990375+0000","last_undegraded":"2023-10-06T03:00:56.990375+0000","last_fullsized":"2023-10-06T03:00:56.990375+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:11:31.937336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.978634+0000","last_change":"2023-10-06T03:00:57.976355+0000","last_active":"2023-10-06T03:00:57.978634+0000","last_peered":"2023-10-06T03:00:57.978634+0000","last_clean":"2023-10-06T03:00:57.978634+0000","last_became_active":"2023-10-06T03:00:57.976098+0000","last_became_peered":"2023-10-06T03:00:57.976098+0000","last_unstale":"2023-10-06T03:00:57.978634+0000","last_undegraded":"2023-10-06T03:00:57.978634+0000","last_fullsized":"2023-10-06T03:00:57.978634+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:32:20.183224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.968264+0000","last_change":"2023-10-06T03:00:56.979150+0000","last_active":"2023-10-06T03:00:57.968264+0000","last_peered":"2023-10-06T03:00:57.968264+0000","last_clean":"2023-10-06T03:00:57.968264+0000","last_became_active":"2023-10-06T03:00:56.977097+0000","last_became_peered":"2023-10-06T03:00:56.977097+0000","last_unstale":"2023-10-06T03:00:57.968264+0000","last_undegraded":"2023-10-06T03:00:57.968264+0000","last_fullsized":"2023-10-06T03:00:57.968264+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:39:17.918596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.986365+0000","last_change":"2023-10-06T03:00:57.986365+0000","last_active":"2023-10-06T03:00:57.986365+0000","last_peered":"2023-10-06T03:00:57.986365+0000","last_clean":"2023-10-06T03:00:57.986365+0000","last_became_active":"2023-10-06T03:00:57.985862+0000","last_became_peered":"2023-10-06T03:00:57.985862+0000","last_unstale":"2023-10-06T03:00:57.986365+0000","last_undegraded":"2023-10-06T03:00:57.986365+0000","last_fullsized":"2023-10-06T03:00:57.986365+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:32:01.876152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.982273+0000","last_change":"2023-10-06T03:00:56.983730+0000","last_active":"2023-10-06T03:00:57.982273+0000","last_peered":"2023-10-06T03:00:57.982273+0000","last_clean":"2023-10-06T03:00:57.982273+0000","last_became_active":"2023-10-06T03:00:56.983403+0000","last_became_peered":"2023-10-06T03:00:56.983403+0000","last_unstale":"2023-10-06T03:00:57.982273+0000","last_undegraded":"2023-10-06T03:00:57.982273+0000","last_fullsized":"2023-10-06T03:00:57.982273+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:50:23.531265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.981050+0000","last_change":"2023-10-06T03:00:57.981050+0000","last_active":"2023-10-06T03:00:57.981050+0000","last_peered":"2023-10-06T03:00:57.981050+0000","last_clean":"2023-10-06T03:00:57.981050+0000","last_became_active":"2023-10-06T03:00:57.980699+0000","last_became_peered":"2023-10-06T03:00:57.980699+0000","last_unstale":"2023-10-06T03:00:57.981050+0000","last_undegraded":"2023-10-06T03:00:57.981050+0000","last_fullsized":"2023-10-06T03:00:57.981050+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:54:01.471407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:58.015580+0000","last_change":"2023-10-06T03:00:56.980374+0000","last_active":"2023-10-06T03:00:58.015580+0000","last_peered":"2023-10-06T03:00:58.015580+0000","last_clean":"2023-10-06T03:00:58.015580+0000","last_became_active":"2023-10-06T03:00:56.980008+0000","last_became_peered":"2023-10-06T03:00:56.980008+0000","last_unstale":"2023-10-06T03:00:58.015580+0000","last_undegraded":"2023-10-06T03:00:58.015580+0000","last_fullsized":"2023-10-06T03:00:58.015580+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:01:20.300193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.981237+0000","last_change":"2023-10-06T03:00:57.981237+0000","last_active":"2023-10-06T03:00:57.981237+0000","last_peered":"2023-10-06T03:00:57.981237+0000","last_clean":"2023-10-06T03:00:57.981237+0000","last_became_active":"2023-10-06T03:00:57.980835+0000","last_became_peered":"2023-10-06T03:00:57.980835+0000","last_unstale":"2023-10-06T03:00:57.981237+0000","last_undegraded":"2023-10-06T03:00:57.981237+0000","last_fullsized":"2023-10-06T03:00:57.981237+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:34:39.099380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:58.015618+0000","last_change":"2023-10-06T03:00:56.982198+0000","last_active":"2023-10-06T03:00:58.015618+0000","last_peered":"2023-10-06T03:00:58.015618+0000","last_clean":"2023-10-06T03:00:58.015618+0000","last_became_active":"2023-10-06T03:00:56.981933+0000","last_became_peered":"2023-10-06T03:00:56.981933+0000","last_unstale":"2023-10-06T03:00:58.015618+0000","last_undegraded":"2023-10-06T03:00:58.015618+0000","last_fullsized":"2023-10-06T03:00:58.015618+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:57:09.321024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.987031+0000","last_change":"2023-10-06T03:00:57.984525+0000","last_active":"2023-10-06T03:00:57.987031+0000","last_peered":"2023-10-06T03:00:57.987031+0000","last_clean":"2023-10-06T03:00:57.987031+0000","last_became_active":"2023-10-06T03:00:57.984205+0000","last_became_peered":"2023-10-06T03:00:57.984205+0000","last_unstale":"2023-10-06T03:00:57.987031+0000","last_undegraded":"2023-10-06T03:00:57.987031+0000","last_fullsized":"2023-10-06T03:00:57.987031+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:28:58.179787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:58.006745+0000","last_change":"2023-10-06T03:00:56.978317+0000","last_active":"2023-10-06T03:00:58.006745+0000","last_peered":"2023-10-06T03:00:58.006745+0000","last_clean":"2023-10-06T03:00:58.006745+0000","last_became_active":"2023-10-06T03:00:56.977802+0000","last_became_peered":"2023-10-06T03:00:56.977802+0000","last_unstale":"2023-10-06T03:00:58.006745+0000","last_undegraded":"2023-10-06T03:00:58.006745+0000","last_fullsized":"2023-10-06T03:00:58.006745+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:04:35.977083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.984100+0000","last_change":"2023-10-06T03:00:57.984100+0000","last_active":"2023-10-06T03:00:57.984100+0000","last_peered":"2023-10-06T03:00:57.984100+0000","last_clean":"2023-10-06T03:00:57.984100+0000","last_became_active":"2023-10-06T03:00:57.983756+0000","last_became_peered":"2023-10-06T03:00:57.983756+0000","last_unstale":"2023-10-06T03:00:57.984100+0000","last_undegraded":"2023-10-06T03:00:57.984100+0000","last_fullsized":"2023-10-06T03:00:57.984100+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:10:20.444330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:58.007358+0000","last_change":"2023-10-06T03:00:56.981315+0000","last_active":"2023-10-06T03:00:58.007358+0000","last_peered":"2023-10-06T03:00:58.007358+0000","last_clean":"2023-10-06T03:00:58.007358+0000","last_became_active":"2023-10-06T03:00:56.980617+0000","last_became_peered":"2023-10-06T03:00:56.980617+0000","last_unstale":"2023-10-06T03:00:58.007358+0000","last_undegraded":"2023-10-06T03:00:58.007358+0000","last_fullsized":"2023-10-06T03:00:58.007358+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:04:35.977083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298120,"kb_used_data":832,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073720,"statfs":{"total":96636764160,"available":96331489280,"internally_reserved":0,"allocated":851968,"data_stored":674798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92700000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3680000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4870000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3420000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.157}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89400000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5549999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297512,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074328,"statfs":{"total":96636764160,"available":96332111872,"internally_reserved":0,"allocated":229376,"data_stored":82678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.083}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5229999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0469999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.129}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3540000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.647}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6060000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297520,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074320,"statfs":{"total":96636764160,"available":96332103680,"internally_reserved":0,"allocated":237568,"data_stored":83302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85099999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3080000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.331}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.353}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.214}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.163}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297532,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074308,"statfs":{"total":96636764160,"available":96332091392,"internally_reserved":0,"allocated":249856,"data_stored":84270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1080000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0660000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4239999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.383}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6719999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.776}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9059999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301612,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070228,"statfs":{"total":96636764160,"available":96327913472,"internally_reserved":0,"allocated":233472,"data_stored":82768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92200000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.173}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.361}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.123}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.532}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301608,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070232,"statfs":{"total":96636764160,"available":96327917568,"internally_reserved":0,"allocated":229376,"data_stored":82678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0149999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83099999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5189999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.794}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4359999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8420000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301608,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070232,"statfs":{"total":96636764160,"available":96327917568,"internally_reserved":0,"allocated":229376,"data_stored":82678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0149999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2430000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6319999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.702}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5529999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302192,"kb_used_data":808,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069648,"statfs":{"total":96636764160,"available":96327319552,"internally_reserved":0,"allocated":827392,"data_stored":673600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.075}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2310000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.246}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4179999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.46}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:01:02.721 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-06T03:01:02.721 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-06T03:01:02.721 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-10-06T03:01:02.722 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-10-06T03:01:02.722 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-10-06T03:01:02.931 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.927+0000 7f7de0e6e700 1 Processor -- start 2023-10-06T03:01:02.931 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.927+0000 7f7de0e6e700 1 -- start start 2023-10-06T03:01:02.933 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.927+0000 7f7de0e6e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7ddc158f70 0x7f7ddc0cb2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:02.934 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.927+0000 7f7de0e6e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f7ddc0b01c0 0x7f7ddc06dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:02.934 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.927+0000 7f7de0e6e700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ddc0b0640 con 0x7f7ddc159340 2023-10-06T03:01:02.934 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.927+0000 7f7de0e6e700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ddc0cb900 con 0x7f7ddc0b01c0 2023-10-06T03:01:02.934 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.927+0000 7f7de0e6e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ddc0cbbe0 con 0x7f7ddc158f70 2023-10-06T03:01:02.935 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.927+0000 7f7ddad9d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f7ddc0b01c0 0x7f7ddc06dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:02.935 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.927+0000 7f7ddad9d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f7ddc0b01c0 0x7f7ddc06dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:45020/0 (socket says 172.21.15.57:45020) 2023-10-06T03:01:02.935 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.927+0000 7f7ddad9d700 1 -- 172.21.15.57:0/407695971 learned_addr learned my addr 172.21.15.57:0/407695971 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:02.935 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.927+0000 7f7dda59c700 1 --2- 172.21.15.57:0/407695971 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7ddc158f70 0x7f7ddc0cb2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:02.935 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.931+0000 7f7ddad9d700 1 -- 172.21.15.57:0/407695971 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7ddc158f70 msgr2=0x7f7ddc0cb2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:02.936 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.931+0000 7f7ddad9d700 1 --2- 172.21.15.57:0/407695971 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7ddc158f70 0x7f7ddc0cb2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:02.936 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.931+0000 7f7ddad9d700 1 -- 172.21.15.57:0/407695971 >> v1:172.21.15.105:6789/0 conn(0x7f7ddc159340 legacy=0x7f7ddc06d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:02.936 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.931+0000 7f7ddad9d700 1 -- 172.21.15.57:0/407695971 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ddc06c9c0 con 0x7f7ddc0b01c0 2023-10-06T03:01:02.936 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.931+0000 7f7ddad9d700 1 --2- 172.21.15.57:0/407695971 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ddc0b01c0 0x7f7ddc06dbb0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7dd4009f20 tx=0x7f7dd4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6ad5ebd859c2a71 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:02.937 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.931+0000 7f7dd959a700 1 -- 172.21.15.57:0/407695971 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd400e070 con 0x7f7ddc0b01c0 2023-10-06T03:01:02.937 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.931+0000 7f7dd959a700 1 -- 172.21.15.57:0/407695971 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dd400b9d0 con 0x7f7ddc0b01c0 2023-10-06T03:01:02.937 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.931+0000 7f7dd959a700 1 -- 172.21.15.57:0/407695971 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd40092e0 con 0x7f7ddc0b01c0 2023-10-06T03:01:02.937 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.931+0000 7f7de0e6e700 1 -- 172.21.15.57:0/407695971 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ddc0b01c0 msgr2=0x7f7ddc06dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:02.937 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.931+0000 7f7de0e6e700 1 --2- 172.21.15.57:0/407695971 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ddc0b01c0 0x7f7ddc06dbb0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7dd4009f20 tx=0x7f7dd4009840 comp rx=0 tx=0).stop 2023-10-06T03:01:02.938 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.931+0000 7f7de0e6e700 1 -- 172.21.15.57:0/407695971 shutdown_connections 2023-10-06T03:01:02.938 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.931+0000 7f7de0e6e700 1 --2- 172.21.15.57:0/407695971 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ddc0b01c0 0x7f7ddc06dbb0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:02.938 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.931+0000 7f7de0e6e700 1 --2- 172.21.15.57:0/407695971 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7ddc158f70 0x7f7ddc0cb2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:02.938 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.931+0000 7f7de0e6e700 1 -- 172.21.15.57:0/407695971 >> 172.21.15.57:0/407695971 conn(0x7f7ddc0ccbf0 msgr2=0x7f7ddc0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:02.938 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.931+0000 7f7de0e6e700 1 -- 172.21.15.57:0/407695971 shutdown_connections 2023-10-06T03:01:02.939 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.931+0000 7f7de0e6e700 1 -- 172.21.15.57:0/407695971 wait complete. 2023-10-06T03:01:02.940 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.935+0000 7f7de0e6e700 1 Processor -- start 2023-10-06T03:01:02.940 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.935+0000 7f7de0e6e700 1 -- start start 2023-10-06T03:01:02.942 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.935+0000 7f7de0e6e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7ddc0b01c0 0x7f7ddc15d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:02.942 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.935+0000 7f7de0e6e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7ddc158f70 0x7f7ddc15e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:02.942 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.935+0000 7f7de0e6e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ddc159340 0x7f7ddc159820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:02.942 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.935+0000 7f7de0e6e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ddc159d60 con 0x7f7ddc159340 2023-10-06T03:01:02.942 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.935+0000 7f7de0e6e700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ddc15cff0 con 0x7f7ddc158f70 2023-10-06T03:01:02.942 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.935+0000 7f7de0e6e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ddc15c420 con 0x7f7ddc0b01c0 2023-10-06T03:01:02.943 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.935+0000 7f7ddad9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ddc159340 0x7f7ddc159820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:02.943 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.935+0000 7f7ddad9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ddc159340 0x7f7ddc159820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:45032/0 (socket says 172.21.15.57:45032) 2023-10-06T03:01:02.943 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.935+0000 7f7ddad9d700 1 -- 172.21.15.57:0/4228435473 learned_addr learned my addr 172.21.15.57:0/4228435473 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:02.944 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.939+0000 7f7dda59c700 1 --2- 172.21.15.57:0/4228435473 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7ddc0b01c0 0x7f7ddc15d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:02.944 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.939+0000 7f7dd9d9b700 1 --2- 172.21.15.57:0/4228435473 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7ddc158f70 0x7f7ddc15e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:02.944 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.939+0000 7f7ddad9d700 1 -- 172.21.15.57:0/4228435473 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7ddc0b01c0 msgr2=0x7f7ddc15d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:02.944 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.939+0000 7f7ddad9d700 1 --2- 172.21.15.57:0/4228435473 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7ddc0b01c0 0x7f7ddc15d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:02.944 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.939+0000 7f7ddad9d700 1 -- 172.21.15.57:0/4228435473 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7ddc158f70 msgr2=0x7f7ddc15e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:02.944 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.939+0000 7f7ddad9d700 1 --2- 172.21.15.57:0/4228435473 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7ddc158f70 0x7f7ddc15e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:02.944 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.939+0000 7f7ddad9d700 1 -- 172.21.15.57:0/4228435473 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dd4009ae0 con 0x7f7ddc159340 2023-10-06T03:01:02.945 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.939+0000 7f7ddad9d700 1 --2- 172.21.15.57:0/4228435473 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ddc159340 0x7f7ddc159820 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7ddc06a650 tx=0x7f7dd4018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:02.945 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.939+0000 7f7dca7fc700 1 -- 172.21.15.57:0/4228435473 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd4008b10 con 0x7f7ddc159340 2023-10-06T03:01:02.945 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.939+0000 7f7dca7fc700 1 -- 172.21.15.57:0/4228435473 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dd4008cb0 con 0x7f7ddc159340 2023-10-06T03:01:02.945 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.939+0000 7f7dca7fc700 1 -- 172.21.15.57:0/4228435473 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd40266b0 con 0x7f7ddc159340 2023-10-06T03:01:02.945 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.939+0000 7f7de0e6e700 1 -- 172.21.15.57:0/4228435473 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ddc15c6c0 con 0x7f7ddc159340 2023-10-06T03:01:02.945 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.939+0000 7f7de0e6e700 1 -- 172.21.15.57:0/4228435473 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ddc15cc80 con 0x7f7ddc159340 2023-10-06T03:01:02.946 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.939+0000 7f7de0e6e700 1 -- 172.21.15.57:0/4228435473 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ddc15d180 con 0x7f7ddc159340 2023-10-06T03:01:02.948 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.943+0000 7f7dca7fc700 1 -- 172.21.15.57:0/4228435473 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f7dd4003040 con 0x7f7ddc159340 2023-10-06T03:01:02.950 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.943+0000 7f7dca7fc700 1 --2- 172.21.15.57:0/4228435473 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f7dbc060550 0x7f7dbc062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:02.950 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.943+0000 7f7dca7fc700 1 -- 172.21.15.57:0/4228435473 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7dd407e780 con 0x7f7ddc159340 2023-10-06T03:01:02.950 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.943+0000 7f7dda59c700 1 --2- 172.21.15.57:0/4228435473 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f7dbc060550 0x7f7dbc062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:02.951 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.947+0000 7f7dda59c700 1 --2- 172.21.15.57:0/4228435473 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f7dbc060550 0x7f7dbc062a00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc009db0 tx=0x7f7dcc0091a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:02.955 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:02.951+0000 7f7dca7fc700 1 -- 172.21.15.57:0/4228435473 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f7dd404ec10 con 0x7f7ddc159340 2023-10-06T03:01:03.071 INFO:tasks.ceph.mds.b.smithi105.stderr:2023-10-06T03:01:03.069+0000 7fb6a4521700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T03:01:03.168 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.163+0000 7f7de0e6e700 1 -- 172.21.15.57:0/4228435473 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f7ddc0712e0 con 0x7f7ddc159340 2023-10-06T03:01:03.173 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.167+0000 7f7dca7fc700 1 -- 172.21.15.57:0/4228435473 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+154130 (secure 0 0 0) 0x7f7dd4052230 con 0x7f7ddc159340 2023-10-06T03:01:03.174 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:01:03.178 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.171+0000 7f7de0e6e700 1 -- 172.21.15.57:0/4228435473 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f7dbc060550 msgr2=0x7f7dbc062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:03.178 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.171+0000 7f7de0e6e700 1 --2- 172.21.15.57:0/4228435473 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f7dbc060550 0x7f7dbc062a00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc009db0 tx=0x7f7dcc0091a0 comp rx=0 tx=0).stop 2023-10-06T03:01:03.178 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.171+0000 7f7de0e6e700 1 -- 172.21.15.57:0/4228435473 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ddc159340 msgr2=0x7f7ddc159820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:03.178 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.171+0000 7f7de0e6e700 1 --2- 172.21.15.57:0/4228435473 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ddc159340 0x7f7ddc159820 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7ddc06a650 tx=0x7f7dd4018000 comp rx=0 tx=0).stop 2023-10-06T03:01:03.178 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.171+0000 7f7de0e6e700 1 -- 172.21.15.57:0/4228435473 shutdown_connections 2023-10-06T03:01:03.179 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.171+0000 7f7de0e6e700 1 --2- 172.21.15.57:0/4228435473 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ddc159340 0x7f7ddc159820 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:03.179 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.171+0000 7f7de0e6e700 1 --2- 172.21.15.57:0/4228435473 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7ddc158f70 0x7f7ddc15e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:03.179 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.171+0000 7f7de0e6e700 1 --2- 172.21.15.57:0/4228435473 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f7dbc060550 0x7f7dbc062a00 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:03.179 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.171+0000 7f7de0e6e700 1 --2- 172.21.15.57:0/4228435473 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7ddc0b01c0 0x7f7ddc15d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:03.179 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.171+0000 7f7de0e6e700 1 -- 172.21.15.57:0/4228435473 >> 172.21.15.57:0/4228435473 conn(0x7f7ddc0ccbf0 msgr2=0x7f7ddc158070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:03.179 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.171+0000 7f7de0e6e700 1 -- 172.21.15.57:0/4228435473 shutdown_connections 2023-10-06T03:01:03.179 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.171+0000 7f7de0e6e700 1 -- 172.21.15.57:0/4228435473 wait complete. 2023-10-06T03:01:03.199 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":5,"active_gid":4103,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":32947},{"type":"v1","addr":"172.21.15.57:6833","nonce":32947}]},"active_addr":"172.21.15.57:6833/32947","active_change":"2023-10-06T03:00:36.244828+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":4100,"name":"x","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":false,"error_string":"loading asyncssh library:No module named 'asyncssh'","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":false,"error_string":"loading asyncssh library:No module named 'asyncssh'","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.57:0","nonce":2541828361}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.57:0","nonce":3011620609}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.57:0","nonce":547462581}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.57:0","nonce":2610068048}]}]} 2023-10-06T03:01:03.203 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-10-06T03:01:03.203 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-06T03:01:03.203 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:01:03.366 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.359+0000 7f4e6d26b700 1 Processor -- start 2023-10-06T03:01:03.366 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.359+0000 7f4e6d26b700 1 -- start start 2023-10-06T03:01:03.367 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.363+0000 7f4e6d26b700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f4e680aae90 0x7f4e680aa7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:03.367 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.363+0000 7f4e6d26b700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4e6806bba0 0x7f4e680ab970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:03.368 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.363+0000 7f4e6d26b700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e6806de50 con 0x7f4e6806c920 2023-10-06T03:01:03.368 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.363+0000 7f4e6d26b700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e6806bff0 con 0x7f4e680aae90 2023-10-06T03:01:03.368 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.363+0000 7f4e6d26b700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e6806e130 con 0x7f4e6806bba0 2023-10-06T03:01:03.368 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.363+0000 7f4e67fff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f4e6806c920 0x7f4e6806ccf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:43314/0 (socket says 172.21.15.57:43314) 2023-10-06T03:01:03.368 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.363+0000 7f4e67fff700 1 -- 172.21.15.57:0/3170324566 learned_addr learned my addr 172.21.15.57:0/3170324566 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:01:03.369 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.363+0000 7f4e677fe700 1 --2- 172.21.15.57:0/3170324566 >> v2:172.21.15.105:3300/0 conn(0x7f4e680aae90 0x7f4e680aa7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:03.369 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.363+0000 7f4e6ca6a700 1 --2- 172.21.15.57:0/3170324566 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4e6806bba0 0x7f4e680ab970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:03.369 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.363+0000 7f4e66ffd700 1 -- 172.21.15.57:0/3170324566 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3030594945 0 0) 0x7f4e6806de50 con 0x7f4e6806c920 2023-10-06T03:01:03.369 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.363+0000 7f4e66ffd700 1 -- 172.21.15.57:0/3170324566 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e50003570 con 0x7f4e6806c920 2023-10-06T03:01:03.369 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.363+0000 7f4e677fe700 1 -- 172.21.15.57:0/3170324566 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4e6806bba0 msgr2=0x7f4e680ab970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:03.370 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.363+0000 7f4e677fe700 1 --2- 172.21.15.57:0/3170324566 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4e6806bba0 0x7f4e680ab970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:03.370 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.363+0000 7f4e677fe700 1 -- 172.21.15.57:0/3170324566 >> v1:172.21.15.57:6789/0 conn(0x7f4e6806c920 legacy=0x7f4e6806ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:03.370 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.363+0000 7f4e677fe700 1 -- 172.21.15.57:0/3170324566 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e6806b3a0 con 0x7f4e680aae90 2023-10-06T03:01:03.370 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.363+0000 7f4e677fe700 1 --2- 172.21.15.57:0/3170324566 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4e680aae90 0x7f4e680aa7e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c0098e0 tx=0x7f4e5c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a98ee5f1a2fbc76c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:03.371 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.363+0000 7f4e66ffd700 1 -- 172.21.15.57:0/3170324566 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e5c011630 con 0x7f4e680aae90 2023-10-06T03:01:03.371 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.363+0000 7f4e66ffd700 1 -- 172.21.15.57:0/3170324566 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e5c011790 con 0x7f4e680aae90 2023-10-06T03:01:03.371 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.367+0000 7f4e66ffd700 1 -- 172.21.15.57:0/3170324566 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e5c011b30 con 0x7f4e680aae90 2023-10-06T03:01:03.372 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.367+0000 7f4e6d26b700 1 -- 172.21.15.57:0/3170324566 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4e680aae90 msgr2=0x7f4e680aa7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:03.372 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.367+0000 7f4e6d26b700 1 --2- 172.21.15.57:0/3170324566 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4e680aae90 0x7f4e680aa7e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c0098e0 tx=0x7f4e5c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:01:03.372 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.367+0000 7f4e6d26b700 1 -- 172.21.15.57:0/3170324566 shutdown_connections 2023-10-06T03:01:03.372 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.367+0000 7f4e6d26b700 1 --2- 172.21.15.57:0/3170324566 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4e6806bba0 0x7f4e680ab970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:03.372 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.367+0000 7f4e6d26b700 1 --2- 172.21.15.57:0/3170324566 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4e680aae90 0x7f4e680aa7e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:03.372 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.367+0000 7f4e6d26b700 1 -- 172.21.15.57:0/3170324566 >> 172.21.15.57:0/3170324566 conn(0x7f4e680c85e0 msgr2=0x7f4e680c89e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:03.372 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.367+0000 7f4e6d26b700 1 -- 172.21.15.57:0/3170324566 shutdown_connections 2023-10-06T03:01:03.372 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.367+0000 7f4e6d26b700 1 -- 172.21.15.57:0/3170324566 wait complete. 2023-10-06T03:01:03.374 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.367+0000 7f4e6d26b700 1 Processor -- start 2023-10-06T03:01:03.374 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.367+0000 7f4e6d26b700 1 -- start start 2023-10-06T03:01:03.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.371+0000 7f4e6d26b700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4e6806bba0 0x7f4e68171240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:03.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.371+0000 7f4e6d26b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e6806c920 0x7f4e6816f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:03.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.371+0000 7f4e6d26b700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4e680aae90 0x7f4e680b1050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:03.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.371+0000 7f4e6d26b700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e681706e0 con 0x7f4e6806c920 2023-10-06T03:01:03.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.371+0000 7f4e6d26b700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e68171780 con 0x7f4e680aae90 2023-10-06T03:01:03.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.371+0000 7f4e6d26b700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e68170120 con 0x7f4e6806bba0 2023-10-06T03:01:03.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.371+0000 7f4e677fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e6806c920 0x7f4e6816f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:03.378 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.371+0000 7f4e677fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e6806c920 0x7f4e6816f770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:45042/0 (socket says 172.21.15.57:45042) 2023-10-06T03:01:03.378 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.371+0000 7f4e677fe700 1 -- 172.21.15.57:0/3910952244 learned_addr learned my addr 172.21.15.57:0/3910952244 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:03.378 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.371+0000 7f4e67fff700 1 --2- 172.21.15.57:0/3910952244 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4e6806bba0 0x7f4e68171240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:03.378 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.371+0000 7f4e6ca6a700 1 --2- 172.21.15.57:0/3910952244 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4e680aae90 0x7f4e680b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:03.378 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.371+0000 7f4e677fe700 1 -- 172.21.15.57:0/3910952244 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4e6806bba0 msgr2=0x7f4e68171240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:03.378 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.371+0000 7f4e677fe700 1 --2- 172.21.15.57:0/3910952244 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4e6806bba0 0x7f4e68171240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:03.378 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.371+0000 7f4e677fe700 1 -- 172.21.15.57:0/3910952244 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4e680aae90 msgr2=0x7f4e680b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:03.378 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.371+0000 7f4e677fe700 1 --2- 172.21.15.57:0/3910952244 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4e680aae90 0x7f4e680b1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:03.379 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.371+0000 7f4e677fe700 1 -- 172.21.15.57:0/3910952244 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e5c009420 con 0x7f4e6806c920 2023-10-06T03:01:03.379 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.371+0000 7f4e677fe700 1 --2- 172.21.15.57:0/3910952244 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e6806c920 0x7f4e6816f770 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4e6806a1d0 tx=0x7f4e5c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:03.379 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.371+0000 7f4e4ffff700 1 -- 172.21.15.57:0/3910952244 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e5c000c40 con 0x7f4e6806c920 2023-10-06T03:01:03.379 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.371+0000 7f4e4ffff700 1 -- 172.21.15.57:0/3910952244 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e5c011900 con 0x7f4e6806c920 2023-10-06T03:01:03.380 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.371+0000 7f4e4ffff700 1 -- 172.21.15.57:0/3910952244 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e5c025420 con 0x7f4e6806c920 2023-10-06T03:01:03.380 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.371+0000 7f4e6d26b700 1 -- 172.21.15.57:0/3910952244 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e68170400 con 0x7f4e6806c920 2023-10-06T03:01:03.380 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.375+0000 7f4e6d26b700 1 -- 172.21.15.57:0/3910952244 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e68170d20 con 0x7f4e6806c920 2023-10-06T03:01:03.381 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.375+0000 7f4e6d26b700 1 -- 172.21.15.57:0/3910952244 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e68170f40 con 0x7f4e6806c920 2023-10-06T03:01:03.382 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.375+0000 7f4e4ffff700 1 -- 172.21.15.57:0/3910952244 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f4e5c023070 con 0x7f4e6806c920 2023-10-06T03:01:03.384 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.379+0000 7f4e4ffff700 1 --2- 172.21.15.57:0/3910952244 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f4e54060550 0x7f4e54062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:03.384 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.379+0000 7f4e4ffff700 1 -- 172.21.15.57:0/3910952244 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4e5c07dce0 con 0x7f4e6806c920 2023-10-06T03:01:03.384 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.379+0000 7f4e67fff700 1 --2- 172.21.15.57:0/3910952244 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f4e54060550 0x7f4e54062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:03.385 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.379+0000 7f4e67fff700 1 --2- 172.21.15.57:0/3910952244 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f4e54060550 0x7f4e54062a00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4e58001580 tx=0x7f4e58009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:03.389 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.383+0000 7f4e4ffff700 1 -- 172.21.15.57:0/3910952244 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f4e5c04e110 con 0x7f4e6806c920 2023-10-06T03:01:03.562 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.555+0000 7f4e6d26b700 1 -- 172.21.15.57:0/3910952244 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4e6804be40 con 0x7f4e6806c920 2023-10-06T03:01:03.563 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.559+0000 7f4e4ffff700 1 -- 172.21.15.57:0/3910952244 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16866 (secure 0 0 0) 0x7f4e5c015090 con 0x7f4e6806c920 2023-10-06T03:01:03.564 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:01:03.564 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":23,"fsid":"eb56dc0f-9213-41cb-9aad-8ade6c802e98","created":"2023-10-06T03:00:30.806197+0000","modified":"2023-10-06T03:00:58.975366+0000","last_up_change":"2023-10-06T03:00:43.607454+0000","last_in_change":"2023-10-06T03:00:33.943513+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T03:00:44.360651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T03:00:50.466601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:00:55.472586+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T03:00:56.400884+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"58cf6c90-d704-43e0-b2db-dffe526d5e8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":33053},{"type":"v1","addr":"172.21.15.57:6801","nonce":33053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":33053},{"type":"v1","addr":"172.21.15.57:6803","nonce":33053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":33053},{"type":"v1","addr":"172.21.15.57:6807","nonce":33053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":33053},{"type":"v1","addr":"172.21.15.57:6805","nonce":33053}]},"public_addr":"172.21.15.57:6801/33053","cluster_addr":"172.21.15.57:6803/33053","heartbeat_back_addr":"172.21.15.57:6807/33053","heartbeat_front_addr":"172.21.15.57:6805/33053","state":["exists","up"]},{"osd":1,"uuid":"16afbe70-7f9e-4568-9c92-763e6e348119","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6809","nonce":33052},{"type":"v1","addr":"172.21.15.57:6810","nonce":33052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":33052},{"type":"v1","addr":"172.21.15.57:6813","nonce":33052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":33052},{"type":"v1","addr":"172.21.15.57:6822","nonce":33052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6815","nonce":33052},{"type":"v1","addr":"172.21.15.57:6818","nonce":33052}]},"public_addr":"172.21.15.57:6810/33052","cluster_addr":"172.21.15.57:6813/33052","heartbeat_back_addr":"172.21.15.57:6822/33052","heartbeat_front_addr":"172.21.15.57:6818/33052","state":["exists","up"]},{"osd":2,"uuid":"7255c62e-f92f-470f-a5ce-30228920d9f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":33058},{"type":"v1","addr":"172.21.15.57:6825","nonce":33058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":33058},{"type":"v1","addr":"172.21.15.57:6827","nonce":33058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":33058},{"type":"v1","addr":"172.21.15.57:6831","nonce":33058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":33058},{"type":"v1","addr":"172.21.15.57:6829","nonce":33058}]},"public_addr":"172.21.15.57:6825/33058","cluster_addr":"172.21.15.57:6827/33058","heartbeat_back_addr":"172.21.15.57:6831/33058","heartbeat_front_addr":"172.21.15.57:6829/33058","state":["exists","up"]},{"osd":3,"uuid":"152a236d-f799-4888-8544-74865508d5a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":33057},{"type":"v1","addr":"172.21.15.57:6811","nonce":33057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":33057},{"type":"v1","addr":"172.21.15.57:6816","nonce":33057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6821","nonce":33057},{"type":"v1","addr":"172.21.15.57:6823","nonce":33057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6817","nonce":33057},{"type":"v1","addr":"172.21.15.57:6819","nonce":33057}]},"public_addr":"172.21.15.57:6811/33057","cluster_addr":"172.21.15.57:6816/33057","heartbeat_back_addr":"172.21.15.57:6823/33057","heartbeat_front_addr":"172.21.15.57:6819/33057","state":["exists","up"]},{"osd":4,"uuid":"37db2a65-3566-41d0-9d60-e66c49e1e68e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":33368},{"type":"v1","addr":"172.21.15.105:6801","nonce":33368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":33368},{"type":"v1","addr":"172.21.15.105:6803","nonce":33368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":33368},{"type":"v1","addr":"172.21.15.105:6807","nonce":33368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":33368},{"type":"v1","addr":"172.21.15.105:6805","nonce":33368}]},"public_addr":"172.21.15.105:6801/33368","cluster_addr":"172.21.15.105:6803/33368","heartbeat_back_addr":"172.21.15.105:6807/33368","heartbeat_front_addr":"172.21.15.105:6805/33368","state":["exists","up"]},{"osd":5,"uuid":"35e77918-1bb4-42ca-9b20-f3c14eaa0c04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":33379},{"type":"v1","addr":"172.21.15.105:6818","nonce":33379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":33379},{"type":"v1","addr":"172.21.15.105:6823","nonce":33379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":33379},{"type":"v1","addr":"172.21.15.105:6831","nonce":33379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":33379},{"type":"v1","addr":"172.21.15.105:6827","nonce":33379}]},"public_addr":"172.21.15.105:6818/33379","cluster_addr":"172.21.15.105:6823/33379","heartbeat_back_addr":"172.21.15.105:6831/33379","heartbeat_front_addr":"172.21.15.105:6827/33379","state":["exists","up"]},{"osd":6,"uuid":"b4d9d510-7a45-4173-8287-c6c8d6547f2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":33369},{"type":"v1","addr":"172.21.15.105:6819","nonce":33369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":33369},{"type":"v1","addr":"172.21.15.105:6822","nonce":33369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":33369},{"type":"v1","addr":"172.21.15.105:6830","nonce":33369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":33369},{"type":"v1","addr":"172.21.15.105:6826","nonce":33369}]},"public_addr":"172.21.15.105:6819/33369","cluster_addr":"172.21.15.105:6822/33369","heartbeat_back_addr":"172.21.15.105:6830/33369","heartbeat_front_addr":"172.21.15.105:6826/33369","state":["exists","up"]},{"osd":7,"uuid":"74266fb0-cd84-463f-8bf0-092652a71dc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":33370},{"type":"v1","addr":"172.21.15.105:6809","nonce":33370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":33370},{"type":"v1","addr":"172.21.15.105:6811","nonce":33370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":33370},{"type":"v1","addr":"172.21.15.105:6815","nonce":33370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":33370},{"type":"v1","addr":"172.21.15.105:6813","nonce":33370}]},"public_addr":"172.21.15.105:6809/33370","cluster_addr":"172.21.15.105:6811/33370","heartbeat_back_addr":"172.21.15.105:6815/33370","heartbeat_front_addr":"172.21.15.105:6813/33370","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.596864+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.633851+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.636993+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.529681+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.608601+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.659752+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.661717+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.642221+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:01:03.569 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.563+0000 7f4e6d26b700 1 -- 172.21.15.57:0/3910952244 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f4e54060550 msgr2=0x7f4e54062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:03.569 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.563+0000 7f4e6d26b700 1 --2- 172.21.15.57:0/3910952244 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f4e54060550 0x7f4e54062a00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4e58001580 tx=0x7f4e58009040 comp rx=0 tx=0).stop 2023-10-06T03:01:03.569 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.563+0000 7f4e6d26b700 1 -- 172.21.15.57:0/3910952244 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e6806c920 msgr2=0x7f4e6816f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:03.569 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.563+0000 7f4e6d26b700 1 --2- 172.21.15.57:0/3910952244 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e6806c920 0x7f4e6816f770 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4e6806a1d0 tx=0x7f4e5c017000 comp rx=0 tx=0).stop 2023-10-06T03:01:03.569 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.563+0000 7f4e6d26b700 1 -- 172.21.15.57:0/3910952244 shutdown_connections 2023-10-06T03:01:03.569 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.563+0000 7f4e6d26b700 1 --2- 172.21.15.57:0/3910952244 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4e680aae90 0x7f4e680b1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:03.570 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.563+0000 7f4e6d26b700 1 --2- 172.21.15.57:0/3910952244 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e6806c920 0x7f4e6816f770 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:03.570 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.563+0000 7f4e6d26b700 1 --2- 172.21.15.57:0/3910952244 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f4e54060550 0x7f4e54062a00 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:03.570 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.563+0000 7f4e6d26b700 1 --2- 172.21.15.57:0/3910952244 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4e6806bba0 0x7f4e68171240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:03.570 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.563+0000 7f4e6d26b700 1 -- 172.21.15.57:0/3910952244 >> 172.21.15.57:0/3910952244 conn(0x7f4e680c85e0 msgr2=0x7f4e680abdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:03.571 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.563+0000 7f4e6d26b700 1 -- 172.21.15.57:0/3910952244 shutdown_connections 2023-10-06T03:01:03.571 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.563+0000 7f4e6d26b700 1 -- 172.21.15.57:0/3910952244 wait complete. 2023-10-06T03:01:03.590 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-06T03:01:03.590 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:01:03.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.743+0000 7f7ae8ecd700 1 Processor -- start 2023-10-06T03:01:03.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.743+0000 7f7ae8ecd700 1 -- start start 2023-10-06T03:01:03.752 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.747+0000 7f7ae8ecd700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f7ae40b10c0 0x7f7ae415b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:03.752 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.747+0000 7f7ae8ecd700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7ae40b1490 0x7f7ae4154680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:03.752 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.747+0000 7f7ae8ecd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f7ae4154bc0 0x7f7ae41575d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:03.752 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.747+0000 7f7ae8ecd700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ae406bb10 con 0x7f7ae4154bc0 2023-10-06T03:01:03.752 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.747+0000 7f7ae8ecd700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ae40b18e0 con 0x7f7ae40b10c0 2023-10-06T03:01:03.752 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.747+0000 7f7ae8ecd700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae4155000 con 0x7f7ae40b1490 2023-10-06T03:01:03.755 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.747+0000 7f7ae2d9d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f7ae4154bc0 0x7f7ae41575d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:03.755 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.747+0000 7f7ae2d9d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f7ae4154bc0 0x7f7ae41575d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:45058/0 (socket says 172.21.15.57:45058) 2023-10-06T03:01:03.755 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.747+0000 7f7ae2d9d700 1 -- 172.21.15.57:0/3002290366 learned_addr learned my addr 172.21.15.57:0/3002290366 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:03.755 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.747+0000 7f7ae259c700 1 --2- 172.21.15.57:0/3002290366 >> v2:172.21.15.105:3300/0 conn(0x7f7ae40b10c0 0x7f7ae415b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:03.755 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.747+0000 7f7ad9d9b700 1 --2- 172.21.15.57:0/3002290366 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7ae40b1490 0x7f7ae4154680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:03.756 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.747+0000 7f7ae2d9d700 1 -- 172.21.15.57:0/3002290366 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7ae40b1490 msgr2=0x7f7ae4154680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:03.756 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.747+0000 7f7ae2d9d700 1 --2- 172.21.15.57:0/3002290366 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7ae40b1490 0x7f7ae4154680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:03.756 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.747+0000 7f7ae2d9d700 1 -- 172.21.15.57:0/3002290366 >> v2:172.21.15.105:3300/0 conn(0x7f7ae40b10c0 msgr2=0x7f7ae415b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:03.756 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.747+0000 7f7ae2d9d700 1 --2- 172.21.15.57:0/3002290366 >> v2:172.21.15.105:3300/0 conn(0x7f7ae40b10c0 0x7f7ae415b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:03.756 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.747+0000 7f7ae2d9d700 1 -- 172.21.15.57:0/3002290366 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ae4158530 con 0x7f7ae4154bc0 2023-10-06T03:01:03.756 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.747+0000 7f7ad9d9b700 1 --2- 172.21.15.57:0/3002290366 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7ae40b1490 0x7f7ae4154680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:03.756 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.747+0000 7f7ae259c700 1 --2- 172.21.15.57:0/3002290366 >> v2:172.21.15.105:3300/0 conn(0x7f7ae40b10c0 0x7f7ae415b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:01:03.757 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.747+0000 7f7ae2d9d700 1 --2- 172.21.15.57:0/3002290366 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ae4154bc0 0x7f7ae41575d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7ae4068120 tx=0x7f7adc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f7879eeff39507d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:03.757 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.747+0000 7f7ae1d9b700 1 -- 172.21.15.57:0/3002290366 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7adc00e070 con 0x7f7ae4154bc0 2023-10-06T03:01:03.757 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.751+0000 7f7ae1d9b700 1 -- 172.21.15.57:0/3002290366 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7adc00b990 con 0x7f7ae4154bc0 2023-10-06T03:01:03.757 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.751+0000 7f7ae1d9b700 1 -- 172.21.15.57:0/3002290366 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7adc0092e0 con 0x7f7ae4154bc0 2023-10-06T03:01:03.758 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.751+0000 7f7ae8ecd700 1 -- 172.21.15.57:0/3002290366 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ae4154bc0 msgr2=0x7f7ae41575d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:03.758 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.751+0000 7f7ae8ecd700 1 --2- 172.21.15.57:0/3002290366 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ae4154bc0 0x7f7ae41575d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7ae4068120 tx=0x7f7adc009840 comp rx=0 tx=0).stop 2023-10-06T03:01:03.758 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.751+0000 7f7ae8ecd700 1 -- 172.21.15.57:0/3002290366 shutdown_connections 2023-10-06T03:01:03.758 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.751+0000 7f7ae8ecd700 1 --2- 172.21.15.57:0/3002290366 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ae4154bc0 0x7f7ae41575d0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:03.759 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.751+0000 7f7ae8ecd700 1 --2- 172.21.15.57:0/3002290366 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7ae40b1490 0x7f7ae4154680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:03.759 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.751+0000 7f7ae8ecd700 1 --2- 172.21.15.57:0/3002290366 >> v2:172.21.15.105:3300/0 conn(0x7f7ae40b10c0 0x7f7ae415b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:03.759 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.751+0000 7f7ae8ecd700 1 -- 172.21.15.57:0/3002290366 >> 172.21.15.57:0/3002290366 conn(0x7f7ae40cbdd0 msgr2=0x7f7ae40cc1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:03.759 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.751+0000 7f7ae8ecd700 1 -- 172.21.15.57:0/3002290366 shutdown_connections 2023-10-06T03:01:03.759 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.751+0000 7f7ae8ecd700 1 -- 172.21.15.57:0/3002290366 wait complete. 2023-10-06T03:01:03.759 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.751+0000 7f7ae8ecd700 1 Processor -- start 2023-10-06T03:01:03.759 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.755+0000 7f7ae8ecd700 1 -- start start 2023-10-06T03:01:03.760 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.755+0000 7f7ae8ecd700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7ae40b10c0 0x7f7ae4169490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:03.760 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.755+0000 7f7ae8ecd700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7ae40b1490 0x7f7ae40b0880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:03.760 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.755+0000 7f7ae8ecd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ae4154bc0 0x7f7ae4152080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:03.761 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.755+0000 7f7ae8ecd700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae40b0dc0 con 0x7f7ae4154bc0 2023-10-06T03:01:03.761 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.755+0000 7f7ae8ecd700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae40aedb0 con 0x7f7ae40b1490 2023-10-06T03:01:03.761 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.755+0000 7f7ae8ecd700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae4169b20 con 0x7f7ae40b10c0 2023-10-06T03:01:03.762 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.755+0000 7f7ae2d9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ae4154bc0 0x7f7ae4152080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:03.762 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.755+0000 7f7ae2d9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ae4154bc0 0x7f7ae4152080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:45072/0 (socket says 172.21.15.57:45072) 2023-10-06T03:01:03.762 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.755+0000 7f7ae2d9d700 1 -- 172.21.15.57:0/123820185 learned_addr learned my addr 172.21.15.57:0/123820185 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:03.762 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.755+0000 7f7ad9d9b700 1 --2- 172.21.15.57:0/123820185 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7ae40b1490 0x7f7ae40b0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:03.762 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.755+0000 7f7ae259c700 1 --2- 172.21.15.57:0/123820185 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7ae40b10c0 0x7f7ae4169490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:03.762 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.755+0000 7f7ae2d9d700 1 -- 172.21.15.57:0/123820185 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7ae40b10c0 msgr2=0x7f7ae4169490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:03.763 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.755+0000 7f7ae2d9d700 1 --2- 172.21.15.57:0/123820185 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7ae40b10c0 0x7f7ae4169490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:03.763 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.755+0000 7f7ae2d9d700 1 -- 172.21.15.57:0/123820185 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7ae40b1490 msgr2=0x7f7ae40b0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:03.763 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.755+0000 7f7ae2d9d700 1 --2- 172.21.15.57:0/123820185 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7ae40b1490 0x7f7ae40b0880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:03.763 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.755+0000 7f7ae2d9d700 1 -- 172.21.15.57:0/123820185 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ad4009420 con 0x7f7ae4154bc0 2023-10-06T03:01:03.763 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.755+0000 7f7ae259c700 1 --2- 172.21.15.57:0/123820185 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7ae40b10c0 0x7f7ae4169490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:01:03.763 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.755+0000 7f7ae2d9d700 1 --2- 172.21.15.57:0/123820185 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ae4154bc0 0x7f7ae4152080 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7ae40b1ce0 tx=0x7f7adc018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:03.764 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.755+0000 7f7adaffd700 1 -- 172.21.15.57:0/123820185 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7adc008c30 con 0x7f7ae4154bc0 2023-10-06T03:01:03.764 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.755+0000 7f7adaffd700 1 -- 172.21.15.57:0/123820185 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7adc008db0 con 0x7f7ae4154bc0 2023-10-06T03:01:03.764 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.755+0000 7f7adaffd700 1 -- 172.21.15.57:0/123820185 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7adc0256b0 con 0x7f7ae4154bc0 2023-10-06T03:01:03.764 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.755+0000 7f7ae8ecd700 1 -- 172.21.15.57:0/123820185 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7adc009ae0 con 0x7f7ae4154bc0 2023-10-06T03:01:03.764 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.755+0000 7f7ae8ecd700 1 -- 172.21.15.57:0/123820185 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ae416a0e0 con 0x7f7ae4154bc0 2023-10-06T03:01:03.765 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.759+0000 7f7ae8ecd700 1 -- 172.21.15.57:0/123820185 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ae40aefb0 con 0x7f7ae4154bc0 2023-10-06T03:01:03.765 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.759+0000 7f7adaffd700 1 -- 172.21.15.57:0/123820185 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f7adc003040 con 0x7f7ae4154bc0 2023-10-06T03:01:03.768 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.763+0000 7f7adaffd700 1 --2- 172.21.15.57:0/123820185 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f7ac4060550 0x7f7ac4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:03.768 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.763+0000 7f7adaffd700 1 -- 172.21.15.57:0/123820185 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7adc07df90 con 0x7f7ae4154bc0 2023-10-06T03:01:03.769 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.763+0000 7f7ae259c700 1 --2- 172.21.15.57:0/123820185 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f7ac4060550 0x7f7ac4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:03.769 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.763+0000 7f7ae259c700 1 --2- 172.21.15.57:0/123820185 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f7ac4060550 0x7f7ac4062a00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7ad40093f0 tx=0x7f7ad4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:03.774 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.767+0000 7f7adaffd700 1 -- 172.21.15.57:0/123820185 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f7ae40aefb0 con 0x7f7ae4154bc0 2023-10-06T03:01:03.941 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.935+0000 7f7ae8ecd700 1 -- 172.21.15.57:0/123820185 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7ae40aef70 con 0x7f7ae4154bc0 2023-10-06T03:01:03.943 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.939+0000 7f7adaffd700 1 -- 172.21.15.57:0/123820185 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16866 (secure 0 0 0) 0x7f7adc04e430 con 0x7f7ae4154bc0 2023-10-06T03:01:03.944 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:01:03.944 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":23,"fsid":"eb56dc0f-9213-41cb-9aad-8ade6c802e98","created":"2023-10-06T03:00:30.806197+0000","modified":"2023-10-06T03:00:58.975366+0000","last_up_change":"2023-10-06T03:00:43.607454+0000","last_in_change":"2023-10-06T03:00:33.943513+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T03:00:44.360651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T03:00:50.466601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:00:55.472586+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T03:00:56.400884+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"58cf6c90-d704-43e0-b2db-dffe526d5e8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":33053},{"type":"v1","addr":"172.21.15.57:6801","nonce":33053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":33053},{"type":"v1","addr":"172.21.15.57:6803","nonce":33053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":33053},{"type":"v1","addr":"172.21.15.57:6807","nonce":33053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":33053},{"type":"v1","addr":"172.21.15.57:6805","nonce":33053}]},"public_addr":"172.21.15.57:6801/33053","cluster_addr":"172.21.15.57:6803/33053","heartbeat_back_addr":"172.21.15.57:6807/33053","heartbeat_front_addr":"172.21.15.57:6805/33053","state":["exists","up"]},{"osd":1,"uuid":"16afbe70-7f9e-4568-9c92-763e6e348119","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6809","nonce":33052},{"type":"v1","addr":"172.21.15.57:6810","nonce":33052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":33052},{"type":"v1","addr":"172.21.15.57:6813","nonce":33052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":33052},{"type":"v1","addr":"172.21.15.57:6822","nonce":33052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6815","nonce":33052},{"type":"v1","addr":"172.21.15.57:6818","nonce":33052}]},"public_addr":"172.21.15.57:6810/33052","cluster_addr":"172.21.15.57:6813/33052","heartbeat_back_addr":"172.21.15.57:6822/33052","heartbeat_front_addr":"172.21.15.57:6818/33052","state":["exists","up"]},{"osd":2,"uuid":"7255c62e-f92f-470f-a5ce-30228920d9f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":33058},{"type":"v1","addr":"172.21.15.57:6825","nonce":33058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":33058},{"type":"v1","addr":"172.21.15.57:6827","nonce":33058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":33058},{"type":"v1","addr":"172.21.15.57:6831","nonce":33058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":33058},{"type":"v1","addr":"172.21.15.57:6829","nonce":33058}]},"public_addr":"172.21.15.57:6825/33058","cluster_addr":"172.21.15.57:6827/33058","heartbeat_back_addr":"172.21.15.57:6831/33058","heartbeat_front_addr":"172.21.15.57:6829/33058","state":["exists","up"]},{"osd":3,"uuid":"152a236d-f799-4888-8544-74865508d5a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":33057},{"type":"v1","addr":"172.21.15.57:6811","nonce":33057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":33057},{"type":"v1","addr":"172.21.15.57:6816","nonce":33057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6821","nonce":33057},{"type":"v1","addr":"172.21.15.57:6823","nonce":33057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6817","nonce":33057},{"type":"v1","addr":"172.21.15.57:6819","nonce":33057}]},"public_addr":"172.21.15.57:6811/33057","cluster_addr":"172.21.15.57:6816/33057","heartbeat_back_addr":"172.21.15.57:6823/33057","heartbeat_front_addr":"172.21.15.57:6819/33057","state":["exists","up"]},{"osd":4,"uuid":"37db2a65-3566-41d0-9d60-e66c49e1e68e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":33368},{"type":"v1","addr":"172.21.15.105:6801","nonce":33368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":33368},{"type":"v1","addr":"172.21.15.105:6803","nonce":33368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":33368},{"type":"v1","addr":"172.21.15.105:6807","nonce":33368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":33368},{"type":"v1","addr":"172.21.15.105:6805","nonce":33368}]},"public_addr":"172.21.15.105:6801/33368","cluster_addr":"172.21.15.105:6803/33368","heartbeat_back_addr":"172.21.15.105:6807/33368","heartbeat_front_addr":"172.21.15.105:6805/33368","state":["exists","up"]},{"osd":5,"uuid":"35e77918-1bb4-42ca-9b20-f3c14eaa0c04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":33379},{"type":"v1","addr":"172.21.15.105:6818","nonce":33379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":33379},{"type":"v1","addr":"172.21.15.105:6823","nonce":33379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":33379},{"type":"v1","addr":"172.21.15.105:6831","nonce":33379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":33379},{"type":"v1","addr":"172.21.15.105:6827","nonce":33379}]},"public_addr":"172.21.15.105:6818/33379","cluster_addr":"172.21.15.105:6823/33379","heartbeat_back_addr":"172.21.15.105:6831/33379","heartbeat_front_addr":"172.21.15.105:6827/33379","state":["exists","up"]},{"osd":6,"uuid":"b4d9d510-7a45-4173-8287-c6c8d6547f2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":33369},{"type":"v1","addr":"172.21.15.105:6819","nonce":33369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":33369},{"type":"v1","addr":"172.21.15.105:6822","nonce":33369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":33369},{"type":"v1","addr":"172.21.15.105:6830","nonce":33369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":33369},{"type":"v1","addr":"172.21.15.105:6826","nonce":33369}]},"public_addr":"172.21.15.105:6819/33369","cluster_addr":"172.21.15.105:6822/33369","heartbeat_back_addr":"172.21.15.105:6830/33369","heartbeat_front_addr":"172.21.15.105:6826/33369","state":["exists","up"]},{"osd":7,"uuid":"74266fb0-cd84-463f-8bf0-092652a71dc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":33370},{"type":"v1","addr":"172.21.15.105:6809","nonce":33370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":33370},{"type":"v1","addr":"172.21.15.105:6811","nonce":33370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":33370},{"type":"v1","addr":"172.21.15.105:6815","nonce":33370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":33370},{"type":"v1","addr":"172.21.15.105:6813","nonce":33370}]},"public_addr":"172.21.15.105:6809/33370","cluster_addr":"172.21.15.105:6811/33370","heartbeat_back_addr":"172.21.15.105:6815/33370","heartbeat_front_addr":"172.21.15.105:6813/33370","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.596864+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.633851+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.636993+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.529681+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.608601+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.659752+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.661717+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.642221+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:01:03.946 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.939+0000 7f7ae8ecd700 1 -- 172.21.15.57:0/123820185 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f7ac4060550 msgr2=0x7f7ac4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:03.946 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.939+0000 7f7ae8ecd700 1 --2- 172.21.15.57:0/123820185 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f7ac4060550 0x7f7ac4062a00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7ad40093f0 tx=0x7f7ad4008040 comp rx=0 tx=0).stop 2023-10-06T03:01:03.946 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.939+0000 7f7ae8ecd700 1 -- 172.21.15.57:0/123820185 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ae4154bc0 msgr2=0x7f7ae4152080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:03.946 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.939+0000 7f7ae8ecd700 1 --2- 172.21.15.57:0/123820185 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ae4154bc0 0x7f7ae4152080 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7ae40b1ce0 tx=0x7f7adc018000 comp rx=0 tx=0).stop 2023-10-06T03:01:03.946 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.939+0000 7f7ae8ecd700 1 -- 172.21.15.57:0/123820185 shutdown_connections 2023-10-06T03:01:03.946 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.939+0000 7f7ae8ecd700 1 --2- 172.21.15.57:0/123820185 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ae4154bc0 0x7f7ae4152080 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:03.947 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.939+0000 7f7ae8ecd700 1 --2- 172.21.15.57:0/123820185 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7ae40b1490 0x7f7ae40b0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:03.947 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.939+0000 7f7ae8ecd700 1 --2- 172.21.15.57:0/123820185 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f7ac4060550 0x7f7ac4062a00 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:03.947 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.939+0000 7f7ae8ecd700 1 --2- 172.21.15.57:0/123820185 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7ae40b10c0 0x7f7ae4169490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:03.947 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.939+0000 7f7ae8ecd700 1 -- 172.21.15.57:0/123820185 >> 172.21.15.57:0/123820185 conn(0x7f7ae40cbdd0 msgr2=0x7f7ae41593b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:03.947 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.939+0000 7f7ae8ecd700 1 -- 172.21.15.57:0/123820185 shutdown_connections 2023-10-06T03:01:03.947 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:03.939+0000 7f7ae8ecd700 1 -- 172.21.15.57:0/123820185 wait complete. 2023-10-06T03:01:03.968 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-10-06T03:01:03.968 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-10-06T03:01:03.969 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-10-06T03:01:03.969 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-10-06T03:01:03.970 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-10-06T03:01:03.970 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-10-06T03:01:03.971 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-10-06T03:01:03.971 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-10-06T03:01:04.190 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.183+0000 7f2ca2af0700 1 Processor -- start 2023-10-06T03:01:04.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.183+0000 7f2ca2af0700 1 -- start start 2023-10-06T03:01:04.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.187+0000 7f2ca2af0700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2c9c154ca0 0x7f2c9c155070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:04.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.187+0000 7f2ca2af0700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2c9c159490 0x7f2c9c0c8390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:04.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.187+0000 7f2ca2af0700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c9c1555b0 con 0x7f2c9c0c88d0 2023-10-06T03:01:04.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.187+0000 7f2ca2af0700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c9c0c8d50 con 0x7f2c9c154ca0 2023-10-06T03:01:04.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.187+0000 7f2ca2af0700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c9c155850 con 0x7f2c9c159490 2023-10-06T03:01:04.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.187+0000 7f2ca088c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2c9c154ca0 0x7f2c9c155070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:04.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.187+0000 7f2ca088c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2c9c154ca0 0x7f2c9c155070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:45080/0 (socket says 172.21.15.57:45080) 2023-10-06T03:01:04.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.187+0000 7f2ca088c700 1 -- 172.21.15.57:0/1046680698 learned_addr learned my addr 172.21.15.57:0/1046680698 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:04.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.187+0000 7f2c9bfff700 1 --2- 172.21.15.57:0/1046680698 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2c9c159490 0x7f2c9c0c8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:04.196 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.187+0000 7f2ca088c700 1 -- 172.21.15.57:0/1046680698 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2c9c159490 msgr2=0x7f2c9c0c8390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:04.196 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.187+0000 7f2ca088c700 1 --2- 172.21.15.57:0/1046680698 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2c9c159490 0x7f2c9c0c8390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.196 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.187+0000 7f2ca088c700 1 -- 172.21.15.57:0/1046680698 >> v1:172.21.15.105:6789/0 conn(0x7f2c9c0c88d0 legacy=0x7f2c9c06a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:04.196 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.187+0000 7f2ca088c700 1 -- 172.21.15.57:0/1046680698 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c9c155b30 con 0x7f2c9c154ca0 2023-10-06T03:01:04.196 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.187+0000 7f2c9bfff700 1 --2- 172.21.15.57:0/1046680698 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2c9c159490 0x7f2c9c0c8390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:04.197 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.191+0000 7f2ca088c700 1 --2- 172.21.15.57:0/1046680698 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c9c154ca0 0x7f2c9c155070 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2c940105a0 tx=0x7f2c9400aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd371da2e61bc965 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:04.197 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.191+0000 7f2c9b7fe700 1 -- 172.21.15.57:0/1046680698 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c94008de0 con 0x7f2c9c154ca0 2023-10-06T03:01:04.197 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.191+0000 7f2c9b7fe700 1 -- 172.21.15.57:0/1046680698 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c94007ae0 con 0x7f2c9c154ca0 2023-10-06T03:01:04.197 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.191+0000 7f2c9b7fe700 1 -- 172.21.15.57:0/1046680698 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c94007ea0 con 0x7f2c9c154ca0 2023-10-06T03:01:04.197 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.191+0000 7f2ca2af0700 1 -- 172.21.15.57:0/1046680698 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c9c154ca0 msgr2=0x7f2c9c155070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:04.197 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.191+0000 7f2ca2af0700 1 --2- 172.21.15.57:0/1046680698 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c9c154ca0 0x7f2c9c155070 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2c940105a0 tx=0x7f2c9400aca0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.198 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.191+0000 7f2ca2af0700 1 -- 172.21.15.57:0/1046680698 shutdown_connections 2023-10-06T03:01:04.198 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.191+0000 7f2ca2af0700 1 --2- 172.21.15.57:0/1046680698 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2c9c159490 0x7f2c9c0c8390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.198 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.191+0000 7f2ca2af0700 1 --2- 172.21.15.57:0/1046680698 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c9c154ca0 0x7f2c9c155070 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.198 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.191+0000 7f2ca2af0700 1 -- 172.21.15.57:0/1046680698 >> 172.21.15.57:0/1046680698 conn(0x7f2c9c067050 msgr2=0x7f2c9c067450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:04.198 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.191+0000 7f2ca2af0700 1 -- 172.21.15.57:0/1046680698 shutdown_connections 2023-10-06T03:01:04.199 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.191+0000 7f2f818ae700 1 Processor -- start 2023-10-06T03:01:04.199 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.191+0000 7f2f818ae700 1 -- start start 2023-10-06T03:01:04.199 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.191+0000 7f2ca2af0700 1 -- 172.21.15.57:0/1046680698 wait complete. 2023-10-06T03:01:04.200 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.195+0000 7f8ee5545700 1 Processor -- start 2023-10-06T03:01:04.200 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.195+0000 7f2ca2af0700 1 Processor -- start 2023-10-06T03:01:04.200 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.195+0000 7f8ee5545700 1 -- start start 2023-10-06T03:01:04.201 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.195+0000 7f2f818ae700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2f7c0c7ed0 0x7f2f7c1610b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:04.201 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.195+0000 7f2f818ae700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2f7c15e530 0x7f2f7c067050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:04.201 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.195+0000 7f2f818ae700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f7c154980 con 0x7f2f7c067590 2023-10-06T03:01:04.201 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.195+0000 7f2f818ae700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f7c0c1550 con 0x7f2f7c15e530 2023-10-06T03:01:04.201 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.195+0000 7f2f818ae700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f7c0679a0 con 0x7f2f7c0c7ed0 2023-10-06T03:01:04.202 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.195+0000 7f2ca2af0700 1 -- start start 2023-10-06T03:01:04.202 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.195+0000 7f2f7a7fc700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2f7c15e530 0x7f2f7c067050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:04.202 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.195+0000 7f2f7a7fc700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2f7c15e530 0x7f2f7c067050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:45096/0 (socket says 172.21.15.57:45096) 2023-10-06T03:01:04.203 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.195+0000 7f2f7a7fc700 1 -- 172.21.15.57:0/1175390901 learned_addr learned my addr 172.21.15.57:0/1175390901 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:04.203 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.195+0000 7f2f7affd700 1 --2- 172.21.15.57:0/1175390901 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2f7c0c7ed0 0x7f2f7c1610b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:04.203 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.195+0000 7f2f7a7fc700 1 -- 172.21.15.57:0/1175390901 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2f7c0c7ed0 msgr2=0x7f2f7c1610b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:04.203 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.195+0000 7f2f7a7fc700 1 --2- 172.21.15.57:0/1175390901 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2f7c0c7ed0 0x7f2f7c1610b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.203 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.195+0000 7f2f7a7fc700 1 -- 172.21.15.57:0/1175390901 >> v1:172.21.15.57:6789/0 conn(0x7f2f7c067590 legacy=0x7f2f7c06a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:04.203 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.195+0000 7f2f7a7fc700 1 -- 172.21.15.57:0/1175390901 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f7c15e960 con 0x7f2f7c15e530 2023-10-06T03:01:04.203 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.199+0000 7f8ee5545700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f8ee00c08f0 0x7f8ee01583c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:04.204 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.199+0000 7f2f7a7fc700 1 --2- 172.21.15.57:0/1175390901 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2f7c15e530 0x7f2f7c067050 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2f700099b0 tx=0x7f2f70009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78a382238add8cc0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:04.204 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.199+0000 7f2ca2af0700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2c9c0c88d0 0x7f2c9c14bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:04.204 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.199+0000 7f2ca2af0700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c9c154ca0 0x7f2c9c0bf550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:04.205 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.199+0000 7f8ee5545700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ee0159c50 con 0x7f8ee00cc630 2023-10-06T03:01:04.205 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.199+0000 7f8ee5545700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ee006dae0 con 0x7f8ee0158900 2023-10-06T03:01:04.205 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.199+0000 7f8ee5545700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ee00c6440 con 0x7f8ee00c08f0 2023-10-06T03:01:04.205 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.199+0000 7fc2df945700 1 Processor -- start 2023-10-06T03:01:04.205 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.199+0000 7f2ca2af0700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c9c159490 0x7f2c9c0b09d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:04.206 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.199+0000 7f8ed67fc700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f8ee00c08f0 0x7f8ee01583c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:04.206 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.199+0000 7f8ed67fc700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f8ee00c08f0 0x7f8ee01583c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:45106/0 (socket says 172.21.15.57:45106) 2023-10-06T03:01:04.206 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.199+0000 7f8ed67fc700 1 -- 172.21.15.57:0/3999299999 learned_addr learned my addr 172.21.15.57:0/3999299999 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:04.207 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.199+0000 7f2ca2af0700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c9c0ca220 con 0x7f2c9c154ca0 2023-10-06T03:01:04.207 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.199+0000 7f2ca2af0700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c9c14c480 con 0x7f2c9c159490 2023-10-06T03:01:04.207 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.199+0000 7f2ca2af0700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c9c0c1f70 con 0x7f2c9c0c88d0 2023-10-06T03:01:04.207 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.199+0000 7f2ca088c700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2c9c0c88d0 0x7f2c9c14bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:04.207 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.199+0000 7f2ca088c700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2c9c0c88d0 0x7f2c9c14bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.57:42180/0 (socket says 172.21.15.57:42180) 2023-10-06T03:01:04.207 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.199+0000 7f2ca088c700 1 -- 172.21.15.57:0/3251248026 learned_addr learned my addr 172.21.15.57:0/3251248026 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:04.207 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.199+0000 7f120ac4c700 1 Processor -- start 2023-10-06T03:01:04.208 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.199+0000 7fc2df945700 1 -- start start 2023-10-06T03:01:04.208 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.199+0000 7f2c9bfff700 1 --2- 172.21.15.57:0/3251248026 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c9c154ca0 0x7f2c9c0bf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:04.208 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.199+0000 7f2ca108d700 1 --2- 172.21.15.57:0/3251248026 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c9c159490 0x7f2c9c0b09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:04.209 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.199+0000 7f120ac4c700 1 -- start start 2023-10-06T03:01:04.209 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.199+0000 7f8ed67fc700 1 -- 172.21.15.57:0/3999299999 >> v1:172.21.15.105:6789/0 conn(0x7f8ee0158900 legacy=0x7f8ee0159540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:04.209 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.199+0000 7f8ed67fc700 1 -- 172.21.15.57:0/3999299999 >> v1:172.21.15.57:6789/0 conn(0x7f8ee00cc630 legacy=0x7f8ee006d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:04.209 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.199+0000 7f8ed67fc700 1 -- 172.21.15.57:0/3999299999 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ee006ddc0 con 0x7f8ee00c08f0 2023-10-06T03:01:04.209 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.199+0000 7f8ede7fc700 1 -- 172.21.15.57:0/3999299999 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 655000145 0 0) 0x7f8ee006dae0 con 0x7f8ee0158900 2023-10-06T03:01:04.210 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.199+0000 7f2ca108d700 1 -- 172.21.15.57:0/3251248026 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2c9c0c88d0 msgr2=0x7f2c9c14bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:04.210 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.199+0000 7f2ca108d700 1 --2- 172.21.15.57:0/3251248026 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2c9c0c88d0 0x7f2c9c14bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.210 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.199+0000 7f2ca108d700 1 -- 172.21.15.57:0/3251248026 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c9c154ca0 msgr2=0x7f2c9c0bf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:04.210 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.199+0000 7f2ca108d700 1 --2- 172.21.15.57:0/3251248026 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c9c154ca0 0x7f2c9c0bf550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.210 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.199+0000 7f2ca108d700 1 -- 172.21.15.57:0/3251248026 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c940076e0 con 0x7f2c9c159490 2023-10-06T03:01:04.210 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.199+0000 7f2ca088c700 1 --2- 172.21.15.57:0/3251248026 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2c9c0c88d0 0x7f2c9c14bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:01:04.211 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.199+0000 7f2f79ffb700 1 -- 172.21.15.57:0/1175390901 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f70009ea0 con 0x7f2f7c15e530 2023-10-06T03:01:04.211 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.199+0000 7f2f79ffb700 1 -- 172.21.15.57:0/1175390901 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f7000b860 con 0x7f2f7c15e530 2023-10-06T03:01:04.211 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.199+0000 7f2f79ffb700 1 -- 172.21.15.57:0/1175390901 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f7000bc00 con 0x7f2f7c15e530 2023-10-06T03:01:04.211 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.199+0000 7f2f818ae700 1 -- 172.21.15.57:0/1175390901 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2f7c15e530 msgr2=0x7f2f7c067050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:04.211 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.199+0000 7f2f818ae700 1 --2- 172.21.15.57:0/1175390901 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2f7c15e530 0x7f2f7c067050 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2f700099b0 tx=0x7f2f70009250 comp rx=0 tx=0).stop 2023-10-06T03:01:04.211 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.199+0000 7f2ca108d700 1 --2- 172.21.15.57:0/3251248026 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c9c159490 0x7f2c9c0b09d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2c9000c4b0 tx=0x7f2c90007e60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:04.212 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.199+0000 7fc2df945700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc2d0038ff0 0x7fc2d00393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:04.212 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.199+0000 7f8ed67fc700 1 --2- 172.21.15.57:0/3999299999 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8ee00c08f0 0x7f8ee01583c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8ed00099b0 tx=0x7f8ed0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8c1791b48e88d18 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:04.212 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.199+0000 7f2c98ff9700 1 -- 172.21.15.57:0/3251248026 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c9000ce60 con 0x7f2c9c159490 2023-10-06T03:01:04.213 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.199+0000 7fc2df945700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc2d0036a40 0x7fc2d00e3c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:04.213 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.199+0000 7f2f818ae700 1 -- 172.21.15.57:0/1175390901 shutdown_connections 2023-10-06T03:01:04.213 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.199+0000 7f2f818ae700 1 --2- 172.21.15.57:0/1175390901 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2f7c15e530 0x7f2f7c067050 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.213 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.199+0000 7f2f818ae700 1 --2- 172.21.15.57:0/1175390901 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2f7c0c7ed0 0x7f2f7c1610b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.214 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.199+0000 7f2f818ae700 1 -- 172.21.15.57:0/1175390901 >> 172.21.15.57:0/1175390901 conn(0x7f2f7c0cbb50 msgr2=0x7f2f7c0cbf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:04.214 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.199+0000 7f2c98ff9700 1 -- 172.21.15.57:0/3251248026 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c90011590 con 0x7f2c9c159490 2023-10-06T03:01:04.214 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.199+0000 7f2c98ff9700 1 -- 172.21.15.57:0/3251248026 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c90011950 con 0x7f2c9c159490 2023-10-06T03:01:04.214 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.199+0000 7fc2df945700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2d00e44a0 con 0x7fc2d00e2fd0 2023-10-06T03:01:04.215 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.199+0000 7fc2df945700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2d00e4780 con 0x7fc2d0036a40 2023-10-06T03:01:04.215 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.203+0000 7f2ca2af0700 1 -- 172.21.15.57:0/3251248026 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c9c0c2250 con 0x7f2c9c159490 2023-10-06T03:01:04.215 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.203+0000 7f120ac4c700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f120406c920 0x7f12040aa7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:04.215 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.203+0000 7f2ca2af0700 1 -- 172.21.15.57:0/3251248026 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c9c0c1c40 con 0x7f2c9c159490 2023-10-06T03:01:04.216 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.203+0000 7fc2dd6e1700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc2d0038ff0 0x7fc2d00393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:04.216 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.203+0000 7fc2dd6e1700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc2d0038ff0 0x7fc2d00393c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.57:42194/0 (socket says 172.21.15.57:42194) 2023-10-06T03:01:04.216 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.203+0000 7fc2dd6e1700 1 -- 172.21.15.57:0/543485758 learned_addr learned my addr 172.21.15.57:0/543485758 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:04.216 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.203+0000 7f120ac4c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f12040aae90 0x7f120406bba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:04.217 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.203+0000 7f120ac4c700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f120406de50 con 0x7f120406ccf0 2023-10-06T03:01:04.217 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.203+0000 7f120ac4c700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f120406e130 con 0x7f12040aae90 2023-10-06T03:01:04.217 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.203+0000 7f120ac4c700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f120406b3a0 con 0x7f120406c920 2023-10-06T03:01:04.217 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.203+0000 7fc2df945700 1 -- 172.21.15.57:0/543485758 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d00e4a60 con 0x7fc2d0038ff0 2023-10-06T03:01:04.217 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.203+0000 7f8ede7fc700 1 -- 172.21.15.57:0/3999299999 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ed000b8f0 con 0x7f8ee00c08f0 2023-10-06T03:01:04.218 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.203+0000 7f8ede7fc700 1 -- 172.21.15.57:0/3999299999 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ed000ba50 con 0x7f8ee00c08f0 2023-10-06T03:01:04.218 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.203+0000 7f8ede7fc700 1 -- 172.21.15.57:0/3999299999 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ed000bdf0 con 0x7f8ee00c08f0 2023-10-06T03:01:04.218 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.203+0000 7f8ee5545700 1 -- 172.21.15.57:0/3999299999 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8ee00c08f0 msgr2=0x7f8ee01583c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:04.218 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.203+0000 7f8ee5545700 1 --2- 172.21.15.57:0/3999299999 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8ee00c08f0 0x7f8ee01583c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8ed00099b0 tx=0x7f8ed0009250 comp rx=0 tx=0).stop 2023-10-06T03:01:04.218 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.203+0000 7f1209c4a700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f120406c920 0x7f12040aa7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:04.218 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.203+0000 7f120a44b700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f120406ccf0 0x7f12040c64c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:43334/0 (socket says 172.21.15.57:43334) 2023-10-06T03:01:04.218 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.203+0000 7f120a44b700 1 -- 172.21.15.57:0/2756431481 learned_addr learned my addr 172.21.15.57:0/2756431481 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:01:04.219 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.203+0000 7f1209449700 1 --2- 172.21.15.57:0/2756431481 >> v2:172.21.15.57:3300/0 conn(0x7f12040aae90 0x7f120406bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:04.219 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.203+0000 7f1209c4a700 1 -- 172.21.15.57:0/2756431481 >> v2:172.21.15.57:3300/0 conn(0x7f12040aae90 msgr2=0x7f120406bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:04.219 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.203+0000 7f1209c4a700 1 --2- 172.21.15.57:0/2756431481 >> v2:172.21.15.57:3300/0 conn(0x7f12040aae90 0x7f120406bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.219 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.203+0000 7f1209c4a700 1 -- 172.21.15.57:0/2756431481 >> v1:172.21.15.57:6789/0 conn(0x7f120406ccf0 legacy=0x7f12040c64c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:04.219 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.203+0000 7f1208c48700 1 -- 172.21.15.57:0/2756431481 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 103785419 0 0) 0x7f120406de50 con 0x7f120406ccf0 2023-10-06T03:01:04.219 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.203+0000 7f1209c4a700 1 -- 172.21.15.57:0/2756431481 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f120406b680 con 0x7f120406c920 2023-10-06T03:01:04.219 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.203+0000 7f2f818ae700 1 -- 172.21.15.57:0/1175390901 shutdown_connections 2023-10-06T03:01:04.220 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.203+0000 7fc2dcee0700 1 --2- 172.21.15.57:0/543485758 >> v2:172.21.15.57:3300/0 conn(0x7fc2d0036a40 0x7fc2d00e3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:04.220 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.203+0000 7fc2cffff700 1 -- 172.21.15.57:0/543485758 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2636253104 0 0) 0x7fc2d00e44a0 con 0x7fc2d00e2fd0 2023-10-06T03:01:04.220 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.203+0000 7fc2cffff700 1 -- 172.21.15.57:0/543485758 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2c4003570 con 0x7fc2d00e2fd0 2023-10-06T03:01:04.220 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.203+0000 7fc2dd6e1700 1 -- 172.21.15.57:0/543485758 >> v2:172.21.15.57:3300/0 conn(0x7fc2d0036a40 msgr2=0x7fc2d00e3c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:04.220 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.203+0000 7fc2dd6e1700 1 --2- 172.21.15.57:0/543485758 >> v2:172.21.15.57:3300/0 conn(0x7fc2d0036a40 0x7fc2d00e3c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.220 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.203+0000 7fc2dd6e1700 1 -- 172.21.15.57:0/543485758 >> v1:172.21.15.105:6789/0 conn(0x7fc2d00e2fd0 legacy=0x7fc2d00e3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:04.220 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.203+0000 7fc2dd6e1700 1 -- 172.21.15.57:0/543485758 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2d0051ca0 con 0x7fc2d0038ff0 2023-10-06T03:01:04.220 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.203+0000 7fc2dd6e1700 1 --2- 172.21.15.57:0/543485758 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc2d0038ff0 0x7fc2d00393c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc2d40099b0 tx=0x7fc2d4009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2087c43de0aad6f1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:04.221 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.203+0000 7f8ee5545700 1 -- 172.21.15.57:0/3999299999 shutdown_connections 2023-10-06T03:01:04.221 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.203+0000 7f8ee5545700 1 --2- 172.21.15.57:0/3999299999 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8ee00c08f0 0x7f8ee01583c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.221 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.203+0000 7f8ee5545700 1 -- 172.21.15.57:0/3999299999 >> 172.21.15.57:0/3999299999 conn(0x7f8ee00cbb50 msgr2=0x7f8ee00cbf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:04.221 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.203+0000 7f1209c4a700 1 --2- 172.21.15.57:0/2756431481 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f120406c920 0x7f12040aa7e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f11fc0098e0 tx=0x7f11fc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f58477dd41a4cc81 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:04.222 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.203+0000 7fc2cffff700 1 -- 172.21.15.57:0/543485758 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2d4009ea0 con 0x7fc2d0038ff0 2023-10-06T03:01:04.222 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.203+0000 7fc2cffff700 1 -- 172.21.15.57:0/543485758 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2d400b860 con 0x7fc2d0038ff0 2023-10-06T03:01:04.222 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.203+0000 7fc2cffff700 1 -- 172.21.15.57:0/543485758 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2d400bc00 con 0x7fc2d0038ff0 2023-10-06T03:01:04.223 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.203+0000 7f8ee5545700 1 -- 172.21.15.57:0/3999299999 shutdown_connections 2023-10-06T03:01:04.223 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.203+0000 7f8ee5545700 1 -- 172.21.15.57:0/3999299999 wait complete. 2023-10-06T03:01:04.226 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.203+0000 7f2ca2af0700 1 -- 172.21.15.57:0/3251248026 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2c9c069300 con 0x7f2c9c159490 2023-10-06T03:01:04.226 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.203+0000 7f2f818ae700 1 -- 172.21.15.57:0/1175390901 wait complete. 2023-10-06T03:01:04.226 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.203+0000 7f2f818ae700 1 Processor -- start 2023-10-06T03:01:04.227 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.207+0000 7f2c98ff9700 1 -- 172.21.15.57:0/3251248026 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f2c90011cc0 con 0x7f2c9c159490 2023-10-06T03:01:04.227 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.207+0000 7f1208c48700 1 -- 172.21.15.57:0/2756431481 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11fc00b640 con 0x7f120406c920 2023-10-06T03:01:04.227 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.207+0000 7f1208c48700 1 -- 172.21.15.57:0/2756431481 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11fc00b7a0 con 0x7f120406c920 2023-10-06T03:01:04.227 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.207+0000 7f1208c48700 1 -- 172.21.15.57:0/2756431481 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11fc00bb40 con 0x7f120406c920 2023-10-06T03:01:04.228 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.207+0000 7f2f818ae700 1 -- start start 2023-10-06T03:01:04.228 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.207+0000 7fc2df945700 1 -- 172.21.15.57:0/543485758 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc2d0038ff0 msgr2=0x7fc2d00393c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:04.228 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.207+0000 7fc2df945700 1 --2- 172.21.15.57:0/543485758 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc2d0038ff0 0x7fc2d00393c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc2d40099b0 tx=0x7fc2d4009250 comp rx=0 tx=0).stop 2023-10-06T03:01:04.228 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.207+0000 7f2c98ff9700 1 --2- 172.21.15.57:0/3251248026 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f2c80060670 0x7f2c80062b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:04.229 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.207+0000 7f2f818ae700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2f7c067590 0x7f2f7c176070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:04.229 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.207+0000 7f2c98ff9700 1 -- 172.21.15.57:0/3251248026 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2c9007bc40 con 0x7f2c9c159490 2023-10-06T03:01:04.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.207+0000 7f120ac4c700 1 -- 172.21.15.57:0/2756431481 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f120406c920 msgr2=0x7f12040aa7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:04.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.207+0000 7f120ac4c700 1 --2- 172.21.15.57:0/2756431481 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f120406c920 0x7f12040aa7e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f11fc0098e0 tx=0x7f11fc0091a0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.207+0000 7f120ac4c700 1 -- 172.21.15.57:0/2756431481 shutdown_connections 2023-10-06T03:01:04.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.207+0000 7f120ac4c700 1 --2- 172.21.15.57:0/2756431481 >> v2:172.21.15.57:3300/0 conn(0x7f12040aae90 0x7f120406bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.207+0000 7f120ac4c700 1 --2- 172.21.15.57:0/2756431481 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f120406c920 0x7f12040aa7e0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.207+0000 7f120ac4c700 1 -- 172.21.15.57:0/2756431481 >> 172.21.15.57:0/2756431481 conn(0x7f12040c85e0 msgr2=0x7f12040c89e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:04.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.207+0000 7f2c98ff9700 1 --2- 172.21.15.57:0/3251248026 >> [v2:172.21.15.57:6800/33053,v1:172.21.15.57:6801/33053] conn(0x7f2c80068f20 0x7f2c8006b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:04.231 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.207+0000 7f2c98ff9700 1 -- 172.21.15.57:0/3251248026 --> [v2:172.21.15.57:6800/33053,v1:172.21.15.57:6801/33053] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2c8006b9e0 con 0x7f2c80068f20 2023-10-06T03:01:04.231 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.207+0000 7f2c98ff9700 1 -- 172.21.15.57:0/3251248026 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2c90080220 con 0x7f2c9c159490 2023-10-06T03:01:04.231 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.207+0000 7f2ca088c700 1 --2- 172.21.15.57:0/3251248026 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f2c80060670 0x7f2c80062b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:04.231 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.207+0000 7f8ee5545700 1 Processor -- start 2023-10-06T03:01:04.231 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.207+0000 7f2f818ae700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2f7c0c7ed0 0x7f2f7c155520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:04.232 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.207+0000 7f120ac4c700 1 -- 172.21.15.57:0/2756431481 shutdown_connections 2023-10-06T03:01:04.232 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.207+0000 7f2f7affd700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2f7c067590 0x7f2f7c176070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:04.232 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.207+0000 7f2f7affd700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2f7c067590 0x7f2f7c176070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.57:33790/0 (socket says 172.21.15.57:33790) 2023-10-06T03:01:04.233 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.207+0000 7f2f7affd700 1 -- 172.21.15.57:0/308286016 learned_addr learned my addr 172.21.15.57:0/308286016 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:04.233 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.207+0000 7f2f818ae700 1 --2- 172.21.15.57:0/308286016 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2f7c15e530 0x7f2f7c152e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:04.233 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.207+0000 7fc2df945700 1 -- 172.21.15.57:0/543485758 shutdown_connections 2023-10-06T03:01:04.233 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.207+0000 7fc2df945700 1 --2- 172.21.15.57:0/543485758 >> v2:172.21.15.57:3300/0 conn(0x7fc2d0036a40 0x7fc2d00e3c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.233 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.207+0000 7fc2df945700 1 --2- 172.21.15.57:0/543485758 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc2d0038ff0 0x7fc2d00393c0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.234 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.207+0000 7fc2df945700 1 -- 172.21.15.57:0/543485758 >> 172.21.15.57:0/543485758 conn(0x7fc2d0009e80 msgr2=0x7fc2d000a250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:04.234 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.207+0000 7f2c9bfff700 1 --2- 172.21.15.57:0/3251248026 >> [v2:172.21.15.57:6800/33053,v1:172.21.15.57:6801/33053] conn(0x7f2c80068f20 0x7f2c8006b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:04.235 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.207+0000 7f2f7a7fc700 1 --2- 172.21.15.57:0/308286016 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2f7c0c7ed0 0x7f2f7c155520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:04.235 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.207+0000 7f2f7b7fe700 1 --2- 172.21.15.57:0/308286016 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2f7c15e530 0x7f2f7c152e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:04.235 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.207+0000 7f2ca088c700 1 --2- 172.21.15.57:0/3251248026 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f2c80060670 0x7f2c80062b20 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2c94007ab0 tx=0x7f2c94019000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:04.235 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.207+0000 7f2c9bfff700 1 --2- 172.21.15.57:0/3251248026 >> [v2:172.21.15.57:6800/33053,v1:172.21.15.57:6801/33053] conn(0x7f2c80068f20 0x7f2c8006b330 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:04.236 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.207+0000 7f2f818ae700 1 -- 172.21.15.57:0/308286016 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f7c155f20 con 0x7f2f7c15e530 2023-10-06T03:01:04.236 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.207+0000 7f2f818ae700 1 -- 172.21.15.57:0/308286016 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f7c156170 con 0x7f2f7c067590 2023-10-06T03:01:04.236 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.207+0000 7f2f818ae700 1 -- 172.21.15.57:0/308286016 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f7c156450 con 0x7f2f7c0c7ed0 2023-10-06T03:01:04.236 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.207+0000 7fa653945700 1 Processor -- start 2023-10-06T03:01:04.237 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.207+0000 7f8ee5545700 1 -- start start 2023-10-06T03:01:04.237 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.211+0000 7fa653945700 1 -- start start 2023-10-06T03:01:04.238 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.211+0000 7f8ee5545700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8ee00c08f0 0x7f8ee01766a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:04.238 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.211+0000 7f8ee5545700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8ee00cc630 0x7f8ee00c5450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:04.239 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.211+0000 7f2f7a7fc700 1 -- 172.21.15.57:0/308286016 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2f7c067590 msgr2=0x7f2f7c176070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:04.239 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.211+0000 7f2f7a7fc700 1 --2- 172.21.15.57:0/308286016 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2f7c067590 0x7f2f7c176070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.239 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.211+0000 7f2f7a7fc700 1 -- 172.21.15.57:0/308286016 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2f7c15e530 msgr2=0x7f2f7c152e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:04.239 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.211+0000 7f2f7a7fc700 1 --2- 172.21.15.57:0/308286016 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2f7c15e530 0x7f2f7c152e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.239 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.211+0000 7f2f7a7fc700 1 -- 172.21.15.57:0/308286016 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f700094f0 con 0x7f2f7c0c7ed0 2023-10-06T03:01:04.239 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.211+0000 7fc2df945700 1 -- 172.21.15.57:0/543485758 shutdown_connections 2023-10-06T03:01:04.240 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.211+0000 7f2f7affd700 1 --2- 172.21.15.57:0/308286016 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2f7c067590 0x7f2f7c176070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:01:04.240 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.211+0000 7f2f7b7fe700 1 --2- 172.21.15.57:0/308286016 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2f7c15e530 0x7f2f7c152e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:01:04.240 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.211+0000 7fc2df945700 1 -- 172.21.15.57:0/543485758 wait complete. 2023-10-06T03:01:04.241 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.207+0000 7f120ac4c700 1 -- 172.21.15.57:0/2756431481 wait complete. 2023-10-06T03:01:04.241 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.211+0000 7f120ac4c700 1 Processor -- start 2023-10-06T03:01:04.241 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.211+0000 7f2f7a7fc700 1 --2- 172.21.15.57:0/308286016 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2f7c0c7ed0 0x7f2f7c155520 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c06b9e0 tx=0x7f2f70017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:04.241 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.211+0000 7f2c98ff9700 1 -- 172.21.15.57:0/3251248026 <== osd.0 v2:172.21.15.57:6800/33053 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f2c8006b9e0 con 0x7f2c80068f20 2023-10-06T03:01:04.242 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.211+0000 7fa76f59e700 1 Processor -- start 2023-10-06T03:01:04.242 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.211+0000 7f2f62ffd700 1 -- 172.21.15.57:0/308286016 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f7000bbe0 con 0x7f2f7c0c7ed0 2023-10-06T03:01:04.242 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.211+0000 7f2f62ffd700 1 -- 172.21.15.57:0/308286016 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f70025440 con 0x7f2f7c0c7ed0 2023-10-06T03:01:04.242 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.211+0000 7f2f62ffd700 1 -- 172.21.15.57:0/308286016 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f700257c0 con 0x7f2f7c0c7ed0 2023-10-06T03:01:04.243 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.211+0000 7fa7e7fff700 1 Processor -- start 2023-10-06T03:01:04.243 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.211+0000 7fa76f59e700 1 -- start start 2023-10-06T03:01:04.243 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.211+0000 7f2f818ae700 1 -- 172.21.15.57:0/308286016 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f7c156730 con 0x7f2f7c0c7ed0 2023-10-06T03:01:04.243 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.211+0000 7f2f818ae700 1 -- 172.21.15.57:0/308286016 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f7c1765b0 con 0x7f2f7c0c7ed0 2023-10-06T03:01:04.244 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.211+0000 7fa7e7fff700 1 -- start start 2023-10-06T03:01:04.244 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.211+0000 7fa653945700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fa644038ff0 0x7fa6440393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:04.244 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.211+0000 7f120ac4c700 1 -- start start 2023-10-06T03:01:04.244 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.211+0000 7f120ac4c700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f120406c920 0x7f120416d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:04.245 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.211+0000 7fa653945700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa6440e2fd0 0x7fa6440e33f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:04.245 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.211+0000 7f2f818ae700 1 -- 172.21.15.57:0/308286016 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2f7c04be40 con 0x7f2f7c0c7ed0 2023-10-06T03:01:04.245 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.211+0000 7fc2df945700 1 Processor -- start 2023-10-06T03:01:04.246 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.211+0000 7fa653945700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6440e44a0 con 0x7fa644036a40 2023-10-06T03:01:04.246 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.211+0000 7f8edeffd700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8ee00c08f0 0x7f8ee01766a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:04.246 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.211+0000 7f8edeffd700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8ee00c08f0 0x7f8ee01766a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.57:33806/0 (socket says 172.21.15.57:33806) 2023-10-06T03:01:04.246 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.215+0000 7f1209c4a700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f120406c920 0x7f120416d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:04.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.215+0000 7f1209c4a700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f120406c920 0x7f120416d500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.57:42222/0 (socket says 172.21.15.57:42222) 2023-10-06T03:01:04.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.215+0000 7fc2df945700 1 -- start start 2023-10-06T03:01:04.248 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.215+0000 7f1209c4a700 1 -- 172.21.15.57:0/943826298 learned_addr learned my addr 172.21.15.57:0/943826298 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:04.248 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.215+0000 7fa76f59e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa7700c6a40 0x7fa7700c6e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:04.248 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.215+0000 7fa76f59e700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fa7700cb6b0 0x7fa77006b040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:04.248 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.215+0000 7f120ac4c700 1 --2- 172.21.15.57:0/943826298 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f120406ccf0 0x7f120415cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:04.249 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.215+0000 7f8ed67fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8ee00cc630 0x7f8ee00c5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:04.249 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.215+0000 7f8ed67fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8ee00cc630 0x7f8ee00c5450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:45154/0 (socket says 172.21.15.57:45154) 2023-10-06T03:01:04.249 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.215+0000 7f120ac4c700 1 --2- 172.21.15.57:0/943826298 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f12040aae90 0x7f12040b09f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:04.250 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.215+0000 7fa76f59e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa77006dc40 0x7fa77006c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:04.250 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.215+0000 7fa76f59e700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa77006b930 con 0x7fa77006dc40 2023-10-06T03:01:04.250 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.215+0000 7fa76f59e700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa77006bc10 con 0x7fa7700cb6b0 2023-10-06T03:01:04.250 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.215+0000 7fa76f59e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa77006bef0 con 0x7fa7700c6a40 2023-10-06T03:01:04.250 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.215+0000 7f8edeffd700 1 -- 172.21.15.57:0/4219614746 learned_addr learned my addr 172.21.15.57:0/4219614746 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:04.251 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.215+0000 7f1209449700 1 --2- 172.21.15.57:0/943826298 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f120406ccf0 0x7f120415cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:04.251 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.215+0000 7f8ee5545700 1 --2- 172.21.15.57:0/4219614746 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8ee0158900 0x7f8ee00c5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:04.251 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.215+0000 7f120a44b700 1 --2- 172.21.15.57:0/943826298 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f12040aae90 0x7f12040b09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:04.251 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.215+0000 7f120ac4c700 1 -- 172.21.15.57:0/943826298 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f120416da40 con 0x7f12040aae90 2023-10-06T03:01:04.252 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.215+0000 7fa76dd9b700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fa7700cb6b0 0x7fa77006b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:04.252 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.215+0000 7fa76dd9b700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fa7700cb6b0 0x7fa77006b040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.57:33830/0 (socket says 172.21.15.57:33830) 2023-10-06T03:01:04.252 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.215+0000 7fa76dd9b700 1 -- 172.21.15.57:0/2537468952 learned_addr learned my addr 172.21.15.57:0/2537468952 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:04.252 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.215+0000 7fa6516e1700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fa644038ff0 0x7fa6440393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:04.253 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.215+0000 7fa6516e1700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fa644038ff0 0x7fa6440393c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.57:33818/0 (socket says 172.21.15.57:33818) 2023-10-06T03:01:04.253 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.215+0000 7fa6516e1700 1 -- 172.21.15.57:0/3907183064 learned_addr learned my addr 172.21.15.57:0/3907183064 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:04.253 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.215+0000 7fa651ee2700 1 --2- 172.21.15.57:0/3907183064 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa6440e2fd0 0x7fa6440e33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:04.253 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.215+0000 7f120ac4c700 1 -- 172.21.15.57:0/943826298 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f120415d310 con 0x7f120406ccf0 2023-10-06T03:01:04.253 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.215+0000 7fa7e6ffd700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fa7e8158b90 0x7fa7e8158f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:43344/0 (socket says 172.21.15.57:43344) 2023-10-06T03:01:04.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.215+0000 7fa653945700 1 -- 172.21.15.57:0/3907183064 --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6440e4780 con 0x7fa644038ff0 2023-10-06T03:01:04.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.215+0000 7fa653945700 1 -- 172.21.15.57:0/3907183064 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6440e4a60 con 0x7fa6440e2fd0 2023-10-06T03:01:04.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.215+0000 7fa7e6ffd700 1 -- 172.21.15.57:0/3649494973 learned_addr learned my addr 172.21.15.57:0/3649494973 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:01:04.255 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.215+0000 7f8ee5545700 1 -- 172.21.15.57:0/4219614746 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee00c3d10 con 0x7f8ee00cc630 2023-10-06T03:01:04.255 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.215+0000 7f120ac4c700 1 -- 172.21.15.57:0/943826298 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12040c0cd0 con 0x7f120406c920 2023-10-06T03:01:04.255 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.215+0000 7fc2df945700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc2d0036a40 0x7fc2d004f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:04.256 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.215+0000 7fa7e7fff700 1 --2- 172.21.15.57:0/3649494973 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa7e80cb580 0x7fa7e80cc910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:04.256 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.215+0000 7fa76ed9d700 1 --2- 172.21.15.57:0/2537468952 >> v2:172.21.15.57:3300/0 conn(0x7fa77006dc40 0x7fa77006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:04.256 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.215+0000 7fa643fff700 1 -- 172.21.15.57:0/3907183064 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1024469116 0 0) 0x7fa6440e44a0 con 0x7fa644036a40 2023-10-06T03:01:04.256 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.215+0000 7fa643fff700 1 -- 172.21.15.57:0/3907183064 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa638003570 con 0x7fa644036a40 2023-10-06T03:01:04.257 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.215+0000 7f8edf7fe700 1 --2- 172.21.15.57:0/4219614746 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8ee0158900 0x7f8ee00c5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:04.257 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.215+0000 7fa7e7fff700 1 --2- 172.21.15.57:0/3649494973 >> v2:172.21.15.57:3300/0 conn(0x7fa7e80cce50 0x7fa7e806ce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:04.257 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.215+0000 7f8ee5545700 1 -- 172.21.15.57:0/4219614746 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee00c3ff0 con 0x7f8ee00c08f0 2023-10-06T03:01:04.257 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.215+0000 7f8ee5545700 1 -- 172.21.15.57:0/4219614746 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee00c42d0 con 0x7f8ee0158900 2023-10-06T03:01:04.258 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.215+0000 7fc2dd6e1700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc2d0036a40 0x7fc2d004f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:04.258 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.215+0000 7fa76dd9b700 1 -- 172.21.15.57:0/2537468952 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa7700c6a40 msgr2=0x7fa7700c6e10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-06T03:01:04.258 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.215+0000 7fa76dd9b700 1 --2- 172.21.15.57:0/2537468952 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa7700c6a40 0x7fa7700c6e10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.258 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.215+0000 7fa76dd9b700 1 -- 172.21.15.57:0/2537468952 >> v2:172.21.15.57:3300/0 conn(0x7fa77006dc40 msgr2=0x7fa77006c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:04.258 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.215+0000 7fa76dd9b700 1 --2- 172.21.15.57:0/2537468952 >> v2:172.21.15.57:3300/0 conn(0x7fa77006dc40 0x7fa77006c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.258 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.215+0000 7fa76dd9b700 1 -- 172.21.15.57:0/2537468952 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7700ac060 con 0x7fa7700cb6b0 2023-10-06T03:01:04.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.215+0000 7fc2df945700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc2d0038ff0 0x7fc2d004de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:04.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.215+0000 7fa7e7fff700 1 -- 172.21.15.57:0/3649494973 --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7e80cb0f0 con 0x7fa7e8158b90 2023-10-06T03:01:04.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.215+0000 7fa7e7fff700 1 -- 172.21.15.57:0/3649494973 --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7e80cd2d0 con 0x7fa7e80cce50 2023-10-06T03:01:04.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.215+0000 7fa7e67fc700 1 --2- 172.21.15.57:0/3649494973 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa7e80cb580 0x7fa7e80cc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:04.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.215+0000 7fa7e7fff700 1 -- 172.21.15.57:0/3649494973 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e80ca830 con 0x7fa7e80cb580 2023-10-06T03:01:04.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.215+0000 7fa6516e1700 1 -- 172.21.15.57:0/3907183064 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa6440e2fd0 msgr2=0x7fa6440e33f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:04.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.215+0000 7fa6516e1700 1 --2- 172.21.15.57:0/3907183064 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa6440e2fd0 0x7fa6440e33f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.261 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.215+0000 7fa6516e1700 1 -- 172.21.15.57:0/3907183064 >> v1:172.21.15.105:6789/0 conn(0x7fa644036a40 legacy=0x7fa6440e3c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:04.261 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.215+0000 7fa6516e1700 1 -- 172.21.15.57:0/3907183064 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa644051ca0 con 0x7fa644038ff0 2023-10-06T03:01:04.261 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.215+0000 7fa76dd9b700 1 --2- 172.21.15.57:0/2537468952 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa7700cb6b0 0x7fa77006b040 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa770069f20 tx=0x7fa760009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3136c108be9c1d62 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:04.261 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.215+0000 7f2f62ffd700 1 -- 172.21.15.57:0/308286016 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f2f70025bb0 con 0x7f2f7c0c7ed0 2023-10-06T03:01:04.262 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.215+0000 7fc2dd6e1700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc2d0036a40 0x7fc2d004f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.57:42254/0 (socket says 172.21.15.57:42254) 2023-10-06T03:01:04.262 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.215+0000 7fc2dd6e1700 1 -- 172.21.15.57:0/3577525915 learned_addr learned my addr 172.21.15.57:0/3577525915 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:04.262 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.215+0000 7fc2df945700 1 --2- 172.21.15.57:0/3577525915 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc2d00e2fd0 0x7fc2d003ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:04.262 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.215+0000 7fc2df945700 1 -- 172.21.15.57:0/3577525915 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d004e800 con 0x7fc2d0038ff0 2023-10-06T03:01:04.262 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.215+0000 7fc2df945700 1 -- 172.21.15.57:0/3577525915 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d004ea50 con 0x7fc2d00e2fd0 2023-10-06T03:01:04.262 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.215+0000 7fc2df945700 1 -- 172.21.15.57:0/3577525915 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d004ed30 con 0x7fc2d0036a40 2023-10-06T03:01:04.263 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.215+0000 7f1209449700 1 -- 172.21.15.57:0/943826298 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f120406c920 msgr2=0x7f120416d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:04.263 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.215+0000 7f1209449700 1 --2- 172.21.15.57:0/943826298 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f120406c920 0x7f120416d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.263 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.215+0000 7f1209449700 1 -- 172.21.15.57:0/943826298 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f12040aae90 msgr2=0x7f12040b09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:04.263 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.215+0000 7f1209449700 1 --2- 172.21.15.57:0/943826298 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f12040aae90 0x7f12040b09f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.263 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.215+0000 7f1209449700 1 -- 172.21.15.57:0/943826298 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11fc009420 con 0x7f120406ccf0 2023-10-06T03:01:04.264 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.215+0000 7f2f62ffd700 1 --2- 172.21.15.57:0/308286016 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f2f680605d0 0x7f2f68062a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:04.264 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.215+0000 7f2f62ffd700 1 -- 172.21.15.57:0/308286016 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2f7007e830 con 0x7f2f7c0c7ed0 2023-10-06T03:01:04.264 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.215+0000 7f2f62ffd700 1 --2- 172.21.15.57:0/308286016 >> [v2:172.21.15.57:6808/33057,v1:172.21.15.57:6811/33057] conn(0x7f2f68068e80 0x7f2f6806b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:04.264 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.215+0000 7f2f62ffd700 1 -- 172.21.15.57:0/308286016 --> [v2:172.21.15.57:6808/33057,v1:172.21.15.57:6811/33057] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2f6806b940 con 0x7f2f68068e80 2023-10-06T03:01:04.264 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.215+0000 7f2f62ffd700 1 -- 172.21.15.57:0/308286016 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2f7007eb60 con 0x7f2f7c0c7ed0 2023-10-06T03:01:04.264 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.215+0000 7f2f7affd700 1 --2- 172.21.15.57:0/308286016 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f2f680605d0 0x7f2f68062a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:04.264 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.215+0000 7fa76d59a700 1 -- 172.21.15.57:0/2537468952 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa76000b860 con 0x7fa7700cb6b0 2023-10-06T03:01:04.265 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.219+0000 7fc2ddee2700 1 --2- 172.21.15.57:0/3577525915 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc2d00e2fd0 0x7fc2d003ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:04.265 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.219+0000 7fc2dd6e1700 1 -- 172.21.15.57:0/3577525915 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc2d00e2fd0 msgr2=0x7fc2d003ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:04.265 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.215+0000 7fa7e5ffb700 1 -- 172.21.15.57:0/3649494973 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3317160290 0 0) 0x7fa7e80cb0f0 con 0x7fa7e8158b90 2023-10-06T03:01:04.265 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.219+0000 7fa7e5ffb700 1 -- 172.21.15.57:0/3649494973 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7d0003570 con 0x7fa7e8158b90 2023-10-06T03:01:04.265 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.219+0000 7fa7e77fe700 1 --2- 172.21.15.57:0/3649494973 >> v2:172.21.15.57:3300/0 conn(0x7fa7e80cce50 0x7fa7e806ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:04.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.219+0000 7fa76d59a700 1 -- 172.21.15.57:0/2537468952 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa76000b9c0 con 0x7fa7700cb6b0 2023-10-06T03:01:04.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.219+0000 7fa76d59a700 1 -- 172.21.15.57:0/2537468952 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa76000bd60 con 0x7fa7700cb6b0 2023-10-06T03:01:04.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.219+0000 7fc2dd6e1700 1 --2- 172.21.15.57:0/3577525915 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc2d00e2fd0 0x7fc2d003ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.219+0000 7fc2dd6e1700 1 -- 172.21.15.57:0/3577525915 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc2d0038ff0 msgr2=0x7fc2d004de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:04.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.219+0000 7fc2dcee0700 1 --2- 172.21.15.57:0/3577525915 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc2d0038ff0 0x7fc2d004de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:04.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.219+0000 7f2f7b7fe700 1 --2- 172.21.15.57:0/308286016 >> [v2:172.21.15.57:6808/33057,v1:172.21.15.57:6811/33057] conn(0x7f2f68068e80 0x7f2f6806b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:04.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.219+0000 7fc2dd6e1700 1 --2- 172.21.15.57:0/3577525915 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc2d0038ff0 0x7fc2d004de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.219+0000 7fc2dd6e1700 1 -- 172.21.15.57:0/3577525915 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2d40094f0 con 0x7fc2d0036a40 2023-10-06T03:01:04.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.219+0000 7fc2ddee2700 1 --2- 172.21.15.57:0/3577525915 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc2d00e2fd0 0x7fc2d003ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:01:04.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.219+0000 7fc2dcee0700 1 --2- 172.21.15.57:0/3577525915 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc2d0038ff0 0x7fc2d004de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:01:04.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.219+0000 7fa7e67fc700 1 -- 172.21.15.57:0/3649494973 >> v2:172.21.15.57:3300/0 conn(0x7fa7e80cce50 msgr2=0x7fa7e806ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:04.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.219+0000 7fa7e67fc700 1 --2- 172.21.15.57:0/3649494973 >> v2:172.21.15.57:3300/0 conn(0x7fa7e80cce50 0x7fa7e806ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.219+0000 7fa7e67fc700 1 -- 172.21.15.57:0/3649494973 >> v1:172.21.15.57:6789/0 conn(0x7fa7e8158b90 legacy=0x7fa7e8158f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:04.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.219+0000 7f1209449700 1 --2- 172.21.15.57:0/943826298 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f120406ccf0 0x7f120415cdd0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f11f800e930 tx=0x7f11f80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:04.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.219+0000 7f1201ffb700 1 -- 172.21.15.57:0/943826298 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f8013680 con 0x7f120406ccf0 2023-10-06T03:01:04.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.219+0000 7f1201ffb700 1 -- 172.21.15.57:0/943826298 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11f80137e0 con 0x7f120406ccf0 2023-10-06T03:01:04.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.219+0000 7f1201ffb700 1 -- 172.21.15.57:0/943826298 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f8013b60 con 0x7f120406ccf0 2023-10-06T03:01:04.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.219+0000 7fc2dd6e1700 1 --2- 172.21.15.57:0/3577525915 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc2d0036a40 0x7fc2d004f810 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fc2d000c0d0 tx=0x7fc2d4017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:04.270 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.219+0000 7f2f7affd700 1 --2- 172.21.15.57:0/308286016 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f2f680605d0 0x7f2f68062a80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2f740094d0 tx=0x7f2f7400b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:04.270 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.219+0000 7f120ac4c700 1 -- 172.21.15.57:0/943826298 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f120415d740 con 0x7f120406ccf0 2023-10-06T03:01:04.270 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.219+0000 7fa76f59e700 1 -- 172.21.15.57:0/2537468952 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa7700cb6b0 msgr2=0x7fa77006b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:04.270 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.219+0000 7fa76f59e700 1 --2- 172.21.15.57:0/2537468952 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa7700cb6b0 0x7fa77006b040 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa770069f20 tx=0x7fa760009250 comp rx=0 tx=0).stop 2023-10-06T03:01:04.271 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.219+0000 7f2f7b7fe700 1 --2- 172.21.15.57:0/308286016 >> [v2:172.21.15.57:6808/33057,v1:172.21.15.57:6811/33057] conn(0x7f2f68068e80 0x7f2f6806b290 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:04.271 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.219+0000 7fc2cd7fa700 1 -- 172.21.15.57:0/3577525915 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2d400b9d0 con 0x7fc2d0036a40 2023-10-06T03:01:04.271 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.219+0000 7fc2cd7fa700 1 -- 172.21.15.57:0/3577525915 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2d400bb30 con 0x7fc2d0036a40 2023-10-06T03:01:04.271 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.219+0000 7fc2cd7fa700 1 -- 172.21.15.57:0/3577525915 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2d4026680 con 0x7fc2d0036a40 2023-10-06T03:01:04.272 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.219+0000 7fa76f59e700 1 -- 172.21.15.57:0/2537468952 shutdown_connections 2023-10-06T03:01:04.272 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.219+0000 7fa76f59e700 1 --2- 172.21.15.57:0/2537468952 >> v2:172.21.15.57:3300/0 conn(0x7fa77006dc40 0x7fa77006c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.272 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.219+0000 7fa76f59e700 1 --2- 172.21.15.57:0/2537468952 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa7700cb6b0 0x7fa77006b040 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.272 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.219+0000 7fa76f59e700 1 --2- 172.21.15.57:0/2537468952 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa7700c6a40 0x7fa7700c6e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.272 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.219+0000 7fa76f59e700 1 -- 172.21.15.57:0/2537468952 >> 172.21.15.57:0/2537468952 conn(0x7fa7700c85e0 msgr2=0x7fa7700c89e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:04.272 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.219+0000 7fa6516e1700 1 --2- 172.21.15.57:0/3907183064 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa644038ff0 0x7fa6440393c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa6480099b0 tx=0x7fa648009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd4931ab4b968123 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:04.273 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.219+0000 7fa76f59e700 1 -- 172.21.15.57:0/2537468952 shutdown_connections 2023-10-06T03:01:04.273 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.219+0000 7f120ac4c700 1 -- 172.21.15.57:0/943826298 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12040b0f30 con 0x7f120406ccf0 2023-10-06T03:01:04.273 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.219+0000 7fa76f59e700 1 -- 172.21.15.57:0/2537468952 wait complete. 2023-10-06T03:01:04.274 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.219+0000 7fa643fff700 1 -- 172.21.15.57:0/3907183064 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa64800b680 con 0x7fa644038ff0 2023-10-06T03:01:04.274 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.219+0000 7fa643fff700 1 -- 172.21.15.57:0/3907183064 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa64800b7e0 con 0x7fa644038ff0 2023-10-06T03:01:04.274 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.219+0000 7fa643fff700 1 -- 172.21.15.57:0/3907183064 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa64800bb80 con 0x7fa644038ff0 2023-10-06T03:01:04.274 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.219+0000 7f2f62ffd700 1 -- 172.21.15.57:0/308286016 <== osd.3 v2:172.21.15.57:6808/33057 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f2f6806b940 con 0x7f2f68068e80 2023-10-06T03:01:04.275 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.219+0000 7f8edf7fe700 1 -- 172.21.15.57:0/4219614746 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8ee00c08f0 msgr2=0x7f8ee01766a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:04.275 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.219+0000 7f8edf7fe700 1 --2- 172.21.15.57:0/4219614746 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8ee00c08f0 0x7f8ee01766a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.275 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.219+0000 7f8edf7fe700 1 -- 172.21.15.57:0/4219614746 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8ee00cc630 msgr2=0x7f8ee00c5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:04.275 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.219+0000 7f8edf7fe700 1 --2- 172.21.15.57:0/4219614746 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8ee00cc630 0x7f8ee00c5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.275 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.219+0000 7f8edf7fe700 1 -- 172.21.15.57:0/4219614746 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ed00094f0 con 0x7f8ee0158900 2023-10-06T03:01:04.276 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.219+0000 7fa653945700 1 -- 172.21.15.57:0/3907183064 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa644038ff0 msgr2=0x7fa6440393c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:04.276 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.219+0000 7fa653945700 1 --2- 172.21.15.57:0/3907183064 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa644038ff0 0x7fa6440393c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa6480099b0 tx=0x7fa648009250 comp rx=0 tx=0).stop 2023-10-06T03:01:04.276 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.219+0000 7fa653945700 1 -- 172.21.15.57:0/3907183064 shutdown_connections 2023-10-06T03:01:04.276 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.219+0000 7fa653945700 1 --2- 172.21.15.57:0/3907183064 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa6440e2fd0 0x7fa6440e33f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.276 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.219+0000 7fa653945700 1 --2- 172.21.15.57:0/3907183064 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa644038ff0 0x7fa6440393c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.276 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.219+0000 7fa653945700 1 -- 172.21.15.57:0/3907183064 >> 172.21.15.57:0/3907183064 conn(0x7fa644009e80 msgr2=0x7fa64400a250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:04.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.219+0000 7f8edf7fe700 1 --2- 172.21.15.57:0/4219614746 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8ee0158900 0x7f8ee00c5990 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f8ee006d150 tx=0x7f8ed8001630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:04.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.219+0000 7fc2df945700 1 -- 172.21.15.57:0/3577525915 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2d004f010 con 0x7fc2d0036a40 2023-10-06T03:01:04.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.219+0000 7fc2df945700 1 -- 172.21.15.57:0/3577525915 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2d004e430 con 0x7fc2d0036a40 2023-10-06T03:01:04.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.219+0000 7fa7e67fc700 1 -- 172.21.15.57:0/3649494973 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7e80caaa0 con 0x7fa7e80cb580 2023-10-06T03:01:04.278 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.223+0000 7f8ed77fe700 1 -- 172.21.15.57:0/4219614746 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ed8012630 con 0x7f8ee0158900 2023-10-06T03:01:04.278 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.223+0000 7f8ed77fe700 1 -- 172.21.15.57:0/4219614746 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ed80127d0 con 0x7f8ee0158900 2023-10-06T03:01:04.278 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.223+0000 7f8ed77fe700 1 -- 172.21.15.57:0/4219614746 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ed8012b90 con 0x7f8ee0158900 2023-10-06T03:01:04.278 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.223+0000 7fa653945700 1 -- 172.21.15.57:0/3907183064 shutdown_connections 2023-10-06T03:01:04.279 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.223+0000 7fa7e67fc700 1 --2- 172.21.15.57:0/3649494973 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa7e80cb580 0x7fa7e80cc910 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fa7dc0098e0 tx=0x7fa7dc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=243e45a657a4bc75 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:04.279 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.223+0000 7fa76f59e700 1 Processor -- start 2023-10-06T03:01:04.279 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.223+0000 7fa653945700 1 -- 172.21.15.57:0/3907183064 wait complete. 2023-10-06T03:01:04.279 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.223+0000 7fa7e5ffb700 1 -- 172.21.15.57:0/3649494973 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7dc00b690 con 0x7fa7e80cb580 2023-10-06T03:01:04.280 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.223+0000 7fa7e5ffb700 1 -- 172.21.15.57:0/3649494973 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7dc00b7f0 con 0x7fa7e80cb580 2023-10-06T03:01:04.280 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.223+0000 7fa7e5ffb700 1 -- 172.21.15.57:0/3649494973 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7dc00bb90 con 0x7fa7e80cb580 2023-10-06T03:01:04.280 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.223+0000 7f8ee5545700 1 -- 172.21.15.57:0/4219614746 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ee00c45b0 con 0x7f8ee0158900 2023-10-06T03:01:04.280 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.223+0000 7f8ee5545700 1 -- 172.21.15.57:0/4219614746 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ee016c950 con 0x7f8ee0158900 2023-10-06T03:01:04.280 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.223+0000 7fc2c2ffd700 1 -- 172.21.15.57:0/3577525915 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc2d0039660 con 0x7fc2d0036a40 2023-10-06T03:01:04.281 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.223+0000 7f1201ffb700 1 -- 172.21.15.57:0/943826298 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f11f80123d0 con 0x7f120406ccf0 2023-10-06T03:01:04.281 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.223+0000 7f11e77fe700 1 -- 172.21.15.57:0/943826298 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f120404be40 con 0x7f120406ccf0 2023-10-06T03:01:04.281 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.223+0000 7fa76f59e700 1 -- start start 2023-10-06T03:01:04.281 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.223+0000 7fa76f59e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa77006dc40 0x7fa7700bf1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:04.281 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.223+0000 7fa76f59e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7700c6a40 0x7fa7700afbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:04.282 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.223+0000 7fa653945700 1 Processor -- start 2023-10-06T03:01:04.282 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.223+0000 7fa653945700 1 -- start start 2023-10-06T03:01:04.282 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.223+0000 7fa7e7fff700 1 -- 172.21.15.57:0/3649494973 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa7e80cb580 msgr2=0x7fa7e80cc910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:04.282 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.223+0000 7fa7e7fff700 1 --2- 172.21.15.57:0/3649494973 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa7e80cb580 0x7fa7e80cc910 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fa7dc0098e0 tx=0x7fa7dc0091a0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.283 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.223+0000 7fa76dd9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7700c6a40 0x7fa7700afbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:04.283 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.223+0000 7fa76dd9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7700c6a40 0x7fa7700afbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:45202/0 (socket says 172.21.15.57:45202) 2023-10-06T03:01:04.283 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.223+0000 7fa76dd9b700 1 -- 172.21.15.57:0/3654530708 learned_addr learned my addr 172.21.15.57:0/3654530708 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:04.283 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.223+0000 7fa76f59e700 1 --2- 172.21.15.57:0/3654530708 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa7700cb6b0 0x7fa7700c59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:04.283 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.223+0000 7fa76f59e700 1 -- 172.21.15.57:0/3654530708 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7700bcd20 con 0x7fa7700c6a40 2023-10-06T03:01:04.284 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.223+0000 7f1201ffb700 1 --2- 172.21.15.57:0/943826298 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f11e80606a0 0x7f11e8062b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:04.284 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.223+0000 7fa76f59e700 1 -- 172.21.15.57:0/3654530708 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7700bc110 con 0x7fa7700cb6b0 2023-10-06T03:01:04.284 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.227+0000 7fa76ed9d700 1 --2- 172.21.15.57:0/3654530708 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa7700cb6b0 0x7fa7700c59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:04.284 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.227+0000 7fa76f59e700 1 -- 172.21.15.57:0/3654530708 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7700bc3f0 con 0x7fa77006dc40 2023-10-06T03:01:04.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.223+0000 7fa653945700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa644036a40 0x7fa6440dbb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:04.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.227+0000 7fa653945700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa644038ff0 0x7fa64404e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:04.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.227+0000 7fa653945700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa6440e2fd0 0x7fa644050320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:04.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.227+0000 7f1201ffb700 1 -- 172.21.15.57:0/943826298 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f11f807ca50 con 0x7f120406ccf0 2023-10-06T03:01:04.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.227+0000 7f1201ffb700 1 --2- 172.21.15.57:0/943826298 >> [v2:172.21.15.57:6824/33058,v1:172.21.15.57:6825/33058] conn(0x7f11e8068ed0 0x7f11e806b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:04.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.227+0000 7f1201ffb700 1 -- 172.21.15.57:0/943826298 --> [v2:172.21.15.57:6824/33058,v1:172.21.15.57:6825/33058] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f11e806b990 con 0x7f11e8068ed0 2023-10-06T03:01:04.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.227+0000 7fa6516e1700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa644036a40 0x7fa6440dbb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:04.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.227+0000 7fa6516e1700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa644036a40 0x7fa6440dbb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.57:42272/0 (socket says 172.21.15.57:42272) 2023-10-06T03:01:04.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.227+0000 7fa6516e1700 1 -- 172.21.15.57:0/4040347178 learned_addr learned my addr 172.21.15.57:0/4040347178 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:04.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.227+0000 7fa653945700 1 -- 172.21.15.57:0/4040347178 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa64403a260 con 0x7fa6440e2fd0 2023-10-06T03:01:04.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.227+0000 7fa653945700 1 -- 172.21.15.57:0/4040347178 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa64404f2d0 con 0x7fa644038ff0 2023-10-06T03:01:04.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.227+0000 7fa653945700 1 -- 172.21.15.57:0/4040347178 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa64404f5b0 con 0x7fa644036a40 2023-10-06T03:01:04.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.227+0000 7f1201ffb700 1 -- 172.21.15.57:0/943826298 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f11f804ce40 con 0x7f120406ccf0 2023-10-06T03:01:04.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.227+0000 7fa650ee0700 1 --2- 172.21.15.57:0/4040347178 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa644038ff0 0x7fa64404e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:04.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.227+0000 7fa651ee2700 1 --2- 172.21.15.57:0/4040347178 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa6440e2fd0 0x7fa644050320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:04.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.227+0000 7f120a44b700 1 --2- 172.21.15.57:0/943826298 >> [v2:172.21.15.57:6824/33058,v1:172.21.15.57:6825/33058] conn(0x7f11e8068ed0 0x7f11e806b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:04.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.227+0000 7f1209c4a700 1 --2- 172.21.15.57:0/943826298 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f11e80606a0 0x7f11e8062b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:04.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.223+0000 7fc2cd7fa700 1 -- 172.21.15.57:0/3577525915 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fc2d4023030 con 0x7fc2d0036a40 2023-10-06T03:01:04.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.227+0000 7fc2cd7fa700 1 --2- 172.21.15.57:0/3577525915 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fc2bc0605d0 0x7fc2bc062a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:04.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.227+0000 7fc2cd7fa700 1 -- 172.21.15.57:0/3577525915 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc2d407e230 con 0x7fc2d0036a40 2023-10-06T03:01:04.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.227+0000 7fc2cd7fa700 1 --2- 172.21.15.57:0/3577525915 >> [v2:172.21.15.105:6800/33368,v1:172.21.15.105:6801/33368] conn(0x7fc2bc068e00 0x7fc2bc06b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:04.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.227+0000 7fc2cd7fa700 1 -- 172.21.15.57:0/3577525915 --> [v2:172.21.15.105:6800/33368,v1:172.21.15.105:6801/33368] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc2bc06b8c0 con 0x7fc2bc068e00 2023-10-06T03:01:04.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.227+0000 7f8ee5545700 1 -- 172.21.15.57:0/4219614746 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8ec4000fd0 con 0x7f8ee0158900 2023-10-06T03:01:04.289 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.227+0000 7fc2cd7fa700 1 -- 172.21.15.57:0/3577525915 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc2d404e620 con 0x7fc2d0036a40 2023-10-06T03:01:04.289 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.227+0000 7fa6516e1700 1 -- 172.21.15.57:0/4040347178 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa644038ff0 msgr2=0x7fa64404e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:04.289 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.227+0000 7fa6516e1700 1 --2- 172.21.15.57:0/4040347178 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa644038ff0 0x7fa64404e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.289 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.227+0000 7fa6516e1700 1 -- 172.21.15.57:0/4040347178 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa6440e2fd0 msgr2=0x7fa644050320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:04.290 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.227+0000 7fa6516e1700 1 --2- 172.21.15.57:0/4040347178 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa6440e2fd0 0x7fa644050320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.290 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.227+0000 7fa6516e1700 1 -- 172.21.15.57:0/4040347178 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6480094f0 con 0x7fa644036a40 2023-10-06T03:01:04.290 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.227+0000 7fc2dcee0700 1 --2- 172.21.15.57:0/3577525915 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fc2bc0605d0 0x7fc2bc062a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:04.290 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.227+0000 7fa76dd9b700 1 -- 172.21.15.57:0/3654530708 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa77006dc40 msgr2=0x7fa7700bf1b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-06T03:01:04.290 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.227+0000 7fa76dd9b700 1 --2- 172.21.15.57:0/3654530708 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa77006dc40 0x7fa7700bf1b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.291 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.227+0000 7fa76dd9b700 1 -- 172.21.15.57:0/3654530708 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa7700cb6b0 msgr2=0x7fa7700c59f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:04.291 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.227+0000 7fa76dd9b700 1 --2- 172.21.15.57:0/3654530708 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa7700cb6b0 0x7fa7700c59f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.291 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.227+0000 7fa76dd9b700 1 -- 172.21.15.57:0/3654530708 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7600094f0 con 0x7fa7700c6a40 2023-10-06T03:01:04.291 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.227+0000 7f8ed77fe700 1 -- 172.21.15.57:0/4219614746 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f8ed8003030 con 0x7f8ee0158900 2023-10-06T03:01:04.291 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.227+0000 7fc2ddee2700 1 --2- 172.21.15.57:0/3577525915 >> [v2:172.21.15.105:6800/33368,v1:172.21.15.105:6801/33368] conn(0x7fc2bc068e00 0x7fc2bc06b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:04.292 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.227+0000 7fa7e7fff700 1 -- 172.21.15.57:0/3649494973 shutdown_connections 2023-10-06T03:01:04.292 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.227+0000 7fa7e7fff700 1 --2- 172.21.15.57:0/3649494973 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa7e80cb580 0x7fa7e80cc910 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.292 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.227+0000 7fa7e7fff700 1 --2- 172.21.15.57:0/3649494973 >> v2:172.21.15.57:3300/0 conn(0x7fa7e80cce50 0x7fa7e806ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.292 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.227+0000 7fa7e7fff700 1 -- 172.21.15.57:0/3649494973 >> 172.21.15.57:0/3649494973 conn(0x7fa7e8067050 msgr2=0x7fa7e8067420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:04.292 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.227+0000 7fa7e7fff700 1 -- 172.21.15.57:0/3649494973 shutdown_connections 2023-10-06T03:01:04.292 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.227+0000 7fa7e7fff700 1 -- 172.21.15.57:0/3649494973 wait complete. 2023-10-06T03:01:04.293 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.227+0000 7fa76ed9d700 1 --2- 172.21.15.57:0/3654530708 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa7700cb6b0 0x7fa7700c59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:01:04.293 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.227+0000 7fa76dd9b700 1 --2- 172.21.15.57:0/3654530708 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7700c6a40 0x7fa7700afbc0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa77006bd50 tx=0x7fa760017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:04.293 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.227+0000 7fa6516e1700 1 --2- 172.21.15.57:0/4040347178 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa644036a40 0x7fa6440dbb90 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa648009290 tx=0x7fa648017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:04.293 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.227+0000 7fa6417fa700 1 -- 172.21.15.57:0/4040347178 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa64800b950 con 0x7fa644036a40 2023-10-06T03:01:04.293 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.227+0000 7fa6417fa700 1 -- 172.21.15.57:0/4040347178 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa64800bab0 con 0x7fa644036a40 2023-10-06T03:01:04.293 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.227+0000 7fa6417fa700 1 -- 172.21.15.57:0/4040347178 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa64801a680 con 0x7fa644036a40 2023-10-06T03:01:04.294 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.227+0000 7fa75e7fc700 1 -- 172.21.15.57:0/3654530708 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa760011d00 con 0x7fa7700c6a40 2023-10-06T03:01:04.294 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.227+0000 7fa75e7fc700 1 -- 172.21.15.57:0/3654530708 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa760029070 con 0x7fa7700c6a40 2023-10-06T03:01:04.294 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.227+0000 7fa75e7fc700 1 -- 172.21.15.57:0/3654530708 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa760025aa0 con 0x7fa7700c6a40 2023-10-06T03:01:04.294 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.227+0000 7fc2dcee0700 1 --2- 172.21.15.57:0/3577525915 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fc2bc0605d0 0x7fc2bc062a80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc2d00e0a90 tx=0x7fc2c8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:04.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.231+0000 7f8ed77fe700 1 --2- 172.21.15.57:0/4219614746 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f8ec0060670 0x7f8ec0062b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:04.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.231+0000 7f8ed77fe700 1 -- 172.21.15.57:0/4219614746 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8ed807c780 con 0x7f8ee0158900 2023-10-06T03:01:04.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.231+0000 7f8ed77fe700 1 --2- 172.21.15.57:0/4219614746 >> [v2:172.21.15.57:6809/33052,v1:172.21.15.57:6810/33052] conn(0x7f8ec0068ea0 0x7f8ec006b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:04.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.231+0000 7f8ed77fe700 1 -- 172.21.15.57:0/4219614746 --> [v2:172.21.15.57:6809/33052,v1:172.21.15.57:6810/33052] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8ec006b960 con 0x7f8ec0068ea0 2023-10-06T03:01:04.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.227+0000 7f120a44b700 1 --2- 172.21.15.57:0/943826298 >> [v2:172.21.15.57:6824/33058,v1:172.21.15.57:6825/33058] conn(0x7f11e8068ed0 0x7f11e806b2e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:04.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.227+0000 7f1201ffb700 1 -- 172.21.15.57:0/943826298 <== osd.2 v2:172.21.15.57:6824/33058 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f11e806b990 con 0x7f11e8068ed0 2023-10-06T03:01:04.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.231+0000 7f1209c4a700 1 --2- 172.21.15.57:0/943826298 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f11e80606a0 0x7f11e8062b50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f11fc003080 tx=0x7f11fc017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:04.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.231+0000 7fa7e7fff700 1 Processor -- start 2023-10-06T03:01:04.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.231+0000 7fa7e7fff700 1 -- start start 2023-10-06T03:01:04.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.227+0000 7fa76f59e700 1 -- 172.21.15.57:0/3654530708 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7700bc6d0 con 0x7fa7700c6a40 2023-10-06T03:01:04.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.231+0000 7fa75e7fc700 1 -- 172.21.15.57:0/3654530708 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fa76002b030 con 0x7fa7700c6a40 2023-10-06T03:01:04.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.227+0000 7fa653945700 1 -- 172.21.15.57:0/4040347178 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa644039c10 con 0x7fa644036a40 2023-10-06T03:01:04.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.231+0000 7fa653945700 1 -- 172.21.15.57:0/4040347178 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa64404d520 con 0x7fa644036a40 2023-10-06T03:01:04.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.231+0000 7fa636ffd700 1 -- 172.21.15.57:0/4040347178 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa624000fd0 con 0x7fa644036a40 2023-10-06T03:01:04.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.231+0000 7f8edeffd700 1 --2- 172.21.15.57:0/4219614746 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f8ec0060670 0x7f8ec0062b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:04.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.231+0000 7f8ed67fc700 1 --2- 172.21.15.57:0/4219614746 >> [v2:172.21.15.57:6809/33052,v1:172.21.15.57:6810/33052] conn(0x7f8ec0068ea0 0x7f8ec006b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:04.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.235+0000 7f8ed67fc700 1 --2- 172.21.15.57:0/4219614746 >> [v2:172.21.15.57:6809/33052,v1:172.21.15.57:6810/33052] conn(0x7f8ec0068ea0 0x7f8ec006b2b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:04.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.235+0000 7f8edeffd700 1 --2- 172.21.15.57:0/4219614746 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f8ec0060670 0x7f8ec0062b20 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8ec80078a0 tx=0x7f8ec8007830 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:04.298 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.235+0000 7fc2ddee2700 1 --2- 172.21.15.57:0/3577525915 >> [v2:172.21.15.105:6800/33368,v1:172.21.15.105:6801/33368] conn(0x7fc2bc068e00 0x7fc2bc06b210 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:04.298 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.235+0000 7fa7e7fff700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa7e80cb580 0x7fa7e80c6900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:04.298 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.235+0000 7fa7e7fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7e80cce50 0x7fa7e8169bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:04.298 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.235+0000 7fa7e7fff700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa7e8158b90 0x7fa7e80c9190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:04.298 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.235+0000 7fa7e7fff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e816a110 con 0x7fa7e80cce50 2023-10-06T03:01:04.298 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.235+0000 7fa7e7fff700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e80c80f0 con 0x7fa7e8158b90 2023-10-06T03:01:04.298 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.235+0000 7fa7e7fff700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e80c83d0 con 0x7fa7e80cb580 2023-10-06T03:01:04.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.231+0000 7fa76f59e700 1 -- 172.21.15.57:0/3654530708 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7700beb60 con 0x7fa7700c6a40 2023-10-06T03:01:04.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.235+0000 7fa75e7fc700 1 --2- 172.21.15.57:0/3654530708 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fa750060650 0x7fa750062b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:04.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.235+0000 7fa75e7fc700 1 -- 172.21.15.57:0/3654530708 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa760085fe0 con 0x7fa7700c6a40 2023-10-06T03:01:04.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.235+0000 7fa76f59e700 1 --2- 172.21.15.57:0/3654530708 >> [v2:172.21.15.105:6817/33369,v1:172.21.15.105:6819/33369] conn(0x7fa7700b0100 0x7fa77014a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:04.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.235+0000 7fa76f59e700 1 -- 172.21.15.57:0/3654530708 --> [v2:172.21.15.105:6817/33369,v1:172.21.15.105:6819/33369] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa770063410 con 0x7fa7700b0100 2023-10-06T03:01:04.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.235+0000 7fa76e59c700 1 --2- 172.21.15.57:0/3654530708 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fa750060650 0x7fa750062b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:04.300 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.235+0000 7f8ed77fe700 1 -- 172.21.15.57:0/4219614746 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8ed804cbf0 con 0x7f8ee0158900 2023-10-06T03:01:04.300 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.235+0000 7f8ed77fe700 1 -- 172.21.15.57:0/4219614746 <== osd.1 v2:172.21.15.57:6809/33052 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f8ec006b960 con 0x7f8ec0068ea0 2023-10-06T03:01:04.300 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.235+0000 7fa76ed9d700 1 --2- 172.21.15.57:0/3654530708 >> [v2:172.21.15.105:6817/33369,v1:172.21.15.105:6819/33369] conn(0x7fa7700b0100 0x7fa77014a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:04.300 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.235+0000 7fa7e77fe700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa7e8158b90 0x7fa7e80c9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:04.301 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.235+0000 7fa6417fa700 1 -- 172.21.15.57:0/4040347178 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fa64801aa70 con 0x7fa644036a40 2023-10-06T03:01:04.301 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.235+0000 7fa6417fa700 1 --2- 172.21.15.57:0/4040347178 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fa6300606a0 0x7fa630062b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:04.301 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.235+0000 7fa6417fa700 1 -- 172.21.15.57:0/4040347178 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa64807e610 con 0x7fa644036a40 2023-10-06T03:01:04.301 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.235+0000 7fa6417fa700 1 --2- 172.21.15.57:0/4040347178 >> [v2:172.21.15.105:6808/33370,v1:172.21.15.105:6809/33370] conn(0x7fa630068ed0 0x7fa63006b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:04.301 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.235+0000 7fa6417fa700 1 -- 172.21.15.57:0/4040347178 --> [v2:172.21.15.105:6808/33370,v1:172.21.15.105:6809/33370] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa63006b990 con 0x7fa630068ed0 2023-10-06T03:01:04.301 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.235+0000 7fa6417fa700 1 -- 172.21.15.57:0/4040347178 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa64804eb40 con 0x7fa644036a40 2023-10-06T03:01:04.302 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.235+0000 7fa7e6ffd700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa7e80cb580 0x7fa7e80c6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:04.302 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.235+0000 7fa7e6ffd700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa7e80cb580 0x7fa7e80c6900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.57:42284/0 (socket says 172.21.15.57:42284) 2023-10-06T03:01:04.302 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.235+0000 7fa7e6ffd700 1 -- 172.21.15.57:0/1312457288 learned_addr learned my addr 172.21.15.57:0/1312457288 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:04.302 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.235+0000 7fa76e59c700 1 --2- 172.21.15.57:0/3654530708 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fa750060650 0x7fa750062b00 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa76800ad60 tx=0x7fa768009350 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:04.302 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.235+0000 7fa76ed9d700 1 --2- 172.21.15.57:0/3654530708 >> [v2:172.21.15.105:6817/33369,v1:172.21.15.105:6819/33369] conn(0x7fa7700b0100 0x7fa77014a890 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:04.303 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.235+0000 7fa651ee2700 1 --2- 172.21.15.57:0/4040347178 >> [v2:172.21.15.105:6808/33370,v1:172.21.15.105:6809/33370] conn(0x7fa630068ed0 0x7fa63006b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:04.303 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.235+0000 7fa650ee0700 1 --2- 172.21.15.57:0/4040347178 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fa6300606a0 0x7fa630062b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:04.303 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.239+0000 7fc2cd7fa700 1 -- 172.21.15.57:0/3577525915 <== osd.4 v2:172.21.15.105:6800/33368 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fc2bc06b8c0 con 0x7fc2bc068e00 2023-10-06T03:01:04.303 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.235+0000 7fa7e67fc700 1 --2- 172.21.15.57:0/1312457288 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7e80cce50 0x7fa7e8169bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:04.304 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.239+0000 7fa7e6ffd700 1 -- 172.21.15.57:0/1312457288 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa7e8158b90 msgr2=0x7fa7e80c9190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:04.304 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.239+0000 7fa7e6ffd700 1 --2- 172.21.15.57:0/1312457288 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa7e8158b90 0x7fa7e80c9190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.304 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.239+0000 7fa7e6ffd700 1 -- 172.21.15.57:0/1312457288 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7e80cce50 msgr2=0x7fa7e8169bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:04.304 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.239+0000 7fa7e6ffd700 1 --2- 172.21.15.57:0/1312457288 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7e80cce50 0x7fa7e8169bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.304 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.239+0000 7fa7e6ffd700 1 -- 172.21.15.57:0/1312457288 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7dc009420 con 0x7fa7e80cb580 2023-10-06T03:01:04.304 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.239+0000 7fa7e6ffd700 1 --2- 172.21.15.57:0/1312457288 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa7e80cb580 0x7fa7e80c6900 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fa7d800c810 tx=0x7fa7d8007de0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:04.305 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.239+0000 7fa650ee0700 1 --2- 172.21.15.57:0/4040347178 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fa6300606a0 0x7fa630062b50 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa6440097c0 tx=0x7fa63c007d50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:04.305 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.239+0000 7fa651ee2700 1 --2- 172.21.15.57:0/4040347178 >> [v2:172.21.15.105:6808/33370,v1:172.21.15.105:6809/33370] conn(0x7fa630068ed0 0x7fa63006b2e0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:04.305 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.239+0000 7fa7ceffd700 1 -- 172.21.15.57:0/1312457288 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d8005c00 con 0x7fa7e80cb580 2023-10-06T03:01:04.305 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.239+0000 7fa7ceffd700 1 -- 172.21.15.57:0/1312457288 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7d8005d60 con 0x7fa7e80cb580 2023-10-06T03:01:04.305 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.239+0000 7fa7e7fff700 1 -- 172.21.15.57:0/1312457288 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7e80c86b0 con 0x7fa7e80cb580 2023-10-06T03:01:04.306 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.239+0000 7fa75e7fc700 1 -- 172.21.15.57:0/3654530708 <== osd.6 v2:172.21.15.105:6817/33369 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fa770063410 con 0x7fa7700b0100 2023-10-06T03:01:04.306 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.239+0000 7fa7e7fff700 1 -- 172.21.15.57:0/1312457288 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7e80c8c70 con 0x7fa7e80cb580 2023-10-06T03:01:04.306 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.239+0000 7fa6417fa700 1 -- 172.21.15.57:0/4040347178 <== osd.7 v2:172.21.15.105:6808/33370 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fa63006b990 con 0x7fa630068ed0 2023-10-06T03:01:04.307 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.239+0000 7fa7ceffd700 1 -- 172.21.15.57:0/1312457288 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d8007300 con 0x7fa7e80cb580 2023-10-06T03:01:04.307 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.243+0000 7fa7ceffd700 1 -- 172.21.15.57:0/1312457288 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fa7d801b3b0 con 0x7fa7e80cb580 2023-10-06T03:01:04.307 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.243+0000 7fa7e7fff700 1 -- 172.21.15.57:0/1312457288 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa7e804be40 con 0x7fa7e80cb580 2023-10-06T03:01:04.307 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.243+0000 7fa7ceffd700 1 --2- 172.21.15.57:0/1312457288 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fa7d4060620 0x7fa7d4062ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:04.308 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.247+0000 7f2f818ae700 1 -- 172.21.15.57:0/308286016 --> [v2:172.21.15.57:6808/33057,v1:172.21.15.57:6811/33057] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2f7c063a60 con 0x7f2f68068e80 2023-10-06T03:01:04.308 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.247+0000 7fa7e67fc700 1 --2- 172.21.15.57:0/1312457288 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fa7d4060620 0x7fa7d4062ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:04.308 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.247+0000 7fa7ceffd700 1 -- 172.21.15.57:0/1312457288 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa7d807be40 con 0x7fa7e80cb580 2023-10-06T03:01:04.308 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.247+0000 7f2f62ffd700 1 -- 172.21.15.57:0/308286016 <== osd.3 v2:172.21.15.57:6808/33057 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2f7c063a60 con 0x7f2f68068e80 2023-10-06T03:01:04.309 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.247+0000 7fa7ceffd700 1 --2- 172.21.15.57:0/1312457288 >> [v2:172.21.15.105:6816/33379,v1:172.21.15.105:6818/33379] conn(0x7fa7d4068d60 0x7fa7d406b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:04.309 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.247+0000 7fa7e67fc700 1 --2- 172.21.15.57:0/1312457288 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fa7d4060620 0x7fa7d4062ad0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa7dc0030c0 tx=0x7fa7dc016000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:04.309 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.247+0000 7fa7ceffd700 1 -- 172.21.15.57:0/1312457288 --> [v2:172.21.15.105:6816/33379,v1:172.21.15.105:6818/33379] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa7d406b820 con 0x7fa7d4068d60 2023-10-06T03:01:04.309 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.247+0000 7fa7ceffd700 1 -- 172.21.15.57:0/1312457288 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa7d8081350 con 0x7fa7e80cb580 2023-10-06T03:01:04.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.247+0000 7f2ca2af0700 1 -- 172.21.15.57:0/3251248026 --> [v2:172.21.15.57:6800/33053,v1:172.21.15.57:6801/33053] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2c9c04b600 con 0x7f2c80068f20 2023-10-06T03:01:04.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.247+0000 7f2f818ae700 1 -- 172.21.15.57:0/308286016 >> [v2:172.21.15.57:6808/33057,v1:172.21.15.57:6811/33057] conn(0x7f2f68068e80 msgr2=0x7f2f6806b290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:04.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.247+0000 7f2f818ae700 1 --2- 172.21.15.57:0/308286016 >> [v2:172.21.15.57:6808/33057,v1:172.21.15.57:6811/33057] conn(0x7f2f68068e80 0x7f2f6806b290 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.247+0000 7fa7e77fe700 1 --2- 172.21.15.57:0/1312457288 >> [v2:172.21.15.105:6816/33379,v1:172.21.15.105:6818/33379] conn(0x7fa7d4068d60 0x7fa7d406b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:04.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.247+0000 7f2f818ae700 1 -- 172.21.15.57:0/308286016 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f2f680605d0 msgr2=0x7f2f68062a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:04.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.247+0000 7f2f818ae700 1 --2- 172.21.15.57:0/308286016 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f2f680605d0 0x7f2f68062a80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2f740094d0 tx=0x7f2f7400b040 comp rx=0 tx=0).stop 2023-10-06T03:01:04.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.247+0000 7f2f818ae700 1 -- 172.21.15.57:0/308286016 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2f7c0c7ed0 msgr2=0x7f2f7c155520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:04.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.247+0000 7f2f818ae700 1 --2- 172.21.15.57:0/308286016 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2f7c0c7ed0 0x7f2f7c155520 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c06b9e0 tx=0x7f2f70017000 comp rx=0 tx=0).stop 2023-10-06T03:01:04.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.247+0000 7f2f7b7fe700 1 -- 172.21.15.57:0/308286016 reap_dead start 2023-10-06T03:01:04.312 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.247+0000 7f2f818ae700 1 -- 172.21.15.57:0/308286016 shutdown_connections 2023-10-06T03:01:04.312 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.247+0000 7f2f818ae700 1 -- 172.21.15.57:0/308286016 >> 172.21.15.57:0/308286016 conn(0x7f2f7c0cbb50 msgr2=0x7f2f7c1538d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:04.312 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.247+0000 7f2c98ff9700 1 -- 172.21.15.57:0/3251248026 <== osd.0 v2:172.21.15.57:6800/33053 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2c9c04b600 con 0x7f2c80068f20 2023-10-06T03:01:04.312 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.247+0000 7f2f818ae700 1 -- 172.21.15.57:0/308286016 shutdown_connections 2023-10-06T03:01:04.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.247+0000 7f2f818ae700 1 -- 172.21.15.57:0/308286016 wait complete. 2023-10-06T03:01:04.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.247+0000 7fa7e77fe700 1 --2- 172.21.15.57:0/1312457288 >> [v2:172.21.15.105:6816/33379,v1:172.21.15.105:6818/33379] conn(0x7fa7d4068d60 0x7fa7d406b170 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:04.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.251+0000 7f2c867fc700 1 -- 172.21.15.57:0/3251248026 >> [v2:172.21.15.57:6800/33053,v1:172.21.15.57:6801/33053] conn(0x7f2c80068f20 msgr2=0x7f2c8006b330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:04.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.251+0000 7f2c867fc700 1 --2- 172.21.15.57:0/3251248026 >> [v2:172.21.15.57:6800/33053,v1:172.21.15.57:6801/33053] conn(0x7f2c80068f20 0x7f2c8006b330 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.314 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.251+0000 7f2c867fc700 1 -- 172.21.15.57:0/3251248026 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f2c80060670 msgr2=0x7f2c80062b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:04.314 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.251+0000 7f2c867fc700 1 --2- 172.21.15.57:0/3251248026 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f2c80060670 0x7f2c80062b20 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2c94007ab0 tx=0x7f2c94019000 comp rx=0 tx=0).stop 2023-10-06T03:01:04.314 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.251+0000 7fa7ceffd700 1 -- 172.21.15.57:0/1312457288 <== osd.5 v2:172.21.15.105:6816/33379 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fa7d406b820 con 0x7fa7d4068d60 2023-10-06T03:01:04.314 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.251+0000 7f2c867fc700 1 -- 172.21.15.57:0/3251248026 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c9c159490 msgr2=0x7f2c9c0b09d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:04.315 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.251+0000 7f2c867fc700 1 --2- 172.21.15.57:0/3251248026 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c9c159490 0x7f2c9c0b09d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2c9000c4b0 tx=0x7f2c90007e60 comp rx=0 tx=0).stop 2023-10-06T03:01:04.315 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.251+0000 7f2ca108d700 1 -- 172.21.15.57:0/3251248026 reap_dead start 2023-10-06T03:01:04.315 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.251+0000 7f2c867fc700 1 -- 172.21.15.57:0/3251248026 shutdown_connections 2023-10-06T03:01:04.315 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.251+0000 7f2c867fc700 1 -- 172.21.15.57:0/3251248026 >> 172.21.15.57:0/3251248026 conn(0x7f2c9c067050 msgr2=0x7f2c9c06cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:04.315 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.255+0000 7f2c867fc700 1 -- 172.21.15.57:0/3251248026 shutdown_connections 2023-10-06T03:01:04.315 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.255+0000 7f2c867fc700 1 -- 172.21.15.57:0/3251248026 wait complete. 2023-10-06T03:01:04.315 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.259+0000 7f11e77fe700 1 -- 172.21.15.57:0/943826298 --> [v2:172.21.15.57:6824/33058,v1:172.21.15.57:6825/33058] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1204063a60 con 0x7f11e8068ed0 2023-10-06T03:01:04.316 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.259+0000 7f1201ffb700 1 -- 172.21.15.57:0/943826298 <== osd.2 v2:172.21.15.57:6824/33058 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1204063a60 con 0x7f11e8068ed0 2023-10-06T03:01:04.316 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.259+0000 7f11e77fe700 1 -- 172.21.15.57:0/943826298 >> [v2:172.21.15.57:6824/33058,v1:172.21.15.57:6825/33058] conn(0x7f11e8068ed0 msgr2=0x7f11e806b2e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:04.317 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.259+0000 7f11e77fe700 1 --2- 172.21.15.57:0/943826298 >> [v2:172.21.15.57:6824/33058,v1:172.21.15.57:6825/33058] conn(0x7f11e8068ed0 0x7f11e806b2e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.317 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.259+0000 7f11e77fe700 1 -- 172.21.15.57:0/943826298 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f11e80606a0 msgr2=0x7f11e8062b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:04.317 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.259+0000 7f11e77fe700 1 --2- 172.21.15.57:0/943826298 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f11e80606a0 0x7f11e8062b50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f11fc003080 tx=0x7f11fc017000 comp rx=0 tx=0).stop 2023-10-06T03:01:04.317 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.259+0000 7f11e77fe700 1 -- 172.21.15.57:0/943826298 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f120406ccf0 msgr2=0x7f120415cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:04.317 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.259+0000 7f11e77fe700 1 --2- 172.21.15.57:0/943826298 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f120406ccf0 0x7f120415cdd0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f11f800e930 tx=0x7f11f80091a0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.317 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.259+0000 7f120a44b700 1 -- 172.21.15.57:0/943826298 reap_dead start 2023-10-06T03:01:04.318 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.263+0000 7fa76f59e700 1 -- 172.21.15.57:0/3654530708 --> [v2:172.21.15.105:6817/33369,v1:172.21.15.105:6819/33369] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa7700ac340 con 0x7fa7700b0100 2023-10-06T03:01:04.318 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.263+0000 7fa75e7fc700 1 -- 172.21.15.57:0/3654530708 <== osd.6 v2:172.21.15.105:6817/33369 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa7700ac340 con 0x7fa7700b0100 2023-10-06T03:01:04.318 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.263+0000 7f11e77fe700 1 -- 172.21.15.57:0/943826298 shutdown_connections 2023-10-06T03:01:04.318 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.263+0000 7f11e77fe700 1 -- 172.21.15.57:0/943826298 >> 172.21.15.57:0/943826298 conn(0x7f12040c85e0 msgr2=0x7f1204160040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:04.319 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.263+0000 7f11e77fe700 1 -- 172.21.15.57:0/943826298 shutdown_connections 2023-10-06T03:01:04.319 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.263+0000 7f11e77fe700 1 -- 172.21.15.57:0/943826298 wait complete. 2023-10-06T03:01:04.319 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.263+0000 7fc2c2ffd700 1 -- 172.21.15.57:0/3577525915 --> [v2:172.21.15.105:6800/33368,v1:172.21.15.105:6801/33368] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc2d00379d0 con 0x7fc2bc068e00 2023-10-06T03:01:04.320 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.267+0000 7fa76f59e700 1 -- 172.21.15.57:0/3654530708 >> [v2:172.21.15.105:6817/33369,v1:172.21.15.105:6819/33369] conn(0x7fa7700b0100 msgr2=0x7fa77014a890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:04.320 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.267+0000 7fa76f59e700 1 --2- 172.21.15.57:0/3654530708 >> [v2:172.21.15.105:6817/33369,v1:172.21.15.105:6819/33369] conn(0x7fa7700b0100 0x7fa77014a890 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.320 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.267+0000 7fa76f59e700 1 -- 172.21.15.57:0/3654530708 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fa750060650 msgr2=0x7fa750062b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:04.320 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.267+0000 7fa76f59e700 1 --2- 172.21.15.57:0/3654530708 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fa750060650 0x7fa750062b00 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa76800ad60 tx=0x7fa768009350 comp rx=0 tx=0).stop 2023-10-06T03:01:04.320 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.267+0000 7fa76f59e700 1 -- 172.21.15.57:0/3654530708 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7700c6a40 msgr2=0x7fa7700afbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:04.320 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.267+0000 7fa76f59e700 1 --2- 172.21.15.57:0/3654530708 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7700c6a40 0x7fa7700afbc0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa77006bd50 tx=0x7fa760017000 comp rx=0 tx=0).stop 2023-10-06T03:01:04.320 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.267+0000 7fa76ed9d700 1 -- 172.21.15.57:0/3654530708 reap_dead start 2023-10-06T03:01:04.321 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.267+0000 7fa76f59e700 1 -- 172.21.15.57:0/3654530708 shutdown_connections 2023-10-06T03:01:04.321 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.267+0000 7fa76f59e700 1 -- 172.21.15.57:0/3654530708 >> 172.21.15.57:0/3654530708 conn(0x7fa7700c85e0 msgr2=0x7fa7700c89b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:04.321 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.267+0000 7fa76f59e700 1 -- 172.21.15.57:0/3654530708 shutdown_connections 2023-10-06T03:01:04.321 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.267+0000 7fa76f59e700 1 -- 172.21.15.57:0/3654530708 wait complete. 2023-10-06T03:01:04.322 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.267+0000 7fc2cd7fa700 1 -- 172.21.15.57:0/3577525915 <== osd.4 v2:172.21.15.105:6800/33368 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc2d806b020 con 0x7fc2bc068e00 2023-10-06T03:01:04.322 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.267+0000 7fc2c2ffd700 1 -- 172.21.15.57:0/3577525915 >> [v2:172.21.15.105:6800/33368,v1:172.21.15.105:6801/33368] conn(0x7fc2bc068e00 msgr2=0x7fc2bc06b210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:04.322 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.267+0000 7fc2c2ffd700 1 --2- 172.21.15.57:0/3577525915 >> [v2:172.21.15.105:6800/33368,v1:172.21.15.105:6801/33368] conn(0x7fc2bc068e00 0x7fc2bc06b210 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.322 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.267+0000 7f8ee5545700 1 -- 172.21.15.57:0/4219614746 --> [v2:172.21.15.57:6809/33052,v1:172.21.15.57:6810/33052] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8ec4002d30 con 0x7f8ec0068ea0 2023-10-06T03:01:04.323 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.267+0000 7fc2c2ffd700 1 -- 172.21.15.57:0/3577525915 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fc2bc0605d0 msgr2=0x7fc2bc062a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:04.323 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.267+0000 7fc2c2ffd700 1 --2- 172.21.15.57:0/3577525915 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fc2bc0605d0 0x7fc2bc062a80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc2d00e0a90 tx=0x7fc2c8008040 comp rx=0 tx=0).stop 2023-10-06T03:01:04.323 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.267+0000 7fc2c2ffd700 1 -- 172.21.15.57:0/3577525915 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc2d0036a40 msgr2=0x7fc2d004f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:04.323 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.267+0000 7fc2c2ffd700 1 --2- 172.21.15.57:0/3577525915 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc2d0036a40 0x7fc2d004f810 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fc2d000c0d0 tx=0x7fc2d4017000 comp rx=0 tx=0).stop 2023-10-06T03:01:04.324 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.267+0000 7fc2ddee2700 1 -- 172.21.15.57:0/3577525915 reap_dead start 2023-10-06T03:01:04.324 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.267+0000 7f8ed77fe700 1 -- 172.21.15.57:0/4219614746 <== osd.1 v2:172.21.15.57:6809/33052 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8ec4002d30 con 0x7f8ec0068ea0 2023-10-06T03:01:04.324 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.271+0000 7fa636ffd700 1 -- 172.21.15.57:0/4040347178 --> [v2:172.21.15.105:6808/33370,v1:172.21.15.105:6809/33370] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa624002d30 con 0x7fa630068ed0 2023-10-06T03:01:04.325 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.271+0000 7f8ed4ff9700 1 -- 172.21.15.57:0/4219614746 >> [v2:172.21.15.57:6809/33052,v1:172.21.15.57:6810/33052] conn(0x7f8ec0068ea0 msgr2=0x7f8ec006b2b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:04.325 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.271+0000 7f8ed4ff9700 1 --2- 172.21.15.57:0/4219614746 >> [v2:172.21.15.57:6809/33052,v1:172.21.15.57:6810/33052] conn(0x7f8ec0068ea0 0x7f8ec006b2b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.325 INFO:teuthology.orchestra.run.smithi057.stdout:55834574853 2023-10-06T03:01:04.326 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-06T03:01:04.326 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.271+0000 7f8ed4ff9700 1 -- 172.21.15.57:0/4219614746 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f8ec0060670 msgr2=0x7f8ec0062b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:04.326 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.271+0000 7f8ed4ff9700 1 --2- 172.21.15.57:0/4219614746 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f8ec0060670 0x7f8ec0062b20 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8ec80078a0 tx=0x7f8ec8007830 comp rx=0 tx=0).stop 2023-10-06T03:01:04.327 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.271+0000 7fc2c2ffd700 1 -- 172.21.15.57:0/3577525915 shutdown_connections 2023-10-06T03:01:04.327 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.271+0000 7f8ed4ff9700 1 -- 172.21.15.57:0/4219614746 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8ee0158900 msgr2=0x7f8ee00c5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:04.327 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.271+0000 7f8ed4ff9700 1 --2- 172.21.15.57:0/4219614746 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8ee0158900 0x7f8ee00c5990 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f8ee006d150 tx=0x7f8ed8001630 comp rx=0 tx=0).stop 2023-10-06T03:01:04.327 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.271+0000 7fa6417fa700 1 -- 172.21.15.57:0/4040347178 <== osd.7 v2:172.21.15.105:6808/33370 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa624002d30 con 0x7fa630068ed0 2023-10-06T03:01:04.328 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.271+0000 7f8edf7fe700 1 -- 172.21.15.57:0/4219614746 reap_dead start 2023-10-06T03:01:04.328 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.271+0000 7f8ed4ff9700 1 -- 172.21.15.57:0/4219614746 shutdown_connections 2023-10-06T03:01:04.328 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.271+0000 7f8ed4ff9700 1 -- 172.21.15.57:0/4219614746 >> 172.21.15.57:0/4219614746 conn(0x7f8ee00cbb50 msgr2=0x7f8ee015a900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:04.328 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.271+0000 7fc2c2ffd700 1 -- 172.21.15.57:0/3577525915 >> 172.21.15.57:0/3577525915 conn(0x7fc2d0009e80 msgr2=0x7fc2d0035e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:04.329 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.271+0000 7f8ed4ff9700 1 -- 172.21.15.57:0/4219614746 shutdown_connections 2023-10-06T03:01:04.329 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.271+0000 7f8ed4ff9700 1 -- 172.21.15.57:0/4219614746 wait complete. 2023-10-06T03:01:04.330 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.271+0000 7fc2c2ffd700 1 -- 172.21.15.57:0/3577525915 shutdown_connections 2023-10-06T03:01:04.330 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.271+0000 7fc2c2ffd700 1 -- 172.21.15.57:0/3577525915 wait complete. 2023-10-06T03:01:04.331 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.271+0000 7fa636ffd700 1 -- 172.21.15.57:0/4040347178 >> [v2:172.21.15.105:6808/33370,v1:172.21.15.105:6809/33370] conn(0x7fa630068ed0 msgr2=0x7fa63006b2e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:04.331 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.271+0000 7fa636ffd700 1 --2- 172.21.15.57:0/4040347178 >> [v2:172.21.15.105:6808/33370,v1:172.21.15.105:6809/33370] conn(0x7fa630068ed0 0x7fa63006b2e0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.331 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.271+0000 7fa636ffd700 1 -- 172.21.15.57:0/4040347178 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fa6300606a0 msgr2=0x7fa630062b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:04.331 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.271+0000 7fa636ffd700 1 --2- 172.21.15.57:0/4040347178 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fa6300606a0 0x7fa630062b50 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa6440097c0 tx=0x7fa63c007d50 comp rx=0 tx=0).stop 2023-10-06T03:01:04.331 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.271+0000 7fa636ffd700 1 -- 172.21.15.57:0/4040347178 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa644036a40 msgr2=0x7fa6440dbb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:04.331 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.271+0000 7fa636ffd700 1 --2- 172.21.15.57:0/4040347178 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa644036a40 0x7fa6440dbb90 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa648009290 tx=0x7fa648017000 comp rx=0 tx=0).stop 2023-10-06T03:01:04.331 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.271+0000 7fa651ee2700 1 -- 172.21.15.57:0/4040347178 reap_dead start 2023-10-06T03:01:04.331 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.271+0000 7fa636ffd700 1 -- 172.21.15.57:0/4040347178 shutdown_connections 2023-10-06T03:01:04.331 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.271+0000 7fa636ffd700 1 -- 172.21.15.57:0/4040347178 >> 172.21.15.57:0/4040347178 conn(0x7fa644009e80 msgr2=0x7fa6440e0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:04.331 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.275+0000 7fa636ffd700 1 -- 172.21.15.57:0/4040347178 shutdown_connections 2023-10-06T03:01:04.332 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.275+0000 7fa636ffd700 1 -- 172.21.15.57:0/4040347178 wait complete. 2023-10-06T03:01:04.332 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.279+0000 7fa7e7fff700 1 -- 172.21.15.57:0/1312457288 --> [v2:172.21.15.105:6816/33379,v1:172.21.15.105:6818/33379] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa7e80cd870 con 0x7fa7d4068d60 2023-10-06T03:01:04.332 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.279+0000 7fa7ceffd700 1 -- 172.21.15.57:0/1312457288 <== osd.5 v2:172.21.15.105:6816/33379 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa7e80cd870 con 0x7fa7d4068d60 2023-10-06T03:01:04.333 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.279+0000 7fa7e7fff700 1 -- 172.21.15.57:0/1312457288 >> [v2:172.21.15.105:6816/33379,v1:172.21.15.105:6818/33379] conn(0x7fa7d4068d60 msgr2=0x7fa7d406b170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:04.333 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.279+0000 7fa7e7fff700 1 --2- 172.21.15.57:0/1312457288 >> [v2:172.21.15.105:6816/33379,v1:172.21.15.105:6818/33379] conn(0x7fa7d4068d60 0x7fa7d406b170 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.334 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.279+0000 7fa7e7fff700 1 -- 172.21.15.57:0/1312457288 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fa7d4060620 msgr2=0x7fa7d4062ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:04.334 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.279+0000 7fa7e7fff700 1 --2- 172.21.15.57:0/1312457288 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fa7d4060620 0x7fa7d4062ad0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa7dc0030c0 tx=0x7fa7dc016000 comp rx=0 tx=0).stop 2023-10-06T03:01:04.334 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.279+0000 7fa7e7fff700 1 -- 172.21.15.57:0/1312457288 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa7e80cb580 msgr2=0x7fa7e80c6900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:04.334 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.279+0000 7fa7e7fff700 1 --2- 172.21.15.57:0/1312457288 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa7e80cb580 0x7fa7e80c6900 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fa7d800c810 tx=0x7fa7d8007de0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.334 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.283+0000 7fa7e77fe700 1 -- 172.21.15.57:0/1312457288 reap_dead start 2023-10-06T03:01:04.334 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.283+0000 7fa7e7fff700 1 -- 172.21.15.57:0/1312457288 shutdown_connections 2023-10-06T03:01:04.334 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.283+0000 7fa7e7fff700 1 -- 172.21.15.57:0/1312457288 >> 172.21.15.57:0/1312457288 conn(0x7fa7e8067050 msgr2=0x7fa7e80b5680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:04.334 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.287+0000 7fa7e7fff700 1 -- 172.21.15.57:0/1312457288 shutdown_connections 2023-10-06T03:01:04.334 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.287+0000 7fa7e7fff700 1 -- 172.21.15.57:0/1312457288 wait complete. 2023-10-06T03:01:04.335 INFO:teuthology.orchestra.run.smithi057.stdout:55834574853 2023-10-06T03:01:04.335 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-06T03:01:04.336 INFO:teuthology.orchestra.run.smithi057.stdout:55834574854 2023-10-06T03:01:04.336 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-06T03:01:04.337 INFO:teuthology.orchestra.run.smithi057.stdout:55834574853 2023-10-06T03:01:04.337 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-06T03:01:04.338 INFO:teuthology.orchestra.run.smithi057.stdout:55834574854 2023-10-06T03:01:04.339 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-06T03:01:04.339 INFO:teuthology.orchestra.run.smithi057.stdout:55834574853 2023-10-06T03:01:04.340 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-06T03:01:04.340 INFO:teuthology.orchestra.run.smithi057.stdout:55834574854 2023-10-06T03:01:04.341 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-06T03:01:04.341 INFO:teuthology.orchestra.run.smithi057.stdout:55834574854 2023-10-06T03:01:04.342 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-06T03:01:04.585 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.579+0000 7fbeb24e3700 1 Processor -- start 2023-10-06T03:01:04.586 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.579+0000 7fbeb24e3700 1 -- start start 2023-10-06T03:01:04.588 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.583+0000 7fbeb24e3700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbeac06dc40 0x7fbeac0c6810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:04.588 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.583+0000 7fbeb24e3700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbeac0c7190 con 0x7fbeac0cb6b0 2023-10-06T03:01:04.588 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.583+0000 7fbeb24e3700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbeac06bc10 con 0x7fbeac0c6d50 2023-10-06T03:01:04.588 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.583+0000 7fbeb24e3700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbeac06b750 con 0x7fbeac06dc40 2023-10-06T03:01:04.589 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.583+0000 7fbeb14e1700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fbeac0cb6b0 0x7fbeac06b040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:45782/0 (socket says 172.21.15.57:45782) 2023-10-06T03:01:04.589 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.583+0000 7fbeb14e1700 1 -- 172.21.15.57:0/1516349947 learned_addr learned my addr 172.21.15.57:0/1516349947 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:01:04.589 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.583+0000 7fbeb0ce0700 1 --2- 172.21.15.57:0/1516349947 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbeac06dc40 0x7fbeac0c6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:04.590 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.583+0000 7fbea3fff700 1 -- 172.21.15.57:0/1516349947 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 699950027 0 0) 0x7fbeac0c7190 con 0x7fbeac0cb6b0 2023-10-06T03:01:04.590 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.583+0000 7fbeb0ce0700 1 -- 172.21.15.57:0/1516349947 >> v1:172.21.15.105:6789/0 conn(0x7fbeac0c6d50 legacy=0x7fbeac158e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:04.590 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.583+0000 7fbeb0ce0700 1 -- 172.21.15.57:0/1516349947 >> v1:172.21.15.57:6789/0 conn(0x7fbeac0cb6b0 legacy=0x7fbeac06b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:04.590 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.583+0000 7fbeb0ce0700 1 -- 172.21.15.57:0/1516349947 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbeac15c090 con 0x7fbeac06dc40 2023-10-06T03:01:04.590 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.583+0000 7fbeb0ce0700 1 --2- 172.21.15.57:0/1516349947 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbeac06dc40 0x7fbeac0c6810 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fbea4009e90 tx=0x7fbea4009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=906a3e989cc08142 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:04.591 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.587+0000 7fbea3fff700 1 -- 172.21.15.57:0/1516349947 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbea400e070 con 0x7fbeac06dc40 2023-10-06T03:01:04.591 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.587+0000 7fbea3fff700 1 -- 172.21.15.57:0/1516349947 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbea400bc30 con 0x7fbeac06dc40 2023-10-06T03:01:04.591 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.587+0000 7fbea3fff700 1 -- 172.21.15.57:0/1516349947 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbea4012430 con 0x7fbeac06dc40 2023-10-06T03:01:04.593 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.587+0000 7fbeb24e3700 1 -- 172.21.15.57:0/1516349947 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbeac06dc40 msgr2=0x7fbeac0c6810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:04.593 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.587+0000 7fbeb24e3700 1 --2- 172.21.15.57:0/1516349947 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbeac06dc40 0x7fbeac0c6810 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fbea4009e90 tx=0x7fbea4009780 comp rx=0 tx=0).stop 2023-10-06T03:01:04.593 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.587+0000 7fbeb24e3700 1 -- 172.21.15.57:0/1516349947 shutdown_connections 2023-10-06T03:01:04.593 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.587+0000 7fbeb24e3700 1 --2- 172.21.15.57:0/1516349947 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbeac06dc40 0x7fbeac0c6810 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.594 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.587+0000 7fbeb24e3700 1 -- 172.21.15.57:0/1516349947 >> 172.21.15.57:0/1516349947 conn(0x7fbeac0c85e0 msgr2=0x7fbeac0c89e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:04.595 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.587+0000 7fbeb24e3700 1 -- 172.21.15.57:0/1516349947 shutdown_connections 2023-10-06T03:01:04.595 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.587+0000 7fbeb24e3700 1 -- 172.21.15.57:0/1516349947 wait complete. 2023-10-06T03:01:04.595 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.591+0000 7fbeb24e3700 1 Processor -- start 2023-10-06T03:01:04.600 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.591+0000 7fbeb24e3700 1 -- start start 2023-10-06T03:01:04.600 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.591+0000 7fbeb24e3700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbeac06dc40 0x7fbeac158300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:04.600 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.591+0000 7fbeb24e3700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbeac0c6d50 0x7fbeac159f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:04.600 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.591+0000 7fbeb24e3700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbeac0cb6b0 0x7fbeac15a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:04.600 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.591+0000 7fbeb24e3700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbeac14c0d0 con 0x7fbeac06dc40 2023-10-06T03:01:04.600 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.591+0000 7fbeb24e3700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbeac155c50 con 0x7fbeac0cb6b0 2023-10-06T03:01:04.600 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.591+0000 7fbeb24e3700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbeac1564f0 con 0x7fbeac0c6d50 2023-10-06T03:01:04.601 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.591+0000 7fbeb14e1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbeac06dc40 0x7fbeac158300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:04.601 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.591+0000 7fbeb14e1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbeac06dc40 0x7fbeac158300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55722/0 (socket says 172.21.15.57:55722) 2023-10-06T03:01:04.601 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.591+0000 7fbeb14e1700 1 -- 172.21.15.57:0/4049309859 learned_addr learned my addr 172.21.15.57:0/4049309859 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:04.601 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.591+0000 7fbeb0ce0700 1 --2- 172.21.15.57:0/4049309859 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbeac0c6d50 0x7fbeac159f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:04.601 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.595+0000 7fbeb1ce2700 1 --2- 172.21.15.57:0/4049309859 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbeac0cb6b0 0x7fbeac15a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:04.601 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.595+0000 7fbeb14e1700 1 -- 172.21.15.57:0/4049309859 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbeac0c6d50 msgr2=0x7fbeac159f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:04.601 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.595+0000 7fbeb14e1700 1 --2- 172.21.15.57:0/4049309859 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbeac0c6d50 0x7fbeac159f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.601 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.595+0000 7fbeb14e1700 1 -- 172.21.15.57:0/4049309859 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbeac0cb6b0 msgr2=0x7fbeac15a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:04.601 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.595+0000 7fbeb14e1700 1 --2- 172.21.15.57:0/4049309859 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbeac0cb6b0 0x7fbeac15a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.601 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.595+0000 7fbeb14e1700 1 -- 172.21.15.57:0/4049309859 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbea4009a20 con 0x7fbeac06dc40 2023-10-06T03:01:04.601 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.595+0000 7fbeb14e1700 1 --2- 172.21.15.57:0/4049309859 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbeac06dc40 0x7fbeac158300 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fbea800c5e0 tx=0x7fbea8001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:04.602 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.595+0000 7fbea17fa700 1 -- 172.21.15.57:0/4049309859 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbea8005b30 con 0x7fbeac06dc40 2023-10-06T03:01:04.602 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.595+0000 7fbea17fa700 1 -- 172.21.15.57:0/4049309859 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbea8005c90 con 0x7fbeac06dc40 2023-10-06T03:01:04.602 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.595+0000 7fbeb24e3700 1 -- 172.21.15.57:0/4049309859 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbeac14efb0 con 0x7fbeac06dc40 2023-10-06T03:01:04.602 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.595+0000 7fd995f85700 1 Processor -- start 2023-10-06T03:01:04.603 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.595+0000 7fbeb24e3700 1 -- 172.21.15.57:0/4049309859 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbeac156180 con 0x7fbeac06dc40 2023-10-06T03:01:04.603 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.595+0000 7fbea17fa700 1 -- 172.21.15.57:0/4049309859 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbea8007300 con 0x7fbeac06dc40 2023-10-06T03:01:04.603 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.595+0000 7fd995f85700 1 -- start start 2023-10-06T03:01:04.603 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.595+0000 7fa047f45700 1 Processor -- start 2023-10-06T03:01:04.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.595+0000 7fbeb24e3700 1 -- 172.21.15.57:0/4049309859 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbeac04be40 con 0x7fbeac06dc40 2023-10-06T03:01:04.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.595+0000 7fa047f45700 1 -- start start 2023-10-06T03:01:04.605 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.599+0000 7f74f426e700 1 Processor -- start 2023-10-06T03:01:04.605 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.599+0000 7f74f426e700 1 -- start start 2023-10-06T03:01:04.605 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.599+0000 7fd995f85700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd9900cffc0 0x7fd9900d0390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:04.605 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.599+0000 7fa047f45700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fa040158fb0 0x7fa04006cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:04.606 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.599+0000 7fa047f45700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa040159380 0x7fa0400aff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:04.606 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.599+0000 7fa047f45700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa04006dc90 con 0x7fa04006a670 2023-10-06T03:01:04.606 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.599+0000 7fa047f45700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0400ca970 con 0x7fa040159380 2023-10-06T03:01:04.606 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.599+0000 7fa047f45700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa04006d3f0 con 0x7fa040158fb0 2023-10-06T03:01:04.606 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.599+0000 7fd98effd700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fd9900b38e0 0x7fd99006d1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:45786/0 (socket says 172.21.15.57:45786) 2023-10-06T03:01:04.606 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.599+0000 7fd98f7fe700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd9900cffc0 0x7fd9900d0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:04.607 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.599+0000 7fbea17fa700 1 -- 172.21.15.57:0/4049309859 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fbea80076b0 con 0x7fbeac06dc40 2023-10-06T03:01:04.607 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.599+0000 7fbea17fa700 1 --2- 172.21.15.57:0/4049309859 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fbe90060580 0x7fbe90062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:04.607 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.599+0000 7fd98f7fe700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd9900cffc0 0x7fd9900d0390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.57:46004/0 (socket says 172.21.15.57:46004) 2023-10-06T03:01:04.607 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.599+0000 7fd98effd700 1 -- 172.21.15.57:0/2706666294 learned_addr learned my addr 172.21.15.57:0/2706666294 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:01:04.607 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.599+0000 7fa0454e0700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa040159380 0x7fa0400aff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:04.607 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.599+0000 7fa045ce1700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fa040158fb0 0x7fa04006cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:04.608 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.599+0000 7fa045ce1700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fa040158fb0 0x7fa04006cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.57:39358/0 (socket says 172.21.15.57:39358) 2023-10-06T03:01:04.608 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.599+0000 7fa045ce1700 1 -- 172.21.15.57:0/1567335615 learned_addr learned my addr 172.21.15.57:0/1567335615 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:04.608 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.599+0000 7fd995f85700 1 -- 172.21.15.57:0/2706666294 --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd99006b8c0 con 0x7fd9900b38e0 2023-10-06T03:01:04.608 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.599+0000 7fd995f85700 1 -- 172.21.15.57:0/2706666294 --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9900b3d30 con 0x7fd99006b440 2023-10-06T03:01:04.608 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.599+0000 7fd995f85700 1 -- 172.21.15.57:0/2706666294 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9900b3fe0 con 0x7fd9900cffc0 2023-10-06T03:01:04.608 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.599+0000 7fa045ce1700 1 -- 172.21.15.57:0/1567335615 >> v2:172.21.15.57:3300/0 conn(0x7fa040159380 msgr2=0x7fa0400aff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:04.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.599+0000 7fa045ce1700 1 --2- 172.21.15.57:0/1567335615 >> v2:172.21.15.57:3300/0 conn(0x7fa040159380 0x7fa0400aff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.599+0000 7fa045ce1700 1 -- 172.21.15.57:0/1567335615 >> v1:172.21.15.105:6789/0 conn(0x7fa04006a670 legacy=0x7fa0400cc930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:04.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.599+0000 7fa045ce1700 1 -- 172.21.15.57:0/1567335615 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa04006d6d0 con 0x7fa040158fb0 2023-10-06T03:01:04.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.599+0000 7f74f426e700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f74ec159370 0x7f74ec06ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:04.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.599+0000 7f74f426e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f74ec0c3740 0x7f74ec0c1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:04.610 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.599+0000 7fa045ce1700 1 --2- 172.21.15.57:0/1567335615 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa040158fb0 0x7fa04006cbc0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa04006b880 tx=0x7fa030009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d90a690110c14c68 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:04.610 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.603+0000 7fd98f7fe700 1 -- 172.21.15.57:0/2706666294 >> v1:172.21.15.105:6789/0 conn(0x7fd99006b440 legacy=0x7fd99006d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:04.610 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.603+0000 7fd98f7fe700 1 -- 172.21.15.57:0/2706666294 >> v1:172.21.15.57:6789/0 conn(0x7fd9900b38e0 legacy=0x7fd99006d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:04.611 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.603+0000 7f74f1809700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f74ec159370 0x7f74ec06ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:04.611 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.603+0000 7fd98f7fe700 1 -- 172.21.15.57:0/2706666294 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9900b42c0 con 0x7fd9900cffc0 2023-10-06T03:01:04.612 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.603+0000 7f74f1809700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f74ec159370 0x7f74ec06ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.57:39366/0 (socket says 172.21.15.57:39366) 2023-10-06T03:01:04.612 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.603+0000 7f74f1809700 1 -- 172.21.15.57:0/757011796 learned_addr learned my addr 172.21.15.57:0/757011796 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:04.612 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.603+0000 7f74f426e700 1 -- 172.21.15.57:0/757011796 --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74ec0b29e0 con 0x7f74ec158fa0 2023-10-06T03:01:04.612 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.603+0000 7f74f426e700 1 -- 172.21.15.57:0/757011796 --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74ec06f3c0 con 0x7f74ec0c3740 2023-10-06T03:01:04.612 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.603+0000 7f74f300c700 1 --2- 172.21.15.57:0/757011796 >> v2:172.21.15.57:3300/0 conn(0x7f74ec0c3740 0x7f74ec0c1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:04.613 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.603+0000 7fa044cdf700 1 -- 172.21.15.57:0/1567335615 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa03000b820 con 0x7fa040158fb0 2023-10-06T03:01:04.613 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.603+0000 7fa044cdf700 1 -- 172.21.15.57:0/1567335615 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa03000b980 con 0x7fa040158fb0 2023-10-06T03:01:04.613 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.603+0000 7f74f426e700 1 -- 172.21.15.57:0/757011796 --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74ec0ca2f0 con 0x7f74ec159370 2023-10-06T03:01:04.614 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.603+0000 7fa044cdf700 1 -- 172.21.15.57:0/1567335615 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa03000bd00 con 0x7fa040158fb0 2023-10-06T03:01:04.614 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.603+0000 7fd98f7fe700 1 --2- 172.21.15.57:0/2706666294 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd9900cffc0 0x7fd9900d0390 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd984009910 tx=0x7fd9840091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c2c4e2630cd1c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:04.615 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.603+0000 7fd98e7fc700 1 -- 172.21.15.57:0/2706666294 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd98400b860 con 0x7fd9900cffc0 2023-10-06T03:01:04.615 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.603+0000 7fd98e7fc700 1 -- 172.21.15.57:0/2706666294 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd98400b9c0 con 0x7fd9900cffc0 2023-10-06T03:01:04.615 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.603+0000 7fd98e7fc700 1 -- 172.21.15.57:0/2706666294 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd98400bd60 con 0x7fd9900cffc0 2023-10-06T03:01:04.616 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.603+0000 7f74f1809700 1 -- 172.21.15.57:0/757011796 >> v2:172.21.15.57:3300/0 conn(0x7f74ec0c3740 msgr2=0x7f74ec0c1ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:04.616 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.603+0000 7f74f1809700 1 --2- 172.21.15.57:0/757011796 >> v2:172.21.15.57:3300/0 conn(0x7f74ec0c3740 0x7f74ec0c1ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.616 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.603+0000 7f74f1809700 1 -- 172.21.15.57:0/757011796 >> v1:172.21.15.57:6789/0 conn(0x7f74ec158fa0 legacy=0x7f74ec0c3030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:04.616 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.603+0000 7f74f1809700 1 -- 172.21.15.57:0/757011796 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74ec0c96e0 con 0x7f74ec159370 2023-10-06T03:01:04.617 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.603+0000 7f74f1809700 1 --2- 172.21.15.57:0/757011796 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f74ec159370 0x7f74ec06ee80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f74ec15cbd0 tx=0x7f74dc009220 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b369f86516c4df2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:04.617 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.603+0000 7fd995f85700 1 -- 172.21.15.57:0/2706666294 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd9900cffc0 msgr2=0x7fd9900d0390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:04.617 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.603+0000 7fd995f85700 1 --2- 172.21.15.57:0/2706666294 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd9900cffc0 0x7fd9900d0390 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd984009910 tx=0x7fd9840091a0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.617 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.603+0000 7fa047f45700 1 -- 172.21.15.57:0/1567335615 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa040158fb0 msgr2=0x7fa04006cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:04.618 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.603+0000 7fa047f45700 1 --2- 172.21.15.57:0/1567335615 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa040158fb0 0x7fa04006cbc0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa04006b880 tx=0x7fa030009250 comp rx=0 tx=0).stop 2023-10-06T03:01:04.618 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.603+0000 7fa047f45700 1 -- 172.21.15.57:0/1567335615 shutdown_connections 2023-10-06T03:01:04.618 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.603+0000 7fa047f45700 1 --2- 172.21.15.57:0/1567335615 >> v2:172.21.15.57:3300/0 conn(0x7fa040159380 0x7fa0400aff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.618 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.603+0000 7fa047f45700 1 --2- 172.21.15.57:0/1567335615 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa040158fb0 0x7fa04006cbc0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.618 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.603+0000 7fa047f45700 1 -- 172.21.15.57:0/1567335615 >> 172.21.15.57:0/1567335615 conn(0x7fa040067050 msgr2=0x7fa040067420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:04.618 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.603+0000 7fd995f85700 1 -- 172.21.15.57:0/2706666294 shutdown_connections 2023-10-06T03:01:04.619 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.603+0000 7fd995f85700 1 --2- 172.21.15.57:0/2706666294 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd9900cffc0 0x7fd9900d0390 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.619 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.603+0000 7fd995f85700 1 -- 172.21.15.57:0/2706666294 >> 172.21.15.57:0/2706666294 conn(0x7fd990067050 msgr2=0x7fd990067450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:04.619 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.603+0000 7fa047f45700 1 -- 172.21.15.57:0/1567335615 shutdown_connections 2023-10-06T03:01:04.619 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.603+0000 7fd995f85700 1 -- 172.21.15.57:0/2706666294 shutdown_connections 2023-10-06T03:01:04.620 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.599+0000 7f9f01d23700 1 Processor -- start 2023-10-06T03:01:04.620 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.599+0000 7f9f01d23700 1 -- start start 2023-10-06T03:01:04.621 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.599+0000 7f9f01d23700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f9efc0ada50 0x7f9efc0aba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:04.621 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.599+0000 7f9efbfff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f9efc0865a0 0x7f9efc06d2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:45796/0 (socket says 172.21.15.57:45796) 2023-10-06T03:01:04.621 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.599+0000 7f9f01d23700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f9efc0aaa80 0x7f9efc0aae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:04.621 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.599+0000 7f9efbfff700 1 -- 172.21.15.57:0/4113974955 learned_addr learned my addr 172.21.15.57:0/4113974955 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:01:04.621 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.599+0000 7f9f01d23700 1 -- 172.21.15.57:0/4113974955 --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9efc06ad70 con 0x7f9efc0865a0 2023-10-06T03:01:04.621 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.599+0000 7f9f01d23700 1 -- 172.21.15.57:0/4113974955 --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9efc0abf40 con 0x7f9efc0ada50 2023-10-06T03:01:04.621 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.603+0000 7f9f01d23700 1 -- 172.21.15.57:0/4113974955 --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9efc0ade20 con 0x7f9efc0aaa80 2023-10-06T03:01:04.621 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.603+0000 7f9f01522700 1 --2- 172.21.15.57:0/4113974955 >> v2:172.21.15.105:3300/0 conn(0x7f9efc0aaa80 0x7f9efc0aae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:04.622 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.603+0000 7fd995f85700 1 -- 172.21.15.57:0/2706666294 wait complete. 2023-10-06T03:01:04.622 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.603+0000 7fa047f45700 1 -- 172.21.15.57:0/1567335615 wait complete. 2023-10-06T03:01:04.622 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.603+0000 7f9f01522700 1 -- 172.21.15.57:0/4113974955 >> v2:172.21.15.57:3300/0 conn(0x7f9efc0ada50 msgr2=0x7f9efc0aba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:04.623 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.607+0000 7fbeb0ce0700 1 --2- 172.21.15.57:0/4049309859 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fbe90060580 0x7fbe90062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:04.623 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.603+0000 7f9f01522700 1 --2- 172.21.15.57:0/4113974955 >> v2:172.21.15.57:3300/0 conn(0x7f9efc0ada50 0x7f9efc0aba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.624 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.603+0000 7f9f01522700 1 -- 172.21.15.57:0/4113974955 >> v1:172.21.15.57:6789/0 conn(0x7f9efc0865a0 legacy=0x7f9efc06d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:04.624 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.603+0000 7f9f01522700 1 -- 172.21.15.57:0/4113974955 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9efc06a790 con 0x7f9efc0aaa80 2023-10-06T03:01:04.624 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.607+0000 7f9f01522700 1 --2- 172.21.15.57:0/4113974955 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9efc0aaa80 0x7f9efc0aae80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9efc0c2b10 tx=0x7f9ef40073d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dac785ea57372630 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:04.624 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.607+0000 7f9efb7fe700 1 -- 172.21.15.57:0/4113974955 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ef4017070 con 0x7f9efc0aaa80 2023-10-06T03:01:04.624 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.607+0000 7f9efb7fe700 1 -- 172.21.15.57:0/4113974955 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ef4009320 con 0x7f9efc0aaa80 2023-10-06T03:01:04.624 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.607+0000 7f9efb7fe700 1 -- 172.21.15.57:0/4113974955 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ef4007790 con 0x7f9efc0aaa80 2023-10-06T03:01:04.625 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.607+0000 7f74f1008700 1 -- 172.21.15.57:0/757011796 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74dc005c10 con 0x7f74ec159370 2023-10-06T03:01:04.625 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.607+0000 7fbeb0ce0700 1 --2- 172.21.15.57:0/4049309859 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fbe90060580 0x7fbe90062a30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fbea4009e90 tx=0x7fbea4019000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:04.626 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.607+0000 7f5abf59e700 1 Processor -- start 2023-10-06T03:01:04.626 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.607+0000 7fa047f45700 1 Processor -- start 2023-10-06T03:01:04.627 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.607+0000 7f74f1008700 1 -- 172.21.15.57:0/757011796 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74dc005d70 con 0x7f74ec159370 2023-10-06T03:01:04.627 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.607+0000 7f9f01d23700 1 -- 172.21.15.57:0/4113974955 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9efc0aaa80 msgr2=0x7f9efc0aae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:04.627 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.607+0000 7f9f01d23700 1 --2- 172.21.15.57:0/4113974955 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9efc0aaa80 0x7f9efc0aae80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9efc0c2b10 tx=0x7f9ef40073d0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.627 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.607+0000 7f9f01d23700 1 -- 172.21.15.57:0/4113974955 shutdown_connections 2023-10-06T03:01:04.628 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.607+0000 7f9f01d23700 1 --2- 172.21.15.57:0/4113974955 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9efc0aaa80 0x7f9efc0aae80 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.628 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.607+0000 7f9f01d23700 1 --2- 172.21.15.57:0/4113974955 >> v2:172.21.15.57:3300/0 conn(0x7f9efc0ada50 0x7f9efc0aba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.628 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.607+0000 7f9f01d23700 1 -- 172.21.15.57:0/4113974955 >> 172.21.15.57:0/4113974955 conn(0x7f9efc0c85e0 msgr2=0x7f9efc0c89e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:04.628 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.607+0000 7fbea17fa700 1 -- 172.21.15.57:0/4049309859 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fbea80503a0 con 0x7fbeac06dc40 2023-10-06T03:01:04.629 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.607+0000 7fd995f85700 1 Processor -- start 2023-10-06T03:01:04.629 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.607+0000 7f74f426e700 1 -- 172.21.15.57:0/757011796 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f74ec159370 msgr2=0x7f74ec06ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:04.629 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.607+0000 7f74f426e700 1 --2- 172.21.15.57:0/757011796 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f74ec159370 0x7f74ec06ee80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f74ec15cbd0 tx=0x7f74dc009220 comp rx=0 tx=0).stop 2023-10-06T03:01:04.630 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.607+0000 7f9f01d23700 1 -- 172.21.15.57:0/4113974955 shutdown_connections 2023-10-06T03:01:04.630 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.607+0000 7fa047f45700 1 -- start start 2023-10-06T03:01:04.630 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.607+0000 7f9f01d23700 1 -- 172.21.15.57:0/4113974955 wait complete. 2023-10-06T03:01:04.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.607+0000 7fa047f45700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa04006a670 0x7fa0400b56c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:04.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.607+0000 7fd995f85700 1 -- start start 2023-10-06T03:01:04.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.607+0000 7fd995f85700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd99006b440 0x7fd99014cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:04.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.607+0000 7fa045ce1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa04006a670 0x7fa0400b56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:04.632 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.607+0000 7fa045ce1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa04006a670 0x7fa0400b56c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55762/0 (socket says 172.21.15.57:55762) 2023-10-06T03:01:04.632 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.607+0000 7fd995f85700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd9900b38e0 0x7fd9900c56f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:04.632 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.611+0000 7f529182e700 1 Processor -- start 2023-10-06T03:01:04.633 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.607+0000 7f5abf59e700 1 -- start start 2023-10-06T03:01:04.633 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.607+0000 7f5abf59e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5ab80e23d0 0x7f5ab803bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:04.633 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.611+0000 7fa047f45700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa040158fb0 0x7fa0400c39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:04.634 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.611+0000 7fd98f7fe700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd99006b440 0x7fd99014cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:04.634 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.611+0000 7fd98f7fe700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd99006b440 0x7fd99014cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.57:39378/0 (socket says 172.21.15.57:39378) 2023-10-06T03:01:04.634 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.611+0000 7fd98f7fe700 1 -- 172.21.15.57:0/3952761453 learned_addr learned my addr 172.21.15.57:0/3952761453 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:04.634 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.611+0000 7fa047f45700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa040159380 0x7fa0400c97c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:04.635 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.611+0000 7f529182e700 1 -- start start 2023-10-06T03:01:04.636 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.611+0000 7fd98effd700 1 --2- 172.21.15.57:0/3952761453 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd9900b38e0 0x7fd9900c56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:04.636 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.611+0000 7fd995f85700 1 --2- 172.21.15.57:0/3952761453 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd9900cffc0 0x7fd9900c5c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:04.636 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.611+0000 7fd995f85700 1 -- 172.21.15.57:0/3952761453 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd990088b50 con 0x7fd9900b38e0 2023-10-06T03:01:04.636 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.611+0000 7fd995f85700 1 -- 172.21.15.57:0/3952761453 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd990087310 con 0x7fd99006b440 2023-10-06T03:01:04.636 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.611+0000 7fd995f85700 1 -- 172.21.15.57:0/3952761453 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd99014a2f0 con 0x7fd9900cffc0 2023-10-06T03:01:04.637 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.611+0000 7fa0454e0700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa040158fb0 0x7fa0400c39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:04.637 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.611+0000 7fa0454e0700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa040158fb0 0x7fa0400c39c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.57:39392/0 (socket says 172.21.15.57:39392) 2023-10-06T03:01:04.637 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.611+0000 7fbea17fa700 1 -- 172.21.15.57:0/4049309859 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fbea8081060 con 0x7fbeac06dc40 2023-10-06T03:01:04.637 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.611+0000 7f9f01d23700 1 Processor -- start 2023-10-06T03:01:04.638 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.611+0000 7fd994d23700 1 --2- 172.21.15.57:0/3952761453 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd9900cffc0 0x7fd9900c5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:04.638 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.611+0000 7fa047f45700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0400c6880 con 0x7fa04006a670 2023-10-06T03:01:04.638 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.611+0000 7fa047f45700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0400c63f0 con 0x7fa040158fb0 2023-10-06T03:01:04.638 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.611+0000 7fa047f45700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0400b5c00 con 0x7fa040159380 2023-10-06T03:01:04.639 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.611+0000 7fa045ce1700 1 -- 172.21.15.57:0/2949742492 learned_addr learned my addr 172.21.15.57:0/2949742492 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:04.639 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.611+0000 7fa0464e2700 1 --2- 172.21.15.57:0/2949742492 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa040159380 0x7fa0400c97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:04.639 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.611+0000 7f74f426e700 1 -- 172.21.15.57:0/757011796 shutdown_connections 2023-10-06T03:01:04.639 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.611+0000 7f74f426e700 1 --2- 172.21.15.57:0/757011796 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f74ec159370 0x7f74ec06ee80 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.639 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.611+0000 7f74f426e700 1 --2- 172.21.15.57:0/757011796 >> v2:172.21.15.57:3300/0 conn(0x7f74ec0c3740 0x7f74ec0c1ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.639 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.611+0000 7f74f426e700 1 -- 172.21.15.57:0/757011796 >> 172.21.15.57:0/757011796 conn(0x7f74ec0afbd0 msgr2=0x7f74ec0affd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:04.639 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.611+0000 7fd994d23700 1 -- 172.21.15.57:0/3952761453 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd99006b440 msgr2=0x7fd99014cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:04.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.611+0000 7f9f01d23700 1 -- start start 2023-10-06T03:01:04.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.611+0000 7fd994d23700 1 --2- 172.21.15.57:0/3952761453 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd99006b440 0x7fd99014cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.611+0000 7fd994d23700 1 -- 172.21.15.57:0/3952761453 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd9900b38e0 msgr2=0x7fd9900c56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:04.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.611+0000 7fd994d23700 1 --2- 172.21.15.57:0/3952761453 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd9900b38e0 0x7fd9900c56f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.611+0000 7fd994d23700 1 -- 172.21.15.57:0/3952761453 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd984009420 con 0x7fd9900cffc0 2023-10-06T03:01:04.641 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.611+0000 7f471b5c5700 1 Processor -- start 2023-10-06T03:01:04.641 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.611+0000 7fd994d23700 1 --2- 172.21.15.57:0/3952761453 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd9900cffc0 0x7fd9900c5c30 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd99006dfc0 tx=0x7fd9880096c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:04.641 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.611+0000 7f471b5c5700 1 -- start start 2023-10-06T03:01:04.642 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.611+0000 7fa045ce1700 1 -- 172.21.15.57:0/2949742492 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa040159380 msgr2=0x7fa0400c97c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:04.642 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.611+0000 7fa045ce1700 1 --2- 172.21.15.57:0/2949742492 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa040159380 0x7fa0400c97c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.642 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.611+0000 7fa045ce1700 1 -- 172.21.15.57:0/2949742492 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa040158fb0 msgr2=0x7fa0400c39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:04.642 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.611+0000 7fa045ce1700 1 --2- 172.21.15.57:0/2949742492 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa040158fb0 0x7fa0400c39c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.642 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.611+0000 7fa045ce1700 1 -- 172.21.15.57:0/2949742492 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0300094f0 con 0x7fa04006a670 2023-10-06T03:01:04.643 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.611+0000 7fd97b7fe700 1 -- 172.21.15.57:0/3952761453 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd98800cd50 con 0x7fd9900cffc0 2023-10-06T03:01:04.643 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.611+0000 7fd97b7fe700 1 -- 172.21.15.57:0/3952761453 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd988014440 con 0x7fd9900cffc0 2023-10-06T03:01:04.643 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.611+0000 7fd97b7fe700 1 -- 172.21.15.57:0/3952761453 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9880147e0 con 0x7fd9900cffc0 2023-10-06T03:01:04.643 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.611+0000 7fd995f85700 1 -- 172.21.15.57:0/3952761453 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd990089330 con 0x7fd9900cffc0 2023-10-06T03:01:04.643 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.611+0000 7f9f01d23700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9efc0865a0 0x7f9efc0c6b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:04.644 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.611+0000 7fd995f85700 1 -- 172.21.15.57:0/3952761453 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9900898f0 con 0x7fd9900cffc0 2023-10-06T03:01:04.644 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.611+0000 7f529182e700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f528c158e70 0x7f528c067050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:04.644 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.611+0000 7f529182e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f528c0a88c0 con 0x7f528c06d510 2023-10-06T03:01:04.644 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.611+0000 7f529182e700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f528c0c1e30 con 0x7f528c159240 2023-10-06T03:01:04.644 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.611+0000 7f529182e700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f528c06d990 con 0x7f528c158e70 2023-10-06T03:01:04.645 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.611+0000 7f5abe59c700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f5ab80e2000 0x7f5ab8007240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:45822/0 (socket says 172.21.15.57:45822) 2023-10-06T03:01:04.645 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.615+0000 7f9f01d23700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9efc0aaa80 0x7f9efc168c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:04.646 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.615+0000 7f9f01d23700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9efc0ada50 0x7f9efc0c2130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:04.646 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.615+0000 7f528b7fe700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f528c06d510 0x7f528c0c7230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:45830/0 (socket says 172.21.15.57:45830) 2023-10-06T03:01:04.646 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.615+0000 7f528b7fe700 1 -- 172.21.15.57:0/1799634961 learned_addr learned my addr 172.21.15.57:0/1799634961 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:01:04.647 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.615+0000 7f5abf59e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ab8053df0 con 0x7f5ab80e2000 2023-10-06T03:01:04.647 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.615+0000 7f5abf59e700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ab8054970 con 0x7f5ab803af90 2023-10-06T03:01:04.647 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.615+0000 7f5abf59e700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ab803c480 con 0x7f5ab80e23d0 2023-10-06T03:01:04.647 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.615+0000 7f5abe59c700 1 -- 172.21.15.57:0/1025336266 learned_addr learned my addr 172.21.15.57:0/1025336266 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:01:04.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.615+0000 7f9f01d23700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9efc0c29a0 con 0x7f9efc0aaa80 2023-10-06T03:01:04.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.615+0000 7f9f01d23700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9efc175eb0 con 0x7f9efc0ada50 2023-10-06T03:01:04.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.615+0000 7f528affd700 1 --2- 172.21.15.57:0/1799634961 >> v2:172.21.15.105:3300/0 conn(0x7f528c158e70 0x7f528c067050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:04.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.615+0000 7f9efbfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9efc0aaa80 0x7f9efc168c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:04.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.615+0000 7f9efbfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9efc0aaa80 0x7f9efc168c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55788/0 (socket says 172.21.15.57:55788) 2023-10-06T03:01:04.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.615+0000 7f9efbfff700 1 -- 172.21.15.57:0/2235514362 learned_addr learned my addr 172.21.15.57:0/2235514362 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:04.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.615+0000 7f9f00d21700 1 --2- 172.21.15.57:0/2235514362 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9efc0865a0 0x7f9efc0c6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:04.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.615+0000 7f5abdd9b700 1 --2- 172.21.15.57:0/1025336266 >> v2:172.21.15.57:3300/0 conn(0x7f5ab80e23d0 0x7f5ab803bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:04.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.615+0000 7f9f01522700 1 --2- 172.21.15.57:0/2235514362 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9efc0ada50 0x7f9efc0c2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:04.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.615+0000 7f9f01d23700 1 -- 172.21.15.57:0/2235514362 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9efc176e80 con 0x7f9efc0865a0 2023-10-06T03:01:04.652 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.611+0000 7fa045ce1700 1 --2- 172.21.15.57:0/2949742492 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa04006a670 0x7fa0400b56c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa030006fd0 tx=0x7fa030016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:04.652 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.615+0000 7fa035ffb700 1 -- 172.21.15.57:0/2949742492 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa030011de0 con 0x7fa04006a670 2023-10-06T03:01:04.653 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.615+0000 7fa035ffb700 1 -- 172.21.15.57:0/2949742492 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa03001b470 con 0x7fa04006a670 2023-10-06T03:01:04.653 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.615+0000 7f5289ffb700 1 -- 172.21.15.57:0/1799634961 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3953025987 0 0) 0x7f528c0c1e30 con 0x7f528c159240 2023-10-06T03:01:04.653 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.615+0000 7f5289ffb700 1 -- 172.21.15.57:0/1799634961 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5274003570 con 0x7f528c159240 2023-10-06T03:01:04.654 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.615+0000 7fd995f85700 1 -- 172.21.15.57:0/3952761453 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd99004be40 con 0x7fd9900cffc0 2023-10-06T03:01:04.655 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.615+0000 7f528affd700 1 -- 172.21.15.57:0/1799634961 >> v1:172.21.15.105:6789/0 conn(0x7f528c159240 legacy=0x7f528c06ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:04.655 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.615+0000 7f528affd700 1 -- 172.21.15.57:0/1799634961 >> v1:172.21.15.57:6789/0 conn(0x7f528c06d510 legacy=0x7f528c0c7230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:04.655 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.615+0000 7f528affd700 1 -- 172.21.15.57:0/1799634961 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f528c06db70 con 0x7f528c158e70 2023-10-06T03:01:04.655 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.615+0000 7f528affd700 1 --2- 172.21.15.57:0/1799634961 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f528c158e70 0x7f528c067050 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f527c0098e0 tx=0x7f527c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=226dbbe51adf25cf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:04.656 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.615+0000 7f5abdd9b700 1 -- 172.21.15.57:0/1025336266 >> v1:172.21.15.105:6789/0 conn(0x7f5ab803af90 legacy=0x7f5ab803b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:04.656 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.615+0000 7f5abdd9b700 1 -- 172.21.15.57:0/1025336266 >> v1:172.21.15.57:6789/0 conn(0x7f5ab80e2000 legacy=0x7f5ab8007240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:04.656 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.615+0000 7f5abdd9b700 1 -- 172.21.15.57:0/1025336266 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ab8054040 con 0x7f5ab80e23d0 2023-10-06T03:01:04.657 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.615+0000 7fa047f45700 1 -- 172.21.15.57:0/2949742492 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0400c5ac0 con 0x7fa04006a670 2023-10-06T03:01:04.657 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.615+0000 7f5289ffb700 1 -- 172.21.15.57:0/1799634961 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f527c011630 con 0x7f528c158e70 2023-10-06T03:01:04.657 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.615+0000 7f5289ffb700 1 -- 172.21.15.57:0/1799634961 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f527c011790 con 0x7f528c158e70 2023-10-06T03:01:04.658 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.615+0000 7fa047f45700 1 -- 172.21.15.57:0/2949742492 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0400c6080 con 0x7fa04006a670 2023-10-06T03:01:04.658 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.615+0000 7f5289ffb700 1 -- 172.21.15.57:0/1799634961 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f527c011b30 con 0x7f528c158e70 2023-10-06T03:01:04.659 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.615+0000 7fd97b7fe700 1 -- 172.21.15.57:0/3952761453 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fd988008030 con 0x7fd9900cffc0 2023-10-06T03:01:04.660 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.615+0000 7f471b5c5700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4714069240 0x7f4714069610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:04.660 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.615+0000 7f471b5c5700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f47140cc810 0x7f471406e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:04.660 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.615+0000 7f9f01522700 1 -- 172.21.15.57:0/2235514362 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9efc0865a0 msgr2=0x7f9efc0c6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:04.661 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.615+0000 7f9f01522700 1 --2- 172.21.15.57:0/2235514362 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9efc0865a0 0x7f9efc0c6b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.661 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.615+0000 7f9f01522700 1 -- 172.21.15.57:0/2235514362 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9efc0aaa80 msgr2=0x7f9efc168c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:04.661 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.615+0000 7f9f01522700 1 --2- 172.21.15.57:0/2235514362 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9efc0aaa80 0x7f9efc168c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.661 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.615+0000 7f9f01522700 1 -- 172.21.15.57:0/2235514362 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ef4009a60 con 0x7f9efc0ada50 2023-10-06T03:01:04.661 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.615+0000 7f9f01522700 1 --2- 172.21.15.57:0/2235514362 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9efc0ada50 0x7f9efc0c2130 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9ef4016000 tx=0x7f9ef4015000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:04.662 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.615+0000 7f9ef8ff9700 1 -- 172.21.15.57:0/2235514362 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ef4017040 con 0x7f9efc0ada50 2023-10-06T03:01:04.662 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.615+0000 7f9ef8ff9700 1 -- 172.21.15.57:0/2235514362 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ef400c850 con 0x7f9efc0ada50 2023-10-06T03:01:04.662 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.615+0000 7f9ef8ff9700 1 -- 172.21.15.57:0/2235514362 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ef40138b0 con 0x7f9efc0ada50 2023-10-06T03:01:04.663 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.615+0000 7f5abdd9b700 1 --2- 172.21.15.57:0/1025336266 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ab80e23d0 0x7f5ab803bf40 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5ab00098e0 tx=0x7f5ab00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40765fceb53fa5e9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:04.663 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.615+0000 7f471b5c5700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f471406f3a0 con 0x7f47141589b0 2023-10-06T03:01:04.663 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.619+0000 7f471b5c5700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f471406eb00 con 0x7f47140cc810 2023-10-06T03:01:04.663 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.619+0000 7f471b5c5700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f471406ede0 con 0x7f4714069240 2023-10-06T03:01:04.664 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.615+0000 7f74f426e700 1 -- 172.21.15.57:0/757011796 shutdown_connections 2023-10-06T03:01:04.664 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.619+0000 7f74f426e700 1 -- 172.21.15.57:0/757011796 wait complete. 2023-10-06T03:01:04.665 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.619+0000 7f4718b60700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f47140cc810 0x7f471406e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:04.665 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.619+0000 7f4718b60700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f47140cc810 0x7f471406e1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.57:39426/0 (socket says 172.21.15.57:39426) 2023-10-06T03:01:04.665 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.619+0000 7f4718b60700 1 -- 172.21.15.57:0/1839311981 learned_addr learned my addr 172.21.15.57:0/1839311981 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:04.665 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.619+0000 7f4719361700 1 --2- 172.21.15.57:0/1839311981 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4714069240 0x7f4714069610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:04.666 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.619+0000 7f9f01d23700 1 -- 172.21.15.57:0/2235514362 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9efc1760c0 con 0x7f9efc0ada50 2023-10-06T03:01:04.666 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.619+0000 7fa035ffb700 1 -- 172.21.15.57:0/2949742492 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa03001b7f0 con 0x7fa04006a670 2023-10-06T03:01:04.667 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.619+0000 7f9f01d23700 1 -- 172.21.15.57:0/2235514362 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9efc176680 con 0x7f9efc0ada50 2023-10-06T03:01:04.667 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.619+0000 7f4718b60700 1 -- 172.21.15.57:0/1839311981 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4714069240 msgr2=0x7f4714069610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:04.667 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.619+0000 7f4718b60700 1 --2- 172.21.15.57:0/1839311981 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4714069240 0x7f4714069610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.668 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.619+0000 7f4718b60700 1 -- 172.21.15.57:0/1839311981 >> v1:172.21.15.57:6789/0 conn(0x7f47141589b0 legacy=0x7f4714158e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:04.668 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.619+0000 7fd97b7fe700 1 --2- 172.21.15.57:0/3952761453 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fd974060620 0x7fd974062ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:04.668 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.619+0000 7fd97b7fe700 1 -- 172.21.15.57:0/3952761453 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd98807cb00 con 0x7fd9900cffc0 2023-10-06T03:01:04.669 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.619+0000 7f4718b60700 1 -- 172.21.15.57:0/1839311981 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f471406f0c0 con 0x7f47140cc810 2023-10-06T03:01:04.669 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.619+0000 7fd98f7fe700 1 --2- 172.21.15.57:0/3952761453 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fd974060620 0x7fd974062ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:04.670 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.619+0000 7fa047f45700 1 -- 172.21.15.57:0/2949742492 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa040067d80 con 0x7fa04006a670 2023-10-06T03:01:04.670 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.619+0000 7f4718b60700 1 --2- 172.21.15.57:0/1839311981 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47140cc810 0x7f471406e1f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f47040099b0 tx=0x7f4704009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea29cdf5147daa26 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:04.671 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.619+0000 7f9ee67fc700 1 -- 172.21.15.57:0/2235514362 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9efc06d930 con 0x7f9efc0ada50 2023-10-06T03:01:04.671 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.619+0000 7f529182e700 1 -- 172.21.15.57:0/1799634961 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f528c158e70 msgr2=0x7f528c067050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:04.672 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.619+0000 7f529182e700 1 --2- 172.21.15.57:0/1799634961 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f528c158e70 0x7f528c067050 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f527c0098e0 tx=0x7f527c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.672 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.619+0000 7f529182e700 1 -- 172.21.15.57:0/1799634961 shutdown_connections 2023-10-06T03:01:04.672 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.619+0000 7f529182e700 1 --2- 172.21.15.57:0/1799634961 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f528c158e70 0x7f528c067050 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.672 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.619+0000 7f529182e700 1 -- 172.21.15.57:0/1799634961 >> 172.21.15.57:0/1799634961 conn(0x7f528c0cbb50 msgr2=0x7f528c0cbf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:04.672 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.619+0000 7f529182e700 1 -- 172.21.15.57:0/1799634961 shutdown_connections 2023-10-06T03:01:04.672 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.619+0000 7f74f426e700 1 Processor -- start 2023-10-06T03:01:04.673 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.619+0000 7fd98f7fe700 1 --2- 172.21.15.57:0/3952761453 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fd974060620 0x7fd974062ad0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd984003080 tx=0x7fd984017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:04.673 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.619+0000 7f470bfff700 1 -- 172.21.15.57:0/1839311981 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4704009ea0 con 0x7f47140cc810 2023-10-06T03:01:04.673 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.619+0000 7f470bfff700 1 -- 172.21.15.57:0/1839311981 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f470400b820 con 0x7f47140cc810 2023-10-06T03:01:04.674 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.619+0000 7f470bfff700 1 -- 172.21.15.57:0/1839311981 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f470400bbc0 con 0x7f47140cc810 2023-10-06T03:01:04.674 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.619+0000 7f529182e700 1 -- 172.21.15.57:0/1799634961 wait complete. 2023-10-06T03:01:04.674 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.619+0000 7f5abd59a700 1 -- 172.21.15.57:0/1025336266 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ab0009e80 con 0x7f5ab80e23d0 2023-10-06T03:01:04.675 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.619+0000 7f74f426e700 1 -- start start 2023-10-06T03:01:04.675 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.619+0000 7f471b5c5700 1 -- 172.21.15.57:0/1839311981 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47140cc810 msgr2=0x7f471406e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:04.675 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.619+0000 7f471b5c5700 1 --2- 172.21.15.57:0/1839311981 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47140cc810 0x7f471406e1f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f47040099b0 tx=0x7f4704009250 comp rx=0 tx=0).stop 2023-10-06T03:01:04.676 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.619+0000 7f74f426e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f74ec0c3740 0x7f74ec147790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:04.676 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.619+0000 7f74f426e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f74ec158fa0 0x7f74ec146b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:04.676 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.619+0000 7f471b5c5700 1 -- 172.21.15.57:0/1839311981 shutdown_connections 2023-10-06T03:01:04.676 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.619+0000 7f471b5c5700 1 --2- 172.21.15.57:0/1839311981 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47140cc810 0x7f471406e1f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.676 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.619+0000 7f74f426e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f74ec159370 0x7f74ec15cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:04.677 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.619+0000 7f471b5c5700 1 --2- 172.21.15.57:0/1839311981 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4714069240 0x7f4714069610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.677 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.619+0000 7f471b5c5700 1 -- 172.21.15.57:0/1839311981 >> 172.21.15.57:0/1839311981 conn(0x7f47140ccc80 msgr2=0x7f47140cd050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:04.678 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.623+0000 7f74f426e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74ec0c5d60 con 0x7f74ec158fa0 2023-10-06T03:01:04.678 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.623+0000 7f74f200a700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f74ec0c3740 0x7f74ec147790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:04.678 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.623+0000 7f74f200a700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f74ec0c3740 0x7f74ec147790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.57:46044/0 (socket says 172.21.15.57:46044) 2023-10-06T03:01:04.678 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.623+0000 7f74f200a700 1 -- 172.21.15.57:0/475824107 learned_addr learned my addr 172.21.15.57:0/475824107 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:04.678 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.623+0000 7f74f426e700 1 -- 172.21.15.57:0/475824107 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74ec0c5150 con 0x7f74ec159370 2023-10-06T03:01:04.678 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.623+0000 7f74f426e700 1 -- 172.21.15.57:0/475824107 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74ec0c5430 con 0x7f74ec0c3740 2023-10-06T03:01:04.679 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.623+0000 7f471b5c5700 1 -- 172.21.15.57:0/1839311981 shutdown_connections 2023-10-06T03:01:04.679 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.623+0000 7f471b5c5700 1 -- 172.21.15.57:0/1839311981 wait complete. 2023-10-06T03:01:04.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.623+0000 7f74f1809700 1 --2- 172.21.15.57:0/475824107 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f74ec158fa0 0x7f74ec146b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:04.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.623+0000 7f74f300c700 1 --2- 172.21.15.57:0/475824107 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f74ec159370 0x7f74ec15cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:04.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.623+0000 7f74f300c700 1 -- 172.21.15.57:0/475824107 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f74ec0c3740 msgr2=0x7f74ec147790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:04.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.623+0000 7f74f300c700 1 --2- 172.21.15.57:0/475824107 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f74ec0c3740 0x7f74ec147790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.623+0000 7f74f300c700 1 -- 172.21.15.57:0/475824107 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f74ec158fa0 msgr2=0x7f74ec146b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:04.681 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.623+0000 7f74f300c700 1 --2- 172.21.15.57:0/475824107 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f74ec158fa0 0x7f74ec146b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.681 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.623+0000 7f74f300c700 1 -- 172.21.15.57:0/475824107 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74dc009480 con 0x7f74ec159370 2023-10-06T03:01:04.681 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.623+0000 7f74f300c700 1 --2- 172.21.15.57:0/475824107 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f74ec159370 0x7f74ec15cc00 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f74e4002580 tx=0x7f74e4009810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:04.682 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.623+0000 7f9ef8ff9700 1 -- 172.21.15.57:0/2235514362 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f9ef4003020 con 0x7f9efc0ada50 2023-10-06T03:01:04.682 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.623+0000 7f529182e700 1 Processor -- start 2023-10-06T03:01:04.682 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.623+0000 7f9ef8ff9700 1 --2- 172.21.15.57:0/2235514362 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f9ee00606a0 0x7f9ee0062b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:04.683 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.623+0000 7f9ef8ff9700 1 -- 172.21.15.57:0/2235514362 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9ef40823c0 con 0x7f9efc0ada50 2023-10-06T03:01:04.683 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.623+0000 7fd97b7fe700 1 -- 172.21.15.57:0/3952761453 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fd98804cff0 con 0x7fd9900cffc0 2023-10-06T03:01:04.684 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.623+0000 7f5abd59a700 1 -- 172.21.15.57:0/1025336266 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ab000b860 con 0x7f5ab80e23d0 2023-10-06T03:01:04.684 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.623+0000 7f5abf59e700 1 -- 172.21.15.57:0/1025336266 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ab80e23d0 msgr2=0x7f5ab803bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:04.684 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.623+0000 7f5abf59e700 1 --2- 172.21.15.57:0/1025336266 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ab80e23d0 0x7f5ab803bf40 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5ab00098e0 tx=0x7f5ab00091a0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.684 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.623+0000 7f5abf59e700 1 -- 172.21.15.57:0/1025336266 shutdown_connections 2023-10-06T03:01:04.685 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.623+0000 7f5abf59e700 1 --2- 172.21.15.57:0/1025336266 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ab80e23d0 0x7f5ab803bf40 secure :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5ab00098e0 tx=0x7f5ab00091a0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.685 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.623+0000 7f5abf59e700 1 -- 172.21.15.57:0/1025336266 >> 172.21.15.57:0/1025336266 conn(0x7f5ab8059c40 msgr2=0x7f5ab8055be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:04.685 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.623+0000 7f5abf59e700 1 -- 172.21.15.57:0/1025336266 shutdown_connections 2023-10-06T03:01:04.685 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.623+0000 7f9f00d21700 1 --2- 172.21.15.57:0/2235514362 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f9ee00606a0 0x7f9ee0062b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:04.686 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.623+0000 7f529182e700 1 -- start start 2023-10-06T03:01:04.686 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.623+0000 7fa035ffb700 1 -- 172.21.15.57:0/2949742492 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fa03001bbe0 con 0x7fa04006a670 2023-10-06T03:01:04.687 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.623+0000 7fa035ffb700 1 --2- 172.21.15.57:0/2949742492 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fa024060550 0x7fa024062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:04.687 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.627+0000 7fa0454e0700 1 --2- 172.21.15.57:0/2949742492 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fa024060550 0x7fa024062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:04.687 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.627+0000 7f529182e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f528c06d510 0x7f528c0cae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:04.687 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.627+0000 7f529182e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f528c158e70 0x7f528c147a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:04.687 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.627+0000 7f529182e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f528c159240 0x7f528c147f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:04.688 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.627+0000 7f529182e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f528c0b1720 con 0x7f528c06d510 2023-10-06T03:01:04.688 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.627+0000 7f529182e700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f528c0b1440 con 0x7f528c158e70 2023-10-06T03:01:04.688 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.627+0000 7f529182e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f528c155320 con 0x7f528c159240 2023-10-06T03:01:04.688 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.627+0000 7f9f00d21700 1 --2- 172.21.15.57:0/2235514362 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f9ee00606a0 0x7f9ee0062b50 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9efc16acb0 tx=0x7f9ef00091a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:04.688 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.627+0000 7fa0454e0700 1 --2- 172.21.15.57:0/2949742492 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fa024060550 0x7fa024062a00 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa04008b3c0 tx=0x7fa03c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:04.688 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.627+0000 7f528b7fe700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f528c159240 0x7f528c147f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:04.689 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.627+0000 7f528affd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f528c06d510 0x7f528c0cae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:04.689 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.627+0000 7f528b7fe700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f528c159240 0x7f528c147f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.57:46054/0 (socket says 172.21.15.57:46054) 2023-10-06T03:01:04.689 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.627+0000 7f528affd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f528c06d510 0x7f528c0cae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55802/0 (socket says 172.21.15.57:55802) 2023-10-06T03:01:04.689 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.627+0000 7f528b7fe700 1 -- 172.21.15.57:0/2637523339 learned_addr learned my addr 172.21.15.57:0/2637523339 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:04.689 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.627+0000 7f528a7fc700 1 --2- 172.21.15.57:0/2637523339 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f528c158e70 0x7f528c147a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:04.689 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.623+0000 7f5abf59e700 1 -- 172.21.15.57:0/1025336266 wait complete. 2023-10-06T03:01:04.690 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.627+0000 7f528b7fe700 1 -- 172.21.15.57:0/2637523339 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f528c158e70 msgr2=0x7f528c147a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:04.690 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.627+0000 7f528b7fe700 1 --2- 172.21.15.57:0/2637523339 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f528c158e70 0x7f528c147a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.695 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.627+0000 7f528b7fe700 1 -- 172.21.15.57:0/2637523339 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f528c06d510 msgr2=0x7f528c0cae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:04.695 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.627+0000 7f528b7fe700 1 --2- 172.21.15.57:0/2637523339 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f528c06d510 0x7f528c0cae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.695 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.627+0000 7f528b7fe700 1 -- 172.21.15.57:0/2637523339 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f527c009420 con 0x7f528c159240 2023-10-06T03:01:04.695 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.627+0000 7f528affd700 1 --2- 172.21.15.57:0/2637523339 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f528c06d510 0x7f528c0cae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:01:04.695 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.627+0000 7f528a7fc700 1 --2- 172.21.15.57:0/2637523339 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f528c158e70 0x7f528c147a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:01:04.695 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.627+0000 7f528b7fe700 1 --2- 172.21.15.57:0/2637523339 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f528c159240 0x7f528c147f80 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f528400ccc0 tx=0x7f5284005400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:04.696 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.627+0000 7fa035ffb700 1 -- 172.21.15.57:0/2949742492 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa030053000 con 0x7fa04006a670 2023-10-06T03:01:04.696 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.627+0000 7f5272ffd700 1 -- 172.21.15.57:0/2637523339 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f528400a880 con 0x7f528c159240 2023-10-06T03:01:04.696 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.627+0000 7f5272ffd700 1 -- 172.21.15.57:0/2637523339 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f528400a9e0 con 0x7f528c159240 2023-10-06T03:01:04.696 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.627+0000 7f529182e700 1 -- 172.21.15.57:0/2637523339 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f528c155600 con 0x7f528c159240 2023-10-06T03:01:04.697 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.627+0000 7f5272ffd700 1 -- 172.21.15.57:0/2637523339 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f528400ada0 con 0x7f528c159240 2023-10-06T03:01:04.697 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.627+0000 7f529182e700 1 -- 172.21.15.57:0/2637523339 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f528c0cb3a0 con 0x7f528c159240 2023-10-06T03:01:04.697 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.627+0000 7f471b5c5700 1 Processor -- start 2023-10-06T03:01:04.697 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.627+0000 7f5abf59e700 1 Processor -- start 2023-10-06T03:01:04.697 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.627+0000 7f471b5c5700 1 -- start start 2023-10-06T03:01:04.698 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.627+0000 7f5abf59e700 1 -- start start 2023-10-06T03:01:04.698 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.631+0000 7f529182e700 1 -- 172.21.15.57:0/2637523339 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f528c04be40 con 0x7f528c159240 2023-10-06T03:01:04.698 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.631+0000 7f5abf59e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5ab803af90 0x7f5ab80e77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:04.699 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.631+0000 7f471b5c5700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4714069240 0x7f47140b1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:04.699 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.631+0000 7f74e27fc700 1 -- 172.21.15.57:0/475824107 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e4011070 con 0x7f74ec159370 2023-10-06T03:01:04.699 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.631+0000 7f74e27fc700 1 -- 172.21.15.57:0/475824107 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74e400c2e0 con 0x7f74ec159370 2023-10-06T03:01:04.699 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.631+0000 7f74e27fc700 1 -- 172.21.15.57:0/475824107 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e4007d00 con 0x7f74ec159370 2023-10-06T03:01:04.699 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.631+0000 7f74f426e700 1 -- 172.21.15.57:0/475824107 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74ec0c5710 con 0x7f74ec159370 2023-10-06T03:01:04.699 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.631+0000 7f471b5c5700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f47140cc810 0x7f4714154800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:04.700 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.631+0000 7f74f426e700 1 -- 172.21.15.57:0/475824107 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74ec147cd0 con 0x7f74ec159370 2023-10-06T03:01:04.700 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.631+0000 7f9ef8ff9700 1 -- 172.21.15.57:0/2235514362 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f9ef4052830 con 0x7f9efc0ada50 2023-10-06T03:01:04.700 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.631+0000 7f4719361700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4714069240 0x7f47140b1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:04.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.631+0000 7f4719361700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4714069240 0x7f47140b1ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.57:39444/0 (socket says 172.21.15.57:39444) 2023-10-06T03:01:04.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.631+0000 7f4719361700 1 -- 172.21.15.57:0/272952957 learned_addr learned my addr 172.21.15.57:0/272952957 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:04.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.631+0000 7f471b5c5700 1 --2- 172.21.15.57:0/272952957 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f47141589b0 0x7f47140aff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:04.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.631+0000 7f4718b60700 1 --2- 172.21.15.57:0/272952957 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f47140cc810 0x7f4714154800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:04.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.631+0000 7f5abf59e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ab80e2000 0x7f5ab80e3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:04.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.631+0000 7f5abe59c700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5ab803af90 0x7f5ab80e77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:04.702 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.631+0000 7f471b5c5700 1 -- 172.21.15.57:0/272952957 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f471415bbc0 con 0x7f47140cc810 2023-10-06T03:01:04.702 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.631+0000 7f471b5c5700 1 -- 172.21.15.57:0/272952957 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47140b22f0 con 0x7f4714069240 2023-10-06T03:01:04.702 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.631+0000 7f5abe59c700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5ab803af90 0x7f5ab80e77a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.57:46066/0 (socket says 172.21.15.57:46066) 2023-10-06T03:01:04.702 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.631+0000 7f4719b62700 1 --2- 172.21.15.57:0/272952957 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f47141589b0 0x7f47140aff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:04.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.631+0000 7f471b5c5700 1 -- 172.21.15.57:0/272952957 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47140b25d0 con 0x7f47141589b0 2023-10-06T03:01:04.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.631+0000 7f5272ffd700 1 -- 172.21.15.57:0/2637523339 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f5284007300 con 0x7f528c159240 2023-10-06T03:01:04.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.631+0000 7f4719361700 1 -- 172.21.15.57:0/272952957 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f47141589b0 msgr2=0x7f47140aff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:04.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.631+0000 7f4719361700 1 --2- 172.21.15.57:0/272952957 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f47141589b0 0x7f47140aff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.631+0000 7f4719361700 1 -- 172.21.15.57:0/272952957 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f47140cc810 msgr2=0x7f4714154800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:04.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.631+0000 7f4719361700 1 --2- 172.21.15.57:0/272952957 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f47140cc810 0x7f4714154800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.631+0000 7f4719361700 1 -- 172.21.15.57:0/272952957 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47040094f0 con 0x7f4714069240 2023-10-06T03:01:04.704 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.635+0000 7f74f426e700 1 -- 172.21.15.57:0/475824107 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74d40052b0 con 0x7f74ec159370 2023-10-06T03:01:04.704 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.635+0000 7f4719361700 1 --2- 172.21.15.57:0/272952957 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4714069240 0x7f47140b1ce0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4710009ef0 tx=0x7f471000b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:04.704 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.635+0000 7f5272ffd700 1 --2- 172.21.15.57:0/2637523339 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f52780605d0 0x7f5278062a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:04.705 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.635+0000 7f5abf59e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5ab80e3fa0 0x7f5ab80df160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:04.705 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.635+0000 7f5abdd9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ab80e2000 0x7f5ab80e3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:04.705 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.635+0000 7f5abdd9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ab80e2000 0x7f5ab80e3a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55828/0 (socket says 172.21.15.57:55828) 2023-10-06T03:01:04.705 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.635+0000 7f5abdd9b700 1 -- 172.21.15.57:0/157043498 learned_addr learned my addr 172.21.15.57:0/157043498 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:04.705 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.635+0000 7f5272ffd700 1 -- 172.21.15.57:0/2637523339 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f528407cd40 con 0x7f528c159240 2023-10-06T03:01:04.706 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.635+0000 7f5abf59e700 1 -- 172.21.15.57:0/157043498 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab80f6f60 con 0x7f5ab80e2000 2023-10-06T03:01:04.706 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.635+0000 7f47097fa700 1 -- 172.21.15.57:0/272952957 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f471000cb70 con 0x7f4714069240 2023-10-06T03:01:04.706 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.635+0000 7f47097fa700 1 -- 172.21.15.57:0/272952957 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f471000f040 con 0x7f4714069240 2023-10-06T03:01:04.706 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.635+0000 7f47097fa700 1 -- 172.21.15.57:0/272952957 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4710014480 con 0x7f4714069240 2023-10-06T03:01:04.706 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.635+0000 7f471b5c5700 1 -- 172.21.15.57:0/272952957 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47140b28b0 con 0x7f4714069240 2023-10-06T03:01:04.707 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.635+0000 7f471b5c5700 1 -- 172.21.15.57:0/272952957 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47140afd00 con 0x7f4714069240 2023-10-06T03:01:04.707 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.635+0000 7f528affd700 1 --2- 172.21.15.57:0/2637523339 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f52780605d0 0x7f5278062a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:04.707 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.635+0000 7f5abed9d700 1 --2- 172.21.15.57:0/157043498 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5ab80e3fa0 0x7f5ab80df160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:04.707 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.635+0000 7f5abf59e700 1 -- 172.21.15.57:0/157043498 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab80e4fd0 con 0x7f5ab80e3fa0 2023-10-06T03:01:04.707 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.635+0000 7f5abf59e700 1 -- 172.21.15.57:0/157043498 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab80e7ce0 con 0x7f5ab803af90 2023-10-06T03:01:04.708 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.635+0000 7f528affd700 1 --2- 172.21.15.57:0/2637523339 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f52780605d0 0x7f5278062a80 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f527c0030c0 tx=0x7f527c016000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:04.708 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.635+0000 7f5abed9d700 1 -- 172.21.15.57:0/157043498 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5ab803af90 msgr2=0x7f5ab80e77a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:04.708 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.635+0000 7f5abed9d700 1 --2- 172.21.15.57:0/157043498 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5ab803af90 0x7f5ab80e77a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.708 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.635+0000 7f5abed9d700 1 -- 172.21.15.57:0/157043498 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ab80e2000 msgr2=0x7f5ab80e3a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:04.708 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.635+0000 7f5abed9d700 1 --2- 172.21.15.57:0/157043498 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ab80e2000 0x7f5ab80e3a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.708 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.635+0000 7f5abed9d700 1 -- 172.21.15.57:0/157043498 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ab0009420 con 0x7f5ab80e3fa0 2023-10-06T03:01:04.709 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.635+0000 7f471b5c5700 1 -- 172.21.15.57:0/272952957 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47140b2aa0 con 0x7f4714069240 2023-10-06T03:01:04.709 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.635+0000 7f5abed9d700 1 --2- 172.21.15.57:0/157043498 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5ab80e3fa0 0x7f5ab80df160 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5aa800c4b0 tx=0x7f5aa8007e60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:04.709 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.635+0000 7f5abe59c700 1 --2- 172.21.15.57:0/157043498 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5ab803af90 0x7f5ab80e77a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2023-10-06T03:01:04.710 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.635+0000 7f74e27fc700 1 -- 172.21.15.57:0/475824107 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f74e400a640 con 0x7f74ec159370 2023-10-06T03:01:04.710 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.639+0000 7f74e27fc700 1 --2- 172.21.15.57:0/475824107 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f74d00606a0 0x7f74d0062b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:04.710 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.639+0000 7f74e27fc700 1 -- 172.21.15.57:0/475824107 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f74e407cac0 con 0x7f74ec159370 2023-10-06T03:01:04.710 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.639+0000 7f74f200a700 1 --2- 172.21.15.57:0/475824107 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f74d00606a0 0x7f74d0062b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:04.710 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.639+0000 7fa035ffb700 1 -- 172.21.15.57:0/2949742492 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fa03004ec00 con 0x7fa04006a670 2023-10-06T03:01:04.711 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.639+0000 7f74f200a700 1 --2- 172.21.15.57:0/475824107 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f74d00606a0 0x7f74d0062b50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f74e8001fe0 tx=0x7f74e8007ed0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:04.711 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.639+0000 7f5272ffd700 1 -- 172.21.15.57:0/2637523339 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f528404d1b0 con 0x7f528c159240 2023-10-06T03:01:04.711 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.639+0000 7f74e27fc700 1 -- 172.21.15.57:0/475824107 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f74e4050a40 con 0x7f74ec159370 2023-10-06T03:01:04.712 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.639+0000 7f5ab67fc700 1 -- 172.21.15.57:0/157043498 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aa8011590 con 0x7f5ab80e3fa0 2023-10-06T03:01:04.712 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.639+0000 7f5ab67fc700 1 -- 172.21.15.57:0/157043498 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5aa80116f0 con 0x7f5ab80e3fa0 2023-10-06T03:01:04.712 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.639+0000 7f5ab67fc700 1 -- 172.21.15.57:0/157043498 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aa8011a90 con 0x7f5ab80e3fa0 2023-10-06T03:01:04.712 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.639+0000 7f5abf59e700 1 -- 172.21.15.57:0/157043498 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ab80f7140 con 0x7f5ab80e3fa0 2023-10-06T03:01:04.712 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.639+0000 7f5abf59e700 1 -- 172.21.15.57:0/157043498 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ab80f79e0 con 0x7f5ab80e3fa0 2023-10-06T03:01:04.712 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.643+0000 7f5abf59e700 1 -- 172.21.15.57:0/157043498 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ab80e7fe0 con 0x7f5ab80e3fa0 2023-10-06T03:01:04.713 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.643+0000 7f47097fa700 1 -- 172.21.15.57:0/272952957 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f47100147f0 con 0x7f4714069240 2023-10-06T03:01:04.713 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.647+0000 7f47097fa700 1 --2- 172.21.15.57:0/272952957 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f46f80606d0 0x7f46f8062b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:04.713 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.647+0000 7f47097fa700 1 -- 172.21.15.57:0/272952957 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f471007d970 con 0x7f4714069240 2023-10-06T03:01:04.713 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.647+0000 7f4718b60700 1 --2- 172.21.15.57:0/272952957 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f46f80606d0 0x7f46f8062b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:04.713 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.647+0000 7f47097fa700 1 -- 172.21.15.57:0/272952957 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f471004de60 con 0x7f4714069240 2023-10-06T03:01:04.713 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.647+0000 7f4718b60700 1 --2- 172.21.15.57:0/272952957 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f46f80606d0 0x7f46f8062b80 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f47040099b0 tx=0x7f4704016000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:04.714 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.651+0000 7f5ab67fc700 1 -- 172.21.15.57:0/157043498 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f5aa8012420 con 0x7f5ab80e3fa0 2023-10-06T03:01:04.714 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.651+0000 7f5ab67fc700 1 --2- 172.21.15.57:0/157043498 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f5aa00606a0 0x7f5aa0062b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:04.714 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.651+0000 7f5ab67fc700 1 -- 172.21.15.57:0/157043498 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5aa807c410 con 0x7f5ab80e3fa0 2023-10-06T03:01:04.714 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.651+0000 7f5abe59c700 1 --2- 172.21.15.57:0/157043498 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f5aa00606a0 0x7f5aa0062b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:04.714 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.651+0000 7f5abe59c700 1 --2- 172.21.15.57:0/157043498 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f5aa00606a0 0x7f5aa0062b50 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5ac0065280 tx=0x7f5ac00655f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:04.714 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.655+0000 7f5ab67fc700 1 -- 172.21.15.57:0/157043498 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f5aa804c9b0 con 0x7f5ab80e3fa0 2023-10-06T03:01:04.953 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.947+0000 7fbeb24e3700 1 -- 172.21.15.57:0/4049309859 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fbeac06bef0 con 0x7fbeac06dc40 2023-10-06T03:01:04.953 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.947+0000 7fbea17fa700 1 -- 172.21.15.57:0/4049309859 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbea8017090 con 0x7fbeac06dc40 2023-10-06T03:01:04.956 INFO:teuthology.orchestra.run.smithi057.stdout:55834574852 2023-10-06T03:01:04.963 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.959+0000 7fd995f85700 1 -- 172.21.15.57:0/3952761453 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fd99006c9c0 con 0x7fd9900cffc0 2023-10-06T03:01:04.964 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.959+0000 7fbe96ffd700 1 -- 172.21.15.57:0/4049309859 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fbe90060580 msgr2=0x7fbe90062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:04.964 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.959+0000 7fbe96ffd700 1 --2- 172.21.15.57:0/4049309859 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fbe90060580 0x7fbe90062a30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fbea4009e90 tx=0x7fbea4019000 comp rx=0 tx=0).stop 2023-10-06T03:01:04.964 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.959+0000 7fbe96ffd700 1 -- 172.21.15.57:0/4049309859 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbeac06dc40 msgr2=0x7fbeac158300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:04.965 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.959+0000 7fbe96ffd700 1 --2- 172.21.15.57:0/4049309859 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbeac06dc40 0x7fbeac158300 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fbea800c5e0 tx=0x7fbea8001070 comp rx=0 tx=0).stop 2023-10-06T03:01:04.965 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.959+0000 7fbe96ffd700 1 -- 172.21.15.57:0/4049309859 shutdown_connections 2023-10-06T03:01:04.965 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.959+0000 7fbe96ffd700 1 --2- 172.21.15.57:0/4049309859 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbeac0cb6b0 0x7fbeac15a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.965 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.959+0000 7fbe96ffd700 1 --2- 172.21.15.57:0/4049309859 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fbe90060580 0x7fbe90062a30 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.965 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.959+0000 7fbe96ffd700 1 --2- 172.21.15.57:0/4049309859 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbeac0c6d50 0x7fbeac159f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.965 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.959+0000 7fbe96ffd700 1 --2- 172.21.15.57:0/4049309859 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbeac06dc40 0x7fbeac158300 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.965 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.959+0000 7fbe96ffd700 1 -- 172.21.15.57:0/4049309859 >> 172.21.15.57:0/4049309859 conn(0x7fbeac0c85e0 msgr2=0x7fbeac0ac740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:04.965 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.959+0000 7fbe96ffd700 1 -- 172.21.15.57:0/4049309859 shutdown_connections 2023-10-06T03:01:04.965 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.959+0000 7fbe96ffd700 1 -- 172.21.15.57:0/4049309859 wait complete. 2023-10-06T03:01:04.966 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.959+0000 7fd97b7fe700 1 -- 172.21.15.57:0/3952761453 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd988019020 con 0x7fd9900cffc0 2023-10-06T03:01:04.966 INFO:teuthology.orchestra.run.smithi057.stdout:55834574853 2023-10-06T03:01:04.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.963+0000 7fd995f85700 1 -- 172.21.15.57:0/3952761453 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fd974060620 msgr2=0x7fd974062ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:04.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.963+0000 7fd995f85700 1 --2- 172.21.15.57:0/3952761453 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fd974060620 0x7fd974062ad0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd984003080 tx=0x7fd984017000 comp rx=0 tx=0).stop 2023-10-06T03:01:04.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.963+0000 7fd995f85700 1 -- 172.21.15.57:0/3952761453 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd9900cffc0 msgr2=0x7fd9900c5c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:04.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.963+0000 7fd995f85700 1 --2- 172.21.15.57:0/3952761453 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd9900cffc0 0x7fd9900c5c30 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd99006dfc0 tx=0x7fd9880096c0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.963+0000 7fd995f85700 1 -- 172.21.15.57:0/3952761453 shutdown_connections 2023-10-06T03:01:04.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.963+0000 7fd995f85700 1 --2- 172.21.15.57:0/3952761453 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fd974060620 0x7fd974062ad0 secure :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd984003080 tx=0x7fd984017000 comp rx=0 tx=0).stop 2023-10-06T03:01:04.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.963+0000 7fd995f85700 1 --2- 172.21.15.57:0/3952761453 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd9900cffc0 0x7fd9900c5c30 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.963+0000 7fd995f85700 1 --2- 172.21.15.57:0/3952761453 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd9900b38e0 0x7fd9900c56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.963+0000 7fd995f85700 1 --2- 172.21.15.57:0/3952761453 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd99006b440 0x7fd99014cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.970 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.963+0000 7fd995f85700 1 -- 172.21.15.57:0/3952761453 >> 172.21.15.57:0/3952761453 conn(0x7fd990067050 msgr2=0x7fd9901568c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:04.970 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.963+0000 7f9ee67fc700 1 -- 172.21.15.57:0/2235514362 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9efc04be40 con 0x7f9efc0ada50 2023-10-06T03:01:04.970 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.963+0000 7fd995f85700 1 -- 172.21.15.57:0/3952761453 shutdown_connections 2023-10-06T03:01:04.970 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.963+0000 7fd995f85700 1 -- 172.21.15.57:0/3952761453 wait complete. 2023-10-06T03:01:04.971 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.967+0000 7f9ef8ff9700 1 -- 172.21.15.57:0/2235514362 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9ef4055e50 con 0x7f9efc0ada50 2023-10-06T03:01:04.971 INFO:teuthology.orchestra.run.smithi057.stdout:55834574852 2023-10-06T03:01:04.976 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.971+0000 7fa047f45700 1 -- 172.21.15.57:0/2949742492 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa040067d80 con 0x7fa04006a670 2023-10-06T03:01:04.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.971+0000 7f9f01d23700 1 -- 172.21.15.57:0/2235514362 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f9ee00606a0 msgr2=0x7f9ee0062b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:04.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.971+0000 7f9f01d23700 1 --2- 172.21.15.57:0/2235514362 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f9ee00606a0 0x7f9ee0062b50 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9efc16acb0 tx=0x7f9ef00091a0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.971+0000 7f9f01d23700 1 -- 172.21.15.57:0/2235514362 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9efc0ada50 msgr2=0x7f9efc0c2130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:04.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.971+0000 7f9f01d23700 1 --2- 172.21.15.57:0/2235514362 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9efc0ada50 0x7f9efc0c2130 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9ef4016000 tx=0x7f9ef4015000 comp rx=0 tx=0).stop 2023-10-06T03:01:04.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.971+0000 7fa035ffb700 1 -- 172.21.15.57:0/2949742492 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa040067d80 con 0x7fa04006a670 2023-10-06T03:01:04.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.971+0000 7f9f01d23700 1 -- 172.21.15.57:0/2235514362 shutdown_connections 2023-10-06T03:01:04.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.971+0000 7f9f01d23700 1 --2- 172.21.15.57:0/2235514362 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9efc0ada50 0x7f9efc0c2130 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.971+0000 7f9f01d23700 1 --2- 172.21.15.57:0/2235514362 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9efc0aaa80 0x7f9efc168c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.971+0000 7f9f01d23700 1 --2- 172.21.15.57:0/2235514362 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f9ee00606a0 0x7f9ee0062b50 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.971+0000 7f9f01d23700 1 --2- 172.21.15.57:0/2235514362 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9efc0865a0 0x7f9efc0c6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.971+0000 7f9f01d23700 1 -- 172.21.15.57:0/2235514362 >> 172.21.15.57:0/2235514362 conn(0x7f9efc0c85e0 msgr2=0x7f9efc0ca2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:04.978 INFO:teuthology.orchestra.run.smithi057.stdout:55834574852 2023-10-06T03:01:04.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.971+0000 7f9f01d23700 1 -- 172.21.15.57:0/2235514362 shutdown_connections 2023-10-06T03:01:04.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.971+0000 7f9f01d23700 1 -- 172.21.15.57:0/2235514362 wait complete. 2023-10-06T03:01:04.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.975+0000 7f529182e700 1 -- 172.21.15.57:0/2637523339 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f528c0b1980 con 0x7f528c159240 2023-10-06T03:01:04.980 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.975+0000 7f5272ffd700 1 -- 172.21.15.57:0/2637523339 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f52840507d0 con 0x7f528c159240 2023-10-06T03:01:04.981 INFO:teuthology.orchestra.run.smithi057.stdout:55834574853 2023-10-06T03:01:04.982 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.975+0000 7fa047f45700 1 -- 172.21.15.57:0/2949742492 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fa024060550 msgr2=0x7fa024062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:04.983 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.975+0000 7fa047f45700 1 --2- 172.21.15.57:0/2949742492 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fa024060550 0x7fa024062a00 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa04008b3c0 tx=0x7fa03c008040 comp rx=0 tx=0).stop 2023-10-06T03:01:04.983 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.975+0000 7fa047f45700 1 -- 172.21.15.57:0/2949742492 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa04006a670 msgr2=0x7fa0400b56c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:04.983 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.975+0000 7fa047f45700 1 --2- 172.21.15.57:0/2949742492 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa04006a670 0x7fa0400b56c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa030006fd0 tx=0x7fa030016000 comp rx=0 tx=0).stop 2023-10-06T03:01:04.983 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.979+0000 7fa047f45700 1 -- 172.21.15.57:0/2949742492 shutdown_connections 2023-10-06T03:01:04.983 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.979+0000 7fa047f45700 1 --2- 172.21.15.57:0/2949742492 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fa024060550 0x7fa024062a00 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.983 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.979+0000 7fa047f45700 1 --2- 172.21.15.57:0/2949742492 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa040159380 0x7fa0400c97c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.983 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.979+0000 7fa047f45700 1 --2- 172.21.15.57:0/2949742492 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa040158fb0 0x7fa0400c39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.983 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.979+0000 7fa047f45700 1 --2- 172.21.15.57:0/2949742492 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa04006a670 0x7fa0400b56c0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.983 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.979+0000 7fa047f45700 1 -- 172.21.15.57:0/2949742492 >> 172.21.15.57:0/2949742492 conn(0x7fa040067050 msgr2=0x7fa0400cf2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:04.983 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.979+0000 7fa047f45700 1 -- 172.21.15.57:0/2949742492 shutdown_connections 2023-10-06T03:01:04.984 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.979+0000 7fa047f45700 1 -- 172.21.15.57:0/2949742492 wait complete. 2023-10-06T03:01:04.984 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.979+0000 7f471b5c5700 1 -- 172.21.15.57:0/272952957 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f471404be40 con 0x7f4714069240 2023-10-06T03:01:04.985 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.979+0000 7f47097fa700 1 -- 172.21.15.57:0/272952957 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4710051480 con 0x7f4714069240 2023-10-06T03:01:04.985 INFO:teuthology.orchestra.run.smithi057.stdout:55834574853 2023-10-06T03:01:04.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.983+0000 7f529182e700 1 -- 172.21.15.57:0/2637523339 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f52780605d0 msgr2=0x7f5278062a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:04.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.983+0000 7f529182e700 1 --2- 172.21.15.57:0/2637523339 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f52780605d0 0x7f5278062a80 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f527c0030c0 tx=0x7f527c016000 comp rx=0 tx=0).stop 2023-10-06T03:01:04.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.983+0000 7f529182e700 1 -- 172.21.15.57:0/2637523339 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f528c159240 msgr2=0x7f528c147f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:04.989 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.983+0000 7f529182e700 1 --2- 172.21.15.57:0/2637523339 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f528c159240 0x7f528c147f80 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f528400ccc0 tx=0x7f5284005400 comp rx=0 tx=0).stop 2023-10-06T03:01:04.990 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.3 2023-10-06T03:01:04.990 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.983+0000 7f471b5c5700 1 -- 172.21.15.57:0/272952957 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f46f80606d0 msgr2=0x7f46f8062b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:04.990 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.983+0000 7f471b5c5700 1 --2- 172.21.15.57:0/272952957 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f46f80606d0 0x7f46f8062b80 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f47040099b0 tx=0x7f4704016000 comp rx=0 tx=0).stop 2023-10-06T03:01:04.990 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.983+0000 7f471b5c5700 1 -- 172.21.15.57:0/272952957 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4714069240 msgr2=0x7f47140b1ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:04.990 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.983+0000 7f471b5c5700 1 --2- 172.21.15.57:0/272952957 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4714069240 0x7f47140b1ce0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4710009ef0 tx=0x7f471000b040 comp rx=0 tx=0).stop 2023-10-06T03:01:04.991 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.983+0000 7f74f426e700 1 -- 172.21.15.57:0/475824107 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f74d4005830 con 0x7f74ec159370 2023-10-06T03:01:04.991 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.983+0000 7f471b5c5700 1 -- 172.21.15.57:0/272952957 shutdown_connections 2023-10-06T03:01:04.991 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.983+0000 7f471b5c5700 1 --2- 172.21.15.57:0/272952957 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f46f80606d0 0x7f46f8062b80 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.991 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.983+0000 7f471b5c5700 1 --2- 172.21.15.57:0/272952957 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f47141589b0 0x7f47140aff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.992 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.983+0000 7f471b5c5700 1 --2- 172.21.15.57:0/272952957 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f47140cc810 0x7f4714154800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.992 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.983+0000 7f471b5c5700 1 --2- 172.21.15.57:0/272952957 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4714069240 0x7f47140b1ce0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.992 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.983+0000 7f471b5c5700 1 -- 172.21.15.57:0/272952957 >> 172.21.15.57:0/272952957 conn(0x7f47140ccc80 msgr2=0x7f47140cd050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:04.992 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.983+0000 7f471b5c5700 1 -- 172.21.15.57:0/272952957 shutdown_connections 2023-10-06T03:01:04.992 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.983+0000 7f471b5c5700 1 -- 172.21.15.57:0/272952957 wait complete. 2023-10-06T03:01:04.993 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.983+0000 7f529182e700 1 -- 172.21.15.57:0/2637523339 shutdown_connections 2023-10-06T03:01:04.993 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.983+0000 7f529182e700 1 --2- 172.21.15.57:0/2637523339 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f52780605d0 0x7f5278062a80 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.993 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.983+0000 7f529182e700 1 --2- 172.21.15.57:0/2637523339 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f528c159240 0x7f528c147f80 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.993 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.983+0000 7f529182e700 1 --2- 172.21.15.57:0/2637523339 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f528c158e70 0x7f528c147a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.993 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.983+0000 7f529182e700 1 --2- 172.21.15.57:0/2637523339 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f528c06d510 0x7f528c0cae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.993 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.983+0000 7f529182e700 1 -- 172.21.15.57:0/2637523339 >> 172.21.15.57:0/2637523339 conn(0x7f528c0cbb50 msgr2=0x7f528c06c920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:04.993 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.983+0000 7f74e27fc700 1 -- 172.21.15.57:0/475824107 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f74e4007e60 con 0x7f74ec159370 2023-10-06T03:01:04.994 INFO:teuthology.orchestra.run.smithi057.stdout:55834574852 2023-10-06T03:01:04.994 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.987+0000 7f529182e700 1 -- 172.21.15.57:0/2637523339 shutdown_connections 2023-10-06T03:01:04.994 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.987+0000 7f5abf59e700 1 -- 172.21.15.57:0/157043498 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f5ab80054e0 con 0x7f5ab80e3fa0 2023-10-06T03:01:04.995 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.987+0000 7f529182e700 1 -- 172.21.15.57:0/2637523339 wait complete. 2023-10-06T03:01:04.995 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.987+0000 7f74f426e700 1 -- 172.21.15.57:0/475824107 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f74d00606a0 msgr2=0x7f74d0062b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:04.996 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.987+0000 7f74f426e700 1 --2- 172.21.15.57:0/475824107 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f74d00606a0 0x7f74d0062b50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f74e8001fe0 tx=0x7f74e8007ed0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.996 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.987+0000 7f74f426e700 1 -- 172.21.15.57:0/475824107 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f74ec159370 msgr2=0x7f74ec15cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:04.996 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.987+0000 7f74f426e700 1 --2- 172.21.15.57:0/475824107 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f74ec159370 0x7f74ec15cc00 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f74e4002580 tx=0x7f74e4009810 comp rx=0 tx=0).stop 2023-10-06T03:01:04.996 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.987+0000 7f74f426e700 1 -- 172.21.15.57:0/475824107 shutdown_connections 2023-10-06T03:01:04.996 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.987+0000 7f74f426e700 1 --2- 172.21.15.57:0/475824107 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f74ec159370 0x7f74ec15cc00 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.996 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.987+0000 7f74f426e700 1 --2- 172.21.15.57:0/475824107 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f74ec158fa0 0x7f74ec146b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.996 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.987+0000 7f74f426e700 1 --2- 172.21.15.57:0/475824107 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f74d00606a0 0x7f74d0062b50 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.996 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.987+0000 7f74f426e700 1 --2- 172.21.15.57:0/475824107 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f74ec0c3740 0x7f74ec147790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.996 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.987+0000 7f74f426e700 1 -- 172.21.15.57:0/475824107 >> 172.21.15.57:0/475824107 conn(0x7f74ec0afbd0 msgr2=0x7f74ec0cbb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:04.996 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.987+0000 7f5ab67fc700 1 -- 172.21.15.57:0/157043498 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5aa8021090 con 0x7f5ab80e3fa0 2023-10-06T03:01:04.997 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.991+0000 7f74f426e700 1 -- 172.21.15.57:0/475824107 shutdown_connections 2023-10-06T03:01:04.997 INFO:teuthology.orchestra.run.smithi057.stdout:55834574853 2023-10-06T03:01:04.997 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.991+0000 7f74f426e700 1 -- 172.21.15.57:0/475824107 wait complete. 2023-10-06T03:01:04.998 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.991+0000 7f5abf59e700 1 -- 172.21.15.57:0/157043498 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f5aa00606a0 msgr2=0x7f5aa0062b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:04.999 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.991+0000 7f5abf59e700 1 --2- 172.21.15.57:0/157043498 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f5aa00606a0 0x7f5aa0062b50 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5ac0065280 tx=0x7f5ac00655f0 comp rx=0 tx=0).stop 2023-10-06T03:01:04.999 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.6 2023-10-06T03:01:05.000 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.991+0000 7f5abf59e700 1 -- 172.21.15.57:0/157043498 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5ab80e3fa0 msgr2=0x7f5ab80df160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:05.000 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.991+0000 7f5abf59e700 1 --2- 172.21.15.57:0/157043498 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5ab80e3fa0 0x7f5ab80df160 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5aa800c4b0 tx=0x7f5aa8007e60 comp rx=0 tx=0).stop 2023-10-06T03:01:05.000 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.995+0000 7f5abf59e700 1 -- 172.21.15.57:0/157043498 shutdown_connections 2023-10-06T03:01:05.000 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.995+0000 7f5abf59e700 1 --2- 172.21.15.57:0/157043498 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5ab80e3fa0 0x7f5ab80df160 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:05.000 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.995+0000 7f5abf59e700 1 --2- 172.21.15.57:0/157043498 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ab80e2000 0x7f5ab80e3a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:05.000 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.995+0000 7f5abf59e700 1 --2- 172.21.15.57:0/157043498 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f5aa00606a0 0x7f5aa0062b50 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:05.000 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.995+0000 7f5abf59e700 1 --2- 172.21.15.57:0/157043498 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5ab803af90 0x7f5ab80e77a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:05.000 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.995+0000 7f5abf59e700 1 -- 172.21.15.57:0/157043498 >> 172.21.15.57:0/157043498 conn(0x7f5ab8059c40 msgr2=0x7f5ab80e07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:05.002 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.995+0000 7f5abf59e700 1 -- 172.21.15.57:0/157043498 shutdown_connections 2023-10-06T03:01:05.002 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:04.995+0000 7f5abf59e700 1 -- 172.21.15.57:0/157043498 wait complete. 2023-10-06T03:01:05.004 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.0 2023-10-06T03:01:05.006 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.2 2023-10-06T03:01:05.011 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.5 2023-10-06T03:01:05.021 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.4 2023-10-06T03:01:05.022 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.7 2023-10-06T03:01:05.023 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.1 2023-10-06T03:01:05.990 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-06T03:01:05.999 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-06T03:01:06.005 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-06T03:01:06.007 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-06T03:01:06.012 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-06T03:01:06.022 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-06T03:01:06.022 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-06T03:01:06.024 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-06T03:01:06.188 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.183+0000 7feda1cf0700 1 Processor -- start 2023-10-06T03:01:06.191 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.183+0000 7feda1cf0700 1 -- start start 2023-10-06T03:01:06.192 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.187+0000 7feda1cf0700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fed9c1585f0 0x7fed9c06d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.192 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.187+0000 7feda1cf0700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fed9c0c08f0 0x7fed9c159540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.192 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.187+0000 7feda1cf0700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed9c1590b0 con 0x7fed9c159a80 2023-10-06T03:01:06.192 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.187+0000 7feda1cf0700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed9c0c6440 con 0x7fed9c1585f0 2023-10-06T03:01:06.192 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.187+0000 7feda1cf0700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed9c06dae0 con 0x7fed9c0c08f0 2023-10-06T03:01:06.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.187+0000 7fed9bfff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fed9c159a80 0x7fed9c067050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:45846/0 (socket says 172.21.15.57:45846) 2023-10-06T03:01:06.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.187+0000 7fed9bfff700 1 -- 172.21.15.57:0/575050054 learned_addr learned my addr 172.21.15.57:0/575050054 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:01:06.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.187+0000 7fed9affd700 1 --2- 172.21.15.57:0/575050054 >> v2:172.21.15.105:3300/0 conn(0x7fed9c0c08f0 0x7fed9c159540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:06.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.187+0000 7fed9b7fe700 1 --2- 172.21.15.57:0/575050054 >> v2:172.21.15.57:3300/0 conn(0x7fed9c1585f0 0x7fed9c06d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:06.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.187+0000 7fed9affd700 1 -- 172.21.15.57:0/575050054 >> v2:172.21.15.57:3300/0 conn(0x7fed9c1585f0 msgr2=0x7fed9c06d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:06.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.187+0000 7fed9affd700 1 --2- 172.21.15.57:0/575050054 >> v2:172.21.15.57:3300/0 conn(0x7fed9c1585f0 0x7fed9c06d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.187+0000 7fed9affd700 1 -- 172.21.15.57:0/575050054 >> v1:172.21.15.57:6789/0 conn(0x7fed9c159a80 legacy=0x7fed9c067050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:06.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.187+0000 7fed9affd700 1 -- 172.21.15.57:0/575050054 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed9c06ddc0 con 0x7fed9c0c08f0 2023-10-06T03:01:06.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.187+0000 7fed9b7fe700 1 --2- 172.21.15.57:0/575050054 >> v2:172.21.15.57:3300/0 conn(0x7fed9c1585f0 0x7fed9c06d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:01:06.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.187+0000 7fed9affd700 1 --2- 172.21.15.57:0/575050054 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fed9c0c08f0 0x7fed9c159540 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fed9c0c98c0 tx=0x7fed940099a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d1ca1e0d11eb69e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:06.197 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.187+0000 7fed9a7fc700 1 -- 172.21.15.57:0/575050054 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed9400cb20 con 0x7fed9c0c08f0 2023-10-06T03:01:06.197 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.191+0000 7fed9a7fc700 1 -- 172.21.15.57:0/575050054 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed9400cc80 con 0x7fed9c0c08f0 2023-10-06T03:01:06.197 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.191+0000 7fed9a7fc700 1 -- 172.21.15.57:0/575050054 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed94010430 con 0x7fed9c0c08f0 2023-10-06T03:01:06.197 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.191+0000 7feda1cf0700 1 -- 172.21.15.57:0/575050054 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fed9c0c08f0 msgr2=0x7fed9c159540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:06.198 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.191+0000 7feda1cf0700 1 --2- 172.21.15.57:0/575050054 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fed9c0c08f0 0x7fed9c159540 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fed9c0c98c0 tx=0x7fed940099a0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.198 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.191+0000 7feda1cf0700 1 -- 172.21.15.57:0/575050054 shutdown_connections 2023-10-06T03:01:06.198 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.191+0000 7feda1cf0700 1 --2- 172.21.15.57:0/575050054 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fed9c0c08f0 0x7fed9c159540 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.198 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.191+0000 7feda1cf0700 1 --2- 172.21.15.57:0/575050054 >> v2:172.21.15.57:3300/0 conn(0x7fed9c1585f0 0x7fed9c06d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.198 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.191+0000 7feda1cf0700 1 -- 172.21.15.57:0/575050054 >> 172.21.15.57:0/575050054 conn(0x7fed9c0cbb50 msgr2=0x7fed9c0cbf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:06.198 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.191+0000 7feda1cf0700 1 -- 172.21.15.57:0/575050054 shutdown_connections 2023-10-06T03:01:06.199 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.191+0000 7feda1cf0700 1 -- 172.21.15.57:0/575050054 wait complete. 2023-10-06T03:01:06.200 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.195+0000 7feda1cf0700 1 Processor -- start 2023-10-06T03:01:06.201 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.195+0000 7feda1cf0700 1 -- start start 2023-10-06T03:01:06.202 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.195+0000 7feda1cf0700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fed9c0c08f0 0x7fed9c0ad070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.202 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.195+0000 7feda1cf0700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fed9c1585f0 0x7fed9c0afd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.202 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.195+0000 7feda1cf0700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fed9c159a80 0x7fed9c150c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.202 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.195+0000 7feda1cf0700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed9c0c31c0 con 0x7fed9c1585f0 2023-10-06T03:01:06.203 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.195+0000 7fed9affd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fed9c1585f0 0x7fed9c0afd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:06.203 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.195+0000 7fed9affd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fed9c1585f0 0x7fed9c0afd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55854/0 (socket says 172.21.15.57:55854) 2023-10-06T03:01:06.203 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.195+0000 7fed9affd700 1 -- 172.21.15.57:0/2237042321 learned_addr learned my addr 172.21.15.57:0/2237042321 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:06.203 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.195+0000 7feda1cf0700 1 -- 172.21.15.57:0/2237042321 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed9c0af300 con 0x7fed9c0c08f0 2023-10-06T03:01:06.203 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.195+0000 7feda1cf0700 1 -- 172.21.15.57:0/2237042321 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed9c0af870 con 0x7fed9c159a80 2023-10-06T03:01:06.203 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.199+0000 7fed9bfff700 1 --2- 172.21.15.57:0/2237042321 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fed9c159a80 0x7fed9c150c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:06.204 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.199+0000 7fed9b7fe700 1 --2- 172.21.15.57:0/2237042321 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fed9c0c08f0 0x7fed9c0ad070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:06.204 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.199+0000 7fed9affd700 1 -- 172.21.15.57:0/2237042321 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fed9c159a80 msgr2=0x7fed9c150c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:06.204 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.199+0000 7fed9affd700 1 --2- 172.21.15.57:0/2237042321 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fed9c159a80 0x7fed9c150c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.204 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.199+0000 7fed9affd700 1 -- 172.21.15.57:0/2237042321 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fed9c0c08f0 msgr2=0x7fed9c0ad070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:06.204 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.199+0000 7fed9affd700 1 --2- 172.21.15.57:0/2237042321 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fed9c0c08f0 0x7fed9c0ad070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.204 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.199+0000 7fed9affd700 1 -- 172.21.15.57:0/2237042321 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed9400c2c0 con 0x7fed9c1585f0 2023-10-06T03:01:06.204 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.199+0000 7fed9bfff700 1 --2- 172.21.15.57:0/2237042321 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fed9c159a80 0x7fed9c150c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:06.204 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.199+0000 7fed9affd700 1 --2- 172.21.15.57:0/2237042321 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fed9c1585f0 0x7fed9c0afd00 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fed9c06e3b0 tx=0x7fed9401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:06.205 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.199+0000 7fed837fe700 1 -- 172.21.15.57:0/2237042321 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed94018420 con 0x7fed9c1585f0 2023-10-06T03:01:06.205 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.199+0000 7feda1cf0700 1 -- 172.21.15.57:0/2237042321 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed9c0c2c00 con 0x7fed9c1585f0 2023-10-06T03:01:06.205 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.199+0000 7feda1cf0700 1 -- 172.21.15.57:0/2237042321 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed9c0af500 con 0x7fed9c1585f0 2023-10-06T03:01:06.206 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.199+0000 7fed837fe700 1 -- 172.21.15.57:0/2237042321 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed94018580 con 0x7fed9c1585f0 2023-10-06T03:01:06.207 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.203+0000 7fed837fe700 1 -- 172.21.15.57:0/2237042321 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed94018940 con 0x7fed9c1585f0 2023-10-06T03:01:06.208 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.203+0000 7feda1cf0700 1 -- 172.21.15.57:0/2237042321 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed7c0052b0 con 0x7fed9c1585f0 2023-10-06T03:01:06.209 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.203+0000 7fed837fe700 1 -- 172.21.15.57:0/2237042321 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fed94018d30 con 0x7fed9c1585f0 2023-10-06T03:01:06.211 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.207+0000 7fed837fe700 1 --2- 172.21.15.57:0/2237042321 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fed88060620 0x7fed88062ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.211 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.207+0000 7fed837fe700 1 -- 172.21.15.57:0/2237042321 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fed94014070 con 0x7fed9c1585f0 2023-10-06T03:01:06.212 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.207+0000 7fed9b7fe700 1 --2- 172.21.15.57:0/2237042321 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fed88060620 0x7fed88062ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:06.213 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.207+0000 7fed9b7fe700 1 --2- 172.21.15.57:0/2237042321 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fed88060620 0x7fed88062ad0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fed9000ac00 tx=0x7fed90006f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:06.221 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.215+0000 7fed837fe700 1 -- 172.21.15.57:0/2237042321 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fed9404f380 con 0x7fed9c1585f0 2023-10-06T03:01:06.252 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.247+0000 7f32a2345700 1 Processor -- start 2023-10-06T03:01:06.253 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.247+0000 7f32a2345700 1 -- start start 2023-10-06T03:01:06.255 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.247+0000 7f432dd85700 1 Processor -- start 2023-10-06T03:01:06.255 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.247+0000 7f432dd85700 1 -- start start 2023-10-06T03:01:06.255 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.247+0000 7f32a2345700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f329c158e70 0x7f329c067050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.255 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.247+0000 7f32a2345700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f329c159240 0x7f329c067590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.255 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.251+0000 7f32a2345700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f329c06ce00 0x7f329c06d280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.256 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.251+0000 7f32a2345700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f329c0a88c0 con 0x7f329c158e70 2023-10-06T03:01:06.256 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.251+0000 7f32a2345700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f329c0c1e30 con 0x7f329c06ce00 2023-10-06T03:01:06.256 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.251+0000 7f32a2345700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f329c06db70 con 0x7f329c159240 2023-10-06T03:01:06.256 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.251+0000 7f3293fff700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f329c159240 0x7f329c067590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:06.257 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.251+0000 7f3293fff700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f329c159240 0x7f329c067590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.57:46092/0 (socket says 172.21.15.57:46092) 2023-10-06T03:01:06.257 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.251+0000 7f3293fff700 1 -- 172.21.15.57:0/2321616237 learned_addr learned my addr 172.21.15.57:0/2321616237 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:06.257 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.251+0000 7f32a08e2700 1 --2- 172.21.15.57:0/2321616237 >> v2:172.21.15.105:3300/0 conn(0x7f329c06ce00 0x7f329c06d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:06.257 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.251+0000 7f329bfff700 1 --2- 172.21.15.57:0/2321616237 >> v2:172.21.15.57:3300/0 conn(0x7f329c158e70 0x7f329c067050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:06.257 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.251+0000 7f432dd85700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4328155060 0x7f43280c19b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.258 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.251+0000 7f432dd85700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4328067760 0x7f43280c6c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.258 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.251+0000 7f432dd85700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f432806cd20 con 0x7f432806dd30 2023-10-06T03:01:06.258 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.251+0000 7f432dd85700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43280ae600 con 0x7f4328067760 2023-10-06T03:01:06.258 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.251+0000 7f432dd85700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f432806d8a0 con 0x7f4328155060 2023-10-06T03:01:06.258 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.251+0000 7f329bfff700 1 -- 172.21.15.57:0/2321616237 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f329c159240 msgr2=0x7f329c067590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:06.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.251+0000 7f329bfff700 1 --2- 172.21.15.57:0/2321616237 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f329c159240 0x7f329c067590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.251+0000 7f329bfff700 1 -- 172.21.15.57:0/2321616237 >> v2:172.21.15.105:3300/0 conn(0x7f329c06ce00 msgr2=0x7f329c06d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:06.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.251+0000 7f329bfff700 1 --2- 172.21.15.57:0/2321616237 >> v2:172.21.15.105:3300/0 conn(0x7f329c06ce00 0x7f329c06d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.251+0000 7f329bfff700 1 -- 172.21.15.57:0/2321616237 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f329c06de50 con 0x7f329c158e70 2023-10-06T03:01:06.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.251+0000 7f329bfff700 1 --2- 172.21.15.57:0/2321616237 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f329c158e70 0x7f329c067050 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f329c0c2b10 tx=0x7f328c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72fa8f2b73b26342 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:06.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.251+0000 7f4327fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4328067760 0x7f43280c6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:06.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.251+0000 7f4327fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4328067760 0x7f43280c6c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55866/0 (socket says 172.21.15.57:55866) 2023-10-06T03:01:06.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.251+0000 7f4327fff700 1 -- 172.21.15.57:0/2282577596 learned_addr learned my addr 172.21.15.57:0/2282577596 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:06.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.251+0000 7f329b7fe700 1 -- 172.21.15.57:0/2321616237 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f328c011630 con 0x7f329c158e70 2023-10-06T03:01:06.261 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.251+0000 7f329b7fe700 1 -- 172.21.15.57:0/2321616237 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f328c0117b0 con 0x7f329c158e70 2023-10-06T03:01:06.261 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.251+0000 7f329b7fe700 1 -- 172.21.15.57:0/2321616237 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f328c011b70 con 0x7f329c158e70 2023-10-06T03:01:06.261 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.255+0000 7f4327fff700 1 -- 172.21.15.57:0/2282577596 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4328155060 msgr2=0x7f43280c19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:06.261 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.255+0000 7f43277fe700 1 --2- 172.21.15.57:0/2282577596 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4328155060 0x7f43280c19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:06.262 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.255+0000 7f4327fff700 1 --2- 172.21.15.57:0/2282577596 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4328155060 0x7f43280c19b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.262 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.255+0000 7f4327fff700 1 -- 172.21.15.57:0/2282577596 >> v1:172.21.15.105:6789/0 conn(0x7f432806dd30 legacy=0x7f4328067050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:06.262 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.255+0000 7f43267fc700 1 -- 172.21.15.57:0/2282577596 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 90650365 0 0) 0x7f432806cd20 con 0x7f432806dd30 2023-10-06T03:01:06.262 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.255+0000 7f4327fff700 1 -- 172.21.15.57:0/2282577596 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f432806cf70 con 0x7f4328067760 2023-10-06T03:01:06.262 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.255+0000 7f43277fe700 1 --2- 172.21.15.57:0/2282577596 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4328155060 0x7f43280c19b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:01:06.262 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.255+0000 7f32a2345700 1 -- 172.21.15.57:0/2321616237 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f329c158e70 msgr2=0x7f329c067050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:06.263 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.255+0000 7f32a2345700 1 --2- 172.21.15.57:0/2321616237 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f329c158e70 0x7f329c067050 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f329c0c2b10 tx=0x7f328c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.263 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.255+0000 7f32a2345700 1 -- 172.21.15.57:0/2321616237 shutdown_connections 2023-10-06T03:01:06.263 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.255+0000 7f32a2345700 1 --2- 172.21.15.57:0/2321616237 >> v2:172.21.15.105:3300/0 conn(0x7f329c06ce00 0x7f329c06d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.263 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.255+0000 7f32a2345700 1 --2- 172.21.15.57:0/2321616237 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f329c159240 0x7f329c067590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.263 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.255+0000 7f32a2345700 1 --2- 172.21.15.57:0/2321616237 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f329c158e70 0x7f329c067050 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.263 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.255+0000 7f32a2345700 1 -- 172.21.15.57:0/2321616237 >> 172.21.15.57:0/2321616237 conn(0x7f329c0cbb50 msgr2=0x7f329c0cbf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:06.263 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.255+0000 7f4d35eae700 1 Processor -- start 2023-10-06T03:01:06.264 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.255+0000 7f32a2345700 1 -- 172.21.15.57:0/2321616237 shutdown_connections 2023-10-06T03:01:06.264 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.255+0000 7f4327fff700 1 --2- 172.21.15.57:0/2282577596 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4328067760 0x7f43280c6c60 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f431c0099e0 tx=0x7f431c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7987e750aca91552 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:06.264 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.255+0000 7f4d35eae700 1 -- start start 2023-10-06T03:01:06.265 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.255+0000 7f32a2345700 1 -- 172.21.15.57:0/2321616237 wait complete. 2023-10-06T03:01:06.265 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.255+0000 7f43267fc700 1 -- 172.21.15.57:0/2282577596 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f431c00b820 con 0x7f4328067760 2023-10-06T03:01:06.265 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.255+0000 7f43267fc700 1 -- 172.21.15.57:0/2282577596 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f431c00b980 con 0x7f4328067760 2023-10-06T03:01:06.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.255+0000 7f43267fc700 1 -- 172.21.15.57:0/2282577596 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f431c00bd20 con 0x7f4328067760 2023-10-06T03:01:06.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.255+0000 7f4d35eae700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4d30067760 0x7f4d301585f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.255+0000 7f4d35eae700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d30158b30 con 0x7f4d300c08f0 2023-10-06T03:01:06.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.255+0000 7f32a2345700 1 Processor -- start 2023-10-06T03:01:06.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.255+0000 7f4d35eae700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d301590b0 con 0x7f4d300cc630 2023-10-06T03:01:06.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.255+0000 7f4d35eae700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d300c6440 con 0x7f4d30067760 2023-10-06T03:01:06.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.259+0000 7f432dd85700 1 -- 172.21.15.57:0/2282577596 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4328067760 msgr2=0x7f43280c6c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:06.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.259+0000 7f432dd85700 1 --2- 172.21.15.57:0/2282577596 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4328067760 0x7f43280c6c60 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f431c0099e0 tx=0x7f431c009250 comp rx=0 tx=0).stop 2023-10-06T03:01:06.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.259+0000 7f4d2f7fe700 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f4d300cc630 0x7f4d3006d290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.57:36348/0 (socket says 172.21.15.57:36348) 2023-10-06T03:01:06.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.259+0000 7f4d2f7fe700 1 -- 172.21.15.57:0/776134359 learned_addr learned my addr 172.21.15.57:0/776134359 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:01:06.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.259+0000 7f432dd85700 1 -- 172.21.15.57:0/2282577596 shutdown_connections 2023-10-06T03:01:06.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.259+0000 7f432dd85700 1 --2- 172.21.15.57:0/2282577596 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4328067760 0x7f43280c6c60 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.259+0000 7f432dd85700 1 --2- 172.21.15.57:0/2282577596 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4328155060 0x7f43280c19b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.259+0000 7f432dd85700 1 -- 172.21.15.57:0/2282577596 >> 172.21.15.57:0/2282577596 conn(0x7f43280cbb50 msgr2=0x7f43280cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:06.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.259+0000 7f432dd85700 1 -- 172.21.15.57:0/2282577596 shutdown_connections 2023-10-06T03:01:06.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.259+0000 7f432dd85700 1 -- 172.21.15.57:0/2282577596 wait complete. 2023-10-06T03:01:06.270 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.259+0000 7f4d2ffff700 1 --2- 172.21.15.57:0/776134359 >> v2:172.21.15.57:3300/0 conn(0x7f4d30067760 0x7f4d301585f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:06.270 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.259+0000 7f4d2e7fc700 1 -- 172.21.15.57:0/776134359 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 802760435 0 0) 0x7f4d301590b0 con 0x7f4d300cc630 2023-10-06T03:01:06.270 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.259+0000 7f4d2e7fc700 1 -- 172.21.15.57:0/776134359 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d1c003570 con 0x7f4d300cc630 2023-10-06T03:01:06.270 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.259+0000 7f4d2ffff700 1 -- 172.21.15.57:0/776134359 >> v1:172.21.15.105:6789/0 conn(0x7f4d300cc630 legacy=0x7f4d3006d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:06.270 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.259+0000 7f4d2ffff700 1 -- 172.21.15.57:0/776134359 >> v1:172.21.15.57:6789/0 conn(0x7f4d300c08f0 legacy=0x7f4d30067050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:06.270 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.259+0000 7f4d2ffff700 1 -- 172.21.15.57:0/776134359 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d3006dae0 con 0x7f4d30067760 2023-10-06T03:01:06.270 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.259+0000 7f32a2345700 1 -- start start 2023-10-06T03:01:06.271 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.259+0000 7f32a2345700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f329c06ce00 0x7f329c0b11d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.271 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.259+0000 7fb0599c5700 1 Processor -- start 2023-10-06T03:01:06.271 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.259+0000 7f4d2ffff700 1 --2- 172.21.15.57:0/776134359 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d30067760 0x7f4d301585f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f4d180098e0 tx=0x7f4d180091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34882fc85fd222a4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:06.271 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.259+0000 7fb0599c5700 1 -- start start 2023-10-06T03:01:06.272 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.259+0000 7f32a2345700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f329c158e70 0x7f329c156470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.272 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.259+0000 7f329bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f329c06ce00 0x7f329c0b11d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:06.272 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.259+0000 7f329bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f329c06ce00 0x7f329c0b11d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55878/0 (socket says 172.21.15.57:55878) 2023-10-06T03:01:06.273 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.259+0000 7f4d2e7fc700 1 -- 172.21.15.57:0/776134359 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d1800b640 con 0x7f4d30067760 2023-10-06T03:01:06.273 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.259+0000 7f4d2e7fc700 1 -- 172.21.15.57:0/776134359 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d1800b7a0 con 0x7f4d30067760 2023-10-06T03:01:06.273 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.259+0000 7f4d2e7fc700 1 -- 172.21.15.57:0/776134359 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d1800bb40 con 0x7f4d30067760 2023-10-06T03:01:06.273 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.259+0000 7f329bfff700 1 -- 172.21.15.57:0/987728833 learned_addr learned my addr 172.21.15.57:0/987728833 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:06.274 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.259+0000 7f432dd85700 1 Processor -- start 2023-10-06T03:01:06.274 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.259+0000 7f32a2345700 1 --2- 172.21.15.57:0/987728833 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f329c159240 0x7f329c0c88e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.274 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.259+0000 7f432dd85700 1 -- start start 2023-10-06T03:01:06.275 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.259+0000 7f32a2345700 1 -- 172.21.15.57:0/987728833 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f329c0b0d40 con 0x7f329c06ce00 2023-10-06T03:01:06.275 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.259+0000 7f3293fff700 1 --2- 172.21.15.57:0/987728833 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f329c158e70 0x7f329c156470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:06.275 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.259+0000 7f4d35eae700 1 -- 172.21.15.57:0/776134359 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d30067760 msgr2=0x7f4d301585f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:06.275 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.259+0000 7f4d35eae700 1 --2- 172.21.15.57:0/776134359 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d30067760 0x7f4d301585f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f4d180098e0 tx=0x7f4d180091a0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.276 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.259+0000 7f32a08e2700 1 --2- 172.21.15.57:0/987728833 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f329c159240 0x7f329c0c88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:06.276 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.259+0000 7f32a2345700 1 -- 172.21.15.57:0/987728833 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f329c0afe90 con 0x7f329c158e70 2023-10-06T03:01:06.276 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.263+0000 7f32a2345700 1 -- 172.21.15.57:0/987728833 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f329c0b0130 con 0x7f329c159240 2023-10-06T03:01:06.276 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.263+0000 7f4d35eae700 1 -- 172.21.15.57:0/776134359 shutdown_connections 2023-10-06T03:01:06.276 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.263+0000 7f4d35eae700 1 --2- 172.21.15.57:0/776134359 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d30067760 0x7f4d301585f0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.263+0000 7f4d35eae700 1 -- 172.21.15.57:0/776134359 >> 172.21.15.57:0/776134359 conn(0x7f4d300cbb50 msgr2=0x7f4d300cbf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:06.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.263+0000 7f432dd85700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4328067760 0x7f4328149050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.263+0000 7f432dd85700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f432806dd30 0x7f43280c4f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.263+0000 7f432dd85700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4328155060 0x7f43280c5460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.263+0000 7f432dd85700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43280c4770 con 0x7f4328155060 2023-10-06T03:01:06.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.263+0000 7f432dd85700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43280c3a40 con 0x7f432806dd30 2023-10-06T03:01:06.278 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.263+0000 7f432dd85700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43280c42e0 con 0x7f4328067760 2023-10-06T03:01:06.278 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.263+0000 7f4d35eae700 1 -- 172.21.15.57:0/776134359 shutdown_connections 2023-10-06T03:01:06.278 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.263+0000 7fb0599c5700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb04c006150 0x7fb04c006520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.278 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.263+0000 7fb0599c5700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb04c04bd70 con 0x7fb04c006a60 2023-10-06T03:01:06.278 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.263+0000 7fb0599c5700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb04c007dc0 con 0x7fb04c0e6760 2023-10-06T03:01:06.279 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.263+0000 7fb0599c5700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb04c0e6cd0 con 0x7fb04c006150 2023-10-06T03:01:06.279 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.263+0000 7f4327fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4328155060 0x7f43280c5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:06.279 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.263+0000 7f43277fe700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4328067760 0x7f4328149050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:06.279 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.263+0000 7f4327fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4328155060 0x7f43280c5460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55882/0 (socket says 172.21.15.57:55882) 2023-10-06T03:01:06.279 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.263+0000 7f4327fff700 1 -- 172.21.15.57:0/1227302221 learned_addr learned my addr 172.21.15.57:0/1227302221 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:06.280 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.263+0000 7f3293fff700 1 -- 172.21.15.57:0/987728833 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f329c159240 msgr2=0x7f329c0c88e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:06.280 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.263+0000 7f3293fff700 1 --2- 172.21.15.57:0/987728833 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f329c159240 0x7f329c0c88e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.280 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.263+0000 7f3293fff700 1 -- 172.21.15.57:0/987728833 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f329c06ce00 msgr2=0x7f329c0b11d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:06.280 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.263+0000 7f3293fff700 1 --2- 172.21.15.57:0/987728833 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f329c06ce00 0x7f329c0b11d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.280 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.263+0000 7f3293fff700 1 -- 172.21.15.57:0/987728833 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f328c009420 con 0x7f329c158e70 2023-10-06T03:01:06.280 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.263+0000 7f4d35eae700 1 -- 172.21.15.57:0/776134359 wait complete. 2023-10-06T03:01:06.281 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.263+0000 7fb0537fe700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fb04c006a60 0x7fb04c0e2b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:45866/0 (socket says 172.21.15.57:45866) 2023-10-06T03:01:06.281 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.263+0000 7fb0537fe700 1 -- 172.21.15.57:0/2858470517 learned_addr learned my addr 172.21.15.57:0/2858470517 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:01:06.281 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.263+0000 7fb052ffd700 1 --2- 172.21.15.57:0/2858470517 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb04c006150 0x7fb04c006520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:06.281 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.263+0000 7f4326ffd700 1 --2- 172.21.15.57:0/1227302221 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f432806dd30 0x7f43280c4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:06.282 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.263+0000 7f3293fff700 1 --2- 172.21.15.57:0/987728833 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f329c158e70 0x7f329c156470 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3284006d40 tx=0x7f3284009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:06.282 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.263+0000 7f3a883c5700 1 Processor -- start 2023-10-06T03:01:06.282 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.263+0000 7f4327fff700 1 -- 172.21.15.57:0/1227302221 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4328067760 msgr2=0x7f4328149050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:06.282 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.263+0000 7f4327fff700 1 --2- 172.21.15.57:0/1227302221 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4328067760 0x7f4328149050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.283 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.263+0000 7f4327fff700 1 -- 172.21.15.57:0/1227302221 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f432806dd30 msgr2=0x7f43280c4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:06.283 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.263+0000 7f4327fff700 1 --2- 172.21.15.57:0/1227302221 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f432806dd30 0x7f43280c4f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.283 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.263+0000 7f4327fff700 1 -- 172.21.15.57:0/1227302221 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f431c0094f0 con 0x7f4328155060 2023-10-06T03:01:06.283 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.263+0000 7fe0b7f85700 1 Processor -- start 2023-10-06T03:01:06.283 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.263+0000 7f3298ff9700 1 -- 172.21.15.57:0/987728833 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3284013680 con 0x7f329c158e70 2023-10-06T03:01:06.284 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.263+0000 7f3298ff9700 1 -- 172.21.15.57:0/987728833 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32840137e0 con 0x7f329c158e70 2023-10-06T03:01:06.284 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.263+0000 7f3298ff9700 1 -- 172.21.15.57:0/987728833 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3284013b60 con 0x7f329c158e70 2023-10-06T03:01:06.284 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.263+0000 7f4327fff700 1 --2- 172.21.15.57:0/1227302221 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4328155060 0x7f43280c5460 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f432806b940 tx=0x7f431c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:06.284 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.263+0000 7f4d35eae700 1 Processor -- start 2023-10-06T03:01:06.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.263+0000 7f430f7fe700 1 -- 172.21.15.57:0/1227302221 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f431c01a630 con 0x7f4328155060 2023-10-06T03:01:06.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.263+0000 7f430f7fe700 1 -- 172.21.15.57:0/1227302221 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f431c01a790 con 0x7f4328155060 2023-10-06T03:01:06.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.263+0000 7f432dd85700 1 -- 172.21.15.57:0/1227302221 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4328149d00 con 0x7f4328155060 2023-10-06T03:01:06.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.263+0000 7f430f7fe700 1 -- 172.21.15.57:0/1227302221 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f431c01ab50 con 0x7f4328155060 2023-10-06T03:01:06.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.263+0000 7f432dd85700 1 -- 172.21.15.57:0/1227302221 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43280c3c90 con 0x7f4328155060 2023-10-06T03:01:06.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.263+0000 7f32a2345700 1 -- 172.21.15.57:0/987728833 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f329c0b0410 con 0x7f329c158e70 2023-10-06T03:01:06.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.263+0000 7f32a2345700 1 -- 172.21.15.57:0/987728833 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f329c0b09d0 con 0x7f329c158e70 2023-10-06T03:01:06.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.263+0000 7fe0b7f85700 1 -- start start 2023-10-06T03:01:06.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.267+0000 7f32a2345700 1 -- 172.21.15.57:0/987728833 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32800052b0 con 0x7f329c158e70 2023-10-06T03:01:06.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.263+0000 7f4d35eae700 1 -- start start 2023-10-06T03:01:06.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.267+0000 7f4d35eae700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d30067760 0x7f4d300ab460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.267+0000 7f4d35eae700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4d300c08f0 0x7f4d30157230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.267+0000 7f4d35eae700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4d300cc630 0x7f4d300ac100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.263+0000 7f3a883c5700 1 -- start start 2023-10-06T03:01:06.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.267+0000 7f3a883c5700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3a8015d350 0x7f3a8006dc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.267+0000 7f3a883c5700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f3a8015d720 0x7f3a80067050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.267+0000 7f3a883c5700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a8006d7f0 con 0x7f3a80067590 2023-10-06T03:01:06.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.267+0000 7f3a883c5700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a80067a10 con 0x7f3a8015d720 2023-10-06T03:01:06.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.267+0000 7f3a883c5700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a8006cf00 con 0x7f3a8015d350 2023-10-06T03:01:06.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.267+0000 7f432dd85700 1 -- 172.21.15.57:0/1227302221 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43280c4470 con 0x7f4328155060 2023-10-06T03:01:06.289 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.263+0000 7fb051ffb700 1 -- 172.21.15.57:0/2858470517 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2679953949 0 0) 0x7fb04c007dc0 con 0x7fb04c0e6760 2023-10-06T03:01:06.289 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.263+0000 7fb051ffb700 1 -- 172.21.15.57:0/2858470517 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb03c003570 con 0x7fb04c0e6760 2023-10-06T03:01:06.289 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.263+0000 7fb052ffd700 1 -- 172.21.15.57:0/2858470517 >> v1:172.21.15.105:6789/0 conn(0x7fb04c0e6760 legacy=0x7fb04c04c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:06.289 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.263+0000 7fb052ffd700 1 -- 172.21.15.57:0/2858470517 >> v1:172.21.15.57:6789/0 conn(0x7fb04c006a60 legacy=0x7fb04c0e2b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:06.289 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.263+0000 7fb052ffd700 1 -- 172.21.15.57:0/2858470517 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb04c0080a0 con 0x7fb04c006150 2023-10-06T03:01:06.289 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.263+0000 7fb052ffd700 1 --2- 172.21.15.57:0/2858470517 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb04c006150 0x7fb04c006520 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb048009900 tx=0x7fb048009120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9344aa4734fe31c6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:06.289 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.263+0000 7fb051ffb700 1 -- 172.21.15.57:0/2858470517 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb048005c10 con 0x7fb04c006150 2023-10-06T03:01:06.290 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.263+0000 7fb051ffb700 1 -- 172.21.15.57:0/2858470517 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb048005d70 con 0x7fb04c006150 2023-10-06T03:01:06.290 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.263+0000 7fb051ffb700 1 -- 172.21.15.57:0/2858470517 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb048006260 con 0x7fb04c006150 2023-10-06T03:01:06.290 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.267+0000 7f4d35eae700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d300acea0 con 0x7f4d30067760 2023-10-06T03:01:06.290 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.267+0000 7f4d35eae700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d300aa730 con 0x7f4d300c08f0 2023-10-06T03:01:06.290 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.267+0000 7f4d35eae700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d300aafd0 con 0x7f4d300cc630 2023-10-06T03:01:06.291 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.267+0000 7f4d2f7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d30067760 0x7f4d300ab460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:06.291 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.267+0000 7f4d2f7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d30067760 0x7f4d300ab460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55884/0 (socket says 172.21.15.57:55884) 2023-10-06T03:01:06.291 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.267+0000 7f4d2f7fe700 1 -- 172.21.15.57:0/3528799391 learned_addr learned my addr 172.21.15.57:0/3528799391 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:06.291 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.267+0000 7f3a86161700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3a8015d350 0x7f3a8006dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:06.292 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.267+0000 7f4d2effd700 1 --2- 172.21.15.57:0/3528799391 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4d300c08f0 0x7f4d30157230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:06.292 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.267+0000 7f4d2f7fe700 1 -- 172.21.15.57:0/3528799391 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4d300cc630 msgr2=0x7f4d300ac100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:06.292 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.267+0000 7f4d2f7fe700 1 --2- 172.21.15.57:0/3528799391 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4d300cc630 0x7f4d300ac100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.292 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.267+0000 7f4d2f7fe700 1 -- 172.21.15.57:0/3528799391 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4d300c08f0 msgr2=0x7f4d30157230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:06.292 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.267+0000 7f4d2f7fe700 1 --2- 172.21.15.57:0/3528799391 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4d300c08f0 0x7f4d30157230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.292 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.267+0000 7f4d2f7fe700 1 -- 172.21.15.57:0/3528799391 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d18009420 con 0x7f4d30067760 2023-10-06T03:01:06.292 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.267+0000 7f4d2effd700 1 --2- 172.21.15.57:0/3528799391 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4d300c08f0 0x7f4d30157230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:06.293 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.267+0000 7f3a85960700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f3a8015d720 0x7f3a80067050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:06.293 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.267+0000 7f3a85960700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f3a8015d720 0x7f3a80067050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.57:39524/0 (socket says 172.21.15.57:39524) 2023-10-06T03:01:06.293 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.267+0000 7f3a85960700 1 -- 172.21.15.57:0/2179259778 learned_addr learned my addr 172.21.15.57:0/2179259778 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:06.293 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.267+0000 7fe0b7f85700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe0b0067760 0x7fe0b0160040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.293 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.267+0000 7fe0b7f85700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0b006cd20 con 0x7fe0b0155060 2023-10-06T03:01:06.293 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.267+0000 7fe0b7f85700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0b006d8a0 con 0x7fe0b006dd30 2023-10-06T03:01:06.294 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.267+0000 7fe0b7f85700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0b00ae600 con 0x7fe0b0067760 2023-10-06T03:01:06.294 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.267+0000 7fb0599c5700 1 -- 172.21.15.57:0/2858470517 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb04c006150 msgr2=0x7fb04c006520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:06.294 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.267+0000 7fb0599c5700 1 --2- 172.21.15.57:0/2858470517 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb04c006150 0x7fb04c006520 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb048009900 tx=0x7fb048009120 comp rx=0 tx=0).stop 2023-10-06T03:01:06.294 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.267+0000 7fb0599c5700 1 -- 172.21.15.57:0/2858470517 shutdown_connections 2023-10-06T03:01:06.294 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.267+0000 7fb0599c5700 1 --2- 172.21.15.57:0/2858470517 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb04c006150 0x7fb04c006520 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.294 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.267+0000 7fb0599c5700 1 -- 172.21.15.57:0/2858470517 >> 172.21.15.57:0/2858470517 conn(0x7fb04c039d60 msgr2=0x7fb04c03a160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:06.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.267+0000 7fe0b5520700 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7fe0b006dd30 0x7fe0b0067050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.57:36366/0 (socket says 172.21.15.57:36366) 2023-10-06T03:01:06.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.267+0000 7fe0b5520700 1 -- 172.21.15.57:0/1897893281 learned_addr learned my addr 172.21.15.57:0/1897893281 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:01:06.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.267+0000 7f4d2f7fe700 1 --2- 172.21.15.57:0/3528799391 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d30067760 0x7f4d300ab460 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4d2800c7c0 tx=0x7f4d28007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:06.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.267+0000 7fe0b6522700 1 --2- 172.21.15.57:0/1897893281 >> v2:172.21.15.57:3300/0 conn(0x7fe0b0067760 0x7fe0b0160040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:06.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.267+0000 7f7dfe48e700 1 Processor -- start 2023-10-06T03:01:06.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.267+0000 7f3a85960700 1 -- 172.21.15.57:0/2179259778 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3a8015d350 msgr2=0x7f3a8006dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:06.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.267+0000 7f3a85960700 1 --2- 172.21.15.57:0/2179259778 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3a8015d350 0x7f3a8006dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.267+0000 7f3a85960700 1 -- 172.21.15.57:0/2179259778 >> v1:172.21.15.57:6789/0 conn(0x7f3a80067590 legacy=0x7f3a800c1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:06.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.267+0000 7f3a85960700 1 -- 172.21.15.57:0/2179259778 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a800c1e10 con 0x7f3a8015d720 2023-10-06T03:01:06.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.267+0000 7f3298ff9700 1 -- 172.21.15.57:0/987728833 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f328400c3e0 con 0x7f329c158e70 2023-10-06T03:01:06.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.271+0000 7f430f7fe700 1 -- 172.21.15.57:0/1227302221 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f431c026450 con 0x7f4328155060 2023-10-06T03:01:06.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.271+0000 7f3298ff9700 1 --2- 172.21.15.57:0/987728833 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f327c0606a0 0x7f327c062b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.271+0000 7f3298ff9700 1 -- 172.21.15.57:0/987728833 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f328407d130 con 0x7f329c158e70 2023-10-06T03:01:06.298 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.271+0000 7f4d277fe700 1 -- 172.21.15.57:0/3528799391 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d28005b30 con 0x7f4d30067760 2023-10-06T03:01:06.298 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.271+0000 7f4d35eae700 1 -- 172.21.15.57:0/3528799391 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d300a8040 con 0x7f4d30067760 2023-10-06T03:01:06.298 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.271+0000 7f4d35eae700 1 -- 172.21.15.57:0/3528799391 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d300aa980 con 0x7f4d30067760 2023-10-06T03:01:06.298 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.271+0000 7f4d277fe700 1 -- 172.21.15.57:0/3528799391 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d28005c90 con 0x7f4d30067760 2023-10-06T03:01:06.298 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.271+0000 7f4d277fe700 1 -- 172.21.15.57:0/3528799391 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d28007340 con 0x7f4d30067760 2023-10-06T03:01:06.298 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.271+0000 7f3a85960700 1 --2- 172.21.15.57:0/2179259778 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3a8015d720 0x7f3a80067050 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3a7c0099b0 tx=0x7f3a7c009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e976145b6890768f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:06.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.271+0000 7fe0b6522700 1 -- 172.21.15.57:0/1897893281 >> v1:172.21.15.105:6789/0 conn(0x7fe0b006dd30 legacy=0x7fe0b0067050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:06.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.271+0000 7fe0b6522700 1 -- 172.21.15.57:0/1897893281 >> v1:172.21.15.57:6789/0 conn(0x7fe0b0155060 legacy=0x7fe0b00c19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:06.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.271+0000 7fe0b6522700 1 -- 172.21.15.57:0/1897893281 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0b00c20c0 con 0x7fe0b0067760 2023-10-06T03:01:06.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.271+0000 7fe0b6522700 1 --2- 172.21.15.57:0/1897893281 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe0b0067760 0x7fe0b0160040 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe0a800af70 tx=0x7fe0a800a890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ef969a6752b1bd4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:06.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.271+0000 7f329bfff700 1 --2- 172.21.15.57:0/987728833 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f327c0606a0 0x7f327c062b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:06.300 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.271+0000 7f430f7fe700 1 --2- 172.21.15.57:0/1227302221 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f4314060620 0x7f4314062ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.300 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.271+0000 7f430f7fe700 1 -- 172.21.15.57:0/1227302221 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f431c07e750 con 0x7f4328155060 2023-10-06T03:01:06.300 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.271+0000 7fe0b4d1f700 1 -- 172.21.15.57:0/1897893281 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0a800f070 con 0x7fe0b0067760 2023-10-06T03:01:06.301 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.271+0000 7f7dfe48e700 1 -- start start 2023-10-06T03:01:06.301 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.271+0000 7fb0599c5700 1 -- 172.21.15.57:0/2858470517 shutdown_connections 2023-10-06T03:01:06.301 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.271+0000 7fb0599c5700 1 -- 172.21.15.57:0/2858470517 wait complete. 2023-10-06T03:01:06.301 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.271+0000 7f329bfff700 1 --2- 172.21.15.57:0/987728833 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f327c0606a0 0x7f327c062b50 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f328c0091e0 tx=0x7f328c017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:06.302 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.271+0000 7f43277fe700 1 --2- 172.21.15.57:0/1227302221 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f4314060620 0x7f4314062ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:06.302 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.271+0000 7f7dfe48e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f7df8158dc0 0x7f7df80cc660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.303 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.271+0000 7f7dfe48e700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f7df806b4b0 0x7f7df80ccba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.303 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.271+0000 7f7dfe48e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7df8159190 0x7f7df815ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.303 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.271+0000 7f7dfe48e700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7df80cd0e0 con 0x7f7df8158dc0 2023-10-06T03:01:06.303 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.271+0000 7f7dfe48e700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7df806b020 con 0x7f7df806b4b0 2023-10-06T03:01:06.303 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.271+0000 7f7dfe48e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7df806a6f0 con 0x7f7df8159190 2023-10-06T03:01:06.303 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.271+0000 7f7dfcc8b700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f7df806b4b0 0x7f7df80ccba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:06.303 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.271+0000 7f43277fe700 1 --2- 172.21.15.57:0/1227302221 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f4314060620 0x7f4314062ad0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f431800adc0 tx=0x7f4318006f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:06.304 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.271+0000 7f7dfdc8d700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7df8159190 0x7f7df815ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:06.304 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.271+0000 7f7dfdc8d700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7df8159190 0x7f7df815ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.57:46146/0 (socket says 172.21.15.57:46146) 2023-10-06T03:01:06.304 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.271+0000 7f7dfdc8d700 1 -- 172.21.15.57:0/994204647 learned_addr learned my addr 172.21.15.57:0/994204647 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:06.304 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.271+0000 7f7dfd48c700 1 --2- 172.21.15.57:0/994204647 >> v2:172.21.15.57:3300/0 conn(0x7f7df8158dc0 0x7f7df80cc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:06.304 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.271+0000 7f4d35eae700 1 -- 172.21.15.57:0/3528799391 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d140052b0 con 0x7f4d30067760 2023-10-06T03:01:06.305 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.275+0000 7f7dfdc8d700 1 -- 172.21.15.57:0/994204647 >> v2:172.21.15.105:3300/0 conn(0x7f7df806b4b0 msgr2=0x7f7df80ccba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:06.305 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.275+0000 7f7dfdc8d700 1 --2- 172.21.15.57:0/994204647 >> v2:172.21.15.105:3300/0 conn(0x7f7df806b4b0 0x7f7df80ccba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.305 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.275+0000 7f7dfdc8d700 1 -- 172.21.15.57:0/994204647 >> v2:172.21.15.57:3300/0 conn(0x7f7df8158dc0 msgr2=0x7f7df80cc660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:06.305 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.275+0000 7f7dfdc8d700 1 --2- 172.21.15.57:0/994204647 >> v2:172.21.15.57:3300/0 conn(0x7f7df8158dc0 0x7f7df80cc660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.305 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.275+0000 7f7dfdc8d700 1 -- 172.21.15.57:0/994204647 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7df806a9d0 con 0x7f7df8159190 2023-10-06T03:01:06.306 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.275+0000 7f7dfdc8d700 1 --2- 172.21.15.57:0/994204647 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7df8159190 0x7f7df815ccb0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7df80b60a0 tx=0x7f7df0009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a8f1dd8a1a4a6260 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:06.306 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.275+0000 7fb0599c5700 1 Processor -- start 2023-10-06T03:01:06.306 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.275+0000 7f7deffff700 1 -- 172.21.15.57:0/994204647 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df000e070 con 0x7f7df8159190 2023-10-06T03:01:06.307 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.275+0000 7f7deffff700 1 -- 172.21.15.57:0/994204647 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7df000b970 con 0x7f7df8159190 2023-10-06T03:01:06.307 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.275+0000 7f7dfe48e700 1 -- 172.21.15.57:0/994204647 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7df8159190 msgr2=0x7f7df815ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:06.307 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.275+0000 7f7dfe48e700 1 --2- 172.21.15.57:0/994204647 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7df8159190 0x7f7df815ccb0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7df80b60a0 tx=0x7f7df0009840 comp rx=0 tx=0).stop 2023-10-06T03:01:06.307 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.275+0000 7fb0599c5700 1 -- start start 2023-10-06T03:01:06.307 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.275+0000 7f7dfe48e700 1 -- 172.21.15.57:0/994204647 shutdown_connections 2023-10-06T03:01:06.307 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.275+0000 7f7dfe48e700 1 --2- 172.21.15.57:0/994204647 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7df8159190 0x7f7df815ccb0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.308 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.275+0000 7f7dfe48e700 1 --2- 172.21.15.57:0/994204647 >> v2:172.21.15.105:3300/0 conn(0x7f7df806b4b0 0x7f7df80ccba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.308 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.275+0000 7f7dfe48e700 1 --2- 172.21.15.57:0/994204647 >> v2:172.21.15.57:3300/0 conn(0x7f7df8158dc0 0x7f7df80cc660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.308 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.275+0000 7f7dfe48e700 1 -- 172.21.15.57:0/994204647 >> 172.21.15.57:0/994204647 conn(0x7f7df8067050 msgr2=0x7f7df8067450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:06.308 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.275+0000 7fb0599c5700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb04c006150 0x7fb04c0edf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.309 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.275+0000 7fb0599c5700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb04c006a60 0x7fb04c04c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.309 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.275+0000 7fb0599c5700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb04c0e6760 0x7fb04c0d9700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.309 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.275+0000 7fb0599c5700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb04c0ee4c0 con 0x7fb04c006a60 2023-10-06T03:01:06.309 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.275+0000 7fb0599c5700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb04c04ee40 con 0x7fb04c006150 2023-10-06T03:01:06.309 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.275+0000 7fb0599c5700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb04c04df50 con 0x7fb04c0e6760 2023-10-06T03:01:06.309 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.275+0000 7f7dfe48e700 1 -- 172.21.15.57:0/994204647 shutdown_connections 2023-10-06T03:01:06.309 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.275+0000 7f7dfe48e700 1 -- 172.21.15.57:0/994204647 wait complete. 2023-10-06T03:01:06.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.275+0000 7fb0527fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb04c006a60 0x7fb04c04c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:06.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.275+0000 7fb0527fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb04c006a60 0x7fb04c04c430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55916/0 (socket says 172.21.15.57:55916) 2023-10-06T03:01:06.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.275+0000 7fb0527fc700 1 -- 172.21.15.57:0/3636872971 learned_addr learned my addr 172.21.15.57:0/3636872971 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:06.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.275+0000 7fb052ffd700 1 --2- 172.21.15.57:0/3636872971 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb04c006150 0x7fb04c0edf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:06.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.275+0000 7fb0537fe700 1 --2- 172.21.15.57:0/3636872971 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb04c0e6760 0x7fb04c0d9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:06.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.275+0000 7fb0527fc700 1 -- 172.21.15.57:0/3636872971 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb04c0e6760 msgr2=0x7fb04c0d9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:06.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.275+0000 7fb0527fc700 1 --2- 172.21.15.57:0/3636872971 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb04c0e6760 0x7fb04c0d9700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.275+0000 7fb0527fc700 1 -- 172.21.15.57:0/3636872971 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb04c006150 msgr2=0x7fb04c0edf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:06.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.275+0000 7fb0527fc700 1 --2- 172.21.15.57:0/3636872971 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb04c006150 0x7fb04c0edf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.275+0000 7fb0527fc700 1 -- 172.21.15.57:0/3636872971 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0480093c0 con 0x7fb04c006a60 2023-10-06T03:01:06.312 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.275+0000 7f3a8515f700 1 -- 172.21.15.57:0/2179259778 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a7c00b820 con 0x7f3a8015d720 2023-10-06T03:01:06.312 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.275+0000 7f3a8515f700 1 -- 172.21.15.57:0/2179259778 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a7c00b980 con 0x7f3a8015d720 2023-10-06T03:01:06.312 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.275+0000 7f3a8515f700 1 -- 172.21.15.57:0/2179259778 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a7c00bd00 con 0x7f3a8015d720 2023-10-06T03:01:06.312 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.279+0000 7f3298ff9700 1 -- 172.21.15.57:0/987728833 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f328404d620 con 0x7f329c158e70 2023-10-06T03:01:06.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.279+0000 7fb0527fc700 1 --2- 172.21.15.57:0/3636872971 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb04c006a60 0x7fb04c04c430 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb04400c790 tx=0x7fb044007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:06.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.279+0000 7f3a883c5700 1 -- 172.21.15.57:0/2179259778 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3a8015d720 msgr2=0x7f3a80067050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:06.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.279+0000 7f3a883c5700 1 --2- 172.21.15.57:0/2179259778 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3a8015d720 0x7f3a80067050 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3a7c0099b0 tx=0x7f3a7c009250 comp rx=0 tx=0).stop 2023-10-06T03:01:06.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.279+0000 7f7dfe48e700 1 Processor -- start 2023-10-06T03:01:06.314 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.279+0000 7f7dfe48e700 1 -- start start 2023-10-06T03:01:06.314 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.279+0000 7f3a883c5700 1 -- 172.21.15.57:0/2179259778 shutdown_connections 2023-10-06T03:01:06.314 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.279+0000 7f3a883c5700 1 --2- 172.21.15.57:0/2179259778 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3a8015d720 0x7f3a80067050 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.314 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.279+0000 7f3a883c5700 1 --2- 172.21.15.57:0/2179259778 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3a8015d350 0x7f3a8006dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.314 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.279+0000 7f3a883c5700 1 -- 172.21.15.57:0/2179259778 >> 172.21.15.57:0/2179259778 conn(0x7f3a800cbb50 msgr2=0x7f3a800cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:06.315 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.279+0000 7f3a883c5700 1 -- 172.21.15.57:0/2179259778 shutdown_connections 2023-10-06T03:01:06.315 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.279+0000 7f3a883c5700 1 -- 172.21.15.57:0/2179259778 wait complete. 2023-10-06T03:01:06.315 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.279+0000 7fb03affd700 1 -- 172.21.15.57:0/3636872971 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb044010510 con 0x7fb04c006a60 2023-10-06T03:01:06.315 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.279+0000 7f430f7fe700 1 -- 172.21.15.57:0/1227302221 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f431c04ec40 con 0x7f4328155060 2023-10-06T03:01:06.316 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.279+0000 7f7dfe48e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7df806b4b0 0x7f7df815a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.316 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.279+0000 7f7dfe48e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7df8158dc0 0x7f7df81530c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.316 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.279+0000 7f7dfe48e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7df8159190 0x7f7df80d06e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.316 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.279+0000 7f7dfe48e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7df8153600 con 0x7f7df8158dc0 2023-10-06T03:01:06.316 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.279+0000 7f7dfe48e700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7df80ce520 con 0x7f7df806b4b0 2023-10-06T03:01:06.316 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.279+0000 7f7dfe48e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7df80ce800 con 0x7f7df8159190 2023-10-06T03:01:06.316 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.279+0000 7f7dfcc8b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7df8158dc0 0x7f7df81530c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:06.316 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.279+0000 7f7dfcc8b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7df8158dc0 0x7f7df81530c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55928/0 (socket says 172.21.15.57:55928) 2023-10-06T03:01:06.316 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.279+0000 7f7dfcc8b700 1 -- 172.21.15.57:0/2245751995 learned_addr learned my addr 172.21.15.57:0/2245751995 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:06.317 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.279+0000 7fe0b4d1f700 1 -- 172.21.15.57:0/1897893281 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0a800a2e0 con 0x7fe0b0067760 2023-10-06T03:01:06.317 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.279+0000 7fe0b4d1f700 1 -- 172.21.15.57:0/1897893281 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0a800cd00 con 0x7fe0b0067760 2023-10-06T03:01:06.317 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.279+0000 7fe0b7f85700 1 -- 172.21.15.57:0/1897893281 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe0b0067760 msgr2=0x7fe0b0160040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:06.317 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.279+0000 7fe0b7f85700 1 --2- 172.21.15.57:0/1897893281 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe0b0067760 0x7fe0b0160040 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe0a800af70 tx=0x7fe0a800a890 comp rx=0 tx=0).stop 2023-10-06T03:01:06.317 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.279+0000 7fe0b7f85700 1 -- 172.21.15.57:0/1897893281 shutdown_connections 2023-10-06T03:01:06.317 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.279+0000 7fe0b7f85700 1 --2- 172.21.15.57:0/1897893281 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe0b0067760 0x7fe0b0160040 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.318 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.279+0000 7fe0b7f85700 1 -- 172.21.15.57:0/1897893281 >> 172.21.15.57:0/1897893281 conn(0x7fe0b00cbb50 msgr2=0x7fe0b00cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:06.318 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.279+0000 7fe0b7f85700 1 -- 172.21.15.57:0/1897893281 shutdown_connections 2023-10-06T03:01:06.318 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.279+0000 7fe0b7f85700 1 -- 172.21.15.57:0/1897893281 wait complete. 2023-10-06T03:01:06.318 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.279+0000 7fb03affd700 1 -- 172.21.15.57:0/3636872971 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb044010670 con 0x7fb04c006a60 2023-10-06T03:01:06.318 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.283+0000 7f7dfcc8b700 1 -- 172.21.15.57:0/2245751995 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7df8159190 msgr2=0x7f7df80d06e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T03:01:06.319 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.283+0000 7f7dfcc8b700 1 --2- 172.21.15.57:0/2245751995 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7df8159190 0x7f7df80d06e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.319 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.283+0000 7f7dfcc8b700 1 -- 172.21.15.57:0/2245751995 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7df806b4b0 msgr2=0x7f7df815a8a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-06T03:01:06.319 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.283+0000 7f7dfcc8b700 1 --2- 172.21.15.57:0/2245751995 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7df806b4b0 0x7f7df815a8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.319 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.283+0000 7f7dfcc8b700 1 -- 172.21.15.57:0/2245751995 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7df0009ae0 con 0x7f7df8158dc0 2023-10-06T03:01:06.319 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.283+0000 7f7dfcc8b700 1 --2- 172.21.15.57:0/2245751995 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7df8158dc0 0x7f7df81530c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f7df400ec50 tx=0x7f7df40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:06.319 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.283+0000 7fb03affd700 1 -- 172.21.15.57:0/3636872971 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb044010a30 con 0x7fb04c006a60 2023-10-06T03:01:06.320 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.279+0000 7f3a883c5700 1 Processor -- start 2023-10-06T03:01:06.320 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.283+0000 7f3a883c5700 1 -- start start 2023-10-06T03:01:06.320 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.283+0000 7f3a883c5700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3a80067590 0x7f3a800b1440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.320 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.283+0000 7f3a883c5700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3a8015d350 0x7f3a8015ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.320 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.283+0000 7fb0599c5700 1 -- 172.21.15.57:0/3636872971 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb04c04e230 con 0x7fb04c006a60 2023-10-06T03:01:06.321 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.283+0000 7f3a883c5700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a8015d720 0x7f3a8014c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.321 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.283+0000 7f7ded7fa700 1 -- 172.21.15.57:0/2245751995 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df400c9d0 con 0x7f7df8158dc0 2023-10-06T03:01:06.321 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.283+0000 7fb0599c5700 1 -- 172.21.15.57:0/3636872971 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb04c04e7f0 con 0x7fb04c006a60 2023-10-06T03:01:06.321 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.283+0000 7f7dfe48e700 1 -- 172.21.15.57:0/2245751995 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7df80ceae0 con 0x7f7df8158dc0 2023-10-06T03:01:06.322 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.283+0000 7fe0b7f85700 1 Processor -- start 2023-10-06T03:01:06.322 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.283+0000 7f3a86161700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3a80067590 0x7f3a800b1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:06.323 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.283+0000 7f3a86161700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3a80067590 0x7f3a800b1440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.57:46166/0 (socket says 172.21.15.57:46166) 2023-10-06T03:01:06.323 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.283+0000 7f3a85960700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3a8015d350 0x7f3a8015ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:06.323 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.283+0000 7f3a85960700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3a8015d350 0x7f3a8015ed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.57:39558/0 (socket says 172.21.15.57:39558) 2023-10-06T03:01:06.323 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.283+0000 7f3a86962700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a8015d720 0x7f3a8014c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:06.323 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.283+0000 7f3a86962700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a8015d720 0x7f3a8014c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55936/0 (socket says 172.21.15.57:55936) 2023-10-06T03:01:06.323 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.283+0000 7f7dfe48e700 1 -- 172.21.15.57:0/2245751995 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7df80d0c20 con 0x7f7df8158dc0 2023-10-06T03:01:06.324 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.283+0000 7f3a883c5700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a800b0fb0 con 0x7f3a8015d720 2023-10-06T03:01:06.324 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.283+0000 7f3a883c5700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a800b03a0 con 0x7f3a8015d350 2023-10-06T03:01:06.324 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.283+0000 7f3a883c5700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a800b0680 con 0x7f3a80067590 2023-10-06T03:01:06.324 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.283+0000 7f3a86161700 1 -- 172.21.15.57:0/3082821477 learned_addr learned my addr 172.21.15.57:0/3082821477 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:06.324 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.283+0000 7f4d277fe700 1 -- 172.21.15.57:0/3528799391 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f4d28025430 con 0x7f4d30067760 2023-10-06T03:01:06.325 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.283+0000 7f3a86962700 1 -- 172.21.15.57:0/3082821477 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3a80067590 msgr2=0x7f3a800b1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:06.325 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.283+0000 7f3a86962700 1 --2- 172.21.15.57:0/3082821477 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3a80067590 0x7f3a800b1440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.325 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.283+0000 7f3a86962700 1 -- 172.21.15.57:0/3082821477 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3a8015d350 msgr2=0x7f3a8015ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:06.325 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.283+0000 7f3a86962700 1 --2- 172.21.15.57:0/3082821477 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3a8015d350 0x7f3a8015ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.325 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.283+0000 7f3a86962700 1 -- 172.21.15.57:0/3082821477 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a7c0094f0 con 0x7f3a8015d720 2023-10-06T03:01:06.325 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.287+0000 7fb038ff9700 1 -- 172.21.15.57:0/3636872971 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb02c0052b0 con 0x7fb04c006a60 2023-10-06T03:01:06.326 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.283+0000 7fe0b7f85700 1 -- start start 2023-10-06T03:01:06.326 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.287+0000 7f3a86962700 1 --2- 172.21.15.57:0/3082821477 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a8015d720 0x7f3a8014c1c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3a7800bb00 tx=0x7f3a78009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:06.327 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.287+0000 7fe0b7f85700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe0b0067760 0x7fe0b006a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.327 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.287+0000 7fe0b7f85700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe0b006dd30 0x7fe0b01579e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.327 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.287+0000 7fe0b7f85700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe0b0155060 0x7fe0b0157f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.327 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.287+0000 7fe0b7f85700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b0176a80 con 0x7fe0b0067760 2023-10-06T03:01:06.327 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.287+0000 7fe0b7f85700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b0175c00 con 0x7fe0b006dd30 2023-10-06T03:01:06.327 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.287+0000 7fe0b7f85700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b0175e70 con 0x7fe0b0155060 2023-10-06T03:01:06.328 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.287+0000 7fe0b5d21700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe0b0067760 0x7fe0b006a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:06.328 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.287+0000 7fe0b5520700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe0b006dd30 0x7fe0b01579e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:06.328 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.287+0000 7fe0b5d21700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe0b0067760 0x7fe0b006a7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55946/0 (socket says 172.21.15.57:55946) 2023-10-06T03:01:06.328 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.287+0000 7fe0b5d21700 1 -- 172.21.15.57:0/3753187036 learned_addr learned my addr 172.21.15.57:0/3753187036 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:06.328 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.287+0000 7f4d277fe700 1 --2- 172.21.15.57:0/3528799391 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f4d100606a0 0x7f4d10062b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.329 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.287+0000 7fe0b5d21700 1 -- 172.21.15.57:0/3753187036 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe0b0155060 msgr2=0x7fe0b0157f20 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T03:01:06.329 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.287+0000 7fe0b5d21700 1 --2- 172.21.15.57:0/3753187036 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe0b0155060 0x7fe0b0157f20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.329 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.287+0000 7fe0b5d21700 1 -- 172.21.15.57:0/3753187036 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe0b006dd30 msgr2=0x7fe0b01579e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:06.329 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.287+0000 7fe0b5d21700 1 --2- 172.21.15.57:0/3753187036 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe0b006dd30 0x7fe0b01579e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.329 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.287+0000 7fe0b5d21700 1 -- 172.21.15.57:0/3753187036 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0a800ab30 con 0x7fe0b0067760 2023-10-06T03:01:06.329 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.287+0000 7f4d277fe700 1 -- 172.21.15.57:0/3528799391 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4d2807cea0 con 0x7f4d30067760 2023-10-06T03:01:06.330 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.287+0000 7f4d2effd700 1 --2- 172.21.15.57:0/3528799391 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f4d100606a0 0x7f4d10062b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:06.330 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.287+0000 7fe0b5d21700 1 --2- 172.21.15.57:0/3753187036 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe0b0067760 0x7fe0b006a7f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe0a000c4c0 tx=0x7fe0a000c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:06.330 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.287+0000 7f4d2effd700 1 --2- 172.21.15.57:0/3528799391 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f4d100606a0 0x7f4d10062b50 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4d300a97c0 tx=0x7f4d20009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:06.331 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.291+0000 7f7dfe48e700 1 -- 172.21.15.57:0/2245751995 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7df80ce940 con 0x7f7df8158dc0 2023-10-06T03:01:06.331 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.291+0000 7f7ded7fa700 1 -- 172.21.15.57:0/2245751995 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7df400cd40 con 0x7f7df8158dc0 2023-10-06T03:01:06.331 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.291+0000 7f4d277fe700 1 -- 172.21.15.57:0/3528799391 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f4d2804d390 con 0x7f4d30067760 2023-10-06T03:01:06.331 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.291+0000 7f7ded7fa700 1 -- 172.21.15.57:0/2245751995 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df4005a00 con 0x7f7df8158dc0 2023-10-06T03:01:06.332 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.295+0000 7fb03affd700 1 -- 172.21.15.57:0/3636872971 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fb04401b3b0 con 0x7fb04c006a60 2023-10-06T03:01:06.332 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.295+0000 7fb03affd700 1 --2- 172.21.15.57:0/3636872971 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fb040060580 0x7fb040062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.332 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.295+0000 7fb03affd700 1 -- 172.21.15.57:0/3636872971 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb04407c6a0 con 0x7fb04c006a60 2023-10-06T03:01:06.332 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.295+0000 7f3a767fc700 1 -- 172.21.15.57:0/3082821477 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a7800c7c0 con 0x7f3a8015d720 2023-10-06T03:01:06.332 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.295+0000 7f3a767fc700 1 -- 172.21.15.57:0/3082821477 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a7800c920 con 0x7f3a8015d720 2023-10-06T03:01:06.332 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.295+0000 7f3a767fc700 1 -- 172.21.15.57:0/3082821477 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a7800cce0 con 0x7f3a8015d720 2023-10-06T03:01:06.332 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.295+0000 7f3a883c5700 1 -- 172.21.15.57:0/3082821477 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a800b0960 con 0x7f3a8015d720 2023-10-06T03:01:06.333 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.295+0000 7fb052ffd700 1 --2- 172.21.15.57:0/3636872971 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fb040060580 0x7fb040062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:06.333 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.295+0000 7f7ded7fa700 1 -- 172.21.15.57:0/2245751995 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f7df4013470 con 0x7f7df8158dc0 2023-10-06T03:01:06.333 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.295+0000 7f7ded7fa700 1 --2- 172.21.15.57:0/2245751995 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f7ddc060580 0x7f7ddc062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.334 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.295+0000 7f3a883c5700 1 -- 172.21.15.57:0/3082821477 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a8015f2b0 con 0x7f3a8015d720 2023-10-06T03:01:06.334 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.295+0000 7fe0a5ffb700 1 -- 172.21.15.57:0/3753187036 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0a0011590 con 0x7fe0b0067760 2023-10-06T03:01:06.334 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.295+0000 7fe0a5ffb700 1 -- 172.21.15.57:0/3753187036 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0a00116f0 con 0x7fe0b0067760 2023-10-06T03:01:06.334 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.295+0000 7fe0a5ffb700 1 -- 172.21.15.57:0/3753187036 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0a0011ab0 con 0x7fe0b0067760 2023-10-06T03:01:06.334 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.299+0000 7fe0b7f85700 1 -- 172.21.15.57:0/3753187036 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0b0176150 con 0x7fe0b0067760 2023-10-06T03:01:06.335 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.299+0000 7f7dfd48c700 1 --2- 172.21.15.57:0/2245751995 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f7ddc060580 0x7f7ddc062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:06.335 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.299+0000 7fe0b7f85700 1 -- 172.21.15.57:0/3753187036 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0b0176710 con 0x7fe0b0067760 2023-10-06T03:01:06.335 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.299+0000 7f3a883c5700 1 -- 172.21.15.57:0/3082821477 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a8015cc20 con 0x7f3a8015d720 2023-10-06T03:01:06.336 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.299+0000 7fb052ffd700 1 --2- 172.21.15.57:0/3636872971 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fb040060580 0x7fb040062a30 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb048009fd0 tx=0x7fb048016000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:06.336 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.299+0000 7f7dfd48c700 1 --2- 172.21.15.57:0/2245751995 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f7ddc060580 0x7f7ddc062a30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7de8009bb0 tx=0x7f7de80091a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:06.336 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.299+0000 7fe0937fe700 1 -- 172.21.15.57:0/3753187036 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe08c0052b0 con 0x7fe0b0067760 2023-10-06T03:01:06.336 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.303+0000 7fb03affd700 1 -- 172.21.15.57:0/3636872971 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fb04404ca90 con 0x7fb04c006a60 2023-10-06T03:01:06.337 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.303+0000 7f7ded7fa700 1 -- 172.21.15.57:0/2245751995 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7df4051950 con 0x7f7df8158dc0 2023-10-06T03:01:06.337 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.307+0000 7f3a767fc700 1 -- 172.21.15.57:0/3082821477 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f3a78014620 con 0x7f3a8015d720 2023-10-06T03:01:06.337 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.311+0000 7f3a767fc700 1 --2- 172.21.15.57:0/3082821477 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f3a64060620 0x7f3a64062ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.337 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.311+0000 7f3a86161700 1 --2- 172.21.15.57:0/3082821477 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f3a64060620 0x7f3a64062ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:06.338 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.311+0000 7fe0a5ffb700 1 -- 172.21.15.57:0/3753187036 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fe0a0012420 con 0x7fe0b0067760 2023-10-06T03:01:06.338 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.311+0000 7f3a86161700 1 --2- 172.21.15.57:0/3082821477 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f3a64060620 0x7f3a64062ad0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3a70006fd0 tx=0x7f3a70008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:06.339 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.311+0000 7fe0a5ffb700 1 --2- 172.21.15.57:0/3753187036 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fe094060550 0x7fe094062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.339 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.311+0000 7fe0b5520700 1 --2- 172.21.15.57:0/3753187036 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fe094060550 0x7fe094062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:06.339 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.311+0000 7fe0b5520700 1 --2- 172.21.15.57:0/3753187036 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fe094060550 0x7fe094062a00 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe0b00adea0 tx=0x7fe0ac006010 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:06.339 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.319+0000 7f3a767fc700 1 -- 172.21.15.57:0/3082821477 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3a7800ce40 con 0x7f3a8015d720 2023-10-06T03:01:06.339 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.319+0000 7f7ded7fa700 1 -- 172.21.15.57:0/2245751995 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f7df404d550 con 0x7f7df8158dc0 2023-10-06T03:01:06.340 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.319+0000 7fe0a5ffb700 1 -- 172.21.15.57:0/3753187036 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe0a0053860 con 0x7fe0b0067760 2023-10-06T03:01:06.340 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.327+0000 7f3a767fc700 1 -- 172.21.15.57:0/3082821477 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f3a7804d3a0 con 0x7f3a8015d720 2023-10-06T03:01:06.340 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.335+0000 7fe0a5ffb700 1 -- 172.21.15.57:0/3753187036 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fe0a004c9c0 con 0x7fe0b0067760 2023-10-06T03:01:06.534 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.527+0000 7feda1cf0700 1 -- 172.21.15.57:0/2237042321 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fed7c005560 con 0x7fed9c1585f0 2023-10-06T03:01:06.534 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.527+0000 7fed837fe700 1 -- 172.21.15.57:0/2237042321 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fed940529a0 con 0x7fed9c1585f0 2023-10-06T03:01:06.535 INFO:teuthology.orchestra.run.smithi057.stdout:55834574853 2023-10-06T03:01:06.537 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.531+0000 7feda1cf0700 1 -- 172.21.15.57:0/2237042321 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fed88060620 msgr2=0x7fed88062ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:06.538 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.531+0000 7feda1cf0700 1 --2- 172.21.15.57:0/2237042321 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fed88060620 0x7fed88062ad0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fed9000ac00 tx=0x7fed90006f90 comp rx=0 tx=0).stop 2023-10-06T03:01:06.538 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.531+0000 7feda1cf0700 1 -- 172.21.15.57:0/2237042321 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fed9c1585f0 msgr2=0x7fed9c0afd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:06.538 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.531+0000 7feda1cf0700 1 --2- 172.21.15.57:0/2237042321 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fed9c1585f0 0x7fed9c0afd00 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fed9c06e3b0 tx=0x7fed9401a000 comp rx=0 tx=0).stop 2023-10-06T03:01:06.539 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.531+0000 7feda1cf0700 1 -- 172.21.15.57:0/2237042321 shutdown_connections 2023-10-06T03:01:06.539 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.531+0000 7feda1cf0700 1 --2- 172.21.15.57:0/2237042321 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fed88060620 0x7fed88062ad0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.539 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.531+0000 7feda1cf0700 1 --2- 172.21.15.57:0/2237042321 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fed9c159a80 0x7fed9c150c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.539 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.531+0000 7feda1cf0700 1 --2- 172.21.15.57:0/2237042321 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fed9c1585f0 0x7fed9c0afd00 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.539 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.531+0000 7feda1cf0700 1 --2- 172.21.15.57:0/2237042321 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fed9c0c08f0 0x7fed9c0ad070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.540 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.531+0000 7feda1cf0700 1 -- 172.21.15.57:0/2237042321 >> 172.21.15.57:0/2237042321 conn(0x7fed9c0cbb50 msgr2=0x7fed9c0c7990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:06.540 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.531+0000 7feda1cf0700 1 -- 172.21.15.57:0/2237042321 shutdown_connections 2023-10-06T03:01:06.540 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.535+0000 7feda1cf0700 1 -- 172.21.15.57:0/2237042321 wait complete. 2023-10-06T03:01:06.562 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.3 2023-10-06T03:01:06.562 DEBUG:teuthology.parallel:result is None 2023-10-06T03:01:06.611 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.607+0000 7f32a2345700 1 -- 172.21.15.57:0/987728833 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3280005830 con 0x7f329c158e70 2023-10-06T03:01:06.612 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.607+0000 7f7dfe48e700 1 -- 172.21.15.57:0/2245751995 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f7df80ce940 con 0x7f7df8158dc0 2023-10-06T03:01:06.615 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.611+0000 7f3298ff9700 1 -- 172.21.15.57:0/987728833 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3284017020 con 0x7f329c158e70 2023-10-06T03:01:06.615 INFO:teuthology.orchestra.run.smithi057.stdout:55834574854 2023-10-06T03:01:06.615 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.611+0000 7f432dd85700 1 -- 172.21.15.57:0/1227302221 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f432804be40 con 0x7f4328155060 2023-10-06T03:01:06.617 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.611+0000 7f7ded7fa700 1 -- 172.21.15.57:0/2245751995 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7df80ce940 con 0x7f7df8158dc0 2023-10-06T03:01:06.618 INFO:teuthology.orchestra.run.smithi057.stdout:55834574855 2023-10-06T03:01:06.618 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.611+0000 7f430f7fe700 1 -- 172.21.15.57:0/1227302221 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f431c052260 con 0x7f4328155060 2023-10-06T03:01:06.618 INFO:teuthology.orchestra.run.smithi057.stdout:55834574854 2023-10-06T03:01:06.619 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.615+0000 7f32a2345700 1 -- 172.21.15.57:0/987728833 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f327c0606a0 msgr2=0x7f327c062b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:06.619 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.615+0000 7f32a2345700 1 --2- 172.21.15.57:0/987728833 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f327c0606a0 0x7f327c062b50 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f328c0091e0 tx=0x7f328c017000 comp rx=0 tx=0).stop 2023-10-06T03:01:06.619 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.615+0000 7f32a2345700 1 -- 172.21.15.57:0/987728833 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f329c158e70 msgr2=0x7f329c156470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:06.619 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.615+0000 7f32a2345700 1 --2- 172.21.15.57:0/987728833 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f329c158e70 0x7f329c156470 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3284006d40 tx=0x7f3284009250 comp rx=0 tx=0).stop 2023-10-06T03:01:06.619 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.615+0000 7f32a2345700 1 -- 172.21.15.57:0/987728833 shutdown_connections 2023-10-06T03:01:06.619 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.615+0000 7f32a2345700 1 --2- 172.21.15.57:0/987728833 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f327c0606a0 0x7f327c062b50 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.619 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.615+0000 7f32a2345700 1 --2- 172.21.15.57:0/987728833 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f329c159240 0x7f329c0c88e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.620 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.615+0000 7f32a2345700 1 --2- 172.21.15.57:0/987728833 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f329c158e70 0x7f329c156470 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.620 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.615+0000 7f32a2345700 1 --2- 172.21.15.57:0/987728833 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f329c06ce00 0x7f329c0b11d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.620 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.615+0000 7f32a2345700 1 -- 172.21.15.57:0/987728833 >> 172.21.15.57:0/987728833 conn(0x7f329c0cbb50 msgr2=0x7f329c0cafd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:06.620 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.615+0000 7f32a2345700 1 -- 172.21.15.57:0/987728833 shutdown_connections 2023-10-06T03:01:06.620 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.615+0000 7f32a2345700 1 -- 172.21.15.57:0/987728833 wait complete. 2023-10-06T03:01:06.621 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.615+0000 7f7dfe48e700 1 -- 172.21.15.57:0/2245751995 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f7ddc060580 msgr2=0x7f7ddc062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:06.621 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.615+0000 7f7dfe48e700 1 --2- 172.21.15.57:0/2245751995 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f7ddc060580 0x7f7ddc062a30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7de8009bb0 tx=0x7f7de80091a0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.621 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.615+0000 7f7dfe48e700 1 -- 172.21.15.57:0/2245751995 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7df8158dc0 msgr2=0x7f7df81530c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:06.621 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.615+0000 7f7dfe48e700 1 --2- 172.21.15.57:0/2245751995 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7df8158dc0 0x7f7df81530c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f7df400ec50 tx=0x7f7df40091a0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.622 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.615+0000 7f7dfe48e700 1 -- 172.21.15.57:0/2245751995 shutdown_connections 2023-10-06T03:01:06.623 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.615+0000 7f7dfe48e700 1 --2- 172.21.15.57:0/2245751995 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f7ddc060580 0x7f7ddc062a30 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.623 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.615+0000 7f7dfe48e700 1 --2- 172.21.15.57:0/2245751995 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7df8159190 0x7f7df80d06e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.623 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.615+0000 7f7dfe48e700 1 --2- 172.21.15.57:0/2245751995 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7df8158dc0 0x7f7df81530c0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.623 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.615+0000 7f7dfe48e700 1 --2- 172.21.15.57:0/2245751995 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7df806b4b0 0x7f7df815a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.623 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.615+0000 7f7dfe48e700 1 -- 172.21.15.57:0/2245751995 >> 172.21.15.57:0/2245751995 conn(0x7f7df8067050 msgr2=0x7f7df80b2090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:06.623 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.615+0000 7f7dfe48e700 1 -- 172.21.15.57:0/2245751995 shutdown_connections 2023-10-06T03:01:06.623 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.615+0000 7f7dfe48e700 1 -- 172.21.15.57:0/2245751995 wait complete. 2023-10-06T03:01:06.624 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.619+0000 7f432dd85700 1 -- 172.21.15.57:0/1227302221 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f4314060620 msgr2=0x7f4314062ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:06.624 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.619+0000 7f432dd85700 1 --2- 172.21.15.57:0/1227302221 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f4314060620 0x7f4314062ad0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f431800adc0 tx=0x7f4318006f90 comp rx=0 tx=0).stop 2023-10-06T03:01:06.624 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.619+0000 7f432dd85700 1 -- 172.21.15.57:0/1227302221 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4328155060 msgr2=0x7f43280c5460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:06.624 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.619+0000 7f432dd85700 1 --2- 172.21.15.57:0/1227302221 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4328155060 0x7f43280c5460 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f432806b940 tx=0x7f431c017000 comp rx=0 tx=0).stop 2023-10-06T03:01:06.624 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.619+0000 7f432dd85700 1 -- 172.21.15.57:0/1227302221 shutdown_connections 2023-10-06T03:01:06.624 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.619+0000 7f432dd85700 1 --2- 172.21.15.57:0/1227302221 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4328155060 0x7f43280c5460 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.625 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.619+0000 7f432dd85700 1 --2- 172.21.15.57:0/1227302221 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f432806dd30 0x7f43280c4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.625 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.619+0000 7f432dd85700 1 --2- 172.21.15.57:0/1227302221 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f4314060620 0x7f4314062ad0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.625 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.619+0000 7f432dd85700 1 --2- 172.21.15.57:0/1227302221 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4328067760 0x7f4328149050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.625 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.619+0000 7f432dd85700 1 -- 172.21.15.57:0/1227302221 >> 172.21.15.57:0/1227302221 conn(0x7f43280cbb50 msgr2=0x7f43280c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:06.625 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.619+0000 7f432dd85700 1 -- 172.21.15.57:0/1227302221 shutdown_connections 2023-10-06T03:01:06.625 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.619+0000 7f432dd85700 1 -- 172.21.15.57:0/1227302221 wait complete. 2023-10-06T03:01:06.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.627+0000 7f4d35eae700 1 -- 172.21.15.57:0/3528799391 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f4d14005830 con 0x7f4d30067760 2023-10-06T03:01:06.632 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.627+0000 7f4d277fe700 1 -- 172.21.15.57:0/3528799391 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4d280509b0 con 0x7f4d30067760 2023-10-06T03:01:06.632 INFO:teuthology.orchestra.run.smithi057.stdout:55834574854 2023-10-06T03:01:06.635 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.631+0000 7f4d35eae700 1 -- 172.21.15.57:0/3528799391 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f4d100606a0 msgr2=0x7f4d10062b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:06.635 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.631+0000 7f4d35eae700 1 --2- 172.21.15.57:0/3528799391 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f4d100606a0 0x7f4d10062b50 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4d300a97c0 tx=0x7f4d20009040 comp rx=0 tx=0).stop 2023-10-06T03:01:06.636 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.631+0000 7f4d35eae700 1 -- 172.21.15.57:0/3528799391 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d30067760 msgr2=0x7f4d300ab460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:06.636 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.631+0000 7f4d35eae700 1 --2- 172.21.15.57:0/3528799391 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d30067760 0x7f4d300ab460 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4d2800c7c0 tx=0x7f4d28007e00 comp rx=0 tx=0).stop 2023-10-06T03:01:06.637 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.631+0000 7f4d35eae700 1 -- 172.21.15.57:0/3528799391 shutdown_connections 2023-10-06T03:01:06.637 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.631+0000 7f4d35eae700 1 --2- 172.21.15.57:0/3528799391 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f4d100606a0 0x7f4d10062b50 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.637 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.631+0000 7f4d35eae700 1 --2- 172.21.15.57:0/3528799391 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4d300cc630 0x7f4d300ac100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.638 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.631+0000 7f4d35eae700 1 --2- 172.21.15.57:0/3528799391 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4d300c08f0 0x7f4d30157230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.638 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.631+0000 7f4d35eae700 1 --2- 172.21.15.57:0/3528799391 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d30067760 0x7f4d300ab460 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.638 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.631+0000 7f4d35eae700 1 -- 172.21.15.57:0/3528799391 >> 172.21.15.57:0/3528799391 conn(0x7f4d300cbb50 msgr2=0x7f4d300c6c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:06.638 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.631+0000 7f4d35eae700 1 -- 172.21.15.57:0/3528799391 shutdown_connections 2023-10-06T03:01:06.638 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.631+0000 7f4d35eae700 1 -- 172.21.15.57:0/3528799391 wait complete. 2023-10-06T03:01:06.639 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.2 2023-10-06T03:01:06.639 DEBUG:teuthology.parallel:result is None 2023-10-06T03:01:06.642 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.635+0000 7fb038ff9700 1 -- 172.21.15.57:0/3636872971 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fb02c005830 con 0x7fb04c006a60 2023-10-06T03:01:06.643 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.639+0000 7fb03affd700 1 -- 172.21.15.57:0/3636872971 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb044017020 con 0x7fb04c006a60 2023-10-06T03:01:06.643 INFO:teuthology.orchestra.run.smithi057.stdout:55834574855 2023-10-06T03:01:06.646 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.639+0000 7fb038ff9700 1 -- 172.21.15.57:0/3636872971 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fb040060580 msgr2=0x7fb040062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:06.646 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.639+0000 7fb038ff9700 1 --2- 172.21.15.57:0/3636872971 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fb040060580 0x7fb040062a30 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb048009fd0 tx=0x7fb048016000 comp rx=0 tx=0).stop 2023-10-06T03:01:06.646 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.639+0000 7fb038ff9700 1 -- 172.21.15.57:0/3636872971 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb04c006a60 msgr2=0x7fb04c04c430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:06.646 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.639+0000 7fb038ff9700 1 --2- 172.21.15.57:0/3636872971 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb04c006a60 0x7fb04c04c430 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb04400c790 tx=0x7fb044007e10 comp rx=0 tx=0).stop 2023-10-06T03:01:06.646 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.639+0000 7fb038ff9700 1 -- 172.21.15.57:0/3636872971 shutdown_connections 2023-10-06T03:01:06.646 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.639+0000 7fb038ff9700 1 --2- 172.21.15.57:0/3636872971 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fb040060580 0x7fb040062a30 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.647 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.639+0000 7fb038ff9700 1 --2- 172.21.15.57:0/3636872971 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb04c0e6760 0x7fb04c0d9700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.647 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.639+0000 7fb038ff9700 1 --2- 172.21.15.57:0/3636872971 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb04c006a60 0x7fb04c04c430 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.647 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.639+0000 7fb038ff9700 1 --2- 172.21.15.57:0/3636872971 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb04c006150 0x7fb04c0edf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.647 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.639+0000 7fb038ff9700 1 -- 172.21.15.57:0/3636872971 >> 172.21.15.57:0/3636872971 conn(0x7fb04c039d60 msgr2=0x7fb04c0e29f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:06.648 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.5 2023-10-06T03:01:06.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.643+0000 7fb038ff9700 1 -- 172.21.15.57:0/3636872971 shutdown_connections 2023-10-06T03:01:06.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.643+0000 7fb038ff9700 1 -- 172.21.15.57:0/3636872971 wait complete. 2023-10-06T03:01:06.648 DEBUG:teuthology.parallel:result is None 2023-10-06T03:01:06.650 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.0 2023-10-06T03:01:06.650 DEBUG:teuthology.parallel:result is None 2023-10-06T03:01:06.658 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.651+0000 7f3a883c5700 1 -- 172.21.15.57:0/3082821477 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f3a8015cc20 con 0x7f3a8015d720 2023-10-06T03:01:06.659 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.655+0000 7f3a767fc700 1 -- 172.21.15.57:0/3082821477 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3a8015cc20 con 0x7f3a8015d720 2023-10-06T03:01:06.659 INFO:teuthology.orchestra.run.smithi057.stdout:55834574855 2023-10-06T03:01:06.660 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.4 2023-10-06T03:01:06.660 DEBUG:teuthology.parallel:result is None 2023-10-06T03:01:06.663 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.6 2023-10-06T03:01:06.663 DEBUG:teuthology.parallel:result is None 2023-10-06T03:01:06.664 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.655+0000 7f3a883c5700 1 -- 172.21.15.57:0/3082821477 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f3a64060620 msgr2=0x7f3a64062ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:06.664 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.655+0000 7f3a883c5700 1 --2- 172.21.15.57:0/3082821477 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f3a64060620 0x7f3a64062ad0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3a70006fd0 tx=0x7f3a70008040 comp rx=0 tx=0).stop 2023-10-06T03:01:06.664 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.655+0000 7f3a883c5700 1 -- 172.21.15.57:0/3082821477 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a8015d720 msgr2=0x7f3a8014c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:06.664 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.655+0000 7f3a883c5700 1 --2- 172.21.15.57:0/3082821477 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a8015d720 0x7f3a8014c1c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3a7800bb00 tx=0x7f3a78009780 comp rx=0 tx=0).stop 2023-10-06T03:01:06.664 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.655+0000 7f3a883c5700 1 -- 172.21.15.57:0/3082821477 shutdown_connections 2023-10-06T03:01:06.664 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.655+0000 7f3a883c5700 1 --2- 172.21.15.57:0/3082821477 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a8015d720 0x7f3a8014c1c0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.664 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.655+0000 7f3a883c5700 1 --2- 172.21.15.57:0/3082821477 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3a8015d350 0x7f3a8015ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.664 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.655+0000 7f3a883c5700 1 --2- 172.21.15.57:0/3082821477 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f3a64060620 0x7f3a64062ad0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.664 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.655+0000 7f3a883c5700 1 --2- 172.21.15.57:0/3082821477 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3a80067590 0x7f3a800b1440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.664 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.655+0000 7f3a883c5700 1 -- 172.21.15.57:0/3082821477 >> 172.21.15.57:0/3082821477 conn(0x7f3a800cbb50 msgr2=0x7f3a8006b480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:06.664 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.659+0000 7f3a883c5700 1 -- 172.21.15.57:0/3082821477 shutdown_connections 2023-10-06T03:01:06.665 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.659+0000 7f3a883c5700 1 -- 172.21.15.57:0/3082821477 wait complete. 2023-10-06T03:01:06.665 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.659+0000 7fe0937fe700 1 -- 172.21.15.57:0/3753187036 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe08c005830 con 0x7fe0b0067760 2023-10-06T03:01:06.665 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.659+0000 7fe0a5ffb700 1 -- 172.21.15.57:0/3753187036 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe0a0021020 con 0x7fe0b0067760 2023-10-06T03:01:06.665 INFO:teuthology.orchestra.run.smithi057.stdout:55834574855 2023-10-06T03:01:06.666 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.659+0000 7fe0937fe700 1 -- 172.21.15.57:0/3753187036 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fe094060550 msgr2=0x7fe094062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:06.666 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.659+0000 7fe0937fe700 1 --2- 172.21.15.57:0/3753187036 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fe094060550 0x7fe094062a00 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe0b00adea0 tx=0x7fe0ac006010 comp rx=0 tx=0).stop 2023-10-06T03:01:06.666 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.659+0000 7fe0937fe700 1 -- 172.21.15.57:0/3753187036 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe0b0067760 msgr2=0x7fe0b006a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:06.666 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.659+0000 7fe0937fe700 1 --2- 172.21.15.57:0/3753187036 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe0b0067760 0x7fe0b006a7f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe0a000c4c0 tx=0x7fe0a000c7d0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.666 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.659+0000 7fe0937fe700 1 -- 172.21.15.57:0/3753187036 shutdown_connections 2023-10-06T03:01:06.667 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.659+0000 7fe0937fe700 1 --2- 172.21.15.57:0/3753187036 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fe094060550 0x7fe094062a00 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.667 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.659+0000 7fe0937fe700 1 --2- 172.21.15.57:0/3753187036 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe0b0155060 0x7fe0b0157f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.667 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.659+0000 7fe0937fe700 1 --2- 172.21.15.57:0/3753187036 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe0b006dd30 0x7fe0b01579e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.667 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.659+0000 7fe0937fe700 1 --2- 172.21.15.57:0/3753187036 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe0b0067760 0x7fe0b006a7f0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.667 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.659+0000 7fe0937fe700 1 -- 172.21.15.57:0/3753187036 >> 172.21.15.57:0/3753187036 conn(0x7fe0b00cbb50 msgr2=0x7fe0b00c19b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:06.667 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.659+0000 7fe0937fe700 1 -- 172.21.15.57:0/3753187036 shutdown_connections 2023-10-06T03:01:06.667 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.659+0000 7fe0937fe700 1 -- 172.21.15.57:0/3753187036 wait complete. 2023-10-06T03:01:06.681 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.7 2023-10-06T03:01:06.681 DEBUG:teuthology.parallel:result is None 2023-10-06T03:01:06.682 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.1 2023-10-06T03:01:06.683 DEBUG:teuthology.parallel:result is None 2023-10-06T03:01:06.683 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-06T03:01:06.683 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:01:06.886 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.879+0000 7f2decf85700 1 Processor -- start 2023-10-06T03:01:06.886 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.879+0000 7f2decf85700 1 -- start start 2023-10-06T03:01:06.888 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.883+0000 7f2decf85700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f2de80cb2f0 0x7f2de80b01c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.888 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.883+0000 7f2decf85700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2de80cb900 con 0x7f2de8159340 2023-10-06T03:01:06.888 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.883+0000 7f2decf85700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2de80cbbe0 con 0x7f2de8158f70 2023-10-06T03:01:06.888 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.883+0000 7f2decf85700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2de80cb720 con 0x7f2de80cb2f0 2023-10-06T03:01:06.889 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.883+0000 7f2dddd9b700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f2de8159340 0x7f2de806dbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:45892/0 (socket says 172.21.15.57:45892) 2023-10-06T03:01:06.889 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.883+0000 7f2dddd9b700 1 -- 172.21.15.57:0/3483193013 learned_addr learned my addr 172.21.15.57:0/3483193013 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:01:06.889 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.883+0000 7f2de6d9d700 1 --2- 172.21.15.57:0/3483193013 >> v2:172.21.15.105:3300/0 conn(0x7f2de80cb2f0 0x7f2de80b01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:06.890 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.883+0000 7f2de5d9b700 1 -- 172.21.15.57:0/3483193013 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 212731193 0 0) 0x7f2de80cb900 con 0x7f2de8159340 2023-10-06T03:01:06.890 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.883+0000 7f2de5d9b700 1 -- 172.21.15.57:0/3483193013 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2dd4003570 con 0x7f2de8159340 2023-10-06T03:01:06.891 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.883+0000 7f2de5d9b700 1 -- 172.21.15.57:0/3483193013 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1229615547 0 0) 0x7f2dd4003570 con 0x7f2de8159340 2023-10-06T03:01:06.891 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.883+0000 7f2de5d9b700 1 -- 172.21.15.57:0/3483193013 >> v2:172.21.15.105:3300/0 conn(0x7f2de80cb2f0 msgr2=0x7f2de80b01c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:06.891 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.883+0000 7f2de5d9b700 1 --2- 172.21.15.57:0/3483193013 >> v2:172.21.15.105:3300/0 conn(0x7f2de80cb2f0 0x7f2de80b01c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.891 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.883+0000 7f2de5d9b700 1 -- 172.21.15.57:0/3483193013 >> v1:172.21.15.105:6789/0 conn(0x7f2de8158f70 legacy=0x7f2de806d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:06.891 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.883+0000 7f2de5d9b700 1 -- 172.21.15.57:0/3483193013 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2de806c9c0 con 0x7f2de8159340 2023-10-06T03:01:06.892 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.883+0000 7f2de5d9b700 1 -- 172.21.15.57:0/3483193013 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2482400018 0 0) 0x7f2dd00017f0 con 0x7f2de8159340 2023-10-06T03:01:06.892 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.883+0000 7f2de5d9b700 1 -- 172.21.15.57:0/3483193013 >> v1:172.21.15.57:6789/0 conn(0x7f2de8159340 legacy=0x7f2de806dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:06.892 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.883+0000 7f2de5d9b700 1 --2- 172.21.15.57:0/3483193013 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2dd4003a60 0x7f2dd4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.892 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.883+0000 7f2de5d9b700 1 --2- 172.21.15.57:0/3483193013 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2dd4004810 0x7f2dd4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.892 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.883+0000 7f2de5d9b700 1 --2- 172.21.15.57:0/3483193013 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2dd40051c0 0x7f2dd400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.892 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.883+0000 7f2de5d9b700 1 -- 172.21.15.57:0/3483193013 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2de80cb720 con 0x7f2dd4004810 2023-10-06T03:01:06.893 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.883+0000 7f2de5d9b700 1 -- 172.21.15.57:0/3483193013 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dd400c0d0 con 0x7f2dd4003a60 2023-10-06T03:01:06.893 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.883+0000 7f2de5d9b700 1 -- 172.21.15.57:0/3483193013 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dd400c290 con 0x7f2dd40051c0 2023-10-06T03:01:06.893 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.887+0000 7f2dddd9b700 1 --2- 172.21.15.57:0/3483193013 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2dd4004810 0x7f2dd4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:06.893 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.887+0000 7f2de6d9d700 1 --2- 172.21.15.57:0/3483193013 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2dd40051c0 0x7f2dd400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:06.893 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.887+0000 7f2de659c700 1 --2- 172.21.15.57:0/3483193013 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2dd4003a60 0x7f2dd4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:06.895 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.887+0000 7f2dddd9b700 1 -- 172.21.15.57:0/3483193013 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2dd40051c0 msgr2=0x7f2dd400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:06.895 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.887+0000 7f2dddd9b700 1 --2- 172.21.15.57:0/3483193013 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2dd40051c0 0x7f2dd400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.895 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.887+0000 7f2dddd9b700 1 -- 172.21.15.57:0/3483193013 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2dd4003a60 msgr2=0x7f2dd4003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:06.895 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.887+0000 7f2dddd9b700 1 --2- 172.21.15.57:0/3483193013 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2dd4003a60 0x7f2dd4003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.895 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.887+0000 7f2de6d9d700 1 -- 172.21.15.57:0/3483193013 reap_dead start 2023-10-06T03:01:06.895 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.887+0000 7f2dddd9b700 1 -- 172.21.15.57:0/3483193013 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dd4003570 con 0x7f2dd4004810 2023-10-06T03:01:06.895 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.887+0000 7f2dddd9b700 1 --2- 172.21.15.57:0/3483193013 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2dd4004810 0x7f2dd4004c80 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2dd000a930 tx=0x7f2dd00021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=458c3f9adf17c018 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:06.895 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.887+0000 7f2de5d9b700 1 -- 172.21.15.57:0/3483193013 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd00070d0 con 0x7f2dd4004810 2023-10-06T03:01:06.896 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.887+0000 7f2de5d9b700 1 -- 172.21.15.57:0/3483193013 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dd0007230 con 0x7f2dd4004810 2023-10-06T03:01:06.896 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.887+0000 7f2de5d9b700 1 -- 172.21.15.57:0/3483193013 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd00075d0 con 0x7f2dd4004810 2023-10-06T03:01:06.896 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.887+0000 7f2decf85700 1 -- 172.21.15.57:0/3483193013 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2dd4004810 msgr2=0x7f2dd4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:06.896 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.887+0000 7f2decf85700 1 --2- 172.21.15.57:0/3483193013 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2dd4004810 0x7f2dd4004c80 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2dd000a930 tx=0x7f2dd00021d0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.896 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.887+0000 7f2decf85700 1 -- 172.21.15.57:0/3483193013 shutdown_connections 2023-10-06T03:01:06.896 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.887+0000 7f2decf85700 1 --2- 172.21.15.57:0/3483193013 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2dd4004810 0x7f2dd4004c80 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.896 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.887+0000 7f2decf85700 1 -- 172.21.15.57:0/3483193013 >> 172.21.15.57:0/3483193013 conn(0x7f2de80ccbf0 msgr2=0x7f2de80ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:06.896 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.887+0000 7f2decf85700 1 -- 172.21.15.57:0/3483193013 shutdown_connections 2023-10-06T03:01:06.896 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.887+0000 7f2decf85700 1 -- 172.21.15.57:0/3483193013 wait complete. 2023-10-06T03:01:06.897 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.891+0000 7f2decf85700 1 Processor -- start 2023-10-06T03:01:06.897 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.891+0000 7f2decf85700 1 -- start start 2023-10-06T03:01:06.898 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.891+0000 7f2decf85700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2dd4004810 0x7f2de8169ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.898 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.891+0000 7f2decf85700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2de816cac0 0x7f2de8154460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.898 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.891+0000 7f2decf85700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2de815b8b0 0x7f2de80cdcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.891+0000 7f2decf85700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2de80b0700 con 0x7f2de816cac0 2023-10-06T03:01:06.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.891+0000 7f2decf85700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2de8151e90 con 0x7f2de815b8b0 2023-10-06T03:01:06.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.891+0000 7f2decf85700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2de80c9450 con 0x7f2dd4004810 2023-10-06T03:01:06.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.891+0000 7f2dddd9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2de816cac0 0x7f2de8154460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:06.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.895+0000 7f2dddd9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2de816cac0 0x7f2de8154460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55968/0 (socket says 172.21.15.57:55968) 2023-10-06T03:01:06.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.895+0000 7f2dddd9b700 1 -- 172.21.15.57:0/1215725510 learned_addr learned my addr 172.21.15.57:0/1215725510 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:06.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.895+0000 7f2de659c700 1 --2- 172.21.15.57:0/1215725510 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2dd4004810 0x7f2de8169ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:06.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.895+0000 7f2de6d9d700 1 --2- 172.21.15.57:0/1215725510 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2de815b8b0 0x7f2de80cdcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:06.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.895+0000 7f2dddd9b700 1 -- 172.21.15.57:0/1215725510 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2dd4004810 msgr2=0x7f2de8169ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:06.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.895+0000 7f2dddd9b700 1 --2- 172.21.15.57:0/1215725510 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2dd4004810 0x7f2de8169ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.895+0000 7f2dddd9b700 1 -- 172.21.15.57:0/1215725510 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2de815b8b0 msgr2=0x7f2de80cdcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:06.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.895+0000 7f2dddd9b700 1 --2- 172.21.15.57:0/1215725510 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2de815b8b0 0x7f2de80cdcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:06.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.895+0000 7f2dddd9b700 1 -- 172.21.15.57:0/1215725510 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2de816d2f0 con 0x7f2de816cac0 2023-10-06T03:01:06.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.895+0000 7f2dddd9b700 1 --2- 172.21.15.57:0/1215725510 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2de816cac0 0x7f2de8154460 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2dd400c0a0 tx=0x7f2dd0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:06.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.895+0000 7f2ddeffd700 1 -- 172.21.15.57:0/1215725510 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd00075b0 con 0x7f2de816cac0 2023-10-06T03:01:06.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.895+0000 7f2ddeffd700 1 -- 172.21.15.57:0/1215725510 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dd001e430 con 0x7f2de816cac0 2023-10-06T03:01:06.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.895+0000 7f2ddeffd700 1 -- 172.21.15.57:0/1215725510 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd001e5c0 con 0x7f2de816cac0 2023-10-06T03:01:06.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.895+0000 7f2decf85700 1 -- 172.21.15.57:0/1215725510 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2de816d5d0 con 0x7f2de816cac0 2023-10-06T03:01:06.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.895+0000 7f2decf85700 1 -- 172.21.15.57:0/1215725510 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2de81549a0 con 0x7f2de816cac0 2023-10-06T03:01:06.902 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.895+0000 7f2decf85700 1 -- 172.21.15.57:0/1215725510 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2de80c9600 con 0x7f2de816cac0 2023-10-06T03:01:06.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.899+0000 7f2ddeffd700 1 -- 172.21.15.57:0/1215725510 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f2dd0024020 con 0x7f2de816cac0 2023-10-06T03:01:06.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.899+0000 7f2ddeffd700 1 --2- 172.21.15.57:0/1215725510 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f2dc8060550 0x7f2dc8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:06.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.899+0000 7f2ddeffd700 1 -- 172.21.15.57:0/1215725510 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2dd007e990 con 0x7f2de816cac0 2023-10-06T03:01:06.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.899+0000 7f2de659c700 1 --2- 172.21.15.57:0/1215725510 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f2dc8060550 0x7f2dc8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:06.906 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.903+0000 7f2de659c700 1 --2- 172.21.15.57:0/1215725510 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f2dc8060550 0x7f2dc8062a00 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2dd8007fd0 tx=0x7f2dd8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:06.911 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:06.907+0000 7f2ddeffd700 1 -- 172.21.15.57:0/1215725510 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f2de80c9600 con 0x7f2de816cac0 2023-10-06T03:01:07.074 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.067+0000 7f2decf85700 1 -- 172.21.15.57:0/1215725510 --> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2de80c95c0 con 0x7f2dc8060550 2023-10-06T03:01:07.089 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.083+0000 7f2ddeffd700 1 -- 172.21.15.57:0/1215725510 <== mgr.4103 v2:172.21.15.57:6832/32947 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286395 (secure 0 0 0) 0x7f2de80c95c0 con 0x7f2dc8060550 2023-10-06T03:01:07.091 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:01:07.098 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.091+0000 7f2decf85700 1 -- 172.21.15.57:0/1215725510 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f2dc8060550 msgr2=0x7f2dc8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:07.098 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.091+0000 7f2decf85700 1 --2- 172.21.15.57:0/1215725510 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f2dc8060550 0x7f2dc8062a00 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2dd8007fd0 tx=0x7f2dd8009040 comp rx=0 tx=0).stop 2023-10-06T03:01:07.098 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.091+0000 7f2decf85700 1 -- 172.21.15.57:0/1215725510 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2de816cac0 msgr2=0x7f2de8154460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:07.098 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.091+0000 7f2decf85700 1 --2- 172.21.15.57:0/1215725510 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2de816cac0 0x7f2de8154460 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2dd400c0a0 tx=0x7f2dd0016000 comp rx=0 tx=0).stop 2023-10-06T03:01:07.098 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.091+0000 7f2decf85700 1 -- 172.21.15.57:0/1215725510 shutdown_connections 2023-10-06T03:01:07.098 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.091+0000 7f2decf85700 1 --2- 172.21.15.57:0/1215725510 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2de815b8b0 0x7f2de80cdcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:07.098 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.091+0000 7f2decf85700 1 --2- 172.21.15.57:0/1215725510 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2de816cac0 0x7f2de8154460 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:07.098 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.091+0000 7f2decf85700 1 --2- 172.21.15.57:0/1215725510 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f2dc8060550 0x7f2dc8062a00 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:07.099 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.091+0000 7f2decf85700 1 --2- 172.21.15.57:0/1215725510 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2dd4004810 0x7f2de8169ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:07.099 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.091+0000 7f2decf85700 1 -- 172.21.15.57:0/1215725510 >> 172.21.15.57:0/1215725510 conn(0x7f2de80ccbf0 msgr2=0x7f2de80cea90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:07.099 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.091+0000 7f2decf85700 1 -- 172.21.15.57:0/1215725510 shutdown_connections 2023-10-06T03:01:07.099 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.091+0000 7f2decf85700 1 -- 172.21.15.57:0/1215725510 wait complete. 2023-10-06T03:01:07.100 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2023-10-06T03:01:07.117 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2023-10-06T03:01:06.275719+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2397800,"kb_used_data":3112,"kb_used_omap":0,"kb_used_meta":2394624,"kb_avail":752576920,"statfs":{"total":773094113280,"available":770638766080,"internally_reserved":0,"allocated":3186688,"data_stored":1899900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2452094976},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.315292"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.991392+0000","last_change":"2023-10-06T03:00:57.980917+0000","last_active":"2023-10-06T03:00:57.991392+0000","last_peered":"2023-10-06T03:00:57.991392+0000","last_clean":"2023-10-06T03:00:57.991392+0000","last_became_active":"2023-10-06T03:00:57.980580+0000","last_became_peered":"2023-10-06T03:00:57.980580+0000","last_unstale":"2023-10-06T03:00:57.991392+0000","last_undegraded":"2023-10-06T03:00:57.991392+0000","last_fullsized":"2023-10-06T03:00:57.991392+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:30:16.978685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.994006+0000","last_change":"2023-10-06T03:00:57.990358+0000","last_active":"2023-10-06T03:00:57.994006+0000","last_peered":"2023-10-06T03:00:57.994006+0000","last_clean":"2023-10-06T03:00:57.994006+0000","last_became_active":"2023-10-06T03:00:57.990144+0000","last_became_peered":"2023-10-06T03:00:57.990144+0000","last_unstale":"2023-10-06T03:00:57.994006+0000","last_undegraded":"2023-10-06T03:00:57.994006+0000","last_fullsized":"2023-10-06T03:00:57.994006+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:32:39.801984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:58.015239+0000","last_change":"2023-10-06T03:00:58.006699+0000","last_active":"2023-10-06T03:00:58.015239+0000","last_peered":"2023-10-06T03:00:58.015239+0000","last_clean":"2023-10-06T03:00:58.015239+0000","last_became_active":"2023-10-06T03:00:58.005294+0000","last_became_peered":"2023-10-06T03:00:58.005294+0000","last_unstale":"2023-10-06T03:00:58.015239+0000","last_undegraded":"2023-10-06T03:00:58.015239+0000","last_fullsized":"2023-10-06T03:00:58.015239+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:35:56.006762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:58.006066+0000","last_change":"2023-10-06T03:00:57.994292+0000","last_active":"2023-10-06T03:00:58.006066+0000","last_peered":"2023-10-06T03:00:58.006066+0000","last_clean":"2023-10-06T03:00:58.006066+0000","last_became_active":"2023-10-06T03:00:57.994021+0000","last_became_peered":"2023-10-06T03:00:57.994021+0000","last_unstale":"2023-10-06T03:00:58.006066+0000","last_undegraded":"2023-10-06T03:00:58.006066+0000","last_fullsized":"2023-10-06T03:00:58.006066+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:04:36.988945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.995901+0000","last_change":"2023-10-06T03:00:57.992614+0000","last_active":"2023-10-06T03:00:57.995901+0000","last_peered":"2023-10-06T03:00:57.995901+0000","last_clean":"2023-10-06T03:00:57.995901+0000","last_became_active":"2023-10-06T03:00:57.992227+0000","last_became_peered":"2023-10-06T03:00:57.992227+0000","last_unstale":"2023-10-06T03:00:57.995901+0000","last_undegraded":"2023-10-06T03:00:57.995901+0000","last_fullsized":"2023-10-06T03:00:57.995901+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:41:47.568218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:58.014887+0000","last_change":"2023-10-06T03:00:58.005433+0000","last_active":"2023-10-06T03:00:58.014887+0000","last_peered":"2023-10-06T03:00:58.014887+0000","last_clean":"2023-10-06T03:00:58.014887+0000","last_became_active":"2023-10-06T03:00:58.005113+0000","last_became_peered":"2023-10-06T03:00:58.005113+0000","last_unstale":"2023-10-06T03:00:58.014887+0000","last_undegraded":"2023-10-06T03:00:58.014887+0000","last_fullsized":"2023-10-06T03:00:58.014887+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:49:14.009330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:58.008519+0000","last_change":"2023-10-06T03:00:57.998785+0000","last_active":"2023-10-06T03:00:58.008519+0000","last_peered":"2023-10-06T03:00:58.008519+0000","last_clean":"2023-10-06T03:00:58.008519+0000","last_became_active":"2023-10-06T03:00:57.997865+0000","last_became_peered":"2023-10-06T03:00:57.997865+0000","last_unstale":"2023-10-06T03:00:58.008519+0000","last_undegraded":"2023-10-06T03:00:58.008519+0000","last_fullsized":"2023-10-06T03:00:58.008519+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:32:39.801984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.993783+0000","last_change":"2023-10-06T03:00:57.985816+0000","last_active":"2023-10-06T03:00:57.993783+0000","last_peered":"2023-10-06T03:00:57.993783+0000","last_clean":"2023-10-06T03:00:57.993783+0000","last_became_active":"2023-10-06T03:00:57.985504+0000","last_became_peered":"2023-10-06T03:00:57.985504+0000","last_unstale":"2023-10-06T03:00:57.993783+0000","last_undegraded":"2023-10-06T03:00:57.993783+0000","last_fullsized":"2023-10-06T03:00:57.993783+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:12:21.523918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.995855+0000","last_change":"2023-10-06T03:00:57.991750+0000","last_active":"2023-10-06T03:00:57.995855+0000","last_peered":"2023-10-06T03:00:57.995855+0000","last_clean":"2023-10-06T03:00:57.995855+0000","last_became_active":"2023-10-06T03:00:57.991271+0000","last_became_peered":"2023-10-06T03:00:57.991271+0000","last_unstale":"2023-10-06T03:00:57.995855+0000","last_undegraded":"2023-10-06T03:00:57.995855+0000","last_fullsized":"2023-10-06T03:00:57.995855+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:32:20.183224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:58.001086+0000","last_change":"2023-10-06T03:00:57.997031+0000","last_active":"2023-10-06T03:00:58.001086+0000","last_peered":"2023-10-06T03:00:58.001086+0000","last_clean":"2023-10-06T03:00:58.001086+0000","last_became_active":"2023-10-06T03:00:57.996675+0000","last_became_peered":"2023-10-06T03:00:57.996675+0000","last_unstale":"2023-10-06T03:00:58.001086+0000","last_undegraded":"2023-10-06T03:00:58.001086+0000","last_fullsized":"2023-10-06T03:00:58.001086+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:49:14.009330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.984784+0000","last_change":"2023-10-06T03:00:57.978095+0000","last_active":"2023-10-06T03:00:57.984784+0000","last_peered":"2023-10-06T03:00:57.984784+0000","last_clean":"2023-10-06T03:00:57.984784+0000","last_became_active":"2023-10-06T03:00:57.977627+0000","last_became_peered":"2023-10-06T03:00:57.977627+0000","last_unstale":"2023-10-06T03:00:57.984784+0000","last_undegraded":"2023-10-06T03:00:57.984784+0000","last_fullsized":"2023-10-06T03:00:57.984784+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:41:47.568218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.991445+0000","last_change":"2023-10-06T03:00:57.981822+0000","last_active":"2023-10-06T03:00:57.991445+0000","last_peered":"2023-10-06T03:00:57.991445+0000","last_clean":"2023-10-06T03:00:57.991445+0000","last_became_active":"2023-10-06T03:00:57.981246+0000","last_became_peered":"2023-10-06T03:00:57.981246+0000","last_unstale":"2023-10-06T03:00:57.991445+0000","last_undegraded":"2023-10-06T03:00:57.991445+0000","last_fullsized":"2023-10-06T03:00:57.991445+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:11:32.949199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.987651+0000","last_change":"2023-10-06T03:00:57.979093+0000","last_active":"2023-10-06T03:00:57.987651+0000","last_peered":"2023-10-06T03:00:57.987651+0000","last_clean":"2023-10-06T03:00:57.987651+0000","last_became_active":"2023-10-06T03:00:57.978790+0000","last_became_peered":"2023-10-06T03:00:57.978790+0000","last_unstale":"2023-10-06T03:00:57.987651+0000","last_undegraded":"2023-10-06T03:00:57.987651+0000","last_fullsized":"2023-10-06T03:00:57.987651+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:04:36.988945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.996721+0000","last_change":"2023-10-06T03:00:57.992778+0000","last_active":"2023-10-06T03:00:57.996721+0000","last_peered":"2023-10-06T03:00:57.996721+0000","last_clean":"2023-10-06T03:00:57.996721+0000","last_became_active":"2023-10-06T03:00:57.992484+0000","last_became_peered":"2023-10-06T03:00:57.992484+0000","last_unstale":"2023-10-06T03:00:57.996721+0000","last_undegraded":"2023-10-06T03:00:57.996721+0000","last_fullsized":"2023-10-06T03:00:57.996721+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:32:20.183224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:58.008543+0000","last_change":"2023-10-06T03:00:57.999320+0000","last_active":"2023-10-06T03:00:58.008543+0000","last_peered":"2023-10-06T03:00:58.008543+0000","last_clean":"2023-10-06T03:00:58.008543+0000","last_became_active":"2023-10-06T03:00:57.998455+0000","last_became_peered":"2023-10-06T03:00:57.998455+0000","last_unstale":"2023-10-06T03:00:58.008543+0000","last_undegraded":"2023-10-06T03:00:58.008543+0000","last_fullsized":"2023-10-06T03:00:58.008543+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:14:29.859982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:58.015064+0000","last_change":"2023-10-06T03:00:58.005775+0000","last_active":"2023-10-06T03:00:58.015064+0000","last_peered":"2023-10-06T03:00:58.015064+0000","last_clean":"2023-10-06T03:00:58.015064+0000","last_became_active":"2023-10-06T03:00:58.005474+0000","last_became_peered":"2023-10-06T03:00:58.005474+0000","last_unstale":"2023-10-06T03:00:58.015064+0000","last_undegraded":"2023-10-06T03:00:58.015064+0000","last_fullsized":"2023-10-06T03:00:58.015064+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:28:58.179787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.996062+0000","last_change":"2023-10-06T03:00:57.993441+0000","last_active":"2023-10-06T03:00:57.996062+0000","last_peered":"2023-10-06T03:00:57.996062+0000","last_clean":"2023-10-06T03:00:57.996062+0000","last_became_active":"2023-10-06T03:00:57.993145+0000","last_became_peered":"2023-10-06T03:00:57.993145+0000","last_unstale":"2023-10-06T03:00:57.996062+0000","last_undegraded":"2023-10-06T03:00:57.996062+0000","last_fullsized":"2023-10-06T03:00:57.996062+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:49:14.009330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:58.010511+0000","last_change":"2023-10-06T03:00:57.989141+0000","last_active":"2023-10-06T03:00:58.010511+0000","last_peered":"2023-10-06T03:00:58.010511+0000","last_clean":"2023-10-06T03:00:58.010511+0000","last_became_active":"2023-10-06T03:00:57.988752+0000","last_became_peered":"2023-10-06T03:00:57.988752+0000","last_unstale":"2023-10-06T03:00:58.010511+0000","last_undegraded":"2023-10-06T03:00:58.010511+0000","last_fullsized":"2023-10-06T03:00:58.010511+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:48:42.435907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.991593+0000","last_change":"2023-10-06T03:00:57.982128+0000","last_active":"2023-10-06T03:00:57.991593+0000","last_peered":"2023-10-06T03:00:57.991593+0000","last_clean":"2023-10-06T03:00:57.991593+0000","last_became_active":"2023-10-06T03:00:57.981762+0000","last_became_peered":"2023-10-06T03:00:57.981762+0000","last_unstale":"2023-10-06T03:00:57.991593+0000","last_undegraded":"2023-10-06T03:00:57.991593+0000","last_fullsized":"2023-10-06T03:00:57.991593+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:50:24.543128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.986900+0000","last_change":"2023-10-06T03:00:57.980179+0000","last_active":"2023-10-06T03:00:57.986900+0000","last_peered":"2023-10-06T03:00:57.986900+0000","last_clean":"2023-10-06T03:00:57.986900+0000","last_became_active":"2023-10-06T03:00:57.979822+0000","last_became_peered":"2023-10-06T03:00:57.979822+0000","last_unstale":"2023-10-06T03:00:57.986900+0000","last_undegraded":"2023-10-06T03:00:57.986900+0000","last_fullsized":"2023-10-06T03:00:57.986900+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:56:45.815718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.991824+0000","last_change":"2023-10-06T03:00:57.987885+0000","last_active":"2023-10-06T03:00:57.991824+0000","last_peered":"2023-10-06T03:00:57.991824+0000","last_clean":"2023-10-06T03:00:57.991824+0000","last_became_active":"2023-10-06T03:00:57.987306+0000","last_became_peered":"2023-10-06T03:00:57.987306+0000","last_unstale":"2023-10-06T03:00:57.991824+0000","last_undegraded":"2023-10-06T03:00:57.991824+0000","last_fullsized":"2023-10-06T03:00:57.991824+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:16:06.528696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.999698+0000","last_change":"2023-10-06T03:00:57.997306+0000","last_active":"2023-10-06T03:00:57.999698+0000","last_peered":"2023-10-06T03:00:57.999698+0000","last_clean":"2023-10-06T03:00:57.999698+0000","last_became_active":"2023-10-06T03:00:57.996969+0000","last_became_peered":"2023-10-06T03:00:57.996969+0000","last_unstale":"2023-10-06T03:00:57.999698+0000","last_undegraded":"2023-10-06T03:00:57.999698+0000","last_fullsized":"2023-10-06T03:00:57.999698+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:12:21.523918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:58.002300+0000","last_change":"2023-10-06T03:00:57.997342+0000","last_active":"2023-10-06T03:00:58.002300+0000","last_peered":"2023-10-06T03:00:58.002300+0000","last_clean":"2023-10-06T03:00:58.002300+0000","last_became_active":"2023-10-06T03:00:57.996950+0000","last_became_peered":"2023-10-06T03:00:57.996950+0000","last_unstale":"2023-10-06T03:00:58.002300+0000","last_undegraded":"2023-10-06T03:00:58.002300+0000","last_fullsized":"2023-10-06T03:00:58.002300+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:54:01.471407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:58.008023+0000","last_change":"2023-10-06T03:00:57.997946+0000","last_active":"2023-10-06T03:00:58.008023+0000","last_peered":"2023-10-06T03:00:58.008023+0000","last_clean":"2023-10-06T03:00:58.008023+0000","last_became_active":"2023-10-06T03:00:57.997600+0000","last_became_peered":"2023-10-06T03:00:57.997600+0000","last_unstale":"2023-10-06T03:00:58.008023+0000","last_undegraded":"2023-10-06T03:00:58.008023+0000","last_fullsized":"2023-10-06T03:00:58.008023+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:12:21.523918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.994959+0000","last_change":"2023-10-06T03:00:57.989508+0000","last_active":"2023-10-06T03:00:57.994959+0000","last_peered":"2023-10-06T03:00:57.994959+0000","last_clean":"2023-10-06T03:00:57.994959+0000","last_became_active":"2023-10-06T03:00:57.989023+0000","last_became_peered":"2023-10-06T03:00:57.989023+0000","last_unstale":"2023-10-06T03:00:57.994959+0000","last_undegraded":"2023-10-06T03:00:57.994959+0000","last_fullsized":"2023-10-06T03:00:57.994959+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:14:29.859982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.994243+0000","last_change":"2023-10-06T03:00:57.987485+0000","last_active":"2023-10-06T03:00:57.994243+0000","last_peered":"2023-10-06T03:00:57.994243+0000","last_clean":"2023-10-06T03:00:57.994243+0000","last_became_active":"2023-10-06T03:00:57.983554+0000","last_became_peered":"2023-10-06T03:00:57.983554+0000","last_unstale":"2023-10-06T03:00:57.994243+0000","last_undegraded":"2023-10-06T03:00:57.994243+0000","last_fullsized":"2023-10-06T03:00:57.994243+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:18:57.339278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:58.006377+0000","last_change":"2023-10-06T03:00:58.003002+0000","last_active":"2023-10-06T03:00:58.006377+0000","last_peered":"2023-10-06T03:00:58.006377+0000","last_clean":"2023-10-06T03:00:58.006377+0000","last_became_active":"2023-10-06T03:00:58.002705+0000","last_became_peered":"2023-10-06T03:00:58.002705+0000","last_unstale":"2023-10-06T03:00:58.006377+0000","last_undegraded":"2023-10-06T03:00:58.006377+0000","last_fullsized":"2023-10-06T03:00:58.006377+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:14:29.859982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.994965+0000","last_change":"2023-10-06T03:00:57.991310+0000","last_active":"2023-10-06T03:00:57.994965+0000","last_peered":"2023-10-06T03:00:57.994965+0000","last_clean":"2023-10-06T03:00:57.994965+0000","last_became_active":"2023-10-06T03:00:57.990221+0000","last_became_peered":"2023-10-06T03:00:57.990221+0000","last_unstale":"2023-10-06T03:00:57.994965+0000","last_undegraded":"2023-10-06T03:00:57.994965+0000","last_fullsized":"2023-10-06T03:00:57.994965+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:39:00.112932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.995764+0000","last_change":"2023-10-06T03:00:57.991930+0000","last_active":"2023-10-06T03:00:57.995764+0000","last_peered":"2023-10-06T03:00:57.995764+0000","last_clean":"2023-10-06T03:00:57.995764+0000","last_became_active":"2023-10-06T03:00:57.991329+0000","last_became_peered":"2023-10-06T03:00:57.991329+0000","last_unstale":"2023-10-06T03:00:57.995764+0000","last_undegraded":"2023-10-06T03:00:57.995764+0000","last_fullsized":"2023-10-06T03:00:57.995764+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:10:20.444330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.989838+0000","last_change":"2023-10-06T03:00:57.985010+0000","last_active":"2023-10-06T03:00:57.989838+0000","last_peered":"2023-10-06T03:00:57.989838+0000","last_clean":"2023-10-06T03:00:57.989838+0000","last_became_active":"2023-10-06T03:00:57.983945+0000","last_became_peered":"2023-10-06T03:00:57.983945+0000","last_unstale":"2023-10-06T03:00:57.989838+0000","last_undegraded":"2023-10-06T03:00:57.989838+0000","last_fullsized":"2023-10-06T03:00:57.989838+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:16:07.773169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.978641+0000","last_change":"2023-10-06T03:00:57.976726+0000","last_active":"2023-10-06T03:00:57.978641+0000","last_peered":"2023-10-06T03:00:57.978641+0000","last_clean":"2023-10-06T03:00:57.978641+0000","last_became_active":"2023-10-06T03:00:57.976367+0000","last_became_peered":"2023-10-06T03:00:57.976367+0000","last_unstale":"2023-10-06T03:00:57.978641+0000","last_undegraded":"2023-10-06T03:00:57.978641+0000","last_fullsized":"2023-10-06T03:00:57.978641+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:49:14.009330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.997016+0000","last_change":"2023-10-06T03:00:57.992161+0000","last_active":"2023-10-06T03:00:57.997016+0000","last_peered":"2023-10-06T03:00:57.997016+0000","last_clean":"2023-10-06T03:00:57.997016+0000","last_became_active":"2023-10-06T03:00:57.991886+0000","last_became_peered":"2023-10-06T03:00:57.991886+0000","last_unstale":"2023-10-06T03:00:57.997016+0000","last_undegraded":"2023-10-06T03:00:57.997016+0000","last_fullsized":"2023-10-06T03:00:57.997016+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:57:10.332887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.987129+0000","last_change":"2023-10-06T03:00:57.984047+0000","last_active":"2023-10-06T03:00:57.987129+0000","last_peered":"2023-10-06T03:00:57.987129+0000","last_clean":"2023-10-06T03:00:57.987129+0000","last_became_active":"2023-10-06T03:00:57.983670+0000","last_became_peered":"2023-10-06T03:00:57.983670+0000","last_unstale":"2023-10-06T03:00:57.987129+0000","last_undegraded":"2023-10-06T03:00:57.987129+0000","last_fullsized":"2023-10-06T03:00:57.987129+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:12:21.523918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:58.015608+0000","last_change":"2023-10-06T03:00:56.987376+0000","last_active":"2023-10-06T03:00:58.015608+0000","last_peered":"2023-10-06T03:00:58.015608+0000","last_clean":"2023-10-06T03:00:58.015608+0000","last_became_active":"2023-10-06T03:00:56.986953+0000","last_became_peered":"2023-10-06T03:00:56.986953+0000","last_unstale":"2023-10-06T03:00:58.015608+0000","last_undegraded":"2023-10-06T03:00:58.015608+0000","last_fullsized":"2023-10-06T03:00:58.015608+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:39:00.208565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:58.003097+0000","last_change":"2023-10-06T03:00:57.998904+0000","last_active":"2023-10-06T03:00:58.003097+0000","last_peered":"2023-10-06T03:00:58.003097+0000","last_clean":"2023-10-06T03:00:58.003097+0000","last_became_active":"2023-10-06T03:00:57.998631+0000","last_became_peered":"2023-10-06T03:00:57.998631+0000","last_unstale":"2023-10-06T03:00:58.003097+0000","last_undegraded":"2023-10-06T03:00:58.003097+0000","last_fullsized":"2023-10-06T03:00:58.003097+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:41:47.568218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.976447+0000","last_change":"2023-10-06T03:00:56.977003+0000","last_active":"2023-10-06T03:00:57.976447+0000","last_peered":"2023-10-06T03:00:57.976447+0000","last_clean":"2023-10-06T03:00:57.976447+0000","last_became_active":"2023-10-06T03:00:56.976668+0000","last_became_peered":"2023-10-06T03:00:56.976668+0000","last_unstale":"2023-10-06T03:00:57.976447+0000","last_undegraded":"2023-10-06T03:00:57.976447+0000","last_fullsized":"2023-10-06T03:00:57.976447+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:08:59.306830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.998716+0000","last_change":"2023-10-06T03:00:57.995079+0000","last_active":"2023-10-06T03:00:57.998716+0000","last_peered":"2023-10-06T03:00:57.998716+0000","last_clean":"2023-10-06T03:00:57.998716+0000","last_became_active":"2023-10-06T03:00:57.994813+0000","last_became_peered":"2023-10-06T03:00:57.994813+0000","last_unstale":"2023-10-06T03:00:57.998716+0000","last_undegraded":"2023-10-06T03:00:57.998716+0000","last_fullsized":"2023-10-06T03:00:57.998716+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:28:58.179787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.979475+0000","last_change":"2023-10-06T03:00:56.987263+0000","last_active":"2023-10-06T03:00:57.979475+0000","last_peered":"2023-10-06T03:00:57.979475+0000","last_clean":"2023-10-06T03:00:57.979475+0000","last_became_active":"2023-10-06T03:00:56.986927+0000","last_became_peered":"2023-10-06T03:00:56.986927+0000","last_unstale":"2023-10-06T03:00:57.979475+0000","last_undegraded":"2023-10-06T03:00:57.979475+0000","last_fullsized":"2023-10-06T03:00:57.979475+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:01:20.300193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.988672+0000","last_change":"2023-10-06T03:00:57.985729+0000","last_active":"2023-10-06T03:00:57.988672+0000","last_peered":"2023-10-06T03:00:57.988672+0000","last_clean":"2023-10-06T03:00:57.988672+0000","last_became_active":"2023-10-06T03:00:57.985148+0000","last_became_peered":"2023-10-06T03:00:57.985148+0000","last_unstale":"2023-10-06T03:00:57.988672+0000","last_undegraded":"2023-10-06T03:00:57.988672+0000","last_fullsized":"2023-10-06T03:00:57.988672+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:01:50.001484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:58.017678+0000","last_change":"2023-10-06T03:00:56.981696+0000","last_active":"2023-10-06T03:00:58.017678+0000","last_peered":"2023-10-06T03:00:58.017678+0000","last_clean":"2023-10-06T03:00:58.017678+0000","last_became_active":"2023-10-06T03:00:56.981358+0000","last_became_peered":"2023-10-06T03:00:56.981358+0000","last_unstale":"2023-10-06T03:00:58.017678+0000","last_undegraded":"2023-10-06T03:00:58.017678+0000","last_fullsized":"2023-10-06T03:00:58.017678+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:39:17.918596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:58.015903+0000","last_change":"2023-10-06T03:00:56.987266+0000","last_active":"2023-10-06T03:00:58.015903+0000","last_peered":"2023-10-06T03:00:58.015903+0000","last_clean":"2023-10-06T03:00:58.015903+0000","last_became_active":"2023-10-06T03:00:56.986946+0000","last_became_peered":"2023-10-06T03:00:56.986946+0000","last_unstale":"2023-10-06T03:00:58.015903+0000","last_undegraded":"2023-10-06T03:00:58.015903+0000","last_fullsized":"2023-10-06T03:00:58.015903+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:34:15.780752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:58.002688+0000","last_change":"2023-10-06T03:00:57.999452+0000","last_active":"2023-10-06T03:00:58.002688+0000","last_peered":"2023-10-06T03:00:58.002688+0000","last_clean":"2023-10-06T03:00:58.002688+0000","last_became_active":"2023-10-06T03:00:57.999164+0000","last_became_peered":"2023-10-06T03:00:57.999164+0000","last_unstale":"2023-10-06T03:00:58.002688+0000","last_undegraded":"2023-10-06T03:00:58.002688+0000","last_fullsized":"2023-10-06T03:00:58.002688+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:28:58.179787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:58.015419+0000","last_change":"2023-10-06T03:00:56.987382+0000","last_active":"2023-10-06T03:00:58.015419+0000","last_peered":"2023-10-06T03:00:58.015419+0000","last_clean":"2023-10-06T03:00:58.015419+0000","last_became_active":"2023-10-06T03:00:56.987056+0000","last_became_peered":"2023-10-06T03:00:56.987056+0000","last_unstale":"2023-10-06T03:00:58.015419+0000","last_undegraded":"2023-10-06T03:00:58.015419+0000","last_fullsized":"2023-10-06T03:00:58.015419+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:57:09.321024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.983609+0000","last_change":"2023-10-06T03:00:57.975126+0000","last_active":"2023-10-06T03:00:57.983609+0000","last_peered":"2023-10-06T03:00:57.983609+0000","last_clean":"2023-10-06T03:00:57.983609+0000","last_became_active":"2023-10-06T03:00:57.974673+0000","last_became_peered":"2023-10-06T03:00:57.974673+0000","last_unstale":"2023-10-06T03:00:57.983609+0000","last_undegraded":"2023-10-06T03:00:57.983609+0000","last_fullsized":"2023-10-06T03:00:57.983609+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:12:21.523918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:58.012700+0000","last_change":"2023-10-06T03:00:56.976910+0000","last_active":"2023-10-06T03:00:58.012700+0000","last_peered":"2023-10-06T03:00:58.012700+0000","last_clean":"2023-10-06T03:00:58.012700+0000","last_became_active":"2023-10-06T03:00:56.976555+0000","last_became_peered":"2023-10-06T03:00:56.976555+0000","last_unstale":"2023-10-06T03:00:58.012700+0000","last_undegraded":"2023-10-06T03:00:58.012700+0000","last_fullsized":"2023-10-06T03:00:58.012700+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:27:56.469909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:58.007053+0000","last_change":"2023-10-06T03:00:58.004875+0000","last_active":"2023-10-06T03:00:58.007053+0000","last_peered":"2023-10-06T03:00:58.007053+0000","last_clean":"2023-10-06T03:00:58.007053+0000","last_became_active":"2023-10-06T03:00:57.997479+0000","last_became_peered":"2023-10-06T03:00:57.997479+0000","last_unstale":"2023-10-06T03:00:58.007053+0000","last_undegraded":"2023-10-06T03:00:58.007053+0000","last_fullsized":"2023-10-06T03:00:58.007053+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:39:01.220427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.972697+0000","last_change":"2023-10-06T03:00:56.979202+0000","last_active":"2023-10-06T03:00:57.972697+0000","last_peered":"2023-10-06T03:00:57.972697+0000","last_clean":"2023-10-06T03:00:57.972697+0000","last_became_active":"2023-10-06T03:00:56.978922+0000","last_became_peered":"2023-10-06T03:00:56.978922+0000","last_unstale":"2023-10-06T03:00:57.972697+0000","last_undegraded":"2023-10-06T03:00:57.972697+0000","last_fullsized":"2023-10-06T03:00:57.972697+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:04:35.977083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:58.001441+0000","last_change":"2023-10-06T03:00:57.998369+0000","last_active":"2023-10-06T03:00:58.001441+0000","last_peered":"2023-10-06T03:00:58.001441+0000","last_clean":"2023-10-06T03:00:58.001441+0000","last_became_active":"2023-10-06T03:00:57.997963+0000","last_became_peered":"2023-10-06T03:00:57.997963+0000","last_unstale":"2023-10-06T03:00:58.001441+0000","last_undegraded":"2023-10-06T03:00:58.001441+0000","last_fullsized":"2023-10-06T03:00:58.001441+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:32:39.801984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:58.005626+0000","last_change":"2023-10-06T03:00:56.986683+0000","last_active":"2023-10-06T03:00:58.005626+0000","last_peered":"2023-10-06T03:00:58.005626+0000","last_clean":"2023-10-06T03:00:58.005626+0000","last_became_active":"2023-10-06T03:00:56.986329+0000","last_became_peered":"2023-10-06T03:00:56.986329+0000","last_unstale":"2023-10-06T03:00:58.005626+0000","last_undegraded":"2023-10-06T03:00:58.005626+0000","last_fullsized":"2023-10-06T03:00:58.005626+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:41:07.693426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.987686+0000","last_change":"2023-10-06T03:00:57.981948+0000","last_active":"2023-10-06T03:00:57.987686+0000","last_peered":"2023-10-06T03:00:57.987686+0000","last_clean":"2023-10-06T03:00:57.987686+0000","last_became_active":"2023-10-06T03:00:57.980831+0000","last_became_peered":"2023-10-06T03:00:57.980831+0000","last_unstale":"2023-10-06T03:00:57.987686+0000","last_undegraded":"2023-10-06T03:00:57.987686+0000","last_fullsized":"2023-10-06T03:00:57.987686+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:05:44.036671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.978045+0000","last_change":"2023-10-06T03:00:56.981077+0000","last_active":"2023-10-06T03:00:57.978045+0000","last_peered":"2023-10-06T03:00:57.978045+0000","last_clean":"2023-10-06T03:00:57.978045+0000","last_became_active":"2023-10-06T03:00:56.980777+0000","last_became_peered":"2023-10-06T03:00:56.980777+0000","last_unstale":"2023-10-06T03:00:57.978045+0000","last_undegraded":"2023-10-06T03:00:57.978045+0000","last_fullsized":"2023-10-06T03:00:57.978045+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:41:33.554972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.990713+0000","last_change":"2023-10-06T03:00:57.984615+0000","last_active":"2023-10-06T03:00:57.990713+0000","last_peered":"2023-10-06T03:00:57.990713+0000","last_clean":"2023-10-06T03:00:57.990713+0000","last_became_active":"2023-10-06T03:00:57.984307+0000","last_became_peered":"2023-10-06T03:00:57.984307+0000","last_unstale":"2023-10-06T03:00:57.990713+0000","last_undegraded":"2023-10-06T03:00:57.990713+0000","last_fullsized":"2023-10-06T03:00:57.990713+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:35.377456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.965350+0000","last_change":"2023-10-06T03:00:56.987414+0000","last_active":"2023-10-06T03:00:57.965350+0000","last_peered":"2023-10-06T03:00:57.965350+0000","last_clean":"2023-10-06T03:00:57.965350+0000","last_became_active":"2023-10-06T03:00:56.987085+0000","last_became_peered":"2023-10-06T03:00:56.987085+0000","last_unstale":"2023-10-06T03:00:57.965350+0000","last_undegraded":"2023-10-06T03:00:57.965350+0000","last_fullsized":"2023-10-06T03:00:57.965350+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:04:31.750536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.987708+0000","last_change":"2023-10-06T03:00:57.984185+0000","last_active":"2023-10-06T03:00:57.987708+0000","last_peered":"2023-10-06T03:00:57.987708+0000","last_clean":"2023-10-06T03:00:57.987708+0000","last_became_active":"2023-10-06T03:00:57.983849+0000","last_became_peered":"2023-10-06T03:00:57.983849+0000","last_unstale":"2023-10-06T03:00:57.987708+0000","last_undegraded":"2023-10-06T03:00:57.987708+0000","last_fullsized":"2023-10-06T03:00:57.987708+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:32:39.801984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.963112+0000","last_change":"2023-10-06T03:00:56.985582+0000","last_active":"2023-10-06T03:00:57.963112+0000","last_peered":"2023-10-06T03:00:57.963112+0000","last_clean":"2023-10-06T03:00:57.963112+0000","last_became_active":"2023-10-06T03:00:56.985254+0000","last_became_peered":"2023-10-06T03:00:56.985254+0000","last_unstale":"2023-10-06T03:00:57.963112+0000","last_undegraded":"2023-10-06T03:00:57.963112+0000","last_fullsized":"2023-10-06T03:00:57.963112+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:08:59.306830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.990886+0000","last_change":"2023-10-06T03:00:57.975691+0000","last_active":"2023-10-06T03:00:57.990886+0000","last_peered":"2023-10-06T03:00:57.990886+0000","last_clean":"2023-10-06T03:00:57.990886+0000","last_became_active":"2023-10-06T03:00:57.975368+0000","last_became_peered":"2023-10-06T03:00:57.975368+0000","last_unstale":"2023-10-06T03:00:57.990886+0000","last_undegraded":"2023-10-06T03:00:57.990886+0000","last_fullsized":"2023-10-06T03:00:57.990886+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:12:21.523918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":166,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.980333+0000","last_change":"2023-10-06T03:00:45.709165+0000","last_active":"2023-10-06T03:00:57.980333+0000","last_peered":"2023-10-06T03:00:57.980333+0000","last_clean":"2023-10-06T03:00:57.980333+0000","last_became_active":"2023-10-06T03:00:45.707771+0000","last_became_peered":"2023-10-06T03:00:45.707771+0000","last_unstale":"2023-10-06T03:00:57.980333+0000","last_undegraded":"2023-10-06T03:00:57.980333+0000","last_fullsized":"2023-10-06T03:00:57.980333+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:44.625353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:44.625353+0000","last_clean_scrub_stamp":"2023-10-06T03:00:44.625353+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:31:31.774239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.972547+0000","last_change":"2023-10-06T03:00:51.905381+0000","last_active":"2023-10-06T03:00:57.972547+0000","last_peered":"2023-10-06T03:00:57.972547+0000","last_clean":"2023-10-06T03:00:57.972547+0000","last_became_active":"2023-10-06T03:00:51.904974+0000","last_became_peered":"2023-10-06T03:00:51.904974+0000","last_unstale":"2023-10-06T03:00:57.972547+0000","last_undegraded":"2023-10-06T03:00:57.972547+0000","last_fullsized":"2023-10-06T03:00:57.972547+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:15:19.182956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.961981+0000","last_change":"2023-10-06T03:00:56.977217+0000","last_active":"2023-10-06T03:00:57.961981+0000","last_peered":"2023-10-06T03:00:57.961981+0000","last_clean":"2023-10-06T03:00:57.961981+0000","last_became_active":"2023-10-06T03:00:56.976798+0000","last_became_peered":"2023-10-06T03:00:56.976798+0000","last_unstale":"2023-10-06T03:00:57.961981+0000","last_undegraded":"2023-10-06T03:00:57.961981+0000","last_fullsized":"2023-10-06T03:00:57.961981+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:11:31.937336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.985658+0000","last_change":"2023-10-06T03:00:57.979627+0000","last_active":"2023-10-06T03:00:57.985658+0000","last_peered":"2023-10-06T03:00:57.985658+0000","last_clean":"2023-10-06T03:00:57.985658+0000","last_became_active":"2023-10-06T03:00:57.979346+0000","last_became_peered":"2023-10-06T03:00:57.979346+0000","last_unstale":"2023-10-06T03:00:57.985658+0000","last_undegraded":"2023-10-06T03:00:57.985658+0000","last_fullsized":"2023-10-06T03:00:57.985658+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:34:16.792615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.980248+0000","last_change":"2023-10-06T03:00:51.906480+0000","last_active":"2023-10-06T03:00:57.980248+0000","last_peered":"2023-10-06T03:00:57.980248+0000","last_clean":"2023-10-06T03:00:57.980248+0000","last_became_active":"2023-10-06T03:00:51.905956+0000","last_became_peered":"2023-10-06T03:00:51.905956+0000","last_unstale":"2023-10-06T03:00:57.980248+0000","last_undegraded":"2023-10-06T03:00:57.980248+0000","last_fullsized":"2023-10-06T03:00:57.980248+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:15:19.182956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.977891+0000","last_change":"2023-10-06T03:00:56.977514+0000","last_active":"2023-10-06T03:00:57.977891+0000","last_peered":"2023-10-06T03:00:57.977891+0000","last_clean":"2023-10-06T03:00:57.977891+0000","last_became_active":"2023-10-06T03:00:56.977108+0000","last_became_peered":"2023-10-06T03:00:56.977108+0000","last_unstale":"2023-10-06T03:00:57.977891+0000","last_undegraded":"2023-10-06T03:00:57.977891+0000","last_fullsized":"2023-10-06T03:00:57.977891+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:11:31.937336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.999714+0000","last_change":"2023-10-06T03:00:57.997236+0000","last_active":"2023-10-06T03:00:57.999714+0000","last_peered":"2023-10-06T03:00:57.999714+0000","last_clean":"2023-10-06T03:00:57.999714+0000","last_became_active":"2023-10-06T03:00:57.996915+0000","last_became_peered":"2023-10-06T03:00:57.996915+0000","last_unstale":"2023-10-06T03:00:57.999714+0000","last_undegraded":"2023-10-06T03:00:57.999714+0000","last_fullsized":"2023-10-06T03:00:57.999714+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:16:06.528696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.975713+0000","last_change":"2023-10-06T03:00:51.902453+0000","last_active":"2023-10-06T03:00:57.975713+0000","last_peered":"2023-10-06T03:00:57.975713+0000","last_clean":"2023-10-06T03:00:57.975713+0000","last_became_active":"2023-10-06T03:00:51.901948+0000","last_became_peered":"2023-10-06T03:00:51.901948+0000","last_unstale":"2023-10-06T03:00:57.975713+0000","last_undegraded":"2023-10-06T03:00:57.975713+0000","last_fullsized":"2023-10-06T03:00:57.975713+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:13:30.721650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.971727+0000","last_change":"2023-10-06T03:00:56.986609+0000","last_active":"2023-10-06T03:00:57.971727+0000","last_peered":"2023-10-06T03:00:57.971727+0000","last_clean":"2023-10-06T03:00:57.971727+0000","last_became_active":"2023-10-06T03:00:56.986325+0000","last_became_peered":"2023-10-06T03:00:56.986325+0000","last_unstale":"2023-10-06T03:00:57.971727+0000","last_undegraded":"2023-10-06T03:00:57.971727+0000","last_fullsized":"2023-10-06T03:00:57.971727+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:50:23.531265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.994542+0000","last_change":"2023-10-06T03:00:57.987932+0000","last_active":"2023-10-06T03:00:57.994542+0000","last_peered":"2023-10-06T03:00:57.994542+0000","last_clean":"2023-10-06T03:00:57.994542+0000","last_became_active":"2023-10-06T03:00:57.982542+0000","last_became_peered":"2023-10-06T03:00:57.982542+0000","last_unstale":"2023-10-06T03:00:57.994542+0000","last_undegraded":"2023-10-06T03:00:57.994542+0000","last_fullsized":"2023-10-06T03:00:57.994542+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:51:29.997106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.974149+0000","last_change":"2023-10-06T03:00:51.904148+0000","last_active":"2023-10-06T03:00:57.974149+0000","last_peered":"2023-10-06T03:00:57.974149+0000","last_clean":"2023-10-06T03:00:57.974149+0000","last_became_active":"2023-10-06T03:00:51.903729+0000","last_became_peered":"2023-10-06T03:00:51.903729+0000","last_unstale":"2023-10-06T03:00:57.974149+0000","last_undegraded":"2023-10-06T03:00:57.974149+0000","last_fullsized":"2023-10-06T03:00:57.974149+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:17:25.070478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.968707+0000","last_change":"2023-10-06T03:00:56.986459+0000","last_active":"2023-10-06T03:00:57.968707+0000","last_peered":"2023-10-06T03:00:57.968707+0000","last_clean":"2023-10-06T03:00:57.968707+0000","last_became_active":"2023-10-06T03:00:56.986082+0000","last_became_peered":"2023-10-06T03:00:56.986082+0000","last_unstale":"2023-10-06T03:00:57.968707+0000","last_undegraded":"2023-10-06T03:00:57.968707+0000","last_fullsized":"2023-10-06T03:00:57.968707+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:41:07.693426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.994838+0000","last_change":"2023-10-06T03:00:57.989868+0000","last_active":"2023-10-06T03:00:57.994838+0000","last_peered":"2023-10-06T03:00:57.994838+0000","last_clean":"2023-10-06T03:00:57.994838+0000","last_became_active":"2023-10-06T03:00:57.988520+0000","last_became_peered":"2023-10-06T03:00:57.988520+0000","last_unstale":"2023-10-06T03:00:57.994838+0000","last_undegraded":"2023-10-06T03:00:57.994838+0000","last_fullsized":"2023-10-06T03:00:57.994838+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:32:39.801984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.973391+0000","last_change":"2023-10-06T03:00:56.979822+0000","last_active":"2023-10-06T03:00:57.973391+0000","last_peered":"2023-10-06T03:00:57.973391+0000","last_clean":"2023-10-06T03:00:57.973391+0000","last_became_active":"2023-10-06T03:00:56.978084+0000","last_became_peered":"2023-10-06T03:00:56.978084+0000","last_unstale":"2023-10-06T03:00:57.973391+0000","last_undegraded":"2023-10-06T03:00:57.973391+0000","last_fullsized":"2023-10-06T03:00:57.973391+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:39:00.208565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.971790+0000","last_change":"2023-10-06T03:00:52.484317+0000","last_active":"2023-10-06T03:00:57.971790+0000","last_peered":"2023-10-06T03:00:57.971790+0000","last_clean":"2023-10-06T03:00:57.971790+0000","last_became_active":"2023-10-06T03:00:52.483818+0000","last_became_peered":"2023-10-06T03:00:52.483818+0000","last_unstale":"2023-10-06T03:00:57.971790+0000","last_undegraded":"2023-10-06T03:00:57.971790+0000","last_fullsized":"2023-10-06T03:00:57.971790+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:17:24.136459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.995100+0000","last_change":"2023-10-06T03:00:57.991155+0000","last_active":"2023-10-06T03:00:57.995100+0000","last_peered":"2023-10-06T03:00:57.995100+0000","last_clean":"2023-10-06T03:00:57.995100+0000","last_became_active":"2023-10-06T03:00:57.990697+0000","last_became_peered":"2023-10-06T03:00:57.990697+0000","last_unstale":"2023-10-06T03:00:57.995100+0000","last_undegraded":"2023-10-06T03:00:57.995100+0000","last_fullsized":"2023-10-06T03:00:57.995100+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:01:50.001484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.971691+0000","last_change":"2023-10-06T03:00:56.987943+0000","last_active":"2023-10-06T03:00:57.971691+0000","last_peered":"2023-10-06T03:00:57.971691+0000","last_clean":"2023-10-06T03:00:57.971691+0000","last_became_active":"2023-10-06T03:00:56.987664+0000","last_became_peered":"2023-10-06T03:00:56.987664+0000","last_unstale":"2023-10-06T03:00:57.971691+0000","last_undegraded":"2023-10-06T03:00:57.971691+0000","last_fullsized":"2023-10-06T03:00:57.971691+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:32:00.864289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.980458+0000","last_change":"2023-10-06T03:00:52.485186+0000","last_active":"2023-10-06T03:00:57.980458+0000","last_peered":"2023-10-06T03:00:57.980458+0000","last_clean":"2023-10-06T03:00:57.980458+0000","last_became_active":"2023-10-06T03:00:52.484615+0000","last_became_peered":"2023-10-06T03:00:52.484615+0000","last_unstale":"2023-10-06T03:00:57.980458+0000","last_undegraded":"2023-10-06T03:00:57.980458+0000","last_fullsized":"2023-10-06T03:00:57.980458+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:17:25.070478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.996037+0000","last_change":"2023-10-06T03:00:57.993777+0000","last_active":"2023-10-06T03:00:57.996037+0000","last_peered":"2023-10-06T03:00:57.996037+0000","last_clean":"2023-10-06T03:00:57.996037+0000","last_became_active":"2023-10-06T03:00:57.993567+0000","last_became_peered":"2023-10-06T03:00:57.993567+0000","last_unstale":"2023-10-06T03:00:57.996037+0000","last_undegraded":"2023-10-06T03:00:57.996037+0000","last_fullsized":"2023-10-06T03:00:57.996037+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:14:29.859982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:58.012633+0000","last_change":"2023-10-06T03:00:56.980714+0000","last_active":"2023-10-06T03:00:58.012633+0000","last_peered":"2023-10-06T03:00:58.012633+0000","last_clean":"2023-10-06T03:00:58.012633+0000","last_became_active":"2023-10-06T03:00:56.979257+0000","last_became_peered":"2023-10-06T03:00:56.979257+0000","last_unstale":"2023-10-06T03:00:58.012633+0000","last_undegraded":"2023-10-06T03:00:58.012633+0000","last_fullsized":"2023-10-06T03:00:58.012633+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:30:15.966823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.971782+0000","last_change":"2023-10-06T03:00:51.903388+0000","last_active":"2023-10-06T03:00:57.971782+0000","last_peered":"2023-10-06T03:00:57.971782+0000","last_clean":"2023-10-06T03:00:57.971782+0000","last_became_active":"2023-10-06T03:00:51.902959+0000","last_became_peered":"2023-10-06T03:00:51.902959+0000","last_unstale":"2023-10-06T03:00:57.971782+0000","last_undegraded":"2023-10-06T03:00:57.971782+0000","last_fullsized":"2023-10-06T03:00:57.971782+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:30:16.907470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.988640+0000","last_change":"2023-10-06T03:00:57.985087+0000","last_active":"2023-10-06T03:00:57.988640+0000","last_peered":"2023-10-06T03:00:57.988640+0000","last_clean":"2023-10-06T03:00:57.988640+0000","last_became_active":"2023-10-06T03:00:57.984740+0000","last_became_peered":"2023-10-06T03:00:57.984740+0000","last_unstale":"2023-10-06T03:00:57.988640+0000","last_undegraded":"2023-10-06T03:00:57.988640+0000","last_fullsized":"2023-10-06T03:00:57.988640+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:34:39.364267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:00:59.467306+0000","last_change":"2023-10-06T03:00:56.985269+0000","last_active":"2023-10-06T03:00:59.467306+0000","last_peered":"2023-10-06T03:00:59.467306+0000","last_clean":"2023-10-06T03:00:59.467306+0000","last_became_active":"2023-10-06T03:00:56.984926+0000","last_became_peered":"2023-10-06T03:00:56.984926+0000","last_unstale":"2023-10-06T03:00:59.467306+0000","last_undegraded":"2023-10-06T03:00:59.467306+0000","last_fullsized":"2023-10-06T03:00:59.467306+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:32:00.864289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.977974+0000","last_change":"2023-10-06T03:00:51.903242+0000","last_active":"2023-10-06T03:00:57.977974+0000","last_peered":"2023-10-06T03:00:57.977974+0000","last_clean":"2023-10-06T03:00:57.977974+0000","last_became_active":"2023-10-06T03:00:51.902929+0000","last_became_peered":"2023-10-06T03:00:51.902929+0000","last_unstale":"2023-10-06T03:00:57.977974+0000","last_undegraded":"2023-10-06T03:00:57.977974+0000","last_fullsized":"2023-10-06T03:00:57.977974+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:34:12.274158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.989927+0000","last_change":"2023-10-06T03:00:57.986011+0000","last_active":"2023-10-06T03:00:57.989927+0000","last_peered":"2023-10-06T03:00:57.989927+0000","last_clean":"2023-10-06T03:00:57.989927+0000","last_became_active":"2023-10-06T03:00:57.985735+0000","last_became_peered":"2023-10-06T03:00:57.985735+0000","last_unstale":"2023-10-06T03:00:57.989927+0000","last_undegraded":"2023-10-06T03:00:57.989927+0000","last_fullsized":"2023-10-06T03:00:57.989927+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:14:29.859982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.987798+0000","last_change":"2023-10-06T03:00:57.981395+0000","last_active":"2023-10-06T03:00:57.987798+0000","last_peered":"2023-10-06T03:00:57.987798+0000","last_clean":"2023-10-06T03:00:57.987798+0000","last_became_active":"2023-10-06T03:00:57.981107+0000","last_became_peered":"2023-10-06T03:00:57.981107+0000","last_unstale":"2023-10-06T03:00:57.987798+0000","last_undegraded":"2023-10-06T03:00:57.987798+0000","last_fullsized":"2023-10-06T03:00:57.987798+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:32:20.183224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"22'6","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:58.020414+0000","last_change":"2023-10-06T03:00:56.979738+0000","last_active":"2023-10-06T03:00:58.020414+0000","last_peered":"2023-10-06T03:00:58.020414+0000","last_clean":"2023-10-06T03:00:58.020414+0000","last_became_active":"2023-10-06T03:00:56.979409+0000","last_became_peered":"2023-10-06T03:00:56.979409+0000","last_unstale":"2023-10-06T03:00:58.020414+0000","last_undegraded":"2023-10-06T03:00:58.020414+0000","last_fullsized":"2023-10-06T03:00:58.020414+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:41:33.554972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.995082+0000","last_change":"2023-10-06T03:00:57.990981+0000","last_active":"2023-10-06T03:00:57.995082+0000","last_peered":"2023-10-06T03:00:57.995082+0000","last_clean":"2023-10-06T03:00:57.995082+0000","last_became_active":"2023-10-06T03:00:57.990342+0000","last_became_peered":"2023-10-06T03:00:57.990342+0000","last_unstale":"2023-10-06T03:00:57.995082+0000","last_undegraded":"2023-10-06T03:00:57.995082+0000","last_fullsized":"2023-10-06T03:00:57.995082+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:16:06.528696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:58.012662+0000","last_change":"2023-10-06T03:00:56.983297+0000","last_active":"2023-10-06T03:00:58.012662+0000","last_peered":"2023-10-06T03:00:58.012662+0000","last_clean":"2023-10-06T03:00:58.012662+0000","last_became_active":"2023-10-06T03:00:56.983095+0000","last_became_peered":"2023-10-06T03:00:56.983095+0000","last_unstale":"2023-10-06T03:00:58.012662+0000","last_undegraded":"2023-10-06T03:00:58.012662+0000","last_fullsized":"2023-10-06T03:00:58.012662+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:49:02.389155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.976844+0000","last_change":"2023-10-06T03:00:56.976251+0000","last_active":"2023-10-06T03:00:57.976844+0000","last_peered":"2023-10-06T03:00:57.976844+0000","last_clean":"2023-10-06T03:00:57.976844+0000","last_became_active":"2023-10-06T03:00:56.975922+0000","last_became_peered":"2023-10-06T03:00:56.975922+0000","last_unstale":"2023-10-06T03:00:57.976844+0000","last_undegraded":"2023-10-06T03:00:57.976844+0000","last_fullsized":"2023-10-06T03:00:57.976844+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:34:15.780752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.995718+0000","last_change":"2023-10-06T03:00:57.989172+0000","last_active":"2023-10-06T03:00:57.995718+0000","last_peered":"2023-10-06T03:00:57.995718+0000","last_clean":"2023-10-06T03:00:57.995718+0000","last_became_active":"2023-10-06T03:00:57.988815+0000","last_became_peered":"2023-10-06T03:00:57.988815+0000","last_unstale":"2023-10-06T03:00:57.995718+0000","last_undegraded":"2023-10-06T03:00:57.995718+0000","last_fullsized":"2023-10-06T03:00:57.995718+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:41:47.568218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.973765+0000","last_change":"2023-10-06T03:00:56.981539+0000","last_active":"2023-10-06T03:00:57.973765+0000","last_peered":"2023-10-06T03:00:57.973765+0000","last_clean":"2023-10-06T03:00:57.973765+0000","last_became_active":"2023-10-06T03:00:56.980952+0000","last_became_peered":"2023-10-06T03:00:56.980952+0000","last_unstale":"2023-10-06T03:00:57.973765+0000","last_undegraded":"2023-10-06T03:00:57.973765+0000","last_fullsized":"2023-10-06T03:00:57.973765+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:30:15.966823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.987260+0000","last_change":"2023-10-06T03:00:57.984397+0000","last_active":"2023-10-06T03:00:57.987260+0000","last_peered":"2023-10-06T03:00:57.987260+0000","last_clean":"2023-10-06T03:00:57.987260+0000","last_became_active":"2023-10-06T03:00:57.983080+0000","last_became_peered":"2023-10-06T03:00:57.983080+0000","last_unstale":"2023-10-06T03:00:57.987260+0000","last_undegraded":"2023-10-06T03:00:57.987260+0000","last_fullsized":"2023-10-06T03:00:57.987260+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:14:29.859982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.987973+0000","last_change":"2023-10-06T03:00:57.986460+0000","last_active":"2023-10-06T03:00:57.987973+0000","last_peered":"2023-10-06T03:00:57.987973+0000","last_clean":"2023-10-06T03:00:57.987973+0000","last_became_active":"2023-10-06T03:00:57.985944+0000","last_became_peered":"2023-10-06T03:00:57.985944+0000","last_unstale":"2023-10-06T03:00:57.987973+0000","last_undegraded":"2023-10-06T03:00:57.987973+0000","last_fullsized":"2023-10-06T03:00:57.987973+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:01:21.312056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.962907+0000","last_change":"2023-10-06T03:00:56.986763+0000","last_active":"2023-10-06T03:00:57.962907+0000","last_peered":"2023-10-06T03:00:57.962907+0000","last_clean":"2023-10-06T03:00:57.962907+0000","last_became_active":"2023-10-06T03:00:56.986417+0000","last_became_peered":"2023-10-06T03:00:56.986417+0000","last_unstale":"2023-10-06T03:00:57.962907+0000","last_undegraded":"2023-10-06T03:00:57.962907+0000","last_fullsized":"2023-10-06T03:00:57.962907+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:50:23.531265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.998859+0000","last_change":"2023-10-06T03:00:57.996078+0000","last_active":"2023-10-06T03:00:57.998859+0000","last_peered":"2023-10-06T03:00:57.998859+0000","last_clean":"2023-10-06T03:00:57.998859+0000","last_became_active":"2023-10-06T03:00:57.995672+0000","last_became_peered":"2023-10-06T03:00:57.995672+0000","last_unstale":"2023-10-06T03:00:57.998859+0000","last_undegraded":"2023-10-06T03:00:57.998859+0000","last_fullsized":"2023-10-06T03:00:57.998859+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:18:57.339278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.972357+0000","last_change":"2023-10-06T03:00:56.983097+0000","last_active":"2023-10-06T03:00:57.972357+0000","last_peered":"2023-10-06T03:00:57.972357+0000","last_clean":"2023-10-06T03:00:57.972357+0000","last_became_active":"2023-10-06T03:00:56.982646+0000","last_became_peered":"2023-10-06T03:00:56.982646+0000","last_unstale":"2023-10-06T03:00:57.972357+0000","last_undegraded":"2023-10-06T03:00:57.972357+0000","last_fullsized":"2023-10-06T03:00:57.972357+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:11:31.937336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.978634+0000","last_change":"2023-10-06T03:00:57.976355+0000","last_active":"2023-10-06T03:00:57.978634+0000","last_peered":"2023-10-06T03:00:57.978634+0000","last_clean":"2023-10-06T03:00:57.978634+0000","last_became_active":"2023-10-06T03:00:57.976098+0000","last_became_peered":"2023-10-06T03:00:57.976098+0000","last_unstale":"2023-10-06T03:00:57.978634+0000","last_undegraded":"2023-10-06T03:00:57.978634+0000","last_fullsized":"2023-10-06T03:00:57.978634+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:32:20.183224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:58.017783+0000","last_change":"2023-10-06T03:00:56.979150+0000","last_active":"2023-10-06T03:00:58.017783+0000","last_peered":"2023-10-06T03:00:58.017783+0000","last_clean":"2023-10-06T03:00:58.017783+0000","last_became_active":"2023-10-06T03:00:56.977097+0000","last_became_peered":"2023-10-06T03:00:56.977097+0000","last_unstale":"2023-10-06T03:00:58.017783+0000","last_undegraded":"2023-10-06T03:00:58.017783+0000","last_fullsized":"2023-10-06T03:00:58.017783+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:39:17.918596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.991468+0000","last_change":"2023-10-06T03:00:57.986365+0000","last_active":"2023-10-06T03:00:57.991468+0000","last_peered":"2023-10-06T03:00:57.991468+0000","last_clean":"2023-10-06T03:00:57.991468+0000","last_became_active":"2023-10-06T03:00:57.985862+0000","last_became_peered":"2023-10-06T03:00:57.985862+0000","last_unstale":"2023-10-06T03:00:57.991468+0000","last_undegraded":"2023-10-06T03:00:57.991468+0000","last_fullsized":"2023-10-06T03:00:57.991468+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:32:01.876152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:58.014753+0000","last_change":"2023-10-06T03:00:56.983730+0000","last_active":"2023-10-06T03:00:58.014753+0000","last_peered":"2023-10-06T03:00:58.014753+0000","last_clean":"2023-10-06T03:00:58.014753+0000","last_became_active":"2023-10-06T03:00:56.983403+0000","last_became_peered":"2023-10-06T03:00:56.983403+0000","last_unstale":"2023-10-06T03:00:58.014753+0000","last_undegraded":"2023-10-06T03:00:58.014753+0000","last_fullsized":"2023-10-06T03:00:58.014753+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:50:23.531265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.987780+0000","last_change":"2023-10-06T03:00:57.981050+0000","last_active":"2023-10-06T03:00:57.987780+0000","last_peered":"2023-10-06T03:00:57.987780+0000","last_clean":"2023-10-06T03:00:57.987780+0000","last_became_active":"2023-10-06T03:00:57.980699+0000","last_became_peered":"2023-10-06T03:00:57.980699+0000","last_unstale":"2023-10-06T03:00:57.987780+0000","last_undegraded":"2023-10-06T03:00:57.987780+0000","last_fullsized":"2023-10-06T03:00:57.987780+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:54:01.471407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:58.015580+0000","last_change":"2023-10-06T03:00:56.980374+0000","last_active":"2023-10-06T03:00:58.015580+0000","last_peered":"2023-10-06T03:00:58.015580+0000","last_clean":"2023-10-06T03:00:58.015580+0000","last_became_active":"2023-10-06T03:00:56.980008+0000","last_became_peered":"2023-10-06T03:00:56.980008+0000","last_unstale":"2023-10-06T03:00:58.015580+0000","last_undegraded":"2023-10-06T03:00:58.015580+0000","last_fullsized":"2023-10-06T03:00:58.015580+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:01:20.300193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.987713+0000","last_change":"2023-10-06T03:00:57.981237+0000","last_active":"2023-10-06T03:00:57.987713+0000","last_peered":"2023-10-06T03:00:57.987713+0000","last_clean":"2023-10-06T03:00:57.987713+0000","last_became_active":"2023-10-06T03:00:57.980835+0000","last_became_peered":"2023-10-06T03:00:57.980835+0000","last_unstale":"2023-10-06T03:00:57.987713+0000","last_undegraded":"2023-10-06T03:00:57.987713+0000","last_fullsized":"2023-10-06T03:00:57.987713+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:34:39.099380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:58.015618+0000","last_change":"2023-10-06T03:00:56.982198+0000","last_active":"2023-10-06T03:00:58.015618+0000","last_peered":"2023-10-06T03:00:58.015618+0000","last_clean":"2023-10-06T03:00:58.015618+0000","last_became_active":"2023-10-06T03:00:56.981933+0000","last_became_peered":"2023-10-06T03:00:56.981933+0000","last_unstale":"2023-10-06T03:00:58.015618+0000","last_undegraded":"2023-10-06T03:00:58.015618+0000","last_fullsized":"2023-10-06T03:00:58.015618+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:57:09.321024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.987031+0000","last_change":"2023-10-06T03:00:57.984525+0000","last_active":"2023-10-06T03:00:57.987031+0000","last_peered":"2023-10-06T03:00:57.987031+0000","last_clean":"2023-10-06T03:00:57.987031+0000","last_became_active":"2023-10-06T03:00:57.984205+0000","last_became_peered":"2023-10-06T03:00:57.984205+0000","last_unstale":"2023-10-06T03:00:57.987031+0000","last_undegraded":"2023-10-06T03:00:57.987031+0000","last_fullsized":"2023-10-06T03:00:57.987031+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:28:58.179787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:58.006745+0000","last_change":"2023-10-06T03:00:56.978317+0000","last_active":"2023-10-06T03:00:58.006745+0000","last_peered":"2023-10-06T03:00:58.006745+0000","last_clean":"2023-10-06T03:00:58.006745+0000","last_became_active":"2023-10-06T03:00:56.977802+0000","last_became_peered":"2023-10-06T03:00:56.977802+0000","last_unstale":"2023-10-06T03:00:58.006745+0000","last_undegraded":"2023-10-06T03:00:58.006745+0000","last_fullsized":"2023-10-06T03:00:58.006745+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:04:35.977083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.987755+0000","last_change":"2023-10-06T03:00:57.984100+0000","last_active":"2023-10-06T03:00:57.987755+0000","last_peered":"2023-10-06T03:00:57.987755+0000","last_clean":"2023-10-06T03:00:57.987755+0000","last_became_active":"2023-10-06T03:00:57.983756+0000","last_became_peered":"2023-10-06T03:00:57.983756+0000","last_unstale":"2023-10-06T03:00:57.987755+0000","last_undegraded":"2023-10-06T03:00:57.987755+0000","last_fullsized":"2023-10-06T03:00:57.987755+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:10:20.444330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:58.007461+0000","last_change":"2023-10-06T03:00:56.981315+0000","last_active":"2023-10-06T03:00:58.007461+0000","last_peered":"2023-10-06T03:00:58.007461+0000","last_clean":"2023-10-06T03:00:58.007461+0000","last_became_active":"2023-10-06T03:00:56.980617+0000","last_became_peered":"2023-10-06T03:00:56.980617+0000","last_unstale":"2023-10-06T03:00:58.007461+0000","last_undegraded":"2023-10-06T03:00:58.007461+0000","last_fullsized":"2023-10-06T03:00:58.007461+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:04:35.977083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298132,"kb_used_data":844,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073708,"statfs":{"total":96636764160,"available":96331476992,"internally_reserved":0,"allocated":864256,"data_stored":681439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.147}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.27}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7150000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5660000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.512}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6439999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297524,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074316,"statfs":{"total":96636764160,"available":96332099584,"internally_reserved":0,"allocated":241664,"data_stored":89319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96899999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.343}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4330000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.512}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4850000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.407}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7829999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297532,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074308,"statfs":{"total":96636764160,"available":96332091392,"internally_reserved":0,"allocated":249856,"data_stored":89943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96499999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0940000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.123}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.294}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.272}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297544,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074296,"statfs":{"total":96636764160,"available":96332079104,"internally_reserved":0,"allocated":262144,"data_stored":90911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94099999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.177}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5389999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.026}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0580000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4850000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4259999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301624,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070216,"statfs":{"total":96636764160,"available":96327901184,"internally_reserved":0,"allocated":245760,"data_stored":89409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6619999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.716}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5580000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.333}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301620,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070220,"statfs":{"total":96636764160,"available":96327905280,"internally_reserved":0,"allocated":241664,"data_stored":89319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82399999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0369999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.329}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301620,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070220,"statfs":{"total":96636764160,"available":96327905280,"internally_reserved":0,"allocated":241664,"data_stored":89319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.157}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94399999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0800000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0649999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302204,"kb_used_data":820,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069636,"statfs":{"total":96636764160,"available":96327307264,"internally_reserved":0,"allocated":839680,"data_stored":680241,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93999999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.484}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.831}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4610000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7769999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:01:07.125 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:01:07.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.307+0000 7f492f59e700 1 Processor -- start 2023-10-06T03:01:07.312 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.307+0000 7f492f59e700 1 -- start start 2023-10-06T03:01:07.314 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.307+0000 7f492f59e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f493015f3d0 0x7f49301617b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:07.314 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.307+0000 7f492f59e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f493006b4a0 con 0x7f493006d400 2023-10-06T03:01:07.314 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.307+0000 7f492f59e700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49300af9d0 con 0x7f493006c920 2023-10-06T03:01:07.314 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.307+0000 7f492f59e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f493006a890 con 0x7f493015f3d0 2023-10-06T03:01:07.315 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.311+0000 7f4925d9b700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f493006d400 0x7f493015dcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:45908/0 (socket says 172.21.15.57:45908) 2023-10-06T03:01:07.315 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.311+0000 7f4925d9b700 1 -- 172.21.15.57:0/2946817342 learned_addr learned my addr 172.21.15.57:0/2946817342 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:01:07.315 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.311+0000 7f492ed9d700 1 --2- 172.21.15.57:0/2946817342 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f493015f3d0 0x7f49301617b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:07.316 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.311+0000 7f492dd9b700 1 -- 172.21.15.57:0/2946817342 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3353237720 0 0) 0x7f493006b4a0 con 0x7f493006d400 2023-10-06T03:01:07.316 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.311+0000 7f492dd9b700 1 -- 172.21.15.57:0/2946817342 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4910003570 con 0x7f493006d400 2023-10-06T03:01:07.316 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.311+0000 7f492ed9d700 1 -- 172.21.15.57:0/2946817342 >> v1:172.21.15.105:6789/0 conn(0x7f493006c920 legacy=0x7f493006ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:07.316 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.311+0000 7f492ed9d700 1 -- 172.21.15.57:0/2946817342 >> v1:172.21.15.57:6789/0 conn(0x7f493006d400 legacy=0x7f493015dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:07.316 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.311+0000 7f492ed9d700 1 -- 172.21.15.57:0/2946817342 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f493006ab70 con 0x7f493015f3d0 2023-10-06T03:01:07.316 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.311+0000 7f492ed9d700 1 --2- 172.21.15.57:0/2946817342 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f493015f3d0 0x7f49301617b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f4928009e90 tx=0x7f4928009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=18600cb1b2431c1c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:07.317 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.311+0000 7f492dd9b700 1 -- 172.21.15.57:0/2946817342 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f492800e070 con 0x7f493015f3d0 2023-10-06T03:01:07.317 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.311+0000 7f492dd9b700 1 -- 172.21.15.57:0/2946817342 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f492800bc30 con 0x7f493015f3d0 2023-10-06T03:01:07.317 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.311+0000 7f492dd9b700 1 -- 172.21.15.57:0/2946817342 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4928012430 con 0x7f493015f3d0 2023-10-06T03:01:07.318 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.311+0000 7f492f59e700 1 -- 172.21.15.57:0/2946817342 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f493015f3d0 msgr2=0x7f49301617b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:07.318 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.311+0000 7f492f59e700 1 --2- 172.21.15.57:0/2946817342 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f493015f3d0 0x7f49301617b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f4928009e90 tx=0x7f4928009780 comp rx=0 tx=0).stop 2023-10-06T03:01:07.318 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.311+0000 7f492f59e700 1 -- 172.21.15.57:0/2946817342 shutdown_connections 2023-10-06T03:01:07.318 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.311+0000 7f492f59e700 1 --2- 172.21.15.57:0/2946817342 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f493015f3d0 0x7f49301617b0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:07.319 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.311+0000 7f492f59e700 1 -- 172.21.15.57:0/2946817342 >> 172.21.15.57:0/2946817342 conn(0x7f49300c85e0 msgr2=0x7f49300c89e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:07.319 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.311+0000 7f492f59e700 1 -- 172.21.15.57:0/2946817342 shutdown_connections 2023-10-06T03:01:07.319 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.311+0000 7f492f59e700 1 -- 172.21.15.57:0/2946817342 wait complete. 2023-10-06T03:01:07.321 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.315+0000 7f492f59e700 1 Processor -- start 2023-10-06T03:01:07.322 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.315+0000 7f492f59e700 1 -- start start 2023-10-06T03:01:07.323 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.319+0000 7f492f59e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f493006c920 0x7f493016bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:07.323 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.319+0000 7f492f59e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f493006d400 0x7f4930159c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:07.323 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.319+0000 7f492f59e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f493015f3d0 0x7f493015a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:07.323 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.319+0000 7f492f59e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49300c6660 con 0x7f493015f3d0 2023-10-06T03:01:07.323 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.319+0000 7f492f59e700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49300c6940 con 0x7f493006d400 2023-10-06T03:01:07.323 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.319+0000 7f492f59e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49300c6c20 con 0x7f493006c920 2023-10-06T03:01:07.324 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.319+0000 7f492ed9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f493015f3d0 0x7f493015a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:07.324 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.319+0000 7f492ed9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f493015f3d0 0x7f493015a1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55976/0 (socket says 172.21.15.57:55976) 2023-10-06T03:01:07.324 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.319+0000 7f492ed9d700 1 -- 172.21.15.57:0/1804236051 learned_addr learned my addr 172.21.15.57:0/1804236051 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:07.325 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.319+0000 7f4925d9b700 1 --2- 172.21.15.57:0/1804236051 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f493006d400 0x7f4930159c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:07.325 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.319+0000 7f492e59c700 1 --2- 172.21.15.57:0/1804236051 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f493006c920 0x7f493016bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:07.325 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.319+0000 7f492ed9d700 1 -- 172.21.15.57:0/1804236051 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f493006c920 msgr2=0x7f493016bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:07.325 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.319+0000 7f492ed9d700 1 --2- 172.21.15.57:0/1804236051 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f493006c920 0x7f493016bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:07.325 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.319+0000 7f492ed9d700 1 -- 172.21.15.57:0/1804236051 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f493006d400 msgr2=0x7f4930159c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:07.325 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.319+0000 7f492ed9d700 1 --2- 172.21.15.57:0/1804236051 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f493006d400 0x7f4930159c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:07.325 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.319+0000 7f492ed9d700 1 -- 172.21.15.57:0/1804236051 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4928009a20 con 0x7f493015f3d0 2023-10-06T03:01:07.325 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.319+0000 7f492e59c700 1 --2- 172.21.15.57:0/1804236051 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f493006c920 0x7f493016bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:07.326 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.319+0000 7f492ed9d700 1 --2- 172.21.15.57:0/1804236051 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f493015f3d0 0x7f493015a1b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4928013000 tx=0x7f4928019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:07.326 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.319+0000 7f4926ffd700 1 -- 172.21.15.57:0/1804236051 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4928027470 con 0x7f493015f3d0 2023-10-06T03:01:07.326 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.319+0000 7f4926ffd700 1 -- 172.21.15.57:0/1804236051 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49280275d0 con 0x7f493015f3d0 2023-10-06T03:01:07.327 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.319+0000 7f492f59e700 1 -- 172.21.15.57:0/1804236051 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49300c6f00 con 0x7f493015f3d0 2023-10-06T03:01:07.327 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.319+0000 7f4926ffd700 1 -- 172.21.15.57:0/1804236051 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4928027970 con 0x7f493015f3d0 2023-10-06T03:01:07.327 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.319+0000 7f492f59e700 1 -- 172.21.15.57:0/1804236051 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f493016c240 con 0x7f493015f3d0 2023-10-06T03:01:07.327 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.323+0000 7f492f59e700 1 -- 172.21.15.57:0/1804236051 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f493004be40 con 0x7f493015f3d0 2023-10-06T03:01:07.329 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.323+0000 7f4926ffd700 1 -- 172.21.15.57:0/1804236051 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f4928024070 con 0x7f493015f3d0 2023-10-06T03:01:07.331 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.327+0000 7f4926ffd700 1 --2- 172.21.15.57:0/1804236051 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f4914060550 0x7f4914062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:07.331 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.327+0000 7f4926ffd700 1 -- 172.21.15.57:0/1804236051 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f492807f290 con 0x7f493015f3d0 2023-10-06T03:01:07.332 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.327+0000 7f492e59c700 1 --2- 172.21.15.57:0/1804236051 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f4914060550 0x7f4914062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:07.332 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.327+0000 7f492e59c700 1 --2- 172.21.15.57:0/1804236051 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f4914060550 0x7f4914062a00 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4920007fd0 tx=0x7f4920009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:07.338 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.331+0000 7f4926ffd700 1 -- 172.21.15.57:0/1804236051 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f492804f680 con 0x7f493015f3d0 2023-10-06T03:01:07.501 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.495+0000 7f492f59e700 1 -- 172.21.15.57:0/1804236051 --> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f493006ae50 con 0x7f4914060550 2023-10-06T03:01:07.510 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.503+0000 7f4926ffd700 1 -- 172.21.15.57:0/1804236051 <== mgr.4103 v2:172.21.15.57:6832/32947 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286395 (secure 0 0 0) 0x7f493006ae50 con 0x7f4914060550 2023-10-06T03:01:07.514 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:01:07.517 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.511+0000 7f492f59e700 1 -- 172.21.15.57:0/1804236051 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f4914060550 msgr2=0x7f4914062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:07.517 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.511+0000 7f492f59e700 1 --2- 172.21.15.57:0/1804236051 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f4914060550 0x7f4914062a00 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4920007fd0 tx=0x7f4920009040 comp rx=0 tx=0).stop 2023-10-06T03:01:07.517 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.511+0000 7f492f59e700 1 -- 172.21.15.57:0/1804236051 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f493015f3d0 msgr2=0x7f493015a1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:07.517 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.511+0000 7f492f59e700 1 --2- 172.21.15.57:0/1804236051 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f493015f3d0 0x7f493015a1b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4928013000 tx=0x7f4928019000 comp rx=0 tx=0).stop 2023-10-06T03:01:07.518 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.511+0000 7f492f59e700 1 -- 172.21.15.57:0/1804236051 shutdown_connections 2023-10-06T03:01:07.518 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.511+0000 7f492f59e700 1 --2- 172.21.15.57:0/1804236051 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f493015f3d0 0x7f493015a1b0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:07.518 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.511+0000 7f492f59e700 1 --2- 172.21.15.57:0/1804236051 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f493006d400 0x7f4930159c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:07.518 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.511+0000 7f492f59e700 1 --2- 172.21.15.57:0/1804236051 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f4914060550 0x7f4914062a00 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:07.519 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.511+0000 7f492f59e700 1 --2- 172.21.15.57:0/1804236051 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f493006c920 0x7f493016bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:07.519 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.511+0000 7f492f59e700 1 -- 172.21.15.57:0/1804236051 >> 172.21.15.57:0/1804236051 conn(0x7f49300c85e0 msgr2=0x7f49300c96a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:07.519 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.511+0000 7f492f59e700 1 -- 172.21.15.57:0/1804236051 shutdown_connections 2023-10-06T03:01:07.519 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.511+0000 7f492f59e700 1 -- 172.21.15.57:0/1804236051 wait complete. 2023-10-06T03:01:07.520 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2023-10-06T03:01:07.538 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2023-10-06T03:01:06.275719+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2397800,"kb_used_data":3112,"kb_used_omap":0,"kb_used_meta":2394624,"kb_avail":752576920,"statfs":{"total":773094113280,"available":770638766080,"internally_reserved":0,"allocated":3186688,"data_stored":1899900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2452094976},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.315292"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.991392+0000","last_change":"2023-10-06T03:00:57.980917+0000","last_active":"2023-10-06T03:00:57.991392+0000","last_peered":"2023-10-06T03:00:57.991392+0000","last_clean":"2023-10-06T03:00:57.991392+0000","last_became_active":"2023-10-06T03:00:57.980580+0000","last_became_peered":"2023-10-06T03:00:57.980580+0000","last_unstale":"2023-10-06T03:00:57.991392+0000","last_undegraded":"2023-10-06T03:00:57.991392+0000","last_fullsized":"2023-10-06T03:00:57.991392+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:30:16.978685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.994006+0000","last_change":"2023-10-06T03:00:57.990358+0000","last_active":"2023-10-06T03:00:57.994006+0000","last_peered":"2023-10-06T03:00:57.994006+0000","last_clean":"2023-10-06T03:00:57.994006+0000","last_became_active":"2023-10-06T03:00:57.990144+0000","last_became_peered":"2023-10-06T03:00:57.990144+0000","last_unstale":"2023-10-06T03:00:57.994006+0000","last_undegraded":"2023-10-06T03:00:57.994006+0000","last_fullsized":"2023-10-06T03:00:57.994006+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:32:39.801984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:58.015239+0000","last_change":"2023-10-06T03:00:58.006699+0000","last_active":"2023-10-06T03:00:58.015239+0000","last_peered":"2023-10-06T03:00:58.015239+0000","last_clean":"2023-10-06T03:00:58.015239+0000","last_became_active":"2023-10-06T03:00:58.005294+0000","last_became_peered":"2023-10-06T03:00:58.005294+0000","last_unstale":"2023-10-06T03:00:58.015239+0000","last_undegraded":"2023-10-06T03:00:58.015239+0000","last_fullsized":"2023-10-06T03:00:58.015239+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:35:56.006762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:58.006066+0000","last_change":"2023-10-06T03:00:57.994292+0000","last_active":"2023-10-06T03:00:58.006066+0000","last_peered":"2023-10-06T03:00:58.006066+0000","last_clean":"2023-10-06T03:00:58.006066+0000","last_became_active":"2023-10-06T03:00:57.994021+0000","last_became_peered":"2023-10-06T03:00:57.994021+0000","last_unstale":"2023-10-06T03:00:58.006066+0000","last_undegraded":"2023-10-06T03:00:58.006066+0000","last_fullsized":"2023-10-06T03:00:58.006066+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:04:36.988945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.995901+0000","last_change":"2023-10-06T03:00:57.992614+0000","last_active":"2023-10-06T03:00:57.995901+0000","last_peered":"2023-10-06T03:00:57.995901+0000","last_clean":"2023-10-06T03:00:57.995901+0000","last_became_active":"2023-10-06T03:00:57.992227+0000","last_became_peered":"2023-10-06T03:00:57.992227+0000","last_unstale":"2023-10-06T03:00:57.995901+0000","last_undegraded":"2023-10-06T03:00:57.995901+0000","last_fullsized":"2023-10-06T03:00:57.995901+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:41:47.568218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:58.014887+0000","last_change":"2023-10-06T03:00:58.005433+0000","last_active":"2023-10-06T03:00:58.014887+0000","last_peered":"2023-10-06T03:00:58.014887+0000","last_clean":"2023-10-06T03:00:58.014887+0000","last_became_active":"2023-10-06T03:00:58.005113+0000","last_became_peered":"2023-10-06T03:00:58.005113+0000","last_unstale":"2023-10-06T03:00:58.014887+0000","last_undegraded":"2023-10-06T03:00:58.014887+0000","last_fullsized":"2023-10-06T03:00:58.014887+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:49:14.009330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:58.008519+0000","last_change":"2023-10-06T03:00:57.998785+0000","last_active":"2023-10-06T03:00:58.008519+0000","last_peered":"2023-10-06T03:00:58.008519+0000","last_clean":"2023-10-06T03:00:58.008519+0000","last_became_active":"2023-10-06T03:00:57.997865+0000","last_became_peered":"2023-10-06T03:00:57.997865+0000","last_unstale":"2023-10-06T03:00:58.008519+0000","last_undegraded":"2023-10-06T03:00:58.008519+0000","last_fullsized":"2023-10-06T03:00:58.008519+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:32:39.801984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.993783+0000","last_change":"2023-10-06T03:00:57.985816+0000","last_active":"2023-10-06T03:00:57.993783+0000","last_peered":"2023-10-06T03:00:57.993783+0000","last_clean":"2023-10-06T03:00:57.993783+0000","last_became_active":"2023-10-06T03:00:57.985504+0000","last_became_peered":"2023-10-06T03:00:57.985504+0000","last_unstale":"2023-10-06T03:00:57.993783+0000","last_undegraded":"2023-10-06T03:00:57.993783+0000","last_fullsized":"2023-10-06T03:00:57.993783+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:12:21.523918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.995855+0000","last_change":"2023-10-06T03:00:57.991750+0000","last_active":"2023-10-06T03:00:57.995855+0000","last_peered":"2023-10-06T03:00:57.995855+0000","last_clean":"2023-10-06T03:00:57.995855+0000","last_became_active":"2023-10-06T03:00:57.991271+0000","last_became_peered":"2023-10-06T03:00:57.991271+0000","last_unstale":"2023-10-06T03:00:57.995855+0000","last_undegraded":"2023-10-06T03:00:57.995855+0000","last_fullsized":"2023-10-06T03:00:57.995855+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:32:20.183224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:58.001086+0000","last_change":"2023-10-06T03:00:57.997031+0000","last_active":"2023-10-06T03:00:58.001086+0000","last_peered":"2023-10-06T03:00:58.001086+0000","last_clean":"2023-10-06T03:00:58.001086+0000","last_became_active":"2023-10-06T03:00:57.996675+0000","last_became_peered":"2023-10-06T03:00:57.996675+0000","last_unstale":"2023-10-06T03:00:58.001086+0000","last_undegraded":"2023-10-06T03:00:58.001086+0000","last_fullsized":"2023-10-06T03:00:58.001086+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:49:14.009330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.984784+0000","last_change":"2023-10-06T03:00:57.978095+0000","last_active":"2023-10-06T03:00:57.984784+0000","last_peered":"2023-10-06T03:00:57.984784+0000","last_clean":"2023-10-06T03:00:57.984784+0000","last_became_active":"2023-10-06T03:00:57.977627+0000","last_became_peered":"2023-10-06T03:00:57.977627+0000","last_unstale":"2023-10-06T03:00:57.984784+0000","last_undegraded":"2023-10-06T03:00:57.984784+0000","last_fullsized":"2023-10-06T03:00:57.984784+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:41:47.568218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.991445+0000","last_change":"2023-10-06T03:00:57.981822+0000","last_active":"2023-10-06T03:00:57.991445+0000","last_peered":"2023-10-06T03:00:57.991445+0000","last_clean":"2023-10-06T03:00:57.991445+0000","last_became_active":"2023-10-06T03:00:57.981246+0000","last_became_peered":"2023-10-06T03:00:57.981246+0000","last_unstale":"2023-10-06T03:00:57.991445+0000","last_undegraded":"2023-10-06T03:00:57.991445+0000","last_fullsized":"2023-10-06T03:00:57.991445+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:11:32.949199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.987651+0000","last_change":"2023-10-06T03:00:57.979093+0000","last_active":"2023-10-06T03:00:57.987651+0000","last_peered":"2023-10-06T03:00:57.987651+0000","last_clean":"2023-10-06T03:00:57.987651+0000","last_became_active":"2023-10-06T03:00:57.978790+0000","last_became_peered":"2023-10-06T03:00:57.978790+0000","last_unstale":"2023-10-06T03:00:57.987651+0000","last_undegraded":"2023-10-06T03:00:57.987651+0000","last_fullsized":"2023-10-06T03:00:57.987651+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:04:36.988945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.996721+0000","last_change":"2023-10-06T03:00:57.992778+0000","last_active":"2023-10-06T03:00:57.996721+0000","last_peered":"2023-10-06T03:00:57.996721+0000","last_clean":"2023-10-06T03:00:57.996721+0000","last_became_active":"2023-10-06T03:00:57.992484+0000","last_became_peered":"2023-10-06T03:00:57.992484+0000","last_unstale":"2023-10-06T03:00:57.996721+0000","last_undegraded":"2023-10-06T03:00:57.996721+0000","last_fullsized":"2023-10-06T03:00:57.996721+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:32:20.183224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:58.008543+0000","last_change":"2023-10-06T03:00:57.999320+0000","last_active":"2023-10-06T03:00:58.008543+0000","last_peered":"2023-10-06T03:00:58.008543+0000","last_clean":"2023-10-06T03:00:58.008543+0000","last_became_active":"2023-10-06T03:00:57.998455+0000","last_became_peered":"2023-10-06T03:00:57.998455+0000","last_unstale":"2023-10-06T03:00:58.008543+0000","last_undegraded":"2023-10-06T03:00:58.008543+0000","last_fullsized":"2023-10-06T03:00:58.008543+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:14:29.859982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:58.015064+0000","last_change":"2023-10-06T03:00:58.005775+0000","last_active":"2023-10-06T03:00:58.015064+0000","last_peered":"2023-10-06T03:00:58.015064+0000","last_clean":"2023-10-06T03:00:58.015064+0000","last_became_active":"2023-10-06T03:00:58.005474+0000","last_became_peered":"2023-10-06T03:00:58.005474+0000","last_unstale":"2023-10-06T03:00:58.015064+0000","last_undegraded":"2023-10-06T03:00:58.015064+0000","last_fullsized":"2023-10-06T03:00:58.015064+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:28:58.179787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.996062+0000","last_change":"2023-10-06T03:00:57.993441+0000","last_active":"2023-10-06T03:00:57.996062+0000","last_peered":"2023-10-06T03:00:57.996062+0000","last_clean":"2023-10-06T03:00:57.996062+0000","last_became_active":"2023-10-06T03:00:57.993145+0000","last_became_peered":"2023-10-06T03:00:57.993145+0000","last_unstale":"2023-10-06T03:00:57.996062+0000","last_undegraded":"2023-10-06T03:00:57.996062+0000","last_fullsized":"2023-10-06T03:00:57.996062+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:49:14.009330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:58.010511+0000","last_change":"2023-10-06T03:00:57.989141+0000","last_active":"2023-10-06T03:00:58.010511+0000","last_peered":"2023-10-06T03:00:58.010511+0000","last_clean":"2023-10-06T03:00:58.010511+0000","last_became_active":"2023-10-06T03:00:57.988752+0000","last_became_peered":"2023-10-06T03:00:57.988752+0000","last_unstale":"2023-10-06T03:00:58.010511+0000","last_undegraded":"2023-10-06T03:00:58.010511+0000","last_fullsized":"2023-10-06T03:00:58.010511+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:48:42.435907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.991593+0000","last_change":"2023-10-06T03:00:57.982128+0000","last_active":"2023-10-06T03:00:57.991593+0000","last_peered":"2023-10-06T03:00:57.991593+0000","last_clean":"2023-10-06T03:00:57.991593+0000","last_became_active":"2023-10-06T03:00:57.981762+0000","last_became_peered":"2023-10-06T03:00:57.981762+0000","last_unstale":"2023-10-06T03:00:57.991593+0000","last_undegraded":"2023-10-06T03:00:57.991593+0000","last_fullsized":"2023-10-06T03:00:57.991593+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:50:24.543128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.986900+0000","last_change":"2023-10-06T03:00:57.980179+0000","last_active":"2023-10-06T03:00:57.986900+0000","last_peered":"2023-10-06T03:00:57.986900+0000","last_clean":"2023-10-06T03:00:57.986900+0000","last_became_active":"2023-10-06T03:00:57.979822+0000","last_became_peered":"2023-10-06T03:00:57.979822+0000","last_unstale":"2023-10-06T03:00:57.986900+0000","last_undegraded":"2023-10-06T03:00:57.986900+0000","last_fullsized":"2023-10-06T03:00:57.986900+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:56:45.815718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.991824+0000","last_change":"2023-10-06T03:00:57.987885+0000","last_active":"2023-10-06T03:00:57.991824+0000","last_peered":"2023-10-06T03:00:57.991824+0000","last_clean":"2023-10-06T03:00:57.991824+0000","last_became_active":"2023-10-06T03:00:57.987306+0000","last_became_peered":"2023-10-06T03:00:57.987306+0000","last_unstale":"2023-10-06T03:00:57.991824+0000","last_undegraded":"2023-10-06T03:00:57.991824+0000","last_fullsized":"2023-10-06T03:00:57.991824+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:16:06.528696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.999698+0000","last_change":"2023-10-06T03:00:57.997306+0000","last_active":"2023-10-06T03:00:57.999698+0000","last_peered":"2023-10-06T03:00:57.999698+0000","last_clean":"2023-10-06T03:00:57.999698+0000","last_became_active":"2023-10-06T03:00:57.996969+0000","last_became_peered":"2023-10-06T03:00:57.996969+0000","last_unstale":"2023-10-06T03:00:57.999698+0000","last_undegraded":"2023-10-06T03:00:57.999698+0000","last_fullsized":"2023-10-06T03:00:57.999698+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:12:21.523918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:58.002300+0000","last_change":"2023-10-06T03:00:57.997342+0000","last_active":"2023-10-06T03:00:58.002300+0000","last_peered":"2023-10-06T03:00:58.002300+0000","last_clean":"2023-10-06T03:00:58.002300+0000","last_became_active":"2023-10-06T03:00:57.996950+0000","last_became_peered":"2023-10-06T03:00:57.996950+0000","last_unstale":"2023-10-06T03:00:58.002300+0000","last_undegraded":"2023-10-06T03:00:58.002300+0000","last_fullsized":"2023-10-06T03:00:58.002300+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:54:01.471407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:58.008023+0000","last_change":"2023-10-06T03:00:57.997946+0000","last_active":"2023-10-06T03:00:58.008023+0000","last_peered":"2023-10-06T03:00:58.008023+0000","last_clean":"2023-10-06T03:00:58.008023+0000","last_became_active":"2023-10-06T03:00:57.997600+0000","last_became_peered":"2023-10-06T03:00:57.997600+0000","last_unstale":"2023-10-06T03:00:58.008023+0000","last_undegraded":"2023-10-06T03:00:58.008023+0000","last_fullsized":"2023-10-06T03:00:58.008023+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:12:21.523918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.994959+0000","last_change":"2023-10-06T03:00:57.989508+0000","last_active":"2023-10-06T03:00:57.994959+0000","last_peered":"2023-10-06T03:00:57.994959+0000","last_clean":"2023-10-06T03:00:57.994959+0000","last_became_active":"2023-10-06T03:00:57.989023+0000","last_became_peered":"2023-10-06T03:00:57.989023+0000","last_unstale":"2023-10-06T03:00:57.994959+0000","last_undegraded":"2023-10-06T03:00:57.994959+0000","last_fullsized":"2023-10-06T03:00:57.994959+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:14:29.859982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.994243+0000","last_change":"2023-10-06T03:00:57.987485+0000","last_active":"2023-10-06T03:00:57.994243+0000","last_peered":"2023-10-06T03:00:57.994243+0000","last_clean":"2023-10-06T03:00:57.994243+0000","last_became_active":"2023-10-06T03:00:57.983554+0000","last_became_peered":"2023-10-06T03:00:57.983554+0000","last_unstale":"2023-10-06T03:00:57.994243+0000","last_undegraded":"2023-10-06T03:00:57.994243+0000","last_fullsized":"2023-10-06T03:00:57.994243+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:18:57.339278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:58.006377+0000","last_change":"2023-10-06T03:00:58.003002+0000","last_active":"2023-10-06T03:00:58.006377+0000","last_peered":"2023-10-06T03:00:58.006377+0000","last_clean":"2023-10-06T03:00:58.006377+0000","last_became_active":"2023-10-06T03:00:58.002705+0000","last_became_peered":"2023-10-06T03:00:58.002705+0000","last_unstale":"2023-10-06T03:00:58.006377+0000","last_undegraded":"2023-10-06T03:00:58.006377+0000","last_fullsized":"2023-10-06T03:00:58.006377+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:14:29.859982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.994965+0000","last_change":"2023-10-06T03:00:57.991310+0000","last_active":"2023-10-06T03:00:57.994965+0000","last_peered":"2023-10-06T03:00:57.994965+0000","last_clean":"2023-10-06T03:00:57.994965+0000","last_became_active":"2023-10-06T03:00:57.990221+0000","last_became_peered":"2023-10-06T03:00:57.990221+0000","last_unstale":"2023-10-06T03:00:57.994965+0000","last_undegraded":"2023-10-06T03:00:57.994965+0000","last_fullsized":"2023-10-06T03:00:57.994965+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:39:00.112932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.995764+0000","last_change":"2023-10-06T03:00:57.991930+0000","last_active":"2023-10-06T03:00:57.995764+0000","last_peered":"2023-10-06T03:00:57.995764+0000","last_clean":"2023-10-06T03:00:57.995764+0000","last_became_active":"2023-10-06T03:00:57.991329+0000","last_became_peered":"2023-10-06T03:00:57.991329+0000","last_unstale":"2023-10-06T03:00:57.995764+0000","last_undegraded":"2023-10-06T03:00:57.995764+0000","last_fullsized":"2023-10-06T03:00:57.995764+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:10:20.444330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.989838+0000","last_change":"2023-10-06T03:00:57.985010+0000","last_active":"2023-10-06T03:00:57.989838+0000","last_peered":"2023-10-06T03:00:57.989838+0000","last_clean":"2023-10-06T03:00:57.989838+0000","last_became_active":"2023-10-06T03:00:57.983945+0000","last_became_peered":"2023-10-06T03:00:57.983945+0000","last_unstale":"2023-10-06T03:00:57.989838+0000","last_undegraded":"2023-10-06T03:00:57.989838+0000","last_fullsized":"2023-10-06T03:00:57.989838+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:16:07.773169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.978641+0000","last_change":"2023-10-06T03:00:57.976726+0000","last_active":"2023-10-06T03:00:57.978641+0000","last_peered":"2023-10-06T03:00:57.978641+0000","last_clean":"2023-10-06T03:00:57.978641+0000","last_became_active":"2023-10-06T03:00:57.976367+0000","last_became_peered":"2023-10-06T03:00:57.976367+0000","last_unstale":"2023-10-06T03:00:57.978641+0000","last_undegraded":"2023-10-06T03:00:57.978641+0000","last_fullsized":"2023-10-06T03:00:57.978641+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:49:14.009330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.997016+0000","last_change":"2023-10-06T03:00:57.992161+0000","last_active":"2023-10-06T03:00:57.997016+0000","last_peered":"2023-10-06T03:00:57.997016+0000","last_clean":"2023-10-06T03:00:57.997016+0000","last_became_active":"2023-10-06T03:00:57.991886+0000","last_became_peered":"2023-10-06T03:00:57.991886+0000","last_unstale":"2023-10-06T03:00:57.997016+0000","last_undegraded":"2023-10-06T03:00:57.997016+0000","last_fullsized":"2023-10-06T03:00:57.997016+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:57:10.332887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.987129+0000","last_change":"2023-10-06T03:00:57.984047+0000","last_active":"2023-10-06T03:00:57.987129+0000","last_peered":"2023-10-06T03:00:57.987129+0000","last_clean":"2023-10-06T03:00:57.987129+0000","last_became_active":"2023-10-06T03:00:57.983670+0000","last_became_peered":"2023-10-06T03:00:57.983670+0000","last_unstale":"2023-10-06T03:00:57.987129+0000","last_undegraded":"2023-10-06T03:00:57.987129+0000","last_fullsized":"2023-10-06T03:00:57.987129+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:12:21.523918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:58.015608+0000","last_change":"2023-10-06T03:00:56.987376+0000","last_active":"2023-10-06T03:00:58.015608+0000","last_peered":"2023-10-06T03:00:58.015608+0000","last_clean":"2023-10-06T03:00:58.015608+0000","last_became_active":"2023-10-06T03:00:56.986953+0000","last_became_peered":"2023-10-06T03:00:56.986953+0000","last_unstale":"2023-10-06T03:00:58.015608+0000","last_undegraded":"2023-10-06T03:00:58.015608+0000","last_fullsized":"2023-10-06T03:00:58.015608+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:39:00.208565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:58.003097+0000","last_change":"2023-10-06T03:00:57.998904+0000","last_active":"2023-10-06T03:00:58.003097+0000","last_peered":"2023-10-06T03:00:58.003097+0000","last_clean":"2023-10-06T03:00:58.003097+0000","last_became_active":"2023-10-06T03:00:57.998631+0000","last_became_peered":"2023-10-06T03:00:57.998631+0000","last_unstale":"2023-10-06T03:00:58.003097+0000","last_undegraded":"2023-10-06T03:00:58.003097+0000","last_fullsized":"2023-10-06T03:00:58.003097+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:41:47.568218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.976447+0000","last_change":"2023-10-06T03:00:56.977003+0000","last_active":"2023-10-06T03:00:57.976447+0000","last_peered":"2023-10-06T03:00:57.976447+0000","last_clean":"2023-10-06T03:00:57.976447+0000","last_became_active":"2023-10-06T03:00:56.976668+0000","last_became_peered":"2023-10-06T03:00:56.976668+0000","last_unstale":"2023-10-06T03:00:57.976447+0000","last_undegraded":"2023-10-06T03:00:57.976447+0000","last_fullsized":"2023-10-06T03:00:57.976447+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:08:59.306830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.998716+0000","last_change":"2023-10-06T03:00:57.995079+0000","last_active":"2023-10-06T03:00:57.998716+0000","last_peered":"2023-10-06T03:00:57.998716+0000","last_clean":"2023-10-06T03:00:57.998716+0000","last_became_active":"2023-10-06T03:00:57.994813+0000","last_became_peered":"2023-10-06T03:00:57.994813+0000","last_unstale":"2023-10-06T03:00:57.998716+0000","last_undegraded":"2023-10-06T03:00:57.998716+0000","last_fullsized":"2023-10-06T03:00:57.998716+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:28:58.179787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.979475+0000","last_change":"2023-10-06T03:00:56.987263+0000","last_active":"2023-10-06T03:00:57.979475+0000","last_peered":"2023-10-06T03:00:57.979475+0000","last_clean":"2023-10-06T03:00:57.979475+0000","last_became_active":"2023-10-06T03:00:56.986927+0000","last_became_peered":"2023-10-06T03:00:56.986927+0000","last_unstale":"2023-10-06T03:00:57.979475+0000","last_undegraded":"2023-10-06T03:00:57.979475+0000","last_fullsized":"2023-10-06T03:00:57.979475+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:01:20.300193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.988672+0000","last_change":"2023-10-06T03:00:57.985729+0000","last_active":"2023-10-06T03:00:57.988672+0000","last_peered":"2023-10-06T03:00:57.988672+0000","last_clean":"2023-10-06T03:00:57.988672+0000","last_became_active":"2023-10-06T03:00:57.985148+0000","last_became_peered":"2023-10-06T03:00:57.985148+0000","last_unstale":"2023-10-06T03:00:57.988672+0000","last_undegraded":"2023-10-06T03:00:57.988672+0000","last_fullsized":"2023-10-06T03:00:57.988672+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:01:50.001484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:58.017678+0000","last_change":"2023-10-06T03:00:56.981696+0000","last_active":"2023-10-06T03:00:58.017678+0000","last_peered":"2023-10-06T03:00:58.017678+0000","last_clean":"2023-10-06T03:00:58.017678+0000","last_became_active":"2023-10-06T03:00:56.981358+0000","last_became_peered":"2023-10-06T03:00:56.981358+0000","last_unstale":"2023-10-06T03:00:58.017678+0000","last_undegraded":"2023-10-06T03:00:58.017678+0000","last_fullsized":"2023-10-06T03:00:58.017678+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:39:17.918596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:58.015903+0000","last_change":"2023-10-06T03:00:56.987266+0000","last_active":"2023-10-06T03:00:58.015903+0000","last_peered":"2023-10-06T03:00:58.015903+0000","last_clean":"2023-10-06T03:00:58.015903+0000","last_became_active":"2023-10-06T03:00:56.986946+0000","last_became_peered":"2023-10-06T03:00:56.986946+0000","last_unstale":"2023-10-06T03:00:58.015903+0000","last_undegraded":"2023-10-06T03:00:58.015903+0000","last_fullsized":"2023-10-06T03:00:58.015903+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:34:15.780752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:58.002688+0000","last_change":"2023-10-06T03:00:57.999452+0000","last_active":"2023-10-06T03:00:58.002688+0000","last_peered":"2023-10-06T03:00:58.002688+0000","last_clean":"2023-10-06T03:00:58.002688+0000","last_became_active":"2023-10-06T03:00:57.999164+0000","last_became_peered":"2023-10-06T03:00:57.999164+0000","last_unstale":"2023-10-06T03:00:58.002688+0000","last_undegraded":"2023-10-06T03:00:58.002688+0000","last_fullsized":"2023-10-06T03:00:58.002688+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:28:58.179787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:58.015419+0000","last_change":"2023-10-06T03:00:56.987382+0000","last_active":"2023-10-06T03:00:58.015419+0000","last_peered":"2023-10-06T03:00:58.015419+0000","last_clean":"2023-10-06T03:00:58.015419+0000","last_became_active":"2023-10-06T03:00:56.987056+0000","last_became_peered":"2023-10-06T03:00:56.987056+0000","last_unstale":"2023-10-06T03:00:58.015419+0000","last_undegraded":"2023-10-06T03:00:58.015419+0000","last_fullsized":"2023-10-06T03:00:58.015419+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:57:09.321024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.983609+0000","last_change":"2023-10-06T03:00:57.975126+0000","last_active":"2023-10-06T03:00:57.983609+0000","last_peered":"2023-10-06T03:00:57.983609+0000","last_clean":"2023-10-06T03:00:57.983609+0000","last_became_active":"2023-10-06T03:00:57.974673+0000","last_became_peered":"2023-10-06T03:00:57.974673+0000","last_unstale":"2023-10-06T03:00:57.983609+0000","last_undegraded":"2023-10-06T03:00:57.983609+0000","last_fullsized":"2023-10-06T03:00:57.983609+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:12:21.523918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:58.012700+0000","last_change":"2023-10-06T03:00:56.976910+0000","last_active":"2023-10-06T03:00:58.012700+0000","last_peered":"2023-10-06T03:00:58.012700+0000","last_clean":"2023-10-06T03:00:58.012700+0000","last_became_active":"2023-10-06T03:00:56.976555+0000","last_became_peered":"2023-10-06T03:00:56.976555+0000","last_unstale":"2023-10-06T03:00:58.012700+0000","last_undegraded":"2023-10-06T03:00:58.012700+0000","last_fullsized":"2023-10-06T03:00:58.012700+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:27:56.469909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:58.007053+0000","last_change":"2023-10-06T03:00:58.004875+0000","last_active":"2023-10-06T03:00:58.007053+0000","last_peered":"2023-10-06T03:00:58.007053+0000","last_clean":"2023-10-06T03:00:58.007053+0000","last_became_active":"2023-10-06T03:00:57.997479+0000","last_became_peered":"2023-10-06T03:00:57.997479+0000","last_unstale":"2023-10-06T03:00:58.007053+0000","last_undegraded":"2023-10-06T03:00:58.007053+0000","last_fullsized":"2023-10-06T03:00:58.007053+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:39:01.220427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.972697+0000","last_change":"2023-10-06T03:00:56.979202+0000","last_active":"2023-10-06T03:00:57.972697+0000","last_peered":"2023-10-06T03:00:57.972697+0000","last_clean":"2023-10-06T03:00:57.972697+0000","last_became_active":"2023-10-06T03:00:56.978922+0000","last_became_peered":"2023-10-06T03:00:56.978922+0000","last_unstale":"2023-10-06T03:00:57.972697+0000","last_undegraded":"2023-10-06T03:00:57.972697+0000","last_fullsized":"2023-10-06T03:00:57.972697+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:04:35.977083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:58.001441+0000","last_change":"2023-10-06T03:00:57.998369+0000","last_active":"2023-10-06T03:00:58.001441+0000","last_peered":"2023-10-06T03:00:58.001441+0000","last_clean":"2023-10-06T03:00:58.001441+0000","last_became_active":"2023-10-06T03:00:57.997963+0000","last_became_peered":"2023-10-06T03:00:57.997963+0000","last_unstale":"2023-10-06T03:00:58.001441+0000","last_undegraded":"2023-10-06T03:00:58.001441+0000","last_fullsized":"2023-10-06T03:00:58.001441+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:32:39.801984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:58.005626+0000","last_change":"2023-10-06T03:00:56.986683+0000","last_active":"2023-10-06T03:00:58.005626+0000","last_peered":"2023-10-06T03:00:58.005626+0000","last_clean":"2023-10-06T03:00:58.005626+0000","last_became_active":"2023-10-06T03:00:56.986329+0000","last_became_peered":"2023-10-06T03:00:56.986329+0000","last_unstale":"2023-10-06T03:00:58.005626+0000","last_undegraded":"2023-10-06T03:00:58.005626+0000","last_fullsized":"2023-10-06T03:00:58.005626+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:41:07.693426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.987686+0000","last_change":"2023-10-06T03:00:57.981948+0000","last_active":"2023-10-06T03:00:57.987686+0000","last_peered":"2023-10-06T03:00:57.987686+0000","last_clean":"2023-10-06T03:00:57.987686+0000","last_became_active":"2023-10-06T03:00:57.980831+0000","last_became_peered":"2023-10-06T03:00:57.980831+0000","last_unstale":"2023-10-06T03:00:57.987686+0000","last_undegraded":"2023-10-06T03:00:57.987686+0000","last_fullsized":"2023-10-06T03:00:57.987686+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:05:44.036671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.978045+0000","last_change":"2023-10-06T03:00:56.981077+0000","last_active":"2023-10-06T03:00:57.978045+0000","last_peered":"2023-10-06T03:00:57.978045+0000","last_clean":"2023-10-06T03:00:57.978045+0000","last_became_active":"2023-10-06T03:00:56.980777+0000","last_became_peered":"2023-10-06T03:00:56.980777+0000","last_unstale":"2023-10-06T03:00:57.978045+0000","last_undegraded":"2023-10-06T03:00:57.978045+0000","last_fullsized":"2023-10-06T03:00:57.978045+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:41:33.554972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.990713+0000","last_change":"2023-10-06T03:00:57.984615+0000","last_active":"2023-10-06T03:00:57.990713+0000","last_peered":"2023-10-06T03:00:57.990713+0000","last_clean":"2023-10-06T03:00:57.990713+0000","last_became_active":"2023-10-06T03:00:57.984307+0000","last_became_peered":"2023-10-06T03:00:57.984307+0000","last_unstale":"2023-10-06T03:00:57.990713+0000","last_undegraded":"2023-10-06T03:00:57.990713+0000","last_fullsized":"2023-10-06T03:00:57.990713+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:35.377456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.965350+0000","last_change":"2023-10-06T03:00:56.987414+0000","last_active":"2023-10-06T03:00:57.965350+0000","last_peered":"2023-10-06T03:00:57.965350+0000","last_clean":"2023-10-06T03:00:57.965350+0000","last_became_active":"2023-10-06T03:00:56.987085+0000","last_became_peered":"2023-10-06T03:00:56.987085+0000","last_unstale":"2023-10-06T03:00:57.965350+0000","last_undegraded":"2023-10-06T03:00:57.965350+0000","last_fullsized":"2023-10-06T03:00:57.965350+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:04:31.750536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.987708+0000","last_change":"2023-10-06T03:00:57.984185+0000","last_active":"2023-10-06T03:00:57.987708+0000","last_peered":"2023-10-06T03:00:57.987708+0000","last_clean":"2023-10-06T03:00:57.987708+0000","last_became_active":"2023-10-06T03:00:57.983849+0000","last_became_peered":"2023-10-06T03:00:57.983849+0000","last_unstale":"2023-10-06T03:00:57.987708+0000","last_undegraded":"2023-10-06T03:00:57.987708+0000","last_fullsized":"2023-10-06T03:00:57.987708+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:32:39.801984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.963112+0000","last_change":"2023-10-06T03:00:56.985582+0000","last_active":"2023-10-06T03:00:57.963112+0000","last_peered":"2023-10-06T03:00:57.963112+0000","last_clean":"2023-10-06T03:00:57.963112+0000","last_became_active":"2023-10-06T03:00:56.985254+0000","last_became_peered":"2023-10-06T03:00:56.985254+0000","last_unstale":"2023-10-06T03:00:57.963112+0000","last_undegraded":"2023-10-06T03:00:57.963112+0000","last_fullsized":"2023-10-06T03:00:57.963112+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:08:59.306830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.990886+0000","last_change":"2023-10-06T03:00:57.975691+0000","last_active":"2023-10-06T03:00:57.990886+0000","last_peered":"2023-10-06T03:00:57.990886+0000","last_clean":"2023-10-06T03:00:57.990886+0000","last_became_active":"2023-10-06T03:00:57.975368+0000","last_became_peered":"2023-10-06T03:00:57.975368+0000","last_unstale":"2023-10-06T03:00:57.990886+0000","last_undegraded":"2023-10-06T03:00:57.990886+0000","last_fullsized":"2023-10-06T03:00:57.990886+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:12:21.523918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":166,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.980333+0000","last_change":"2023-10-06T03:00:45.709165+0000","last_active":"2023-10-06T03:00:57.980333+0000","last_peered":"2023-10-06T03:00:57.980333+0000","last_clean":"2023-10-06T03:00:57.980333+0000","last_became_active":"2023-10-06T03:00:45.707771+0000","last_became_peered":"2023-10-06T03:00:45.707771+0000","last_unstale":"2023-10-06T03:00:57.980333+0000","last_undegraded":"2023-10-06T03:00:57.980333+0000","last_fullsized":"2023-10-06T03:00:57.980333+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:44.625353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:44.625353+0000","last_clean_scrub_stamp":"2023-10-06T03:00:44.625353+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:31:31.774239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.972547+0000","last_change":"2023-10-06T03:00:51.905381+0000","last_active":"2023-10-06T03:00:57.972547+0000","last_peered":"2023-10-06T03:00:57.972547+0000","last_clean":"2023-10-06T03:00:57.972547+0000","last_became_active":"2023-10-06T03:00:51.904974+0000","last_became_peered":"2023-10-06T03:00:51.904974+0000","last_unstale":"2023-10-06T03:00:57.972547+0000","last_undegraded":"2023-10-06T03:00:57.972547+0000","last_fullsized":"2023-10-06T03:00:57.972547+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:15:19.182956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.961981+0000","last_change":"2023-10-06T03:00:56.977217+0000","last_active":"2023-10-06T03:00:57.961981+0000","last_peered":"2023-10-06T03:00:57.961981+0000","last_clean":"2023-10-06T03:00:57.961981+0000","last_became_active":"2023-10-06T03:00:56.976798+0000","last_became_peered":"2023-10-06T03:00:56.976798+0000","last_unstale":"2023-10-06T03:00:57.961981+0000","last_undegraded":"2023-10-06T03:00:57.961981+0000","last_fullsized":"2023-10-06T03:00:57.961981+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:11:31.937336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.985658+0000","last_change":"2023-10-06T03:00:57.979627+0000","last_active":"2023-10-06T03:00:57.985658+0000","last_peered":"2023-10-06T03:00:57.985658+0000","last_clean":"2023-10-06T03:00:57.985658+0000","last_became_active":"2023-10-06T03:00:57.979346+0000","last_became_peered":"2023-10-06T03:00:57.979346+0000","last_unstale":"2023-10-06T03:00:57.985658+0000","last_undegraded":"2023-10-06T03:00:57.985658+0000","last_fullsized":"2023-10-06T03:00:57.985658+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:34:16.792615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.980248+0000","last_change":"2023-10-06T03:00:51.906480+0000","last_active":"2023-10-06T03:00:57.980248+0000","last_peered":"2023-10-06T03:00:57.980248+0000","last_clean":"2023-10-06T03:00:57.980248+0000","last_became_active":"2023-10-06T03:00:51.905956+0000","last_became_peered":"2023-10-06T03:00:51.905956+0000","last_unstale":"2023-10-06T03:00:57.980248+0000","last_undegraded":"2023-10-06T03:00:57.980248+0000","last_fullsized":"2023-10-06T03:00:57.980248+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:15:19.182956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.977891+0000","last_change":"2023-10-06T03:00:56.977514+0000","last_active":"2023-10-06T03:00:57.977891+0000","last_peered":"2023-10-06T03:00:57.977891+0000","last_clean":"2023-10-06T03:00:57.977891+0000","last_became_active":"2023-10-06T03:00:56.977108+0000","last_became_peered":"2023-10-06T03:00:56.977108+0000","last_unstale":"2023-10-06T03:00:57.977891+0000","last_undegraded":"2023-10-06T03:00:57.977891+0000","last_fullsized":"2023-10-06T03:00:57.977891+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:11:31.937336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.999714+0000","last_change":"2023-10-06T03:00:57.997236+0000","last_active":"2023-10-06T03:00:57.999714+0000","last_peered":"2023-10-06T03:00:57.999714+0000","last_clean":"2023-10-06T03:00:57.999714+0000","last_became_active":"2023-10-06T03:00:57.996915+0000","last_became_peered":"2023-10-06T03:00:57.996915+0000","last_unstale":"2023-10-06T03:00:57.999714+0000","last_undegraded":"2023-10-06T03:00:57.999714+0000","last_fullsized":"2023-10-06T03:00:57.999714+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:16:06.528696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.975713+0000","last_change":"2023-10-06T03:00:51.902453+0000","last_active":"2023-10-06T03:00:57.975713+0000","last_peered":"2023-10-06T03:00:57.975713+0000","last_clean":"2023-10-06T03:00:57.975713+0000","last_became_active":"2023-10-06T03:00:51.901948+0000","last_became_peered":"2023-10-06T03:00:51.901948+0000","last_unstale":"2023-10-06T03:00:57.975713+0000","last_undegraded":"2023-10-06T03:00:57.975713+0000","last_fullsized":"2023-10-06T03:00:57.975713+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:13:30.721650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.971727+0000","last_change":"2023-10-06T03:00:56.986609+0000","last_active":"2023-10-06T03:00:57.971727+0000","last_peered":"2023-10-06T03:00:57.971727+0000","last_clean":"2023-10-06T03:00:57.971727+0000","last_became_active":"2023-10-06T03:00:56.986325+0000","last_became_peered":"2023-10-06T03:00:56.986325+0000","last_unstale":"2023-10-06T03:00:57.971727+0000","last_undegraded":"2023-10-06T03:00:57.971727+0000","last_fullsized":"2023-10-06T03:00:57.971727+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:50:23.531265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.994542+0000","last_change":"2023-10-06T03:00:57.987932+0000","last_active":"2023-10-06T03:00:57.994542+0000","last_peered":"2023-10-06T03:00:57.994542+0000","last_clean":"2023-10-06T03:00:57.994542+0000","last_became_active":"2023-10-06T03:00:57.982542+0000","last_became_peered":"2023-10-06T03:00:57.982542+0000","last_unstale":"2023-10-06T03:00:57.994542+0000","last_undegraded":"2023-10-06T03:00:57.994542+0000","last_fullsized":"2023-10-06T03:00:57.994542+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:51:29.997106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.974149+0000","last_change":"2023-10-06T03:00:51.904148+0000","last_active":"2023-10-06T03:00:57.974149+0000","last_peered":"2023-10-06T03:00:57.974149+0000","last_clean":"2023-10-06T03:00:57.974149+0000","last_became_active":"2023-10-06T03:00:51.903729+0000","last_became_peered":"2023-10-06T03:00:51.903729+0000","last_unstale":"2023-10-06T03:00:57.974149+0000","last_undegraded":"2023-10-06T03:00:57.974149+0000","last_fullsized":"2023-10-06T03:00:57.974149+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:17:25.070478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.968707+0000","last_change":"2023-10-06T03:00:56.986459+0000","last_active":"2023-10-06T03:00:57.968707+0000","last_peered":"2023-10-06T03:00:57.968707+0000","last_clean":"2023-10-06T03:00:57.968707+0000","last_became_active":"2023-10-06T03:00:56.986082+0000","last_became_peered":"2023-10-06T03:00:56.986082+0000","last_unstale":"2023-10-06T03:00:57.968707+0000","last_undegraded":"2023-10-06T03:00:57.968707+0000","last_fullsized":"2023-10-06T03:00:57.968707+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:41:07.693426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.994838+0000","last_change":"2023-10-06T03:00:57.989868+0000","last_active":"2023-10-06T03:00:57.994838+0000","last_peered":"2023-10-06T03:00:57.994838+0000","last_clean":"2023-10-06T03:00:57.994838+0000","last_became_active":"2023-10-06T03:00:57.988520+0000","last_became_peered":"2023-10-06T03:00:57.988520+0000","last_unstale":"2023-10-06T03:00:57.994838+0000","last_undegraded":"2023-10-06T03:00:57.994838+0000","last_fullsized":"2023-10-06T03:00:57.994838+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:32:39.801984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.973391+0000","last_change":"2023-10-06T03:00:56.979822+0000","last_active":"2023-10-06T03:00:57.973391+0000","last_peered":"2023-10-06T03:00:57.973391+0000","last_clean":"2023-10-06T03:00:57.973391+0000","last_became_active":"2023-10-06T03:00:56.978084+0000","last_became_peered":"2023-10-06T03:00:56.978084+0000","last_unstale":"2023-10-06T03:00:57.973391+0000","last_undegraded":"2023-10-06T03:00:57.973391+0000","last_fullsized":"2023-10-06T03:00:57.973391+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:39:00.208565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.971790+0000","last_change":"2023-10-06T03:00:52.484317+0000","last_active":"2023-10-06T03:00:57.971790+0000","last_peered":"2023-10-06T03:00:57.971790+0000","last_clean":"2023-10-06T03:00:57.971790+0000","last_became_active":"2023-10-06T03:00:52.483818+0000","last_became_peered":"2023-10-06T03:00:52.483818+0000","last_unstale":"2023-10-06T03:00:57.971790+0000","last_undegraded":"2023-10-06T03:00:57.971790+0000","last_fullsized":"2023-10-06T03:00:57.971790+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:17:24.136459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.995100+0000","last_change":"2023-10-06T03:00:57.991155+0000","last_active":"2023-10-06T03:00:57.995100+0000","last_peered":"2023-10-06T03:00:57.995100+0000","last_clean":"2023-10-06T03:00:57.995100+0000","last_became_active":"2023-10-06T03:00:57.990697+0000","last_became_peered":"2023-10-06T03:00:57.990697+0000","last_unstale":"2023-10-06T03:00:57.995100+0000","last_undegraded":"2023-10-06T03:00:57.995100+0000","last_fullsized":"2023-10-06T03:00:57.995100+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:01:50.001484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.971691+0000","last_change":"2023-10-06T03:00:56.987943+0000","last_active":"2023-10-06T03:00:57.971691+0000","last_peered":"2023-10-06T03:00:57.971691+0000","last_clean":"2023-10-06T03:00:57.971691+0000","last_became_active":"2023-10-06T03:00:56.987664+0000","last_became_peered":"2023-10-06T03:00:56.987664+0000","last_unstale":"2023-10-06T03:00:57.971691+0000","last_undegraded":"2023-10-06T03:00:57.971691+0000","last_fullsized":"2023-10-06T03:00:57.971691+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:32:00.864289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.980458+0000","last_change":"2023-10-06T03:00:52.485186+0000","last_active":"2023-10-06T03:00:57.980458+0000","last_peered":"2023-10-06T03:00:57.980458+0000","last_clean":"2023-10-06T03:00:57.980458+0000","last_became_active":"2023-10-06T03:00:52.484615+0000","last_became_peered":"2023-10-06T03:00:52.484615+0000","last_unstale":"2023-10-06T03:00:57.980458+0000","last_undegraded":"2023-10-06T03:00:57.980458+0000","last_fullsized":"2023-10-06T03:00:57.980458+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:17:25.070478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.996037+0000","last_change":"2023-10-06T03:00:57.993777+0000","last_active":"2023-10-06T03:00:57.996037+0000","last_peered":"2023-10-06T03:00:57.996037+0000","last_clean":"2023-10-06T03:00:57.996037+0000","last_became_active":"2023-10-06T03:00:57.993567+0000","last_became_peered":"2023-10-06T03:00:57.993567+0000","last_unstale":"2023-10-06T03:00:57.996037+0000","last_undegraded":"2023-10-06T03:00:57.996037+0000","last_fullsized":"2023-10-06T03:00:57.996037+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:14:29.859982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:58.012633+0000","last_change":"2023-10-06T03:00:56.980714+0000","last_active":"2023-10-06T03:00:58.012633+0000","last_peered":"2023-10-06T03:00:58.012633+0000","last_clean":"2023-10-06T03:00:58.012633+0000","last_became_active":"2023-10-06T03:00:56.979257+0000","last_became_peered":"2023-10-06T03:00:56.979257+0000","last_unstale":"2023-10-06T03:00:58.012633+0000","last_undegraded":"2023-10-06T03:00:58.012633+0000","last_fullsized":"2023-10-06T03:00:58.012633+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:30:15.966823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.971782+0000","last_change":"2023-10-06T03:00:51.903388+0000","last_active":"2023-10-06T03:00:57.971782+0000","last_peered":"2023-10-06T03:00:57.971782+0000","last_clean":"2023-10-06T03:00:57.971782+0000","last_became_active":"2023-10-06T03:00:51.902959+0000","last_became_peered":"2023-10-06T03:00:51.902959+0000","last_unstale":"2023-10-06T03:00:57.971782+0000","last_undegraded":"2023-10-06T03:00:57.971782+0000","last_fullsized":"2023-10-06T03:00:57.971782+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:30:16.907470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.988640+0000","last_change":"2023-10-06T03:00:57.985087+0000","last_active":"2023-10-06T03:00:57.988640+0000","last_peered":"2023-10-06T03:00:57.988640+0000","last_clean":"2023-10-06T03:00:57.988640+0000","last_became_active":"2023-10-06T03:00:57.984740+0000","last_became_peered":"2023-10-06T03:00:57.984740+0000","last_unstale":"2023-10-06T03:00:57.988640+0000","last_undegraded":"2023-10-06T03:00:57.988640+0000","last_fullsized":"2023-10-06T03:00:57.988640+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:34:39.364267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:00:59.467306+0000","last_change":"2023-10-06T03:00:56.985269+0000","last_active":"2023-10-06T03:00:59.467306+0000","last_peered":"2023-10-06T03:00:59.467306+0000","last_clean":"2023-10-06T03:00:59.467306+0000","last_became_active":"2023-10-06T03:00:56.984926+0000","last_became_peered":"2023-10-06T03:00:56.984926+0000","last_unstale":"2023-10-06T03:00:59.467306+0000","last_undegraded":"2023-10-06T03:00:59.467306+0000","last_fullsized":"2023-10-06T03:00:59.467306+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:32:00.864289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.977974+0000","last_change":"2023-10-06T03:00:51.903242+0000","last_active":"2023-10-06T03:00:57.977974+0000","last_peered":"2023-10-06T03:00:57.977974+0000","last_clean":"2023-10-06T03:00:57.977974+0000","last_became_active":"2023-10-06T03:00:51.902929+0000","last_became_peered":"2023-10-06T03:00:51.902929+0000","last_unstale":"2023-10-06T03:00:57.977974+0000","last_undegraded":"2023-10-06T03:00:57.977974+0000","last_fullsized":"2023-10-06T03:00:57.977974+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:34:12.274158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.989927+0000","last_change":"2023-10-06T03:00:57.986011+0000","last_active":"2023-10-06T03:00:57.989927+0000","last_peered":"2023-10-06T03:00:57.989927+0000","last_clean":"2023-10-06T03:00:57.989927+0000","last_became_active":"2023-10-06T03:00:57.985735+0000","last_became_peered":"2023-10-06T03:00:57.985735+0000","last_unstale":"2023-10-06T03:00:57.989927+0000","last_undegraded":"2023-10-06T03:00:57.989927+0000","last_fullsized":"2023-10-06T03:00:57.989927+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:14:29.859982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.987798+0000","last_change":"2023-10-06T03:00:57.981395+0000","last_active":"2023-10-06T03:00:57.987798+0000","last_peered":"2023-10-06T03:00:57.987798+0000","last_clean":"2023-10-06T03:00:57.987798+0000","last_became_active":"2023-10-06T03:00:57.981107+0000","last_became_peered":"2023-10-06T03:00:57.981107+0000","last_unstale":"2023-10-06T03:00:57.987798+0000","last_undegraded":"2023-10-06T03:00:57.987798+0000","last_fullsized":"2023-10-06T03:00:57.987798+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:32:20.183224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"22'6","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:58.020414+0000","last_change":"2023-10-06T03:00:56.979738+0000","last_active":"2023-10-06T03:00:58.020414+0000","last_peered":"2023-10-06T03:00:58.020414+0000","last_clean":"2023-10-06T03:00:58.020414+0000","last_became_active":"2023-10-06T03:00:56.979409+0000","last_became_peered":"2023-10-06T03:00:56.979409+0000","last_unstale":"2023-10-06T03:00:58.020414+0000","last_undegraded":"2023-10-06T03:00:58.020414+0000","last_fullsized":"2023-10-06T03:00:58.020414+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:41:33.554972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.995082+0000","last_change":"2023-10-06T03:00:57.990981+0000","last_active":"2023-10-06T03:00:57.995082+0000","last_peered":"2023-10-06T03:00:57.995082+0000","last_clean":"2023-10-06T03:00:57.995082+0000","last_became_active":"2023-10-06T03:00:57.990342+0000","last_became_peered":"2023-10-06T03:00:57.990342+0000","last_unstale":"2023-10-06T03:00:57.995082+0000","last_undegraded":"2023-10-06T03:00:57.995082+0000","last_fullsized":"2023-10-06T03:00:57.995082+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:16:06.528696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:58.012662+0000","last_change":"2023-10-06T03:00:56.983297+0000","last_active":"2023-10-06T03:00:58.012662+0000","last_peered":"2023-10-06T03:00:58.012662+0000","last_clean":"2023-10-06T03:00:58.012662+0000","last_became_active":"2023-10-06T03:00:56.983095+0000","last_became_peered":"2023-10-06T03:00:56.983095+0000","last_unstale":"2023-10-06T03:00:58.012662+0000","last_undegraded":"2023-10-06T03:00:58.012662+0000","last_fullsized":"2023-10-06T03:00:58.012662+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:49:02.389155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.976844+0000","last_change":"2023-10-06T03:00:56.976251+0000","last_active":"2023-10-06T03:00:57.976844+0000","last_peered":"2023-10-06T03:00:57.976844+0000","last_clean":"2023-10-06T03:00:57.976844+0000","last_became_active":"2023-10-06T03:00:56.975922+0000","last_became_peered":"2023-10-06T03:00:56.975922+0000","last_unstale":"2023-10-06T03:00:57.976844+0000","last_undegraded":"2023-10-06T03:00:57.976844+0000","last_fullsized":"2023-10-06T03:00:57.976844+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:34:15.780752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.995718+0000","last_change":"2023-10-06T03:00:57.989172+0000","last_active":"2023-10-06T03:00:57.995718+0000","last_peered":"2023-10-06T03:00:57.995718+0000","last_clean":"2023-10-06T03:00:57.995718+0000","last_became_active":"2023-10-06T03:00:57.988815+0000","last_became_peered":"2023-10-06T03:00:57.988815+0000","last_unstale":"2023-10-06T03:00:57.995718+0000","last_undegraded":"2023-10-06T03:00:57.995718+0000","last_fullsized":"2023-10-06T03:00:57.995718+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:41:47.568218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.973765+0000","last_change":"2023-10-06T03:00:56.981539+0000","last_active":"2023-10-06T03:00:57.973765+0000","last_peered":"2023-10-06T03:00:57.973765+0000","last_clean":"2023-10-06T03:00:57.973765+0000","last_became_active":"2023-10-06T03:00:56.980952+0000","last_became_peered":"2023-10-06T03:00:56.980952+0000","last_unstale":"2023-10-06T03:00:57.973765+0000","last_undegraded":"2023-10-06T03:00:57.973765+0000","last_fullsized":"2023-10-06T03:00:57.973765+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:30:15.966823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.987260+0000","last_change":"2023-10-06T03:00:57.984397+0000","last_active":"2023-10-06T03:00:57.987260+0000","last_peered":"2023-10-06T03:00:57.987260+0000","last_clean":"2023-10-06T03:00:57.987260+0000","last_became_active":"2023-10-06T03:00:57.983080+0000","last_became_peered":"2023-10-06T03:00:57.983080+0000","last_unstale":"2023-10-06T03:00:57.987260+0000","last_undegraded":"2023-10-06T03:00:57.987260+0000","last_fullsized":"2023-10-06T03:00:57.987260+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:14:29.859982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.987973+0000","last_change":"2023-10-06T03:00:57.986460+0000","last_active":"2023-10-06T03:00:57.987973+0000","last_peered":"2023-10-06T03:00:57.987973+0000","last_clean":"2023-10-06T03:00:57.987973+0000","last_became_active":"2023-10-06T03:00:57.985944+0000","last_became_peered":"2023-10-06T03:00:57.985944+0000","last_unstale":"2023-10-06T03:00:57.987973+0000","last_undegraded":"2023-10-06T03:00:57.987973+0000","last_fullsized":"2023-10-06T03:00:57.987973+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:01:21.312056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.962907+0000","last_change":"2023-10-06T03:00:56.986763+0000","last_active":"2023-10-06T03:00:57.962907+0000","last_peered":"2023-10-06T03:00:57.962907+0000","last_clean":"2023-10-06T03:00:57.962907+0000","last_became_active":"2023-10-06T03:00:56.986417+0000","last_became_peered":"2023-10-06T03:00:56.986417+0000","last_unstale":"2023-10-06T03:00:57.962907+0000","last_undegraded":"2023-10-06T03:00:57.962907+0000","last_fullsized":"2023-10-06T03:00:57.962907+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:50:23.531265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.998859+0000","last_change":"2023-10-06T03:00:57.996078+0000","last_active":"2023-10-06T03:00:57.998859+0000","last_peered":"2023-10-06T03:00:57.998859+0000","last_clean":"2023-10-06T03:00:57.998859+0000","last_became_active":"2023-10-06T03:00:57.995672+0000","last_became_peered":"2023-10-06T03:00:57.995672+0000","last_unstale":"2023-10-06T03:00:57.998859+0000","last_undegraded":"2023-10-06T03:00:57.998859+0000","last_fullsized":"2023-10-06T03:00:57.998859+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:18:57.339278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.972357+0000","last_change":"2023-10-06T03:00:56.983097+0000","last_active":"2023-10-06T03:00:57.972357+0000","last_peered":"2023-10-06T03:00:57.972357+0000","last_clean":"2023-10-06T03:00:57.972357+0000","last_became_active":"2023-10-06T03:00:56.982646+0000","last_became_peered":"2023-10-06T03:00:56.982646+0000","last_unstale":"2023-10-06T03:00:57.972357+0000","last_undegraded":"2023-10-06T03:00:57.972357+0000","last_fullsized":"2023-10-06T03:00:57.972357+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:11:31.937336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.978634+0000","last_change":"2023-10-06T03:00:57.976355+0000","last_active":"2023-10-06T03:00:57.978634+0000","last_peered":"2023-10-06T03:00:57.978634+0000","last_clean":"2023-10-06T03:00:57.978634+0000","last_became_active":"2023-10-06T03:00:57.976098+0000","last_became_peered":"2023-10-06T03:00:57.976098+0000","last_unstale":"2023-10-06T03:00:57.978634+0000","last_undegraded":"2023-10-06T03:00:57.978634+0000","last_fullsized":"2023-10-06T03:00:57.978634+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:32:20.183224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:58.017783+0000","last_change":"2023-10-06T03:00:56.979150+0000","last_active":"2023-10-06T03:00:58.017783+0000","last_peered":"2023-10-06T03:00:58.017783+0000","last_clean":"2023-10-06T03:00:58.017783+0000","last_became_active":"2023-10-06T03:00:56.977097+0000","last_became_peered":"2023-10-06T03:00:56.977097+0000","last_unstale":"2023-10-06T03:00:58.017783+0000","last_undegraded":"2023-10-06T03:00:58.017783+0000","last_fullsized":"2023-10-06T03:00:58.017783+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:39:17.918596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.991468+0000","last_change":"2023-10-06T03:00:57.986365+0000","last_active":"2023-10-06T03:00:57.991468+0000","last_peered":"2023-10-06T03:00:57.991468+0000","last_clean":"2023-10-06T03:00:57.991468+0000","last_became_active":"2023-10-06T03:00:57.985862+0000","last_became_peered":"2023-10-06T03:00:57.985862+0000","last_unstale":"2023-10-06T03:00:57.991468+0000","last_undegraded":"2023-10-06T03:00:57.991468+0000","last_fullsized":"2023-10-06T03:00:57.991468+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:32:01.876152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:58.014753+0000","last_change":"2023-10-06T03:00:56.983730+0000","last_active":"2023-10-06T03:00:58.014753+0000","last_peered":"2023-10-06T03:00:58.014753+0000","last_clean":"2023-10-06T03:00:58.014753+0000","last_became_active":"2023-10-06T03:00:56.983403+0000","last_became_peered":"2023-10-06T03:00:56.983403+0000","last_unstale":"2023-10-06T03:00:58.014753+0000","last_undegraded":"2023-10-06T03:00:58.014753+0000","last_fullsized":"2023-10-06T03:00:58.014753+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:50:23.531265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.987780+0000","last_change":"2023-10-06T03:00:57.981050+0000","last_active":"2023-10-06T03:00:57.987780+0000","last_peered":"2023-10-06T03:00:57.987780+0000","last_clean":"2023-10-06T03:00:57.987780+0000","last_became_active":"2023-10-06T03:00:57.980699+0000","last_became_peered":"2023-10-06T03:00:57.980699+0000","last_unstale":"2023-10-06T03:00:57.987780+0000","last_undegraded":"2023-10-06T03:00:57.987780+0000","last_fullsized":"2023-10-06T03:00:57.987780+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:54:01.471407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:58.015580+0000","last_change":"2023-10-06T03:00:56.980374+0000","last_active":"2023-10-06T03:00:58.015580+0000","last_peered":"2023-10-06T03:00:58.015580+0000","last_clean":"2023-10-06T03:00:58.015580+0000","last_became_active":"2023-10-06T03:00:56.980008+0000","last_became_peered":"2023-10-06T03:00:56.980008+0000","last_unstale":"2023-10-06T03:00:58.015580+0000","last_undegraded":"2023-10-06T03:00:58.015580+0000","last_fullsized":"2023-10-06T03:00:58.015580+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:01:20.300193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.987713+0000","last_change":"2023-10-06T03:00:57.981237+0000","last_active":"2023-10-06T03:00:57.987713+0000","last_peered":"2023-10-06T03:00:57.987713+0000","last_clean":"2023-10-06T03:00:57.987713+0000","last_became_active":"2023-10-06T03:00:57.980835+0000","last_became_peered":"2023-10-06T03:00:57.980835+0000","last_unstale":"2023-10-06T03:00:57.987713+0000","last_undegraded":"2023-10-06T03:00:57.987713+0000","last_fullsized":"2023-10-06T03:00:57.987713+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:34:39.099380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:58.015618+0000","last_change":"2023-10-06T03:00:56.982198+0000","last_active":"2023-10-06T03:00:58.015618+0000","last_peered":"2023-10-06T03:00:58.015618+0000","last_clean":"2023-10-06T03:00:58.015618+0000","last_became_active":"2023-10-06T03:00:56.981933+0000","last_became_peered":"2023-10-06T03:00:56.981933+0000","last_unstale":"2023-10-06T03:00:58.015618+0000","last_undegraded":"2023-10-06T03:00:58.015618+0000","last_fullsized":"2023-10-06T03:00:58.015618+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:57:09.321024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.987031+0000","last_change":"2023-10-06T03:00:57.984525+0000","last_active":"2023-10-06T03:00:57.987031+0000","last_peered":"2023-10-06T03:00:57.987031+0000","last_clean":"2023-10-06T03:00:57.987031+0000","last_became_active":"2023-10-06T03:00:57.984205+0000","last_became_peered":"2023-10-06T03:00:57.984205+0000","last_unstale":"2023-10-06T03:00:57.987031+0000","last_undegraded":"2023-10-06T03:00:57.987031+0000","last_fullsized":"2023-10-06T03:00:57.987031+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:28:58.179787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:58.006745+0000","last_change":"2023-10-06T03:00:56.978317+0000","last_active":"2023-10-06T03:00:58.006745+0000","last_peered":"2023-10-06T03:00:58.006745+0000","last_clean":"2023-10-06T03:00:58.006745+0000","last_became_active":"2023-10-06T03:00:56.977802+0000","last_became_peered":"2023-10-06T03:00:56.977802+0000","last_unstale":"2023-10-06T03:00:58.006745+0000","last_undegraded":"2023-10-06T03:00:58.006745+0000","last_fullsized":"2023-10-06T03:00:58.006745+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:04:35.977083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:57.987755+0000","last_change":"2023-10-06T03:00:57.984100+0000","last_active":"2023-10-06T03:00:57.987755+0000","last_peered":"2023-10-06T03:00:57.987755+0000","last_clean":"2023-10-06T03:00:57.987755+0000","last_became_active":"2023-10-06T03:00:57.983756+0000","last_became_peered":"2023-10-06T03:00:57.983756+0000","last_unstale":"2023-10-06T03:00:57.987755+0000","last_undegraded":"2023-10-06T03:00:57.987755+0000","last_fullsized":"2023-10-06T03:00:57.987755+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:56.938861+0000","last_clean_scrub_stamp":"2023-10-06T03:00:56.938861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:10:20.444330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-06T03:00:58.007461+0000","last_change":"2023-10-06T03:00:56.981315+0000","last_active":"2023-10-06T03:00:58.007461+0000","last_peered":"2023-10-06T03:00:58.007461+0000","last_clean":"2023-10-06T03:00:58.007461+0000","last_became_active":"2023-10-06T03:00:56.980617+0000","last_became_peered":"2023-10-06T03:00:56.980617+0000","last_unstale":"2023-10-06T03:00:58.007461+0000","last_undegraded":"2023-10-06T03:00:58.007461+0000","last_fullsized":"2023-10-06T03:00:58.007461+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:55.926999+0000","last_clean_scrub_stamp":"2023-10-06T03:00:55.926999+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:04:35.977083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298132,"kb_used_data":844,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073708,"statfs":{"total":96636764160,"available":96331476992,"internally_reserved":0,"allocated":864256,"data_stored":681439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.147}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.27}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7150000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5660000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.512}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6439999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297524,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074316,"statfs":{"total":96636764160,"available":96332099584,"internally_reserved":0,"allocated":241664,"data_stored":89319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96899999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.343}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4330000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.512}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4850000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.407}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7829999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297532,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074308,"statfs":{"total":96636764160,"available":96332091392,"internally_reserved":0,"allocated":249856,"data_stored":89943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96499999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0940000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.123}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.294}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.272}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297544,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074296,"statfs":{"total":96636764160,"available":96332079104,"internally_reserved":0,"allocated":262144,"data_stored":90911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94099999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.177}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5389999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.026}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0580000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4850000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4259999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301624,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070216,"statfs":{"total":96636764160,"available":96327901184,"internally_reserved":0,"allocated":245760,"data_stored":89409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6619999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.716}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5580000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.333}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301620,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070220,"statfs":{"total":96636764160,"available":96327905280,"internally_reserved":0,"allocated":241664,"data_stored":89319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82399999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0369999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.329}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301620,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070220,"statfs":{"total":96636764160,"available":96327905280,"internally_reserved":0,"allocated":241664,"data_stored":89319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.157}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94399999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0800000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0649999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302204,"kb_used_data":820,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069636,"statfs":{"total":96636764160,"available":96327307264,"internally_reserved":0,"allocated":839680,"data_stored":680241,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93999999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.484}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.831}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4610000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7769999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:01:07.544 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-06T03:01:07.544 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-10-06T03:01:07.544 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-10-06T03:01:07.545 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-06T03:01:07.737 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.731+0000 7faffb59e700 1 Processor -- start 2023-10-06T03:01:07.737 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.731+0000 7faffb59e700 1 -- start start 2023-10-06T03:01:07.740 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.735+0000 7faffb59e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faffc1553b0 0x7faffc0c6110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:07.740 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.735+0000 7faffb59e700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7faffc06ba10 0x7faffc0c6650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:07.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.735+0000 7faffb59e700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faffc0aceb0 con 0x7faffc155780 2023-10-06T03:01:07.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.735+0000 7faffb59e700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faffc06be70 con 0x7faffc06ba10 2023-10-06T03:01:07.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.735+0000 7faffb59e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faffc0ac2e0 con 0x7faffc1553b0 2023-10-06T03:01:07.742 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.735+0000 7faff3fff700 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7faffc155780 0x7faffc06b300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.57:36384/0 (socket says 172.21.15.57:36384) 2023-10-06T03:01:07.742 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.735+0000 7faff3fff700 1 -- 172.21.15.57:0/3616920462 learned_addr learned my addr 172.21.15.57:0/3616920462 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:01:07.742 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.735+0000 7faffa59c700 1 --2- 172.21.15.57:0/3616920462 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faffc1553b0 0x7faffc0c6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:07.742 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.735+0000 7faffad9d700 1 --2- 172.21.15.57:0/3616920462 >> v2:172.21.15.105:3300/0 conn(0x7faffc06ba10 0x7faffc0c6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:07.743 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.735+0000 7faff9d9b700 1 -- 172.21.15.57:0/3616920462 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3333028657 0 0) 0x7faffc0aceb0 con 0x7faffc155780 2023-10-06T03:01:07.743 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.735+0000 7faff9d9b700 1 -- 172.21.15.57:0/3616920462 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fafe8003570 con 0x7faffc155780 2023-10-06T03:01:07.743 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.735+0000 7faffa59c700 1 -- 172.21.15.57:0/3616920462 >> v2:172.21.15.105:3300/0 conn(0x7faffc06ba10 msgr2=0x7faffc0c6650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:07.743 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.735+0000 7faffa59c700 1 --2- 172.21.15.57:0/3616920462 >> v2:172.21.15.105:3300/0 conn(0x7faffc06ba10 0x7faffc0c6650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:07.743 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.735+0000 7faffa59c700 1 -- 172.21.15.57:0/3616920462 >> v1:172.21.15.105:6789/0 conn(0x7faffc155780 legacy=0x7faffc06b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:07.743 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.735+0000 7faffa59c700 1 -- 172.21.15.57:0/3616920462 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faffc0ac580 con 0x7faffc1553b0 2023-10-06T03:01:07.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.739+0000 7faffa59c700 1 --2- 172.21.15.57:0/3616920462 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faffc1553b0 0x7faffc0c6110 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fafec0098e0 tx=0x7fafec0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=941348122b766ea2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:07.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.739+0000 7faff9d9b700 1 -- 172.21.15.57:0/3616920462 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafec011630 con 0x7faffc1553b0 2023-10-06T03:01:07.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.739+0000 7faff9d9b700 1 -- 172.21.15.57:0/3616920462 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafec011790 con 0x7faffc1553b0 2023-10-06T03:01:07.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.739+0000 7faff9d9b700 1 -- 172.21.15.57:0/3616920462 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafec011b30 con 0x7faffc1553b0 2023-10-06T03:01:07.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.739+0000 7faffb59e700 1 -- 172.21.15.57:0/3616920462 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faffc1553b0 msgr2=0x7faffc0c6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:07.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.739+0000 7faffb59e700 1 --2- 172.21.15.57:0/3616920462 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faffc1553b0 0x7faffc0c6110 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fafec0098e0 tx=0x7fafec0091a0 comp rx=0 tx=0).stop 2023-10-06T03:01:07.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.739+0000 7faffb59e700 1 -- 172.21.15.57:0/3616920462 shutdown_connections 2023-10-06T03:01:07.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.739+0000 7faffb59e700 1 --2- 172.21.15.57:0/3616920462 >> v2:172.21.15.105:3300/0 conn(0x7faffc06ba10 0x7faffc0c6650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:07.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.739+0000 7faffb59e700 1 --2- 172.21.15.57:0/3616920462 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faffc1553b0 0x7faffc0c6110 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:07.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.739+0000 7faffb59e700 1 -- 172.21.15.57:0/3616920462 >> 172.21.15.57:0/3616920462 conn(0x7faffc0c85e0 msgr2=0x7faffc0c89e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:07.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.739+0000 7faffb59e700 1 -- 172.21.15.57:0/3616920462 shutdown_connections 2023-10-06T03:01:07.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.739+0000 7faffb59e700 1 -- 172.21.15.57:0/3616920462 wait complete. 2023-10-06T03:01:07.747 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.743+0000 7faffb59e700 1 Processor -- start 2023-10-06T03:01:07.747 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.743+0000 7faffb59e700 1 -- start start 2023-10-06T03:01:07.749 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.743+0000 7faffb59e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faffc06ba10 0x7faffc0c2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:07.749 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.743+0000 7faffb59e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faffc1553b0 0x7faffc14d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:07.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.743+0000 7faffb59e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faffc155780 0x7faffc0c3630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:07.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.743+0000 7faffb59e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faffc0c3260 con 0x7faffc155780 2023-10-06T03:01:07.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.743+0000 7faffb59e700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faffc14d5b0 con 0x7faffc06ba10 2023-10-06T03:01:07.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.743+0000 7faffb59e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faffc0c6540 con 0x7faffc1553b0 2023-10-06T03:01:07.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.743+0000 7faffa59c700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faffc06ba10 0x7faffc0c2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:07.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.743+0000 7faffad9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faffc155780 0x7faffc0c3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:07.751 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.743+0000 7faffa59c700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faffc06ba10 0x7faffc0c2b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.57:39628/0 (socket says 172.21.15.57:39628) 2023-10-06T03:01:07.751 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.743+0000 7faffa59c700 1 -- 172.21.15.57:0/1523078300 learned_addr learned my addr 172.21.15.57:0/1523078300 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:07.751 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.743+0000 7faff3fff700 1 --2- 172.21.15.57:0/1523078300 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faffc1553b0 0x7faffc14d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:07.752 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.743+0000 7faffa59c700 1 -- 172.21.15.57:0/1523078300 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faffc1553b0 msgr2=0x7faffc14d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:07.752 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.743+0000 7faffa59c700 1 --2- 172.21.15.57:0/1523078300 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faffc1553b0 0x7faffc14d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:07.752 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.743+0000 7faffa59c700 1 -- 172.21.15.57:0/1523078300 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faffc155780 msgr2=0x7faffc0c3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:07.752 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.743+0000 7faffa59c700 1 --2- 172.21.15.57:0/1523078300 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faffc155780 0x7faffc0c3630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:07.753 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.743+0000 7faffa59c700 1 -- 172.21.15.57:0/1523078300 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafec009420 con 0x7faffc06ba10 2023-10-06T03:01:07.753 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.747+0000 7faffa59c700 1 --2- 172.21.15.57:0/1523078300 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faffc06ba10 0x7faffc0c2b80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fafec009ed0 tx=0x7fafec017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:07.753 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.747+0000 7faff27fc700 1 -- 172.21.15.57:0/1523078300 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafec011900 con 0x7faffc06ba10 2023-10-06T03:01:07.753 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.747+0000 7faff27fc700 1 -- 172.21.15.57:0/1523078300 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafec011a60 con 0x7faffc06ba10 2023-10-06T03:01:07.753 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.747+0000 7faff27fc700 1 -- 172.21.15.57:0/1523078300 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafec023620 con 0x7faffc06ba10 2023-10-06T03:01:07.753 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.747+0000 7faffb59e700 1 -- 172.21.15.57:0/1523078300 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faffc0c3b70 con 0x7faffc06ba10 2023-10-06T03:01:07.753 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.747+0000 7faffb59e700 1 -- 172.21.15.57:0/1523078300 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faffc0c5c50 con 0x7faffc06ba10 2023-10-06T03:01:07.753 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.747+0000 7faffb59e700 1 -- 172.21.15.57:0/1523078300 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faffc04be40 con 0x7faffc06ba10 2023-10-06T03:01:07.758 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.751+0000 7faff27fc700 1 -- 172.21.15.57:0/1523078300 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fafec02c3b0 con 0x7faffc06ba10 2023-10-06T03:01:07.758 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.751+0000 7faff27fc700 1 --2- 172.21.15.57:0/1523078300 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fafdc060620 0x7fafdc062ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:07.758 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.751+0000 7faff27fc700 1 -- 172.21.15.57:0/1523078300 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fafec07dca0 con 0x7faffc06ba10 2023-10-06T03:01:07.758 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.751+0000 7faff3fff700 1 --2- 172.21.15.57:0/1523078300 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fafdc060620 0x7fafdc062ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:07.758 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.751+0000 7faff3fff700 1 --2- 172.21.15.57:0/1523078300 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fafdc060620 0x7fafdc062ad0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7faffc159000 tx=0x7fafe4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:07.764 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.759+0000 7faff27fc700 1 -- 172.21.15.57:0/1523078300 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fafec04e190 con 0x7faffc06ba10 2023-10-06T03:01:07.962 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.955+0000 7faffb59e700 1 -- 172.21.15.57:0/1523078300 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7faffc0ac860 con 0x7faffc06ba10 2023-10-06T03:01:07.963 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.959+0000 7faff27fc700 1 -- 172.21.15.57:0/1523078300 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fafec0517b0 con 0x7faffc06ba10 2023-10-06T03:01:07.963 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:01:07.964 INFO:teuthology.orchestra.run.smithi057.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-06T03:01:07.968 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.963+0000 7faffb59e700 1 -- 172.21.15.57:0/1523078300 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fafdc060620 msgr2=0x7fafdc062ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:07.968 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.963+0000 7faffb59e700 1 --2- 172.21.15.57:0/1523078300 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fafdc060620 0x7fafdc062ad0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7faffc159000 tx=0x7fafe4009040 comp rx=0 tx=0).stop 2023-10-06T03:01:07.968 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.963+0000 7faffb59e700 1 -- 172.21.15.57:0/1523078300 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faffc06ba10 msgr2=0x7faffc0c2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:07.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.963+0000 7faffb59e700 1 --2- 172.21.15.57:0/1523078300 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faffc06ba10 0x7faffc0c2b80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fafec009ed0 tx=0x7fafec017000 comp rx=0 tx=0).stop 2023-10-06T03:01:07.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.963+0000 7faffb59e700 1 -- 172.21.15.57:0/1523078300 shutdown_connections 2023-10-06T03:01:07.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.963+0000 7faffb59e700 1 --2- 172.21.15.57:0/1523078300 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faffc155780 0x7faffc0c3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:07.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.963+0000 7faffb59e700 1 --2- 172.21.15.57:0/1523078300 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fafdc060620 0x7fafdc062ad0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:07.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.963+0000 7faffb59e700 1 --2- 172.21.15.57:0/1523078300 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faffc1553b0 0x7faffc14d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:07.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.963+0000 7faffb59e700 1 --2- 172.21.15.57:0/1523078300 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faffc06ba10 0x7faffc0c2b80 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:07.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.963+0000 7faffb59e700 1 -- 172.21.15.57:0/1523078300 >> 172.21.15.57:0/1523078300 conn(0x7faffc0c85e0 msgr2=0x7faffc0c89b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:07.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.963+0000 7faffb59e700 1 -- 172.21.15.57:0/1523078300 shutdown_connections 2023-10-06T03:01:07.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:07.963+0000 7faffb59e700 1 -- 172.21.15.57:0/1523078300 wait complete. 2023-10-06T03:01:07.987 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-10-06T03:01:07.987 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:01:08.141 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.135+0000 7f234a945700 1 Processor -- start 2023-10-06T03:01:08.141 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.135+0000 7f234a945700 1 -- start start 2023-10-06T03:01:08.144 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.139+0000 7f234a945700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f2344159280 0x7f23440ca420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:08.144 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.139+0000 7f234a945700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f23440cad00 0x7f23440cb180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:08.144 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.139+0000 7f234a945700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23440c7420 con 0x7f23440c7890 2023-10-06T03:01:08.144 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.139+0000 7f234a945700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23440ca960 con 0x7f23440cad00 2023-10-06T03:01:08.144 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.139+0000 7f234a945700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23440cb6c0 con 0x7f2344159280 2023-10-06T03:01:08.145 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.139+0000 7f233bfff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f23440cad00 0x7f23440cb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:08.145 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.139+0000 7f233bfff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f23440cad00 0x7f23440cb180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55988/0 (socket says 172.21.15.57:55988) 2023-10-06T03:01:08.145 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.139+0000 7f233bfff700 1 -- 172.21.15.57:0/2579844946 learned_addr learned my addr 172.21.15.57:0/2579844946 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:08.145 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.139+0000 7f2343fff700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f2344159280 0x7f23440ca420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:08.147 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.139+0000 7f23437fe700 1 -- 172.21.15.57:0/2579844946 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3865040696 0 0) 0x7f23440c7420 con 0x7f23440c7890 2023-10-06T03:01:08.147 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.139+0000 7f233bfff700 1 -- 172.21.15.57:0/2579844946 >> v2:172.21.15.105:3300/0 conn(0x7f2344159280 msgr2=0x7f23440ca420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:08.148 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.139+0000 7f233bfff700 1 --2- 172.21.15.57:0/2579844946 >> v2:172.21.15.105:3300/0 conn(0x7f2344159280 0x7f23440ca420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:08.148 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.139+0000 7f233bfff700 1 -- 172.21.15.57:0/2579844946 >> v1:172.21.15.105:6789/0 conn(0x7f23440c7890 legacy=0x7f23440c7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:08.148 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.139+0000 7f233bfff700 1 -- 172.21.15.57:0/2579844946 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f234415dd10 con 0x7f23440cad00 2023-10-06T03:01:08.148 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.139+0000 7f233bfff700 1 --2- 172.21.15.57:0/2579844946 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f23440cad00 0x7f23440cb180 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2344070c50 tx=0x7f232c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed18881d96c2365d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:08.148 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.143+0000 7f23437fe700 1 -- 172.21.15.57:0/2579844946 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f232c009e70 con 0x7f23440cad00 2023-10-06T03:01:08.148 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.143+0000 7f23437fe700 1 -- 172.21.15.57:0/2579844946 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f232c00b860 con 0x7f23440cad00 2023-10-06T03:01:08.148 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.143+0000 7f23437fe700 1 -- 172.21.15.57:0/2579844946 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f232c00bc00 con 0x7f23440cad00 2023-10-06T03:01:08.149 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.143+0000 7f234a945700 1 -- 172.21.15.57:0/2579844946 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f23440cad00 msgr2=0x7f23440cb180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:08.149 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.143+0000 7f234a945700 1 --2- 172.21.15.57:0/2579844946 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f23440cad00 0x7f23440cb180 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2344070c50 tx=0x7f232c009250 comp rx=0 tx=0).stop 2023-10-06T03:01:08.149 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.143+0000 7f234a945700 1 -- 172.21.15.57:0/2579844946 shutdown_connections 2023-10-06T03:01:08.149 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.143+0000 7f234a945700 1 --2- 172.21.15.57:0/2579844946 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f23440cad00 0x7f23440cb180 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:08.149 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.143+0000 7f234a945700 1 --2- 172.21.15.57:0/2579844946 >> v2:172.21.15.105:3300/0 conn(0x7f2344159280 0x7f23440ca420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:08.150 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.143+0000 7f234a945700 1 -- 172.21.15.57:0/2579844946 >> 172.21.15.57:0/2579844946 conn(0x7f2344067380 msgr2=0x7f2344067780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:08.150 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.143+0000 7f234a945700 1 -- 172.21.15.57:0/2579844946 shutdown_connections 2023-10-06T03:01:08.150 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.143+0000 7f234a945700 1 -- 172.21.15.57:0/2579844946 wait complete. 2023-10-06T03:01:08.150 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.147+0000 7f234a945700 1 Processor -- start 2023-10-06T03:01:08.151 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.147+0000 7f234a945700 1 -- start start 2023-10-06T03:01:08.153 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.147+0000 7f234a945700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f23440c7890 0x7f23440b1060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:08.153 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.147+0000 7f234a945700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23440cad00 0x7f23440c5a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:08.153 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.147+0000 7f234a945700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2344159280 0x7f234416d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:08.153 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.147+0000 7f234a945700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23440c62b0 con 0x7f2344159280 2023-10-06T03:01:08.153 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.147+0000 7f234a945700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23440c6590 con 0x7f23440c7890 2023-10-06T03:01:08.153 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.147+0000 7f234a945700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23440c39f0 con 0x7f23440cad00 2023-10-06T03:01:08.154 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.147+0000 7f2348ee2700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2344159280 0x7f234416d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:08.154 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.147+0000 7f2343fff700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f23440c7890 0x7f23440b1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:08.154 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.147+0000 7f2343fff700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f23440c7890 0x7f23440b1060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.57:39642/0 (socket says 172.21.15.57:39642) 2023-10-06T03:01:08.154 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.147+0000 7f2348ee2700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2344159280 0x7f234416d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55994/0 (socket says 172.21.15.57:55994) 2023-10-06T03:01:08.155 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.147+0000 7f2343fff700 1 -- 172.21.15.57:0/791867701 learned_addr learned my addr 172.21.15.57:0/791867701 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:08.155 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.147+0000 7f233bfff700 1 --2- 172.21.15.57:0/791867701 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23440cad00 0x7f23440c5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:08.155 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.147+0000 7f2348ee2700 1 -- 172.21.15.57:0/791867701 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23440cad00 msgr2=0x7f23440c5a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:08.155 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.147+0000 7f2348ee2700 1 --2- 172.21.15.57:0/791867701 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23440cad00 0x7f23440c5a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:08.155 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.147+0000 7f2348ee2700 1 -- 172.21.15.57:0/791867701 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f23440c7890 msgr2=0x7f23440b1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:08.155 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.147+0000 7f2348ee2700 1 --2- 172.21.15.57:0/791867701 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f23440c7890 0x7f23440b1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:08.155 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.147+0000 7f2348ee2700 1 -- 172.21.15.57:0/791867701 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f232c0094f0 con 0x7f2344159280 2023-10-06T03:01:08.156 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.151+0000 7f2348ee2700 1 --2- 172.21.15.57:0/791867701 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2344159280 0x7f234416d970 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f233c001560 tx=0x7f233c0016c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:08.157 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.151+0000 7f2340ff9700 1 -- 172.21.15.57:0/791867701 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f233c012630 con 0x7f2344159280 2023-10-06T03:01:08.157 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.151+0000 7f2340ff9700 1 -- 172.21.15.57:0/791867701 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f233c012790 con 0x7f2344159280 2023-10-06T03:01:08.157 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.151+0000 7f234a945700 1 -- 172.21.15.57:0/791867701 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23440c3cd0 con 0x7f2344159280 2023-10-06T03:01:08.157 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.151+0000 7f2340ff9700 1 -- 172.21.15.57:0/791867701 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f233c012b50 con 0x7f2344159280 2023-10-06T03:01:08.157 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.151+0000 7f234a945700 1 -- 172.21.15.57:0/791867701 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23440c5fa0 con 0x7f2344159280 2023-10-06T03:01:08.158 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.151+0000 7f234a945700 1 -- 172.21.15.57:0/791867701 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23440c41d0 con 0x7f2344159280 2023-10-06T03:01:08.159 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.155+0000 7f2340ff9700 1 -- 172.21.15.57:0/791867701 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f233c003030 con 0x7f2344159280 2023-10-06T03:01:08.161 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.155+0000 7f2340ff9700 1 --2- 172.21.15.57:0/791867701 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f2324060550 0x7f2324062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:08.161 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.155+0000 7f2340ff9700 1 -- 172.21.15.57:0/791867701 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f233c07c950 con 0x7f2344159280 2023-10-06T03:01:08.161 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.155+0000 7f2343fff700 1 --2- 172.21.15.57:0/791867701 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f2324060550 0x7f2324062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:08.162 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.155+0000 7f2343fff700 1 --2- 172.21.15.57:0/791867701 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f2324060550 0x7f2324062a00 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f2334009dd0 tx=0x7f23340091a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:08.171 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.163+0000 7f2340ff9700 1 -- 172.21.15.57:0/791867701 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f233c04cd40 con 0x7f2344159280 2023-10-06T03:01:08.338 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.331+0000 7f234a945700 1 -- 172.21.15.57:0/791867701 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f23440712e0 con 0x7f2344159280 2023-10-06T03:01:08.340 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.335+0000 7f2340ff9700 1 -- 172.21.15.57:0/791867701 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16866 (secure 0 0 0) 0x7f233c050360 con 0x7f2344159280 2023-10-06T03:01:08.341 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:01:08.341 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":23,"fsid":"eb56dc0f-9213-41cb-9aad-8ade6c802e98","created":"2023-10-06T03:00:30.806197+0000","modified":"2023-10-06T03:00:58.975366+0000","last_up_change":"2023-10-06T03:00:43.607454+0000","last_in_change":"2023-10-06T03:00:33.943513+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T03:00:44.360651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T03:00:50.466601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:00:55.472586+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T03:00:56.400884+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"58cf6c90-d704-43e0-b2db-dffe526d5e8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":33053},{"type":"v1","addr":"172.21.15.57:6801","nonce":33053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":33053},{"type":"v1","addr":"172.21.15.57:6803","nonce":33053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":33053},{"type":"v1","addr":"172.21.15.57:6807","nonce":33053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":33053},{"type":"v1","addr":"172.21.15.57:6805","nonce":33053}]},"public_addr":"172.21.15.57:6801/33053","cluster_addr":"172.21.15.57:6803/33053","heartbeat_back_addr":"172.21.15.57:6807/33053","heartbeat_front_addr":"172.21.15.57:6805/33053","state":["exists","up"]},{"osd":1,"uuid":"16afbe70-7f9e-4568-9c92-763e6e348119","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6809","nonce":33052},{"type":"v1","addr":"172.21.15.57:6810","nonce":33052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":33052},{"type":"v1","addr":"172.21.15.57:6813","nonce":33052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":33052},{"type":"v1","addr":"172.21.15.57:6822","nonce":33052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6815","nonce":33052},{"type":"v1","addr":"172.21.15.57:6818","nonce":33052}]},"public_addr":"172.21.15.57:6810/33052","cluster_addr":"172.21.15.57:6813/33052","heartbeat_back_addr":"172.21.15.57:6822/33052","heartbeat_front_addr":"172.21.15.57:6818/33052","state":["exists","up"]},{"osd":2,"uuid":"7255c62e-f92f-470f-a5ce-30228920d9f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":33058},{"type":"v1","addr":"172.21.15.57:6825","nonce":33058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":33058},{"type":"v1","addr":"172.21.15.57:6827","nonce":33058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":33058},{"type":"v1","addr":"172.21.15.57:6831","nonce":33058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":33058},{"type":"v1","addr":"172.21.15.57:6829","nonce":33058}]},"public_addr":"172.21.15.57:6825/33058","cluster_addr":"172.21.15.57:6827/33058","heartbeat_back_addr":"172.21.15.57:6831/33058","heartbeat_front_addr":"172.21.15.57:6829/33058","state":["exists","up"]},{"osd":3,"uuid":"152a236d-f799-4888-8544-74865508d5a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":33057},{"type":"v1","addr":"172.21.15.57:6811","nonce":33057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":33057},{"type":"v1","addr":"172.21.15.57:6816","nonce":33057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6821","nonce":33057},{"type":"v1","addr":"172.21.15.57:6823","nonce":33057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6817","nonce":33057},{"type":"v1","addr":"172.21.15.57:6819","nonce":33057}]},"public_addr":"172.21.15.57:6811/33057","cluster_addr":"172.21.15.57:6816/33057","heartbeat_back_addr":"172.21.15.57:6823/33057","heartbeat_front_addr":"172.21.15.57:6819/33057","state":["exists","up"]},{"osd":4,"uuid":"37db2a65-3566-41d0-9d60-e66c49e1e68e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":33368},{"type":"v1","addr":"172.21.15.105:6801","nonce":33368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":33368},{"type":"v1","addr":"172.21.15.105:6803","nonce":33368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":33368},{"type":"v1","addr":"172.21.15.105:6807","nonce":33368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":33368},{"type":"v1","addr":"172.21.15.105:6805","nonce":33368}]},"public_addr":"172.21.15.105:6801/33368","cluster_addr":"172.21.15.105:6803/33368","heartbeat_back_addr":"172.21.15.105:6807/33368","heartbeat_front_addr":"172.21.15.105:6805/33368","state":["exists","up"]},{"osd":5,"uuid":"35e77918-1bb4-42ca-9b20-f3c14eaa0c04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":33379},{"type":"v1","addr":"172.21.15.105:6818","nonce":33379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":33379},{"type":"v1","addr":"172.21.15.105:6823","nonce":33379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":33379},{"type":"v1","addr":"172.21.15.105:6831","nonce":33379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":33379},{"type":"v1","addr":"172.21.15.105:6827","nonce":33379}]},"public_addr":"172.21.15.105:6818/33379","cluster_addr":"172.21.15.105:6823/33379","heartbeat_back_addr":"172.21.15.105:6831/33379","heartbeat_front_addr":"172.21.15.105:6827/33379","state":["exists","up"]},{"osd":6,"uuid":"b4d9d510-7a45-4173-8287-c6c8d6547f2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":33369},{"type":"v1","addr":"172.21.15.105:6819","nonce":33369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":33369},{"type":"v1","addr":"172.21.15.105:6822","nonce":33369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":33369},{"type":"v1","addr":"172.21.15.105:6830","nonce":33369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":33369},{"type":"v1","addr":"172.21.15.105:6826","nonce":33369}]},"public_addr":"172.21.15.105:6819/33369","cluster_addr":"172.21.15.105:6822/33369","heartbeat_back_addr":"172.21.15.105:6830/33369","heartbeat_front_addr":"172.21.15.105:6826/33369","state":["exists","up"]},{"osd":7,"uuid":"74266fb0-cd84-463f-8bf0-092652a71dc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":33370},{"type":"v1","addr":"172.21.15.105:6809","nonce":33370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":33370},{"type":"v1","addr":"172.21.15.105:6811","nonce":33370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":33370},{"type":"v1","addr":"172.21.15.105:6815","nonce":33370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":33370},{"type":"v1","addr":"172.21.15.105:6813","nonce":33370}]},"public_addr":"172.21.15.105:6809/33370","cluster_addr":"172.21.15.105:6811/33370","heartbeat_back_addr":"172.21.15.105:6815/33370","heartbeat_front_addr":"172.21.15.105:6813/33370","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.596864+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.633851+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.636993+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.529681+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.608601+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.659752+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.661717+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.642221+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:01:08.343 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.339+0000 7f234a945700 1 -- 172.21.15.57:0/791867701 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f2324060550 msgr2=0x7f2324062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:08.344 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.339+0000 7f234a945700 1 --2- 172.21.15.57:0/791867701 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f2324060550 0x7f2324062a00 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f2334009dd0 tx=0x7f23340091a0 comp rx=0 tx=0).stop 2023-10-06T03:01:08.344 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.339+0000 7f234a945700 1 -- 172.21.15.57:0/791867701 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2344159280 msgr2=0x7f234416d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:08.344 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.339+0000 7f234a945700 1 --2- 172.21.15.57:0/791867701 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2344159280 0x7f234416d970 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f233c001560 tx=0x7f233c0016c0 comp rx=0 tx=0).stop 2023-10-06T03:01:08.344 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.339+0000 7f234a945700 1 -- 172.21.15.57:0/791867701 shutdown_connections 2023-10-06T03:01:08.344 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.339+0000 7f234a945700 1 --2- 172.21.15.57:0/791867701 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2344159280 0x7f234416d970 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:08.344 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.339+0000 7f234a945700 1 --2- 172.21.15.57:0/791867701 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f2324060550 0x7f2324062a00 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:08.344 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.339+0000 7f234a945700 1 --2- 172.21.15.57:0/791867701 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23440cad00 0x7f23440c5a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:08.344 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.339+0000 7f234a945700 1 --2- 172.21.15.57:0/791867701 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f23440c7890 0x7f23440b1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:08.344 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.339+0000 7f234a945700 1 -- 172.21.15.57:0/791867701 >> 172.21.15.57:0/791867701 conn(0x7f2344067380 msgr2=0x7f2344156fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:08.344 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.339+0000 7f234a945700 1 -- 172.21.15.57:0/791867701 shutdown_connections 2023-10-06T03:01:08.345 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.339+0000 7f234a945700 1 -- 172.21.15.57:0/791867701 wait complete. 2023-10-06T03:01:08.365 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T03:00:44.360651+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T03:00:50.466601+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T03:00:55.472586+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T03:00:56.400884+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T03:01:08.366 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T03:01:08.536 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.531+0000 7fadb0e78700 1 Processor -- start 2023-10-06T03:01:08.536 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.531+0000 7fadb0e78700 1 -- start start 2023-10-06T03:01:08.540 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.535+0000 7fadb0e78700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fadac142d40 0x7fadac0c60b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:08.540 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.535+0000 7fadb0e78700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadac06b0e0 con 0x7fadac0c5ce0 2023-10-06T03:01:08.541 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.535+0000 7fadb0e78700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadac0cc3a0 con 0x7fadac0cb0f0 2023-10-06T03:01:08.541 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.535+0000 7fadb0e78700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadac0cb570 con 0x7fadac142d40 2023-10-06T03:01:08.541 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.535+0000 7fadaa59c700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fadac0c5ce0 0x7fadac142630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:45924/0 (socket says 172.21.15.57:45924) 2023-10-06T03:01:08.541 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.535+0000 7fadaa59c700 1 -- 172.21.15.57:0/3128352584 learned_addr learned my addr 172.21.15.57:0/3128352584 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:01:08.542 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.535+0000 7fada9d9b700 1 --2- 172.21.15.57:0/3128352584 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fadac142d40 0x7fadac0c60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:08.542 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.535+0000 7fada959a700 1 -- 172.21.15.57:0/3128352584 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 308987987 0 0) 0x7fadac06b0e0 con 0x7fadac0c5ce0 2023-10-06T03:01:08.542 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.535+0000 7fada959a700 1 -- 172.21.15.57:0/3128352584 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad94003570 con 0x7fadac0c5ce0 2023-10-06T03:01:08.542 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.535+0000 7fada959a700 1 -- 172.21.15.57:0/3128352584 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1177639820 0 0) 0x7fadac0cc3a0 con 0x7fadac0cb0f0 2023-10-06T03:01:08.542 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.535+0000 7fada959a700 1 -- 172.21.15.57:0/3128352584 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fadac06b0e0 con 0x7fadac0cb0f0 2023-10-06T03:01:08.542 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.535+0000 7fada9d9b700 1 -- 172.21.15.57:0/3128352584 >> v1:172.21.15.105:6789/0 conn(0x7fadac0cb0f0 legacy=0x7fadac06c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:08.542 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.535+0000 7fada9d9b700 1 -- 172.21.15.57:0/3128352584 >> v1:172.21.15.57:6789/0 conn(0x7fadac0c5ce0 legacy=0x7fadac142630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:08.542 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.535+0000 7fada9d9b700 1 -- 172.21.15.57:0/3128352584 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadac0cb790 con 0x7fadac142d40 2023-10-06T03:01:08.543 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.539+0000 7fada9d9b700 1 --2- 172.21.15.57:0/3128352584 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fadac142d40 0x7fadac0c60b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fada0009910 tx=0x7fada00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74422214f2905891 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:08.543 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.539+0000 7fada959a700 1 -- 172.21.15.57:0/3128352584 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fada0011630 con 0x7fadac142d40 2023-10-06T03:01:08.543 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.539+0000 7fada959a700 1 -- 172.21.15.57:0/3128352584 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fada0011790 con 0x7fadac142d40 2023-10-06T03:01:08.543 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.539+0000 7fada959a700 1 -- 172.21.15.57:0/3128352584 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fada0011b30 con 0x7fadac142d40 2023-10-06T03:01:08.544 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.539+0000 7fadb0e78700 1 -- 172.21.15.57:0/3128352584 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fadac142d40 msgr2=0x7fadac0c60b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:08.544 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.539+0000 7fadb0e78700 1 --2- 172.21.15.57:0/3128352584 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fadac142d40 0x7fadac0c60b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fada0009910 tx=0x7fada00091a0 comp rx=0 tx=0).stop 2023-10-06T03:01:08.545 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.539+0000 7fadb0e78700 1 -- 172.21.15.57:0/3128352584 shutdown_connections 2023-10-06T03:01:08.545 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.539+0000 7fadb0e78700 1 --2- 172.21.15.57:0/3128352584 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fadac142d40 0x7fadac0c60b0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:08.545 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.539+0000 7fadb0e78700 1 -- 172.21.15.57:0/3128352584 >> 172.21.15.57:0/3128352584 conn(0x7fadac0ccbd0 msgr2=0x7fadac0ccfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:08.545 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.539+0000 7fadb0e78700 1 -- 172.21.15.57:0/3128352584 shutdown_connections 2023-10-06T03:01:08.545 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.539+0000 7fadb0e78700 1 -- 172.21.15.57:0/3128352584 wait complete. 2023-10-06T03:01:08.547 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.539+0000 7fadb0e78700 1 Processor -- start 2023-10-06T03:01:08.547 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.543+0000 7fadb0e78700 1 -- start start 2023-10-06T03:01:08.548 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.543+0000 7fadb0e78700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fadac0c5ce0 0x7fadac135750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:08.548 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.543+0000 7fadb0e78700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fadac0cb0f0 0x7fadac067050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:08.548 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.543+0000 7fadb0e78700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fadac142d40 0x7fadac067590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:08.548 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.543+0000 7fadb0e78700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadac131fe0 con 0x7fadac0c5ce0 2023-10-06T03:01:08.548 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.543+0000 7fadb0e78700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadac1313d0 con 0x7fadac142d40 2023-10-06T03:01:08.548 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.543+0000 7fadb0e78700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadac1316b0 con 0x7fadac0cb0f0 2023-10-06T03:01:08.549 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.543+0000 7fadaa59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fadac0c5ce0 0x7fadac135750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:08.550 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.543+0000 7fadaa59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fadac0c5ce0 0x7fadac135750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56010/0 (socket says 172.21.15.57:56010) 2023-10-06T03:01:08.550 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.543+0000 7fadaa59c700 1 -- 172.21.15.57:0/4093466302 learned_addr learned my addr 172.21.15.57:0/4093466302 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:08.550 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.543+0000 7fada9d9b700 1 --2- 172.21.15.57:0/4093466302 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fadac0cb0f0 0x7fadac067050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:08.550 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.543+0000 7fadaad9d700 1 --2- 172.21.15.57:0/4093466302 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fadac142d40 0x7fadac067590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:08.550 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.543+0000 7fadaa59c700 1 -- 172.21.15.57:0/4093466302 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fadac0cb0f0 msgr2=0x7fadac067050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:08.550 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.543+0000 7fadaa59c700 1 --2- 172.21.15.57:0/4093466302 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fadac0cb0f0 0x7fadac067050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:08.550 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.543+0000 7fadaa59c700 1 -- 172.21.15.57:0/4093466302 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fadac142d40 msgr2=0x7fadac067590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:08.550 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.543+0000 7fadaa59c700 1 --2- 172.21.15.57:0/4093466302 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fadac142d40 0x7fadac067590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:08.550 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.543+0000 7fadaa59c700 1 -- 172.21.15.57:0/4093466302 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fada0009420 con 0x7fadac0c5ce0 2023-10-06T03:01:08.551 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.543+0000 7fadaa59c700 1 --2- 172.21.15.57:0/4093466302 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fadac0c5ce0 0x7fadac135750 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fad9c00c790 tx=0x7fad9c007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:08.551 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.543+0000 7fad9a7fc700 1 -- 172.21.15.57:0/4093466302 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad9c005b30 con 0x7fadac0c5ce0 2023-10-06T03:01:08.551 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.543+0000 7fad9a7fc700 1 -- 172.21.15.57:0/4093466302 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad9c005c90 con 0x7fadac0c5ce0 2023-10-06T03:01:08.552 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.543+0000 7fadb0e78700 1 -- 172.21.15.57:0/4093466302 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadac131990 con 0x7fadac0c5ce0 2023-10-06T03:01:08.552 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.543+0000 7fad9a7fc700 1 -- 172.21.15.57:0/4093466302 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad9c007300 con 0x7fadac0c5ce0 2023-10-06T03:01:08.552 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.543+0000 7fadb0e78700 1 -- 172.21.15.57:0/4093466302 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadac132470 con 0x7fadac0c5ce0 2023-10-06T03:01:08.552 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.547+0000 7fadb0e78700 1 -- 172.21.15.57:0/4093466302 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadac142130 con 0x7fadac0c5ce0 2023-10-06T03:01:08.552 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.547+0000 7fad9a7fc700 1 -- 172.21.15.57:0/4093466302 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fad9c01b400 con 0x7fadac0c5ce0 2023-10-06T03:01:08.554 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.547+0000 7fad9a7fc700 1 --2- 172.21.15.57:0/4093466302 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fad8c060550 0x7fad8c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:08.554 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.547+0000 7fad9a7fc700 1 -- 172.21.15.57:0/4093466302 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fad9c07c4d0 con 0x7fadac0c5ce0 2023-10-06T03:01:08.555 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.551+0000 7fada9d9b700 1 --2- 172.21.15.57:0/4093466302 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fad8c060550 0x7fad8c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:08.556 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.551+0000 7fada9d9b700 1 --2- 172.21.15.57:0/4093466302 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fad8c060550 0x7fad8c062a00 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fada00091e0 tx=0x7fada0017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:08.561 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.555+0000 7fad9a7fc700 1 -- 172.21.15.57:0/4093466302 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fadac142130 con 0x7fadac0c5ce0 2023-10-06T03:01:08.736 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.731+0000 7fadb0e78700 1 -- 172.21.15.57:0/4093466302 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fadac142130 con 0x7fadac0c5ce0 2023-10-06T03:01:08.736 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.731+0000 7fad9a7fc700 1 -- 172.21.15.57:0/4093466302 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7fadac142130 con 0x7fadac0c5ce0 2023-10-06T03:01:08.736 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2023-10-06T03:01:08.739 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.735+0000 7fadb0e78700 1 -- 172.21.15.57:0/4093466302 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fad8c060550 msgr2=0x7fad8c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:08.739 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.735+0000 7fadb0e78700 1 --2- 172.21.15.57:0/4093466302 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fad8c060550 0x7fad8c062a00 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fada00091e0 tx=0x7fada0017000 comp rx=0 tx=0).stop 2023-10-06T03:01:08.739 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.735+0000 7fadb0e78700 1 -- 172.21.15.57:0/4093466302 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fadac0c5ce0 msgr2=0x7fadac135750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:08.740 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.735+0000 7fadb0e78700 1 --2- 172.21.15.57:0/4093466302 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fadac0c5ce0 0x7fadac135750 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fad9c00c790 tx=0x7fad9c007ea0 comp rx=0 tx=0).stop 2023-10-06T03:01:08.740 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.735+0000 7fadb0e78700 1 -- 172.21.15.57:0/4093466302 shutdown_connections 2023-10-06T03:01:08.740 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.735+0000 7fadb0e78700 1 --2- 172.21.15.57:0/4093466302 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fadac142d40 0x7fadac067590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:08.740 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.735+0000 7fadb0e78700 1 --2- 172.21.15.57:0/4093466302 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fad8c060550 0x7fad8c062a00 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:08.740 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.735+0000 7fadb0e78700 1 --2- 172.21.15.57:0/4093466302 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fadac0cb0f0 0x7fadac067050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:08.740 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.735+0000 7fadb0e78700 1 --2- 172.21.15.57:0/4093466302 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fadac0c5ce0 0x7fadac135750 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:08.740 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.735+0000 7fadb0e78700 1 -- 172.21.15.57:0/4093466302 >> 172.21.15.57:0/4093466302 conn(0x7fadac0ccbd0 msgr2=0x7fadac0ce0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:08.740 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.735+0000 7fadb0e78700 1 -- 172.21.15.57:0/4093466302 shutdown_connections 2023-10-06T03:01:08.740 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.735+0000 7fadb0e78700 1 -- 172.21.15.57:0/4093466302 wait complete. 2023-10-06T03:01:08.761 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T03:01:08.928 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.923+0000 7f1ad7585700 1 Processor -- start 2023-10-06T03:01:08.929 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.923+0000 7f1ad7585700 1 -- start start 2023-10-06T03:01:08.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.927+0000 7f1ad7585700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1ad00c7160 0x7f1ad006b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:08.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.927+0000 7f1ad7585700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1ad00bf310 0x7f1ad006b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:08.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.927+0000 7f1ad7585700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ad00ac530 con 0x7f1ad00bef40 2023-10-06T03:01:08.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.927+0000 7f1ad7585700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ad006dc60 con 0x7f1ad00bf310 2023-10-06T03:01:08.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.927+0000 7f1ad7585700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad006bed0 con 0x7f1ad00c7160 2023-10-06T03:01:08.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.927+0000 7f1ad5b22700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1ad00bf310 0x7f1ad006b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:08.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.927+0000 7f1ad5b22700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1ad00bf310 0x7f1ad006b7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56012/0 (socket says 172.21.15.57:56012) 2023-10-06T03:01:08.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.927+0000 7f1ad5b22700 1 -- 172.21.15.57:0/2550017349 learned_addr learned my addr 172.21.15.57:0/2550017349 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:08.933 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.927+0000 7f1ad4b20700 1 --2- 172.21.15.57:0/2550017349 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1ad00c7160 0x7f1ad006b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:08.933 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.927+0000 7f1ad5b22700 1 -- 172.21.15.57:0/2550017349 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1ad00c7160 msgr2=0x7f1ad006b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:08.933 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.927+0000 7f1ad5b22700 1 --2- 172.21.15.57:0/2550017349 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1ad00c7160 0x7f1ad006b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:08.933 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.927+0000 7f1ad5b22700 1 -- 172.21.15.57:0/2550017349 >> v1:172.21.15.105:6789/0 conn(0x7f1ad00bef40 legacy=0x7f1ad00c6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:08.933 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.927+0000 7f1ad5b22700 1 -- 172.21.15.57:0/2550017349 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ad006c1b0 con 0x7f1ad00bf310 2023-10-06T03:01:08.933 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.927+0000 7f1ad5b22700 1 --2- 172.21.15.57:0/2550017349 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1ad00bf310 0x7f1ad006b7e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1ac8009f20 tx=0x7f1ac8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca5e7bd4d8b12aa4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:08.934 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.927+0000 7f1ac7fff700 1 -- 172.21.15.57:0/2550017349 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ac800e070 con 0x7f1ad00bf310 2023-10-06T03:01:08.934 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.927+0000 7f1ac7fff700 1 -- 172.21.15.57:0/2550017349 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ac800bb10 con 0x7f1ad00bf310 2023-10-06T03:01:08.934 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.927+0000 7f1ac7fff700 1 -- 172.21.15.57:0/2550017349 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ac80092e0 con 0x7f1ad00bf310 2023-10-06T03:01:08.935 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.931+0000 7f1ad7585700 1 -- 172.21.15.57:0/2550017349 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1ad00bf310 msgr2=0x7f1ad006b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:08.935 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.931+0000 7f1ad7585700 1 --2- 172.21.15.57:0/2550017349 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1ad00bf310 0x7f1ad006b7e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1ac8009f20 tx=0x7f1ac8009840 comp rx=0 tx=0).stop 2023-10-06T03:01:08.935 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.931+0000 7f1ad7585700 1 -- 172.21.15.57:0/2550017349 shutdown_connections 2023-10-06T03:01:08.935 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.931+0000 7f1ad7585700 1 --2- 172.21.15.57:0/2550017349 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1ad00bf310 0x7f1ad006b7e0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:08.935 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.931+0000 7f1ad7585700 1 --2- 172.21.15.57:0/2550017349 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1ad00c7160 0x7f1ad006b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:08.935 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.931+0000 7f1ad7585700 1 -- 172.21.15.57:0/2550017349 >> 172.21.15.57:0/2550017349 conn(0x7f1ad00c87b0 msgr2=0x7f1ad00c8bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:08.936 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.931+0000 7f1ad7585700 1 -- 172.21.15.57:0/2550017349 shutdown_connections 2023-10-06T03:01:08.936 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.931+0000 7f1ad7585700 1 -- 172.21.15.57:0/2550017349 wait complete. 2023-10-06T03:01:08.938 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.931+0000 7f1ad7585700 1 Processor -- start 2023-10-06T03:01:08.939 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.935+0000 7f1ad7585700 1 -- start start 2023-10-06T03:01:08.943 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.935+0000 7f1ad7585700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1ad00bef40 0x7f1ad00b04f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:08.943 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.935+0000 7f1ad7585700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1ad00bf310 0x7f1ad015f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:08.944 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.935+0000 7f1ad7585700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1ad00c7160 0x7f1ad015fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:08.944 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.935+0000 7f1ad7585700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad015bc20 con 0x7f1ad00bf310 2023-10-06T03:01:08.944 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.935+0000 7f1ad7585700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad00b1420 con 0x7f1ad00bef40 2023-10-06T03:01:08.944 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.935+0000 7f1ad7585700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad00b0e60 con 0x7f1ad00c7160 2023-10-06T03:01:08.944 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.935+0000 7f1ad4b20700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1ad00bf310 0x7f1ad015f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:08.944 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.935+0000 7f1ad4b20700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1ad00bf310 0x7f1ad015f960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56026/0 (socket says 172.21.15.57:56026) 2023-10-06T03:01:08.944 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.935+0000 7f1ad4b20700 1 -- 172.21.15.57:0/2325421679 learned_addr learned my addr 172.21.15.57:0/2325421679 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:08.944 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.935+0000 7f1ad5b22700 1 --2- 172.21.15.57:0/2325421679 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1ad00c7160 0x7f1ad015fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:08.944 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.935+0000 7f1ad5321700 1 --2- 172.21.15.57:0/2325421679 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1ad00bef40 0x7f1ad00b04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:08.944 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.935+0000 7f1ad4b20700 1 -- 172.21.15.57:0/2325421679 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1ad00c7160 msgr2=0x7f1ad015fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:08.944 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.935+0000 7f1ad4b20700 1 --2- 172.21.15.57:0/2325421679 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1ad00c7160 0x7f1ad015fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:08.944 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.935+0000 7f1ad4b20700 1 -- 172.21.15.57:0/2325421679 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1ad00bef40 msgr2=0x7f1ad00b04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:08.945 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.935+0000 7f1ad4b20700 1 --2- 172.21.15.57:0/2325421679 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1ad00bef40 0x7f1ad00b04f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:08.945 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.935+0000 7f1ad4b20700 1 -- 172.21.15.57:0/2325421679 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ac8009ae0 con 0x7f1ad00bf310 2023-10-06T03:01:08.945 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.935+0000 7f1ad5321700 1 --2- 172.21.15.57:0/2325421679 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1ad00bef40 0x7f1ad00b04f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:01:08.945 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.939+0000 7f1ad4b20700 1 --2- 172.21.15.57:0/2325421679 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1ad00bf310 0x7f1ad015f960 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1ac000d890 tx=0x7f1ac0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:08.945 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.939+0000 7f1ac57fa700 1 -- 172.21.15.57:0/2325421679 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ac00125f0 con 0x7f1ad00bf310 2023-10-06T03:01:08.945 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.939+0000 7f1ac57fa700 1 -- 172.21.15.57:0/2325421679 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ac0012770 con 0x7f1ad00bf310 2023-10-06T03:01:08.945 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.939+0000 7f1ad7585700 1 -- 172.21.15.57:0/2325421679 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ad00b1140 con 0x7f1ad00bf310 2023-10-06T03:01:08.945 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.939+0000 7f1ac57fa700 1 -- 172.21.15.57:0/2325421679 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ac0012b30 con 0x7f1ad00bf310 2023-10-06T03:01:08.945 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.939+0000 7f1ad7585700 1 -- 172.21.15.57:0/2325421679 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ad0161740 con 0x7f1ad00bf310 2023-10-06T03:01:08.946 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.939+0000 7f1ad7585700 1 -- 172.21.15.57:0/2325421679 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ad0067dc0 con 0x7f1ad00bf310 2023-10-06T03:01:08.946 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.943+0000 7f1ac57fa700 1 -- 172.21.15.57:0/2325421679 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f1ac001e460 con 0x7f1ad00bf310 2023-10-06T03:01:08.948 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.943+0000 7f1ac57fa700 1 --2- 172.21.15.57:0/2325421679 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f1ab4060550 0x7f1ab4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:08.948 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.943+0000 7f1ac57fa700 1 -- 172.21.15.57:0/2325421679 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1ac007cff0 con 0x7f1ad00bf310 2023-10-06T03:01:08.949 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.943+0000 7f1ad5321700 1 --2- 172.21.15.57:0/2325421679 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f1ab4060550 0x7f1ab4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:08.949 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.943+0000 7f1ad5321700 1 --2- 172.21.15.57:0/2325421679 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f1ab4060550 0x7f1ab4062a00 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1acc0017a0 tx=0x7f1acc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:08.955 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:08.951+0000 7f1ac57fa700 1 -- 172.21.15.57:0/2325421679 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f1ac00acbe0 con 0x7f1ad00bf310 2023-10-06T03:01:09.125 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.119+0000 7f1ad7585700 1 -- 172.21.15.57:0/2325421679 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f1ad0161b90 con 0x7f1ad00bf310 2023-10-06T03:01:09.126 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.119+0000 7f1ac57fa700 1 -- 172.21.15.57:0/2325421679 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1ad0067dc0 con 0x7f1ad00bf310 2023-10-06T03:01:09.126 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2023-10-06T03:01:09.128 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.123+0000 7f1ad7585700 1 -- 172.21.15.57:0/2325421679 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f1ab4060550 msgr2=0x7f1ab4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:09.128 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.123+0000 7f1ad7585700 1 --2- 172.21.15.57:0/2325421679 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f1ab4060550 0x7f1ab4062a00 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1acc0017a0 tx=0x7f1acc009040 comp rx=0 tx=0).stop 2023-10-06T03:01:09.128 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.123+0000 7f1ad7585700 1 -- 172.21.15.57:0/2325421679 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1ad00bf310 msgr2=0x7f1ad015f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:09.128 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.123+0000 7f1ad7585700 1 --2- 172.21.15.57:0/2325421679 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1ad00bf310 0x7f1ad015f960 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1ac000d890 tx=0x7f1ac0008040 comp rx=0 tx=0).stop 2023-10-06T03:01:09.129 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.123+0000 7f1ad7585700 1 -- 172.21.15.57:0/2325421679 shutdown_connections 2023-10-06T03:01:09.129 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.123+0000 7f1ad7585700 1 --2- 172.21.15.57:0/2325421679 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f1ab4060550 0x7f1ab4062a00 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.129 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.123+0000 7f1ad7585700 1 --2- 172.21.15.57:0/2325421679 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1ad00c7160 0x7f1ad015fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.129 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.123+0000 7f1ad7585700 1 --2- 172.21.15.57:0/2325421679 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1ad00bf310 0x7f1ad015f960 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.129 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.123+0000 7f1ad7585700 1 --2- 172.21.15.57:0/2325421679 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1ad00bef40 0x7f1ad00b04f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.123+0000 7f1ad7585700 1 -- 172.21.15.57:0/2325421679 >> 172.21.15.57:0/2325421679 conn(0x7f1ad00c87b0 msgr2=0x7f1ad006a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:09.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.123+0000 7f1ad7585700 1 -- 172.21.15.57:0/2325421679 shutdown_connections 2023-10-06T03:01:09.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.123+0000 7f1ad7585700 1 -- 172.21.15.57:0/2325421679 wait complete. 2023-10-06T03:01:09.148 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T03:01:09.312 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.307+0000 7fb126443700 1 Processor -- start 2023-10-06T03:01:09.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.307+0000 7fb126443700 1 -- start start 2023-10-06T03:01:09.317 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.311+0000 7fb126443700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb120140910 0x7fb1200c6b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.317 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.311+0000 7fb126443700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb120067ba0 0x7fb1200c7060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.317 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.311+0000 7fb126443700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb120157740 con 0x7fb120140540 2023-10-06T03:01:09.317 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.311+0000 7fb126443700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb120068070 con 0x7fb120067ba0 2023-10-06T03:01:09.317 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.311+0000 7fb126443700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb120068350 con 0x7fb120140910 2023-10-06T03:01:09.318 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.311+0000 7fb125c42700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb120067ba0 0x7fb1200c7060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.318 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.311+0000 7fb125c42700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb120067ba0 0x7fb1200c7060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56032/0 (socket says 172.21.15.57:56032) 2023-10-06T03:01:09.318 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.311+0000 7fb125c42700 1 -- 172.21.15.57:0/2287446985 learned_addr learned my addr 172.21.15.57:0/2287446985 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:09.318 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.311+0000 7fb124c40700 1 --2- 172.21.15.57:0/2287446985 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb120140910 0x7fb1200c6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.318 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.311+0000 7fb125c42700 1 -- 172.21.15.57:0/2287446985 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb120140910 msgr2=0x7fb1200c6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:09.319 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.311+0000 7fb125c42700 1 --2- 172.21.15.57:0/2287446985 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb120140910 0x7fb1200c6b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.319 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.311+0000 7fb125c42700 1 -- 172.21.15.57:0/2287446985 >> v1:172.21.15.105:6789/0 conn(0x7fb120140540 legacy=0x7fb120067490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:09.319 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.311+0000 7fb125c42700 1 -- 172.21.15.57:0/2287446985 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb120068630 con 0x7fb120067ba0 2023-10-06T03:01:09.320 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.315+0000 7fb125c42700 1 --2- 172.21.15.57:0/2287446985 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb120067ba0 0x7fb1200c7060 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb118009f20 tx=0x7fb118009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=270354467b171b32 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:09.320 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.315+0000 7fb117fff700 1 -- 172.21.15.57:0/2287446985 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb11800e070 con 0x7fb120067ba0 2023-10-06T03:01:09.320 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.315+0000 7fb117fff700 1 -- 172.21.15.57:0/2287446985 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb11800b9d0 con 0x7fb120067ba0 2023-10-06T03:01:09.320 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.315+0000 7fb117fff700 1 -- 172.21.15.57:0/2287446985 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1180092e0 con 0x7fb120067ba0 2023-10-06T03:01:09.321 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.315+0000 7fb126443700 1 -- 172.21.15.57:0/2287446985 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb120067ba0 msgr2=0x7fb1200c7060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:09.321 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.315+0000 7fb126443700 1 --2- 172.21.15.57:0/2287446985 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb120067ba0 0x7fb1200c7060 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb118009f20 tx=0x7fb118009840 comp rx=0 tx=0).stop 2023-10-06T03:01:09.321 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.315+0000 7fb126443700 1 -- 172.21.15.57:0/2287446985 shutdown_connections 2023-10-06T03:01:09.321 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.315+0000 7fb126443700 1 --2- 172.21.15.57:0/2287446985 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb120067ba0 0x7fb1200c7060 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.321 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.315+0000 7fb126443700 1 --2- 172.21.15.57:0/2287446985 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb120140910 0x7fb1200c6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.321 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.315+0000 7fb126443700 1 -- 172.21.15.57:0/2287446985 >> 172.21.15.57:0/2287446985 conn(0x7fb1200c8660 msgr2=0x7fb1200c8a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:09.322 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.315+0000 7fb126443700 1 -- 172.21.15.57:0/2287446985 shutdown_connections 2023-10-06T03:01:09.322 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.315+0000 7fb126443700 1 -- 172.21.15.57:0/2287446985 wait complete. 2023-10-06T03:01:09.323 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.319+0000 7fb126443700 1 Processor -- start 2023-10-06T03:01:09.324 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.319+0000 7fb126443700 1 -- start start 2023-10-06T03:01:09.326 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.319+0000 7fb126443700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb120067ba0 0x7fb12013a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.326 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.319+0000 7fb126443700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb120140540 0x7fb120156710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.326 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.319+0000 7fb126443700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb120140910 0x7fb1200ad120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.327 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.319+0000 7fb126443700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb12013b040 con 0x7fb120140910 2023-10-06T03:01:09.327 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.319+0000 7fb126443700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb12013aa80 con 0x7fb120067ba0 2023-10-06T03:01:09.327 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.319+0000 7fb126443700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb12013ad60 con 0x7fb120140540 2023-10-06T03:01:09.327 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.319+0000 7fb125c42700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb120140910 0x7fb1200ad120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.327 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.323+0000 7fb125c42700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb120140910 0x7fb1200ad120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56042/0 (socket says 172.21.15.57:56042) 2023-10-06T03:01:09.327 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.323+0000 7fb125c42700 1 -- 172.21.15.57:0/3374449300 learned_addr learned my addr 172.21.15.57:0/3374449300 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:09.328 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.323+0000 7fb124c40700 1 --2- 172.21.15.57:0/3374449300 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb120140540 0x7fb120156710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.329 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.323+0000 7fb125441700 1 --2- 172.21.15.57:0/3374449300 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb120067ba0 0x7fb12013a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.329 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.323+0000 7fb125c42700 1 -- 172.21.15.57:0/3374449300 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb120140540 msgr2=0x7fb120156710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:09.329 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.323+0000 7fb125c42700 1 --2- 172.21.15.57:0/3374449300 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb120140540 0x7fb120156710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.329 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.323+0000 7fb125c42700 1 -- 172.21.15.57:0/3374449300 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb120067ba0 msgr2=0x7fb12013a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:09.329 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.323+0000 7fb125c42700 1 --2- 172.21.15.57:0/3374449300 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb120067ba0 0x7fb12013a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.329 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.323+0000 7fb125c42700 1 -- 172.21.15.57:0/3374449300 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb118009ae0 con 0x7fb120140910 2023-10-06T03:01:09.329 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.323+0000 7fb125c42700 1 --2- 172.21.15.57:0/3374449300 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb120140910 0x7fb1200ad120 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb1201578d0 tx=0x7fb118018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:09.329 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.323+0000 7fb1157fa700 1 -- 172.21.15.57:0/3374449300 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb118008b80 con 0x7fb120140910 2023-10-06T03:01:09.330 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.323+0000 7fb1157fa700 1 -- 172.21.15.57:0/3374449300 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb118008ce0 con 0x7fb120140910 2023-10-06T03:01:09.330 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.323+0000 7fb126443700 1 -- 172.21.15.57:0/3374449300 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb12016a6a0 con 0x7fb120140910 2023-10-06T03:01:09.330 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.323+0000 7fb1157fa700 1 -- 172.21.15.57:0/3374449300 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1180266b0 con 0x7fb120140910 2023-10-06T03:01:09.330 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.323+0000 7fb126443700 1 -- 172.21.15.57:0/3374449300 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1200ad660 con 0x7fb120140910 2023-10-06T03:01:09.330 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.323+0000 7fb126443700 1 -- 172.21.15.57:0/3374449300 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb12004be40 con 0x7fb120140910 2023-10-06T03:01:09.332 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.327+0000 7fb1157fa700 1 -- 172.21.15.57:0/3374449300 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fb118003040 con 0x7fb120140910 2023-10-06T03:01:09.334 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.327+0000 7fb1157fa700 1 --2- 172.21.15.57:0/3374449300 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fb104060580 0x7fb104062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.335 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.327+0000 7fb1157fa700 1 -- 172.21.15.57:0/3374449300 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb11807e810 con 0x7fb120140910 2023-10-06T03:01:09.336 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.327+0000 7fb125441700 1 --2- 172.21.15.57:0/3374449300 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fb104060580 0x7fb104062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.336 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.331+0000 7fb125441700 1 --2- 172.21.15.57:0/3374449300 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fb104060580 0x7fb104062a30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb12015a910 tx=0x7fb11c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:09.340 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.335+0000 7fb1157fa700 1 -- 172.21.15.57:0/3374449300 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fb11804ec00 con 0x7fb120140910 2023-10-06T03:01:09.509 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.503+0000 7fb126443700 1 -- 172.21.15.57:0/3374449300 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb120068910 con 0x7fb120140910 2023-10-06T03:01:09.509 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.503+0000 7fb1157fa700 1 -- 172.21.15.57:0/3374449300 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb118052220 con 0x7fb120140910 2023-10-06T03:01:09.510 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2023-10-06T03:01:09.512 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.507+0000 7fb126443700 1 -- 172.21.15.57:0/3374449300 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fb104060580 msgr2=0x7fb104062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:09.512 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.507+0000 7fb126443700 1 --2- 172.21.15.57:0/3374449300 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fb104060580 0x7fb104062a30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb12015a910 tx=0x7fb11c009040 comp rx=0 tx=0).stop 2023-10-06T03:01:09.512 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.507+0000 7fb126443700 1 -- 172.21.15.57:0/3374449300 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb120140910 msgr2=0x7fb1200ad120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:09.512 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.507+0000 7fb126443700 1 --2- 172.21.15.57:0/3374449300 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb120140910 0x7fb1200ad120 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb1201578d0 tx=0x7fb118018000 comp rx=0 tx=0).stop 2023-10-06T03:01:09.513 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.507+0000 7fb126443700 1 -- 172.21.15.57:0/3374449300 shutdown_connections 2023-10-06T03:01:09.513 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.507+0000 7fb126443700 1 --2- 172.21.15.57:0/3374449300 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb120140910 0x7fb1200ad120 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.513 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.507+0000 7fb126443700 1 --2- 172.21.15.57:0/3374449300 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fb104060580 0x7fb104062a30 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.513 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.507+0000 7fb126443700 1 --2- 172.21.15.57:0/3374449300 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb120140540 0x7fb120156710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.514 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.507+0000 7fb126443700 1 --2- 172.21.15.57:0/3374449300 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb120067ba0 0x7fb12013a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.514 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.507+0000 7fb126443700 1 -- 172.21.15.57:0/3374449300 >> 172.21.15.57:0/3374449300 conn(0x7fb1200c8660 msgr2=0x7fb1200c1780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:09.514 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.507+0000 7fb126443700 1 -- 172.21.15.57:0/3374449300 shutdown_connections 2023-10-06T03:01:09.514 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.507+0000 7fb126443700 1 -- 172.21.15.57:0/3374449300 wait complete. 2023-10-06T03:01:09.536 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T03:01:09.704 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.699+0000 7f00be678700 1 Processor -- start 2023-10-06T03:01:09.705 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.699+0000 7f00be678700 1 -- start start 2023-10-06T03:01:09.708 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.703+0000 7f00be678700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f00b80c5ce0 0x7f00b80c60b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.708 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.703+0000 7f00be678700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00b80cb0f0 0x7f00b806bca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.708 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.703+0000 7f00be678700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f00b8142630 0x7f00b8142ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.708 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.703+0000 7f00be678700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00b806b0e0 con 0x7f00b80c5ce0 2023-10-06T03:01:09.708 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.703+0000 7f00be678700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00b80cb560 con 0x7f00b8142630 2023-10-06T03:01:09.708 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.703+0000 7f00be678700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00b80cc3a0 con 0x7f00b80cb0f0 2023-10-06T03:01:09.710 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.703+0000 7f00b7fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f00b80c5ce0 0x7f00b80c60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.710 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.703+0000 7f00b7fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f00b80c5ce0 0x7f00b80c60b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56052/0 (socket says 172.21.15.57:56052) 2023-10-06T03:01:09.710 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.703+0000 7f00b7fff700 1 -- 172.21.15.57:0/3152573023 learned_addr learned my addr 172.21.15.57:0/3152573023 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:09.710 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.703+0000 7f00af7fe700 1 --2- 172.21.15.57:0/3152573023 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00b80cb0f0 0x7f00b806bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.710 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.703+0000 7f00bcc15700 1 --2- 172.21.15.57:0/3152573023 >> v2:172.21.15.105:3300/0 conn(0x7f00b8142630 0x7f00b8142ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.710 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.703+0000 7f00b7fff700 1 -- 172.21.15.57:0/3152573023 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00b80cb0f0 msgr2=0x7f00b806bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:09.710 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.703+0000 7f00b7fff700 1 --2- 172.21.15.57:0/3152573023 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00b80cb0f0 0x7f00b806bca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.710 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.703+0000 7f00b7fff700 1 -- 172.21.15.57:0/3152573023 >> v2:172.21.15.105:3300/0 conn(0x7f00b8142630 msgr2=0x7f00b8142ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:09.710 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.703+0000 7f00b7fff700 1 --2- 172.21.15.57:0/3152573023 >> v2:172.21.15.105:3300/0 conn(0x7f00b8142630 0x7f00b8142ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.710 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.703+0000 7f00b7fff700 1 -- 172.21.15.57:0/3152573023 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00b80cb790 con 0x7f00b80c5ce0 2023-10-06T03:01:09.711 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.703+0000 7f00bcc15700 1 --2- 172.21.15.57:0/3152573023 >> v2:172.21.15.105:3300/0 conn(0x7f00b8142630 0x7f00b8142ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:01:09.711 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.703+0000 7f00b7fff700 1 --2- 172.21.15.57:0/3152573023 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00b80c5ce0 0x7f00b80c60b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f00b80c6810 tx=0x7f00a8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ded360fc93c9372 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:09.711 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.703+0000 7f00b77fe700 1 -- 172.21.15.57:0/3152573023 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a8009ea0 con 0x7f00b80c5ce0 2023-10-06T03:01:09.711 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.703+0000 7f00b77fe700 1 -- 172.21.15.57:0/3152573023 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00a800b820 con 0x7f00b80c5ce0 2023-10-06T03:01:09.711 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.703+0000 7f00b77fe700 1 -- 172.21.15.57:0/3152573023 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a800bbc0 con 0x7f00b80c5ce0 2023-10-06T03:01:09.712 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.707+0000 7f00be678700 1 -- 172.21.15.57:0/3152573023 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00b80c5ce0 msgr2=0x7f00b80c60b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:09.712 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.707+0000 7f00be678700 1 --2- 172.21.15.57:0/3152573023 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00b80c5ce0 0x7f00b80c60b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f00b80c6810 tx=0x7f00a8009250 comp rx=0 tx=0).stop 2023-10-06T03:01:09.712 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.707+0000 7f00be678700 1 -- 172.21.15.57:0/3152573023 shutdown_connections 2023-10-06T03:01:09.712 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.707+0000 7f00be678700 1 --2- 172.21.15.57:0/3152573023 >> v2:172.21.15.105:3300/0 conn(0x7f00b8142630 0x7f00b8142ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.712 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.707+0000 7f00be678700 1 --2- 172.21.15.57:0/3152573023 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00b80cb0f0 0x7f00b806bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.712 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.707+0000 7f00be678700 1 --2- 172.21.15.57:0/3152573023 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00b80c5ce0 0x7f00b80c60b0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.712 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.707+0000 7f00be678700 1 -- 172.21.15.57:0/3152573023 >> 172.21.15.57:0/3152573023 conn(0x7f00b80ccbd0 msgr2=0x7f00b80ccfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:09.712 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.707+0000 7f00be678700 1 -- 172.21.15.57:0/3152573023 shutdown_connections 2023-10-06T03:01:09.712 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.707+0000 7f00be678700 1 -- 172.21.15.57:0/3152573023 wait complete. 2023-10-06T03:01:09.713 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.707+0000 7f00be678700 1 Processor -- start 2023-10-06T03:01:09.714 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.707+0000 7f00be678700 1 -- start start 2023-10-06T03:01:09.715 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.711+0000 7f00be678700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00b80c5ce0 0x7f00b80c7210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.715 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.711+0000 7f00be678700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f00b80cb0f0 0x7f00b81599e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.716 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.711+0000 7f00be678700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00b8142630 0x7f00b8159f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.716 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.711+0000 7f00be678700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00b80c8670 con 0x7f00b80c5ce0 2023-10-06T03:01:09.716 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.711+0000 7f00be678700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00b80c7a60 con 0x7f00b80cb0f0 2023-10-06T03:01:09.716 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.711+0000 7f00be678700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00b80c7d40 con 0x7f00b8142630 2023-10-06T03:01:09.717 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.711+0000 7f00b7fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00b80c5ce0 0x7f00b80c7210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.717 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.711+0000 7f00b7fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00b80c5ce0 0x7f00b80c7210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56064/0 (socket says 172.21.15.57:56064) 2023-10-06T03:01:09.717 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.711+0000 7f00b7fff700 1 -- 172.21.15.57:0/3168883471 learned_addr learned my addr 172.21.15.57:0/3168883471 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:09.717 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.711+0000 7f00af7fe700 1 --2- 172.21.15.57:0/3168883471 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f00b80cb0f0 0x7f00b81599e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.717 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.711+0000 7f00bcc15700 1 --2- 172.21.15.57:0/3168883471 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00b8142630 0x7f00b8159f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.717 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.711+0000 7f00b7fff700 1 -- 172.21.15.57:0/3168883471 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00b8142630 msgr2=0x7f00b8159f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:09.717 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.711+0000 7f00b7fff700 1 --2- 172.21.15.57:0/3168883471 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00b8142630 0x7f00b8159f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.718 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.711+0000 7f00b7fff700 1 -- 172.21.15.57:0/3168883471 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f00b80cb0f0 msgr2=0x7f00b81599e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:09.718 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.711+0000 7f00b7fff700 1 --2- 172.21.15.57:0/3168883471 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f00b80cb0f0 0x7f00b81599e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.718 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.711+0000 7f00b7fff700 1 -- 172.21.15.57:0/3168883471 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00a80094f0 con 0x7f00b80c5ce0 2023-10-06T03:01:09.718 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.711+0000 7f00b7fff700 1 --2- 172.21.15.57:0/3168883471 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00b80c5ce0 0x7f00b80c7210 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f00a80094c0 tx=0x7f00a8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:09.719 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.711+0000 7f00b4ff9700 1 -- 172.21.15.57:0/3168883471 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a800bba0 con 0x7f00b80c5ce0 2023-10-06T03:01:09.719 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.711+0000 7f00b4ff9700 1 -- 172.21.15.57:0/3168883471 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00a8011420 con 0x7f00b80c5ce0 2023-10-06T03:01:09.719 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.711+0000 7f00b4ff9700 1 -- 172.21.15.57:0/3168883471 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a80117c0 con 0x7f00b80c5ce0 2023-10-06T03:01:09.719 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.711+0000 7f00be678700 1 -- 172.21.15.57:0/3168883471 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00b80c8020 con 0x7f00b80c5ce0 2023-10-06T03:01:09.719 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.711+0000 7f00be678700 1 -- 172.21.15.57:0/3168883471 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00b80c7750 con 0x7f00b80c5ce0 2023-10-06T03:01:09.720 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.715+0000 7f00be678700 1 -- 172.21.15.57:0/3168883471 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00b80712e0 con 0x7f00b80c5ce0 2023-10-06T03:01:09.721 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.715+0000 7f00b4ff9700 1 -- 172.21.15.57:0/3168883471 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f00a8011bb0 con 0x7f00b80c5ce0 2023-10-06T03:01:09.722 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.715+0000 7f00b4ff9700 1 --2- 172.21.15.57:0/3168883471 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f0098060550 0x7f0098062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:09.722 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.719+0000 7f00b4ff9700 1 -- 172.21.15.57:0/3168883471 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f00a807e200 con 0x7f00b80c5ce0 2023-10-06T03:01:09.723 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.719+0000 7f00af7fe700 1 --2- 172.21.15.57:0/3168883471 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f0098060550 0x7f0098062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:09.724 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.719+0000 7f00af7fe700 1 --2- 172.21.15.57:0/3168883471 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f0098060550 0x7f0098062a00 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f00b80b2930 tx=0x7f00a00091a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:09.729 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.723+0000 7f00b4ff9700 1 -- 172.21.15.57:0/3168883471 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f00a804e5f0 con 0x7f00b80c5ce0 2023-10-06T03:01:09.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.891+0000 7f00be678700 1 -- 172.21.15.57:0/3168883471 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f00b806ab90 con 0x7f00b80c5ce0 2023-10-06T03:01:09.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.895+0000 7f00b4ff9700 1 -- 172.21.15.57:0/3168883471 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f00a8015020 con 0x7f00b80c5ce0 2023-10-06T03:01:09.900 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 64 2023-10-06T03:01:09.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.899+0000 7f00be678700 1 -- 172.21.15.57:0/3168883471 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f0098060550 msgr2=0x7f0098062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:09.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.899+0000 7f00be678700 1 --2- 172.21.15.57:0/3168883471 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f0098060550 0x7f0098062a00 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f00b80b2930 tx=0x7f00a00091a0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.899+0000 7f00be678700 1 -- 172.21.15.57:0/3168883471 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00b80c5ce0 msgr2=0x7f00b80c7210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:09.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.899+0000 7f00be678700 1 --2- 172.21.15.57:0/3168883471 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00b80c5ce0 0x7f00b80c7210 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f00a80094c0 tx=0x7f00a8017000 comp rx=0 tx=0).stop 2023-10-06T03:01:09.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.899+0000 7f00be678700 1 -- 172.21.15.57:0/3168883471 shutdown_connections 2023-10-06T03:01:09.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.899+0000 7f00be678700 1 --2- 172.21.15.57:0/3168883471 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f0098060550 0x7f0098062a00 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.899+0000 7f00be678700 1 --2- 172.21.15.57:0/3168883471 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00b8142630 0x7f00b8159f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.899+0000 7f00be678700 1 --2- 172.21.15.57:0/3168883471 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f00b80cb0f0 0x7f00b81599e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.899+0000 7f00be678700 1 --2- 172.21.15.57:0/3168883471 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00b80c5ce0 0x7f00b80c7210 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:09.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.899+0000 7f00be678700 1 -- 172.21.15.57:0/3168883471 >> 172.21.15.57:0/3168883471 conn(0x7f00b80ccbd0 msgr2=0x7f00b8141950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:09.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.899+0000 7f00be678700 1 -- 172.21.15.57:0/3168883471 shutdown_connections 2023-10-06T03:01:09.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:09.899+0000 7f00be678700 1 -- 172.21.15.57:0/3168883471 wait complete. 2023-10-06T03:01:09.925 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:01:10.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.083+0000 7fdeaa2f0700 1 Processor -- start 2023-10-06T03:01:10.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.083+0000 7fdeaa2f0700 1 -- start start 2023-10-06T03:01:10.092 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.087+0000 7fdeaa2f0700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdea4154d90 0x7fdea415b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:10.092 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.087+0000 7fdeaa2f0700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fdea40b1490 0x7fdea41575d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:10.092 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.087+0000 7fdeaa2f0700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdea40b18d0 con 0x7fdea40b10c0 2023-10-06T03:01:10.092 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.087+0000 7fdeaa2f0700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdea406bb10 con 0x7fdea40b1490 2023-10-06T03:01:10.092 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.087+0000 7fdeaa2f0700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdea4158530 con 0x7fdea4154d90 2023-10-06T03:01:10.093 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.087+0000 7fdea3fff700 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7fdea40b10c0 0x7fdea4154680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.57:36426/0 (socket says 172.21.15.57:36426) 2023-10-06T03:01:10.093 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.087+0000 7fdea3fff700 1 -- 172.21.15.57:0/3920399241 learned_addr learned my addr 172.21.15.57:0/3920399241 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:01:10.093 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.087+0000 7fde9bfff700 1 --2- 172.21.15.57:0/3920399241 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdea4154d90 0x7fdea415b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:10.093 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.087+0000 7fdea888d700 1 --2- 172.21.15.57:0/3920399241 >> v2:172.21.15.57:3300/0 conn(0x7fdea40b1490 0x7fdea41575d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:10.093 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.087+0000 7fdea37fe700 1 -- 172.21.15.57:0/3920399241 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3508873600 0 0) 0x7fdea40b18d0 con 0x7fdea40b10c0 2023-10-06T03:01:10.094 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.087+0000 7fdea37fe700 1 -- 172.21.15.57:0/3920399241 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde90003570 con 0x7fdea40b10c0 2023-10-06T03:01:10.094 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.087+0000 7fde9bfff700 1 -- 172.21.15.57:0/3920399241 >> v2:172.21.15.57:3300/0 conn(0x7fdea40b1490 msgr2=0x7fdea41575d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:10.094 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.087+0000 7fde9bfff700 1 --2- 172.21.15.57:0/3920399241 >> v2:172.21.15.57:3300/0 conn(0x7fdea40b1490 0x7fdea41575d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:10.094 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.087+0000 7fde9bfff700 1 -- 172.21.15.57:0/3920399241 >> v1:172.21.15.105:6789/0 conn(0x7fdea40b10c0 legacy=0x7fdea4154680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:10.094 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.087+0000 7fde9bfff700 1 -- 172.21.15.57:0/3920399241 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdea4158250 con 0x7fdea4154d90 2023-10-06T03:01:10.094 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.087+0000 7fde9bfff700 1 --2- 172.21.15.57:0/3920399241 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdea4154d90 0x7fdea415b750 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fde8c0098e0 tx=0x7fde8c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d5300e6837470ee0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:10.095 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.091+0000 7fdea37fe700 1 -- 172.21.15.57:0/3920399241 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde8c011630 con 0x7fdea4154d90 2023-10-06T03:01:10.095 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.091+0000 7fdea37fe700 1 -- 172.21.15.57:0/3920399241 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde8c011790 con 0x7fdea4154d90 2023-10-06T03:01:10.095 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.091+0000 7fdea37fe700 1 -- 172.21.15.57:0/3920399241 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde8c011b30 con 0x7fdea4154d90 2023-10-06T03:01:10.096 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.091+0000 7fdeaa2f0700 1 -- 172.21.15.57:0/3920399241 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdea4154d90 msgr2=0x7fdea415b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:10.096 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.091+0000 7fdeaa2f0700 1 --2- 172.21.15.57:0/3920399241 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdea4154d90 0x7fdea415b750 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fde8c0098e0 tx=0x7fde8c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:01:10.096 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.091+0000 7fdeaa2f0700 1 -- 172.21.15.57:0/3920399241 shutdown_connections 2023-10-06T03:01:10.096 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.091+0000 7fdeaa2f0700 1 --2- 172.21.15.57:0/3920399241 >> v2:172.21.15.57:3300/0 conn(0x7fdea40b1490 0x7fdea41575d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:10.097 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.091+0000 7fdeaa2f0700 1 --2- 172.21.15.57:0/3920399241 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdea4154d90 0x7fdea415b750 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:10.097 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.091+0000 7fdeaa2f0700 1 -- 172.21.15.57:0/3920399241 >> 172.21.15.57:0/3920399241 conn(0x7fdea40cbdd0 msgr2=0x7fdea40cc1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:10.097 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.091+0000 7fdeaa2f0700 1 -- 172.21.15.57:0/3920399241 shutdown_connections 2023-10-06T03:01:10.097 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.091+0000 7fdeaa2f0700 1 -- 172.21.15.57:0/3920399241 wait complete. 2023-10-06T03:01:10.098 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.091+0000 7fdeaa2f0700 1 Processor -- start 2023-10-06T03:01:10.098 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.091+0000 7fdeaa2f0700 1 -- start start 2023-10-06T03:01:10.100 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.095+0000 7fdeaa2f0700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdea40b10c0 0x7fdea4152e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:10.100 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.095+0000 7fdeaa2f0700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdea40b1490 0x7fdea4155c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:10.100 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.095+0000 7fdeaa2f0700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdea4154d90 0x7fdea40c5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:10.100 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.095+0000 7fdeaa2f0700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdea40c5690 con 0x7fdea40b1490 2023-10-06T03:01:10.100 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.095+0000 7fdeaa2f0700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdea40ab0a0 con 0x7fdea4154d90 2023-10-06T03:01:10.100 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.095+0000 7fdeaa2f0700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdea40ab380 con 0x7fdea40b10c0 2023-10-06T03:01:10.100 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.095+0000 7fde9bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdea40b1490 0x7fdea4155c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:10.101 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.095+0000 7fde9bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdea40b1490 0x7fdea4155c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56076/0 (socket says 172.21.15.57:56076) 2023-10-06T03:01:10.101 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.095+0000 7fde9bfff700 1 -- 172.21.15.57:0/2400367190 learned_addr learned my addr 172.21.15.57:0/2400367190 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:10.101 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.095+0000 7fdea3fff700 1 --2- 172.21.15.57:0/2400367190 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdea40b10c0 0x7fdea4152e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:10.102 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.095+0000 7fdea888d700 1 --2- 172.21.15.57:0/2400367190 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdea4154d90 0x7fdea40c5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:10.102 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.095+0000 7fde9bfff700 1 -- 172.21.15.57:0/2400367190 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdea40b10c0 msgr2=0x7fdea4152e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:10.102 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.095+0000 7fde9bfff700 1 --2- 172.21.15.57:0/2400367190 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdea40b10c0 0x7fdea4152e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:10.102 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.095+0000 7fde9bfff700 1 -- 172.21.15.57:0/2400367190 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdea4154d90 msgr2=0x7fdea40c5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:10.102 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.095+0000 7fde9bfff700 1 --2- 172.21.15.57:0/2400367190 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdea4154d90 0x7fdea40c5b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:10.102 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.095+0000 7fde9bfff700 1 -- 172.21.15.57:0/2400367190 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde8c009420 con 0x7fdea40b1490 2023-10-06T03:01:10.102 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.095+0000 7fdea3fff700 1 --2- 172.21.15.57:0/2400367190 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdea40b10c0 0x7fdea4152e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:10.103 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.095+0000 7fde9bfff700 1 --2- 172.21.15.57:0/2400367190 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdea40b1490 0x7fdea4155c00 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fde8c013000 tx=0x7fde8c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:10.103 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.095+0000 7fdea0ff9700 1 -- 172.21.15.57:0/2400367190 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde8c011900 con 0x7fdea40b1490 2023-10-06T03:01:10.103 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.095+0000 7fdea0ff9700 1 -- 172.21.15.57:0/2400367190 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde8c011a60 con 0x7fdea40b1490 2023-10-06T03:01:10.103 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.095+0000 7fdea0ff9700 1 -- 172.21.15.57:0/2400367190 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde8c025670 con 0x7fdea40b1490 2023-10-06T03:01:10.103 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.095+0000 7fdeaa2f0700 1 -- 172.21.15.57:0/2400367190 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdea40c5040 con 0x7fdea40b1490 2023-10-06T03:01:10.103 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.095+0000 7fdeaa2f0700 1 -- 172.21.15.57:0/2400367190 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdea4156140 con 0x7fdea40b1490 2023-10-06T03:01:10.103 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.099+0000 7fdeaa2f0700 1 -- 172.21.15.57:0/2400367190 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdea40c5840 con 0x7fdea40b1490 2023-10-06T03:01:10.104 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.099+0000 7fdea0ff9700 1 -- 172.21.15.57:0/2400367190 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fde8c023070 con 0x7fdea40b1490 2023-10-06T03:01:10.105 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.099+0000 7fdea0ff9700 1 --2- 172.21.15.57:0/2400367190 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fde84060550 0x7fde84062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:10.105 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.099+0000 7fdea0ff9700 1 -- 172.21.15.57:0/2400367190 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fde8c07de10 con 0x7fdea40b1490 2023-10-06T03:01:10.105 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.099+0000 7fdea3fff700 1 --2- 172.21.15.57:0/2400367190 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fde84060550 0x7fde84062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:10.106 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.103+0000 7fdea3fff700 1 --2- 172.21.15.57:0/2400367190 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fde84060550 0x7fde84062a00 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fde940058d0 tx=0x7fde94009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:10.113 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.107+0000 7fdea0ff9700 1 -- 172.21.15.57:0/2400367190 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fdea40c5840 con 0x7fdea40b1490 2023-10-06T03:01:10.322 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.315+0000 7fdeaa2f0700 1 -- 172.21.15.57:0/2400367190 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdea40712e0 con 0x7fdea40b1490 2023-10-06T03:01:10.323 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.319+0000 7fdea0ff9700 1 -- 172.21.15.57:0/2400367190 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4594 (secure 0 0 0) 0x7fde8c015090 con 0x7fdea40b1490 2023-10-06T03:01:10.323 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:01:10.324 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6834/1042131376","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":1042131376},{"type":"v1","addr":"172.21.15.105:6834","nonce":1042131376}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4287,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6836/3619570714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":3619570714},{"type":"v1","addr":"172.21.15.57:6836","nonce":3619570714}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6837/645924568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6835","nonce":645924568},{"type":"v1","addr":"172.21.15.57:6837","nonce":645924568}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:00:57.411689+0000","modified":"2023-10-06T03:01:00.999490+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4303},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4303":{"gid":4303,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6835/1286071598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":1286071598},{"type":"v1","addr":"172.21.15.105:6835","nonce":1286071598}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T03:01:10.326 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.319+0000 7fdeaa2f0700 1 -- 172.21.15.57:0/2400367190 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fde84060550 msgr2=0x7fde84062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:10.326 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.319+0000 7fdeaa2f0700 1 --2- 172.21.15.57:0/2400367190 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fde84060550 0x7fde84062a00 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fde940058d0 tx=0x7fde94009040 comp rx=0 tx=0).stop 2023-10-06T03:01:10.326 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.319+0000 7fdeaa2f0700 1 -- 172.21.15.57:0/2400367190 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdea40b1490 msgr2=0x7fdea4155c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:10.326 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.319+0000 7fdeaa2f0700 1 --2- 172.21.15.57:0/2400367190 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdea40b1490 0x7fdea4155c00 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fde8c013000 tx=0x7fde8c017000 comp rx=0 tx=0).stop 2023-10-06T03:01:10.327 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.319+0000 7fdeaa2f0700 1 -- 172.21.15.57:0/2400367190 shutdown_connections 2023-10-06T03:01:10.327 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.319+0000 7fdeaa2f0700 1 --2- 172.21.15.57:0/2400367190 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdea4154d90 0x7fdea40c5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:10.327 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.319+0000 7fdeaa2f0700 1 --2- 172.21.15.57:0/2400367190 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdea40b1490 0x7fdea4155c00 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:10.327 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.319+0000 7fdeaa2f0700 1 --2- 172.21.15.57:0/2400367190 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fde84060550 0x7fde84062a00 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:10.327 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.319+0000 7fdeaa2f0700 1 --2- 172.21.15.57:0/2400367190 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdea40b10c0 0x7fdea4152e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:10.327 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.319+0000 7fdeaa2f0700 1 -- 172.21.15.57:0/2400367190 >> 172.21.15.57:0/2400367190 conn(0x7fdea40cbdd0 msgr2=0x7fdea41589d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:10.327 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.323+0000 7fdeaa2f0700 1 -- 172.21.15.57:0/2400367190 shutdown_connections 2023-10-06T03:01:10.327 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.323+0000 7fdeaa2f0700 1 -- 172.21.15.57:0/2400367190 wait complete. 2023-10-06T03:01:10.329 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 8 2023-10-06T03:01:10.350 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:01:10.511 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.507+0000 7f82e922e700 1 Processor -- start 2023-10-06T03:01:10.511 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.507+0000 7f82e922e700 1 -- start start 2023-10-06T03:01:10.513 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.507+0000 7f82e922e700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f82e4154d90 0x7f82e415b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:10.514 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.507+0000 7f82e922e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f82e40b1490 0x7f82e41575d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:10.514 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.507+0000 7f82e922e700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82e40b18d0 con 0x7f82e40b10c0 2023-10-06T03:01:10.514 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.507+0000 7f82e922e700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82e406bb10 con 0x7f82e4154d90 2023-10-06T03:01:10.514 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.507+0000 7f82e922e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82e4158530 con 0x7f82e40b1490 2023-10-06T03:01:10.515 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.507+0000 7f82e259c700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f82e4154d90 0x7f82e415b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:10.515 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.507+0000 7f82e259c700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f82e4154d90 0x7f82e415b750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.57:39700/0 (socket says 172.21.15.57:39700) 2023-10-06T03:01:10.515 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.507+0000 7f82e259c700 1 -- 172.21.15.57:0/2220169904 learned_addr learned my addr 172.21.15.57:0/2220169904 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:10.515 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.507+0000 7f82e2d9d700 1 --1- 172.21.15.57:0/2220169904 >> v1:172.21.15.105:6789/0 conn(0x7f82e40b10c0 0x7f82e4154680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.57:36434/0 (socket says 172.21.15.57:36434) 2023-10-06T03:01:10.515 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.511+0000 7f82e359e700 1 --2- 172.21.15.57:0/2220169904 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f82e40b1490 0x7f82e41575d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:10.516 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.511+0000 7f82e259c700 1 -- 172.21.15.57:0/2220169904 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f82e40b1490 msgr2=0x7f82e41575d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:10.516 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.511+0000 7f82e259c700 1 --2- 172.21.15.57:0/2220169904 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f82e40b1490 0x7f82e41575d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:10.516 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.511+0000 7f82e259c700 1 -- 172.21.15.57:0/2220169904 >> v1:172.21.15.105:6789/0 conn(0x7f82e40b10c0 legacy=0x7f82e4154680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:10.516 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.511+0000 7f82e259c700 1 -- 172.21.15.57:0/2220169904 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82e4158250 con 0x7f82e4154d90 2023-10-06T03:01:10.516 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.511+0000 7f82e259c700 1 --2- 172.21.15.57:0/2220169904 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82e4154d90 0x7f82e415b750 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f82d80099b0 tx=0x7f82d8009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0f1a6032dd03825 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:10.516 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.511+0000 7f82e1d9b700 1 -- 172.21.15.57:0/2220169904 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d800b860 con 0x7f82e4154d90 2023-10-06T03:01:10.517 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.511+0000 7f82e1d9b700 1 -- 172.21.15.57:0/2220169904 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82d800b9c0 con 0x7f82e4154d90 2023-10-06T03:01:10.517 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.511+0000 7f82e1d9b700 1 -- 172.21.15.57:0/2220169904 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d800bd60 con 0x7f82e4154d90 2023-10-06T03:01:10.517 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.511+0000 7f82e922e700 1 -- 172.21.15.57:0/2220169904 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82e4154d90 msgr2=0x7f82e415b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:10.517 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.511+0000 7f82e922e700 1 --2- 172.21.15.57:0/2220169904 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82e4154d90 0x7f82e415b750 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f82d80099b0 tx=0x7f82d8009250 comp rx=0 tx=0).stop 2023-10-06T03:01:10.518 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.511+0000 7f82e922e700 1 -- 172.21.15.57:0/2220169904 shutdown_connections 2023-10-06T03:01:10.518 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.511+0000 7f82e922e700 1 --2- 172.21.15.57:0/2220169904 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f82e40b1490 0x7f82e41575d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:10.518 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.511+0000 7f82e922e700 1 --2- 172.21.15.57:0/2220169904 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82e4154d90 0x7f82e415b750 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:10.518 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.511+0000 7f82e922e700 1 -- 172.21.15.57:0/2220169904 >> 172.21.15.57:0/2220169904 conn(0x7f82e40cbdd0 msgr2=0x7f82e40cc1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:10.518 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.511+0000 7f82e922e700 1 -- 172.21.15.57:0/2220169904 shutdown_connections 2023-10-06T03:01:10.518 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.511+0000 7f82e922e700 1 -- 172.21.15.57:0/2220169904 wait complete. 2023-10-06T03:01:10.520 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.515+0000 7f82e922e700 1 Processor -- start 2023-10-06T03:01:10.521 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.515+0000 7f82e922e700 1 -- start start 2023-10-06T03:01:10.523 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.515+0000 7f82e922e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82e40b10c0 0x7f82e40ab040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:10.523 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.515+0000 7f82e922e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f82e40b1490 0x7f82e40ab7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:10.523 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.519+0000 7f82e922e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f82e4154d90 0x7f82e4149920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:10.523 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.519+0000 7f82e922e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82e4149e60 con 0x7f82e40b1490 2023-10-06T03:01:10.524 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.519+0000 7f82e922e700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82e40aac70 con 0x7f82e40b10c0 2023-10-06T03:01:10.524 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.519+0000 7f82e922e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82e41691a0 con 0x7f82e4154d90 2023-10-06T03:01:10.524 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.519+0000 7f82e259c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f82e40b1490 0x7f82e40ab7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:10.524 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.519+0000 7f82e259c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f82e40b1490 0x7f82e40ab7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56084/0 (socket says 172.21.15.57:56084) 2023-10-06T03:01:10.524 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.519+0000 7f82e259c700 1 -- 172.21.15.57:0/2736294623 learned_addr learned my addr 172.21.15.57:0/2736294623 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:10.524 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.519+0000 7f82e2d9d700 1 --2- 172.21.15.57:0/2736294623 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82e40b10c0 0x7f82e40ab040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:10.524 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.519+0000 7f82e359e700 1 --2- 172.21.15.57:0/2736294623 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f82e4154d90 0x7f82e4149920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:10.525 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.519+0000 7f82e259c700 1 -- 172.21.15.57:0/2736294623 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f82e4154d90 msgr2=0x7f82e4149920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:10.526 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.519+0000 7f82e259c700 1 --2- 172.21.15.57:0/2736294623 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f82e4154d90 0x7f82e4149920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:10.526 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.519+0000 7f82e259c700 1 -- 172.21.15.57:0/2736294623 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82e40b10c0 msgr2=0x7f82e40ab040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:10.526 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.519+0000 7f82e259c700 1 --2- 172.21.15.57:0/2736294623 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82e40b10c0 0x7f82e40ab040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:10.526 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.519+0000 7f82e259c700 1 -- 172.21.15.57:0/2736294623 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82d80094f0 con 0x7f82e40b1490 2023-10-06T03:01:10.526 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.519+0000 7f82e359e700 1 --2- 172.21.15.57:0/2736294623 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f82e4154d90 0x7f82e4149920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:10.527 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.519+0000 7f82e259c700 1 --2- 172.21.15.57:0/2736294623 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f82e40b1490 0x7f82e40ab7b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f82d8009fd0 tx=0x7f82d8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:10.527 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.519+0000 7f82caffd700 1 -- 172.21.15.57:0/2736294623 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d8024440 con 0x7f82e40b1490 2023-10-06T03:01:10.527 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.519+0000 7f82caffd700 1 -- 172.21.15.57:0/2736294623 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82d80245a0 con 0x7f82e40b1490 2023-10-06T03:01:10.527 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.519+0000 7f82e922e700 1 -- 172.21.15.57:0/2736294623 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82e40abeb0 con 0x7f82e40b1490 2023-10-06T03:01:10.527 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.519+0000 7f82caffd700 1 -- 172.21.15.57:0/2736294623 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d8024920 con 0x7f82e40b1490 2023-10-06T03:01:10.528 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.519+0000 7f82e922e700 1 -- 172.21.15.57:0/2736294623 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82e40ac470 con 0x7f82e40b1490 2023-10-06T03:01:10.528 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.523+0000 7f82e922e700 1 -- 172.21.15.57:0/2736294623 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82e40712e0 con 0x7f82e40b1490 2023-10-06T03:01:10.529 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.523+0000 7f82caffd700 1 -- 172.21.15.57:0/2736294623 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f82d8024d50 con 0x7f82e40b1490 2023-10-06T03:01:10.531 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.527+0000 7f82caffd700 1 --2- 172.21.15.57:0/2736294623 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f82d0060550 0x7f82d0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:10.531 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.527+0000 7f82caffd700 1 -- 172.21.15.57:0/2736294623 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f82d807e3d0 con 0x7f82e40b1490 2023-10-06T03:01:10.532 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.527+0000 7f82e2d9d700 1 --2- 172.21.15.57:0/2736294623 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f82d0060550 0x7f82d0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:10.532 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.527+0000 7f82e2d9d700 1 --2- 172.21.15.57:0/2736294623 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f82d0060550 0x7f82d0062a00 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f82e406e440 tx=0x7f82d4000f40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:10.536 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.531+0000 7f82caffd700 1 -- 172.21.15.57:0/2736294623 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f82d804e840 con 0x7f82e40b1490 2023-10-06T03:01:10.711 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.707+0000 7f82e922e700 1 -- 172.21.15.57:0/2736294623 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f82e415ac70 con 0x7f82e40b1490 2023-10-06T03:01:10.713 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.707+0000 7f82caffd700 1 -- 172.21.15.57:0/2736294623 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16866 (secure 0 0 0) 0x7f82d8051e60 con 0x7f82e40b1490 2023-10-06T03:01:10.714 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:01:10.714 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":23,"fsid":"eb56dc0f-9213-41cb-9aad-8ade6c802e98","created":"2023-10-06T03:00:30.806197+0000","modified":"2023-10-06T03:00:58.975366+0000","last_up_change":"2023-10-06T03:00:43.607454+0000","last_in_change":"2023-10-06T03:00:33.943513+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T03:00:44.360651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T03:00:50.466601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:00:55.472586+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T03:00:56.400884+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"58cf6c90-d704-43e0-b2db-dffe526d5e8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":33053},{"type":"v1","addr":"172.21.15.57:6801","nonce":33053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":33053},{"type":"v1","addr":"172.21.15.57:6803","nonce":33053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":33053},{"type":"v1","addr":"172.21.15.57:6807","nonce":33053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":33053},{"type":"v1","addr":"172.21.15.57:6805","nonce":33053}]},"public_addr":"172.21.15.57:6801/33053","cluster_addr":"172.21.15.57:6803/33053","heartbeat_back_addr":"172.21.15.57:6807/33053","heartbeat_front_addr":"172.21.15.57:6805/33053","state":["exists","up"]},{"osd":1,"uuid":"16afbe70-7f9e-4568-9c92-763e6e348119","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6809","nonce":33052},{"type":"v1","addr":"172.21.15.57:6810","nonce":33052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":33052},{"type":"v1","addr":"172.21.15.57:6813","nonce":33052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":33052},{"type":"v1","addr":"172.21.15.57:6822","nonce":33052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6815","nonce":33052},{"type":"v1","addr":"172.21.15.57:6818","nonce":33052}]},"public_addr":"172.21.15.57:6810/33052","cluster_addr":"172.21.15.57:6813/33052","heartbeat_back_addr":"172.21.15.57:6822/33052","heartbeat_front_addr":"172.21.15.57:6818/33052","state":["exists","up"]},{"osd":2,"uuid":"7255c62e-f92f-470f-a5ce-30228920d9f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":33058},{"type":"v1","addr":"172.21.15.57:6825","nonce":33058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":33058},{"type":"v1","addr":"172.21.15.57:6827","nonce":33058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":33058},{"type":"v1","addr":"172.21.15.57:6831","nonce":33058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":33058},{"type":"v1","addr":"172.21.15.57:6829","nonce":33058}]},"public_addr":"172.21.15.57:6825/33058","cluster_addr":"172.21.15.57:6827/33058","heartbeat_back_addr":"172.21.15.57:6831/33058","heartbeat_front_addr":"172.21.15.57:6829/33058","state":["exists","up"]},{"osd":3,"uuid":"152a236d-f799-4888-8544-74865508d5a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":33057},{"type":"v1","addr":"172.21.15.57:6811","nonce":33057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":33057},{"type":"v1","addr":"172.21.15.57:6816","nonce":33057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6821","nonce":33057},{"type":"v1","addr":"172.21.15.57:6823","nonce":33057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6817","nonce":33057},{"type":"v1","addr":"172.21.15.57:6819","nonce":33057}]},"public_addr":"172.21.15.57:6811/33057","cluster_addr":"172.21.15.57:6816/33057","heartbeat_back_addr":"172.21.15.57:6823/33057","heartbeat_front_addr":"172.21.15.57:6819/33057","state":["exists","up"]},{"osd":4,"uuid":"37db2a65-3566-41d0-9d60-e66c49e1e68e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":33368},{"type":"v1","addr":"172.21.15.105:6801","nonce":33368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":33368},{"type":"v1","addr":"172.21.15.105:6803","nonce":33368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":33368},{"type":"v1","addr":"172.21.15.105:6807","nonce":33368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":33368},{"type":"v1","addr":"172.21.15.105:6805","nonce":33368}]},"public_addr":"172.21.15.105:6801/33368","cluster_addr":"172.21.15.105:6803/33368","heartbeat_back_addr":"172.21.15.105:6807/33368","heartbeat_front_addr":"172.21.15.105:6805/33368","state":["exists","up"]},{"osd":5,"uuid":"35e77918-1bb4-42ca-9b20-f3c14eaa0c04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":33379},{"type":"v1","addr":"172.21.15.105:6818","nonce":33379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":33379},{"type":"v1","addr":"172.21.15.105:6823","nonce":33379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":33379},{"type":"v1","addr":"172.21.15.105:6831","nonce":33379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":33379},{"type":"v1","addr":"172.21.15.105:6827","nonce":33379}]},"public_addr":"172.21.15.105:6818/33379","cluster_addr":"172.21.15.105:6823/33379","heartbeat_back_addr":"172.21.15.105:6831/33379","heartbeat_front_addr":"172.21.15.105:6827/33379","state":["exists","up"]},{"osd":6,"uuid":"b4d9d510-7a45-4173-8287-c6c8d6547f2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":33369},{"type":"v1","addr":"172.21.15.105:6819","nonce":33369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":33369},{"type":"v1","addr":"172.21.15.105:6822","nonce":33369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":33369},{"type":"v1","addr":"172.21.15.105:6830","nonce":33369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":33369},{"type":"v1","addr":"172.21.15.105:6826","nonce":33369}]},"public_addr":"172.21.15.105:6819/33369","cluster_addr":"172.21.15.105:6822/33369","heartbeat_back_addr":"172.21.15.105:6830/33369","heartbeat_front_addr":"172.21.15.105:6826/33369","state":["exists","up"]},{"osd":7,"uuid":"74266fb0-cd84-463f-8bf0-092652a71dc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":33370},{"type":"v1","addr":"172.21.15.105:6809","nonce":33370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":33370},{"type":"v1","addr":"172.21.15.105:6811","nonce":33370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":33370},{"type":"v1","addr":"172.21.15.105:6815","nonce":33370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":33370},{"type":"v1","addr":"172.21.15.105:6813","nonce":33370}]},"public_addr":"172.21.15.105:6809/33370","cluster_addr":"172.21.15.105:6811/33370","heartbeat_back_addr":"172.21.15.105:6815/33370","heartbeat_front_addr":"172.21.15.105:6813/33370","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.596864+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.633851+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.636993+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.529681+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.608601+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.659752+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.661717+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.642221+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:01:10.717 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.711+0000 7f82e922e700 1 -- 172.21.15.57:0/2736294623 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f82d0060550 msgr2=0x7f82d0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:10.717 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.711+0000 7f82e922e700 1 --2- 172.21.15.57:0/2736294623 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f82d0060550 0x7f82d0062a00 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f82e406e440 tx=0x7f82d4000f40 comp rx=0 tx=0).stop 2023-10-06T03:01:10.717 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.711+0000 7f82e922e700 1 -- 172.21.15.57:0/2736294623 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f82e40b1490 msgr2=0x7f82e40ab7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:10.717 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.711+0000 7f82e922e700 1 --2- 172.21.15.57:0/2736294623 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f82e40b1490 0x7f82e40ab7b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f82d8009fd0 tx=0x7f82d8017000 comp rx=0 tx=0).stop 2023-10-06T03:01:10.718 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.711+0000 7f82e922e700 1 -- 172.21.15.57:0/2736294623 shutdown_connections 2023-10-06T03:01:10.718 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.711+0000 7f82e922e700 1 --2- 172.21.15.57:0/2736294623 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f82d0060550 0x7f82d0062a00 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:10.718 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.711+0000 7f82e922e700 1 --2- 172.21.15.57:0/2736294623 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f82e4154d90 0x7f82e4149920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:10.718 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.711+0000 7f82e922e700 1 --2- 172.21.15.57:0/2736294623 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f82e40b1490 0x7f82e40ab7b0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:10.718 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.711+0000 7f82e922e700 1 --2- 172.21.15.57:0/2736294623 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82e40b10c0 0x7f82e40ab040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:10.718 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.711+0000 7f82e922e700 1 -- 172.21.15.57:0/2736294623 >> 172.21.15.57:0/2736294623 conn(0x7f82e40cbdd0 msgr2=0x7f82e4154660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:10.719 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.711+0000 7f82e922e700 1 -- 172.21.15.57:0/2736294623 shutdown_connections 2023-10-06T03:01:10.719 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.711+0000 7f82e922e700 1 -- 172.21.15.57:0/2736294623 wait complete. 2023-10-06T03:01:10.740 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T03:00:44.360651+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T03:00:50.466601+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T03:00:55.472586+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T03:00:56.400884+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T03:01:10.740 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T03:01:10.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.899+0000 7f3858c2e700 1 Processor -- start 2023-10-06T03:01:10.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.899+0000 7f3858c2e700 1 -- start start 2023-10-06T03:01:10.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.903+0000 7f3858c2e700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f38541501b0 0x7f38540cb700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:10.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.903+0000 7f3858c2e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38540cbc40 con 0x7f385415cd50 2023-10-06T03:01:10.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.903+0000 7f3858c2e700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f385406afb0 con 0x7f385414fd10 2023-10-06T03:01:10.908 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.903+0000 7f3858c2e700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f385406e300 con 0x7f38541501b0 2023-10-06T03:01:10.908 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.903+0000 7f385259c700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f385415cd50 0x7f385415d120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:45928/0 (socket says 172.21.15.57:45928) 2023-10-06T03:01:10.908 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.903+0000 7f385259c700 1 -- 172.21.15.57:0/3486963969 learned_addr learned my addr 172.21.15.57:0/3486963969 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:01:10.908 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.903+0000 7f3852d9d700 1 --2- 172.21.15.57:0/3486963969 >> v2:172.21.15.105:3300/0 conn(0x7f38541501b0 0x7f38540cb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:10.909 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.903+0000 7f385159a700 1 -- 172.21.15.57:0/3486963969 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1849348186 0 0) 0x7f38540cbc40 con 0x7f385415cd50 2023-10-06T03:01:10.909 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.903+0000 7f385159a700 1 -- 172.21.15.57:0/3486963969 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f383c003570 con 0x7f385415cd50 2023-10-06T03:01:10.909 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.903+0000 7f3852d9d700 1 -- 172.21.15.57:0/3486963969 >> v1:172.21.15.105:6789/0 conn(0x7f385414fd10 legacy=0x7f385406c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:10.909 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.903+0000 7f3852d9d700 1 -- 172.21.15.57:0/3486963969 >> v1:172.21.15.57:6789/0 conn(0x7f385415cd50 legacy=0x7f385415d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:10.909 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.903+0000 7f3852d9d700 1 -- 172.21.15.57:0/3486963969 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f385406b290 con 0x7f38541501b0 2023-10-06T03:01:10.910 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.903+0000 7f3852d9d700 1 --2- 172.21.15.57:0/3486963969 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f38541501b0 0x7f38540cb700 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f384c009e60 tx=0x7f384c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=da8cb04daae65137 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:10.911 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.907+0000 7f385159a700 1 -- 172.21.15.57:0/3486963969 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f384c00e070 con 0x7f38541501b0 2023-10-06T03:01:10.911 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.907+0000 7f385159a700 1 -- 172.21.15.57:0/3486963969 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f384c00bb60 con 0x7f38541501b0 2023-10-06T03:01:10.911 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.907+0000 7f385159a700 1 -- 172.21.15.57:0/3486963969 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f384c012430 con 0x7f38541501b0 2023-10-06T03:01:10.911 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.907+0000 7f3858c2e700 1 -- 172.21.15.57:0/3486963969 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f38541501b0 msgr2=0x7f38540cb700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:10.912 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.907+0000 7f3858c2e700 1 --2- 172.21.15.57:0/3486963969 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f38541501b0 0x7f38540cb700 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f384c009e60 tx=0x7f384c009780 comp rx=0 tx=0).stop 2023-10-06T03:01:10.912 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.907+0000 7f3858c2e700 1 -- 172.21.15.57:0/3486963969 shutdown_connections 2023-10-06T03:01:10.913 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.907+0000 7f3858c2e700 1 --2- 172.21.15.57:0/3486963969 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f38541501b0 0x7f38540cb700 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:10.913 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.907+0000 7f3858c2e700 1 -- 172.21.15.57:0/3486963969 >> 172.21.15.57:0/3486963969 conn(0x7f38540ccbc0 msgr2=0x7f38540ccfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:10.913 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.907+0000 7f3858c2e700 1 -- 172.21.15.57:0/3486963969 shutdown_connections 2023-10-06T03:01:10.913 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.907+0000 7f3858c2e700 1 -- 172.21.15.57:0/3486963969 wait complete. 2023-10-06T03:01:10.914 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.907+0000 7f3858c2e700 1 Processor -- start 2023-10-06T03:01:10.914 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.911+0000 7f3858c2e700 1 -- start start 2023-10-06T03:01:10.915 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.911+0000 7f3858c2e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f385414fd10 0x7f385414e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:10.916 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.911+0000 7f3858c2e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f38541501b0 0x7f38540b2f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:10.916 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.911+0000 7f3858c2e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f385415cd50 0x7f38540c9020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:10.916 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.911+0000 7f3858c2e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3854157880 con 0x7f385415cd50 2023-10-06T03:01:10.916 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.911+0000 7f3858c2e700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38540c8bc0 con 0x7f385414fd10 2023-10-06T03:01:10.916 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.911+0000 7f3858c2e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38540c8320 con 0x7f38541501b0 2023-10-06T03:01:10.917 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.911+0000 7f3852d9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f385415cd50 0x7f38540c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:10.917 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.911+0000 7f385259c700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f385414fd10 0x7f385414e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:10.917 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.911+0000 7f3852d9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f385415cd50 0x7f38540c9020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56086/0 (socket says 172.21.15.57:56086) 2023-10-06T03:01:10.917 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.911+0000 7f3852d9d700 1 -- 172.21.15.57:0/1551908335 learned_addr learned my addr 172.21.15.57:0/1551908335 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:10.917 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.911+0000 7f3851d9b700 1 --2- 172.21.15.57:0/1551908335 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f38541501b0 0x7f38540b2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:10.918 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.911+0000 7f3852d9d700 1 -- 172.21.15.57:0/1551908335 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f38541501b0 msgr2=0x7f38540b2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:10.918 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.911+0000 7f3852d9d700 1 --2- 172.21.15.57:0/1551908335 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f38541501b0 0x7f38540b2f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:10.918 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.911+0000 7f3852d9d700 1 -- 172.21.15.57:0/1551908335 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f385414fd10 msgr2=0x7f385414e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:10.918 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.911+0000 7f3852d9d700 1 --2- 172.21.15.57:0/1551908335 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f385414fd10 0x7f385414e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:10.918 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.911+0000 7f3852d9d700 1 -- 172.21.15.57:0/1551908335 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f384c009a20 con 0x7f385415cd50 2023-10-06T03:01:10.918 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.911+0000 7f385259c700 1 --2- 172.21.15.57:0/1551908335 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f385414fd10 0x7f385414e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:01:10.918 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.911+0000 7f3852d9d700 1 --2- 172.21.15.57:0/1551908335 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f385415cd50 0x7f38540c9020 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f385406a6a0 tx=0x7f384c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:10.919 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.911+0000 7f38427fc700 1 -- 172.21.15.57:0/1551908335 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f384c027470 con 0x7f385415cd50 2023-10-06T03:01:10.919 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.911+0000 7f38427fc700 1 -- 172.21.15.57:0/1551908335 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f384c0275f0 con 0x7f385415cd50 2023-10-06T03:01:10.919 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.911+0000 7f3858c2e700 1 -- 172.21.15.57:0/1551908335 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38540c8600 con 0x7f385415cd50 2023-10-06T03:01:10.919 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.911+0000 7f38427fc700 1 -- 172.21.15.57:0/1551908335 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f384c0279b0 con 0x7f385415cd50 2023-10-06T03:01:10.919 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.915+0000 7f3858c2e700 1 -- 172.21.15.57:0/1551908335 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38540c7f10 con 0x7f385415cd50 2023-10-06T03:01:10.921 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.915+0000 7f3858c2e700 1 -- 172.21.15.57:0/1551908335 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3854157a30 con 0x7f385415cd50 2023-10-06T03:01:10.921 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.915+0000 7f38427fc700 1 -- 172.21.15.57:0/1551908335 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f384c024070 con 0x7f385415cd50 2023-10-06T03:01:10.923 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.919+0000 7f38427fc700 1 --2- 172.21.15.57:0/1551908335 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f3834060550 0x7f3834062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:10.923 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.919+0000 7f38427fc700 1 -- 172.21.15.57:0/1551908335 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f384c07f360 con 0x7f385415cd50 2023-10-06T03:01:10.924 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.919+0000 7f385259c700 1 --2- 172.21.15.57:0/1551908335 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f3834060550 0x7f3834062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:10.925 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.919+0000 7f385259c700 1 --2- 172.21.15.57:0/1551908335 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f3834060550 0x7f3834062a00 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3844007fd0 tx=0x7f3844009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:10.929 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:10.923+0000 7f38427fc700 1 -- 172.21.15.57:0/1551908335 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f3854157a30 con 0x7f385415cd50 2023-10-06T03:01:11.100 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.095+0000 7f3858c2e700 1 -- 172.21.15.57:0/1551908335 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f38540712e0 con 0x7f385415cd50 2023-10-06T03:01:11.101 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.095+0000 7f38427fc700 1 -- 172.21.15.57:0/1551908335 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f384c02c020 con 0x7f385415cd50 2023-10-06T03:01:11.101 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2023-10-06T03:01:11.105 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.099+0000 7f3858c2e700 1 -- 172.21.15.57:0/1551908335 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f3834060550 msgr2=0x7f3834062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:11.105 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.099+0000 7f3858c2e700 1 --2- 172.21.15.57:0/1551908335 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f3834060550 0x7f3834062a00 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3844007fd0 tx=0x7f3844009040 comp rx=0 tx=0).stop 2023-10-06T03:01:11.105 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.099+0000 7f3858c2e700 1 -- 172.21.15.57:0/1551908335 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f385415cd50 msgr2=0x7f38540c9020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:11.105 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.099+0000 7f3858c2e700 1 --2- 172.21.15.57:0/1551908335 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f385415cd50 0x7f38540c9020 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f385406a6a0 tx=0x7f384c019000 comp rx=0 tx=0).stop 2023-10-06T03:01:11.106 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.099+0000 7f3858c2e700 1 -- 172.21.15.57:0/1551908335 shutdown_connections 2023-10-06T03:01:11.106 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.099+0000 7f3858c2e700 1 --2- 172.21.15.57:0/1551908335 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f385415cd50 0x7f38540c9020 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:11.106 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.099+0000 7f3858c2e700 1 --2- 172.21.15.57:0/1551908335 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f3834060550 0x7f3834062a00 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:11.106 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.099+0000 7f3858c2e700 1 --2- 172.21.15.57:0/1551908335 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f38541501b0 0x7f38540b2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:11.106 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.099+0000 7f3858c2e700 1 --2- 172.21.15.57:0/1551908335 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f385414fd10 0x7f385414e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:11.106 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.099+0000 7f3858c2e700 1 -- 172.21.15.57:0/1551908335 >> 172.21.15.57:0/1551908335 conn(0x7f38540ccbc0 msgr2=0x7f38540cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:11.106 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.099+0000 7f3858c2e700 1 -- 172.21.15.57:0/1551908335 shutdown_connections 2023-10-06T03:01:11.107 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.099+0000 7f3858c2e700 1 -- 172.21.15.57:0/1551908335 wait complete. 2023-10-06T03:01:11.127 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T03:01:11.300 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.295+0000 7f948920c700 1 Processor -- start 2023-10-06T03:01:11.300 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.295+0000 7f948920c700 1 -- start start 2023-10-06T03:01:11.304 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.299+0000 7f948920c700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94840cb140 0x7f94840cb510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:11.304 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.299+0000 7f948920c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f948406e040 0x7f94840b04d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:11.305 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.299+0000 7f948920c700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f948406c920 con 0x7f94840b0080 2023-10-06T03:01:11.305 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.299+0000 7f948920c700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f948406d4a0 con 0x7f948406e040 2023-10-06T03:01:11.305 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.299+0000 7f948920c700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f948406cb70 con 0x7f94840cb140 2023-10-06T03:01:11.305 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.299+0000 7f9488a0b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f948406e040 0x7f94840b04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:11.305 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.299+0000 7f9483fff700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94840cb140 0x7f94840cb510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:11.305 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.299+0000 7f9488a0b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f948406e040 0x7f94840b04d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56100/0 (socket says 172.21.15.57:56100) 2023-10-06T03:01:11.305 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.299+0000 7f9488a0b700 1 -- 172.21.15.57:0/328530010 learned_addr learned my addr 172.21.15.57:0/328530010 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:11.306 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.299+0000 7f9488a0b700 1 -- 172.21.15.57:0/328530010 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94840cb140 msgr2=0x7f94840cb510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:11.307 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.299+0000 7f9488a0b700 1 --2- 172.21.15.57:0/328530010 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94840cb140 0x7f94840cb510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:11.307 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.299+0000 7f9488a0b700 1 -- 172.21.15.57:0/328530010 >> v1:172.21.15.57:6789/0 conn(0x7f94840b0080 legacy=0x7f948406d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:11.308 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.299+0000 7f9488a0b700 1 -- 172.21.15.57:0/328530010 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f948406ce50 con 0x7f948406e040 2023-10-06T03:01:11.308 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.299+0000 7f9482ffd700 1 -- 172.21.15.57:0/328530010 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2871501069 0 0) 0x7f948406c920 con 0x7f94840b0080 2023-10-06T03:01:11.308 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.299+0000 7f9488a0b700 1 --2- 172.21.15.57:0/328530010 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f948406e040 0x7f94840b04d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f947c009f20 tx=0x7f947c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b14f7803eb658039 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:11.309 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.299+0000 7f9482ffd700 1 -- 172.21.15.57:0/328530010 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f947c00e070 con 0x7f948406e040 2023-10-06T03:01:11.309 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.299+0000 7f9482ffd700 1 -- 172.21.15.57:0/328530010 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f947c00b9d0 con 0x7f948406e040 2023-10-06T03:01:11.309 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.299+0000 7f9482ffd700 1 -- 172.21.15.57:0/328530010 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f947c0092e0 con 0x7f948406e040 2023-10-06T03:01:11.309 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.303+0000 7f948920c700 1 -- 172.21.15.57:0/328530010 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f948406e040 msgr2=0x7f94840b04d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:11.309 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.303+0000 7f948920c700 1 --2- 172.21.15.57:0/328530010 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f948406e040 0x7f94840b04d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f947c009f20 tx=0x7f947c009840 comp rx=0 tx=0).stop 2023-10-06T03:01:11.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.303+0000 7f948920c700 1 -- 172.21.15.57:0/328530010 shutdown_connections 2023-10-06T03:01:11.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.303+0000 7f948920c700 1 --2- 172.21.15.57:0/328530010 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f948406e040 0x7f94840b04d0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:11.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.303+0000 7f948920c700 1 --2- 172.21.15.57:0/328530010 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94840cb140 0x7f94840cb510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:11.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.303+0000 7f948920c700 1 -- 172.21.15.57:0/328530010 >> 172.21.15.57:0/328530010 conn(0x7f94840d0a50 msgr2=0x7f94840cca60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:11.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.303+0000 7f948920c700 1 -- 172.21.15.57:0/328530010 shutdown_connections 2023-10-06T03:01:11.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.303+0000 7f948920c700 1 -- 172.21.15.57:0/328530010 wait complete. 2023-10-06T03:01:11.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.303+0000 7f948920c700 1 Processor -- start 2023-10-06T03:01:11.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.303+0000 7f948920c700 1 -- start start 2023-10-06T03:01:11.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.303+0000 7f948920c700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f948406e040 0x7f948415bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:11.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.303+0000 7f948920c700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94840b0080 0x7f94840c9110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:11.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.303+0000 7f948920c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f94840cb140 0x7f94840ab000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:11.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.303+0000 7f948920c700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94840a8ec0 con 0x7f94840cb140 2023-10-06T03:01:11.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.303+0000 7f948920c700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94840c8c80 con 0x7f948406e040 2023-10-06T03:01:11.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.303+0000 7f948920c700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f948415c3e0 con 0x7f94840b0080 2023-10-06T03:01:11.312 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.307+0000 7f9488a0b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f94840cb140 0x7f94840ab000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:11.312 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.307+0000 7f9488a0b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f94840cb140 0x7f94840ab000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56114/0 (socket says 172.21.15.57:56114) 2023-10-06T03:01:11.312 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.307+0000 7f9488a0b700 1 -- 172.21.15.57:0/3747635876 learned_addr learned my addr 172.21.15.57:0/3747635876 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:11.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.307+0000 7f9483fff700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f948406e040 0x7f948415bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:11.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.307+0000 7f94837fe700 1 --2- 172.21.15.57:0/3747635876 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94840b0080 0x7f94840c9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:11.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.307+0000 7f9488a0b700 1 -- 172.21.15.57:0/3747635876 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94840b0080 msgr2=0x7f94840c9110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:11.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.307+0000 7f9488a0b700 1 --2- 172.21.15.57:0/3747635876 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94840b0080 0x7f94840c9110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:11.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.307+0000 7f9488a0b700 1 -- 172.21.15.57:0/3747635876 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f948406e040 msgr2=0x7f948415bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:11.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.307+0000 7f9488a0b700 1 --2- 172.21.15.57:0/3747635876 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f948406e040 0x7f948415bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:11.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.307+0000 7f9488a0b700 1 -- 172.21.15.57:0/3747635876 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f947c009ae0 con 0x7f94840cb140 2023-10-06T03:01:11.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.307+0000 7f94837fe700 1 --2- 172.21.15.57:0/3747635876 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94840b0080 0x7f94840c9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:11.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.307+0000 7f9488a0b700 1 --2- 172.21.15.57:0/3747635876 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f94840cb140 0x7f94840ab000 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f948406a150 tx=0x7f947c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:11.314 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.307+0000 7f946bfff700 1 -- 172.21.15.57:0/3747635876 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f947c008b80 con 0x7f94840cb140 2023-10-06T03:01:11.314 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.307+0000 7f946bfff700 1 -- 172.21.15.57:0/3747635876 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f947c008d00 con 0x7f94840cb140 2023-10-06T03:01:11.314 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.307+0000 7f948920c700 1 -- 172.21.15.57:0/3747635876 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94840c8070 con 0x7f94840cb140 2023-10-06T03:01:11.314 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.307+0000 7f946bfff700 1 -- 172.21.15.57:0/3747635876 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f947c0256b0 con 0x7f94840cb140 2023-10-06T03:01:11.314 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.307+0000 7f948920c700 1 -- 172.21.15.57:0/3747635876 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94840c8630 con 0x7f94840cb140 2023-10-06T03:01:11.315 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.311+0000 7f948920c700 1 -- 172.21.15.57:0/3747635876 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94840c8e10 con 0x7f94840cb140 2023-10-06T03:01:11.316 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.311+0000 7f946bfff700 1 -- 172.21.15.57:0/3747635876 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f947c003040 con 0x7f94840cb140 2023-10-06T03:01:11.318 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.311+0000 7f946bfff700 1 --2- 172.21.15.57:0/3747635876 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f9470060550 0x7f9470062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:11.318 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.311+0000 7f946bfff700 1 -- 172.21.15.57:0/3747635876 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f947c07df40 con 0x7f94840cb140 2023-10-06T03:01:11.318 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.315+0000 7f9483fff700 1 --2- 172.21.15.57:0/3747635876 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f9470060550 0x7f9470062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:11.319 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.315+0000 7f9483fff700 1 --2- 172.21.15.57:0/3747635876 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f9470060550 0x7f9470062a00 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9474009d10 tx=0x7f94740091a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:11.324 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.319+0000 7f946bfff700 1 -- 172.21.15.57:0/3747635876 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f947c04e330 con 0x7f94840cb140 2023-10-06T03:01:11.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.487+0000 7f948920c700 1 -- 172.21.15.57:0/3747635876 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f948404be40 con 0x7f94840cb140 2023-10-06T03:01:11.495 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.491+0000 7f946bfff700 1 -- 172.21.15.57:0/3747635876 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f947c051950 con 0x7f94840cb140 2023-10-06T03:01:11.495 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2023-10-06T03:01:11.498 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.491+0000 7f948920c700 1 -- 172.21.15.57:0/3747635876 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f9470060550 msgr2=0x7f9470062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:11.498 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.491+0000 7f948920c700 1 --2- 172.21.15.57:0/3747635876 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f9470060550 0x7f9470062a00 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9474009d10 tx=0x7f94740091a0 comp rx=0 tx=0).stop 2023-10-06T03:01:11.498 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.491+0000 7f948920c700 1 -- 172.21.15.57:0/3747635876 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f94840cb140 msgr2=0x7f94840ab000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:11.498 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.491+0000 7f948920c700 1 --2- 172.21.15.57:0/3747635876 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f94840cb140 0x7f94840ab000 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f948406a150 tx=0x7f947c018000 comp rx=0 tx=0).stop 2023-10-06T03:01:11.498 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.491+0000 7f948920c700 1 -- 172.21.15.57:0/3747635876 shutdown_connections 2023-10-06T03:01:11.498 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.491+0000 7f948920c700 1 --2- 172.21.15.57:0/3747635876 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f94840cb140 0x7f94840ab000 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:11.498 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.491+0000 7f948920c700 1 --2- 172.21.15.57:0/3747635876 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f9470060550 0x7f9470062a00 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:11.498 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.491+0000 7f948920c700 1 --2- 172.21.15.57:0/3747635876 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94840b0080 0x7f94840c9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:11.498 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.491+0000 7f948920c700 1 --2- 172.21.15.57:0/3747635876 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f948406e040 0x7f948415bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:11.498 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.491+0000 7f948920c700 1 -- 172.21.15.57:0/3747635876 >> 172.21.15.57:0/3747635876 conn(0x7f94840d0a50 msgr2=0x7f94840cf180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:11.498 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.491+0000 7f948920c700 1 -- 172.21.15.57:0/3747635876 shutdown_connections 2023-10-06T03:01:11.499 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.491+0000 7f948920c700 1 -- 172.21.15.57:0/3747635876 wait complete. 2023-10-06T03:01:11.516 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T03:01:11.679 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.675+0000 7f787759e700 1 Processor -- start 2023-10-06T03:01:11.679 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.675+0000 7f787759e700 1 -- start start 2023-10-06T03:01:11.681 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.675+0000 7f787759e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7878140540 0x7f7878067490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:11.681 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.675+0000 7f787759e700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f7878140910 0x7f78780679d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:11.681 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.675+0000 7f787759e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7878157740 con 0x7f78780c6b20 2023-10-06T03:01:11.681 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.675+0000 7f787759e700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7878068070 con 0x7f7878140910 2023-10-06T03:01:11.681 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.675+0000 7f787759e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7878068350 con 0x7f7878140540 2023-10-06T03:01:11.682 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.675+0000 7f7876d9d700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f78780c6b20 0x7f787815a9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:45956/0 (socket says 172.21.15.57:45956) 2023-10-06T03:01:11.682 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.675+0000 7f7876d9d700 1 -- 172.21.15.57:0/1549580707 learned_addr learned my addr 172.21.15.57:0/1549580707 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:01:11.682 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.675+0000 7f7875d9b700 1 --2- 172.21.15.57:0/1549580707 >> v2:172.21.15.105:3300/0 conn(0x7f7878140910 0x7f78780679d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:11.682 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.675+0000 7f787659c700 1 --2- 172.21.15.57:0/1549580707 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7878140540 0x7f7878067490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:11.683 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.675+0000 7f787559a700 1 -- 172.21.15.57:0/1549580707 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2874916438 0 0) 0x7f7878157740 con 0x7f78780c6b20 2023-10-06T03:01:11.683 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.675+0000 7f787559a700 1 -- 172.21.15.57:0/1549580707 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7860003570 con 0x7f78780c6b20 2023-10-06T03:01:11.683 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.679+0000 7f7875d9b700 1 -- 172.21.15.57:0/1549580707 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7878140540 msgr2=0x7f7878067490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:11.683 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.679+0000 7f7875d9b700 1 --2- 172.21.15.57:0/1549580707 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7878140540 0x7f7878067490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:11.683 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.679+0000 7f7875d9b700 1 -- 172.21.15.57:0/1549580707 >> v1:172.21.15.57:6789/0 conn(0x7f78780c6b20 legacy=0x7f787815a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:11.683 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.679+0000 7f7875d9b700 1 -- 172.21.15.57:0/1549580707 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7878068630 con 0x7f7878140910 2023-10-06T03:01:11.684 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.679+0000 7f7875d9b700 1 --2- 172.21.15.57:0/1549580707 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7878140910 0x7f78780679d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f786c0098e0 tx=0x7f786c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1124000a6070465 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:11.684 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.679+0000 7f787559a700 1 -- 172.21.15.57:0/1549580707 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f786c011630 con 0x7f7878140910 2023-10-06T03:01:11.684 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.679+0000 7f787559a700 1 -- 172.21.15.57:0/1549580707 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f786c011790 con 0x7f7878140910 2023-10-06T03:01:11.684 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.679+0000 7f787559a700 1 -- 172.21.15.57:0/1549580707 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f786c011b30 con 0x7f7878140910 2023-10-06T03:01:11.684 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.679+0000 7f787759e700 1 -- 172.21.15.57:0/1549580707 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7878140910 msgr2=0x7f78780679d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:11.684 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.679+0000 7f787759e700 1 --2- 172.21.15.57:0/1549580707 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7878140910 0x7f78780679d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f786c0098e0 tx=0x7f786c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:01:11.685 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.679+0000 7f787759e700 1 -- 172.21.15.57:0/1549580707 shutdown_connections 2023-10-06T03:01:11.685 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.679+0000 7f787759e700 1 --2- 172.21.15.57:0/1549580707 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7878140910 0x7f78780679d0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:11.685 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.679+0000 7f787759e700 1 --2- 172.21.15.57:0/1549580707 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7878140540 0x7f7878067490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:11.685 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.679+0000 7f787759e700 1 -- 172.21.15.57:0/1549580707 >> 172.21.15.57:0/1549580707 conn(0x7f78780c8660 msgr2=0x7f78780c8a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:11.685 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.679+0000 7f787759e700 1 -- 172.21.15.57:0/1549580707 shutdown_connections 2023-10-06T03:01:11.685 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.679+0000 7f787759e700 1 -- 172.21.15.57:0/1549580707 wait complete. 2023-10-06T03:01:11.686 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.683+0000 7f787759e700 1 Processor -- start 2023-10-06T03:01:11.687 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.683+0000 7f787759e700 1 -- start start 2023-10-06T03:01:11.688 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.683+0000 7f787759e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f78780c6b20 0x7f78781567a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:11.688 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.683+0000 7f787759e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7878140540 0x7f78780a9300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:11.688 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.683+0000 7f787759e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7878140910 0x7f78780a9840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:11.688 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.683+0000 7f787759e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78780aa760 con 0x7f78780c6b20 2023-10-06T03:01:11.688 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.683+0000 7f787759e700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78780ca530 con 0x7f7878140910 2023-10-06T03:01:11.688 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.683+0000 7f787759e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7878156ce0 con 0x7f7878140540 2023-10-06T03:01:11.689 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.683+0000 7f787659c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f78780c6b20 0x7f78781567a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:11.689 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.683+0000 7f787659c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f78780c6b20 0x7f78781567a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56124/0 (socket says 172.21.15.57:56124) 2023-10-06T03:01:11.689 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.683+0000 7f787659c700 1 -- 172.21.15.57:0/3339651509 learned_addr learned my addr 172.21.15.57:0/3339651509 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:11.689 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.683+0000 7f7875d9b700 1 --2- 172.21.15.57:0/3339651509 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7878140540 0x7f78780a9300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:11.690 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.683+0000 7f7876d9d700 1 --2- 172.21.15.57:0/3339651509 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7878140910 0x7f78780a9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:11.690 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.683+0000 7f787659c700 1 -- 172.21.15.57:0/3339651509 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7878140540 msgr2=0x7f78780a9300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:11.690 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.683+0000 7f787659c700 1 --2- 172.21.15.57:0/3339651509 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7878140540 0x7f78780a9300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:11.690 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.683+0000 7f787659c700 1 -- 172.21.15.57:0/3339651509 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7878140910 msgr2=0x7f78780a9840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:11.690 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.683+0000 7f787659c700 1 --2- 172.21.15.57:0/3339651509 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7878140910 0x7f78780a9840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:11.690 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.683+0000 7f787659c700 1 -- 172.21.15.57:0/3339651509 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f786c009420 con 0x7f78780c6b20 2023-10-06T03:01:11.691 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.683+0000 7f787659c700 1 --2- 172.21.15.57:0/3339651509 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f78780c6b20 0x7f78781567a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f786800ec80 tx=0x7f78680091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:11.691 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.683+0000 7f78667fc700 1 -- 172.21.15.57:0/3339651509 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f786800c850 con 0x7f78780c6b20 2023-10-06T03:01:11.691 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.683+0000 7f78667fc700 1 -- 172.21.15.57:0/3339651509 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f786800c9b0 con 0x7f78780c6b20 2023-10-06T03:01:11.691 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.687+0000 7f78667fc700 1 -- 172.21.15.57:0/3339651509 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f786800cd50 con 0x7f78780c6b20 2023-10-06T03:01:11.691 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.687+0000 7f787759e700 1 -- 172.21.15.57:0/3339651509 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78780a9ec0 con 0x7f78780c6b20 2023-10-06T03:01:11.691 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.687+0000 7f787759e700 1 -- 172.21.15.57:0/3339651509 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78780aa480 con 0x7f78780c6b20 2023-10-06T03:01:11.693 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.687+0000 7f787759e700 1 -- 172.21.15.57:0/3339651509 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78780ca300 con 0x7f78780c6b20 2023-10-06T03:01:11.694 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.687+0000 7f78667fc700 1 -- 172.21.15.57:0/3339651509 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f7868013680 con 0x7f78780c6b20 2023-10-06T03:01:11.696 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.691+0000 7f78667fc700 1 --2- 172.21.15.57:0/3339651509 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f7858060580 0x7f7858062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:11.696 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.691+0000 7f78667fc700 1 -- 172.21.15.57:0/3339651509 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f786807cc10 con 0x7f78780c6b20 2023-10-06T03:01:11.697 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.691+0000 7f7875d9b700 1 --2- 172.21.15.57:0/3339651509 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f7858060580 0x7f7858062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:11.698 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.691+0000 7f7875d9b700 1 --2- 172.21.15.57:0/3339651509 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f7858060580 0x7f7858062a30 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7878140d00 tx=0x7f786c017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:11.702 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.695+0000 7f78667fc700 1 -- 172.21.15.57:0/3339651509 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f78780ca300 con 0x7f78780c6b20 2023-10-06T03:01:11.868 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.863+0000 7f787759e700 1 -- 172.21.15.57:0/3339651509 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f787815a740 con 0x7f78780c6b20 2023-10-06T03:01:11.869 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.863+0000 7f78667fc700 1 -- 172.21.15.57:0/3339651509 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f787815a740 con 0x7f78780c6b20 2023-10-06T03:01:11.869 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2023-10-06T03:01:11.874 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.867+0000 7f787759e700 1 -- 172.21.15.57:0/3339651509 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f7858060580 msgr2=0x7f7858062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:11.874 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.867+0000 7f787759e700 1 --2- 172.21.15.57:0/3339651509 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f7858060580 0x7f7858062a30 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7878140d00 tx=0x7f786c017000 comp rx=0 tx=0).stop 2023-10-06T03:01:11.874 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.867+0000 7f787759e700 1 -- 172.21.15.57:0/3339651509 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f78780c6b20 msgr2=0x7f78781567a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:11.874 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.867+0000 7f787759e700 1 --2- 172.21.15.57:0/3339651509 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f78780c6b20 0x7f78781567a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f786800ec80 tx=0x7f78680091a0 comp rx=0 tx=0).stop 2023-10-06T03:01:11.874 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.867+0000 7f787759e700 1 -- 172.21.15.57:0/3339651509 shutdown_connections 2023-10-06T03:01:11.874 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.867+0000 7f787759e700 1 --2- 172.21.15.57:0/3339651509 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7878140910 0x7f78780a9840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:11.874 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.867+0000 7f787759e700 1 --2- 172.21.15.57:0/3339651509 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f7858060580 0x7f7858062a30 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:11.874 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.867+0000 7f787759e700 1 --2- 172.21.15.57:0/3339651509 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7878140540 0x7f78780a9300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:11.874 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.867+0000 7f787759e700 1 --2- 172.21.15.57:0/3339651509 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f78780c6b20 0x7f78781567a0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:11.875 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.867+0000 7f787759e700 1 -- 172.21.15.57:0/3339651509 >> 172.21.15.57:0/3339651509 conn(0x7f78780c8660 msgr2=0x7f7878067330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:11.875 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.867+0000 7f787759e700 1 -- 172.21.15.57:0/3339651509 shutdown_connections 2023-10-06T03:01:11.875 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:11.867+0000 7f787759e700 1 -- 172.21.15.57:0/3339651509 wait complete. 2023-10-06T03:01:11.896 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T03:01:12.063 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.059+0000 7fd57b24c700 1 Processor -- start 2023-10-06T03:01:12.063 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.059+0000 7fd57b24c700 1 -- start start 2023-10-06T03:01:12.066 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.059+0000 7fd57b24c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd5740cb510 0x7fd57406d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:12.066 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.059+0000 7fd57b24c700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fd57406de70 0x7fd57406b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:12.066 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.059+0000 7fd57b24c700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd57406c920 con 0x7fd5740cb140 2023-10-06T03:01:12.066 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.059+0000 7fd57b24c700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5740cb960 con 0x7fd5740cb510 2023-10-06T03:01:12.066 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.059+0000 7fd57b24c700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd57406d4a0 con 0x7fd57406de70 2023-10-06T03:01:12.067 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.059+0000 7fd579a49700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd5740cb510 0x7fd57406d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:12.067 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.059+0000 7fd579a49700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd5740cb510 0x7fd57406d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56128/0 (socket says 172.21.15.57:56128) 2023-10-06T03:01:12.067 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.059+0000 7fd579a49700 1 -- 172.21.15.57:0/1231049043 learned_addr learned my addr 172.21.15.57:0/1231049043 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:12.067 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.059+0000 7fd57aa4b700 1 --2- 172.21.15.57:0/1231049043 >> v2:172.21.15.105:3300/0 conn(0x7fd57406de70 0x7fd57406b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:12.068 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.063+0000 7fd579a49700 1 -- 172.21.15.57:0/1231049043 >> v2:172.21.15.105:3300/0 conn(0x7fd57406de70 msgr2=0x7fd57406b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:12.068 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.063+0000 7fd579a49700 1 --2- 172.21.15.57:0/1231049043 >> v2:172.21.15.105:3300/0 conn(0x7fd57406de70 0x7fd57406b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:12.068 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.063+0000 7fd579a49700 1 -- 172.21.15.57:0/1231049043 >> v1:172.21.15.105:6789/0 conn(0x7fd5740cb140 legacy=0x7fd5740b0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:12.068 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.063+0000 7fd579a49700 1 -- 172.21.15.57:0/1231049043 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd57406e290 con 0x7fd5740cb510 2023-10-06T03:01:12.068 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.063+0000 7fd579a49700 1 --2- 172.21.15.57:0/1231049043 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd5740cb510 0x7fd57406d930 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd5740c6f90 tx=0x7fd564009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0f5efc4c0cc84c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:12.068 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.063+0000 7fd579248700 1 -- 172.21.15.57:0/1231049043 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd56400b860 con 0x7fd5740cb510 2023-10-06T03:01:12.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.063+0000 7fd579248700 1 -- 172.21.15.57:0/1231049043 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd56400b9c0 con 0x7fd5740cb510 2023-10-06T03:01:12.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.063+0000 7fd579248700 1 -- 172.21.15.57:0/1231049043 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd56400bd60 con 0x7fd5740cb510 2023-10-06T03:01:12.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.063+0000 7fd57b24c700 1 -- 172.21.15.57:0/1231049043 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd5740cb510 msgr2=0x7fd57406d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:12.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.063+0000 7fd57b24c700 1 --2- 172.21.15.57:0/1231049043 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd5740cb510 0x7fd57406d930 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd5740c6f90 tx=0x7fd564009250 comp rx=0 tx=0).stop 2023-10-06T03:01:12.070 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.063+0000 7fd57b24c700 1 -- 172.21.15.57:0/1231049043 shutdown_connections 2023-10-06T03:01:12.070 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.063+0000 7fd57b24c700 1 --2- 172.21.15.57:0/1231049043 >> v2:172.21.15.105:3300/0 conn(0x7fd57406de70 0x7fd57406b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:12.070 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.063+0000 7fd57b24c700 1 --2- 172.21.15.57:0/1231049043 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd5740cb510 0x7fd57406d930 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:12.070 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.063+0000 7fd57b24c700 1 -- 172.21.15.57:0/1231049043 >> 172.21.15.57:0/1231049043 conn(0x7fd5740d0a50 msgr2=0x7fd5740cca60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:12.070 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.063+0000 7fd57b24c700 1 -- 172.21.15.57:0/1231049043 shutdown_connections 2023-10-06T03:01:12.070 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.063+0000 7fd57b24c700 1 -- 172.21.15.57:0/1231049043 wait complete. 2023-10-06T03:01:12.071 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.067+0000 7fd57b24c700 1 Processor -- start 2023-10-06T03:01:12.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.067+0000 7fd57b24c700 1 -- start start 2023-10-06T03:01:12.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.067+0000 7fd57b24c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd57406de70 0x7fd57415c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:12.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.067+0000 7fd57b24c700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd5740cb140 0x7fd5740af0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:12.074 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.067+0000 7fd57b24c700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd5740cb510 0x7fd5740b47c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:12.074 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.067+0000 7fd57b24c700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd574169270 con 0x7fd57406de70 2023-10-06T03:01:12.074 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.067+0000 7fd57b24c700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd574169510 con 0x7fd5740cb140 2023-10-06T03:01:12.074 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.067+0000 7fd57b24c700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5741697f0 con 0x7fd5740cb510 2023-10-06T03:01:12.074 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.067+0000 7fd57a24a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd57406de70 0x7fd57415c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:12.074 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.067+0000 7fd57a24a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd57406de70 0x7fd57415c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56144/0 (socket says 172.21.15.57:56144) 2023-10-06T03:01:12.074 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.067+0000 7fd57a24a700 1 -- 172.21.15.57:0/1040810301 learned_addr learned my addr 172.21.15.57:0/1040810301 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:12.075 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.067+0000 7fd579a49700 1 --2- 172.21.15.57:0/1040810301 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd5740cb140 0x7fd5740af0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:12.075 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.067+0000 7fd57aa4b700 1 --2- 172.21.15.57:0/1040810301 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd5740cb510 0x7fd5740b47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:12.075 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.067+0000 7fd57a24a700 1 -- 172.21.15.57:0/1040810301 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd5740cb510 msgr2=0x7fd5740b47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:12.075 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.067+0000 7fd57a24a700 1 --2- 172.21.15.57:0/1040810301 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd5740cb510 0x7fd5740b47c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:12.075 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.067+0000 7fd57a24a700 1 -- 172.21.15.57:0/1040810301 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd5740cb140 msgr2=0x7fd5740af0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:12.075 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.071+0000 7fd57a24a700 1 --2- 172.21.15.57:0/1040810301 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd5740cb140 0x7fd5740af0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:12.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.071+0000 7fd57a24a700 1 -- 172.21.15.57:0/1040810301 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5640094f0 con 0x7fd57406de70 2023-10-06T03:01:12.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.071+0000 7fd57a24a700 1 --2- 172.21.15.57:0/1040810301 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd57406de70 0x7fd57415c290 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd57000c4e0 tx=0x7fd57000c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:12.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.071+0000 7fd56a7fc700 1 -- 172.21.15.57:0/1040810301 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd570011590 con 0x7fd57406de70 2023-10-06T03:01:12.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.071+0000 7fd56a7fc700 1 -- 172.21.15.57:0/1040810301 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd570011710 con 0x7fd57406de70 2023-10-06T03:01:12.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.071+0000 7fd57b24c700 1 -- 172.21.15.57:0/1040810301 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd574169ad0 con 0x7fd57406de70 2023-10-06T03:01:12.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.071+0000 7fd56a7fc700 1 -- 172.21.15.57:0/1040810301 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd570011ad0 con 0x7fd57406de70 2023-10-06T03:01:12.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.071+0000 7fd57b24c700 1 -- 172.21.15.57:0/1040810301 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5740c8400 con 0x7fd57406de70 2023-10-06T03:01:12.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.071+0000 7fd57b24c700 1 -- 172.21.15.57:0/1040810301 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd57404be40 con 0x7fd57406de70 2023-10-06T03:01:12.079 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.075+0000 7fd56a7fc700 1 -- 172.21.15.57:0/1040810301 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fd57001b3b0 con 0x7fd57406de70 2023-10-06T03:01:12.082 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.075+0000 7fd56a7fc700 1 --2- 172.21.15.57:0/1040810301 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fd558060550 0x7fd558062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:12.082 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.075+0000 7fd56a7fc700 1 -- 172.21.15.57:0/1040810301 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd57007bd70 con 0x7fd57406de70 2023-10-06T03:01:12.082 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.075+0000 7fd579a49700 1 --2- 172.21.15.57:0/1040810301 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fd558060550 0x7fd558062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:12.083 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.079+0000 7fd579a49700 1 --2- 172.21.15.57:0/1040810301 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fd558060550 0x7fd558062a00 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd5740c6f90 tx=0x7fd564017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:12.087 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.083+0000 7fd56a7fc700 1 -- 172.21.15.57:0/1040810301 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fd57004c160 con 0x7fd57406de70 2023-10-06T03:01:12.257 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.251+0000 7fd57b24c700 1 -- 172.21.15.57:0/1040810301 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd5740cd670 con 0x7fd57406de70 2023-10-06T03:01:12.258 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.251+0000 7fd56a7fc700 1 -- 172.21.15.57:0/1040810301 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd57004f780 con 0x7fd57406de70 2023-10-06T03:01:12.258 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 64 2023-10-06T03:01:12.261 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.255+0000 7fd57b24c700 1 -- 172.21.15.57:0/1040810301 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fd558060550 msgr2=0x7fd558062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:12.261 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.255+0000 7fd57b24c700 1 --2- 172.21.15.57:0/1040810301 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fd558060550 0x7fd558062a00 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd5740c6f90 tx=0x7fd564017000 comp rx=0 tx=0).stop 2023-10-06T03:01:12.261 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.255+0000 7fd57b24c700 1 -- 172.21.15.57:0/1040810301 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd57406de70 msgr2=0x7fd57415c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:12.261 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.255+0000 7fd57b24c700 1 --2- 172.21.15.57:0/1040810301 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd57406de70 0x7fd57415c290 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd57000c4e0 tx=0x7fd57000c7f0 comp rx=0 tx=0).stop 2023-10-06T03:01:12.261 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.255+0000 7fd57b24c700 1 -- 172.21.15.57:0/1040810301 shutdown_connections 2023-10-06T03:01:12.261 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.255+0000 7fd57b24c700 1 --2- 172.21.15.57:0/1040810301 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fd558060550 0x7fd558062a00 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:12.261 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.255+0000 7fd57b24c700 1 --2- 172.21.15.57:0/1040810301 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd5740cb510 0x7fd5740b47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:12.261 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.255+0000 7fd57b24c700 1 --2- 172.21.15.57:0/1040810301 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd5740cb140 0x7fd5740af0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:12.262 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.255+0000 7fd57b24c700 1 --2- 172.21.15.57:0/1040810301 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd57406de70 0x7fd57415c290 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:12.262 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.255+0000 7fd57b24c700 1 -- 172.21.15.57:0/1040810301 >> 172.21.15.57:0/1040810301 conn(0x7fd5740d0a50 msgr2=0x7fd5740b0080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:12.262 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.255+0000 7fd57b24c700 1 -- 172.21.15.57:0/1040810301 shutdown_connections 2023-10-06T03:01:12.262 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.255+0000 7fd57b24c700 1 -- 172.21.15.57:0/1040810301 wait complete. 2023-10-06T03:01:12.280 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:01:12.442 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.435+0000 7fd3b802e700 1 Processor -- start 2023-10-06T03:01:12.443 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.439+0000 7fd3b802e700 1 -- start start 2023-10-06T03:01:12.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.439+0000 7fd3b802e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd3b006deb0 0x7fd3b00675c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:12.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.439+0000 7fd3b802e700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fd3b015cee0 0x7fd3b015d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:12.446 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.439+0000 7fd3b802e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3b006da20 con 0x7fd3b00671f0 2023-10-06T03:01:12.446 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.439+0000 7fd3b802e700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3b00b0650 con 0x7fd3b015cee0 2023-10-06T03:01:12.446 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.439+0000 7fd3b802e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b006ce10 con 0x7fd3b006deb0 2023-10-06T03:01:12.446 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.439+0000 7fd3b55c9700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd3b006deb0 0x7fd3b00675c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:12.446 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.439+0000 7fd3b5dca700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fd3b00671f0 0x7fd3b00aff40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:45972/0 (socket says 172.21.15.57:45972) 2023-10-06T03:01:12.447 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.439+0000 7fd3b5dca700 1 -- 172.21.15.57:0/289827063 learned_addr learned my addr 172.21.15.57:0/289827063 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:01:12.447 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.439+0000 7fd3b65cb700 1 --2- 172.21.15.57:0/289827063 >> v2:172.21.15.105:3300/0 conn(0x7fd3b015cee0 0x7fd3b015d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:12.447 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.443+0000 7fd3b4dc8700 1 -- 172.21.15.57:0/289827063 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 439889721 0 0) 0x7fd3b006da20 con 0x7fd3b00671f0 2023-10-06T03:01:12.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.443+0000 7fd3b4dc8700 1 -- 172.21.15.57:0/289827063 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd39c003570 con 0x7fd3b00671f0 2023-10-06T03:01:12.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.443+0000 7fd3b55c9700 1 -- 172.21.15.57:0/289827063 >> v2:172.21.15.105:3300/0 conn(0x7fd3b015cee0 msgr2=0x7fd3b015d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:12.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.443+0000 7fd3b55c9700 1 --2- 172.21.15.57:0/289827063 >> v2:172.21.15.105:3300/0 conn(0x7fd3b015cee0 0x7fd3b015d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:12.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.443+0000 7fd3b55c9700 1 -- 172.21.15.57:0/289827063 >> v1:172.21.15.57:6789/0 conn(0x7fd3b00671f0 legacy=0x7fd3b00aff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:12.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.443+0000 7fd3b55c9700 1 -- 172.21.15.57:0/289827063 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3b006d0f0 con 0x7fd3b006deb0 2023-10-06T03:01:12.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.443+0000 7fd3b55c9700 1 --2- 172.21.15.57:0/289827063 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd3b006deb0 0x7fd3b00675c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd3a00098e0 tx=0x7fd3a00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=54f98e33c3e914cb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:12.449 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.443+0000 7fd3b4dc8700 1 -- 172.21.15.57:0/289827063 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3a0011630 con 0x7fd3b006deb0 2023-10-06T03:01:12.449 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.443+0000 7fd3b4dc8700 1 -- 172.21.15.57:0/289827063 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3a0011790 con 0x7fd3b006deb0 2023-10-06T03:01:12.449 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.443+0000 7fd3b4dc8700 1 -- 172.21.15.57:0/289827063 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3a0011b30 con 0x7fd3b006deb0 2023-10-06T03:01:12.450 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.443+0000 7fd3b802e700 1 -- 172.21.15.57:0/289827063 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd3b006deb0 msgr2=0x7fd3b00675c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:12.450 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.443+0000 7fd3b802e700 1 --2- 172.21.15.57:0/289827063 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd3b006deb0 0x7fd3b00675c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd3a00098e0 tx=0x7fd3a00091a0 comp rx=0 tx=0).stop 2023-10-06T03:01:12.450 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.443+0000 7fd3b802e700 1 -- 172.21.15.57:0/289827063 shutdown_connections 2023-10-06T03:01:12.451 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.443+0000 7fd3b802e700 1 --2- 172.21.15.57:0/289827063 >> v2:172.21.15.105:3300/0 conn(0x7fd3b015cee0 0x7fd3b015d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:12.451 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.443+0000 7fd3b802e700 1 --2- 172.21.15.57:0/289827063 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd3b006deb0 0x7fd3b00675c0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:12.451 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.443+0000 7fd3b802e700 1 -- 172.21.15.57:0/289827063 >> 172.21.15.57:0/289827063 conn(0x7fd3b00cbdd0 msgr2=0x7fd3b00cc1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:12.451 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.443+0000 7fd3b802e700 1 -- 172.21.15.57:0/289827063 shutdown_connections 2023-10-06T03:01:12.451 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.443+0000 7fd3b802e700 1 -- 172.21.15.57:0/289827063 wait complete. 2023-10-06T03:01:12.452 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.447+0000 7fd3b802e700 1 Processor -- start 2023-10-06T03:01:12.453 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.447+0000 7fd3b802e700 1 -- start start 2023-10-06T03:01:12.455 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.447+0000 7fd3b802e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3b00671f0 0x7fd3b00ad9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:12.455 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.447+0000 7fd3b802e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd3b006deb0 0x7fd3b0160120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:12.455 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.447+0000 7fd3b802e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd3b015cee0 0x7fd3b0160660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:12.455 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.447+0000 7fd3b802e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b015de10 con 0x7fd3b00671f0 2023-10-06T03:01:12.456 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.447+0000 7fd3b802e700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b00ad540 con 0x7fd3b015cee0 2023-10-06T03:01:12.456 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.447+0000 7fd3b802e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b00ac970 con 0x7fd3b006deb0 2023-10-06T03:01:12.456 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.451+0000 7fd3b5dca700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3b00671f0 0x7fd3b00ad9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:12.456 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.451+0000 7fd3b5dca700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3b00671f0 0x7fd3b00ad9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56146/0 (socket says 172.21.15.57:56146) 2023-10-06T03:01:12.456 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.451+0000 7fd3b5dca700 1 -- 172.21.15.57:0/1428375125 learned_addr learned my addr 172.21.15.57:0/1428375125 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:12.456 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.451+0000 7fd3b65cb700 1 --2- 172.21.15.57:0/1428375125 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd3b015cee0 0x7fd3b0160660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:12.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.451+0000 7fd3b55c9700 1 --2- 172.21.15.57:0/1428375125 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd3b006deb0 0x7fd3b0160120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:12.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.451+0000 7fd3b5dca700 1 -- 172.21.15.57:0/1428375125 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd3b006deb0 msgr2=0x7fd3b0160120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:12.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.451+0000 7fd3b5dca700 1 --2- 172.21.15.57:0/1428375125 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd3b006deb0 0x7fd3b0160120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:12.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.451+0000 7fd3b5dca700 1 -- 172.21.15.57:0/1428375125 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd3b015cee0 msgr2=0x7fd3b0160660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:12.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.451+0000 7fd3b5dca700 1 --2- 172.21.15.57:0/1428375125 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd3b015cee0 0x7fd3b0160660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:12.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.451+0000 7fd3b5dca700 1 -- 172.21.15.57:0/1428375125 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3a0009420 con 0x7fd3b00671f0 2023-10-06T03:01:12.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.451+0000 7fd3b5dca700 1 --2- 172.21.15.57:0/1428375125 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3b00671f0 0x7fd3b00ad9d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac0011e0 tx=0x7fd3ac007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:12.459 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.451+0000 7fd3a5ffb700 1 -- 172.21.15.57:0/1428375125 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3ac005b30 con 0x7fd3b00671f0 2023-10-06T03:01:12.459 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.451+0000 7fd3a5ffb700 1 -- 172.21.15.57:0/1428375125 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3ac005c90 con 0x7fd3b00671f0 2023-10-06T03:01:12.459 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.451+0000 7fd3b802e700 1 -- 172.21.15.57:0/1428375125 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3b00acc10 con 0x7fd3b00671f0 2023-10-06T03:01:12.459 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.451+0000 7fd3a5ffb700 1 -- 172.21.15.57:0/1428375125 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3ac007300 con 0x7fd3b00671f0 2023-10-06T03:01:12.459 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.451+0000 7fd3b802e700 1 -- 172.21.15.57:0/1428375125 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3b00ad1d0 con 0x7fd3b00671f0 2023-10-06T03:01:12.459 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.455+0000 7fd3b802e700 1 -- 172.21.15.57:0/1428375125 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3b015a170 con 0x7fd3b00671f0 2023-10-06T03:01:12.460 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.455+0000 7fd3a5ffb700 1 -- 172.21.15.57:0/1428375125 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fd3ac007670 con 0x7fd3b00671f0 2023-10-06T03:01:12.462 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.455+0000 7fd3a5ffb700 1 --2- 172.21.15.57:0/1428375125 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fd394060550 0x7fd394062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:12.462 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.455+0000 7fd3a5ffb700 1 -- 172.21.15.57:0/1428375125 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd3ac07bd90 con 0x7fd3b00671f0 2023-10-06T03:01:12.462 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.455+0000 7fd3b55c9700 1 --2- 172.21.15.57:0/1428375125 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fd394060550 0x7fd394062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:12.463 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.459+0000 7fd3b55c9700 1 --2- 172.21.15.57:0/1428375125 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fd394060550 0x7fd394062a00 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd3a00093f0 tx=0x7fd3a0017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:12.467 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.463+0000 7fd3a5ffb700 1 -- 172.21.15.57:0/1428375125 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fd3b015a170 con 0x7fd3b00671f0 2023-10-06T03:01:12.677 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.671+0000 7fd3b802e700 1 -- 172.21.15.57:0/1428375125 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd3b015a170 con 0x7fd3b00671f0 2023-10-06T03:01:12.678 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.671+0000 7fd3a5ffb700 1 -- 172.21.15.57:0/1428375125 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4594 (secure 0 0 0) 0x7fd3b015a170 con 0x7fd3b00671f0 2023-10-06T03:01:12.678 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:01:12.678 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6834/1042131376","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":1042131376},{"type":"v1","addr":"172.21.15.105:6834","nonce":1042131376}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4287,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6836/3619570714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":3619570714},{"type":"v1","addr":"172.21.15.57:6836","nonce":3619570714}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6837/645924568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6835","nonce":645924568},{"type":"v1","addr":"172.21.15.57:6837","nonce":645924568}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:00:57.411689+0000","modified":"2023-10-06T03:01:00.999490+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4303},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4303":{"gid":4303,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6835/1286071598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":1286071598},{"type":"v1","addr":"172.21.15.105:6835","nonce":1286071598}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T03:01:12.681 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.675+0000 7fd3b802e700 1 -- 172.21.15.57:0/1428375125 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fd394060550 msgr2=0x7fd394062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:12.681 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.675+0000 7fd3b802e700 1 --2- 172.21.15.57:0/1428375125 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fd394060550 0x7fd394062a00 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd3a00093f0 tx=0x7fd3a0017000 comp rx=0 tx=0).stop 2023-10-06T03:01:12.681 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.675+0000 7fd3b802e700 1 -- 172.21.15.57:0/1428375125 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3b00671f0 msgr2=0x7fd3b00ad9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:12.681 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.675+0000 7fd3b802e700 1 --2- 172.21.15.57:0/1428375125 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3b00671f0 0x7fd3b00ad9d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac0011e0 tx=0x7fd3ac007df0 comp rx=0 tx=0).stop 2023-10-06T03:01:12.681 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.675+0000 7fd3b802e700 1 -- 172.21.15.57:0/1428375125 shutdown_connections 2023-10-06T03:01:12.681 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.675+0000 7fd3b802e700 1 --2- 172.21.15.57:0/1428375125 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd3b015cee0 0x7fd3b0160660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:12.681 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.675+0000 7fd3b802e700 1 --2- 172.21.15.57:0/1428375125 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fd394060550 0x7fd394062a00 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:12.682 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.675+0000 7fd3b802e700 1 --2- 172.21.15.57:0/1428375125 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd3b006deb0 0x7fd3b0160120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:12.682 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.675+0000 7fd3b802e700 1 --2- 172.21.15.57:0/1428375125 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3b00671f0 0x7fd3b00ad9d0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:12.682 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.675+0000 7fd3b802e700 1 -- 172.21.15.57:0/1428375125 >> 172.21.15.57:0/1428375125 conn(0x7fd3b00cbdd0 msgr2=0x7fd3b015a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:12.682 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.675+0000 7fd3b802e700 1 -- 172.21.15.57:0/1428375125 shutdown_connections 2023-10-06T03:01:12.682 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.675+0000 7fd3b802e700 1 -- 172.21.15.57:0/1428375125 wait complete. 2023-10-06T03:01:12.686 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 8 2023-10-06T03:01:12.700 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:01:12.855 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.851+0000 7eff633cc700 1 Processor -- start 2023-10-06T03:01:12.856 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.851+0000 7eff633cc700 1 -- start start 2023-10-06T03:01:12.859 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.855+0000 7eff633cc700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7eff5c0aa7e0 0x7eff5c06bba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:12.859 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.855+0000 7eff633cc700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff5c06de50 con 0x7eff5c06c920 2023-10-06T03:01:12.859 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.855+0000 7eff633cc700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff5c06e130 con 0x7eff5c0aae90 2023-10-06T03:01:12.859 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.855+0000 7eff633cc700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff5c06b3a0 con 0x7eff5c0aa7e0 2023-10-06T03:01:12.860 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.855+0000 7eff623ca700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7eff5c06c920 0x7eff5c06ccf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:45982/0 (socket says 172.21.15.57:45982) 2023-10-06T03:01:12.860 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.855+0000 7eff623ca700 1 -- 172.21.15.57:0/3133467823 learned_addr learned my addr 172.21.15.57:0/3133467823 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:01:12.860 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.855+0000 7eff62bcb700 1 --2- 172.21.15.57:0/3133467823 >> v2:172.21.15.105:3300/0 conn(0x7eff5c0aa7e0 0x7eff5c06bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:12.861 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.855+0000 7eff613c8700 1 -- 172.21.15.57:0/3133467823 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3486656776 0 0) 0x7eff5c06de50 con 0x7eff5c06c920 2023-10-06T03:01:12.861 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.855+0000 7eff613c8700 1 -- 172.21.15.57:0/3133467823 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff48003570 con 0x7eff5c06c920 2023-10-06T03:01:12.861 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.855+0000 7eff613c8700 1 -- 172.21.15.57:0/3133467823 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 516448077 0 0) 0x7eff5c06e130 con 0x7eff5c0aae90 2023-10-06T03:01:12.861 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.855+0000 7eff613c8700 1 -- 172.21.15.57:0/3133467823 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff5c06de50 con 0x7eff5c0aae90 2023-10-06T03:01:12.861 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.855+0000 7eff613c8700 1 -- 172.21.15.57:0/3133467823 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3711000461 0 0) 0x7eff48003570 con 0x7eff5c06c920 2023-10-06T03:01:12.861 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.855+0000 7eff62bcb700 1 -- 172.21.15.57:0/3133467823 >> v1:172.21.15.105:6789/0 conn(0x7eff5c0aae90 legacy=0x7eff5c0ab970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:12.862 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.855+0000 7eff62bcb700 1 -- 172.21.15.57:0/3133467823 >> v1:172.21.15.57:6789/0 conn(0x7eff5c06c920 legacy=0x7eff5c06ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:12.862 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.855+0000 7eff62bcb700 1 -- 172.21.15.57:0/3133467823 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff5c06b680 con 0x7eff5c0aa7e0 2023-10-06T03:01:12.862 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.855+0000 7eff62bcb700 1 --2- 172.21.15.57:0/3133467823 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7eff5c0aa7e0 0x7eff5c06bba0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7eff54009e60 tx=0x7eff54009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6538f08de58fa179 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:12.862 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.855+0000 7eff613c8700 1 -- 172.21.15.57:0/3133467823 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff5400e070 con 0x7eff5c0aa7e0 2023-10-06T03:01:12.863 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.859+0000 7eff613c8700 1 -- 172.21.15.57:0/3133467823 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff5400b7a0 con 0x7eff5c0aa7e0 2023-10-06T03:01:12.863 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.859+0000 7eff613c8700 1 -- 172.21.15.57:0/3133467823 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff58001470 con 0x7eff5c0aa7e0 2023-10-06T03:01:12.863 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.859+0000 7eff633cc700 1 -- 172.21.15.57:0/3133467823 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7eff5c0aa7e0 msgr2=0x7eff5c06bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:12.863 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.859+0000 7eff633cc700 1 --2- 172.21.15.57:0/3133467823 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7eff5c0aa7e0 0x7eff5c06bba0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7eff54009e60 tx=0x7eff54009780 comp rx=0 tx=0).stop 2023-10-06T03:01:12.864 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.859+0000 7eff633cc700 1 -- 172.21.15.57:0/3133467823 shutdown_connections 2023-10-06T03:01:12.864 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.859+0000 7eff633cc700 1 --2- 172.21.15.57:0/3133467823 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7eff5c0aa7e0 0x7eff5c06bba0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:12.864 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.859+0000 7eff633cc700 1 -- 172.21.15.57:0/3133467823 >> 172.21.15.57:0/3133467823 conn(0x7eff5c0c85e0 msgr2=0x7eff5c0c89e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:12.864 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.859+0000 7eff633cc700 1 -- 172.21.15.57:0/3133467823 shutdown_connections 2023-10-06T03:01:12.865 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.859+0000 7eff633cc700 1 -- 172.21.15.57:0/3133467823 wait complete. 2023-10-06T03:01:12.867 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.863+0000 7eff633cc700 1 Processor -- start 2023-10-06T03:01:12.867 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.863+0000 7eff633cc700 1 -- start start 2023-10-06T03:01:12.868 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.863+0000 7eff633cc700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7eff5c06c920 0x7eff5c160390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:12.869 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.863+0000 7eff633cc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7eff5c0aa7e0 0x7eff5c0c0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:12.869 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.863+0000 7eff633cc700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7eff5c0aae90 0x7eff5c0bf5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:12.869 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.863+0000 7eff633cc700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff5c0c2430 con 0x7eff5c0aa7e0 2023-10-06T03:01:12.869 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.863+0000 7eff633cc700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff5c0bfc40 con 0x7eff5c06c920 2023-10-06T03:01:12.869 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.863+0000 7eff633cc700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff5c0bff20 con 0x7eff5c0aae90 2023-10-06T03:01:12.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.863+0000 7eff61bc9700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7eff5c0aa7e0 0x7eff5c0c0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:12.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.863+0000 7eff61bc9700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7eff5c0aa7e0 0x7eff5c0c0ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56152/0 (socket says 172.21.15.57:56152) 2023-10-06T03:01:12.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.863+0000 7eff61bc9700 1 -- 172.21.15.57:0/3546793698 learned_addr learned my addr 172.21.15.57:0/3546793698 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:12.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.863+0000 7eff623ca700 1 --2- 172.21.15.57:0/3546793698 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7eff5c06c920 0x7eff5c160390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:12.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.863+0000 7eff62bcb700 1 --2- 172.21.15.57:0/3546793698 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7eff5c0aae90 0x7eff5c0bf5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:12.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.863+0000 7eff61bc9700 1 -- 172.21.15.57:0/3546793698 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7eff5c0aae90 msgr2=0x7eff5c0bf5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:12.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.863+0000 7eff61bc9700 1 --2- 172.21.15.57:0/3546793698 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7eff5c0aae90 0x7eff5c0bf5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:12.871 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.863+0000 7eff61bc9700 1 -- 172.21.15.57:0/3546793698 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7eff5c06c920 msgr2=0x7eff5c160390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:12.871 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.863+0000 7eff61bc9700 1 --2- 172.21.15.57:0/3546793698 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7eff5c06c920 0x7eff5c160390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:12.871 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.863+0000 7eff61bc9700 1 -- 172.21.15.57:0/3546793698 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff54009a20 con 0x7eff5c0aa7e0 2023-10-06T03:01:12.871 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.863+0000 7eff623ca700 1 --2- 172.21.15.57:0/3546793698 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7eff5c06c920 0x7eff5c160390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:12.871 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.863+0000 7eff61bc9700 1 --2- 172.21.15.57:0/3546793698 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7eff5c0aa7e0 0x7eff5c0c0ce0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7eff4c00c580 tx=0x7eff4c007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:12.872 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.867+0000 7eff527fc700 1 -- 172.21.15.57:0/3546793698 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff4c010510 con 0x7eff5c0aa7e0 2023-10-06T03:01:12.872 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.867+0000 7eff527fc700 1 -- 172.21.15.57:0/3546793698 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff4c010670 con 0x7eff5c0aa7e0 2023-10-06T03:01:12.872 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.867+0000 7eff633cc700 1 -- 172.21.15.57:0/3546793698 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff5c0c0200 con 0x7eff5c0aa7e0 2023-10-06T03:01:12.872 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.867+0000 7eff527fc700 1 -- 172.21.15.57:0/3546793698 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff4c010a30 con 0x7eff5c0aa7e0 2023-10-06T03:01:12.872 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.867+0000 7eff633cc700 1 -- 172.21.15.57:0/3546793698 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff5c0c07c0 con 0x7eff5c0aa7e0 2023-10-06T03:01:12.872 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.867+0000 7eff633cc700 1 -- 172.21.15.57:0/3546793698 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff5c0c09e0 con 0x7eff5c0aa7e0 2023-10-06T03:01:12.874 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.867+0000 7eff527fc700 1 -- 172.21.15.57:0/3546793698 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7eff4c01b400 con 0x7eff5c0aa7e0 2023-10-06T03:01:12.876 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.871+0000 7eff527fc700 1 --2- 172.21.15.57:0/3546793698 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7eff40060550 0x7eff40062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:12.876 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.871+0000 7eff527fc700 1 -- 172.21.15.57:0/3546793698 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7eff4c07c640 con 0x7eff5c0aa7e0 2023-10-06T03:01:12.876 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.871+0000 7eff623ca700 1 --2- 172.21.15.57:0/3546793698 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7eff40060550 0x7eff40062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:12.877 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.871+0000 7eff623ca700 1 --2- 172.21.15.57:0/3546793698 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7eff40060550 0x7eff40062a00 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7eff580011e0 tx=0x7eff58000bc0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:12.882 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:12.875+0000 7eff527fc700 1 -- 172.21.15.57:0/3546793698 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7eff4c04ca30 con 0x7eff5c0aa7e0 2023-10-06T03:01:13.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:13.051+0000 7eff633cc700 1 -- 172.21.15.57:0/3546793698 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7eff5c04be40 con 0x7eff5c0aa7e0 2023-10-06T03:01:13.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:13.051+0000 7eff527fc700 1 -- 172.21.15.57:0/3546793698 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16866 (secure 0 0 0) 0x7eff4c050050 con 0x7eff5c0aa7e0 2023-10-06T03:01:13.058 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:01:13.058 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":23,"fsid":"eb56dc0f-9213-41cb-9aad-8ade6c802e98","created":"2023-10-06T03:00:30.806197+0000","modified":"2023-10-06T03:00:58.975366+0000","last_up_change":"2023-10-06T03:00:43.607454+0000","last_in_change":"2023-10-06T03:00:33.943513+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T03:00:44.360651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T03:00:50.466601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:00:55.472586+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T03:00:56.400884+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"58cf6c90-d704-43e0-b2db-dffe526d5e8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":33053},{"type":"v1","addr":"172.21.15.57:6801","nonce":33053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":33053},{"type":"v1","addr":"172.21.15.57:6803","nonce":33053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":33053},{"type":"v1","addr":"172.21.15.57:6807","nonce":33053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":33053},{"type":"v1","addr":"172.21.15.57:6805","nonce":33053}]},"public_addr":"172.21.15.57:6801/33053","cluster_addr":"172.21.15.57:6803/33053","heartbeat_back_addr":"172.21.15.57:6807/33053","heartbeat_front_addr":"172.21.15.57:6805/33053","state":["exists","up"]},{"osd":1,"uuid":"16afbe70-7f9e-4568-9c92-763e6e348119","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6809","nonce":33052},{"type":"v1","addr":"172.21.15.57:6810","nonce":33052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":33052},{"type":"v1","addr":"172.21.15.57:6813","nonce":33052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":33052},{"type":"v1","addr":"172.21.15.57:6822","nonce":33052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6815","nonce":33052},{"type":"v1","addr":"172.21.15.57:6818","nonce":33052}]},"public_addr":"172.21.15.57:6810/33052","cluster_addr":"172.21.15.57:6813/33052","heartbeat_back_addr":"172.21.15.57:6822/33052","heartbeat_front_addr":"172.21.15.57:6818/33052","state":["exists","up"]},{"osd":2,"uuid":"7255c62e-f92f-470f-a5ce-30228920d9f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":33058},{"type":"v1","addr":"172.21.15.57:6825","nonce":33058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":33058},{"type":"v1","addr":"172.21.15.57:6827","nonce":33058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":33058},{"type":"v1","addr":"172.21.15.57:6831","nonce":33058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":33058},{"type":"v1","addr":"172.21.15.57:6829","nonce":33058}]},"public_addr":"172.21.15.57:6825/33058","cluster_addr":"172.21.15.57:6827/33058","heartbeat_back_addr":"172.21.15.57:6831/33058","heartbeat_front_addr":"172.21.15.57:6829/33058","state":["exists","up"]},{"osd":3,"uuid":"152a236d-f799-4888-8544-74865508d5a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":33057},{"type":"v1","addr":"172.21.15.57:6811","nonce":33057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":33057},{"type":"v1","addr":"172.21.15.57:6816","nonce":33057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6821","nonce":33057},{"type":"v1","addr":"172.21.15.57:6823","nonce":33057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6817","nonce":33057},{"type":"v1","addr":"172.21.15.57:6819","nonce":33057}]},"public_addr":"172.21.15.57:6811/33057","cluster_addr":"172.21.15.57:6816/33057","heartbeat_back_addr":"172.21.15.57:6823/33057","heartbeat_front_addr":"172.21.15.57:6819/33057","state":["exists","up"]},{"osd":4,"uuid":"37db2a65-3566-41d0-9d60-e66c49e1e68e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":33368},{"type":"v1","addr":"172.21.15.105:6801","nonce":33368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":33368},{"type":"v1","addr":"172.21.15.105:6803","nonce":33368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":33368},{"type":"v1","addr":"172.21.15.105:6807","nonce":33368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":33368},{"type":"v1","addr":"172.21.15.105:6805","nonce":33368}]},"public_addr":"172.21.15.105:6801/33368","cluster_addr":"172.21.15.105:6803/33368","heartbeat_back_addr":"172.21.15.105:6807/33368","heartbeat_front_addr":"172.21.15.105:6805/33368","state":["exists","up"]},{"osd":5,"uuid":"35e77918-1bb4-42ca-9b20-f3c14eaa0c04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":33379},{"type":"v1","addr":"172.21.15.105:6818","nonce":33379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":33379},{"type":"v1","addr":"172.21.15.105:6823","nonce":33379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":33379},{"type":"v1","addr":"172.21.15.105:6831","nonce":33379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":33379},{"type":"v1","addr":"172.21.15.105:6827","nonce":33379}]},"public_addr":"172.21.15.105:6818/33379","cluster_addr":"172.21.15.105:6823/33379","heartbeat_back_addr":"172.21.15.105:6831/33379","heartbeat_front_addr":"172.21.15.105:6827/33379","state":["exists","up"]},{"osd":6,"uuid":"b4d9d510-7a45-4173-8287-c6c8d6547f2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":33369},{"type":"v1","addr":"172.21.15.105:6819","nonce":33369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":33369},{"type":"v1","addr":"172.21.15.105:6822","nonce":33369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":33369},{"type":"v1","addr":"172.21.15.105:6830","nonce":33369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":33369},{"type":"v1","addr":"172.21.15.105:6826","nonce":33369}]},"public_addr":"172.21.15.105:6819/33369","cluster_addr":"172.21.15.105:6822/33369","heartbeat_back_addr":"172.21.15.105:6830/33369","heartbeat_front_addr":"172.21.15.105:6826/33369","state":["exists","up"]},{"osd":7,"uuid":"74266fb0-cd84-463f-8bf0-092652a71dc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":33370},{"type":"v1","addr":"172.21.15.105:6809","nonce":33370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":33370},{"type":"v1","addr":"172.21.15.105:6811","nonce":33370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":33370},{"type":"v1","addr":"172.21.15.105:6815","nonce":33370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":33370},{"type":"v1","addr":"172.21.15.105:6813","nonce":33370}]},"public_addr":"172.21.15.105:6809/33370","cluster_addr":"172.21.15.105:6811/33370","heartbeat_back_addr":"172.21.15.105:6815/33370","heartbeat_front_addr":"172.21.15.105:6813/33370","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.596864+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.633851+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.636993+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.529681+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.608601+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.659752+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.661717+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.642221+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:01:13.061 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:13.055+0000 7eff633cc700 1 -- 172.21.15.57:0/3546793698 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7eff40060550 msgr2=0x7eff40062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:13.061 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:13.055+0000 7eff633cc700 1 --2- 172.21.15.57:0/3546793698 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7eff40060550 0x7eff40062a00 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7eff580011e0 tx=0x7eff58000bc0 comp rx=0 tx=0).stop 2023-10-06T03:01:13.061 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:13.055+0000 7eff633cc700 1 -- 172.21.15.57:0/3546793698 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7eff5c0aa7e0 msgr2=0x7eff5c0c0ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:13.061 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:13.055+0000 7eff633cc700 1 --2- 172.21.15.57:0/3546793698 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7eff5c0aa7e0 0x7eff5c0c0ce0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7eff4c00c580 tx=0x7eff4c007e10 comp rx=0 tx=0).stop 2023-10-06T03:01:13.061 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:13.055+0000 7eff633cc700 1 -- 172.21.15.57:0/3546793698 shutdown_connections 2023-10-06T03:01:13.061 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:13.055+0000 7eff633cc700 1 --2- 172.21.15.57:0/3546793698 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7eff40060550 0x7eff40062a00 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:13.061 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:13.055+0000 7eff633cc700 1 --2- 172.21.15.57:0/3546793698 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7eff5c0aae90 0x7eff5c0bf5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:13.061 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:13.055+0000 7eff633cc700 1 --2- 172.21.15.57:0/3546793698 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7eff5c0aa7e0 0x7eff5c0c0ce0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:13.061 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:13.055+0000 7eff633cc700 1 --2- 172.21.15.57:0/3546793698 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7eff5c06c920 0x7eff5c160390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:13.061 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:13.055+0000 7eff633cc700 1 -- 172.21.15.57:0/3546793698 >> 172.21.15.57:0/3546793698 conn(0x7eff5c0c85e0 msgr2=0x7eff5c06ccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:13.061 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:13.055+0000 7eff633cc700 1 -- 172.21.15.57:0/3546793698 shutdown_connections 2023-10-06T03:01:13.061 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:13.055+0000 7eff633cc700 1 -- 172.21.15.57:0/3546793698 wait complete. 2023-10-06T03:01:13.083 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:01:13.245 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:13.239+0000 7fd007d45700 1 Processor -- start 2023-10-06T03:01:13.245 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:13.239+0000 7fd007d45700 1 -- start start 2023-10-06T03:01:13.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:13.243+0000 7fd007d45700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd00006deb0 0x7fd0000675c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:13.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:13.243+0000 7fd007d45700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fd00015cee0 0x7fd00015d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:13.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:13.243+0000 7fd007d45700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd00006da20 con 0x7fd0000671f0 2023-10-06T03:01:13.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:13.243+0000 7fd007d45700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0000b0650 con 0x7fd00015cee0 2023-10-06T03:01:13.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:13.243+0000 7fd007d45700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd00006ce10 con 0x7fd00006deb0 2023-10-06T03:01:13.248 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:13.243+0000 7fd005ae1700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fd0000671f0 0x7fd0000aff40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:45984/0 (socket says 172.21.15.57:45984) 2023-10-06T03:01:13.248 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:13.243+0000 7fd005ae1700 1 -- 172.21.15.57:0/693445065 learned_addr learned my addr 172.21.15.57:0/693445065 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:01:13.248 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:13.243+0000 7fd0062e2700 1 --2- 172.21.15.57:0/693445065 >> v2:172.21.15.105:3300/0 conn(0x7fd00015cee0 0x7fd00015d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:13.248 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:13.243+0000 7fd0052e0700 1 --2- 172.21.15.57:0/693445065 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd00006deb0 0x7fd0000675c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:13.249 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:13.243+0000 7fd0052e0700 1 -- 172.21.15.57:0/693445065 >> v2:172.21.15.105:3300/0 conn(0x7fd00015cee0 msgr2=0x7fd00015d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:13.249 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:13.243+0000 7fd0052e0700 1 --2- 172.21.15.57:0/693445065 >> v2:172.21.15.105:3300/0 conn(0x7fd00015cee0 0x7fd00015d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:13.249 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:13.243+0000 7fd0052e0700 1 -- 172.21.15.57:0/693445065 >> v1:172.21.15.57:6789/0 conn(0x7fd0000671f0 legacy=0x7fd0000aff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:13.249 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:13.243+0000 7fd0052e0700 1 -- 172.21.15.57:0/693445065 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd00006d0f0 con 0x7fd00006deb0 2023-10-06T03:01:13.249 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:13.243+0000 7fd004adf700 1 -- 172.21.15.57:0/693445065 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 570075042 0 0) 0x7fd00006da20 con 0x7fd0000671f0 2023-10-06T03:01:13.250 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:13.243+0000 7fd0052e0700 1 --2- 172.21.15.57:0/693445065 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd00006deb0 0x7fd0000675c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fcff00098e0 tx=0x7fcff00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f9a4f5a79369151 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:13.250 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:13.243+0000 7fd004adf700 1 -- 172.21.15.57:0/693445065 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff000b640 con 0x7fd00006deb0 2023-10-06T03:01:13.250 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:13.243+0000 7fd004adf700 1 -- 172.21.15.57:0/693445065 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcff000b7a0 con 0x7fd00006deb0 2023-10-06T03:01:13.250 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:13.243+0000 7fd004adf700 1 -- 172.21.15.57:0/693445065 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff000bb40 con 0x7fd00006deb0 2023-10-06T03:01:13.250 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:13.247+0000 7fd007d45700 1 -- 172.21.15.57:0/693445065 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd00006deb0 msgr2=0x7fd0000675c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:13.251 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:13.247+0000 7fd007d45700 1 --2- 172.21.15.57:0/693445065 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd00006deb0 0x7fd0000675c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fcff00098e0 tx=0x7fcff00091a0 comp rx=0 tx=0).stop 2023-10-06T03:01:13.251 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:13.247+0000 7fd007d45700 1 -- 172.21.15.57:0/693445065 shutdown_connections 2023-10-06T03:01:13.251 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:13.247+0000 7fd007d45700 1 --2- 172.21.15.57:0/693445065 >> v2:172.21.15.105:3300/0 conn(0x7fd00015cee0 0x7fd00015d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:13.251 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:13.247+0000 7fd007d45700 1 --2- 172.21.15.57:0/693445065 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd00006deb0 0x7fd0000675c0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:13.252 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:13.247+0000 7fd007d45700 1 -- 172.21.15.57:0/693445065 >> 172.21.15.57:0/693445065 conn(0x7fd0000cbdd0 msgr2=0x7fd0000cc1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:13.252 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:13.247+0000 7fd007d45700 1 -- 172.21.15.57:0/693445065 shutdown_connections 2023-10-06T03:01:13.252 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:13.247+0000 7fd007d45700 1 -- 172.21.15.57:0/693445065 wait complete. 2023-10-06T03:01:13.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:13.247+0000 7fd007d45700 1 Processor -- start 2023-10-06T03:01:13.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:13.251+0000 7fd007d45700 1 -- start start 2023-10-06T03:01:13.256 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:13.251+0000 7fd007d45700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd0000671f0 0x7fd0001444b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:13.256 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:13.251+0000 7fd007d45700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd00006deb0 0x7fd000170bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:13.257 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:13.251+0000 7fd007d45700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd00015cee0 0x7fd000171110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:13.257 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:13.251+0000 7fd007d45700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0001449f0 con 0x7fd0000671f0 2023-10-06T03:01:13.257 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:13.251+0000 7fd007d45700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd000143410 con 0x7fd00006deb0 2023-10-06T03:01:13.257 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:13.251+0000 7fd007d45700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0001436f0 con 0x7fd00015cee0 2023-10-06T03:01:13.258 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:13.251+0000 7fd005ae1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd0000671f0 0x7fd0001444b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:13.258 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:13.251+0000 7fd005ae1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd0000671f0 0x7fd0001444b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56158/0 (socket says 172.21.15.57:56158) 2023-10-06T03:01:13.258 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:13.251+0000 7fd005ae1700 1 -- 172.21.15.57:0/4168290610 learned_addr learned my addr 172.21.15.57:0/4168290610 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:13.258 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:13.251+0000 7fd0062e2700 1 --2- 172.21.15.57:0/4168290610 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd00015cee0 0x7fd000171110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:13.258 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:13.251+0000 7fd0052e0700 1 --2- 172.21.15.57:0/4168290610 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd00006deb0 0x7fd000170bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:13.258 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:13.251+0000 7fd0062e2700 1 -- 172.21.15.57:0/4168290610 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd00006deb0 msgr2=0x7fd000170bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:13.258 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:13.251+0000 7fd0062e2700 1 --2- 172.21.15.57:0/4168290610 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd00006deb0 0x7fd000170bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:13.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:13.251+0000 7fd0062e2700 1 -- 172.21.15.57:0/4168290610 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd0000671f0 msgr2=0x7fd0001444b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:13.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:13.251+0000 7fd0062e2700 1 --2- 172.21.15.57:0/4168290610 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd0000671f0 0x7fd0001444b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:13.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:13.251+0000 7fd0062e2700 1 -- 172.21.15.57:0/4168290610 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcff0009420 con 0x7fd00015cee0 2023-10-06T03:01:13.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:13.251+0000 7fd005ae1700 1 --2- 172.21.15.57:0/4168290610 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd0000671f0 0x7fd0001444b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:01:13.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:13.255+0000 7fd0062e2700 1 --2- 172.21.15.57:0/4168290610 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd00015cee0 0x7fd000171110 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fcff800ecc0 tx=0x7fcff800b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:13.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:13.255+0000 7fcff5ffb700 1 -- 172.21.15.57:0/4168290610 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff800c8c0 con 0x7fd00015cee0 2023-10-06T03:01:13.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:13.255+0000 7fcff5ffb700 1 -- 172.21.15.57:0/4168290610 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcff800f040 con 0x7fd00015cee0 2023-10-06T03:01:13.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:13.255+0000 7fcff5ffb700 1 -- 172.21.15.57:0/4168290610 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff800cc90 con 0x7fd00015cee0 2023-10-06T03:01:13.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:13.255+0000 7fd007d45700 1 -- 172.21.15.57:0/4168290610 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0001439d0 con 0x7fd00015cee0 2023-10-06T03:01:13.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:13.255+0000 7fd007d45700 1 -- 172.21.15.57:0/4168290610 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd000143f90 con 0x7fd00015cee0 2023-10-06T03:01:13.261 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:13.255+0000 7fd007d45700 1 -- 172.21.15.57:0/4168290610 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0000712e0 con 0x7fd00015cee0 2023-10-06T03:01:13.263 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:13.259+0000 7fcff5ffb700 1 -- 172.21.15.57:0/4168290610 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fcff8014690 con 0x7fd00015cee0 2023-10-06T03:01:13.264 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:13.259+0000 7fcff5ffb700 1 --2- 172.21.15.57:0/4168290610 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fcfe4060550 0x7fcfe4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:13.264 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:13.259+0000 7fcff5ffb700 1 -- 172.21.15.57:0/4168290610 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fcff807d400 con 0x7fd00015cee0 2023-10-06T03:01:13.265 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:13.259+0000 7fd005ae1700 1 --2- 172.21.15.57:0/4168290610 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fcfe4060550 0x7fcfe4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:13.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:13.259+0000 7fd005ae1700 1 --2- 172.21.15.57:0/4168290610 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fcfe4060550 0x7fcfe4062a00 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fcffc007fd0 tx=0x7fcffc007df0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:13.272 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:13.267+0000 7fcff5ffb700 1 -- 172.21.15.57:0/4168290610 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fcff804d7f0 con 0x7fd00015cee0 2023-10-06T03:01:13.478 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:13.471+0000 7fd007d45700 1 -- 172.21.15.57:0/4168290610 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd000144180 con 0x7fd00015cee0 2023-10-06T03:01:13.480 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:13.475+0000 7fcff5ffb700 1 -- 172.21.15.57:0/4168290610 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4594 (secure 0 0 0) 0x7fcff8050e10 con 0x7fd00015cee0 2023-10-06T03:01:13.480 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:01:13.480 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6834/1042131376","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":1042131376},{"type":"v1","addr":"172.21.15.105:6834","nonce":1042131376}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4287,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6836/3619570714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":3619570714},{"type":"v1","addr":"172.21.15.57:6836","nonce":3619570714}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6837/645924568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6835","nonce":645924568},{"type":"v1","addr":"172.21.15.57:6837","nonce":645924568}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:00:57.411689+0000","modified":"2023-10-06T03:01:00.999490+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4303},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4303":{"gid":4303,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6835/1286071598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":1286071598},{"type":"v1","addr":"172.21.15.105:6835","nonce":1286071598}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T03:01:13.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:13.479+0000 7fd007d45700 1 -- 172.21.15.57:0/4168290610 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fcfe4060550 msgr2=0x7fcfe4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:13.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:13.479+0000 7fd007d45700 1 --2- 172.21.15.57:0/4168290610 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fcfe4060550 0x7fcfe4062a00 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fcffc007fd0 tx=0x7fcffc007df0 comp rx=0 tx=0).stop 2023-10-06T03:01:13.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:13.479+0000 7fd007d45700 1 -- 172.21.15.57:0/4168290610 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd00015cee0 msgr2=0x7fd000171110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:13.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:13.479+0000 7fd007d45700 1 --2- 172.21.15.57:0/4168290610 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd00015cee0 0x7fd000171110 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fcff800ecc0 tx=0x7fcff800b040 comp rx=0 tx=0).stop 2023-10-06T03:01:13.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:13.479+0000 7fd007d45700 1 -- 172.21.15.57:0/4168290610 shutdown_connections 2023-10-06T03:01:13.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:13.479+0000 7fd007d45700 1 --2- 172.21.15.57:0/4168290610 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fcfe4060550 0x7fcfe4062a00 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:13.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:13.479+0000 7fd007d45700 1 --2- 172.21.15.57:0/4168290610 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd00015cee0 0x7fd000171110 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:13.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:13.479+0000 7fd007d45700 1 --2- 172.21.15.57:0/4168290610 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd00006deb0 0x7fd000170bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:13.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:13.479+0000 7fd007d45700 1 --2- 172.21.15.57:0/4168290610 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd0000671f0 0x7fd0001444b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:13.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:13.479+0000 7fd007d45700 1 -- 172.21.15.57:0/4168290610 >> 172.21.15.57:0/4168290610 conn(0x7fd0000cbdd0 msgr2=0x7fd000156e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:13.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:13.479+0000 7fd007d45700 1 -- 172.21.15.57:0/4168290610 shutdown_connections 2023-10-06T03:01:13.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:13.479+0000 7fd007d45700 1 -- 172.21.15.57:0/4168290610 wait complete. 2023-10-06T03:01:13.488 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 8 2023-10-06T03:01:13.909 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T03:00:57.411689+0000', 'modified': '2023-10-06T03:01:00.999490+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4303}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4303': {'gid': 4303, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.105:6835/1286071598', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.105:6833', 'nonce': 1286071598}, {'type': 'v1', 'addr': '172.21.15.105:6835', 'nonce': 1286071598}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T03:01:13.909 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T03:01:13.909 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-06T03:01:14.081 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.075+0000 7f0956545700 1 Processor -- start 2023-10-06T03:01:14.081 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.075+0000 7f0956545700 1 -- start start 2023-10-06T03:01:14.084 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.079+0000 7f0956545700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f09500cc820 0x7f09500cb1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:14.084 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.079+0000 7f0956545700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f09500cb6e0 0x7f095006da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:14.084 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.079+0000 7f0956545700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09500cad10 con 0x7f09501538d0 2023-10-06T03:01:14.084 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.079+0000 7f0956545700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0950156cc0 con 0x7f09500cc820 2023-10-06T03:01:14.084 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.079+0000 7f0956545700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0950156fa0 con 0x7f09500cb6e0 2023-10-06T03:01:14.085 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.079+0000 7f094ffff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f09501538d0 0x7f0950156400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:45994/0 (socket says 172.21.15.57:45994) 2023-10-06T03:01:14.085 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.079+0000 7f094ffff700 1 -- 172.21.15.57:0/4197132533 learned_addr learned my addr 172.21.15.57:0/4197132533 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:01:14.085 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.079+0000 7f094f7fe700 1 --2- 172.21.15.57:0/4197132533 >> v2:172.21.15.105:3300/0 conn(0x7f09500cc820 0x7f09500cb1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:14.086 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.079+0000 7f0954ae2700 1 --2- 172.21.15.57:0/4197132533 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f09500cb6e0 0x7f095006da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:14.086 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.079+0000 7f094f7fe700 1 -- 172.21.15.57:0/4197132533 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f09500cb6e0 msgr2=0x7f095006da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:14.086 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.079+0000 7f094f7fe700 1 --2- 172.21.15.57:0/4197132533 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f09500cb6e0 0x7f095006da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:14.086 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.079+0000 7f094f7fe700 1 -- 172.21.15.57:0/4197132533 >> v1:172.21.15.57:6789/0 conn(0x7f09501538d0 legacy=0x7f0950156400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:14.086 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.079+0000 7f094f7fe700 1 -- 172.21.15.57:0/4197132533 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0950157280 con 0x7f09500cc820 2023-10-06T03:01:14.086 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.079+0000 7f094effd700 1 -- 172.21.15.57:0/4197132533 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 17164159 0 0) 0x7f09500cad10 con 0x7f09501538d0 2023-10-06T03:01:14.086 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.079+0000 7f094f7fe700 1 --2- 172.21.15.57:0/4197132533 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f09500cc820 0x7f09500cb1a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f09440098e0 tx=0x7f09440091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a571640ad921ba6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:14.087 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.083+0000 7f094effd700 1 -- 172.21.15.57:0/4197132533 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f094400b640 con 0x7f09500cc820 2023-10-06T03:01:14.087 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.083+0000 7f094effd700 1 -- 172.21.15.57:0/4197132533 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f094400b7a0 con 0x7f09500cc820 2023-10-06T03:01:14.087 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.083+0000 7f094effd700 1 -- 172.21.15.57:0/4197132533 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f094400bb40 con 0x7f09500cc820 2023-10-06T03:01:14.087 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.083+0000 7f0956545700 1 -- 172.21.15.57:0/4197132533 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f09500cc820 msgr2=0x7f09500cb1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:14.087 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.083+0000 7f0956545700 1 --2- 172.21.15.57:0/4197132533 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f09500cc820 0x7f09500cb1a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f09440098e0 tx=0x7f09440091a0 comp rx=0 tx=0).stop 2023-10-06T03:01:14.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.083+0000 7f0956545700 1 -- 172.21.15.57:0/4197132533 shutdown_connections 2023-10-06T03:01:14.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.083+0000 7f0956545700 1 --2- 172.21.15.57:0/4197132533 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f09500cb6e0 0x7f095006da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:14.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.083+0000 7f0956545700 1 --2- 172.21.15.57:0/4197132533 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f09500cc820 0x7f09500cb1a0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:14.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.083+0000 7f0956545700 1 -- 172.21.15.57:0/4197132533 >> 172.21.15.57:0/4197132533 conn(0x7f09500c9840 msgr2=0x7f09500c9c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:14.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.083+0000 7f0956545700 1 -- 172.21.15.57:0/4197132533 shutdown_connections 2023-10-06T03:01:14.089 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.083+0000 7f0956545700 1 -- 172.21.15.57:0/4197132533 wait complete. 2023-10-06T03:01:14.090 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.087+0000 7f0956545700 1 Processor -- start 2023-10-06T03:01:14.091 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.087+0000 7f0956545700 1 -- start start 2023-10-06T03:01:14.094 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.087+0000 7f0956545700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f09500cb6e0 0x7f09500c4b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:14.094 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.087+0000 7f0956545700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09500cc820 0x7f09500b0190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:14.094 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.087+0000 7f0956545700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f09501538d0 0x7f09500b06d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:14.094 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.087+0000 7f0956545700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09500c60c0 con 0x7f09500cc820 2023-10-06T03:01:14.094 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.087+0000 7f0956545700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09500c54b0 con 0x7f09501538d0 2023-10-06T03:01:14.094 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.087+0000 7f0956545700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09500c5790 con 0x7f09500cb6e0 2023-10-06T03:01:14.094 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.087+0000 7f094f7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09500cc820 0x7f09500b0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:14.094 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.087+0000 7f094f7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09500cc820 0x7f09500b0190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56162/0 (socket says 172.21.15.57:56162) 2023-10-06T03:01:14.095 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.087+0000 7f094f7fe700 1 -- 172.21.15.57:0/1820804900 learned_addr learned my addr 172.21.15.57:0/1820804900 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:14.095 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.087+0000 7f094ffff700 1 --2- 172.21.15.57:0/1820804900 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f09500cb6e0 0x7f09500c4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:14.095 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.087+0000 7f0954ae2700 1 --2- 172.21.15.57:0/1820804900 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f09501538d0 0x7f09500b06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:14.096 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.087+0000 7f094f7fe700 1 -- 172.21.15.57:0/1820804900 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f09500cb6e0 msgr2=0x7f09500c4b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:14.096 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.087+0000 7f094f7fe700 1 --2- 172.21.15.57:0/1820804900 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f09500cb6e0 0x7f09500c4b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:14.096 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.087+0000 7f094f7fe700 1 -- 172.21.15.57:0/1820804900 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f09501538d0 msgr2=0x7f09500b06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:14.096 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.087+0000 7f094f7fe700 1 --2- 172.21.15.57:0/1820804900 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f09501538d0 0x7f09500b06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:14.096 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.087+0000 7f094f7fe700 1 -- 172.21.15.57:0/1820804900 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0944009420 con 0x7f09500cc820 2023-10-06T03:01:14.096 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.091+0000 7f094f7fe700 1 --2- 172.21.15.57:0/1820804900 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09500cc820 0x7f09500b0190 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f095006b4b0 tx=0x7f0944017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:14.096 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.091+0000 7f0937fff700 1 -- 172.21.15.57:0/1820804900 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f094400bb20 con 0x7f09500cc820 2023-10-06T03:01:14.096 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.091+0000 7f0937fff700 1 -- 172.21.15.57:0/1820804900 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0944000c90 con 0x7f09500cc820 2023-10-06T03:01:14.096 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.091+0000 7f0956545700 1 -- 172.21.15.57:0/1820804900 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09500c5a70 con 0x7f09500cc820 2023-10-06T03:01:14.097 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.091+0000 7f0937fff700 1 -- 172.21.15.57:0/1820804900 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0944011630 con 0x7f09500cc820 2023-10-06T03:01:14.097 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.091+0000 7f0956545700 1 -- 172.21.15.57:0/1820804900 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09501530a0 con 0x7f09500cc820 2023-10-06T03:01:14.099 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.095+0000 7f0937fff700 1 -- 172.21.15.57:0/1820804900 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f09440119a0 con 0x7f09500cc820 2023-10-06T03:01:14.100 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.095+0000 7f0937fff700 1 --2- 172.21.15.57:0/1820804900 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f093c060580 0x7f093c062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:14.101 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.095+0000 7f0937fff700 1 -- 172.21.15.57:0/1820804900 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f094407dc90 con 0x7f09500cc820 2023-10-06T03:01:14.101 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.095+0000 7f094ffff700 1 --2- 172.21.15.57:0/1820804900 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f093c060580 0x7f093c062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:14.102 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.095+0000 7f094ffff700 1 --2- 172.21.15.57:0/1820804900 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f093c060580 0x7f093c062a30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0940007240 tx=0x7f0940001970 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:14.103 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.099+0000 7f095881e740 1 Processor -- start 2023-10-06T03:01:14.103 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.099+0000 7f095881e740 1 -- start start 2023-10-06T03:01:14.104 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.099+0000 7f095881e740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x165fae0 0x18dce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:14.104 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.099+0000 7f095881e740 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x165f710 0x18dd390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:14.104 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.099+0000 7f095881e740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x16aa790 0x18dd8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:14.104 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.099+0000 7f095881e740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x180af30 con 0x16aa790 2023-10-06T03:01:14.104 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.099+0000 7f095881e740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x1806ed0 con 0x165fae0 2023-10-06T03:01:14.104 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.099+0000 7f095881e740 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x17cd0b0 con 0x165f710 2023-10-06T03:01:14.105 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.099+0000 7f0954ae2700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x16aa790 0x18dd8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:14.105 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.099+0000 7f0954ae2700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x16aa790 0x18dd8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56164/0 (socket says 172.21.15.57:56164) 2023-10-06T03:01:14.106 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.099+0000 7f0954ae2700 1 -- 172.21.15.57:0/549336965 learned_addr learned my addr 172.21.15.57:0/549336965 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:14.106 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.099+0000 7f094ffff700 1 --2- 172.21.15.57:0/549336965 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x165fae0 0x18dce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:14.106 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.099+0000 7f094f7fe700 1 --2- 172.21.15.57:0/549336965 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x165f710 0x18dd390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:14.106 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.099+0000 7f0954ae2700 1 -- 172.21.15.57:0/549336965 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x165f710 msgr2=0x18dd390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:14.106 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.099+0000 7f0954ae2700 1 --2- 172.21.15.57:0/549336965 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x165f710 0x18dd390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:14.106 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.099+0000 7f0954ae2700 1 -- 172.21.15.57:0/549336965 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x165fae0 msgr2=0x18dce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:14.106 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.099+0000 7f0954ae2700 1 --2- 172.21.15.57:0/549336965 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x165fae0 0x18dce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:14.106 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.099+0000 7f0954ae2700 1 -- 172.21.15.57:0/549336965 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x16ab9e0 con 0x16aa790 2023-10-06T03:01:14.107 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.099+0000 7f0954ae2700 1 --2- 172.21.15.57:0/549336965 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x16aa790 0x18dd8d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f0948009cf0 tx=0x7f09480091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=593caebbd8f71f2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:14.107 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.099+0000 7f09357fa700 1 -- 172.21.15.57:0/549336965 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0948011ae0 con 0x16aa790 2023-10-06T03:01:14.107 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.103+0000 7f09357fa700 1 -- 172.21.15.57:0/549336965 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0948011c40 con 0x16aa790 2023-10-06T03:01:14.107 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.103+0000 7f09357fa700 1 -- 172.21.15.57:0/549336965 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f094801d480 con 0x16aa790 2023-10-06T03:01:14.108 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.103+0000 7f095881e740 1 -- 172.21.15.57:0/549336965 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x16aa790 msgr2=0x18dd8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:14.108 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.103+0000 7f095881e740 1 --2- 172.21.15.57:0/549336965 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x16aa790 0x18dd8d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f0948009cf0 tx=0x7f09480091a0 comp rx=0 tx=0).stop 2023-10-06T03:01:14.108 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.103+0000 7f095881e740 1 -- 172.21.15.57:0/549336965 shutdown_connections 2023-10-06T03:01:14.108 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.103+0000 7f095881e740 1 --2- 172.21.15.57:0/549336965 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x16aa790 0x18dd8d0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:14.108 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.103+0000 7f095881e740 1 --2- 172.21.15.57:0/549336965 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x165f710 0x18dd390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:14.109 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.103+0000 7f095881e740 1 --2- 172.21.15.57:0/549336965 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x165fae0 0x18dce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:14.109 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.103+0000 7f095881e740 1 -- 172.21.15.57:0/549336965 >> 172.21.15.57:0/549336965 conn(0x165feb0 msgr2=0x1899880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:14.109 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.103+0000 7f095881e740 1 -- 172.21.15.57:0/549336965 shutdown_connections 2023-10-06T03:01:14.109 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.103+0000 7f095881e740 1 -- 172.21.15.57:0/549336965 wait complete. 2023-10-06T03:01:14.109 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.103+0000 7f095881e740 1 -- start start 2023-10-06T03:01:14.109 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.103+0000 7f095881e740 1 Processor -- start 2023-10-06T03:01:14.111 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.107+0000 7f095881e740 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x165f710 0x1899740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:14.111 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.107+0000 7f095881e740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x165fae0 0x18c2c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:14.111 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.107+0000 7f095881e740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x16aa790 0x18c3140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:14.111 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.107+0000 7f095881e740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x17ccd50 con 0x16aa790 2023-10-06T03:01:14.111 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.107+0000 7f095881e740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x17a5970 con 0x165fae0 2023-10-06T03:01:14.111 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.107+0000 7f095881e740 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x180d290 con 0x165f710 2023-10-06T03:01:14.111 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.107+0000 7f095881e740 10 client.0 _ll_register_callbacks cb 0x1850b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:01:14.112 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.107+0000 7f0954ae2700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x16aa790 0x18c3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:14.112 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.107+0000 7f0954ae2700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x16aa790 0x18c3140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56168/0 (socket says 172.21.15.57:56168) 2023-10-06T03:01:14.112 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.107+0000 7f0954ae2700 1 -- 172.21.15.57:0/1833934257 learned_addr learned my addr 172.21.15.57:0/1833934257 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:14.112 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.107+0000 7f094f7fe700 1 --2- 172.21.15.57:0/1833934257 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x165fae0 0x18c2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:14.112 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.107+0000 7f094ffff700 1 --2- 172.21.15.57:0/1833934257 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x165f710 0x1899740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:14.112 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.107+0000 7f094f7fe700 1 -- 172.21.15.57:0/1833934257 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x165f710 msgr2=0x1899740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:14.113 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.107+0000 7f094f7fe700 1 --2- 172.21.15.57:0/1833934257 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x165f710 0x1899740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:14.113 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.107+0000 7f094f7fe700 1 -- 172.21.15.57:0/1833934257 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x16aa790 msgr2=0x18c3140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:14.113 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.107+0000 7f094f7fe700 1 --2- 172.21.15.57:0/1833934257 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x16aa790 0x18c3140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:14.113 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.107+0000 7f094f7fe700 1 -- 172.21.15.57:0/1833934257 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0948009a20 con 0x165fae0 2023-10-06T03:01:14.113 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.107+0000 7f0954ae2700 1 --2- 172.21.15.57:0/1833934257 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x16aa790 0x18c3140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:01:14.114 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.107+0000 7f094f7fe700 1 --2- 172.21.15.57:0/1833934257 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x165fae0 0x18c2c00 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f094407c010 tx=0x7f0944057040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=30bea4b425646d54 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:14.114 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.107+0000 7f092e7fc700 10 client.0 ms_handle_connect on v2:172.21.15.105:3300/0 2023-10-06T03:01:14.114 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.107+0000 7f092e7fc700 1 -- 172.21.15.57:0/1833934257 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09440524e0 con 0x165fae0 2023-10-06T03:01:14.115 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.107+0000 7f095881e740 1 -- 172.21.15.57:0/1833934257 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x17a5cc0 con 0x165fae0 2023-10-06T03:01:14.115 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.107+0000 7f092e7fc700 1 -- 172.21.15.57:0/1833934257 <== mon.1 v2:172.21.15.105:3300/0 2 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0944067170 con 0x165fae0 2023-10-06T03:01:14.115 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.107+0000 7f092e7fc700 1 -- 172.21.15.57:0/1833934257 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0944054fd0 con 0x165fae0 2023-10-06T03:01:14.115 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.107+0000 7f095881e740 10 client.4699 fetch_fsmap learned FSMap version 8 2023-10-06T03:01:14.115 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.107+0000 7f095881e740 1 -- 172.21.15.57:0/1833934257 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x17d5370 con 0x165fae0 2023-10-06T03:01:14.115 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.107+0000 7f092e7fc700 1 -- 172.21.15.57:0/1833934257 <== mon.1 v2:172.21.15.105:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f094407b080 con 0x165fae0 2023-10-06T03:01:14.115 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.107+0000 7f092e7fc700 1 -- 172.21.15.57:0/1833934257 <== mon.1 v2:172.21.15.105:3300/0 5 ==== fsmap(e 8) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f0944051fe0 con 0x165fae0 2023-10-06T03:01:14.115 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.107+0000 7f095881e740 10 client.4699 fetch_fsmap finished waiting for FSMap version 8 2023-10-06T03:01:14.115 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.107+0000 7f095881e740 10 client.4699 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-06T03:01:14.115 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.107+0000 7f095881e740 20 client.4699 populate_metadata read hostname 'smithi057' 2023-10-06T03:01:14.115 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.107+0000 7f095881e740 1 --2- 172.21.15.57:0/1833934257 >> [v2:172.21.15.105:6833/1286071598,v1:172.21.15.105:6835/1286071598] conn(0x18e96b0 0x18eba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:14.116 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.107+0000 7f095881e740 4 client.4699 mds_command: new command op to 4303 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T03:01:14.116 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.107+0000 7f095881e740 1 -- 172.21.15.57:0/1833934257 --> [v2:172.21.15.105:6833/1286071598,v1:172.21.15.105:6835/1286071598] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x17a93e0 con 0x18e96b0 2023-10-06T03:01:14.116 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.111+0000 7f094ffff700 1 --2- 172.21.15.57:0/1833934257 >> [v2:172.21.15.105:6833/1286071598,v1:172.21.15.105:6835/1286071598] conn(0x18e96b0 0x18eba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:14.116 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.111+0000 7f094ffff700 1 --2- 172.21.15.57:0/1833934257 >> [v2:172.21.15.105:6833/1286071598,v1:172.21.15.105:6835/1286071598] conn(0x18e96b0 0x18eba90 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=658de99879903fff server_cookie=5f28377b9605e60d in_seq=0 out_seq=0 2023-10-06T03:01:14.116 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.111+0000 7f092e7fc700 10 client.4699 ms_handle_connect on v2:172.21.15.105:6833/1286071598 2023-10-06T03:01:14.118 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.111+0000 7f092e7fc700 1 -- 172.21.15.57:0/1833934257 <== mds.0 v2:172.21.15.105:6833/1286071598 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x17a93e0 con 0x18e96b0 2023-10-06T03:01:14.118 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.111+0000 7f092e7fc700 10 client.4699 handle_command_reply: tid=0 2023-10-06T03:01:14.118 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.111+0000 7f095881e740 1 client.4699 shutdown 2023-10-06T03:01:14.119 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.111+0000 7f095881e740 1 -- 172.21.15.57:0/1833934257 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x165fae0 msgr2=0x18c2c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:14.119 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.111+0000 7f095881e740 1 --2- 172.21.15.57:0/1833934257 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x165fae0 0x18c2c00 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f094407c010 tx=0x7f0944057040 comp rx=0 tx=0).stop 2023-10-06T03:01:14.119 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.111+0000 7f095881e740 1 -- 172.21.15.57:0/1833934257 shutdown_connections 2023-10-06T03:01:14.119 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.111+0000 7f095881e740 1 --2- 172.21.15.57:0/1833934257 >> [v2:172.21.15.105:6833/1286071598,v1:172.21.15.105:6835/1286071598] conn(0x18e96b0 0x18eba90 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:14.119 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.111+0000 7f095881e740 1 --2- 172.21.15.57:0/1833934257 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x16aa790 0x18c3140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:14.120 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.111+0000 7f095881e740 1 --2- 172.21.15.57:0/1833934257 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x165fae0 0x18c2c00 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:14.120 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.115+0000 7f095881e740 1 --2- 172.21.15.57:0/1833934257 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x165f710 0x1899740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:14.120 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.115+0000 7f095881e740 1 -- 172.21.15.57:0/1833934257 >> 172.21.15.57:0/1833934257 conn(0x165feb0 msgr2=0x1891ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:14.120 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.115+0000 7f092e7fc700 0 client.4699 ms_handle_reset on v2:172.21.15.105:6833/1286071598 2023-10-06T03:01:14.120 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.115+0000 7f095881e740 1 -- 172.21.15.57:0/1833934257 shutdown_connections 2023-10-06T03:01:14.120 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.115+0000 7f095881e740 1 -- 172.21.15.57:0/1833934257 wait complete. 2023-10-06T03:01:14.120 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.115+0000 7f095881e740 20 client.4699 trim_cache size 0 max 16384 2023-10-06T03:01:14.138 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.131+0000 7f095881e740 1 Processor -- start 2023-10-06T03:01:14.139 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.135+0000 7f095881e740 1 -- start start 2023-10-06T03:01:14.140 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.135+0000 7f095881e740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x165f710 0x18eba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:14.140 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.135+0000 7f095881e740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x165fae0 0x18ebfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:14.140 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.135+0000 7f095881e740 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x16aa790 0x18ec510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:14.140 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.135+0000 7f095881e740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x17da040 con 0x165f710 2023-10-06T03:01:14.140 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.135+0000 7f095881e740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x1804890 con 0x165fae0 2023-10-06T03:01:14.140 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.135+0000 7f095881e740 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x17dc550 con 0x16aa790 2023-10-06T03:01:14.141 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.135+0000 7f094f7fe700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x165fae0 0x18ebfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:14.141 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.135+0000 7f094ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x165f710 0x18eba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:14.141 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.135+0000 7f0954ae2700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x16aa790 0x18ec510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:14.141 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.135+0000 7f094f7fe700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x165fae0 0x18ebfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.57:39876/0 (socket says 172.21.15.57:39876) 2023-10-06T03:01:14.141 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.135+0000 7f094f7fe700 1 -- 172.21.15.57:0/3888908294 learned_addr learned my addr 172.21.15.57:0/3888908294 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:14.142 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.135+0000 7f094f7fe700 1 -- 172.21.15.57:0/3888908294 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x16aa790 msgr2=0x18ec510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:14.142 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.135+0000 7f094f7fe700 1 --2- 172.21.15.57:0/3888908294 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x16aa790 0x18ec510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:14.142 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.135+0000 7f094f7fe700 1 -- 172.21.15.57:0/3888908294 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x165f710 msgr2=0x18eba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:14.142 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.135+0000 7f094f7fe700 1 --2- 172.21.15.57:0/3888908294 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x165f710 0x18eba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:14.143 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.135+0000 7f094f7fe700 1 -- 172.21.15.57:0/3888908294 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x17bbd80 con 0x165fae0 2023-10-06T03:01:14.143 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.135+0000 7f094f7fe700 1 --2- 172.21.15.57:0/3888908294 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x165fae0 0x18ebfd0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f09440091e0 tx=0x7f094402e000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=55f2181dba53b16e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:14.143 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.135+0000 7f0935ffb700 1 -- 172.21.15.57:0/3888908294 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09440524e0 con 0x165fae0 2023-10-06T03:01:14.143 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.135+0000 7f0935ffb700 1 -- 172.21.15.57:0/3888908294 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f094407b070 con 0x165fae0 2023-10-06T03:01:14.143 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.135+0000 7f0935ffb700 1 -- 172.21.15.57:0/3888908294 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09440092a0 con 0x165fae0 2023-10-06T03:01:14.143 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.139+0000 7f095881e740 1 -- 172.21.15.57:0/3888908294 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x165fae0 msgr2=0x18ebfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:14.143 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.139+0000 7f095881e740 1 --2- 172.21.15.57:0/3888908294 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x165fae0 0x18ebfd0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f09440091e0 tx=0x7f094402e000 comp rx=0 tx=0).stop 2023-10-06T03:01:14.144 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.139+0000 7f095881e740 1 -- 172.21.15.57:0/3888908294 shutdown_connections 2023-10-06T03:01:14.144 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.139+0000 7f095881e740 1 --2- 172.21.15.57:0/3888908294 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x16aa790 0x18ec510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:14.144 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.139+0000 7f095881e740 1 --2- 172.21.15.57:0/3888908294 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x165fae0 0x18ebfd0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:14.144 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.139+0000 7f095881e740 1 --2- 172.21.15.57:0/3888908294 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x165f710 0x18eba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:14.144 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.139+0000 7f095881e740 1 -- 172.21.15.57:0/3888908294 >> 172.21.15.57:0/3888908294 conn(0x165feb0 msgr2=0x1892760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:14.144 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.139+0000 7f095881e740 1 -- 172.21.15.57:0/3888908294 shutdown_connections 2023-10-06T03:01:14.144 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.139+0000 7f095881e740 1 -- 172.21.15.57:0/3888908294 wait complete. 2023-10-06T03:01:14.144 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.139+0000 7f095881e740 1 -- start start 2023-10-06T03:01:14.145 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.139+0000 7f095881e740 1 Processor -- start 2023-10-06T03:01:14.145 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.139+0000 7f095881e740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x165f710 0x18bdd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:14.146 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.139+0000 7f095881e740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x165fae0 0x18be280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:14.146 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.139+0000 7f095881e740 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x16aa790 0x18be7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:14.146 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.139+0000 7f095881e740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x17dc010 con 0x165fae0 2023-10-06T03:01:14.146 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.139+0000 7f095881e740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x17daf40 con 0x165f710 2023-10-06T03:01:14.146 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.139+0000 7f095881e740 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x17a7b80 con 0x16aa790 2023-10-06T03:01:14.146 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.139+0000 7f095881e740 10 client.0 _ll_register_callbacks cb 0x17230e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:01:14.147 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.139+0000 7f094f7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x165fae0 0x18be280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:14.147 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.139+0000 7f094f7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x165fae0 0x18be280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56194/0 (socket says 172.21.15.57:56194) 2023-10-06T03:01:14.148 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.139+0000 7f094f7fe700 1 -- 172.21.15.57:0/3022675870 learned_addr learned my addr 172.21.15.57:0/3022675870 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:14.148 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.139+0000 7f0954ae2700 1 --2- 172.21.15.57:0/3022675870 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x16aa790 0x18be7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:14.148 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.143+0000 7f094ffff700 1 --2- 172.21.15.57:0/3022675870 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x165f710 0x18bdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:14.148 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.143+0000 7f094f7fe700 1 -- 172.21.15.57:0/3022675870 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x16aa790 msgr2=0x18be7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:14.148 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.143+0000 7f094f7fe700 1 --2- 172.21.15.57:0/3022675870 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x16aa790 0x18be7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:14.148 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.143+0000 7f094f7fe700 1 -- 172.21.15.57:0/3022675870 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x165f710 msgr2=0x18bdd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:14.148 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.143+0000 7f094f7fe700 1 --2- 172.21.15.57:0/3022675870 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x165f710 0x18bdd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:14.148 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.143+0000 7f094f7fe700 1 -- 172.21.15.57:0/3022675870 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x17d5370 con 0x165fae0 2023-10-06T03:01:14.148 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.143+0000 7f0954ae2700 1 --2- 172.21.15.57:0/3022675870 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x16aa790 0x18be7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:14.148 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.143+0000 7f094ffff700 1 --2- 172.21.15.57:0/3022675870 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x165f710 0x18bdd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:01:14.148 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.143+0000 7f094f7fe700 1 --2- 172.21.15.57:0/3022675870 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x165fae0 0x18be280 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f094406c0d0 tx=0x7f094407d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=180581c9c3023caf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:14.149 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.143+0000 7f092e7fc700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-10-06T03:01:14.149 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.143+0000 7f092e7fc700 1 -- 172.21.15.57:0/3022675870 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09440092a0 con 0x165fae0 2023-10-06T03:01:14.149 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.143+0000 7f095881e740 1 -- 172.21.15.57:0/3022675870 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0948011c40 con 0x165fae0 2023-10-06T03:01:14.149 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.143+0000 7f092e7fc700 1 -- 172.21.15.57:0/3022675870 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0944067170 con 0x165fae0 2023-10-06T03:01:14.150 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.143+0000 7f092e7fc700 1 -- 172.21.15.57:0/3022675870 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f09440524e0 con 0x165fae0 2023-10-06T03:01:14.150 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.143+0000 7f095881e740 10 client.4692 fetch_fsmap learned FSMap version 8 2023-10-06T03:01:14.150 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.143+0000 7f095881e740 1 -- 172.21.15.57:0/3022675870 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x17b0130 con 0x165fae0 2023-10-06T03:01:14.150 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.143+0000 7f092e7fc700 1 -- 172.21.15.57:0/3022675870 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0948011c40 con 0x165fae0 2023-10-06T03:01:14.150 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.143+0000 7f092e7fc700 1 -- 172.21.15.57:0/3022675870 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 8) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f0944051230 con 0x165fae0 2023-10-06T03:01:14.150 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.143+0000 7f095881e740 10 client.4692 fetch_fsmap finished waiting for FSMap version 8 2023-10-06T03:01:14.150 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.143+0000 7f095881e740 10 client.4692 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-06T03:01:14.150 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.143+0000 7f095881e740 20 client.4692 populate_metadata read hostname 'smithi057' 2023-10-06T03:01:14.151 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.143+0000 7f095881e740 1 --2- 172.21.15.57:0/3022675870 >> [v2:172.21.15.105:6833/1286071598,v1:172.21.15.105:6835/1286071598] conn(0x18bf150 0x1946930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:14.151 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.143+0000 7f095881e740 4 client.4692 mds_command: new command op to 4303 tid=0[{"prefix": "status"}] 2023-10-06T03:01:14.151 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.143+0000 7f095881e740 1 -- 172.21.15.57:0/3022675870 --> [v2:172.21.15.105:6833/1286071598,v1:172.21.15.105:6835/1286071598] -- command(tid 0: {"prefix": "status"}) v1 -- 0x17db410 con 0x18bf150 2023-10-06T03:01:14.151 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.143+0000 7f094ffff700 1 --2- 172.21.15.57:0/3022675870 >> [v2:172.21.15.105:6833/1286071598,v1:172.21.15.105:6835/1286071598] conn(0x18bf150 0x1946930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:14.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.147+0000 7f092e7fc700 10 client.4692 ms_handle_connect on v2:172.21.15.105:6833/1286071598 2023-10-06T03:01:14.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.147+0000 7f094ffff700 1 --2- 172.21.15.57:0/3022675870 >> [v2:172.21.15.105:6833/1286071598,v1:172.21.15.105:6835/1286071598] conn(0x18bf150 0x1946930 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b3aafa67ed925f8c server_cookie=2158676ae07a09c9 in_seq=0 out_seq=0 2023-10-06T03:01:14.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.147+0000 7f092e7fc700 1 -- 172.21.15.57:0/3022675870 <== mds.0 v2:172.21.15.105:6833/1286071598 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x17db410 con 0x18bf150 2023-10-06T03:01:14.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.147+0000 7f092e7fc700 10 client.4692 handle_command_reply: tid=0 2023-10-06T03:01:14.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.147+0000 7f095881e740 1 client.4692 shutdown 2023-10-06T03:01:14.153 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.147+0000 7f095881e740 1 -- 172.21.15.57:0/3022675870 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x165fae0 msgr2=0x18be280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:14.153 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.147+0000 7f095881e740 1 --2- 172.21.15.57:0/3022675870 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x165fae0 0x18be280 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f094406c0d0 tx=0x7f094407d000 comp rx=0 tx=0).stop 2023-10-06T03:01:14.153 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.147+0000 7f095881e740 1 -- 172.21.15.57:0/3022675870 shutdown_connections 2023-10-06T03:01:14.153 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.147+0000 7f095881e740 1 --2- 172.21.15.57:0/3022675870 >> [v2:172.21.15.105:6833/1286071598,v1:172.21.15.105:6835/1286071598] conn(0x18bf150 0x1946930 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:14.153 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.147+0000 7f095881e740 1 --2- 172.21.15.57:0/3022675870 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x16aa790 0x18be7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:14.153 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.147+0000 7f095881e740 1 --2- 172.21.15.57:0/3022675870 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x165fae0 0x18be280 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:14.153 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.147+0000 7f095881e740 1 --2- 172.21.15.57:0/3022675870 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x165f710 0x18bdd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:14.153 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.147+0000 7f092e7fc700 0 client.4692 ms_handle_reset on v2:172.21.15.105:6833/1286071598 2023-10-06T03:01:14.153 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.147+0000 7f095881e740 1 -- 172.21.15.57:0/3022675870 >> 172.21.15.57:0/3022675870 conn(0x165feb0 msgr2=0x1892e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:14.153 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.147+0000 7f095881e740 1 -- 172.21.15.57:0/3022675870 shutdown_connections 2023-10-06T03:01:14.153 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.147+0000 7f095881e740 1 -- 172.21.15.57:0/3022675870 wait complete. 2023-10-06T03:01:14.153 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.147+0000 7f095881e740 20 client.4692 trim_cache size 0 max 16384 2023-10-06T03:01:14.154 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-10-06T03:01:14.154 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_fsid": "eb56dc0f-9213-41cb-9aad-8ade6c802e98", 2023-10-06T03:01:14.154 INFO:teuthology.orchestra.run.smithi057.stdout: "whoami": 0, 2023-10-06T03:01:14.154 INFO:teuthology.orchestra.run.smithi057.stdout: "id": 4303, 2023-10-06T03:01:14.154 INFO:teuthology.orchestra.run.smithi057.stdout: "want_state": "up:active", 2023-10-06T03:01:14.154 INFO:teuthology.orchestra.run.smithi057.stdout: "state": "up:active", 2023-10-06T03:01:14.154 INFO:teuthology.orchestra.run.smithi057.stdout: "fs_name": "cephfs", 2023-10-06T03:01:14.154 INFO:teuthology.orchestra.run.smithi057.stdout: "rank_uptime": 16.163580613000001, 2023-10-06T03:01:14.155 INFO:teuthology.orchestra.run.smithi057.stdout: "mdsmap_epoch": 8, 2023-10-06T03:01:14.155 INFO:teuthology.orchestra.run.smithi057.stdout: "osdmap_epoch": 23, 2023-10-06T03:01:14.155 INFO:teuthology.orchestra.run.smithi057.stdout: "osdmap_epoch_barrier": 23, 2023-10-06T03:01:14.155 INFO:teuthology.orchestra.run.smithi057.stdout: "uptime": 22.103160456000001 2023-10-06T03:01:14.155 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-10-06T03:01:14.156 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.147+0000 7f0956545700 1 -- 172.21.15.57:0/1820804900 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f093c060580 msgr2=0x7f093c062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:14.156 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.147+0000 7f0956545700 1 --2- 172.21.15.57:0/1820804900 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f093c060580 0x7f093c062a30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0940007240 tx=0x7f0940001970 comp rx=0 tx=0).stop 2023-10-06T03:01:14.156 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.147+0000 7f0956545700 1 -- 172.21.15.57:0/1820804900 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09500cc820 msgr2=0x7f09500b0190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:14.156 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.147+0000 7f0956545700 1 --2- 172.21.15.57:0/1820804900 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09500cc820 0x7f09500b0190 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f095006b4b0 tx=0x7f0944017000 comp rx=0 tx=0).stop 2023-10-06T03:01:14.156 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.147+0000 7f0956545700 1 -- 172.21.15.57:0/1820804900 shutdown_connections 2023-10-06T03:01:14.156 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.147+0000 7f0956545700 1 --2- 172.21.15.57:0/1820804900 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f09501538d0 0x7f09500b06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:14.156 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.147+0000 7f0956545700 1 --2- 172.21.15.57:0/1820804900 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09500cc820 0x7f09500b0190 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:14.156 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.147+0000 7f0956545700 1 --2- 172.21.15.57:0/1820804900 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f093c060580 0x7f093c062a30 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:14.156 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.147+0000 7f0956545700 1 --2- 172.21.15.57:0/1820804900 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f09500cb6e0 0x7f09500c4b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:14.156 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.147+0000 7f0956545700 1 -- 172.21.15.57:0/1820804900 >> 172.21.15.57:0/1820804900 conn(0x7f09500c9840 msgr2=0x7f095006e250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:14.156 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.147+0000 7f0956545700 1 -- 172.21.15.57:0/1820804900 shutdown_connections 2023-10-06T03:01:14.157 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.147+0000 7f0956545700 1 -- 172.21.15.57:0/1820804900 wait complete. 2023-10-06T03:01:14.176 INFO:teuthology.run_tasks:Running task kclient... 2023-10-06T03:01:14.199 INFO:tasks.kclient:Mounting kernel clients... 2023-10-06T03:01:14.199 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-10-06T03:01:14.200 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:01:14.200 DEBUG:teuthology.orchestra.run.smithi057:> ip netns list 2023-10-06T03:01:14.221 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:01:14.222 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip link delete ceph-brx 2023-10-06T03:01:14.307 INFO:teuthology.orchestra.run.smithi057.stderr:Cannot find device "ceph-brx" 2023-10-06T03:01:14.311 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T03:01:14.311 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:01:14.311 DEBUG:teuthology.orchestra.run.smithi057:> ip netns list 2023-10-06T03:01:14.374 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:01:14.374 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip link delete ceph-brx 2023-10-06T03:01:14.462 INFO:teuthology.orchestra.run.smithi057.stderr:Cannot find device "ceph-brx" 2023-10-06T03:01:14.465 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T03:01:14.466 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:01:14.466 DEBUG:teuthology.orchestra.run.smithi105:> ip netns list 2023-10-06T03:01:14.487 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:01:14.488 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip link delete ceph-brx 2023-10-06T03:01:14.576 INFO:teuthology.orchestra.run.smithi105.stderr:Cannot find device "ceph-brx" 2023-10-06T03:01:14.580 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T03:01:14.580 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:01:14.580 DEBUG:teuthology.orchestra.run.smithi105:> ip netns list 2023-10-06T03:01:14.642 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:01:14.642 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip link delete ceph-brx 2023-10-06T03:01:14.731 INFO:teuthology.orchestra.run.smithi105.stderr:Cannot find device "ceph-brx" 2023-10-06T03:01:14.734 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T03:01:14.735 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2023-10-06T03:01:14.735 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T03:01:14.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.903+0000 7f1fb0ef0700 1 Processor -- start 2023-10-06T03:01:14.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.903+0000 7f1fb0ef0700 1 -- start start 2023-10-06T03:01:14.909 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.903+0000 7f1fb0ef0700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1fac0671f0 0x7f1fac06dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:14.909 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.903+0000 7f1fb0ef0700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fac06da50 con 0x7f1fac0675c0 2023-10-06T03:01:14.909 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.903+0000 7f1fb0ef0700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fac06d190 con 0x7f1fac15d5d0 2023-10-06T03:01:14.909 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.903+0000 7f1fb0ef0700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fac067a40 con 0x7f1fac0671f0 2023-10-06T03:01:14.909 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.903+0000 7f1faa59c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1fac0671f0 0x7f1fac06dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:14.910 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.903+0000 7f1faa59c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1fac0671f0 0x7f1fac06dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55410/0 (socket says 172.21.15.57:55410) 2023-10-06T03:01:14.910 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.903+0000 7f1faa59c700 1 -- 172.21.15.57:0/1822454818 learned_addr learned my addr 172.21.15.57:0/1822454818 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:14.910 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.903+0000 7f1fa9d9b700 1 --1- 172.21.15.57:0/1822454818 >> v1:172.21.15.57:6789/0 conn(0x7f1fac0675c0 0x7f1fac15cec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:33298/0 (socket says 172.21.15.57:33298) 2023-10-06T03:01:14.911 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.903+0000 7f1fa959a700 1 -- 172.21.15.57:0/1822454818 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 485608007 0 0) 0x7f1fac06d190 con 0x7f1fac15d5d0 2023-10-06T03:01:14.911 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.903+0000 7f1fa959a700 1 -- 172.21.15.57:0/1822454818 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f94003570 con 0x7f1fac15d5d0 2023-10-06T03:01:14.911 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.907+0000 7f1faa59c700 1 -- 172.21.15.57:0/1822454818 >> v1:172.21.15.105:6789/0 conn(0x7f1fac15d5d0 legacy=0x7f1fac158c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:14.911 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.907+0000 7f1faa59c700 1 -- 172.21.15.57:0/1822454818 >> v1:172.21.15.57:6789/0 conn(0x7f1fac0675c0 legacy=0x7f1fac15cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:14.911 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.907+0000 7f1fa959a700 1 -- 172.21.15.57:0/1822454818 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1545942022 0 0) 0x7f1fac06da50 con 0x7f1fac0675c0 2023-10-06T03:01:14.911 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.907+0000 7f1faa59c700 1 -- 172.21.15.57:0/1822454818 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fac06d400 con 0x7f1fac0671f0 2023-10-06T03:01:14.912 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.907+0000 7f1faa59c700 1 --2- 172.21.15.57:0/1822454818 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1fac0671f0 0x7f1fac06dee0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1f9c0099b0 tx=0x7f1f9c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb7cee2c20017277 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:14.912 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.907+0000 7f1fa959a700 1 -- 172.21.15.57:0/1822454818 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f9c009ea0 con 0x7f1fac0671f0 2023-10-06T03:01:14.912 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.907+0000 7f1fa959a700 1 -- 172.21.15.57:0/1822454818 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f9c00b860 con 0x7f1fac0671f0 2023-10-06T03:01:14.912 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.907+0000 7f1fa959a700 1 -- 172.21.15.57:0/1822454818 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f9c00bc00 con 0x7f1fac0671f0 2023-10-06T03:01:14.913 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.907+0000 7f1fb0ef0700 1 -- 172.21.15.57:0/1822454818 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1fac0671f0 msgr2=0x7f1fac06dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:14.913 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.907+0000 7f1fb0ef0700 1 --2- 172.21.15.57:0/1822454818 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1fac0671f0 0x7f1fac06dee0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1f9c0099b0 tx=0x7f1f9c009250 comp rx=0 tx=0).stop 2023-10-06T03:01:14.913 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.907+0000 7f1fb0ef0700 1 -- 172.21.15.57:0/1822454818 shutdown_connections 2023-10-06T03:01:14.914 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.907+0000 7f1fb0ef0700 1 --2- 172.21.15.57:0/1822454818 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1fac0671f0 0x7f1fac06dee0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:14.914 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.907+0000 7f1fb0ef0700 1 -- 172.21.15.57:0/1822454818 >> 172.21.15.57:0/1822454818 conn(0x7f1fac0d01e0 msgr2=0x7f1fac0d05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:14.914 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.907+0000 7f1fb0ef0700 1 -- 172.21.15.57:0/1822454818 shutdown_connections 2023-10-06T03:01:14.914 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.907+0000 7f1fb0ef0700 1 -- 172.21.15.57:0/1822454818 wait complete. 2023-10-06T03:01:14.916 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.911+0000 7f1fb0ef0700 1 Processor -- start 2023-10-06T03:01:14.916 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.911+0000 7f1fb0ef0700 1 -- start start 2023-10-06T03:01:14.917 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.911+0000 7f1fb0ef0700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1fac0671f0 0x7f1fac16a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:14.918 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.911+0000 7f1fb0ef0700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1fac0675c0 0x7f1fac15aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:14.918 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.911+0000 7f1fb0ef0700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1fac15d5d0 0x7f1fac159c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:14.918 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.911+0000 7f1fb0ef0700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fac0c5f90 con 0x7f1fac15d5d0 2023-10-06T03:01:14.918 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.911+0000 7f1fb0ef0700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fac0c5380 con 0x7f1fac0671f0 2023-10-06T03:01:14.918 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.911+0000 7f1fb0ef0700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fac0c5660 con 0x7f1fac0675c0 2023-10-06T03:01:14.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.911+0000 7f1faad9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1fac15d5d0 0x7f1fac159c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:14.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.911+0000 7f1faad9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1fac15d5d0 0x7f1fac159c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55420/0 (socket says 172.21.15.57:55420) 2023-10-06T03:01:14.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.911+0000 7f1faad9d700 1 -- 172.21.15.57:0/3913631184 learned_addr learned my addr 172.21.15.57:0/3913631184 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:14.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.911+0000 7f1faa59c700 1 --2- 172.21.15.57:0/3913631184 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1fac0671f0 0x7f1fac16a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:14.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.911+0000 7f1fa9d9b700 1 --2- 172.21.15.57:0/3913631184 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1fac0675c0 0x7f1fac15aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:14.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.915+0000 7f1faad9d700 1 -- 172.21.15.57:0/3913631184 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1fac0675c0 msgr2=0x7f1fac15aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:14.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.915+0000 7f1faad9d700 1 --2- 172.21.15.57:0/3913631184 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1fac0675c0 0x7f1fac15aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:14.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.915+0000 7f1faad9d700 1 -- 172.21.15.57:0/3913631184 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1fac0671f0 msgr2=0x7f1fac16a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:14.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.915+0000 7f1faad9d700 1 --2- 172.21.15.57:0/3913631184 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1fac0671f0 0x7f1fac16a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:14.921 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.915+0000 7f1faad9d700 1 -- 172.21.15.57:0/3913631184 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f9c0094f0 con 0x7f1fac15d5d0 2023-10-06T03:01:14.921 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.915+0000 7f1fa9d9b700 1 --2- 172.21.15.57:0/3913631184 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1fac0675c0 0x7f1fac15aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:14.921 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.915+0000 7f1faad9d700 1 --2- 172.21.15.57:0/3913631184 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1fac15d5d0 0x7f1fac159c40 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1fa400c910 tx=0x7f1fa40027a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:14.921 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.915+0000 7f1f9a7fc700 1 -- 172.21.15.57:0/3913631184 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa4012630 con 0x7f1fac15d5d0 2023-10-06T03:01:14.921 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.915+0000 7f1f9a7fc700 1 -- 172.21.15.57:0/3913631184 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fa40127b0 con 0x7f1fac15d5d0 2023-10-06T03:01:14.921 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.915+0000 7f1fb0ef0700 1 -- 172.21.15.57:0/3913631184 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fac0c5940 con 0x7f1fac15d5d0 2023-10-06T03:01:14.921 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.915+0000 7f1f9a7fc700 1 -- 172.21.15.57:0/3913631184 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa4012b70 con 0x7f1fac15d5d0 2023-10-06T03:01:14.921 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.915+0000 7f1fb0ef0700 1 -- 172.21.15.57:0/3913631184 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fac0c4fa0 con 0x7f1fac15d5d0 2023-10-06T03:01:14.921 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.915+0000 7f1fb0ef0700 1 -- 172.21.15.57:0/3913631184 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fac0c6140 con 0x7f1fac15d5d0 2023-10-06T03:01:14.924 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.919+0000 7f1f9a7fc700 1 -- 172.21.15.57:0/3913631184 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f1fa401b400 con 0x7f1fac15d5d0 2023-10-06T03:01:14.925 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.919+0000 7f1f9a7fc700 1 --2- 172.21.15.57:0/3913631184 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f1f8c060550 0x7f1f8c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:14.925 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.919+0000 7f1f9a7fc700 1 -- 172.21.15.57:0/3913631184 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1fa407cd40 con 0x7f1fac15d5d0 2023-10-06T03:01:14.925 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.919+0000 7f1faa59c700 1 --2- 172.21.15.57:0/3913631184 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f1f8c060550 0x7f1f8c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:14.926 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.923+0000 7f1faa59c700 1 --2- 172.21.15.57:0/3913631184 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f1f8c060550 0x7f1f8c062a00 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f1f9c0099b0 tx=0x7f1f9c017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:14.930 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:14.923+0000 7f1f9a7fc700 1 -- 172.21.15.57:0/3913631184 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f1fa404d130 con 0x7f1fac15d5d0 2023-10-06T03:01:15.136 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:15.131+0000 7f1fb0ef0700 1 -- 172.21.15.57:0/3913631184 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1fac0712e0 con 0x7f1fac15d5d0 2023-10-06T03:01:15.137 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:15.131+0000 7f1f9a7fc700 1 -- 172.21.15.57:0/3913631184 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f1fa4016070 con 0x7f1fac15d5d0 2023-10-06T03:01:15.137 INFO:teuthology.orchestra.run.smithi057.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T03:01:15.139 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:15.135+0000 7f1fb0ef0700 1 -- 172.21.15.57:0/3913631184 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f1f8c060550 msgr2=0x7f1f8c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:15.140 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:15.135+0000 7f1fb0ef0700 1 --2- 172.21.15.57:0/3913631184 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f1f8c060550 0x7f1f8c062a00 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f1f9c0099b0 tx=0x7f1f9c017000 comp rx=0 tx=0).stop 2023-10-06T03:01:15.140 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:15.135+0000 7f1fb0ef0700 1 -- 172.21.15.57:0/3913631184 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1fac15d5d0 msgr2=0x7f1fac159c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:15.140 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:15.135+0000 7f1fb0ef0700 1 --2- 172.21.15.57:0/3913631184 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1fac15d5d0 0x7f1fac159c40 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1fa400c910 tx=0x7f1fa40027a0 comp rx=0 tx=0).stop 2023-10-06T03:01:15.140 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:15.135+0000 7f1fb0ef0700 1 -- 172.21.15.57:0/3913631184 shutdown_connections 2023-10-06T03:01:15.140 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:15.135+0000 7f1fb0ef0700 1 --2- 172.21.15.57:0/3913631184 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1fac15d5d0 0x7f1fac159c40 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:15.140 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:15.135+0000 7f1fb0ef0700 1 --2- 172.21.15.57:0/3913631184 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f1f8c060550 0x7f1f8c062a00 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:15.140 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:15.135+0000 7f1fb0ef0700 1 --2- 172.21.15.57:0/3913631184 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1fac0675c0 0x7f1fac15aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:15.140 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:15.135+0000 7f1fb0ef0700 1 --2- 172.21.15.57:0/3913631184 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1fac0671f0 0x7f1fac16a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:15.140 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:15.135+0000 7f1fb0ef0700 1 -- 172.21.15.57:0/3913631184 >> 172.21.15.57:0/3913631184 conn(0x7f1fac0d01e0 msgr2=0x7f1fac0ccbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:15.141 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:15.135+0000 7f1fb0ef0700 1 -- 172.21.15.57:0/3913631184 shutdown_connections 2023-10-06T03:01:15.141 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:15.135+0000 7f1fb0ef0700 1 -- 172.21.15.57:0/3913631184 wait complete. 2023-10-06T03:01:15.161 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T03:01:15.161 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T03:01:15.161 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi057.front.sepia.ceph.com 2023-10-06T03:01:15.161 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T03:01:15.161 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T03:01:15.161 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T03:01:15.161 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T03:01:15.162 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T03:01:15.162 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T03:01:15.162 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:01:15.162 DEBUG:teuthology.orchestra.run.smithi057:> ip addr 2023-10-06T03:01:15.180 INFO:teuthology.orchestra.run.smithi057.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T03:01:15.180 INFO:teuthology.orchestra.run.smithi057.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T03:01:15.181 INFO:teuthology.orchestra.run.smithi057.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T03:01:15.181 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:01:15.181 INFO:teuthology.orchestra.run.smithi057.stdout: inet6 ::1/128 scope host 2023-10-06T03:01:15.181 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:01:15.181 INFO:teuthology.orchestra.run.smithi057.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-06T03:01:15.181 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether 0c:c4:7a:6b:ff:86 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:01:15.181 INFO:teuthology.orchestra.run.smithi057.stdout: altname enp7s0f0 2023-10-06T03:01:15.181 INFO:teuthology.orchestra.run.smithi057.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-06T03:01:15.181 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether 0c:c4:7a:6b:ff:87 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:01:15.181 INFO:teuthology.orchestra.run.smithi057.stdout: altname enp7s0f1 2023-10-06T03:01:15.182 INFO:teuthology.orchestra.run.smithi057.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T03:01:15.182 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether 0c:c4:7a:bd:15:62 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:01:15.182 INFO:teuthology.orchestra.run.smithi057.stdout: altname enp1s0f0 2023-10-06T03:01:15.182 INFO:teuthology.orchestra.run.smithi057.stdout: inet 172.21.15.57/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-10-06T03:01:15.182 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft 42409sec preferred_lft 42409sec 2023-10-06T03:01:15.182 INFO:teuthology.orchestra.run.smithi057.stdout: inet6 fe80::ec4:7aff:febd:1562/64 scope link 2023-10-06T03:01:15.182 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:01:15.182 INFO:teuthology.orchestra.run.smithi057.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-06T03:01:15.182 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether 0c:c4:7a:bd:15:63 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:01:15.182 INFO:teuthology.orchestra.run.smithi057.stdout: altname enp1s0f1 2023-10-06T03:01:15.182 INFO:teuthology.orchestra.run.smithi057.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-06T03:01:15.183 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether 02:42:3c:a1:4c:1b brd ff:ff:ff:ff:ff:ff 2023-10-06T03:01:15.183 INFO:teuthology.orchestra.run.smithi057.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-06T03:01:15.183 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:01:15.184 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-06T03:01:15.184 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:01:15.184 DEBUG:teuthology.orchestra.run.smithi057:> (cd / && exec bash -c ' 2023-10-06T03:01:15.184 DEBUG:teuthology.orchestra.run.smithi057:> set -e 2023-10-06T03:01:15.184 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip link add name ceph-brx type bridge 2023-10-06T03:01:15.184 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip addr flush dev ceph-brx 2023-10-06T03:01:15.184 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip link set ceph-brx up 2023-10-06T03:01:15.185 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-06T03:01:15.185 DEBUG:teuthology.orchestra.run.smithi057:> ') 2023-10-06T03:01:15.339 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:01:15.407 DEBUG:teuthology.orchestra.run.smithi057:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T03:01:15.446 INFO:teuthology.orchestra.run.smithi057.stdout:1 2023-10-06T03:01:15.449 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:01:15.449 DEBUG:teuthology.orchestra.run.smithi057:> route 2023-10-06T03:01:15.530 INFO:teuthology.orchestra.run.smithi057.stdout:Kernel IP routing table 2023-10-06T03:01:15.530 INFO:teuthology.orchestra.run.smithi057.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T03:01:15.531 INFO:teuthology.orchestra.run.smithi057.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-10-06T03:01:15.531 INFO:teuthology.orchestra.run.smithi057.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-06T03:01:15.531 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-10-06T03:01:15.531 INFO:teuthology.orchestra.run.smithi057.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T03:01:15.531 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:01:15.531 DEBUG:teuthology.orchestra.run.smithi057:> (cd / && exec bash -c ' 2023-10-06T03:01:15.531 DEBUG:teuthology.orchestra.run.smithi057:> set -e 2023-10-06T03:01:15.532 DEBUG:teuthology.orchestra.run.smithi057:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-06T03:01:15.532 DEBUG:teuthology.orchestra.run.smithi057:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-06T03:01:15.532 DEBUG:teuthology.orchestra.run.smithi057:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-06T03:01:15.532 DEBUG:teuthology.orchestra.run.smithi057:> ') 2023-10-06T03:01:15.665 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:01:15.665 DEBUG:teuthology.orchestra.run.smithi057:> ip netns list 2023-10-06T03:01:15.686 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:01:15.686 DEBUG:teuthology.orchestra.run.smithi057:> ip netns list-id 2023-10-06T03:01:15.748 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:01:15.748 DEBUG:teuthology.orchestra.run.smithi057:> (cd / && exec bash -c ' 2023-10-06T03:01:15.749 DEBUG:teuthology.orchestra.run.smithi057:> set -e 2023-10-06T03:01:15.749 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T03:01:15.749 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-10-06T03:01:15.749 DEBUG:teuthology.orchestra.run.smithi057:> ') 2023-10-06T03:01:15.872 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-10-06T03:01:15.872 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:01:15.872 DEBUG:teuthology.orchestra.run.smithi057:> (cd / && exec bash -c ' 2023-10-06T03:01:15.873 DEBUG:teuthology.orchestra.run.smithi057:> set -e 2023-10-06T03:01:15.873 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-10-06T03:01:15.873 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-06T03:01:15.873 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-10-06T03:01:15.873 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-10-06T03:01:15.873 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-10-06T03:01:15.873 DEBUG:teuthology.orchestra.run.smithi057:> ') 2023-10-06T03:01:16.049 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:01:16.049 DEBUG:teuthology.orchestra.run.smithi057:> (cd / && exec bash -c ' 2023-10-06T03:01:16.049 DEBUG:teuthology.orchestra.run.smithi057:> set -e 2023-10-06T03:01:16.050 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip link set brx.0 up 2023-10-06T03:01:16.050 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip link set dev brx.0 master ceph-brx 2023-10-06T03:01:16.050 DEBUG:teuthology.orchestra.run.smithi057:> ') 2023-10-06T03:01:16.124 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:01:16.124 DEBUG:teuthology.orchestra.run.smithi057:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T03:01:16.144 INFO:teuthology.orchestra.run.smithi057.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T03:01:16.144 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:01:16.145 DEBUG:teuthology.orchestra.run.smithi057:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T03:01:16.203 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-06T03:01:16.203 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T03:01:16.203 DEBUG:teuthology.orchestra.run.smithi057:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-06T03:01:16.326 INFO:teuthology.orchestra.run.smithi057.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-06T03:01:16.326 INFO:teuthology.orchestra.run.smithi057.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-06T03:01:16.326 INFO:teuthology.orchestra.run.smithi057.stdout:invalid new device string format 2023-10-06T03:01:16.469 INFO:teuthology.orchestra.run.smithi057.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-06T03:01:16.470 INFO:teuthology.orchestra.run.smithi057.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-06T03:01:16.470 INFO:teuthology.orchestra.run.smithi057.stdout:invalid new device string format 2023-10-06T03:01:16.470 INFO:teuthology.orchestra.run.smithi057.stdout:mount.ceph: resolved to: "172.21.15.57:3300,172.21.15.105:3300,172.21.15.105:3301" 2023-10-06T03:01:16.470 INFO:teuthology.orchestra.run.smithi057.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T03:01:16.491 INFO:teuthology.orchestra.run.smithi057.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-06T03:01:16.491 INFO:teuthology.orchestra.run.smithi057.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-06T03:01:16.491 INFO:teuthology.orchestra.run.smithi057.stdout:invalid new device string format 2023-10-06T03:01:16.491 INFO:teuthology.orchestra.run.smithi057.stdout:mount.ceph: resolved to: "172.21.15.57:3300,172.21.15.105:3300,172.21.15.105:3301" 2023-10-06T03:01:16.491 INFO:teuthology.orchestra.run.smithi057.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T03:01:16.491 INFO:teuthology.orchestra.run.smithi057.stdout:mount.ceph: resolved to: "172.21.15.57:6789,172.21.15.105:6789,172.21.15.105:6790" 2023-10-06T03:01:16.492 INFO:teuthology.orchestra.run.smithi057.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.57:6789,172.21.15.105:6789,172.21.15.105:6790:/ 2023-10-06T03:01:16.492 INFO:teuthology.orchestra.run.smithi057.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=eb56dc0f-9213-41cb-9aad-8ade6c802e98" will pass to kernel 2023-10-06T03:01:16.496 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T03:01:16.496 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:01:16.496 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T03:01:16.531 INFO:tasks.kclient:client.2 config is {'syntax': 'v1'} 2023-10-06T03:01:16.531 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T03:01:16.739 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:16.735+0000 7f1faed45700 1 Processor -- start 2023-10-06T03:01:16.739 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:16.735+0000 7f1faed45700 1 -- start start 2023-10-06T03:01:16.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:16.735+0000 7f1faed45700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1fa80675c0 0x7f1fa814fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:16.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:16.735+0000 7f1faed45700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1fa8150180 0x7f1fa815ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:16.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:16.735+0000 7f1faed45700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fa806d7e0 con 0x7f1fa80671f0 2023-10-06T03:01:16.742 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:16.735+0000 7f1faed45700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fa80679d0 con 0x7f1fa8150180 2023-10-06T03:01:16.742 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:16.735+0000 7f1faed45700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa8150600 con 0x7f1fa80675c0 2023-10-06T03:01:16.742 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:16.735+0000 7f1facae1700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f1fa80671f0 0x7f1fa806dc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:33302/0 (socket says 172.21.15.57:33302) 2023-10-06T03:01:16.742 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:16.735+0000 7f1facae1700 1 -- 172.21.15.57:0/3226040796 learned_addr learned my addr 172.21.15.57:0/3226040796 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:01:16.742 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:16.735+0000 7f1fad2e2700 1 --2- 172.21.15.57:0/3226040796 >> v2:172.21.15.57:3300/0 conn(0x7f1fa8150180 0x7f1fa815ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:16.743 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:16.735+0000 7f1f9ffff700 1 --2- 172.21.15.57:0/3226040796 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1fa80675c0 0x7f1fa814fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:16.743 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:16.739+0000 7f1f9f7fe700 1 -- 172.21.15.57:0/3226040796 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1273581109 0 0) 0x7f1fa806d7e0 con 0x7f1fa80671f0 2023-10-06T03:01:16.743 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:16.739+0000 7f1f9f7fe700 1 -- 172.21.15.57:0/3226040796 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f90003570 con 0x7f1fa80671f0 2023-10-06T03:01:16.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:16.739+0000 7f1fad2e2700 1 -- 172.21.15.57:0/3226040796 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1fa80675c0 msgr2=0x7f1fa814fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:16.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:16.739+0000 7f1fad2e2700 1 --2- 172.21.15.57:0/3226040796 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1fa80675c0 0x7f1fa814fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:16.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:16.739+0000 7f1fad2e2700 1 -- 172.21.15.57:0/3226040796 >> v1:172.21.15.57:6789/0 conn(0x7f1fa80671f0 legacy=0x7f1fa806dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:16.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:16.739+0000 7f1fad2e2700 1 -- 172.21.15.57:0/3226040796 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fa815dc00 con 0x7f1fa8150180 2023-10-06T03:01:16.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:16.739+0000 7f1f9ffff700 1 --2- 172.21.15.57:0/3226040796 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1fa80675c0 0x7f1fa814fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:01:16.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:16.739+0000 7f1fad2e2700 1 --2- 172.21.15.57:0/3226040796 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1fa8150180 0x7f1fa815ce90 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1fa00098e0 tx=0x7f1fa00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=127db059a9931afd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:16.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:16.739+0000 7f1f9f7fe700 1 -- 172.21.15.57:0/3226040796 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa0011630 con 0x7f1fa8150180 2023-10-06T03:01:16.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:16.739+0000 7f1f9f7fe700 1 -- 172.21.15.57:0/3226040796 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fa0011790 con 0x7f1fa8150180 2023-10-06T03:01:16.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:16.739+0000 7f1f9f7fe700 1 -- 172.21.15.57:0/3226040796 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa0011b30 con 0x7f1fa8150180 2023-10-06T03:01:16.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:16.739+0000 7f1faed45700 1 -- 172.21.15.57:0/3226040796 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1fa8150180 msgr2=0x7f1fa815ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:16.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:16.739+0000 7f1faed45700 1 --2- 172.21.15.57:0/3226040796 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1fa8150180 0x7f1fa815ce90 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1fa00098e0 tx=0x7f1fa00091a0 comp rx=0 tx=0).stop 2023-10-06T03:01:16.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:16.739+0000 7f1faed45700 1 -- 172.21.15.57:0/3226040796 shutdown_connections 2023-10-06T03:01:16.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:16.739+0000 7f1faed45700 1 --2- 172.21.15.57:0/3226040796 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1fa80675c0 0x7f1fa814fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:16.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:16.739+0000 7f1faed45700 1 --2- 172.21.15.57:0/3226040796 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1fa8150180 0x7f1fa815ce90 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:16.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:16.739+0000 7f1faed45700 1 -- 172.21.15.57:0/3226040796 >> 172.21.15.57:0/3226040796 conn(0x7f1fa80cbdd0 msgr2=0x7f1fa80cc1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:16.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:16.739+0000 7f1faed45700 1 -- 172.21.15.57:0/3226040796 shutdown_connections 2023-10-06T03:01:16.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:16.739+0000 7f1faed45700 1 -- 172.21.15.57:0/3226040796 wait complete. 2023-10-06T03:01:16.748 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:16.743+0000 7f1faed45700 1 Processor -- start 2023-10-06T03:01:16.748 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:16.743+0000 7f1faed45700 1 -- start start 2023-10-06T03:01:16.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:16.743+0000 7f1faed45700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1fa80671f0 0x7f1fa81478b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:16.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:16.743+0000 7f1faed45700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1fa80675c0 0x7f1fa8147df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:16.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:16.743+0000 7f1faed45700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1fa8150180 0x7f1fa80c9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:16.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:16.743+0000 7f1faed45700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa80c97e0 con 0x7f1fa80675c0 2023-10-06T03:01:16.751 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:16.743+0000 7f1faed45700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa80c8bd0 con 0x7f1fa80671f0 2023-10-06T03:01:16.751 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:16.743+0000 7f1faed45700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa80c8eb0 con 0x7f1fa8150180 2023-10-06T03:01:16.752 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:16.747+0000 7f1f9ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1fa80675c0 0x7f1fa8147df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:16.752 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:16.747+0000 7f1f9ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1fa80675c0 0x7f1fa8147df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55438/0 (socket says 172.21.15.57:55438) 2023-10-06T03:01:16.752 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:16.747+0000 7f1f9ffff700 1 -- 172.21.15.57:0/1737497875 learned_addr learned my addr 172.21.15.57:0/1737497875 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:16.752 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:16.747+0000 7f1facae1700 1 --2- 172.21.15.57:0/1737497875 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1fa80671f0 0x7f1fa81478b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:16.752 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:16.747+0000 7f1fad2e2700 1 --2- 172.21.15.57:0/1737497875 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1fa8150180 0x7f1fa80c9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:16.752 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:16.747+0000 7f1f9ffff700 1 -- 172.21.15.57:0/1737497875 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1fa8150180 msgr2=0x7f1fa80c9ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:16.752 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:16.747+0000 7f1f9ffff700 1 --2- 172.21.15.57:0/1737497875 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1fa8150180 0x7f1fa80c9ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:16.752 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:16.747+0000 7f1f9ffff700 1 -- 172.21.15.57:0/1737497875 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1fa80671f0 msgr2=0x7f1fa81478b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:16.752 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:16.747+0000 7f1f9ffff700 1 --2- 172.21.15.57:0/1737497875 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1fa80671f0 0x7f1fa81478b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:16.752 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:16.747+0000 7f1f9ffff700 1 -- 172.21.15.57:0/1737497875 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f98009420 con 0x7f1fa80675c0 2023-10-06T03:01:16.753 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:16.747+0000 7f1f9ffff700 1 --2- 172.21.15.57:0/1737497875 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1fa80675c0 0x7f1fa8147df0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1f9800ec80 tx=0x7f1f980091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:16.753 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:16.747+0000 7f1f9cff9700 1 -- 172.21.15.57:0/1737497875 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f9800c920 con 0x7f1fa80675c0 2023-10-06T03:01:16.753 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:16.747+0000 7f1f9cff9700 1 -- 172.21.15.57:0/1737497875 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f9800ca80 con 0x7f1fa80675c0 2023-10-06T03:01:16.753 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:16.747+0000 7f1faed45700 1 -- 172.21.15.57:0/1737497875 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fa0009420 con 0x7f1fa80675c0 2023-10-06T03:01:16.753 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:16.747+0000 7f1f9cff9700 1 -- 172.21.15.57:0/1737497875 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f9800ce00 con 0x7f1fa80675c0 2023-10-06T03:01:16.754 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:16.747+0000 7f1faed45700 1 -- 172.21.15.57:0/1737497875 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fa80c9470 con 0x7f1fa80675c0 2023-10-06T03:01:16.754 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:16.751+0000 7f1faed45700 1 -- 172.21.15.57:0/1737497875 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fa80712e0 con 0x7f1fa80675c0 2023-10-06T03:01:16.757 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:16.751+0000 7f1f9cff9700 1 -- 172.21.15.57:0/1737497875 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f1f98013680 con 0x7f1fa80675c0 2023-10-06T03:01:16.758 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:16.755+0000 7f1f9cff9700 1 --2- 172.21.15.57:0/1737497875 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f1f94060550 0x7f1f94062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:16.759 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:16.755+0000 7f1f9cff9700 1 -- 172.21.15.57:0/1737497875 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1f9807d060 con 0x7f1fa80675c0 2023-10-06T03:01:16.759 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:16.755+0000 7f1facae1700 1 --2- 172.21.15.57:0/1737497875 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f1f94060550 0x7f1f94062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:16.760 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:16.755+0000 7f1facae1700 1 --2- 172.21.15.57:0/1737497875 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f1f94060550 0x7f1f94062a00 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1fa4005c50 tx=0x7f1fa4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:16.765 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:16.759+0000 7f1f9cff9700 1 -- 172.21.15.57:0/1737497875 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f1f980acbe0 con 0x7f1fa80675c0 2023-10-06T03:01:16.968 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:16.963+0000 7f1faed45700 1 -- 172.21.15.57:0/1737497875 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1fa806ceb0 con 0x7f1fa80675c0 2023-10-06T03:01:16.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:16.963+0000 7f1f9cff9700 1 -- 172.21.15.57:0/1737497875 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f1f98017070 con 0x7f1fa80675c0 2023-10-06T03:01:16.969 INFO:teuthology.orchestra.run.smithi057.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T03:01:16.972 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:16.967+0000 7f1faed45700 1 -- 172.21.15.57:0/1737497875 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f1f94060550 msgr2=0x7f1f94062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:16.972 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:16.967+0000 7f1faed45700 1 --2- 172.21.15.57:0/1737497875 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f1f94060550 0x7f1f94062a00 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1fa4005c50 tx=0x7f1fa4009040 comp rx=0 tx=0).stop 2023-10-06T03:01:16.972 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:16.967+0000 7f1faed45700 1 -- 172.21.15.57:0/1737497875 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1fa80675c0 msgr2=0x7f1fa8147df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:16.972 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:16.967+0000 7f1faed45700 1 --2- 172.21.15.57:0/1737497875 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1fa80675c0 0x7f1fa8147df0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1f9800ec80 tx=0x7f1f980091a0 comp rx=0 tx=0).stop 2023-10-06T03:01:16.973 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:16.967+0000 7f1faed45700 1 -- 172.21.15.57:0/1737497875 shutdown_connections 2023-10-06T03:01:16.973 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:16.967+0000 7f1faed45700 1 --2- 172.21.15.57:0/1737497875 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f1f94060550 0x7f1f94062a00 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:16.973 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:16.967+0000 7f1faed45700 1 --2- 172.21.15.57:0/1737497875 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1fa8150180 0x7f1fa80c9ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:16.973 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:16.967+0000 7f1faed45700 1 --2- 172.21.15.57:0/1737497875 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1fa80675c0 0x7f1fa8147df0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:16.973 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:16.967+0000 7f1faed45700 1 --2- 172.21.15.57:0/1737497875 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1fa80671f0 0x7f1fa81478b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:16.973 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:16.967+0000 7f1faed45700 1 -- 172.21.15.57:0/1737497875 >> 172.21.15.57:0/1737497875 conn(0x7f1fa80cbdd0 msgr2=0x7f1fa814ecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:16.973 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:16.967+0000 7f1faed45700 1 -- 172.21.15.57:0/1737497875 shutdown_connections 2023-10-06T03:01:16.973 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:16.967+0000 7f1faed45700 1 -- 172.21.15.57:0/1737497875 wait complete. 2023-10-06T03:01:16.993 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T03:01:16.993 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T03:01:16.993 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi057.front.sepia.ceph.com 2023-10-06T03:01:16.993 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-10-06T03:01:16.993 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-10-06T03:01:16.993 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T03:01:16.993 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T03:01:16.993 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T03:01:16.994 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-10-06T03:01:16.994 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:01:16.994 DEBUG:teuthology.orchestra.run.smithi057:> ip addr 2023-10-06T03:01:17.011 INFO:teuthology.orchestra.run.smithi057.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T03:01:17.011 INFO:teuthology.orchestra.run.smithi057.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T03:01:17.011 INFO:teuthology.orchestra.run.smithi057.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T03:01:17.011 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:01:17.011 INFO:teuthology.orchestra.run.smithi057.stdout: inet6 ::1/128 scope host 2023-10-06T03:01:17.011 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:01:17.011 INFO:teuthology.orchestra.run.smithi057.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-06T03:01:17.011 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether 0c:c4:7a:6b:ff:86 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:01:17.011 INFO:teuthology.orchestra.run.smithi057.stdout: altname enp7s0f0 2023-10-06T03:01:17.012 INFO:teuthology.orchestra.run.smithi057.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-06T03:01:17.012 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether 0c:c4:7a:6b:ff:87 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:01:17.012 INFO:teuthology.orchestra.run.smithi057.stdout: altname enp7s0f1 2023-10-06T03:01:17.012 INFO:teuthology.orchestra.run.smithi057.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T03:01:17.012 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether 0c:c4:7a:bd:15:62 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:01:17.012 INFO:teuthology.orchestra.run.smithi057.stdout: altname enp1s0f0 2023-10-06T03:01:17.012 INFO:teuthology.orchestra.run.smithi057.stdout: inet 172.21.15.57/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-10-06T03:01:17.012 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft 42408sec preferred_lft 42408sec 2023-10-06T03:01:17.012 INFO:teuthology.orchestra.run.smithi057.stdout: inet6 fe80::ec4:7aff:febd:1562/64 scope link 2023-10-06T03:01:17.012 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:01:17.012 INFO:teuthology.orchestra.run.smithi057.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-06T03:01:17.012 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether 0c:c4:7a:bd:15:63 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:01:17.013 INFO:teuthology.orchestra.run.smithi057.stdout: altname enp1s0f1 2023-10-06T03:01:17.013 INFO:teuthology.orchestra.run.smithi057.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-06T03:01:17.013 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether 02:42:3c:a1:4c:1b brd ff:ff:ff:ff:ff:ff 2023-10-06T03:01:17.013 INFO:teuthology.orchestra.run.smithi057.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-06T03:01:17.013 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:01:17.013 INFO:teuthology.orchestra.run.smithi057.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T03:01:17.013 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether 0a:8c:35:a4:dd:f1 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:01:17.013 INFO:teuthology.orchestra.run.smithi057.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T03:01:17.013 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:01:17.013 INFO:teuthology.orchestra.run.smithi057.stdout: inet6 fe80::581d:6bff:fe09:33c7/64 scope link tentative 2023-10-06T03:01:17.013 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:01:17.013 INFO:teuthology.orchestra.run.smithi057.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T03:01:17.014 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether 0a:8c:35:a4:dd:f1 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T03:01:17.014 INFO:teuthology.orchestra.run.smithi057.stdout: inet6 fe80::88c:35ff:fea4:ddf1/64 scope link tentative 2023-10-06T03:01:17.014 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:01:17.015 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:01:17.015 DEBUG:teuthology.orchestra.run.smithi057:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T03:01:17.093 INFO:teuthology.orchestra.run.smithi057.stdout:1 2023-10-06T03:01:17.096 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:01:17.096 DEBUG:teuthology.orchestra.run.smithi057:> route 2023-10-06T03:01:17.160 INFO:teuthology.orchestra.run.smithi057.stdout:Kernel IP routing table 2023-10-06T03:01:17.160 INFO:teuthology.orchestra.run.smithi057.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T03:01:17.160 INFO:teuthology.orchestra.run.smithi057.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-10-06T03:01:17.160 INFO:teuthology.orchestra.run.smithi057.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-06T03:01:17.160 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-10-06T03:01:17.160 INFO:teuthology.orchestra.run.smithi057.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T03:01:17.160 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:01:17.161 DEBUG:teuthology.orchestra.run.smithi057:> (cd / && exec bash -c ' 2023-10-06T03:01:17.161 DEBUG:teuthology.orchestra.run.smithi057:> set -e 2023-10-06T03:01:17.161 DEBUG:teuthology.orchestra.run.smithi057:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-06T03:01:17.161 DEBUG:teuthology.orchestra.run.smithi057:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-06T03:01:17.161 DEBUG:teuthology.orchestra.run.smithi057:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-06T03:01:17.161 DEBUG:teuthology.orchestra.run.smithi057:> ') 2023-10-06T03:01:17.304 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:01:17.305 DEBUG:teuthology.orchestra.run.smithi057:> ip netns list 2023-10-06T03:01:17.319 INFO:teuthology.orchestra.run.smithi057.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T03:01:17.321 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:01:17.321 DEBUG:teuthology.orchestra.run.smithi057:> ip netns list-id 2023-10-06T03:01:17.378 INFO:teuthology.orchestra.run.smithi057.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-10-06T03:01:17.379 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:01:17.379 DEBUG:teuthology.orchestra.run.smithi057:> (cd / && exec bash -c ' 2023-10-06T03:01:17.380 DEBUG:teuthology.orchestra.run.smithi057:> set -e 2023-10-06T03:01:17.380 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T03:01:17.380 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-10-06T03:01:17.380 DEBUG:teuthology.orchestra.run.smithi057:> ') 2023-10-06T03:01:17.493 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:01:17.493 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-10-06T03:01:17.533 INFO:teuthology.orchestra.run.smithi057.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T03:01:17.533 INFO:teuthology.orchestra.run.smithi057.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T03:01:17.533 INFO:teuthology.orchestra.run.smithi057.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T03:01:17.533 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:01:17.534 INFO:teuthology.orchestra.run.smithi057.stdout: inet6 ::1/128 scope host 2023-10-06T03:01:17.534 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:01:17.534 INFO:teuthology.orchestra.run.smithi057.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T03:01:17.534 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether b2:d2:53:ad:8d:bd brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-06T03:01:17.534 INFO:teuthology.orchestra.run.smithi057.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-06T03:01:17.534 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:01:17.535 INFO:teuthology.orchestra.run.smithi057.stdout: inet6 fe80::b0d2:53ff:fead:8dbd/64 scope link tentative 2023-10-06T03:01:17.535 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:01:17.537 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:01:17.538 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-10-06T03:01:17.616 INFO:teuthology.orchestra.run.smithi057.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T03:01:17.616 INFO:teuthology.orchestra.run.smithi057.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T03:01:17.616 INFO:teuthology.orchestra.run.smithi057.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T03:01:17.616 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:01:17.617 INFO:teuthology.orchestra.run.smithi057.stdout: inet6 ::1/128 scope host 2023-10-06T03:01:17.617 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:01:17.617 INFO:teuthology.orchestra.run.smithi057.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T03:01:17.617 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether b2:d2:53:ad:8d:bd brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-06T03:01:17.617 INFO:teuthology.orchestra.run.smithi057.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-06T03:01:17.617 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:01:17.617 INFO:teuthology.orchestra.run.smithi057.stdout: inet6 fe80::b0d2:53ff:fead:8dbd/64 scope link tentative 2023-10-06T03:01:17.618 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:01:17.620 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-10-06T03:01:17.621 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:01:17.621 DEBUG:teuthology.orchestra.run.smithi057:> (cd / && exec bash -c ' 2023-10-06T03:01:17.621 DEBUG:teuthology.orchestra.run.smithi057:> set -e 2023-10-06T03:01:17.621 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-10-06T03:01:17.621 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-10-06T03:01:17.621 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-10-06T03:01:17.622 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-10-06T03:01:17.622 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-10-06T03:01:17.622 DEBUG:teuthology.orchestra.run.smithi057:> ') 2023-10-06T03:01:17.818 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:01:17.819 DEBUG:teuthology.orchestra.run.smithi057:> (cd / && exec bash -c ' 2023-10-06T03:01:17.819 DEBUG:teuthology.orchestra.run.smithi057:> set -e 2023-10-06T03:01:17.819 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip link set brx.1 up 2023-10-06T03:01:17.819 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip link set dev brx.1 master ceph-brx 2023-10-06T03:01:17.819 DEBUG:teuthology.orchestra.run.smithi057:> ') 2023-10-06T03:01:17.890 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:01:17.890 DEBUG:teuthology.orchestra.run.smithi057:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-10-06T03:01:17.907 INFO:teuthology.orchestra.run.smithi057.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-10-06T03:01:17.907 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:01:17.908 DEBUG:teuthology.orchestra.run.smithi057:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-10-06T03:01:17.912 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:01:17.963 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:01:17.969 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-06T03:01:17.969 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T03:01:17.969 DEBUG:teuthology.orchestra.run.smithi057:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-10-06T03:01:18.088 INFO:teuthology.orchestra.run.smithi057.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-10-06T03:01:18.088 INFO:teuthology.orchestra.run.smithi057.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-10-06T03:01:18.089 INFO:teuthology.orchestra.run.smithi057.stdout:invalid new device string format 2023-10-06T03:01:18.116 INFO:teuthology.orchestra.run.smithi057.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-10-06T03:01:18.116 INFO:teuthology.orchestra.run.smithi057.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-10-06T03:01:18.116 INFO:teuthology.orchestra.run.smithi057.stdout:invalid new device string format 2023-10-06T03:01:18.116 INFO:teuthology.orchestra.run.smithi057.stdout:mount.ceph: resolved to: "172.21.15.57:3300,172.21.15.105:3300,172.21.15.105:3301" 2023-10-06T03:01:18.116 INFO:teuthology.orchestra.run.smithi057.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T03:01:18.132 INFO:teuthology.orchestra.run.smithi057.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-10-06T03:01:18.132 INFO:teuthology.orchestra.run.smithi057.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-10-06T03:01:18.132 INFO:teuthology.orchestra.run.smithi057.stdout:invalid new device string format 2023-10-06T03:01:18.132 INFO:teuthology.orchestra.run.smithi057.stdout:mount.ceph: resolved to: "172.21.15.57:3300,172.21.15.105:3300,172.21.15.105:3301" 2023-10-06T03:01:18.132 INFO:teuthology.orchestra.run.smithi057.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T03:01:18.132 INFO:teuthology.orchestra.run.smithi057.stdout:mount.ceph: resolved to: "172.21.15.57:6789,172.21.15.105:6789,172.21.15.105:6790" 2023-10-06T03:01:18.133 INFO:teuthology.orchestra.run.smithi057.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.57:6789,172.21.15.105:6789,172.21.15.105:6790:/ 2023-10-06T03:01:18.133 INFO:teuthology.orchestra.run.smithi057.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs,key=2,fsid=eb56dc0f-9213-41cb-9aad-8ade6c802e98" will pass to kernel 2023-10-06T03:01:18.138 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T03:01:18.139 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:01:18.139 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-10-06T03:01:18.171 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2023-10-06T03:01:18.171 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T03:01:18.380 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:18.375+0000 7fa5c786e700 1 Processor -- start 2023-10-06T03:01:18.380 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:18.375+0000 7fa5c786e700 1 -- start start 2023-10-06T03:01:18.382 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:18.375+0000 7fa5c786e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa5c006deb0 0x7fa5c00675c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:18.382 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:18.375+0000 7fa5c786e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5c006da20 con 0x7fa5c015cee0 2023-10-06T03:01:18.383 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:18.375+0000 7fa5c786e700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5c00b0650 con 0x7fa5c00671f0 2023-10-06T03:01:18.383 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:18.375+0000 7fa5c786e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c006ce10 con 0x7fa5c006deb0 2023-10-06T03:01:18.383 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:18.379+0000 7fa5c5e0b700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fa5c015cee0 0x7fa5c015d360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:33304/0 (socket says 172.21.15.57:33304) 2023-10-06T03:01:18.383 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:18.379+0000 7fa5c5e0b700 1 -- 172.21.15.57:0/3584952937 learned_addr learned my addr 172.21.15.57:0/3584952937 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:01:18.383 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:18.379+0000 7fa5c4e09700 1 --2- 172.21.15.57:0/3584952937 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa5c006deb0 0x7fa5c00675c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:18.384 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:18.379+0000 7fa5b7fff700 1 -- 172.21.15.57:0/3584952937 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3723391428 0 0) 0x7fa5c006da20 con 0x7fa5c015cee0 2023-10-06T03:01:18.384 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:18.379+0000 7fa5b7fff700 1 -- 172.21.15.57:0/3584952937 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5ac003570 con 0x7fa5c015cee0 2023-10-06T03:01:18.384 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:18.379+0000 7fa5c4e09700 1 -- 172.21.15.57:0/3584952937 >> v1:172.21.15.105:6789/0 conn(0x7fa5c00671f0 legacy=0x7fa5c00aff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:18.384 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:18.379+0000 7fa5c4e09700 1 -- 172.21.15.57:0/3584952937 >> v1:172.21.15.57:6789/0 conn(0x7fa5c015cee0 legacy=0x7fa5c015d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:18.384 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:18.379+0000 7fa5c4e09700 1 -- 172.21.15.57:0/3584952937 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5c006d0f0 con 0x7fa5c006deb0 2023-10-06T03:01:18.385 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:18.379+0000 7fa5c4e09700 1 --2- 172.21.15.57:0/3584952937 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa5c006deb0 0x7fa5c00675c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa5b0009910 tx=0x7fa5b00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1009d5872b1c2020 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:18.385 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:18.379+0000 7fa5b7fff700 1 -- 172.21.15.57:0/3584952937 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b000b680 con 0x7fa5c006deb0 2023-10-06T03:01:18.385 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:18.379+0000 7fa5b7fff700 1 -- 172.21.15.57:0/3584952937 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5b000b7e0 con 0x7fa5c006deb0 2023-10-06T03:01:18.386 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:18.379+0000 7fa5b7fff700 1 -- 172.21.15.57:0/3584952937 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b000bba0 con 0x7fa5c006deb0 2023-10-06T03:01:18.386 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:18.379+0000 7fa5c786e700 1 -- 172.21.15.57:0/3584952937 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa5c006deb0 msgr2=0x7fa5c00675c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:18.386 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:18.379+0000 7fa5c786e700 1 --2- 172.21.15.57:0/3584952937 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa5c006deb0 0x7fa5c00675c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa5b0009910 tx=0x7fa5b00091a0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.386 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:18.379+0000 7fa5c786e700 1 -- 172.21.15.57:0/3584952937 shutdown_connections 2023-10-06T03:01:18.386 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:18.379+0000 7fa5c786e700 1 --2- 172.21.15.57:0/3584952937 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa5c006deb0 0x7fa5c00675c0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.386 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:18.379+0000 7fa5c786e700 1 -- 172.21.15.57:0/3584952937 >> 172.21.15.57:0/3584952937 conn(0x7fa5c00cbdd0 msgr2=0x7fa5c00cc1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:18.387 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:18.379+0000 7fa5c786e700 1 -- 172.21.15.57:0/3584952937 shutdown_connections 2023-10-06T03:01:18.387 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:18.379+0000 7fa5c786e700 1 -- 172.21.15.57:0/3584952937 wait complete. 2023-10-06T03:01:18.388 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:18.383+0000 7fa5c786e700 1 Processor -- start 2023-10-06T03:01:18.388 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:18.383+0000 7fa5c786e700 1 -- start start 2023-10-06T03:01:18.390 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:18.383+0000 7fa5c786e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa5c00671f0 0x7fa5c013b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:18.391 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:18.387+0000 7fa5c786e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa5c006deb0 0x7fa5c016dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:18.391 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:18.387+0000 7fa5c786e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa5c015cee0 0x7fa5c016eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:18.391 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:18.387+0000 7fa5c786e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c014fea0 con 0x7fa5c006deb0 2023-10-06T03:01:18.391 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:18.387+0000 7fa5c786e700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c016ea70 con 0x7fa5c015cee0 2023-10-06T03:01:18.391 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:18.387+0000 7fa5c786e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c016e4b0 con 0x7fa5c00671f0 2023-10-06T03:01:18.392 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:18.387+0000 7fa5c4e09700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa5c006deb0 0x7fa5c016dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:18.392 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:18.387+0000 7fa5c4e09700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa5c006deb0 0x7fa5c016dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55452/0 (socket says 172.21.15.57:55452) 2023-10-06T03:01:18.392 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:18.387+0000 7fa5c4e09700 1 -- 172.21.15.57:0/1608679333 learned_addr learned my addr 172.21.15.57:0/1608679333 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:18.392 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:18.387+0000 7fa5c560a700 1 --2- 172.21.15.57:0/1608679333 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa5c00671f0 0x7fa5c013b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:18.392 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:18.387+0000 7fa5c5e0b700 1 --2- 172.21.15.57:0/1608679333 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa5c015cee0 0x7fa5c016eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:18.392 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:18.387+0000 7fa5c4e09700 1 -- 172.21.15.57:0/1608679333 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa5c00671f0 msgr2=0x7fa5c013b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:18.392 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:18.387+0000 7fa5c4e09700 1 --2- 172.21.15.57:0/1608679333 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa5c00671f0 0x7fa5c013b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.392 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:18.387+0000 7fa5c4e09700 1 -- 172.21.15.57:0/1608679333 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa5c015cee0 msgr2=0x7fa5c016eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:18.393 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:18.387+0000 7fa5c4e09700 1 --2- 172.21.15.57:0/1608679333 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa5c015cee0 0x7fa5c016eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.393 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:18.387+0000 7fa5c4e09700 1 -- 172.21.15.57:0/1608679333 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5b0009420 con 0x7fa5c006deb0 2023-10-06T03:01:18.393 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:18.387+0000 7fa5c560a700 1 --2- 172.21.15.57:0/1608679333 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa5c00671f0 0x7fa5c013b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:18.394 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:18.387+0000 7fa5c4e09700 1 --2- 172.21.15.57:0/1608679333 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa5c006deb0 0x7fa5c016dad0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa5c00ccab0 tx=0x7fa5b0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:18.394 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:18.387+0000 7fa5b57fa700 1 -- 172.21.15.57:0/1608679333 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b000bb60 con 0x7fa5c006deb0 2023-10-06T03:01:18.394 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:18.387+0000 7fa5b57fa700 1 -- 172.21.15.57:0/1608679333 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5b0000c90 con 0x7fa5c006deb0 2023-10-06T03:01:18.394 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:18.387+0000 7fa5b57fa700 1 -- 172.21.15.57:0/1608679333 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b001a660 con 0x7fa5c006deb0 2023-10-06T03:01:18.394 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:18.387+0000 7fa5c786e700 1 -- 172.21.15.57:0/1608679333 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5c016e790 con 0x7fa5c006deb0 2023-10-06T03:01:18.394 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:18.387+0000 7fa5c786e700 1 -- 172.21.15.57:0/1608679333 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5c01503b0 con 0x7fa5c006deb0 2023-10-06T03:01:18.395 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:18.391+0000 7fa5c786e700 1 -- 172.21.15.57:0/1608679333 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5c01505a0 con 0x7fa5c006deb0 2023-10-06T03:01:18.397 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:18.391+0000 7fa5b57fa700 1 -- 172.21.15.57:0/1608679333 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fa5b001aa10 con 0x7fa5c006deb0 2023-10-06T03:01:18.398 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:18.391+0000 7fa5b57fa700 1 --2- 172.21.15.57:0/1608679333 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fa5a4060550 0x7fa5a4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:18.398 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:18.391+0000 7fa5b57fa700 1 -- 172.21.15.57:0/1608679333 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa5b007e580 con 0x7fa5c006deb0 2023-10-06T03:01:18.398 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:18.395+0000 7fa5c560a700 1 --2- 172.21.15.57:0/1608679333 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fa5a4060550 0x7fa5a4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:18.399 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:18.395+0000 7fa5c560a700 1 --2- 172.21.15.57:0/1608679333 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fa5a4060550 0x7fa5a4062a00 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa5bc007fd0 tx=0x7fa5bc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:18.405 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:18.399+0000 7fa5b57fa700 1 -- 172.21.15.57:0/1608679333 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fa5b004e970 con 0x7fa5c006deb0 2023-10-06T03:01:18.613 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:18.607+0000 7fa5c786e700 1 -- 172.21.15.57:0/1608679333 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa5c00712e0 con 0x7fa5c006deb0 2023-10-06T03:01:18.614 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:18.607+0000 7fa5b57fa700 1 -- 172.21.15.57:0/1608679333 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fa5b0051f90 con 0x7fa5c006deb0 2023-10-06T03:01:18.614 INFO:teuthology.orchestra.run.smithi057.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T03:01:18.616 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:18.611+0000 7fa5c786e700 1 -- 172.21.15.57:0/1608679333 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fa5a4060550 msgr2=0x7fa5a4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:18.616 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:18.611+0000 7fa5c786e700 1 --2- 172.21.15.57:0/1608679333 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fa5a4060550 0x7fa5a4062a00 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa5bc007fd0 tx=0x7fa5bc009040 comp rx=0 tx=0).stop 2023-10-06T03:01:18.616 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:18.611+0000 7fa5c786e700 1 -- 172.21.15.57:0/1608679333 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa5c006deb0 msgr2=0x7fa5c016dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:18.616 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:18.611+0000 7fa5c786e700 1 --2- 172.21.15.57:0/1608679333 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa5c006deb0 0x7fa5c016dad0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa5c00ccab0 tx=0x7fa5b0017000 comp rx=0 tx=0).stop 2023-10-06T03:01:18.617 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:18.611+0000 7fa5c786e700 1 -- 172.21.15.57:0/1608679333 shutdown_connections 2023-10-06T03:01:18.617 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:18.611+0000 7fa5c786e700 1 --2- 172.21.15.57:0/1608679333 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa5c015cee0 0x7fa5c016eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.617 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:18.611+0000 7fa5c786e700 1 --2- 172.21.15.57:0/1608679333 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa5c006deb0 0x7fa5c016dad0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.617 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:18.611+0000 7fa5c786e700 1 --2- 172.21.15.57:0/1608679333 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fa5a4060550 0x7fa5a4062a00 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.617 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:18.611+0000 7fa5c786e700 1 --2- 172.21.15.57:0/1608679333 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa5c00671f0 0x7fa5c013b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:18.618 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:18.611+0000 7fa5c786e700 1 -- 172.21.15.57:0/1608679333 >> 172.21.15.57:0/1608679333 conn(0x7fa5c00cbdd0 msgr2=0x7fa5c015eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:18.618 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:18.611+0000 7fa5c786e700 1 -- 172.21.15.57:0/1608679333 shutdown_connections 2023-10-06T03:01:18.618 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:18.611+0000 7fa5c786e700 1 -- 172.21.15.57:0/1608679333 wait complete. 2023-10-06T03:01:18.637 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T03:01:18.637 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T03:01:18.637 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi105.front.sepia.ceph.com 2023-10-06T03:01:18.638 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-06T03:01:18.638 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-06T03:01:18.638 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T03:01:18.638 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T03:01:18.638 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T03:01:18.638 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-06T03:01:18.638 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:01:18.638 DEBUG:teuthology.orchestra.run.smithi105:> ip addr 2023-10-06T03:01:18.658 INFO:teuthology.orchestra.run.smithi105.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T03:01:18.659 INFO:teuthology.orchestra.run.smithi105.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T03:01:18.659 INFO:teuthology.orchestra.run.smithi105.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T03:01:18.659 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:01:18.659 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 ::1/128 scope host 2023-10-06T03:01:18.659 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:01:18.659 INFO:teuthology.orchestra.run.smithi105.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-06T03:01:18.659 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:d8:a4:b8 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:01:18.659 INFO:teuthology.orchestra.run.smithi105.stdout: altname enp7s0f0 2023-10-06T03:01:18.659 INFO:teuthology.orchestra.run.smithi105.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-06T03:01:18.659 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:d8:a4:b9 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:01:18.659 INFO:teuthology.orchestra.run.smithi105.stdout: altname enp7s0f1 2023-10-06T03:01:18.660 INFO:teuthology.orchestra.run.smithi105.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-06T03:01:18.660 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:8f:d4:28 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:01:18.660 INFO:teuthology.orchestra.run.smithi105.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T03:01:18.660 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:8f:d4:29 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:01:18.660 INFO:teuthology.orchestra.run.smithi105.stdout: inet 172.21.15.105/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-10-06T03:01:18.660 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft 42385sec preferred_lft 42385sec 2023-10-06T03:01:18.660 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 fe80::ec4:7aff:fe8f:d429/64 scope link 2023-10-06T03:01:18.660 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:01:18.660 INFO:teuthology.orchestra.run.smithi105.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-06T03:01:18.660 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 02:42:08:23:11:68 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:01:18.660 INFO:teuthology.orchestra.run.smithi105.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-06T03:01:18.661 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:01:18.661 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-06T03:01:18.662 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:01:18.662 DEBUG:teuthology.orchestra.run.smithi105:> (cd / && exec bash -c ' 2023-10-06T03:01:18.662 DEBUG:teuthology.orchestra.run.smithi105:> set -e 2023-10-06T03:01:18.662 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip link add name ceph-brx type bridge 2023-10-06T03:01:18.662 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip addr flush dev ceph-brx 2023-10-06T03:01:18.662 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip link set ceph-brx up 2023-10-06T03:01:18.662 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-06T03:01:18.662 DEBUG:teuthology.orchestra.run.smithi105:> ') 2023-10-06T03:01:18.822 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:01:18.822 DEBUG:teuthology.orchestra.run.smithi105:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T03:01:18.856 INFO:teuthology.orchestra.run.smithi105.stdout:1 2023-10-06T03:01:18.860 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:01:18.860 DEBUG:teuthology.orchestra.run.smithi105:> route 2023-10-06T03:01:18.933 INFO:teuthology.orchestra.run.smithi105.stdout:Kernel IP routing table 2023-10-06T03:01:18.934 INFO:teuthology.orchestra.run.smithi105.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T03:01:18.934 INFO:teuthology.orchestra.run.smithi105.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-10-06T03:01:18.934 INFO:teuthology.orchestra.run.smithi105.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T03:01:18.934 INFO:teuthology.orchestra.run.smithi105.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-06T03:01:18.934 INFO:teuthology.orchestra.run.smithi105.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-10-06T03:01:18.934 INFO:teuthology.orchestra.run.smithi105.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-06T03:01:18.934 INFO:teuthology.orchestra.run.smithi105.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T03:01:18.935 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:01:18.935 DEBUG:teuthology.orchestra.run.smithi105:> (cd / && exec bash -c ' 2023-10-06T03:01:18.935 DEBUG:teuthology.orchestra.run.smithi105:> set -e 2023-10-06T03:01:18.935 DEBUG:teuthology.orchestra.run.smithi105:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T03:01:18.935 DEBUG:teuthology.orchestra.run.smithi105:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T03:01:18.935 DEBUG:teuthology.orchestra.run.smithi105:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T03:01:18.935 DEBUG:teuthology.orchestra.run.smithi105:> ') 2023-10-06T03:01:19.070 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:01:19.070 DEBUG:teuthology.orchestra.run.smithi105:> ip netns list 2023-10-06T03:01:19.084 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:01:19.085 DEBUG:teuthology.orchestra.run.smithi105:> ip netns list-id 2023-10-06T03:01:19.151 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:01:19.151 DEBUG:teuthology.orchestra.run.smithi105:> (cd / && exec bash -c ' 2023-10-06T03:01:19.151 DEBUG:teuthology.orchestra.run.smithi105:> set -e 2023-10-06T03:01:19.151 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-06T03:01:19.152 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-10-06T03:01:19.152 DEBUG:teuthology.orchestra.run.smithi105:> ') 2023-10-06T03:01:19.267 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-10-06T03:01:19.268 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:01:19.268 DEBUG:teuthology.orchestra.run.smithi105:> (cd / && exec bash -c ' 2023-10-06T03:01:19.268 DEBUG:teuthology.orchestra.run.smithi105:> set -e 2023-10-06T03:01:19.268 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-10-06T03:01:19.268 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-06T03:01:19.268 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-10-06T03:01:19.269 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-10-06T03:01:19.269 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-10-06T03:01:19.269 DEBUG:teuthology.orchestra.run.smithi105:> ') 2023-10-06T03:01:19.438 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:01:19.438 DEBUG:teuthology.orchestra.run.smithi105:> (cd / && exec bash -c ' 2023-10-06T03:01:19.438 DEBUG:teuthology.orchestra.run.smithi105:> set -e 2023-10-06T03:01:19.438 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip link set brx.0 up 2023-10-06T03:01:19.438 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip link set dev brx.0 master ceph-brx 2023-10-06T03:01:19.439 DEBUG:teuthology.orchestra.run.smithi105:> ') 2023-10-06T03:01:19.516 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:01:19.516 DEBUG:teuthology.orchestra.run.smithi105:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-06T03:01:19.531 INFO:teuthology.orchestra.run.smithi105.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-06T03:01:19.531 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:01:19.531 DEBUG:teuthology.orchestra.run.smithi105:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-06T03:01:19.588 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-06T03:01:19.588 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T03:01:19.589 DEBUG:teuthology.orchestra.run.smithi105:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-06T03:01:19.709 INFO:teuthology.orchestra.run.smithi105.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-06T03:01:19.709 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-06T03:01:19.709 INFO:teuthology.orchestra.run.smithi105.stdout:invalid new device string format 2023-10-06T03:01:19.841 INFO:teuthology.orchestra.run.smithi105.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-06T03:01:19.841 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-06T03:01:19.842 INFO:teuthology.orchestra.run.smithi105.stdout:invalid new device string format 2023-10-06T03:01:19.842 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: resolved to: "172.21.15.57:3300,172.21.15.105:3300,172.21.15.105:3301" 2023-10-06T03:01:19.842 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T03:01:19.858 INFO:teuthology.orchestra.run.smithi105.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-06T03:01:19.859 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-06T03:01:19.859 INFO:teuthology.orchestra.run.smithi105.stdout:invalid new device string format 2023-10-06T03:01:19.859 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: resolved to: "172.21.15.57:3300,172.21.15.105:3300,172.21.15.105:3301" 2023-10-06T03:01:19.859 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T03:01:19.859 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: resolved to: "172.21.15.57:6789,172.21.15.105:6789,172.21.15.105:6790" 2023-10-06T03:01:19.859 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.57:6789,172.21.15.105:6789,172.21.15.105:6790:/ 2023-10-06T03:01:19.859 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=eb56dc0f-9213-41cb-9aad-8ade6c802e98" will pass to kernel 2023-10-06T03:01:19.863 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T03:01:19.865 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:01:19.865 DEBUG:teuthology.orchestra.run.smithi105:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-06T03:01:19.896 INFO:tasks.kclient:client.3 config is {'syntax': 'v1'} 2023-10-06T03:01:19.896 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T03:01:20.062 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:20.055+0000 7f6fdf5c5700 1 Processor -- start 2023-10-06T03:01:20.062 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:20.055+0000 7f6fdf5c5700 1 -- start start 2023-10-06T03:01:20.065 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:20.059+0000 7f6fdf5c5700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f6fd8158f70 0x7f6fd80cb2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:20.065 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:20.059+0000 7f6fdf5c5700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6fd8159340 0x7f6fd80b01c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:20.065 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:20.059+0000 7f6fdf5c5700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6fd806d4a0 0x7f6fd806d940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:20.065 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:20.059+0000 7f6fdf5c5700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fd80b0700 con 0x7f6fd806d4a0 2023-10-06T03:01:20.066 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:20.059+0000 7f6fdf5c5700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fd80cb900 con 0x7f6fd8158f70 2023-10-06T03:01:20.066 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:20.059+0000 7f6fdf5c5700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd80cbbe0 con 0x7f6fd8159340 2023-10-06T03:01:20.068 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:20.059+0000 7f6fddb62700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6fd806d4a0 0x7f6fd806d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:20.068 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:20.059+0000 7f6fdcb60700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6fd8159340 0x7f6fd80b01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:20.068 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:20.059+0000 7f6fdd361700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f6fd8158f70 0x7f6fd80cb2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:20.068 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:20.059+0000 7f6fddb62700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6fd806d4a0 0x7f6fd806d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55460/0 (socket says 172.21.15.57:55460) 2023-10-06T03:01:20.068 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:20.059+0000 7f6fddb62700 1 -- 172.21.15.57:0/2163215255 learned_addr learned my addr 172.21.15.57:0/2163215255 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:20.068 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:20.059+0000 7f6fdcb60700 1 -- 172.21.15.57:0/2163215255 >> v2:172.21.15.105:3300/0 conn(0x7f6fd8158f70 msgr2=0x7f6fd80cb2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:20.068 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:20.059+0000 7f6fdcb60700 1 --2- 172.21.15.57:0/2163215255 >> v2:172.21.15.105:3300/0 conn(0x7f6fd8158f70 0x7f6fd80cb2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:20.068 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:20.059+0000 7f6fdcb60700 1 -- 172.21.15.57:0/2163215255 >> v2:172.21.15.57:3300/0 conn(0x7f6fd806d4a0 msgr2=0x7f6fd806d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:20.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:20.059+0000 7f6fdcb60700 1 --2- 172.21.15.57:0/2163215255 >> v2:172.21.15.57:3300/0 conn(0x7f6fd806d4a0 0x7f6fd806d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:20.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:20.059+0000 7f6fdcb60700 1 -- 172.21.15.57:0/2163215255 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fd806c9c0 con 0x7f6fd8159340 2023-10-06T03:01:20.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:20.059+0000 7f6fddb62700 1 --2- 172.21.15.57:0/2163215255 >> v2:172.21.15.57:3300/0 conn(0x7f6fd806d4a0 0x7f6fd806d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:01:20.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:20.059+0000 7f6fdcb60700 1 --2- 172.21.15.57:0/2163215255 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6fd8159340 0x7f6fd80b01c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6fd8070a60 tx=0x7f6fc80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=877e78ffe27c5087 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:20.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:20.059+0000 7f6fcffff700 1 -- 172.21.15.57:0/2163215255 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc8011630 con 0x7f6fd8159340 2023-10-06T03:01:20.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:20.063+0000 7f6fcffff700 1 -- 172.21.15.57:0/2163215255 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fc80117b0 con 0x7f6fd8159340 2023-10-06T03:01:20.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:20.063+0000 7f6fcffff700 1 -- 172.21.15.57:0/2163215255 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc8011b70 con 0x7f6fd8159340 2023-10-06T03:01:20.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:20.063+0000 7f6fdf5c5700 1 -- 172.21.15.57:0/2163215255 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6fd8159340 msgr2=0x7f6fd80b01c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:20.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:20.063+0000 7f6fdf5c5700 1 --2- 172.21.15.57:0/2163215255 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6fd8159340 0x7f6fd80b01c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6fd8070a60 tx=0x7f6fc80091a0 comp rx=0 tx=0).stop 2023-10-06T03:01:20.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:20.063+0000 7f6fdf5c5700 1 -- 172.21.15.57:0/2163215255 shutdown_connections 2023-10-06T03:01:20.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:20.063+0000 7f6fdf5c5700 1 --2- 172.21.15.57:0/2163215255 >> v2:172.21.15.57:3300/0 conn(0x7f6fd806d4a0 0x7f6fd806d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:20.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:20.063+0000 7f6fdf5c5700 1 --2- 172.21.15.57:0/2163215255 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6fd8159340 0x7f6fd80b01c0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:20.070 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:20.063+0000 7f6fdf5c5700 1 --2- 172.21.15.57:0/2163215255 >> v2:172.21.15.105:3300/0 conn(0x7f6fd8158f70 0x7f6fd80cb2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:20.070 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:20.063+0000 7f6fdf5c5700 1 -- 172.21.15.57:0/2163215255 >> 172.21.15.57:0/2163215255 conn(0x7f6fd80ccbf0 msgr2=0x7f6fd80ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:20.070 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:20.063+0000 7f6fdf5c5700 1 -- 172.21.15.57:0/2163215255 shutdown_connections 2023-10-06T03:01:20.070 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:20.063+0000 7f6fdf5c5700 1 -- 172.21.15.57:0/2163215255 wait complete. 2023-10-06T03:01:20.070 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:20.063+0000 7f6fdf5c5700 1 Processor -- start 2023-10-06T03:01:20.071 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:20.063+0000 7f6fdf5c5700 1 -- start start 2023-10-06T03:01:20.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:20.067+0000 7f6fdf5c5700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6fd806d4a0 0x7f6fd8159820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:20.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:20.067+0000 7f6fdf5c5700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6fd8158f70 0x7f6fd80cdee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:20.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:20.067+0000 7f6fdf5c5700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6fd8159340 0x7f6fd814a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:20.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:20.067+0000 7f6fdf5c5700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd815cd60 con 0x7f6fd806d4a0 2023-10-06T03:01:20.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:20.067+0000 7f6fdf5c5700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd815a070 con 0x7f6fd8159340 2023-10-06T03:01:20.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:20.067+0000 7f6fdf5c5700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd815a350 con 0x7f6fd8158f70 2023-10-06T03:01:20.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:20.067+0000 7f6fdd361700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6fd806d4a0 0x7f6fd8159820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:20.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:20.067+0000 7f6fdd361700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6fd806d4a0 0x7f6fd8159820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55470/0 (socket says 172.21.15.57:55470) 2023-10-06T03:01:20.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:20.067+0000 7f6fdd361700 1 -- 172.21.15.57:0/424888301 learned_addr learned my addr 172.21.15.57:0/424888301 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:20.075 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:20.067+0000 7f6fdcb60700 1 --2- 172.21.15.57:0/424888301 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6fd8158f70 0x7f6fd80cdee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:20.075 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:20.067+0000 7f6fddb62700 1 --2- 172.21.15.57:0/424888301 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6fd8159340 0x7f6fd814a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:20.075 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:20.067+0000 7f6fdd361700 1 -- 172.21.15.57:0/424888301 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6fd8158f70 msgr2=0x7f6fd80cdee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:20.075 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:20.067+0000 7f6fdd361700 1 --2- 172.21.15.57:0/424888301 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6fd8158f70 0x7f6fd80cdee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:20.075 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:20.067+0000 7f6fdd361700 1 -- 172.21.15.57:0/424888301 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6fd8159340 msgr2=0x7f6fd814a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:20.075 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:20.067+0000 7f6fdd361700 1 --2- 172.21.15.57:0/424888301 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6fd8159340 0x7f6fd814a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:20.075 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:20.067+0000 7f6fdd361700 1 -- 172.21.15.57:0/424888301 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fd0009ae0 con 0x7f6fd806d4a0 2023-10-06T03:01:20.075 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:20.067+0000 7f6fddb62700 1 --2- 172.21.15.57:0/424888301 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6fd8159340 0x7f6fd814a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:20.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:20.067+0000 7f6fdd361700 1 --2- 172.21.15.57:0/424888301 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6fd806d4a0 0x7f6fd8159820 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f6fd400ec80 tx=0x7f6fd40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:20.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:20.067+0000 7f6fcd7fa700 1 -- 172.21.15.57:0/424888301 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fd400c9d0 con 0x7f6fd806d4a0 2023-10-06T03:01:20.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:20.067+0000 7f6fcd7fa700 1 -- 172.21.15.57:0/424888301 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fd400cb50 con 0x7f6fd806d4a0 2023-10-06T03:01:20.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:20.067+0000 7f6fcd7fa700 1 -- 172.21.15.57:0/424888301 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fd4013470 con 0x7f6fd806d4a0 2023-10-06T03:01:20.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:20.067+0000 7f6fdf5c5700 1 -- 172.21.15.57:0/424888301 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fc8009420 con 0x7f6fd806d4a0 2023-10-06T03:01:20.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:20.067+0000 7f6fdf5c5700 1 -- 172.21.15.57:0/424888301 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fd815a910 con 0x7f6fd806d4a0 2023-10-06T03:01:20.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:20.071+0000 7f6fdf5c5700 1 -- 172.21.15.57:0/424888301 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fd80712e0 con 0x7f6fd806d4a0 2023-10-06T03:01:20.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:20.071+0000 7f6fcd7fa700 1 -- 172.21.15.57:0/424888301 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f6fd4013860 con 0x7f6fd806d4a0 2023-10-06T03:01:20.079 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:20.075+0000 7f6fcd7fa700 1 --2- 172.21.15.57:0/424888301 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f6fbc060550 0x7f6fbc062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:20.080 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:20.075+0000 7f6fcd7fa700 1 -- 172.21.15.57:0/424888301 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6fd407cd70 con 0x7f6fd806d4a0 2023-10-06T03:01:20.080 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:20.075+0000 7f6fdcb60700 1 --2- 172.21.15.57:0/424888301 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f6fbc060550 0x7f6fbc062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:20.081 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:20.075+0000 7f6fdcb60700 1 --2- 172.21.15.57:0/424888301 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f6fbc060550 0x7f6fbc062a00 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6fd80cb830 tx=0x7f6fc8017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:20.087 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:20.083+0000 7f6fcd7fa700 1 -- 172.21.15.57:0/424888301 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f6fd404d160 con 0x7f6fd806d4a0 2023-10-06T03:01:20.294 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:20.287+0000 7f6fdf5c5700 1 -- 172.21.15.57:0/424888301 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f6fd80ce9d0 con 0x7f6fd806d4a0 2023-10-06T03:01:20.294 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:20.287+0000 7f6fcd7fa700 1 -- 172.21.15.57:0/424888301 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f6fd4050780 con 0x7f6fd806d4a0 2023-10-06T03:01:20.294 INFO:teuthology.orchestra.run.smithi057.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T03:01:20.300 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:20.291+0000 7f6fdf5c5700 1 -- 172.21.15.57:0/424888301 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f6fbc060550 msgr2=0x7f6fbc062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:20.300 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:20.295+0000 7f6fdf5c5700 1 --2- 172.21.15.57:0/424888301 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f6fbc060550 0x7f6fbc062a00 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6fd80cb830 tx=0x7f6fc8017000 comp rx=0 tx=0).stop 2023-10-06T03:01:20.300 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:20.295+0000 7f6fdf5c5700 1 -- 172.21.15.57:0/424888301 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6fd806d4a0 msgr2=0x7f6fd8159820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:20.301 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:20.295+0000 7f6fdf5c5700 1 --2- 172.21.15.57:0/424888301 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6fd806d4a0 0x7f6fd8159820 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f6fd400ec80 tx=0x7f6fd40091a0 comp rx=0 tx=0).stop 2023-10-06T03:01:20.301 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:20.295+0000 7f6fdf5c5700 1 -- 172.21.15.57:0/424888301 shutdown_connections 2023-10-06T03:01:20.301 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:20.295+0000 7f6fdf5c5700 1 --2- 172.21.15.57:0/424888301 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6fd8159340 0x7f6fd814a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:20.301 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:20.295+0000 7f6fdf5c5700 1 --2- 172.21.15.57:0/424888301 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f6fbc060550 0x7f6fbc062a00 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:20.302 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:20.295+0000 7f6fdf5c5700 1 --2- 172.21.15.57:0/424888301 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6fd8158f70 0x7f6fd80cdee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:20.302 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:20.295+0000 7f6fdf5c5700 1 --2- 172.21.15.57:0/424888301 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6fd806d4a0 0x7f6fd8159820 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:20.302 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:20.295+0000 7f6fdf5c5700 1 -- 172.21.15.57:0/424888301 >> 172.21.15.57:0/424888301 conn(0x7f6fd80ccbf0 msgr2=0x7f6fd806bf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:20.303 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:20.295+0000 7f6fdf5c5700 1 -- 172.21.15.57:0/424888301 shutdown_connections 2023-10-06T03:01:20.303 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:20.295+0000 7f6fdf5c5700 1 -- 172.21.15.57:0/424888301 wait complete. 2023-10-06T03:01:20.320 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T03:01:20.320 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T03:01:20.321 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi105.front.sepia.ceph.com 2023-10-06T03:01:20.321 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-10-06T03:01:20.321 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-10-06T03:01:20.322 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T03:01:20.322 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T03:01:20.322 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T03:01:20.323 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-10-06T03:01:20.323 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:01:20.323 DEBUG:teuthology.orchestra.run.smithi105:> ip addr 2023-10-06T03:01:20.343 INFO:teuthology.orchestra.run.smithi105.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T03:01:20.343 INFO:teuthology.orchestra.run.smithi105.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T03:01:20.344 INFO:teuthology.orchestra.run.smithi105.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T03:01:20.344 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:01:20.344 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 ::1/128 scope host 2023-10-06T03:01:20.344 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:01:20.344 INFO:teuthology.orchestra.run.smithi105.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-06T03:01:20.344 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:d8:a4:b8 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:01:20.344 INFO:teuthology.orchestra.run.smithi105.stdout: altname enp7s0f0 2023-10-06T03:01:20.344 INFO:teuthology.orchestra.run.smithi105.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-06T03:01:20.344 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:d8:a4:b9 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:01:20.344 INFO:teuthology.orchestra.run.smithi105.stdout: altname enp7s0f1 2023-10-06T03:01:20.345 INFO:teuthology.orchestra.run.smithi105.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-06T03:01:20.345 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:8f:d4:28 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:01:20.345 INFO:teuthology.orchestra.run.smithi105.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T03:01:20.345 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:8f:d4:29 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:01:20.345 INFO:teuthology.orchestra.run.smithi105.stdout: inet 172.21.15.105/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-10-06T03:01:20.345 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft 42384sec preferred_lft 42384sec 2023-10-06T03:01:20.345 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 fe80::ec4:7aff:fe8f:d429/64 scope link 2023-10-06T03:01:20.345 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:01:20.345 INFO:teuthology.orchestra.run.smithi105.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-06T03:01:20.345 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 02:42:08:23:11:68 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:01:20.346 INFO:teuthology.orchestra.run.smithi105.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-06T03:01:20.346 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:01:20.346 INFO:teuthology.orchestra.run.smithi105.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T03:01:20.346 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 42:5c:cf:ef:77:ff brd ff:ff:ff:ff:ff:ff 2023-10-06T03:01:20.346 INFO:teuthology.orchestra.run.smithi105.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T03:01:20.346 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:01:20.346 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 fe80::dcd2:51ff:fe2d:bcb0/64 scope link tentative 2023-10-06T03:01:20.346 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:01:20.346 INFO:teuthology.orchestra.run.smithi105.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T03:01:20.346 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 42:5c:cf:ef:77:ff brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-06T03:01:20.347 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 fe80::405c:cfff:feef:77ff/64 scope link tentative 2023-10-06T03:01:20.347 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:01:20.348 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:01:20.348 DEBUG:teuthology.orchestra.run.smithi105:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T03:01:20.425 INFO:teuthology.orchestra.run.smithi105.stdout:1 2023-10-06T03:01:20.428 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:01:20.428 DEBUG:teuthology.orchestra.run.smithi105:> route 2023-10-06T03:01:20.491 INFO:teuthology.orchestra.run.smithi105.stdout:Kernel IP routing table 2023-10-06T03:01:20.492 INFO:teuthology.orchestra.run.smithi105.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T03:01:20.492 INFO:teuthology.orchestra.run.smithi105.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-10-06T03:01:20.492 INFO:teuthology.orchestra.run.smithi105.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T03:01:20.492 INFO:teuthology.orchestra.run.smithi105.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-06T03:01:20.492 INFO:teuthology.orchestra.run.smithi105.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-10-06T03:01:20.492 INFO:teuthology.orchestra.run.smithi105.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-06T03:01:20.492 INFO:teuthology.orchestra.run.smithi105.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T03:01:20.492 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:01:20.493 DEBUG:teuthology.orchestra.run.smithi105:> (cd / && exec bash -c ' 2023-10-06T03:01:20.493 DEBUG:teuthology.orchestra.run.smithi105:> set -e 2023-10-06T03:01:20.493 DEBUG:teuthology.orchestra.run.smithi105:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T03:01:20.493 DEBUG:teuthology.orchestra.run.smithi105:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T03:01:20.493 DEBUG:teuthology.orchestra.run.smithi105:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T03:01:20.493 DEBUG:teuthology.orchestra.run.smithi105:> ') 2023-10-06T03:01:20.632 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:01:20.633 DEBUG:teuthology.orchestra.run.smithi105:> ip netns list 2023-10-06T03:01:20.650 INFO:teuthology.orchestra.run.smithi105.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-06T03:01:20.651 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:01:20.651 DEBUG:teuthology.orchestra.run.smithi105:> ip netns list-id 2023-10-06T03:01:20.714 INFO:teuthology.orchestra.run.smithi105.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-10-06T03:01:20.715 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:01:20.715 DEBUG:teuthology.orchestra.run.smithi105:> (cd / && exec bash -c ' 2023-10-06T03:01:20.715 DEBUG:teuthology.orchestra.run.smithi105:> set -e 2023-10-06T03:01:20.715 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-06T03:01:20.716 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-10-06T03:01:20.716 DEBUG:teuthology.orchestra.run.smithi105:> ') 2023-10-06T03:01:20.837 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:01:20.837 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-10-06T03:01:20.871 INFO:teuthology.orchestra.run.smithi105.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T03:01:20.871 INFO:teuthology.orchestra.run.smithi105.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T03:01:20.871 INFO:teuthology.orchestra.run.smithi105.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T03:01:20.871 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:01:20.872 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 ::1/128 scope host 2023-10-06T03:01:20.872 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:01:20.872 INFO:teuthology.orchestra.run.smithi105.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T03:01:20.872 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether d6:be:9a:87:8b:4c brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-06T03:01:20.872 INFO:teuthology.orchestra.run.smithi105.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-06T03:01:20.872 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:01:20.872 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 fe80::d4be:9aff:fe87:8b4c/64 scope link tentative 2023-10-06T03:01:20.872 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:01:20.874 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:01:20.874 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-10-06T03:01:20.956 INFO:teuthology.orchestra.run.smithi105.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T03:01:20.956 INFO:teuthology.orchestra.run.smithi105.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T03:01:20.956 INFO:teuthology.orchestra.run.smithi105.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T03:01:20.956 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:01:20.956 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 ::1/128 scope host 2023-10-06T03:01:20.957 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:01:20.957 INFO:teuthology.orchestra.run.smithi105.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T03:01:20.957 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether d6:be:9a:87:8b:4c brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-06T03:01:20.957 INFO:teuthology.orchestra.run.smithi105.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-06T03:01:20.957 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:01:20.957 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 fe80::d4be:9aff:fe87:8b4c/64 scope link tentative 2023-10-06T03:01:20.957 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:01:20.959 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-10-06T03:01:20.960 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:01:20.960 DEBUG:teuthology.orchestra.run.smithi105:> (cd / && exec bash -c ' 2023-10-06T03:01:20.960 DEBUG:teuthology.orchestra.run.smithi105:> set -e 2023-10-06T03:01:20.960 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-10-06T03:01:20.960 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-10-06T03:01:20.960 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-10-06T03:01:20.960 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-10-06T03:01:20.961 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-10-06T03:01:20.961 DEBUG:teuthology.orchestra.run.smithi105:> ') 2023-10-06T03:01:21.145 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:01:21.145 DEBUG:teuthology.orchestra.run.smithi105:> (cd / && exec bash -c ' 2023-10-06T03:01:21.145 DEBUG:teuthology.orchestra.run.smithi105:> set -e 2023-10-06T03:01:21.145 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip link set brx.1 up 2023-10-06T03:01:21.145 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip link set dev brx.1 master ceph-brx 2023-10-06T03:01:21.146 DEBUG:teuthology.orchestra.run.smithi105:> ') 2023-10-06T03:01:21.223 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:01:21.223 DEBUG:teuthology.orchestra.run.smithi105:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-10-06T03:01:21.239 INFO:teuthology.orchestra.run.smithi105.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-10-06T03:01:21.239 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:01:21.239 DEBUG:teuthology.orchestra.run.smithi105:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-10-06T03:01:21.298 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-06T03:01:21.298 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T03:01:21.299 DEBUG:teuthology.orchestra.run.smithi105:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-10-06T03:01:21.416 INFO:teuthology.orchestra.run.smithi105.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-10-06T03:01:21.416 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-10-06T03:01:21.416 INFO:teuthology.orchestra.run.smithi105.stdout:invalid new device string format 2023-10-06T03:01:21.440 INFO:teuthology.orchestra.run.smithi105.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-10-06T03:01:21.440 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-10-06T03:01:21.440 INFO:teuthology.orchestra.run.smithi105.stdout:invalid new device string format 2023-10-06T03:01:21.440 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: resolved to: "172.21.15.57:3300,172.21.15.105:3300,172.21.15.105:3301" 2023-10-06T03:01:21.440 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T03:01:21.453 INFO:teuthology.orchestra.run.smithi105.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-10-06T03:01:21.454 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-10-06T03:01:21.454 INFO:teuthology.orchestra.run.smithi105.stdout:invalid new device string format 2023-10-06T03:01:21.454 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: resolved to: "172.21.15.57:3300,172.21.15.105:3300,172.21.15.105:3301" 2023-10-06T03:01:21.454 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T03:01:21.454 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: resolved to: "172.21.15.57:6789,172.21.15.105:6789,172.21.15.105:6790" 2023-10-06T03:01:21.454 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.57:6789,172.21.15.105:6789,172.21.15.105:6790:/ 2023-10-06T03:01:21.454 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs,key=3,fsid=eb56dc0f-9213-41cb-9aad-8ade6c802e98" will pass to kernel 2023-10-06T03:01:21.458 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T03:01:21.459 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:01:21.459 DEBUG:teuthology.orchestra.run.smithi105:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-10-06T03:01:21.491 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-10-06T03:01:21.510 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:01:21.683 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:21.675+0000 7f4026145700 1 Processor -- start 2023-10-06T03:01:21.683 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:21.679+0000 7f4026145700 1 -- start start 2023-10-06T03:01:21.686 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:21.679+0000 7f4026145700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f40200c1c70 0x7f40200c20f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:21.686 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:21.679+0000 7f4026145700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f40200cbfe0 0x7f40200cc440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:21.686 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:21.679+0000 7f4026145700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40200c2630 con 0x7f4020159320 2023-10-06T03:01:21.686 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:21.679+0000 7f4026145700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40200c7510 con 0x7f40200c1c70 2023-10-06T03:01:21.686 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:21.679+0000 7f4026145700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40200b0c60 con 0x7f40200cbfe0 2023-10-06T03:01:21.687 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:21.679+0000 7f4017fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f40200c1c70 0x7f40200c20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:21.687 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:21.683+0000 7f401f7fe700 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f4020159320 0x7f40200c91e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.57:53430/0 (socket says 172.21.15.57:53430) 2023-10-06T03:01:21.687 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:21.683+0000 7f401f7fe700 1 -- 172.21.15.57:0/2959974204 learned_addr learned my addr 172.21.15.57:0/2959974204 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:01:21.687 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:21.683+0000 7f401ffff700 1 --2- 172.21.15.57:0/2959974204 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f40200cbfe0 0x7f40200cc440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:21.688 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:21.683+0000 7f4017fff700 1 -- 172.21.15.57:0/2959974204 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f40200cbfe0 msgr2=0x7f40200cc440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:21.688 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:21.683+0000 7f4017fff700 1 --2- 172.21.15.57:0/2959974204 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f40200cbfe0 0x7f40200cc440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:21.688 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:21.683+0000 7f4017fff700 1 -- 172.21.15.57:0/2959974204 >> v1:172.21.15.105:6789/0 conn(0x7f4020159320 legacy=0x7f40200c91e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:21.688 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:21.683+0000 7f4017fff700 1 -- 172.21.15.57:0/2959974204 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40200c28c0 con 0x7f40200c1c70 2023-10-06T03:01:21.688 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:21.683+0000 7f4017fff700 1 --2- 172.21.15.57:0/2959974204 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f40200c1c70 0x7f40200c20f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f40080098e0 tx=0x7f40080091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d6e5d35bb9a55ec server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:21.689 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:21.683+0000 7f401effd700 1 -- 172.21.15.57:0/2959974204 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f400800b640 con 0x7f40200c1c70 2023-10-06T03:01:21.689 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:21.683+0000 7f401effd700 1 -- 172.21.15.57:0/2959974204 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f400800b7a0 con 0x7f40200c1c70 2023-10-06T03:01:21.689 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:21.683+0000 7f401effd700 1 -- 172.21.15.57:0/2959974204 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f400800bb40 con 0x7f40200c1c70 2023-10-06T03:01:21.689 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:21.683+0000 7f4026145700 1 -- 172.21.15.57:0/2959974204 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f40200c1c70 msgr2=0x7f40200c20f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:21.689 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:21.683+0000 7f4026145700 1 --2- 172.21.15.57:0/2959974204 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f40200c1c70 0x7f40200c20f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f40080098e0 tx=0x7f40080091a0 comp rx=0 tx=0).stop 2023-10-06T03:01:21.690 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:21.683+0000 7f4026145700 1 -- 172.21.15.57:0/2959974204 shutdown_connections 2023-10-06T03:01:21.690 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:21.683+0000 7f4026145700 1 --2- 172.21.15.57:0/2959974204 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f40200cbfe0 0x7f40200cc440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:21.690 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:21.683+0000 7f4026145700 1 --2- 172.21.15.57:0/2959974204 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f40200c1c70 0x7f40200c20f0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:21.690 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:21.683+0000 7f4026145700 1 -- 172.21.15.57:0/2959974204 >> 172.21.15.57:0/2959974204 conn(0x7f40200afd90 msgr2=0x7f40200b0190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:21.690 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:21.683+0000 7f4026145700 1 -- 172.21.15.57:0/2959974204 shutdown_connections 2023-10-06T03:01:21.690 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:21.683+0000 7f4026145700 1 -- 172.21.15.57:0/2959974204 wait complete. 2023-10-06T03:01:21.693 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:21.687+0000 7f4026145700 1 Processor -- start 2023-10-06T03:01:21.693 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:21.687+0000 7f4026145700 1 -- start start 2023-10-06T03:01:21.695 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:21.691+0000 7f4026145700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f40200c1c70 0x7f40200c4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:21.695 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:21.691+0000 7f4026145700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f40200cbfe0 0x7f402015d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:21.695 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:21.691+0000 7f4026145700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4020159320 0x7f402015a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:21.695 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:21.691+0000 7f4026145700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40200c68a0 con 0x7f40200cbfe0 2023-10-06T03:01:21.695 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:21.691+0000 7f4026145700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f402015a080 con 0x7f40200c1c70 2023-10-06T03:01:21.696 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:21.691+0000 7f4026145700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4020159790 con 0x7f4020159320 2023-10-06T03:01:21.696 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:21.691+0000 7f4017fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f40200cbfe0 0x7f402015d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:21.696 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:21.691+0000 7f4017fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f40200cbfe0 0x7f402015d320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55488/0 (socket says 172.21.15.57:55488) 2023-10-06T03:01:21.696 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:21.691+0000 7f4017fff700 1 -- 172.21.15.57:0/1698119405 learned_addr learned my addr 172.21.15.57:0/1698119405 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:21.697 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:21.691+0000 7f401f7fe700 1 --2- 172.21.15.57:0/1698119405 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f40200c1c70 0x7f40200c4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:21.697 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:21.691+0000 7f401ffff700 1 --2- 172.21.15.57:0/1698119405 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4020159320 0x7f402015a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:21.697 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:21.691+0000 7f4017fff700 1 -- 172.21.15.57:0/1698119405 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4020159320 msgr2=0x7f402015a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:21.697 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:21.691+0000 7f4017fff700 1 --2- 172.21.15.57:0/1698119405 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4020159320 0x7f402015a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:21.697 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:21.691+0000 7f4017fff700 1 -- 172.21.15.57:0/1698119405 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f40200c1c70 msgr2=0x7f40200c4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:21.698 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:21.691+0000 7f4017fff700 1 --2- 172.21.15.57:0/1698119405 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f40200c1c70 0x7f40200c4440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:21.698 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:21.691+0000 7f4017fff700 1 -- 172.21.15.57:0/1698119405 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4008009420 con 0x7f40200cbfe0 2023-10-06T03:01:21.698 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:21.691+0000 7f4017fff700 1 --2- 172.21.15.57:0/1698119405 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f40200cbfe0 0x7f402015d320 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f402006a840 tx=0x7f4008017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:21.698 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:21.691+0000 7f40177fe700 1 -- 172.21.15.57:0/1698119405 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f400801bda0 con 0x7f40200cbfe0 2023-10-06T03:01:21.698 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:21.691+0000 7f40177fe700 1 -- 172.21.15.57:0/1698119405 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4008011420 con 0x7f40200cbfe0 2023-10-06T03:01:21.698 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:21.691+0000 7f40177fe700 1 -- 172.21.15.57:0/1698119405 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40080117e0 con 0x7f40200cbfe0 2023-10-06T03:01:21.698 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:21.691+0000 7f4026145700 1 -- 172.21.15.57:0/1698119405 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4020159a30 con 0x7f40200cbfe0 2023-10-06T03:01:21.698 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:21.691+0000 7f4026145700 1 -- 172.21.15.57:0/1698119405 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f402015dcc0 con 0x7f40200cbfe0 2023-10-06T03:01:21.699 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:21.695+0000 7f4026145700 1 -- 172.21.15.57:0/1698119405 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40200712e0 con 0x7f40200cbfe0 2023-10-06T03:01:21.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:21.695+0000 7f40177fe700 1 -- 172.21.15.57:0/1698119405 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f4008011b50 con 0x7f40200cbfe0 2023-10-06T03:01:21.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:21.699+0000 7f40177fe700 1 --2- 172.21.15.57:0/1698119405 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f4000060550 0x7f4000062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:21.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:21.699+0000 7f40177fe700 1 -- 172.21.15.57:0/1698119405 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f400807dfa0 con 0x7f40200cbfe0 2023-10-06T03:01:21.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:21.699+0000 7f401f7fe700 1 --2- 172.21.15.57:0/1698119405 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f4000060550 0x7f4000062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:21.704 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:21.699+0000 7f401f7fe700 1 --2- 172.21.15.57:0/1698119405 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f4000060550 0x7f4000062a00 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f402016ce20 tx=0x7f4010009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:21.710 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:21.707+0000 7f40177fe700 1 -- 172.21.15.57:0/1698119405 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f400804e390 con 0x7f40200cbfe0 2023-10-06T03:01:21.885 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:21.879+0000 7f4026145700 1 -- 172.21.15.57:0/1698119405 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f40200c2ba0 con 0x7f40200cbfe0 2023-10-06T03:01:21.887 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:21.883+0000 7f40177fe700 1 -- 172.21.15.57:0/1698119405 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16866 (secure 0 0 0) 0x7f40080519b0 con 0x7f40200cbfe0 2023-10-06T03:01:21.887 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:01:21.888 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":23,"fsid":"eb56dc0f-9213-41cb-9aad-8ade6c802e98","created":"2023-10-06T03:00:30.806197+0000","modified":"2023-10-06T03:00:58.975366+0000","last_up_change":"2023-10-06T03:00:43.607454+0000","last_in_change":"2023-10-06T03:00:33.943513+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T03:00:44.360651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T03:00:50.466601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:00:55.472586+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T03:00:56.400884+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"58cf6c90-d704-43e0-b2db-dffe526d5e8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":33053},{"type":"v1","addr":"172.21.15.57:6801","nonce":33053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":33053},{"type":"v1","addr":"172.21.15.57:6803","nonce":33053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":33053},{"type":"v1","addr":"172.21.15.57:6807","nonce":33053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":33053},{"type":"v1","addr":"172.21.15.57:6805","nonce":33053}]},"public_addr":"172.21.15.57:6801/33053","cluster_addr":"172.21.15.57:6803/33053","heartbeat_back_addr":"172.21.15.57:6807/33053","heartbeat_front_addr":"172.21.15.57:6805/33053","state":["exists","up"]},{"osd":1,"uuid":"16afbe70-7f9e-4568-9c92-763e6e348119","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6809","nonce":33052},{"type":"v1","addr":"172.21.15.57:6810","nonce":33052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":33052},{"type":"v1","addr":"172.21.15.57:6813","nonce":33052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":33052},{"type":"v1","addr":"172.21.15.57:6822","nonce":33052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6815","nonce":33052},{"type":"v1","addr":"172.21.15.57:6818","nonce":33052}]},"public_addr":"172.21.15.57:6810/33052","cluster_addr":"172.21.15.57:6813/33052","heartbeat_back_addr":"172.21.15.57:6822/33052","heartbeat_front_addr":"172.21.15.57:6818/33052","state":["exists","up"]},{"osd":2,"uuid":"7255c62e-f92f-470f-a5ce-30228920d9f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":33058},{"type":"v1","addr":"172.21.15.57:6825","nonce":33058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":33058},{"type":"v1","addr":"172.21.15.57:6827","nonce":33058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":33058},{"type":"v1","addr":"172.21.15.57:6831","nonce":33058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":33058},{"type":"v1","addr":"172.21.15.57:6829","nonce":33058}]},"public_addr":"172.21.15.57:6825/33058","cluster_addr":"172.21.15.57:6827/33058","heartbeat_back_addr":"172.21.15.57:6831/33058","heartbeat_front_addr":"172.21.15.57:6829/33058","state":["exists","up"]},{"osd":3,"uuid":"152a236d-f799-4888-8544-74865508d5a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":33057},{"type":"v1","addr":"172.21.15.57:6811","nonce":33057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":33057},{"type":"v1","addr":"172.21.15.57:6816","nonce":33057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6821","nonce":33057},{"type":"v1","addr":"172.21.15.57:6823","nonce":33057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6817","nonce":33057},{"type":"v1","addr":"172.21.15.57:6819","nonce":33057}]},"public_addr":"172.21.15.57:6811/33057","cluster_addr":"172.21.15.57:6816/33057","heartbeat_back_addr":"172.21.15.57:6823/33057","heartbeat_front_addr":"172.21.15.57:6819/33057","state":["exists","up"]},{"osd":4,"uuid":"37db2a65-3566-41d0-9d60-e66c49e1e68e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":33368},{"type":"v1","addr":"172.21.15.105:6801","nonce":33368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":33368},{"type":"v1","addr":"172.21.15.105:6803","nonce":33368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":33368},{"type":"v1","addr":"172.21.15.105:6807","nonce":33368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":33368},{"type":"v1","addr":"172.21.15.105:6805","nonce":33368}]},"public_addr":"172.21.15.105:6801/33368","cluster_addr":"172.21.15.105:6803/33368","heartbeat_back_addr":"172.21.15.105:6807/33368","heartbeat_front_addr":"172.21.15.105:6805/33368","state":["exists","up"]},{"osd":5,"uuid":"35e77918-1bb4-42ca-9b20-f3c14eaa0c04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":33379},{"type":"v1","addr":"172.21.15.105:6818","nonce":33379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":33379},{"type":"v1","addr":"172.21.15.105:6823","nonce":33379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":33379},{"type":"v1","addr":"172.21.15.105:6831","nonce":33379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":33379},{"type":"v1","addr":"172.21.15.105:6827","nonce":33379}]},"public_addr":"172.21.15.105:6818/33379","cluster_addr":"172.21.15.105:6823/33379","heartbeat_back_addr":"172.21.15.105:6831/33379","heartbeat_front_addr":"172.21.15.105:6827/33379","state":["exists","up"]},{"osd":6,"uuid":"b4d9d510-7a45-4173-8287-c6c8d6547f2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":33369},{"type":"v1","addr":"172.21.15.105:6819","nonce":33369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":33369},{"type":"v1","addr":"172.21.15.105:6822","nonce":33369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":33369},{"type":"v1","addr":"172.21.15.105:6830","nonce":33369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":33369},{"type":"v1","addr":"172.21.15.105:6826","nonce":33369}]},"public_addr":"172.21.15.105:6819/33369","cluster_addr":"172.21.15.105:6822/33369","heartbeat_back_addr":"172.21.15.105:6830/33369","heartbeat_front_addr":"172.21.15.105:6826/33369","state":["exists","up"]},{"osd":7,"uuid":"74266fb0-cd84-463f-8bf0-092652a71dc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":33370},{"type":"v1","addr":"172.21.15.105:6809","nonce":33370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":33370},{"type":"v1","addr":"172.21.15.105:6811","nonce":33370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":33370},{"type":"v1","addr":"172.21.15.105:6815","nonce":33370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":33370},{"type":"v1","addr":"172.21.15.105:6813","nonce":33370}]},"public_addr":"172.21.15.105:6809/33370","cluster_addr":"172.21.15.105:6811/33370","heartbeat_back_addr":"172.21.15.105:6815/33370","heartbeat_front_addr":"172.21.15.105:6813/33370","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.596864+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.633851+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.636993+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.529681+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.608601+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.659752+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.661717+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.642221+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:01:21.890 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:21.883+0000 7f4026145700 1 -- 172.21.15.57:0/1698119405 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f4000060550 msgr2=0x7f4000062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:21.890 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:21.883+0000 7f4026145700 1 --2- 172.21.15.57:0/1698119405 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f4000060550 0x7f4000062a00 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f402016ce20 tx=0x7f4010009040 comp rx=0 tx=0).stop 2023-10-06T03:01:21.890 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:21.883+0000 7f4026145700 1 -- 172.21.15.57:0/1698119405 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f40200cbfe0 msgr2=0x7f402015d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:21.890 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:21.883+0000 7f4026145700 1 --2- 172.21.15.57:0/1698119405 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f40200cbfe0 0x7f402015d320 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f402006a840 tx=0x7f4008017000 comp rx=0 tx=0).stop 2023-10-06T03:01:21.890 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:21.883+0000 7f4026145700 1 -- 172.21.15.57:0/1698119405 shutdown_connections 2023-10-06T03:01:21.890 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:21.883+0000 7f4026145700 1 --2- 172.21.15.57:0/1698119405 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f4000060550 0x7f4000062a00 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:21.890 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:21.883+0000 7f4026145700 1 --2- 172.21.15.57:0/1698119405 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4020159320 0x7f402015a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:21.890 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:21.883+0000 7f4026145700 1 --2- 172.21.15.57:0/1698119405 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f40200cbfe0 0x7f402015d320 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:21.891 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:21.883+0000 7f4026145700 1 --2- 172.21.15.57:0/1698119405 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f40200c1c70 0x7f40200c4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:21.891 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:21.883+0000 7f4026145700 1 -- 172.21.15.57:0/1698119405 >> 172.21.15.57:0/1698119405 conn(0x7f40200afd90 msgr2=0x7f40200676e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:21.891 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:21.883+0000 7f4026145700 1 -- 172.21.15.57:0/1698119405 shutdown_connections 2023-10-06T03:01:21.891 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:21.887+0000 7f4026145700 1 -- 172.21.15.57:0/1698119405 wait complete. 2023-10-06T03:01:21.912 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T03:00:44.360651+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T03:00:50.466601+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T03:00:55.472586+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T03:00:56.400884+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T03:01:21.913 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T03:01:22.083 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.079+0000 7f0ee1b45700 1 Processor -- start 2023-10-06T03:01:22.083 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.079+0000 7f0ee1b45700 1 -- start start 2023-10-06T03:01:22.085 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.079+0000 7f0ee1b45700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f0edc15cd50 0x7f0edc15d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:22.086 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.079+0000 7f0ee1b45700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0edc1501b0 0x7f0edc159e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:22.086 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.079+0000 7f0ee1b45700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0edc15d660 con 0x7f0edc14fd10 2023-10-06T03:01:22.086 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.079+0000 7f0ee1b45700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0edc06e300 con 0x7f0edc15cd50 2023-10-06T03:01:22.086 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.079+0000 7f0ee1b45700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0edc06afb0 con 0x7f0edc1501b0 2023-10-06T03:01:22.086 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.079+0000 7f0ed3fff700 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f0edc14fd10 0x7f0edc159750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.57:53436/0 (socket says 172.21.15.57:53436) 2023-10-06T03:01:22.087 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.079+0000 7f0ed3fff700 1 -- 172.21.15.57:0/629581878 learned_addr learned my addr 172.21.15.57:0/629581878 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:01:22.087 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.079+0000 7f0edb7fe700 1 --2- 172.21.15.57:0/629581878 >> v2:172.21.15.105:3300/0 conn(0x7f0edc15cd50 0x7f0edc15d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:22.087 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.079+0000 7f0edbfff700 1 --2- 172.21.15.57:0/629581878 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0edc1501b0 0x7f0edc159e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:22.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.083+0000 7f0edaffd700 1 -- 172.21.15.57:0/629581878 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1287389333 0 0) 0x7f0edc15d660 con 0x7f0edc14fd10 2023-10-06T03:01:22.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.083+0000 7f0edaffd700 1 -- 172.21.15.57:0/629581878 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ec8003570 con 0x7f0edc14fd10 2023-10-06T03:01:22.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.083+0000 7f0edb7fe700 1 -- 172.21.15.57:0/629581878 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0edc1501b0 msgr2=0x7f0edc159e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:22.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.083+0000 7f0edb7fe700 1 --2- 172.21.15.57:0/629581878 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0edc1501b0 0x7f0edc159e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:22.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.083+0000 7f0edb7fe700 1 -- 172.21.15.57:0/629581878 >> v1:172.21.15.105:6789/0 conn(0x7f0edc14fd10 legacy=0x7f0edc159750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:22.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.083+0000 7f0edb7fe700 1 -- 172.21.15.57:0/629581878 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0edc06b290 con 0x7f0edc15cd50 2023-10-06T03:01:22.089 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.083+0000 7f0edb7fe700 1 --2- 172.21.15.57:0/629581878 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0edc15cd50 0x7f0edc15d120 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc009910 tx=0x7f0ecc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd678ec6de027db5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:22.089 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.083+0000 7f0edaffd700 1 -- 172.21.15.57:0/629581878 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ecc011630 con 0x7f0edc15cd50 2023-10-06T03:01:22.089 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.083+0000 7f0edaffd700 1 -- 172.21.15.57:0/629581878 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ecc011790 con 0x7f0edc15cd50 2023-10-06T03:01:22.089 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.083+0000 7f0edaffd700 1 -- 172.21.15.57:0/629581878 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ecc011b30 con 0x7f0edc15cd50 2023-10-06T03:01:22.090 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.083+0000 7f0ee1b45700 1 -- 172.21.15.57:0/629581878 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0edc15cd50 msgr2=0x7f0edc15d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:22.090 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.083+0000 7f0ee1b45700 1 --2- 172.21.15.57:0/629581878 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0edc15cd50 0x7f0edc15d120 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc009910 tx=0x7f0ecc0091a0 comp rx=0 tx=0).stop 2023-10-06T03:01:22.090 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.083+0000 7f0ee1b45700 1 -- 172.21.15.57:0/629581878 shutdown_connections 2023-10-06T03:01:22.090 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.083+0000 7f0ee1b45700 1 --2- 172.21.15.57:0/629581878 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0edc1501b0 0x7f0edc159e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:22.091 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.083+0000 7f0ee1b45700 1 --2- 172.21.15.57:0/629581878 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0edc15cd50 0x7f0edc15d120 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:22.091 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.083+0000 7f0ee1b45700 1 -- 172.21.15.57:0/629581878 >> 172.21.15.57:0/629581878 conn(0x7f0edc0ccbc0 msgr2=0x7f0edc0ccfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:22.091 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.083+0000 7f0ee1b45700 1 -- 172.21.15.57:0/629581878 shutdown_connections 2023-10-06T03:01:22.091 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.083+0000 7f0ee1b45700 1 -- 172.21.15.57:0/629581878 wait complete. 2023-10-06T03:01:22.093 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.087+0000 7f0ee1b45700 1 Processor -- start 2023-10-06T03:01:22.093 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.087+0000 7f0ee1b45700 1 -- start start 2023-10-06T03:01:22.095 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.091+0000 7f0ee1b45700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0edc14fd10 0x7f0edc0b4900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:22.095 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.091+0000 7f0ee1b45700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0edc1501b0 0x7f0edc150920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:22.095 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.091+0000 7f0ee1b45700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0edc15cd50 0x7f0edc1522f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:22.095 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.091+0000 7f0ee1b45700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0edc0c76d0 con 0x7f0edc15cd50 2023-10-06T03:01:22.096 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.091+0000 7f0ee1b45700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0edc150e60 con 0x7f0edc14fd10 2023-10-06T03:01:22.096 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.091+0000 7f0ee1b45700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0edc0b4fa0 con 0x7f0edc1501b0 2023-10-06T03:01:22.097 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.091+0000 7f0edbfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0edc15cd50 0x7f0edc1522f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:22.097 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.091+0000 7f0edbfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0edc15cd50 0x7f0edc1522f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55498/0 (socket says 172.21.15.57:55498) 2023-10-06T03:01:22.099 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.091+0000 7f0edbfff700 1 -- 172.21.15.57:0/1041759032 learned_addr learned my addr 172.21.15.57:0/1041759032 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:22.099 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.091+0000 7f0edb7fe700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0edc14fd10 0x7f0edc0b4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:22.099 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.091+0000 7f0ed3fff700 1 --2- 172.21.15.57:0/1041759032 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0edc1501b0 0x7f0edc150920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:22.099 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.091+0000 7f0edb7fe700 1 -- 172.21.15.57:0/1041759032 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0edc1501b0 msgr2=0x7f0edc150920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:22.099 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.091+0000 7f0edb7fe700 1 --2- 172.21.15.57:0/1041759032 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0edc1501b0 0x7f0edc150920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:22.100 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.091+0000 7f0edb7fe700 1 -- 172.21.15.57:0/1041759032 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0edc15cd50 msgr2=0x7f0edc1522f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:22.100 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.091+0000 7f0edb7fe700 1 --2- 172.21.15.57:0/1041759032 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0edc15cd50 0x7f0edc1522f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:22.100 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.091+0000 7f0edb7fe700 1 -- 172.21.15.57:0/1041759032 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ecc009420 con 0x7f0edc14fd10 2023-10-06T03:01:22.100 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.091+0000 7f0edbfff700 1 --2- 172.21.15.57:0/1041759032 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0edc15cd50 0x7f0edc1522f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:01:22.101 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.091+0000 7f0edb7fe700 1 --2- 172.21.15.57:0/1041759032 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0edc14fd10 0x7f0edc0b4900 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc016000 tx=0x7f0ecc017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:22.101 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.091+0000 7f0ed37fe700 1 -- 172.21.15.57:0/1041759032 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ecc000d10 con 0x7f0edc14fd10 2023-10-06T03:01:22.101 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.091+0000 7f0ed37fe700 1 -- 172.21.15.57:0/1041759032 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ecc011b10 con 0x7f0edc14fd10 2023-10-06T03:01:22.101 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.091+0000 7f0ee1b45700 1 -- 172.21.15.57:0/1041759032 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0edc0b5280 con 0x7f0edc14fd10 2023-10-06T03:01:22.101 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.091+0000 7f0ed37fe700 1 -- 172.21.15.57:0/1041759032 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ecc025620 con 0x7f0edc14fd10 2023-10-06T03:01:22.101 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.091+0000 7f0ee1b45700 1 -- 172.21.15.57:0/1041759032 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0edc0b5840 con 0x7f0edc14fd10 2023-10-06T03:01:22.101 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.095+0000 7f0ee1b45700 1 -- 172.21.15.57:0/1041759032 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0edc0712e0 con 0x7f0edc14fd10 2023-10-06T03:01:22.102 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.095+0000 7f0ed37fe700 1 -- 172.21.15.57:0/1041759032 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f0ecc02e450 con 0x7f0edc14fd10 2023-10-06T03:01:22.103 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.099+0000 7f0ed37fe700 1 --2- 172.21.15.57:0/1041759032 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f0ebc060620 0x7f0ebc062ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:22.103 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.099+0000 7f0ed37fe700 1 -- 172.21.15.57:0/1041759032 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0ecc07dfa0 con 0x7f0edc14fd10 2023-10-06T03:01:22.104 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.099+0000 7f0ed3fff700 1 --2- 172.21.15.57:0/1041759032 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f0ebc060620 0x7f0ebc062ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:22.104 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.099+0000 7f0ed3fff700 1 --2- 172.21.15.57:0/1041759032 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f0ebc060620 0x7f0ebc062ad0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f0edc15c0e0 tx=0x7f0ec4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:22.111 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.107+0000 7f0ed37fe700 1 -- 172.21.15.57:0/1041759032 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f0ecc04e410 con 0x7f0edc14fd10 2023-10-06T03:01:22.283 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.279+0000 7f0ee1b45700 1 -- 172.21.15.57:0/1041759032 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0edc06aa20 con 0x7f0edc14fd10 2023-10-06T03:01:22.284 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.279+0000 7f0ed37fe700 1 -- 172.21.15.57:0/1041759032 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0ecc051a30 con 0x7f0edc14fd10 2023-10-06T03:01:22.284 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2023-10-06T03:01:22.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.283+0000 7f0ee1b45700 1 -- 172.21.15.57:0/1041759032 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f0ebc060620 msgr2=0x7f0ebc062ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:22.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.283+0000 7f0ee1b45700 1 --2- 172.21.15.57:0/1041759032 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f0ebc060620 0x7f0ebc062ad0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f0edc15c0e0 tx=0x7f0ec4009040 comp rx=0 tx=0).stop 2023-10-06T03:01:22.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.283+0000 7f0ee1b45700 1 -- 172.21.15.57:0/1041759032 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0edc14fd10 msgr2=0x7f0edc0b4900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:22.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.283+0000 7f0ee1b45700 1 --2- 172.21.15.57:0/1041759032 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0edc14fd10 0x7f0edc0b4900 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc016000 tx=0x7f0ecc017000 comp rx=0 tx=0).stop 2023-10-06T03:01:22.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.283+0000 7f0ee1b45700 1 -- 172.21.15.57:0/1041759032 shutdown_connections 2023-10-06T03:01:22.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.283+0000 7f0ee1b45700 1 --2- 172.21.15.57:0/1041759032 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0edc15cd50 0x7f0edc1522f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:22.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.283+0000 7f0ee1b45700 1 --2- 172.21.15.57:0/1041759032 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f0ebc060620 0x7f0ebc062ad0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:22.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.283+0000 7f0ee1b45700 1 --2- 172.21.15.57:0/1041759032 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0edc1501b0 0x7f0edc150920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:22.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.283+0000 7f0ee1b45700 1 --2- 172.21.15.57:0/1041759032 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0edc14fd10 0x7f0edc0b4900 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:22.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.283+0000 7f0ee1b45700 1 -- 172.21.15.57:0/1041759032 >> 172.21.15.57:0/1041759032 conn(0x7f0edc0ccbc0 msgr2=0x7f0edc14f400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:22.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.283+0000 7f0ee1b45700 1 -- 172.21.15.57:0/1041759032 shutdown_connections 2023-10-06T03:01:22.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.283+0000 7f0ee1b45700 1 -- 172.21.15.57:0/1041759032 wait complete. 2023-10-06T03:01:22.305 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T03:01:22.472 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.467+0000 7fe485785700 1 Processor -- start 2023-10-06T03:01:22.472 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.467+0000 7fe485785700 1 -- start start 2023-10-06T03:01:22.474 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.467+0000 7fe485785700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fe4801501b0 0x7fe4800cb700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:22.475 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.467+0000 7fe485785700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4800cbc40 con 0x7fe48015cd50 2023-10-06T03:01:22.475 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.471+0000 7fe485785700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe48006afb0 con 0x7fe48014fd10 2023-10-06T03:01:22.475 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.471+0000 7fe485785700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe48006e300 con 0x7fe4801501b0 2023-10-06T03:01:22.475 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.471+0000 7fe47effd700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fe48015cd50 0x7fe48015d120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:33320/0 (socket says 172.21.15.57:33320) 2023-10-06T03:01:22.475 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.471+0000 7fe47effd700 1 -- 172.21.15.57:0/2869089740 learned_addr learned my addr 172.21.15.57:0/2869089740 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:01:22.475 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.471+0000 7fe47f7fe700 1 --2- 172.21.15.57:0/2869089740 >> v2:172.21.15.105:3300/0 conn(0x7fe4801501b0 0x7fe4800cb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:22.476 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.471+0000 7fe47dffb700 1 -- 172.21.15.57:0/2869089740 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 92923758 0 0) 0x7fe4800cbc40 con 0x7fe48015cd50 2023-10-06T03:01:22.476 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.471+0000 7fe47dffb700 1 -- 172.21.15.57:0/2869089740 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe468003570 con 0x7fe48015cd50 2023-10-06T03:01:22.477 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.471+0000 7fe47dffb700 1 -- 172.21.15.57:0/2869089740 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4226412087 0 0) 0x7fe48006afb0 con 0x7fe48014fd10 2023-10-06T03:01:22.477 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.471+0000 7fe47f7fe700 1 -- 172.21.15.57:0/2869089740 >> v1:172.21.15.105:6789/0 conn(0x7fe48014fd10 legacy=0x7fe48006c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:22.477 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.471+0000 7fe47f7fe700 1 -- 172.21.15.57:0/2869089740 >> v1:172.21.15.57:6789/0 conn(0x7fe48015cd50 legacy=0x7fe48015d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:22.477 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.471+0000 7fe47f7fe700 1 -- 172.21.15.57:0/2869089740 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe48006b290 con 0x7fe4801501b0 2023-10-06T03:01:22.477 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.471+0000 7fe47f7fe700 1 --2- 172.21.15.57:0/2869089740 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe4801501b0 0x7fe4800cb700 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe478009e60 tx=0x7fe478009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a1c9535249d7bed8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:22.478 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.471+0000 7fe47dffb700 1 -- 172.21.15.57:0/2869089740 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe47800e070 con 0x7fe4801501b0 2023-10-06T03:01:22.478 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.471+0000 7fe47dffb700 1 -- 172.21.15.57:0/2869089740 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe47800bb60 con 0x7fe4801501b0 2023-10-06T03:01:22.479 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.471+0000 7fe47dffb700 1 -- 172.21.15.57:0/2869089740 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe478012430 con 0x7fe4801501b0 2023-10-06T03:01:22.479 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.475+0000 7fe485785700 1 -- 172.21.15.57:0/2869089740 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe4801501b0 msgr2=0x7fe4800cb700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:22.480 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.475+0000 7fe485785700 1 --2- 172.21.15.57:0/2869089740 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe4801501b0 0x7fe4800cb700 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe478009e60 tx=0x7fe478009780 comp rx=0 tx=0).stop 2023-10-06T03:01:22.480 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.475+0000 7fe485785700 1 -- 172.21.15.57:0/2869089740 shutdown_connections 2023-10-06T03:01:22.480 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.475+0000 7fe485785700 1 --2- 172.21.15.57:0/2869089740 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe4801501b0 0x7fe4800cb700 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:22.480 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.475+0000 7fe485785700 1 -- 172.21.15.57:0/2869089740 >> 172.21.15.57:0/2869089740 conn(0x7fe4800ccbc0 msgr2=0x7fe4800ccfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:22.480 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.475+0000 7fe485785700 1 -- 172.21.15.57:0/2869089740 shutdown_connections 2023-10-06T03:01:22.480 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.475+0000 7fe485785700 1 -- 172.21.15.57:0/2869089740 wait complete. 2023-10-06T03:01:22.481 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.475+0000 7fe485785700 1 Processor -- start 2023-10-06T03:01:22.482 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.475+0000 7fe485785700 1 -- start start 2023-10-06T03:01:22.483 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.479+0000 7fe485785700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe48014fd10 0x7fe480154770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:22.483 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.479+0000 7fe485785700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe4801501b0 0x7fe48014f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:22.483 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.479+0000 7fe485785700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe48015cd50 0x7fe48015ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:22.484 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.479+0000 7fe485785700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4800c9950 con 0x7fe4801501b0 2023-10-06T03:01:22.484 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.479+0000 7fe485785700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe480154cb0 con 0x7fe48015cd50 2023-10-06T03:01:22.484 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.479+0000 7fe485785700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4800c8d40 con 0x7fe48014fd10 2023-10-06T03:01:22.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.479+0000 7fe47e7fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe4801501b0 0x7fe48014f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:22.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.479+0000 7fe47e7fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe4801501b0 0x7fe48014f530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55504/0 (socket says 172.21.15.57:55504) 2023-10-06T03:01:22.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.479+0000 7fe47e7fc700 1 -- 172.21.15.57:0/284215487 learned_addr learned my addr 172.21.15.57:0/284215487 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:22.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.479+0000 7fe47f7fe700 1 --2- 172.21.15.57:0/284215487 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe48015cd50 0x7fe48015ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:22.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.479+0000 7fe47effd700 1 --2- 172.21.15.57:0/284215487 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe48014fd10 0x7fe480154770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:22.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.479+0000 7fe47e7fc700 1 -- 172.21.15.57:0/284215487 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe48014fd10 msgr2=0x7fe480154770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:22.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.479+0000 7fe47e7fc700 1 --2- 172.21.15.57:0/284215487 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe48014fd10 0x7fe480154770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:22.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.479+0000 7fe47e7fc700 1 -- 172.21.15.57:0/284215487 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe48015cd50 msgr2=0x7fe48015ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:22.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.479+0000 7fe47e7fc700 1 --2- 172.21.15.57:0/284215487 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe48015cd50 0x7fe48015ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:22.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.479+0000 7fe47e7fc700 1 -- 172.21.15.57:0/284215487 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe478009a20 con 0x7fe4801501b0 2023-10-06T03:01:22.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.479+0000 7fe47f7fe700 1 --2- 172.21.15.57:0/284215487 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe48015cd50 0x7fe48015ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:22.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.479+0000 7fe47effd700 1 --2- 172.21.15.57:0/284215487 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe48014fd10 0x7fe480154770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:22.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.479+0000 7fe47e7fc700 1 --2- 172.21.15.57:0/284215487 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe4801501b0 0x7fe48014f530 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe47400c530 tx=0x7fe47400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:22.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.479+0000 7fe466ffd700 1 -- 172.21.15.57:0/284215487 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe474011590 con 0x7fe4801501b0 2023-10-06T03:01:22.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.479+0000 7fe466ffd700 1 -- 172.21.15.57:0/284215487 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4740116f0 con 0x7fe4801501b0 2023-10-06T03:01:22.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.479+0000 7fe466ffd700 1 -- 172.21.15.57:0/284215487 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe474011ab0 con 0x7fe4801501b0 2023-10-06T03:01:22.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.479+0000 7fe485785700 1 -- 172.21.15.57:0/284215487 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4800c9020 con 0x7fe4801501b0 2023-10-06T03:01:22.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.479+0000 7fe485785700 1 -- 172.21.15.57:0/284215487 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4800c95e0 con 0x7fe4801501b0 2023-10-06T03:01:22.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.483+0000 7fe485785700 1 -- 172.21.15.57:0/284215487 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4800c9b00 con 0x7fe4801501b0 2023-10-06T03:01:22.489 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.483+0000 7fe466ffd700 1 -- 172.21.15.57:0/284215487 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fe47401b3b0 con 0x7fe4801501b0 2023-10-06T03:01:22.491 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.487+0000 7fe466ffd700 1 --2- 172.21.15.57:0/284215487 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fe46c060580 0x7fe46c062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:22.491 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.487+0000 7fe466ffd700 1 -- 172.21.15.57:0/284215487 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe47407bf20 con 0x7fe4801501b0 2023-10-06T03:01:22.491 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.487+0000 7fe47effd700 1 --2- 172.21.15.57:0/284215487 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fe46c060580 0x7fe46c062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:22.492 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.487+0000 7fe47effd700 1 --2- 172.21.15.57:0/284215487 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fe46c060580 0x7fe46c062a30 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe4700058d0 tx=0x7fe470009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:22.499 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.495+0000 7fe466ffd700 1 -- 172.21.15.57:0/284215487 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fe4800c9b00 con 0x7fe4801501b0 2023-10-06T03:01:22.671 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.667+0000 7fe485785700 1 -- 172.21.15.57:0/284215487 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe4800c9a90 con 0x7fe4801501b0 2023-10-06T03:01:22.672 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.667+0000 7fe466ffd700 1 -- 172.21.15.57:0/284215487 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe4740170a0 con 0x7fe4801501b0 2023-10-06T03:01:22.673 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2023-10-06T03:01:22.675 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.671+0000 7fe485785700 1 -- 172.21.15.57:0/284215487 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fe46c060580 msgr2=0x7fe46c062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:22.676 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.671+0000 7fe485785700 1 --2- 172.21.15.57:0/284215487 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fe46c060580 0x7fe46c062a30 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe4700058d0 tx=0x7fe470009040 comp rx=0 tx=0).stop 2023-10-06T03:01:22.676 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.671+0000 7fe485785700 1 -- 172.21.15.57:0/284215487 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe4801501b0 msgr2=0x7fe48014f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:22.676 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.671+0000 7fe485785700 1 --2- 172.21.15.57:0/284215487 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe4801501b0 0x7fe48014f530 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe47400c530 tx=0x7fe47400c8f0 comp rx=0 tx=0).stop 2023-10-06T03:01:22.676 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.671+0000 7fe485785700 1 -- 172.21.15.57:0/284215487 shutdown_connections 2023-10-06T03:01:22.676 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.671+0000 7fe485785700 1 --2- 172.21.15.57:0/284215487 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe48015cd50 0x7fe48015ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:22.676 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.671+0000 7fe485785700 1 --2- 172.21.15.57:0/284215487 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe4801501b0 0x7fe48014f530 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:22.676 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.671+0000 7fe485785700 1 --2- 172.21.15.57:0/284215487 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fe46c060580 0x7fe46c062a30 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:22.676 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.671+0000 7fe485785700 1 --2- 172.21.15.57:0/284215487 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe48014fd10 0x7fe480154770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:22.676 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.671+0000 7fe485785700 1 -- 172.21.15.57:0/284215487 >> 172.21.15.57:0/284215487 conn(0x7fe4800ccbc0 msgr2=0x7fe48006c920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:22.676 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.671+0000 7fe485785700 1 -- 172.21.15.57:0/284215487 shutdown_connections 2023-10-06T03:01:22.677 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.671+0000 7fe485785700 1 -- 172.21.15.57:0/284215487 wait complete. 2023-10-06T03:01:22.698 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T03:01:22.866 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.859+0000 7f86a24f0700 1 Processor -- start 2023-10-06T03:01:22.867 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.863+0000 7f86a24f0700 1 -- start start 2023-10-06T03:01:22.869 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.863+0000 7f86a24f0700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f869c1501b0 0x7f869c0cb700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:22.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.863+0000 7f86a24f0700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f869c0cbc40 con 0x7f869c14fd10 2023-10-06T03:01:22.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.863+0000 7f86a24f0700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f869c06afb0 con 0x7f869c15cd50 2023-10-06T03:01:22.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.863+0000 7f86a24f0700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f869c06e300 con 0x7f869c1501b0 2023-10-06T03:01:22.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.863+0000 7f86937fe700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f869c14fd10 0x7f869c06c920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:33326/0 (socket says 172.21.15.57:33326) 2023-10-06T03:01:22.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.863+0000 7f86937fe700 1 -- 172.21.15.57:0/2875755426 learned_addr learned my addr 172.21.15.57:0/2875755426 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:01:22.871 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.867+0000 7f86a0a8d700 1 --2- 172.21.15.57:0/2875755426 >> v2:172.21.15.105:3300/0 conn(0x7f869c1501b0 0x7f869c0cb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:22.871 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.867+0000 7f869b7fe700 1 -- 172.21.15.57:0/2875755426 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1200030762 0 0) 0x7f869c06afb0 con 0x7f869c15cd50 2023-10-06T03:01:22.871 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.867+0000 7f869b7fe700 1 -- 172.21.15.57:0/2875755426 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8688003570 con 0x7f869c15cd50 2023-10-06T03:01:22.871 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.867+0000 7f869b7fe700 1 -- 172.21.15.57:0/2875755426 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 543454142 0 0) 0x7f869c0cbc40 con 0x7f869c14fd10 2023-10-06T03:01:22.871 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.867+0000 7f869b7fe700 1 -- 172.21.15.57:0/2875755426 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f869c06afb0 con 0x7f869c14fd10 2023-10-06T03:01:22.872 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.867+0000 7f86a0a8d700 1 -- 172.21.15.57:0/2875755426 >> v1:172.21.15.105:6789/0 conn(0x7f869c15cd50 legacy=0x7f869c15d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:22.872 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.867+0000 7f86a0a8d700 1 -- 172.21.15.57:0/2875755426 >> v1:172.21.15.57:6789/0 conn(0x7f869c14fd10 legacy=0x7f869c06c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:22.872 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.867+0000 7f86a0a8d700 1 -- 172.21.15.57:0/2875755426 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f869c06b290 con 0x7f869c1501b0 2023-10-06T03:01:22.872 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.867+0000 7f86a0a8d700 1 --2- 172.21.15.57:0/2875755426 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f869c1501b0 0x7f869c0cb700 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f86940098e0 tx=0x7f86940091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fbab37715ce172f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:22.873 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.867+0000 7f869b7fe700 1 -- 172.21.15.57:0/2875755426 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8694011630 con 0x7f869c1501b0 2023-10-06T03:01:22.873 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.867+0000 7f869b7fe700 1 -- 172.21.15.57:0/2875755426 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8694011790 con 0x7f869c1501b0 2023-10-06T03:01:22.873 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.867+0000 7f869b7fe700 1 -- 172.21.15.57:0/2875755426 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8694011b30 con 0x7f869c1501b0 2023-10-06T03:01:22.874 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.867+0000 7f86a24f0700 1 -- 172.21.15.57:0/2875755426 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f869c1501b0 msgr2=0x7f869c0cb700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:22.874 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.867+0000 7f86a24f0700 1 --2- 172.21.15.57:0/2875755426 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f869c1501b0 0x7f869c0cb700 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f86940098e0 tx=0x7f86940091a0 comp rx=0 tx=0).stop 2023-10-06T03:01:22.874 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.867+0000 7f86a24f0700 1 -- 172.21.15.57:0/2875755426 shutdown_connections 2023-10-06T03:01:22.874 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.867+0000 7f86a24f0700 1 --2- 172.21.15.57:0/2875755426 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f869c1501b0 0x7f869c0cb700 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:22.875 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.867+0000 7f86a24f0700 1 -- 172.21.15.57:0/2875755426 >> 172.21.15.57:0/2875755426 conn(0x7f869c0ccbc0 msgr2=0x7f869c0ccfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:22.875 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.867+0000 7f86a24f0700 1 -- 172.21.15.57:0/2875755426 shutdown_connections 2023-10-06T03:01:22.875 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.867+0000 7f86a24f0700 1 -- 172.21.15.57:0/2875755426 wait complete. 2023-10-06T03:01:22.876 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.871+0000 7f86a24f0700 1 Processor -- start 2023-10-06T03:01:22.877 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.871+0000 7f86a24f0700 1 -- start start 2023-10-06T03:01:22.879 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.875+0000 7f86a24f0700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f869c14fd10 0x7f869c0b2f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:22.879 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.875+0000 7f86a24f0700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f869c1501b0 0x7f869c14f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:22.879 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.875+0000 7f86a24f0700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f869c15cd50 0x7f869c0cebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:22.879 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.875+0000 7f86a24f0700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f869c0cf790 con 0x7f869c14fd10 2023-10-06T03:01:22.879 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.875+0000 7f86a24f0700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f869c153960 con 0x7f869c15cd50 2023-10-06T03:01:22.879 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.875+0000 7f86a24f0700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f869c155870 con 0x7f869c1501b0 2023-10-06T03:01:22.880 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.875+0000 7f869bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f869c14fd10 0x7f869c0b2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:22.880 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.875+0000 7f869bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f869c14fd10 0x7f869c0b2f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55514/0 (socket says 172.21.15.57:55514) 2023-10-06T03:01:22.880 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.875+0000 7f869bfff700 1 -- 172.21.15.57:0/1992022536 learned_addr learned my addr 172.21.15.57:0/1992022536 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:22.880 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.875+0000 7f86937fe700 1 --2- 172.21.15.57:0/1992022536 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f869c1501b0 0x7f869c14f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:22.881 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.875+0000 7f86a0a8d700 1 --2- 172.21.15.57:0/1992022536 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f869c15cd50 0x7f869c0cebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:22.881 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.875+0000 7f869bfff700 1 -- 172.21.15.57:0/1992022536 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f869c1501b0 msgr2=0x7f869c14f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:22.881 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.875+0000 7f869bfff700 1 --2- 172.21.15.57:0/1992022536 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f869c1501b0 0x7f869c14f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:22.881 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.875+0000 7f869bfff700 1 -- 172.21.15.57:0/1992022536 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f869c15cd50 msgr2=0x7f869c0cebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:22.881 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.875+0000 7f869bfff700 1 --2- 172.21.15.57:0/1992022536 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f869c15cd50 0x7f869c0cebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:22.881 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.875+0000 7f869bfff700 1 -- 172.21.15.57:0/1992022536 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8694009420 con 0x7f869c14fd10 2023-10-06T03:01:22.881 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.875+0000 7f86937fe700 1 --2- 172.21.15.57:0/1992022536 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f869c1501b0 0x7f869c14f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:22.881 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.875+0000 7f86a0a8d700 1 --2- 172.21.15.57:0/1992022536 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f869c15cd50 0x7f869c0cebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:22.881 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.875+0000 7f869bfff700 1 --2- 172.21.15.57:0/1992022536 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f869c14fd10 0x7f869c0b2f20 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f868c00cb70 tx=0x7f868c002820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:22.882 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.875+0000 7f8698ff9700 1 -- 172.21.15.57:0/1992022536 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f868c00a7a0 con 0x7f869c14fd10 2023-10-06T03:01:22.882 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.875+0000 7f8698ff9700 1 -- 172.21.15.57:0/1992022536 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f868c00a900 con 0x7f869c14fd10 2023-10-06T03:01:22.882 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.875+0000 7f86a24f0700 1 -- 172.21.15.57:0/1992022536 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f869c154f40 con 0x7f869c14fd10 2023-10-06T03:01:22.882 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.875+0000 7f8698ff9700 1 -- 172.21.15.57:0/1992022536 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f868c00ac80 con 0x7f869c14fd10 2023-10-06T03:01:22.882 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.875+0000 7f86a24f0700 1 -- 172.21.15.57:0/1992022536 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f869c155500 con 0x7f869c14fd10 2023-10-06T03:01:22.883 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.879+0000 7f86a24f0700 1 -- 172.21.15.57:0/1992022536 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f869c0712e0 con 0x7f869c14fd10 2023-10-06T03:01:22.885 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.879+0000 7f8698ff9700 1 -- 172.21.15.57:0/1992022536 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f868c012630 con 0x7f869c14fd10 2023-10-06T03:01:22.887 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.883+0000 7f8698ff9700 1 --2- 172.21.15.57:0/1992022536 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f867c060550 0x7f867c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:22.887 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.883+0000 7f8698ff9700 1 -- 172.21.15.57:0/1992022536 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f868c07cdb0 con 0x7f869c14fd10 2023-10-06T03:01:22.887 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.883+0000 7f86937fe700 1 --2- 172.21.15.57:0/1992022536 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f867c060550 0x7f867c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:22.888 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.883+0000 7f86937fe700 1 --2- 172.21.15.57:0/1992022536 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f867c060550 0x7f867c062a00 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f86840058d0 tx=0x7f8684009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:22.893 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:22.887+0000 7f8698ff9700 1 -- 172.21.15.57:0/1992022536 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f868c081070 con 0x7f869c14fd10 2023-10-06T03:01:23.064 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.059+0000 7f86a24f0700 1 -- 172.21.15.57:0/1992022536 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f869c06b570 con 0x7f869c14fd10 2023-10-06T03:01:23.066 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.059+0000 7f8698ff9700 1 -- 172.21.15.57:0/1992022536 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f868c04d1a0 con 0x7f869c14fd10 2023-10-06T03:01:23.066 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2023-10-06T03:01:23.068 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.063+0000 7f86a24f0700 1 -- 172.21.15.57:0/1992022536 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f867c060550 msgr2=0x7f867c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:23.068 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.063+0000 7f86a24f0700 1 --2- 172.21.15.57:0/1992022536 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f867c060550 0x7f867c062a00 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f86840058d0 tx=0x7f8684009040 comp rx=0 tx=0).stop 2023-10-06T03:01:23.068 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.063+0000 7f86a24f0700 1 -- 172.21.15.57:0/1992022536 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f869c14fd10 msgr2=0x7f869c0b2f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:23.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.063+0000 7f86a24f0700 1 --2- 172.21.15.57:0/1992022536 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f869c14fd10 0x7f869c0b2f20 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f868c00cb70 tx=0x7f868c002820 comp rx=0 tx=0).stop 2023-10-06T03:01:23.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.063+0000 7f86a24f0700 1 -- 172.21.15.57:0/1992022536 shutdown_connections 2023-10-06T03:01:23.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.063+0000 7f86a24f0700 1 --2- 172.21.15.57:0/1992022536 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f869c15cd50 0x7f869c0cebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:23.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.063+0000 7f86a24f0700 1 --2- 172.21.15.57:0/1992022536 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f867c060550 0x7f867c062a00 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:23.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.063+0000 7f86a24f0700 1 --2- 172.21.15.57:0/1992022536 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f869c1501b0 0x7f869c14f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:23.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.063+0000 7f86a24f0700 1 --2- 172.21.15.57:0/1992022536 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f869c14fd10 0x7f869c0b2f20 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:23.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.063+0000 7f86a24f0700 1 -- 172.21.15.57:0/1992022536 >> 172.21.15.57:0/1992022536 conn(0x7f869c0ccbc0 msgr2=0x7f869c0b1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:23.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.063+0000 7f86a24f0700 1 -- 172.21.15.57:0/1992022536 shutdown_connections 2023-10-06T03:01:23.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.063+0000 7f86a24f0700 1 -- 172.21.15.57:0/1992022536 wait complete. 2023-10-06T03:01:23.088 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T03:01:23.256 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.251+0000 7f7691ca5700 1 Processor -- start 2023-10-06T03:01:23.256 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.251+0000 7f7691ca5700 1 -- start start 2023-10-06T03:01:23.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.255+0000 7f7691ca5700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f768c0c7160 0x7f768c06b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:23.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.255+0000 7f7691ca5700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f768c0ac530 con 0x7f768c0bef40 2023-10-06T03:01:23.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.255+0000 7f7691ca5700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f768c06bed0 con 0x7f768c0bf310 2023-10-06T03:01:23.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.255+0000 7f7691ca5700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f768c06dc60 con 0x7f768c0c7160 2023-10-06T03:01:23.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.255+0000 7f768b7fe700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f768c0bef40 0x7f768c0c6a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:33342/0 (socket says 172.21.15.57:33342) 2023-10-06T03:01:23.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.255+0000 7f768b7fe700 1 -- 172.21.15.57:0/378282376 learned_addr learned my addr 172.21.15.57:0/378282376 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:01:23.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.255+0000 7f768affd700 1 --2- 172.21.15.57:0/378282376 >> v2:172.21.15.105:3300/0 conn(0x7f768c0c7160 0x7f768c06b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:23.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.255+0000 7f768a7fc700 1 -- 172.21.15.57:0/378282376 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4266662912 0 0) 0x7f768c0ac530 con 0x7f768c0bef40 2023-10-06T03:01:23.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.255+0000 7f768a7fc700 1 -- 172.21.15.57:0/378282376 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7674003570 con 0x7f768c0bef40 2023-10-06T03:01:23.261 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.255+0000 7f768affd700 1 -- 172.21.15.57:0/378282376 >> v1:172.21.15.105:6789/0 conn(0x7f768c0bf310 legacy=0x7f768c0ac9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:23.261 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.255+0000 7f768a7fc700 1 -- 172.21.15.57:0/378282376 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1951155616 0 0) 0x7f768c06bed0 con 0x7f768c0bf310 2023-10-06T03:01:23.261 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.255+0000 7f768affd700 1 -- 172.21.15.57:0/378282376 >> v1:172.21.15.57:6789/0 conn(0x7f768c0bef40 legacy=0x7f768c0c6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:23.261 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.255+0000 7f768affd700 1 -- 172.21.15.57:0/378282376 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f768c06c1b0 con 0x7f768c0c7160 2023-10-06T03:01:23.262 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.255+0000 7f768affd700 1 --2- 172.21.15.57:0/378282376 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f768c0c7160 0x7f768c06b2a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f76800098e0 tx=0x7f76800091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c39c6ec3980f1a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:23.262 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.255+0000 7f768a7fc700 1 -- 172.21.15.57:0/378282376 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f768000b6d0 con 0x7f768c0c7160 2023-10-06T03:01:23.262 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.255+0000 7f768a7fc700 1 -- 172.21.15.57:0/378282376 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f768000b830 con 0x7f768c0c7160 2023-10-06T03:01:23.263 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.259+0000 7f768a7fc700 1 -- 172.21.15.57:0/378282376 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f768000bbd0 con 0x7f768c0c7160 2023-10-06T03:01:23.264 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.259+0000 7f7691ca5700 1 -- 172.21.15.57:0/378282376 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f768c0c7160 msgr2=0x7f768c06b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:23.264 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.259+0000 7f7691ca5700 1 --2- 172.21.15.57:0/378282376 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f768c0c7160 0x7f768c06b2a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f76800098e0 tx=0x7f76800091a0 comp rx=0 tx=0).stop 2023-10-06T03:01:23.264 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.259+0000 7f7691ca5700 1 -- 172.21.15.57:0/378282376 shutdown_connections 2023-10-06T03:01:23.264 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.259+0000 7f7691ca5700 1 --2- 172.21.15.57:0/378282376 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f768c0c7160 0x7f768c06b2a0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:23.264 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.259+0000 7f7691ca5700 1 -- 172.21.15.57:0/378282376 >> 172.21.15.57:0/378282376 conn(0x7f768c0c87b0 msgr2=0x7f768c0c8bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:23.264 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.259+0000 7f7691ca5700 1 -- 172.21.15.57:0/378282376 shutdown_connections 2023-10-06T03:01:23.264 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.259+0000 7f7691ca5700 1 -- 172.21.15.57:0/378282376 wait complete. 2023-10-06T03:01:23.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.263+0000 7f7691ca5700 1 Processor -- start 2023-10-06T03:01:23.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.263+0000 7f7691ca5700 1 -- start start 2023-10-06T03:01:23.270 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.263+0000 7f7691ca5700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f768c0bef40 0x7f768c15e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:23.270 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.263+0000 7f7691ca5700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f768c0bf310 0x7f768c15e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:23.270 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.263+0000 7f7691ca5700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f768c0c7160 0x7f768c15abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:23.270 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.263+0000 7f7691ca5700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f768c15fe50 con 0x7f768c0bf310 2023-10-06T03:01:23.270 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.263+0000 7f7691ca5700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f768c16df30 con 0x7f768c0c7160 2023-10-06T03:01:23.270 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.263+0000 7f7691ca5700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f768c1600d0 con 0x7f768c0bef40 2023-10-06T03:01:23.270 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.263+0000 7f768affd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f768c0bf310 0x7f768c15e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:23.270 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.263+0000 7f768affd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f768c0bf310 0x7f768c15e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55516/0 (socket says 172.21.15.57:55516) 2023-10-06T03:01:23.270 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.263+0000 7f768affd700 1 -- 172.21.15.57:0/1664973099 learned_addr learned my addr 172.21.15.57:0/1664973099 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:23.272 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.263+0000 7f768b7fe700 1 --2- 172.21.15.57:0/1664973099 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f768c0bef40 0x7f768c15e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:23.272 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.263+0000 7f768bfff700 1 --2- 172.21.15.57:0/1664973099 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f768c0c7160 0x7f768c15abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:23.272 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.267+0000 7f768affd700 1 -- 172.21.15.57:0/1664973099 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f768c0bef40 msgr2=0x7f768c15e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:23.272 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.267+0000 7f768affd700 1 --2- 172.21.15.57:0/1664973099 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f768c0bef40 0x7f768c15e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:23.272 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.267+0000 7f768affd700 1 -- 172.21.15.57:0/1664973099 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f768c0c7160 msgr2=0x7f768c15abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:23.272 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.267+0000 7f768affd700 1 --2- 172.21.15.57:0/1664973099 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f768c0c7160 0x7f768c15abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:23.272 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.267+0000 7f768affd700 1 -- 172.21.15.57:0/1664973099 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7680009420 con 0x7f768c0bf310 2023-10-06T03:01:23.272 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.267+0000 7f768bfff700 1 --2- 172.21.15.57:0/1664973099 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f768c0c7160 0x7f768c15abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:01:23.272 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.267+0000 7f768affd700 1 --2- 172.21.15.57:0/1664973099 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f768c0bf310 0x7f768c15e680 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f76800093f0 tx=0x7f7680017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:23.272 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.267+0000 7f76737fe700 1 -- 172.21.15.57:0/1664973099 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f768001f070 con 0x7f768c0bf310 2023-10-06T03:01:23.273 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.267+0000 7f76737fe700 1 -- 172.21.15.57:0/1664973099 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7680000c90 con 0x7f768c0bf310 2023-10-06T03:01:23.273 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.267+0000 7f7691ca5700 1 -- 172.21.15.57:0/1664973099 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f768c1603b0 con 0x7f768c0bf310 2023-10-06T03:01:23.273 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.267+0000 7f76737fe700 1 -- 172.21.15.57:0/1664973099 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7680025420 con 0x7f768c0bf310 2023-10-06T03:01:23.273 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.267+0000 7f7691ca5700 1 -- 172.21.15.57:0/1664973099 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f768c160bb0 con 0x7f768c0bf310 2023-10-06T03:01:23.273 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.267+0000 7f7691ca5700 1 -- 172.21.15.57:0/1664973099 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f768c160e60 con 0x7f768c0bf310 2023-10-06T03:01:23.275 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.271+0000 7f76737fe700 1 -- 172.21.15.57:0/1664973099 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f7680023070 con 0x7f768c0bf310 2023-10-06T03:01:23.276 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.271+0000 7f76737fe700 1 --2- 172.21.15.57:0/1664973099 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f7678060550 0x7f7678062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:23.276 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.271+0000 7f76737fe700 1 -- 172.21.15.57:0/1664973099 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f768007da20 con 0x7f768c0bf310 2023-10-06T03:01:23.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.271+0000 7f768b7fe700 1 --2- 172.21.15.57:0/1664973099 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f7678060550 0x7f7678062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:23.278 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.271+0000 7f768b7fe700 1 --2- 172.21.15.57:0/1664973099 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f7678060550 0x7f7678062a00 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f767c0058d0 tx=0x7f767c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:23.281 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.275+0000 7f76737fe700 1 -- 172.21.15.57:0/1664973099 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f768004de10 con 0x7f768c0bf310 2023-10-06T03:01:23.452 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.447+0000 7f7691ca5700 1 -- 172.21.15.57:0/1664973099 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f768c0712e0 con 0x7f768c0bf310 2023-10-06T03:01:23.453 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.447+0000 7f76737fe700 1 -- 172.21.15.57:0/1664973099 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f76800150a0 con 0x7f768c0bf310 2023-10-06T03:01:23.453 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 64 2023-10-06T03:01:23.456 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.451+0000 7f7691ca5700 1 -- 172.21.15.57:0/1664973099 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f7678060550 msgr2=0x7f7678062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:23.456 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.451+0000 7f7691ca5700 1 --2- 172.21.15.57:0/1664973099 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f7678060550 0x7f7678062a00 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f767c0058d0 tx=0x7f767c009040 comp rx=0 tx=0).stop 2023-10-06T03:01:23.456 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.451+0000 7f7691ca5700 1 -- 172.21.15.57:0/1664973099 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f768c0bf310 msgr2=0x7f768c15e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:23.456 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.451+0000 7f7691ca5700 1 --2- 172.21.15.57:0/1664973099 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f768c0bf310 0x7f768c15e680 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f76800093f0 tx=0x7f7680017000 comp rx=0 tx=0).stop 2023-10-06T03:01:23.457 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.451+0000 7f7691ca5700 1 -- 172.21.15.57:0/1664973099 shutdown_connections 2023-10-06T03:01:23.457 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.451+0000 7f7691ca5700 1 --2- 172.21.15.57:0/1664973099 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f768c0c7160 0x7f768c15abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:23.457 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.451+0000 7f7691ca5700 1 --2- 172.21.15.57:0/1664973099 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f768c0bf310 0x7f768c15e680 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:23.457 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.451+0000 7f7691ca5700 1 --2- 172.21.15.57:0/1664973099 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f7678060550 0x7f7678062a00 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:23.457 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.451+0000 7f7691ca5700 1 --2- 172.21.15.57:0/1664973099 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f768c0bef40 0x7f768c15e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:23.457 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.451+0000 7f7691ca5700 1 -- 172.21.15.57:0/1664973099 >> 172.21.15.57:0/1664973099 conn(0x7f768c0c87b0 msgr2=0x7f768c067050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:23.457 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.451+0000 7f7691ca5700 1 -- 172.21.15.57:0/1664973099 shutdown_connections 2023-10-06T03:01:23.457 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.451+0000 7f7691ca5700 1 -- 172.21.15.57:0/1664973099 wait complete. 2023-10-06T03:01:23.477 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:01:23.641 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.635+0000 7f330b46e700 1 Processor -- start 2023-10-06T03:01:23.642 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.635+0000 7f330b46e700 1 -- start start 2023-10-06T03:01:23.644 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.639+0000 7f330b46e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f33040671f0 0x7f33040675c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:23.644 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.639+0000 7f330b46e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f330406da20 con 0x7f330415cee0 2023-10-06T03:01:23.644 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.639+0000 7f330b46e700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33040b0650 con 0x7f330406deb0 2023-10-06T03:01:23.644 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.639+0000 7f330b46e700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f330415ea60 con 0x7f33040671f0 2023-10-06T03:01:23.645 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.639+0000 7f330920a700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f33040671f0 0x7f33040675c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:23.645 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.639+0000 7f330920a700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f33040671f0 0x7f33040675c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55520/0 (socket says 172.21.15.57:55520) 2023-10-06T03:01:23.645 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.639+0000 7f330920a700 1 -- 172.21.15.57:0/2946867502 learned_addr learned my addr 172.21.15.57:0/2946867502 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:23.645 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.639+0000 7f3309a0b700 1 --1- 172.21.15.57:0/2946867502 >> v1:172.21.15.57:6789/0 conn(0x7f330415cee0 0x7f330415d340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:33348/0 (socket says 172.21.15.57:33348) 2023-10-06T03:01:23.645 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.639+0000 7f3308a09700 1 --1- 172.21.15.57:0/2946867502 >> v1:172.21.15.105:6789/0 conn(0x7f330406deb0 0x7f33040aff40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.57:53468/0 (socket says 172.21.15.57:53468) 2023-10-06T03:01:23.646 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.639+0000 7f32fbfff700 1 -- 172.21.15.57:0/2946867502 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 164930546 0 0) 0x7f330406da20 con 0x7f330415cee0 2023-10-06T03:01:23.646 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.639+0000 7f32fbfff700 1 -- 172.21.15.57:0/2946867502 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32f0003570 con 0x7f330415cee0 2023-10-06T03:01:23.646 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.639+0000 7f330920a700 1 -- 172.21.15.57:0/2946867502 >> v1:172.21.15.105:6789/0 conn(0x7f330406deb0 legacy=0x7f33040aff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:23.646 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.639+0000 7f330920a700 1 -- 172.21.15.57:0/2946867502 >> v1:172.21.15.57:6789/0 conn(0x7f330415cee0 legacy=0x7f330415d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:23.646 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.639+0000 7f330920a700 1 -- 172.21.15.57:0/2946867502 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f330406ce10 con 0x7f33040671f0 2023-10-06T03:01:23.647 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.643+0000 7f330920a700 1 --2- 172.21.15.57:0/2946867502 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f33040671f0 0x7f33040675c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f33000099b0 tx=0x7f3300009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0f0debc479d8a5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:23.647 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.643+0000 7f32fbfff700 1 -- 172.21.15.57:0/2946867502 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3300009ea0 con 0x7f33040671f0 2023-10-06T03:01:23.647 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.643+0000 7f32fbfff700 1 -- 172.21.15.57:0/2946867502 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f330000b860 con 0x7f33040671f0 2023-10-06T03:01:23.647 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.643+0000 7f32fbfff700 1 -- 172.21.15.57:0/2946867502 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f330000bc00 con 0x7f33040671f0 2023-10-06T03:01:23.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.643+0000 7f330b46e700 1 -- 172.21.15.57:0/2946867502 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f33040671f0 msgr2=0x7f33040675c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:23.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.643+0000 7f330b46e700 1 --2- 172.21.15.57:0/2946867502 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f33040671f0 0x7f33040675c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f33000099b0 tx=0x7f3300009250 comp rx=0 tx=0).stop 2023-10-06T03:01:23.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.643+0000 7f330b46e700 1 -- 172.21.15.57:0/2946867502 shutdown_connections 2023-10-06T03:01:23.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.643+0000 7f330b46e700 1 --2- 172.21.15.57:0/2946867502 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f33040671f0 0x7f33040675c0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:23.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.643+0000 7f330b46e700 1 -- 172.21.15.57:0/2946867502 >> 172.21.15.57:0/2946867502 conn(0x7f33040cbdd0 msgr2=0x7f33040cc1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:23.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.643+0000 7f330b46e700 1 -- 172.21.15.57:0/2946867502 shutdown_connections 2023-10-06T03:01:23.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.643+0000 7f330b46e700 1 -- 172.21.15.57:0/2946867502 wait complete. 2023-10-06T03:01:23.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.647+0000 7f330b46e700 1 Processor -- start 2023-10-06T03:01:23.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.647+0000 7f330b46e700 1 -- start start 2023-10-06T03:01:23.652 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.647+0000 7f330b46e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f33040671f0 0x7f33040adc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:23.653 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.647+0000 7f330b46e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f330406deb0 0x7f33041606a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:23.653 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.647+0000 7f330b46e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f330415cee0 0x7f3304160be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:23.653 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.647+0000 7f330b46e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3304161fc0 con 0x7f330406deb0 2023-10-06T03:01:23.653 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.647+0000 7f330b46e700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3304161120 con 0x7f33040671f0 2023-10-06T03:01:23.653 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.647+0000 7f330b46e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33041613b0 con 0x7f330415cee0 2023-10-06T03:01:23.653 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.647+0000 7f3308a09700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f330406deb0 0x7f33041606a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:23.654 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.647+0000 7f3308a09700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f330406deb0 0x7f33041606a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55526/0 (socket says 172.21.15.57:55526) 2023-10-06T03:01:23.654 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.647+0000 7f3308a09700 1 -- 172.21.15.57:0/3776842845 learned_addr learned my addr 172.21.15.57:0/3776842845 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:23.654 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.647+0000 7f3309a0b700 1 --2- 172.21.15.57:0/3776842845 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f330415cee0 0x7f3304160be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:23.654 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.647+0000 7f330920a700 1 --2- 172.21.15.57:0/3776842845 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f33040671f0 0x7f33040adc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:23.654 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.647+0000 7f3308a09700 1 -- 172.21.15.57:0/3776842845 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f330415cee0 msgr2=0x7f3304160be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:23.654 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.647+0000 7f3308a09700 1 --2- 172.21.15.57:0/3776842845 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f330415cee0 0x7f3304160be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:23.654 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.647+0000 7f3308a09700 1 -- 172.21.15.57:0/3776842845 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f33040671f0 msgr2=0x7f33040adc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:23.655 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.647+0000 7f3308a09700 1 --2- 172.21.15.57:0/3776842845 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f33040671f0 0x7f33040adc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:23.655 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.647+0000 7f3308a09700 1 -- 172.21.15.57:0/3776842845 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33000094f0 con 0x7f330406deb0 2023-10-06T03:01:23.655 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.647+0000 7f3308a09700 1 --2- 172.21.15.57:0/3776842845 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f330406deb0 0x7f33041606a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f32f400c7c0 tx=0x7f32f4007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:23.655 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.651+0000 7f32f97fa700 1 -- 172.21.15.57:0/3776842845 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f4005a70 con 0x7f330406deb0 2023-10-06T03:01:23.655 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.651+0000 7f32f97fa700 1 -- 172.21.15.57:0/3776842845 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32f4005bd0 con 0x7f330406deb0 2023-10-06T03:01:23.656 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.651+0000 7f330b46e700 1 -- 172.21.15.57:0/3776842845 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3304161690 con 0x7f330406deb0 2023-10-06T03:01:23.656 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.651+0000 7f32f97fa700 1 -- 172.21.15.57:0/3776842845 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f40070d0 con 0x7f330406deb0 2023-10-06T03:01:23.656 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.651+0000 7f330b46e700 1 -- 172.21.15.57:0/3776842845 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3304161c50 con 0x7f330406deb0 2023-10-06T03:01:23.657 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.651+0000 7f330b46e700 1 -- 172.21.15.57:0/3776842845 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33040712e0 con 0x7f330406deb0 2023-10-06T03:01:23.658 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.655+0000 7f32f97fa700 1 -- 172.21.15.57:0/3776842845 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f32f4007480 con 0x7f330406deb0 2023-10-06T03:01:23.660 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.655+0000 7f32f97fa700 1 --2- 172.21.15.57:0/3776842845 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f32e8060550 0x7f32e8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:23.660 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.655+0000 7f32f97fa700 1 -- 172.21.15.57:0/3776842845 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f32f407bce0 con 0x7f330406deb0 2023-10-06T03:01:23.660 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.655+0000 7f330920a700 1 --2- 172.21.15.57:0/3776842845 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f32e8060550 0x7f32e8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:23.661 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.655+0000 7f330920a700 1 --2- 172.21.15.57:0/3776842845 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f32e8060550 0x7f32e8062a00 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f33000099b0 tx=0x7f3300017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:23.666 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.663+0000 7f32f97fa700 1 -- 172.21.15.57:0/3776842845 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f32f404c170 con 0x7f330406deb0 2023-10-06T03:01:23.839 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.835+0000 7f330b46e700 1 -- 172.21.15.57:0/3776842845 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f330406d0f0 con 0x7f330406deb0 2023-10-06T03:01:23.841 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.835+0000 7f32f97fa700 1 -- 172.21.15.57:0/3776842845 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16866 (secure 0 0 0) 0x7f32f404f790 con 0x7f330406deb0 2023-10-06T03:01:23.842 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:01:23.842 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":23,"fsid":"eb56dc0f-9213-41cb-9aad-8ade6c802e98","created":"2023-10-06T03:00:30.806197+0000","modified":"2023-10-06T03:00:58.975366+0000","last_up_change":"2023-10-06T03:00:43.607454+0000","last_in_change":"2023-10-06T03:00:33.943513+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T03:00:44.360651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T03:00:50.466601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:00:55.472586+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T03:00:56.400884+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"58cf6c90-d704-43e0-b2db-dffe526d5e8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":33053},{"type":"v1","addr":"172.21.15.57:6801","nonce":33053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":33053},{"type":"v1","addr":"172.21.15.57:6803","nonce":33053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":33053},{"type":"v1","addr":"172.21.15.57:6807","nonce":33053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":33053},{"type":"v1","addr":"172.21.15.57:6805","nonce":33053}]},"public_addr":"172.21.15.57:6801/33053","cluster_addr":"172.21.15.57:6803/33053","heartbeat_back_addr":"172.21.15.57:6807/33053","heartbeat_front_addr":"172.21.15.57:6805/33053","state":["exists","up"]},{"osd":1,"uuid":"16afbe70-7f9e-4568-9c92-763e6e348119","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6809","nonce":33052},{"type":"v1","addr":"172.21.15.57:6810","nonce":33052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":33052},{"type":"v1","addr":"172.21.15.57:6813","nonce":33052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":33052},{"type":"v1","addr":"172.21.15.57:6822","nonce":33052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6815","nonce":33052},{"type":"v1","addr":"172.21.15.57:6818","nonce":33052}]},"public_addr":"172.21.15.57:6810/33052","cluster_addr":"172.21.15.57:6813/33052","heartbeat_back_addr":"172.21.15.57:6822/33052","heartbeat_front_addr":"172.21.15.57:6818/33052","state":["exists","up"]},{"osd":2,"uuid":"7255c62e-f92f-470f-a5ce-30228920d9f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":33058},{"type":"v1","addr":"172.21.15.57:6825","nonce":33058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":33058},{"type":"v1","addr":"172.21.15.57:6827","nonce":33058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":33058},{"type":"v1","addr":"172.21.15.57:6831","nonce":33058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":33058},{"type":"v1","addr":"172.21.15.57:6829","nonce":33058}]},"public_addr":"172.21.15.57:6825/33058","cluster_addr":"172.21.15.57:6827/33058","heartbeat_back_addr":"172.21.15.57:6831/33058","heartbeat_front_addr":"172.21.15.57:6829/33058","state":["exists","up"]},{"osd":3,"uuid":"152a236d-f799-4888-8544-74865508d5a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":33057},{"type":"v1","addr":"172.21.15.57:6811","nonce":33057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":33057},{"type":"v1","addr":"172.21.15.57:6816","nonce":33057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6821","nonce":33057},{"type":"v1","addr":"172.21.15.57:6823","nonce":33057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6817","nonce":33057},{"type":"v1","addr":"172.21.15.57:6819","nonce":33057}]},"public_addr":"172.21.15.57:6811/33057","cluster_addr":"172.21.15.57:6816/33057","heartbeat_back_addr":"172.21.15.57:6823/33057","heartbeat_front_addr":"172.21.15.57:6819/33057","state":["exists","up"]},{"osd":4,"uuid":"37db2a65-3566-41d0-9d60-e66c49e1e68e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":33368},{"type":"v1","addr":"172.21.15.105:6801","nonce":33368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":33368},{"type":"v1","addr":"172.21.15.105:6803","nonce":33368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":33368},{"type":"v1","addr":"172.21.15.105:6807","nonce":33368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":33368},{"type":"v1","addr":"172.21.15.105:6805","nonce":33368}]},"public_addr":"172.21.15.105:6801/33368","cluster_addr":"172.21.15.105:6803/33368","heartbeat_back_addr":"172.21.15.105:6807/33368","heartbeat_front_addr":"172.21.15.105:6805/33368","state":["exists","up"]},{"osd":5,"uuid":"35e77918-1bb4-42ca-9b20-f3c14eaa0c04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":33379},{"type":"v1","addr":"172.21.15.105:6818","nonce":33379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":33379},{"type":"v1","addr":"172.21.15.105:6823","nonce":33379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":33379},{"type":"v1","addr":"172.21.15.105:6831","nonce":33379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":33379},{"type":"v1","addr":"172.21.15.105:6827","nonce":33379}]},"public_addr":"172.21.15.105:6818/33379","cluster_addr":"172.21.15.105:6823/33379","heartbeat_back_addr":"172.21.15.105:6831/33379","heartbeat_front_addr":"172.21.15.105:6827/33379","state":["exists","up"]},{"osd":6,"uuid":"b4d9d510-7a45-4173-8287-c6c8d6547f2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":33369},{"type":"v1","addr":"172.21.15.105:6819","nonce":33369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":33369},{"type":"v1","addr":"172.21.15.105:6822","nonce":33369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":33369},{"type":"v1","addr":"172.21.15.105:6830","nonce":33369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":33369},{"type":"v1","addr":"172.21.15.105:6826","nonce":33369}]},"public_addr":"172.21.15.105:6819/33369","cluster_addr":"172.21.15.105:6822/33369","heartbeat_back_addr":"172.21.15.105:6830/33369","heartbeat_front_addr":"172.21.15.105:6826/33369","state":["exists","up"]},{"osd":7,"uuid":"74266fb0-cd84-463f-8bf0-092652a71dc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":33370},{"type":"v1","addr":"172.21.15.105:6809","nonce":33370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":33370},{"type":"v1","addr":"172.21.15.105:6811","nonce":33370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":33370},{"type":"v1","addr":"172.21.15.105:6815","nonce":33370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":33370},{"type":"v1","addr":"172.21.15.105:6813","nonce":33370}]},"public_addr":"172.21.15.105:6809/33370","cluster_addr":"172.21.15.105:6811/33370","heartbeat_back_addr":"172.21.15.105:6815/33370","heartbeat_front_addr":"172.21.15.105:6813/33370","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.596864+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.633851+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.636993+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.529681+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.608601+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.659752+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.661717+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.642221+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:01:23.844 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.839+0000 7f330b46e700 1 -- 172.21.15.57:0/3776842845 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f32e8060550 msgr2=0x7f32e8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:23.844 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.839+0000 7f330b46e700 1 --2- 172.21.15.57:0/3776842845 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f32e8060550 0x7f32e8062a00 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f33000099b0 tx=0x7f3300017000 comp rx=0 tx=0).stop 2023-10-06T03:01:23.845 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.839+0000 7f330b46e700 1 -- 172.21.15.57:0/3776842845 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f330406deb0 msgr2=0x7f33041606a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:23.845 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.839+0000 7f330b46e700 1 --2- 172.21.15.57:0/3776842845 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f330406deb0 0x7f33041606a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f32f400c7c0 tx=0x7f32f4007f70 comp rx=0 tx=0).stop 2023-10-06T03:01:23.845 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.839+0000 7f330b46e700 1 -- 172.21.15.57:0/3776842845 shutdown_connections 2023-10-06T03:01:23.845 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.839+0000 7f330b46e700 1 --2- 172.21.15.57:0/3776842845 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f32e8060550 0x7f32e8062a00 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:23.845 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.839+0000 7f330b46e700 1 --2- 172.21.15.57:0/3776842845 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f330415cee0 0x7f3304160be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:23.845 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.839+0000 7f330b46e700 1 --2- 172.21.15.57:0/3776842845 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f330406deb0 0x7f33041606a0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:23.845 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.839+0000 7f330b46e700 1 --2- 172.21.15.57:0/3776842845 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f33040671f0 0x7f33040adc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:23.845 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.839+0000 7f330b46e700 1 -- 172.21.15.57:0/3776842845 >> 172.21.15.57:0/3776842845 conn(0x7f33040cbdd0 msgr2=0x7f3304157740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:23.846 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.839+0000 7f330b46e700 1 -- 172.21.15.57:0/3776842845 shutdown_connections 2023-10-06T03:01:23.846 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:23.839+0000 7f330b46e700 1 -- 172.21.15.57:0/3776842845 wait complete. 2023-10-06T03:01:23.867 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T03:00:44.360651+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T03:00:50.466601+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T03:00:55.472586+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T03:00:56.400884+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T03:01:23.868 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T03:01:24.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.027+0000 7f5db4aae700 1 Processor -- start 2023-10-06T03:01:24.032 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.027+0000 7f5db4aae700 1 -- start start 2023-10-06T03:01:24.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.031+0000 7f5db4aae700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5db006b6b0 0x7f5db00c7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:24.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.031+0000 7f5db4aae700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5db0158d00 0x7f5db0159180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:24.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.031+0000 7f5db4aae700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5db00c7bc0 con 0x7f5db006b2e0 2023-10-06T03:01:24.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.031+0000 7f5db4aae700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5db00c8180 con 0x7f5db0158d00 2023-10-06T03:01:24.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.031+0000 7f5db4aae700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5db006bb00 con 0x7f5db006b6b0 2023-10-06T03:01:24.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.031+0000 7f5daed9d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5db0158d00 0x7f5db0159180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:24.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.031+0000 7f5daed9d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5db0158d00 0x7f5db0159180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55540/0 (socket says 172.21.15.57:55540) 2023-10-06T03:01:24.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.031+0000 7f5daed9d700 1 -- 172.21.15.57:0/3102624602 learned_addr learned my addr 172.21.15.57:0/3102624602 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:24.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.031+0000 7f5dadd9b700 1 --2- 172.21.15.57:0/3102624602 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5db006b6b0 0x7f5db00c7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:24.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.031+0000 7f5daed9d700 1 -- 172.21.15.57:0/3102624602 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5db006b6b0 msgr2=0x7f5db00c7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:24.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.031+0000 7f5daed9d700 1 --2- 172.21.15.57:0/3102624602 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5db006b6b0 0x7f5db00c7520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:24.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.031+0000 7f5daed9d700 1 -- 172.21.15.57:0/3102624602 >> v1:172.21.15.105:6789/0 conn(0x7f5db006b2e0 legacy=0x7f5db006c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:24.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.031+0000 7f5daed9d700 1 -- 172.21.15.57:0/3102624602 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5db006e2d0 con 0x7f5db0158d00 2023-10-06T03:01:24.038 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.031+0000 7f5daed9d700 1 --2- 172.21.15.57:0/3102624602 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5db0158d00 0x7f5db0159180 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f5da8009f50 tx=0x7f5da8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0080ceb80f30054 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:24.038 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.031+0000 7f5dad59a700 1 -- 172.21.15.57:0/3102624602 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5da800e070 con 0x7f5db0158d00 2023-10-06T03:01:24.038 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.031+0000 7f5dad59a700 1 -- 172.21.15.57:0/3102624602 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5da800b9c0 con 0x7f5db0158d00 2023-10-06T03:01:24.038 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.031+0000 7f5dad59a700 1 -- 172.21.15.57:0/3102624602 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5da80092e0 con 0x7f5db0158d00 2023-10-06T03:01:24.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.031+0000 7f5db4aae700 1 -- 172.21.15.57:0/3102624602 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5db0158d00 msgr2=0x7f5db0159180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:24.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.031+0000 7f5db4aae700 1 --2- 172.21.15.57:0/3102624602 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5db0158d00 0x7f5db0159180 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f5da8009f50 tx=0x7f5da8009840 comp rx=0 tx=0).stop 2023-10-06T03:01:24.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.035+0000 7f5db4aae700 1 -- 172.21.15.57:0/3102624602 shutdown_connections 2023-10-06T03:01:24.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.035+0000 7f5db4aae700 1 --2- 172.21.15.57:0/3102624602 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5db0158d00 0x7f5db0159180 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:24.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.035+0000 7f5db4aae700 1 --2- 172.21.15.57:0/3102624602 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5db006b6b0 0x7f5db00c7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:24.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.035+0000 7f5db4aae700 1 -- 172.21.15.57:0/3102624602 >> 172.21.15.57:0/3102624602 conn(0x7f5db0067fb0 msgr2=0x7f5db00cc5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:24.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.035+0000 7f5db4aae700 1 -- 172.21.15.57:0/3102624602 shutdown_connections 2023-10-06T03:01:24.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.035+0000 7f5db4aae700 1 -- 172.21.15.57:0/3102624602 wait complete. 2023-10-06T03:01:24.041 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.035+0000 7f5db4aae700 1 Processor -- start 2023-10-06T03:01:24.041 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.035+0000 7f5db4aae700 1 -- start start 2023-10-06T03:01:24.043 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.039+0000 7f5db4aae700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5db006b2e0 0x7f5db0154900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:24.043 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.039+0000 7f5db4aae700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5db006b6b0 0x7f5db00cbb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:24.043 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.039+0000 7f5db4aae700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5db0158d00 0x7f5db00cc060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:24.043 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.039+0000 7f5db4aae700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5db00a9800 con 0x7f5db0158d00 2023-10-06T03:01:24.043 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.039+0000 7f5db4aae700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5db0169250 con 0x7f5db006b2e0 2023-10-06T03:01:24.043 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.039+0000 7f5db4aae700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5db00aa0d0 con 0x7f5db006b6b0 2023-10-06T03:01:24.044 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.039+0000 7f5daed9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5db0158d00 0x7f5db00cc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:24.044 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.039+0000 7f5daed9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5db0158d00 0x7f5db00cc060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55556/0 (socket says 172.21.15.57:55556) 2023-10-06T03:01:24.044 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.039+0000 7f5daed9d700 1 -- 172.21.15.57:0/1573650666 learned_addr learned my addr 172.21.15.57:0/1573650666 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:24.044 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.039+0000 7f5dadd9b700 1 --2- 172.21.15.57:0/1573650666 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5db006b6b0 0x7f5db00cbb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:24.044 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.039+0000 7f5dae59c700 1 --2- 172.21.15.57:0/1573650666 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5db006b2e0 0x7f5db0154900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:24.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.039+0000 7f5daed9d700 1 -- 172.21.15.57:0/1573650666 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5db006b6b0 msgr2=0x7f5db00cbb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:24.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.039+0000 7f5daed9d700 1 --2- 172.21.15.57:0/1573650666 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5db006b6b0 0x7f5db00cbb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:24.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.039+0000 7f5daed9d700 1 -- 172.21.15.57:0/1573650666 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5db006b2e0 msgr2=0x7f5db0154900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:24.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.039+0000 7f5daed9d700 1 --2- 172.21.15.57:0/1573650666 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5db006b2e0 0x7f5db0154900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:24.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.039+0000 7f5daed9d700 1 -- 172.21.15.57:0/1573650666 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5da8009ae0 con 0x7f5db0158d00 2023-10-06T03:01:24.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.039+0000 7f5daed9d700 1 --2- 172.21.15.57:0/1573650666 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5db0158d00 0x7f5db00cc060 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f5da8009880 tx=0x7f5da8018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:24.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.039+0000 7f5d9e7fc700 1 -- 172.21.15.57:0/1573650666 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5da8008ad0 con 0x7f5db0158d00 2023-10-06T03:01:24.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.039+0000 7f5d9e7fc700 1 -- 172.21.15.57:0/1573650666 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5da8008c30 con 0x7f5db0158d00 2023-10-06T03:01:24.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.039+0000 7f5db4aae700 1 -- 172.21.15.57:0/1573650666 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5db0169d80 con 0x7f5db0158d00 2023-10-06T03:01:24.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.039+0000 7f5d9e7fc700 1 -- 172.21.15.57:0/1573650666 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5da8025460 con 0x7f5db0158d00 2023-10-06T03:01:24.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.039+0000 7f5db4aae700 1 -- 172.21.15.57:0/1573650666 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5db016a210 con 0x7f5db0158d00 2023-10-06T03:01:24.047 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.043+0000 7f5db4aae700 1 -- 172.21.15.57:0/1573650666 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5db00712e0 con 0x7f5db0158d00 2023-10-06T03:01:24.049 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.043+0000 7f5d9e7fc700 1 -- 172.21.15.57:0/1573650666 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f5da8003040 con 0x7f5db0158d00 2023-10-06T03:01:24.050 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.043+0000 7f5d9e7fc700 1 --2- 172.21.15.57:0/1573650666 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f5d90060550 0x7f5d90062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:24.050 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.043+0000 7f5d9e7fc700 1 -- 172.21.15.57:0/1573650666 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5da807e420 con 0x7f5db0158d00 2023-10-06T03:01:24.050 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.047+0000 7f5dae59c700 1 --2- 172.21.15.57:0/1573650666 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f5d90060550 0x7f5d90062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:24.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.047+0000 7f5dae59c700 1 --2- 172.21.15.57:0/1573650666 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f5d90060550 0x7f5d90062a00 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f5da0003a80 tx=0x7f5da0007ec0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:24.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.051+0000 7f5d9e7fc700 1 -- 172.21.15.57:0/1573650666 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f5da804e810 con 0x7f5db0158d00 2023-10-06T03:01:24.224 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.219+0000 7f5db4aae700 1 -- 172.21.15.57:0/1573650666 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5db0154ff0 con 0x7f5db0158d00 2023-10-06T03:01:24.225 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.219+0000 7f5d9e7fc700 1 -- 172.21.15.57:0/1573650666 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5da8051e30 con 0x7f5db0158d00 2023-10-06T03:01:24.225 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2023-10-06T03:01:24.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.223+0000 7f5db4aae700 1 -- 172.21.15.57:0/1573650666 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f5d90060550 msgr2=0x7f5d90062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:24.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.223+0000 7f5db4aae700 1 --2- 172.21.15.57:0/1573650666 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f5d90060550 0x7f5d90062a00 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f5da0003a80 tx=0x7f5da0007ec0 comp rx=0 tx=0).stop 2023-10-06T03:01:24.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.223+0000 7f5db4aae700 1 -- 172.21.15.57:0/1573650666 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5db0158d00 msgr2=0x7f5db00cc060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:24.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.223+0000 7f5db4aae700 1 --2- 172.21.15.57:0/1573650666 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5db0158d00 0x7f5db00cc060 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f5da8009880 tx=0x7f5da8018000 comp rx=0 tx=0).stop 2023-10-06T03:01:24.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.223+0000 7f5db4aae700 1 -- 172.21.15.57:0/1573650666 shutdown_connections 2023-10-06T03:01:24.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.223+0000 7f5db4aae700 1 --2- 172.21.15.57:0/1573650666 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5db0158d00 0x7f5db00cc060 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:24.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.223+0000 7f5db4aae700 1 --2- 172.21.15.57:0/1573650666 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f5d90060550 0x7f5d90062a00 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:24.231 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.223+0000 7f5db4aae700 1 --2- 172.21.15.57:0/1573650666 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5db006b6b0 0x7f5db00cbb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:24.231 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.223+0000 7f5db4aae700 1 --2- 172.21.15.57:0/1573650666 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5db006b2e0 0x7f5db0154900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:24.231 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.223+0000 7f5db4aae700 1 -- 172.21.15.57:0/1573650666 >> 172.21.15.57:0/1573650666 conn(0x7f5db0067fb0 msgr2=0x7f5db0062ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:24.231 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.223+0000 7f5db4aae700 1 -- 172.21.15.57:0/1573650666 shutdown_connections 2023-10-06T03:01:24.231 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.223+0000 7f5db4aae700 1 -- 172.21.15.57:0/1573650666 wait complete. 2023-10-06T03:01:24.250 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T03:01:24.423 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.419+0000 7f04f8985700 1 Processor -- start 2023-10-06T03:01:24.424 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.419+0000 7f04f8985700 1 -- start start 2023-10-06T03:01:24.428 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.423+0000 7f04f8985700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f04f4159270 0x7f04f406bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:24.428 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.423+0000 7f04f8985700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f04f40c7090 0x7f04f40c74e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:24.428 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.423+0000 7f04f8985700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04f406b890 con 0x7f04f406c920 2023-10-06T03:01:24.428 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.423+0000 7f04f8985700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04f4159640 con 0x7f04f4159270 2023-10-06T03:01:24.428 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.423+0000 7f04f8985700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04f406c260 con 0x7f04f40c7090 2023-10-06T03:01:24.429 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.423+0000 7f04f259c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f04f4159270 0x7f04f406bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:24.429 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.423+0000 7f04f2d9d700 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f04f406c920 0x7f04f40aeb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.57:53486/0 (socket says 172.21.15.57:53486) 2023-10-06T03:01:24.429 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.423+0000 7f04f2d9d700 1 -- 172.21.15.57:0/2617061945 learned_addr learned my addr 172.21.15.57:0/2617061945 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:01:24.429 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.423+0000 7f04f1d9b700 1 --2- 172.21.15.57:0/2617061945 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f04f40c7090 0x7f04f40c74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:24.429 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.423+0000 7f04f159a700 1 -- 172.21.15.57:0/2617061945 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 729872997 0 0) 0x7f04f406b890 con 0x7f04f406c920 2023-10-06T03:01:24.430 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.423+0000 7f04f259c700 1 -- 172.21.15.57:0/2617061945 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f04f40c7090 msgr2=0x7f04f40c74e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:24.430 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.423+0000 7f04f259c700 1 --2- 172.21.15.57:0/2617061945 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f04f40c7090 0x7f04f40c74e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:24.430 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.423+0000 7f04f259c700 1 -- 172.21.15.57:0/2617061945 >> v1:172.21.15.105:6789/0 conn(0x7f04f406c920 legacy=0x7f04f40aeb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:24.430 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.423+0000 7f04f259c700 1 -- 172.21.15.57:0/2617061945 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04f406ac80 con 0x7f04f4159270 2023-10-06T03:01:24.431 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.423+0000 7f04f259c700 1 --2- 172.21.15.57:0/2617061945 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f04f4159270 0x7f04f406bd20 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f04e40098e0 tx=0x7f04e40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=121f3133b331e7a0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:24.431 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.423+0000 7f04f159a700 1 -- 172.21.15.57:0/2617061945 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e400b640 con 0x7f04f4159270 2023-10-06T03:01:24.431 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.423+0000 7f04f159a700 1 -- 172.21.15.57:0/2617061945 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04e400b7a0 con 0x7f04f4159270 2023-10-06T03:01:24.431 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.423+0000 7f04f159a700 1 -- 172.21.15.57:0/2617061945 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e400bb40 con 0x7f04f4159270 2023-10-06T03:01:24.431 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.427+0000 7f04f8985700 1 -- 172.21.15.57:0/2617061945 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f04f4159270 msgr2=0x7f04f406bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:24.431 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.427+0000 7f04f8985700 1 --2- 172.21.15.57:0/2617061945 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f04f4159270 0x7f04f406bd20 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f04e40098e0 tx=0x7f04e40091a0 comp rx=0 tx=0).stop 2023-10-06T03:01:24.432 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.427+0000 7f04f8985700 1 -- 172.21.15.57:0/2617061945 shutdown_connections 2023-10-06T03:01:24.432 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.427+0000 7f04f8985700 1 --2- 172.21.15.57:0/2617061945 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f04f40c7090 0x7f04f40c74e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:24.432 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.427+0000 7f04f8985700 1 --2- 172.21.15.57:0/2617061945 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f04f4159270 0x7f04f406bd20 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:24.432 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.427+0000 7f04f8985700 1 -- 172.21.15.57:0/2617061945 >> 172.21.15.57:0/2617061945 conn(0x7f04f40c87b0 msgr2=0x7f04f40c8bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:24.432 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.427+0000 7f04f8985700 1 -- 172.21.15.57:0/2617061945 shutdown_connections 2023-10-06T03:01:24.432 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.427+0000 7f04f8985700 1 -- 172.21.15.57:0/2617061945 wait complete. 2023-10-06T03:01:24.435 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.431+0000 7f04f8985700 1 Processor -- start 2023-10-06T03:01:24.435 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.431+0000 7f04f8985700 1 -- start start 2023-10-06T03:01:24.436 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.431+0000 7f04f8985700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f04f406c920 0x7f04f4156490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:24.436 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.431+0000 7f04f8985700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f04f40c7090 0x7f04f415b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:24.437 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.431+0000 7f04f8985700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f04f4159270 0x7f04f40aeb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:24.437 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.431+0000 7f04f8985700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04f4169cf0 con 0x7f04f40c7090 2023-10-06T03:01:24.437 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.431+0000 7f04f8985700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04f41569d0 con 0x7f04f4159270 2023-10-06T03:01:24.437 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.431+0000 7f04f8985700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04f415be30 con 0x7f04f406c920 2023-10-06T03:01:24.438 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.431+0000 7f04f1d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f04f40c7090 0x7f04f415b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:24.438 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.431+0000 7f04f2d9d700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f04f4159270 0x7f04f40aeb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:24.438 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.431+0000 7f04f1d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f04f40c7090 0x7f04f415b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55580/0 (socket says 172.21.15.57:55580) 2023-10-06T03:01:24.438 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.431+0000 7f04f1d9b700 1 -- 172.21.15.57:0/1813392709 learned_addr learned my addr 172.21.15.57:0/1813392709 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:24.438 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.431+0000 7f04f259c700 1 --2- 172.21.15.57:0/1813392709 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f04f406c920 0x7f04f4156490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:24.439 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.431+0000 7f04f2d9d700 1 -- 172.21.15.57:0/1813392709 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f04f406c920 msgr2=0x7f04f4156490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:24.439 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.431+0000 7f04f2d9d700 1 --2- 172.21.15.57:0/1813392709 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f04f406c920 0x7f04f4156490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:24.439 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.431+0000 7f04f2d9d700 1 -- 172.21.15.57:0/1813392709 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f04f40c7090 msgr2=0x7f04f415b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:24.439 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.431+0000 7f04f2d9d700 1 --2- 172.21.15.57:0/1813392709 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f04f40c7090 0x7f04f415b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:24.439 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.431+0000 7f04f2d9d700 1 -- 172.21.15.57:0/1813392709 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04e4009420 con 0x7f04f4159270 2023-10-06T03:01:24.439 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.431+0000 7f04f1d9b700 1 --2- 172.21.15.57:0/1813392709 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f04f40c7090 0x7f04f415b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:01:24.439 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.431+0000 7f04f2d9d700 1 --2- 172.21.15.57:0/1813392709 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f04f4159270 0x7f04f40aeb10 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f04ec00cbe0 tx=0x7f04ec0019a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:24.440 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.435+0000 7f04e27fc700 1 -- 172.21.15.57:0/1813392709 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04ec00a8b0 con 0x7f04f4159270 2023-10-06T03:01:24.440 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.435+0000 7f04e27fc700 1 -- 172.21.15.57:0/1813392709 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04ec00aa30 con 0x7f04f4159270 2023-10-06T03:01:24.440 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.435+0000 7f04f8985700 1 -- 172.21.15.57:0/1813392709 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04f41696a0 con 0x7f04f4159270 2023-10-06T03:01:24.440 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.435+0000 7f04e27fc700 1 -- 172.21.15.57:0/1813392709 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04ec00adf0 con 0x7f04f4159270 2023-10-06T03:01:24.440 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.435+0000 7f04f8985700 1 -- 172.21.15.57:0/1813392709 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04f4159b30 con 0x7f04f4159270 2023-10-06T03:01:24.440 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.435+0000 7f04f8985700 1 -- 172.21.15.57:0/1813392709 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04f4169ea0 con 0x7f04f4159270 2023-10-06T03:01:24.442 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.435+0000 7f04e27fc700 1 -- 172.21.15.57:0/1813392709 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f04ec007300 con 0x7f04f4159270 2023-10-06T03:01:24.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.439+0000 7f04e27fc700 1 --2- 172.21.15.57:0/1813392709 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f04d4060580 0x7f04d4062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:24.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.439+0000 7f04e27fc700 1 -- 172.21.15.57:0/1813392709 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f04ec07cc90 con 0x7f04f4159270 2023-10-06T03:01:24.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.439+0000 7f04f259c700 1 --2- 172.21.15.57:0/1813392709 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f04d4060580 0x7f04d4062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:24.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.439+0000 7f04f259c700 1 --2- 172.21.15.57:0/1813392709 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f04d4060580 0x7f04d4062a30 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f04e40093f0 tx=0x7f04e4017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:24.450 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.447+0000 7f04e27fc700 1 -- 172.21.15.57:0/1813392709 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f04f4169ea0 con 0x7f04f4159270 2023-10-06T03:01:24.624 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.619+0000 7f04f8985700 1 -- 172.21.15.57:0/1813392709 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f04f4169ea0 con 0x7f04f4159270 2023-10-06T03:01:24.625 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.619+0000 7f04e27fc700 1 -- 172.21.15.57:0/1813392709 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f04f4169ea0 con 0x7f04f4159270 2023-10-06T03:01:24.627 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2023-10-06T03:01:24.630 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.623+0000 7f04f8985700 1 -- 172.21.15.57:0/1813392709 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f04d4060580 msgr2=0x7f04d4062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:24.630 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.623+0000 7f04f8985700 1 --2- 172.21.15.57:0/1813392709 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f04d4060580 0x7f04d4062a30 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f04e40093f0 tx=0x7f04e4017000 comp rx=0 tx=0).stop 2023-10-06T03:01:24.630 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.623+0000 7f04f8985700 1 -- 172.21.15.57:0/1813392709 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f04f4159270 msgr2=0x7f04f40aeb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:24.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.623+0000 7f04f8985700 1 --2- 172.21.15.57:0/1813392709 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f04f4159270 0x7f04f40aeb10 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f04ec00cbe0 tx=0x7f04ec0019a0 comp rx=0 tx=0).stop 2023-10-06T03:01:24.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.623+0000 7f04f8985700 1 -- 172.21.15.57:0/1813392709 shutdown_connections 2023-10-06T03:01:24.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.623+0000 7f04f8985700 1 --2- 172.21.15.57:0/1813392709 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f04f4159270 0x7f04f40aeb10 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:24.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.623+0000 7f04f8985700 1 --2- 172.21.15.57:0/1813392709 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f04f40c7090 0x7f04f415b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:24.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.623+0000 7f04f8985700 1 --2- 172.21.15.57:0/1813392709 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f04d4060580 0x7f04d4062a30 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:24.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.623+0000 7f04f8985700 1 --2- 172.21.15.57:0/1813392709 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f04f406c920 0x7f04f4156490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:24.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.623+0000 7f04f8985700 1 -- 172.21.15.57:0/1813392709 >> 172.21.15.57:0/1813392709 conn(0x7f04f40c87b0 msgr2=0x7f04f40af860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:24.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.623+0000 7f04f8985700 1 -- 172.21.15.57:0/1813392709 shutdown_connections 2023-10-06T03:01:24.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.623+0000 7f04f8985700 1 -- 172.21.15.57:0/1813392709 wait complete. 2023-10-06T03:01:24.653 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T03:01:24.815 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.811+0000 7f9f4aa8e700 1 Processor -- start 2023-10-06T03:01:24.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.811+0000 7f9f4aa8e700 1 -- start start 2023-10-06T03:01:24.819 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.811+0000 7f9f4aa8e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9f44140540 0x7f9f44067490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:24.819 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.811+0000 7f9f4aa8e700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f9f44140910 0x7f9f440679d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:24.819 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.815+0000 7f9f4aa8e700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f44157740 con 0x7f9f440c6b20 2023-10-06T03:01:24.819 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.815+0000 7f9f4aa8e700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f44068070 con 0x7f9f44140910 2023-10-06T03:01:24.819 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.815+0000 7f9f4aa8e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f44068350 con 0x7f9f44140540 2023-10-06T03:01:24.820 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.815+0000 7f9f49a8c700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9f44140540 0x7f9f44067490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:24.820 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.815+0000 7f9f4928b700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f9f44140910 0x7f9f440679d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:24.820 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.815+0000 7f9f4a28d700 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f9f440c6b20 0x7f9f4415a9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.57:60404/0 (socket says 172.21.15.57:60404) 2023-10-06T03:01:24.820 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.815+0000 7f9f4a28d700 1 -- 172.21.15.57:0/800134927 learned_addr learned my addr 172.21.15.57:0/800134927 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:01:24.820 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.815+0000 7f9f49a8c700 1 -- 172.21.15.57:0/800134927 >> v2:172.21.15.105:3300/0 conn(0x7f9f44140910 msgr2=0x7f9f440679d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:24.821 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.815+0000 7f9f49a8c700 1 --2- 172.21.15.57:0/800134927 >> v2:172.21.15.105:3300/0 conn(0x7f9f44140910 0x7f9f440679d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:24.821 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.815+0000 7f9f49a8c700 1 -- 172.21.15.57:0/800134927 >> v1:172.21.15.105:6789/0 conn(0x7f9f440c6b20 legacy=0x7f9f4415a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:24.821 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.815+0000 7f9f49a8c700 1 -- 172.21.15.57:0/800134927 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f44068630 con 0x7f9f44140540 2023-10-06T03:01:24.821 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.815+0000 7f9f49a8c700 1 --2- 172.21.15.57:0/800134927 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9f44140540 0x7f9f44067490 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9f400098e0 tx=0x7f9f400091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f4a17fdb5b2ada4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:24.822 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.815+0000 7f9f48a8a700 1 -- 172.21.15.57:0/800134927 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f4000b640 con 0x7f9f44140540 2023-10-06T03:01:24.822 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.815+0000 7f9f48a8a700 1 -- 172.21.15.57:0/800134927 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f4000b7a0 con 0x7f9f44140540 2023-10-06T03:01:24.822 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.815+0000 7f9f48a8a700 1 -- 172.21.15.57:0/800134927 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f4000bb40 con 0x7f9f44140540 2023-10-06T03:01:24.823 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.819+0000 7f9f4aa8e700 1 -- 172.21.15.57:0/800134927 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9f44140540 msgr2=0x7f9f44067490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:24.823 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.819+0000 7f9f4aa8e700 1 --2- 172.21.15.57:0/800134927 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9f44140540 0x7f9f44067490 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9f400098e0 tx=0x7f9f400091a0 comp rx=0 tx=0).stop 2023-10-06T03:01:24.823 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.819+0000 7f9f4aa8e700 1 -- 172.21.15.57:0/800134927 shutdown_connections 2023-10-06T03:01:24.823 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.819+0000 7f9f4aa8e700 1 --2- 172.21.15.57:0/800134927 >> v2:172.21.15.105:3300/0 conn(0x7f9f44140910 0x7f9f440679d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:24.823 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.819+0000 7f9f4aa8e700 1 --2- 172.21.15.57:0/800134927 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9f44140540 0x7f9f44067490 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:24.824 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.819+0000 7f9f4aa8e700 1 -- 172.21.15.57:0/800134927 >> 172.21.15.57:0/800134927 conn(0x7f9f440c8660 msgr2=0x7f9f440c8a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:24.824 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.819+0000 7f9f4aa8e700 1 -- 172.21.15.57:0/800134927 shutdown_connections 2023-10-06T03:01:24.824 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.819+0000 7f9f4aa8e700 1 -- 172.21.15.57:0/800134927 wait complete. 2023-10-06T03:01:24.826 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.823+0000 7f9f4aa8e700 1 Processor -- start 2023-10-06T03:01:24.827 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.823+0000 7f9f4aa8e700 1 -- start start 2023-10-06T03:01:24.829 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.823+0000 7f9f4aa8e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9f440c6b20 0x7f9f440c9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:24.829 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.823+0000 7f9f4aa8e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9f44140540 0x7f9f4413f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:24.829 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.823+0000 7f9f4aa8e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9f44140910 0x7f9f440aa980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:24.829 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.823+0000 7f9f4aa8e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f44170fc0 con 0x7f9f440c6b20 2023-10-06T03:01:24.829 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.823+0000 7f9f4aa8e700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f440aece0 con 0x7f9f44140910 2023-10-06T03:01:24.829 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.823+0000 7f9f4aa8e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f4416e2c0 con 0x7f9f44140540 2023-10-06T03:01:24.830 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.823+0000 7f9f49a8c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9f440c6b20 0x7f9f440c9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:24.830 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.823+0000 7f9f49a8c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9f440c6b20 0x7f9f440c9ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33050/0 (socket says 172.21.15.57:33050) 2023-10-06T03:01:24.830 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.823+0000 7f9f49a8c700 1 -- 172.21.15.57:0/1582394553 learned_addr learned my addr 172.21.15.57:0/1582394553 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:24.831 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.823+0000 7f9f4928b700 1 --2- 172.21.15.57:0/1582394553 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9f44140540 0x7f9f4413f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:24.831 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.823+0000 7f9f4a28d700 1 --2- 172.21.15.57:0/1582394553 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9f44140910 0x7f9f440aa980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:24.831 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.823+0000 7f9f49a8c700 1 -- 172.21.15.57:0/1582394553 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9f44140540 msgr2=0x7f9f4413f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:24.831 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.823+0000 7f9f49a8c700 1 --2- 172.21.15.57:0/1582394553 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9f44140540 0x7f9f4413f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:24.831 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.823+0000 7f9f49a8c700 1 -- 172.21.15.57:0/1582394553 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9f44140910 msgr2=0x7f9f440aa980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:24.831 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.823+0000 7f9f49a8c700 1 --2- 172.21.15.57:0/1582394553 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9f44140910 0x7f9f440aa980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:24.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.823+0000 7f9f49a8c700 1 -- 172.21.15.57:0/1582394553 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f40009420 con 0x7f9f440c6b20 2023-10-06T03:01:24.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.823+0000 7f9f4928b700 1 --2- 172.21.15.57:0/1582394553 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9f44140540 0x7f9f4413f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:01:24.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.823+0000 7f9f4a28d700 1 --2- 172.21.15.57:0/1582394553 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9f44140910 0x7f9f440aa980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:01:24.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.823+0000 7f9f49a8c700 1 --2- 172.21.15.57:0/1582394553 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9f440c6b20 0x7f9f440c9ce0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f9f4406eac0 tx=0x7f9f40017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:24.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.827+0000 7f9f39ffb700 1 -- 172.21.15.57:0/1582394553 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f4001bda0 con 0x7f9f440c6b20 2023-10-06T03:01:24.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.827+0000 7f9f39ffb700 1 -- 172.21.15.57:0/1582394553 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f40011420 con 0x7f9f440c6b20 2023-10-06T03:01:24.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.827+0000 7f9f39ffb700 1 -- 172.21.15.57:0/1582394553 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f400117e0 con 0x7f9f440c6b20 2023-10-06T03:01:24.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.827+0000 7f9f4aa8e700 1 -- 172.21.15.57:0/1582394553 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f440aef80 con 0x7f9f440c6b20 2023-10-06T03:01:24.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.827+0000 7f9f4aa8e700 1 -- 172.21.15.57:0/1582394553 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f4416e5a0 con 0x7f9f440c6b20 2023-10-06T03:01:24.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.827+0000 7f9f4aa8e700 1 -- 172.21.15.57:0/1582394553 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f440af480 con 0x7f9f440c6b20 2023-10-06T03:01:24.834 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.827+0000 7f9f39ffb700 1 -- 172.21.15.57:0/1582394553 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f9f40011b50 con 0x7f9f440c6b20 2023-10-06T03:01:24.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.831+0000 7f9f39ffb700 1 --2- 172.21.15.57:0/1582394553 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f9f28060550 0x7f9f28062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:24.837 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.831+0000 7f9f39ffb700 1 -- 172.21.15.57:0/1582394553 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9f4007e110 con 0x7f9f440c6b20 2023-10-06T03:01:24.837 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.831+0000 7f9f4928b700 1 --2- 172.21.15.57:0/1582394553 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f9f28060550 0x7f9f28062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:24.838 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.831+0000 7f9f4928b700 1 --2- 172.21.15.57:0/1582394553 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f9f28060550 0x7f9f28062a00 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f9f34006f00 tx=0x7f9f34008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:24.843 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:24.839+0000 7f9f39ffb700 1 -- 172.21.15.57:0/1582394553 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f9f4004e500 con 0x7f9f440c6b20 2023-10-06T03:01:25.012 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.007+0000 7f9f4aa8e700 1 -- 172.21.15.57:0/1582394553 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9f4404be40 con 0x7f9f440c6b20 2023-10-06T03:01:25.013 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.007+0000 7f9f39ffb700 1 -- 172.21.15.57:0/1582394553 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9f40051b20 con 0x7f9f440c6b20 2023-10-06T03:01:25.013 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2023-10-06T03:01:25.019 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.011+0000 7f9f4aa8e700 1 -- 172.21.15.57:0/1582394553 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f9f28060550 msgr2=0x7f9f28062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:25.019 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.011+0000 7f9f4aa8e700 1 --2- 172.21.15.57:0/1582394553 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f9f28060550 0x7f9f28062a00 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f9f34006f00 tx=0x7f9f34008040 comp rx=0 tx=0).stop 2023-10-06T03:01:25.019 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.011+0000 7f9f4aa8e700 1 -- 172.21.15.57:0/1582394553 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9f440c6b20 msgr2=0x7f9f440c9ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:25.019 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.011+0000 7f9f4aa8e700 1 --2- 172.21.15.57:0/1582394553 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9f440c6b20 0x7f9f440c9ce0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f9f4406eac0 tx=0x7f9f40017000 comp rx=0 tx=0).stop 2023-10-06T03:01:25.019 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.011+0000 7f9f4aa8e700 1 -- 172.21.15.57:0/1582394553 shutdown_connections 2023-10-06T03:01:25.019 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.011+0000 7f9f4aa8e700 1 --2- 172.21.15.57:0/1582394553 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9f44140910 0x7f9f440aa980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:25.019 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.011+0000 7f9f4aa8e700 1 --2- 172.21.15.57:0/1582394553 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f9f28060550 0x7f9f28062a00 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:25.019 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.011+0000 7f9f4aa8e700 1 --2- 172.21.15.57:0/1582394553 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9f44140540 0x7f9f4413f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:25.019 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.011+0000 7f9f4aa8e700 1 --2- 172.21.15.57:0/1582394553 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9f440c6b20 0x7f9f440c9ce0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:25.019 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.011+0000 7f9f4aa8e700 1 -- 172.21.15.57:0/1582394553 >> 172.21.15.57:0/1582394553 conn(0x7f9f440c8660 msgr2=0x7f9f4406b060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:25.019 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.011+0000 7f9f4aa8e700 1 -- 172.21.15.57:0/1582394553 shutdown_connections 2023-10-06T03:01:25.020 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.015+0000 7f9f4aa8e700 1 -- 172.21.15.57:0/1582394553 wait complete. 2023-10-06T03:01:25.040 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T03:01:25.207 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.203+0000 7f202b59e700 1 Processor -- start 2023-10-06T03:01:25.207 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.203+0000 7f202b59e700 1 -- start start 2023-10-06T03:01:25.209 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.203+0000 7f202b59e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f202c0cc470 0x7f202c0cadc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:25.209 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.203+0000 7f202b59e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f202c142bb0 0x7f202c0ce710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:25.209 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.203+0000 7f202b59e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f202c0cbfe0 con 0x7f202c1427e0 2023-10-06T03:01:25.209 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.203+0000 7f202b59e700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f202c0cb3d0 con 0x7f202c142bb0 2023-10-06T03:01:25.209 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.203+0000 7f202b59e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f202c0cb6b0 con 0x7f202c0cc470 2023-10-06T03:01:25.210 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.203+0000 7f202a59c700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f202c1427e0 0x7f202c06bf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:55440/0 (socket says 172.21.15.57:55440) 2023-10-06T03:01:25.210 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.203+0000 7f202a59c700 1 -- 172.21.15.57:0/3526933895 learned_addr learned my addr 172.21.15.57:0/3526933895 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:01:25.210 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.203+0000 7f202ad9d700 1 --2- 172.21.15.57:0/3526933895 >> v2:172.21.15.57:3300/0 conn(0x7f202c142bb0 0x7f202c0ce710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:25.210 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.203+0000 7f2029d9b700 1 --2- 172.21.15.57:0/3526933895 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f202c0cc470 0x7f202c0cadc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:25.211 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.203+0000 7f202959a700 1 -- 172.21.15.57:0/3526933895 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1566486756 0 0) 0x7f202c0cbfe0 con 0x7f202c1427e0 2023-10-06T03:01:25.211 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.203+0000 7f202959a700 1 -- 172.21.15.57:0/3526933895 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2014003570 con 0x7f202c1427e0 2023-10-06T03:01:25.211 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.203+0000 7f2029d9b700 1 -- 172.21.15.57:0/3526933895 >> v2:172.21.15.57:3300/0 conn(0x7f202c142bb0 msgr2=0x7f202c0ce710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:25.211 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.203+0000 7f2029d9b700 1 --2- 172.21.15.57:0/3526933895 >> v2:172.21.15.57:3300/0 conn(0x7f202c142bb0 0x7f202c0ce710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:25.211 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.203+0000 7f2029d9b700 1 -- 172.21.15.57:0/3526933895 >> v1:172.21.15.57:6789/0 conn(0x7f202c1427e0 legacy=0x7f202c06bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:25.211 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.203+0000 7f2029d9b700 1 -- 172.21.15.57:0/3526933895 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f202c0cb990 con 0x7f202c0cc470 2023-10-06T03:01:25.211 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.207+0000 7f2029d9b700 1 --2- 172.21.15.57:0/3526933895 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f202c0cc470 0x7f202c0cadc0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f20200098e0 tx=0x7f20200091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b07d36951727660 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:25.212 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.207+0000 7f202959a700 1 -- 172.21.15.57:0/3526933895 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2020011630 con 0x7f202c0cc470 2023-10-06T03:01:25.212 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.207+0000 7f202959a700 1 -- 172.21.15.57:0/3526933895 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2020011790 con 0x7f202c0cc470 2023-10-06T03:01:25.212 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.207+0000 7f202959a700 1 -- 172.21.15.57:0/3526933895 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2020011b30 con 0x7f202c0cc470 2023-10-06T03:01:25.212 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.207+0000 7f202b59e700 1 -- 172.21.15.57:0/3526933895 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f202c0cc470 msgr2=0x7f202c0cadc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:25.212 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.207+0000 7f202b59e700 1 --2- 172.21.15.57:0/3526933895 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f202c0cc470 0x7f202c0cadc0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f20200098e0 tx=0x7f20200091a0 comp rx=0 tx=0).stop 2023-10-06T03:01:25.213 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.207+0000 7f202b59e700 1 -- 172.21.15.57:0/3526933895 shutdown_connections 2023-10-06T03:01:25.213 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.207+0000 7f202b59e700 1 --2- 172.21.15.57:0/3526933895 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f202c0cc470 0x7f202c0cadc0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:25.213 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.207+0000 7f202b59e700 1 --2- 172.21.15.57:0/3526933895 >> v2:172.21.15.57:3300/0 conn(0x7f202c142bb0 0x7f202c0ce710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:25.213 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.207+0000 7f202b59e700 1 -- 172.21.15.57:0/3526933895 >> 172.21.15.57:0/3526933895 conn(0x7f202c0cffe0 msgr2=0x7f202c0d03e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:25.213 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.207+0000 7f202b59e700 1 -- 172.21.15.57:0/3526933895 shutdown_connections 2023-10-06T03:01:25.213 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.207+0000 7f202b59e700 1 -- 172.21.15.57:0/3526933895 wait complete. 2023-10-06T03:01:25.216 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.211+0000 7f202b59e700 1 Processor -- start 2023-10-06T03:01:25.216 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.211+0000 7f202b59e700 1 -- start start 2023-10-06T03:01:25.218 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.211+0000 7f202b59e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f202c0cc470 0x7f202c15ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:25.218 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.211+0000 7f202b59e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f202c1427e0 0x7f202c137500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:25.219 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.211+0000 7f202b59e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f202c142bb0 0x7f202c0b2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:25.219 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.211+0000 7f202b59e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f202c137a40 con 0x7f202c142bb0 2023-10-06T03:01:25.219 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.211+0000 7f202b59e700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f202c0b42a0 con 0x7f202c1427e0 2023-10-06T03:01:25.219 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.211+0000 7f202b59e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f202c0b33f0 con 0x7f202c0cc470 2023-10-06T03:01:25.220 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.215+0000 7f202a59c700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f202c0cc470 0x7f202c15ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:25.220 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.215+0000 7f202ad9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f202c142bb0 0x7f202c0b2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:25.220 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.215+0000 7f202a59c700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f202c0cc470 0x7f202c15ba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.57:49434/0 (socket says 172.21.15.57:49434) 2023-10-06T03:01:25.220 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.215+0000 7f202a59c700 1 -- 172.21.15.57:0/1772194837 learned_addr learned my addr 172.21.15.57:0/1772194837 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:25.220 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.215+0000 7f2029d9b700 1 --2- 172.21.15.57:0/1772194837 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f202c1427e0 0x7f202c137500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:25.220 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.215+0000 7f202a59c700 1 -- 172.21.15.57:0/1772194837 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f202c1427e0 msgr2=0x7f202c137500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:25.220 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.215+0000 7f202a59c700 1 --2- 172.21.15.57:0/1772194837 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f202c1427e0 0x7f202c137500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:25.220 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.215+0000 7f202a59c700 1 -- 172.21.15.57:0/1772194837 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f202c142bb0 msgr2=0x7f202c0b2eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:25.220 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.215+0000 7f202a59c700 1 --2- 172.21.15.57:0/1772194837 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f202c142bb0 0x7f202c0b2eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:25.221 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.215+0000 7f202a59c700 1 -- 172.21.15.57:0/1772194837 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2020009420 con 0x7f202c0cc470 2023-10-06T03:01:25.221 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.215+0000 7f202a59c700 1 --2- 172.21.15.57:0/1772194837 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f202c0cc470 0x7f202c15ba30 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f201c00cd00 tx=0x7f201c001b00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:25.221 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.215+0000 7f201a7fc700 1 -- 172.21.15.57:0/1772194837 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f201c00ce60 con 0x7f202c0cc470 2023-10-06T03:01:25.221 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.215+0000 7f201a7fc700 1 -- 172.21.15.57:0/1772194837 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f201c00ab10 con 0x7f202c0cc470 2023-10-06T03:01:25.222 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.215+0000 7f202b59e700 1 -- 172.21.15.57:0/1772194837 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f202c0b3690 con 0x7f202c0cc470 2023-10-06T03:01:25.222 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.215+0000 7f201a7fc700 1 -- 172.21.15.57:0/1772194837 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f201c0070f0 con 0x7f202c0cc470 2023-10-06T03:01:25.222 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.215+0000 7f202b59e700 1 -- 172.21.15.57:0/1772194837 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f202c0b3c50 con 0x7f202c0cc470 2023-10-06T03:01:25.222 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.215+0000 7f202b59e700 1 -- 172.21.15.57:0/1772194837 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f202c04be40 con 0x7f202c0cc470 2023-10-06T03:01:25.223 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.219+0000 7f201a7fc700 1 -- 172.21.15.57:0/1772194837 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f201c035b50 con 0x7f202c0cc470 2023-10-06T03:01:25.225 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.219+0000 7f201a7fc700 1 --2- 172.21.15.57:0/1772194837 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f200c060550 0x7f200c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:25.225 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.219+0000 7f201a7fc700 1 -- 172.21.15.57:0/1772194837 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f201c07cfe0 con 0x7f202c0cc470 2023-10-06T03:01:25.225 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.219+0000 7f2029d9b700 1 --2- 172.21.15.57:0/1772194837 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f200c060550 0x7f200c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:25.226 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.223+0000 7f2029d9b700 1 --2- 172.21.15.57:0/1772194837 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f200c060550 0x7f200c062a00 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f20200098e0 tx=0x7f2020017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:25.232 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.227+0000 7f201a7fc700 1 -- 172.21.15.57:0/1772194837 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f201c04d510 con 0x7f202c0cc470 2023-10-06T03:01:25.402 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.395+0000 7f202b59e700 1 -- 172.21.15.57:0/1772194837 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f202c06aae0 con 0x7f202c0cc470 2023-10-06T03:01:25.404 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.399+0000 7f201a7fc700 1 -- 172.21.15.57:0/1772194837 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f201c050b30 con 0x7f202c0cc470 2023-10-06T03:01:25.404 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 64 2023-10-06T03:01:25.407 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.399+0000 7f202b59e700 1 -- 172.21.15.57:0/1772194837 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f200c060550 msgr2=0x7f200c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:25.407 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.399+0000 7f202b59e700 1 --2- 172.21.15.57:0/1772194837 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f200c060550 0x7f200c062a00 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f20200098e0 tx=0x7f2020017000 comp rx=0 tx=0).stop 2023-10-06T03:01:25.407 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.399+0000 7f202b59e700 1 -- 172.21.15.57:0/1772194837 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f202c0cc470 msgr2=0x7f202c15ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:25.407 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.399+0000 7f202b59e700 1 --2- 172.21.15.57:0/1772194837 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f202c0cc470 0x7f202c15ba30 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f201c00cd00 tx=0x7f201c001b00 comp rx=0 tx=0).stop 2023-10-06T03:01:25.407 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.399+0000 7f202b59e700 1 -- 172.21.15.57:0/1772194837 shutdown_connections 2023-10-06T03:01:25.407 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.399+0000 7f202b59e700 1 --2- 172.21.15.57:0/1772194837 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f202c142bb0 0x7f202c0b2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:25.407 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.399+0000 7f202b59e700 1 --2- 172.21.15.57:0/1772194837 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f202c1427e0 0x7f202c137500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:25.407 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.399+0000 7f202b59e700 1 --2- 172.21.15.57:0/1772194837 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f200c060550 0x7f200c062a00 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:25.407 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.399+0000 7f202b59e700 1 --2- 172.21.15.57:0/1772194837 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f202c0cc470 0x7f202c15ba30 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:25.407 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.399+0000 7f202b59e700 1 -- 172.21.15.57:0/1772194837 >> 172.21.15.57:0/1772194837 conn(0x7f202c0cffe0 msgr2=0x7f202c1402f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:25.407 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.403+0000 7f202b59e700 1 -- 172.21.15.57:0/1772194837 shutdown_connections 2023-10-06T03:01:25.408 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.403+0000 7f202b59e700 1 -- 172.21.15.57:0/1772194837 wait complete. 2023-10-06T03:01:25.429 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:01:25.591 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.587+0000 7f295862e700 1 Processor -- start 2023-10-06T03:01:25.591 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.587+0000 7f295862e700 1 -- start start 2023-10-06T03:01:25.593 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.587+0000 7f295862e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f29500b10c0 0x7f295015b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:25.594 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.587+0000 7f295862e700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f2950154d90 0x7f29501575d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:25.594 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.587+0000 7f295862e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2950158530 con 0x7f29500b1490 2023-10-06T03:01:25.594 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.587+0000 7f295862e700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29500b1910 con 0x7f29500b10c0 2023-10-06T03:01:25.594 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.587+0000 7f295862e700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f295006bb10 con 0x7f2950154d90 2023-10-06T03:01:25.596 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.587+0000 7f29563ca700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f29500b10c0 0x7f295015b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:25.596 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.587+0000 7f2955bc9700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f29500b1490 0x7f2950154680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:55456/0 (socket says 172.21.15.57:55456) 2023-10-06T03:01:25.596 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.587+0000 7f2955bc9700 1 -- 172.21.15.57:0/3865988388 learned_addr learned my addr 172.21.15.57:0/3865988388 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:01:25.596 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.591+0000 7f2956bcb700 1 --2- 172.21.15.57:0/3865988388 >> v2:172.21.15.105:3300/0 conn(0x7f2950154d90 0x7f29501575d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:25.596 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.591+0000 7f29553c8700 1 -- 172.21.15.57:0/3865988388 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3047175873 0 0) 0x7f2950158530 con 0x7f29500b1490 2023-10-06T03:01:25.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.591+0000 7f29553c8700 1 -- 172.21.15.57:0/3865988388 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f293c003570 con 0x7f29500b1490 2023-10-06T03:01:25.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.591+0000 7f29563ca700 1 -- 172.21.15.57:0/3865988388 >> v2:172.21.15.105:3300/0 conn(0x7f2950154d90 msgr2=0x7f29501575d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:25.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.591+0000 7f29563ca700 1 --2- 172.21.15.57:0/3865988388 >> v2:172.21.15.105:3300/0 conn(0x7f2950154d90 0x7f29501575d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:25.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.591+0000 7f29563ca700 1 -- 172.21.15.57:0/3865988388 >> v1:172.21.15.57:6789/0 conn(0x7f29500b1490 legacy=0x7f2950154680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:25.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.591+0000 7f29563ca700 1 -- 172.21.15.57:0/3865988388 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2950158250 con 0x7f29500b10c0 2023-10-06T03:01:25.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.591+0000 7f29563ca700 1 --2- 172.21.15.57:0/3865988388 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29500b10c0 0x7f295015b750 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f29500b1b70 tx=0x7f294c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77160fed3688e58d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:25.599 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.591+0000 7f29553c8700 1 -- 172.21.15.57:0/3865988388 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f294c00e070 con 0x7f29500b10c0 2023-10-06T03:01:25.599 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.591+0000 7f29553c8700 1 -- 172.21.15.57:0/3865988388 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f294c00bb60 con 0x7f29500b10c0 2023-10-06T03:01:25.599 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.591+0000 7f29553c8700 1 -- 172.21.15.57:0/3865988388 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f294c012430 con 0x7f29500b10c0 2023-10-06T03:01:25.599 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.591+0000 7f295862e700 1 -- 172.21.15.57:0/3865988388 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29500b10c0 msgr2=0x7f295015b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:25.599 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.591+0000 7f295862e700 1 --2- 172.21.15.57:0/3865988388 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29500b10c0 0x7f295015b750 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f29500b1b70 tx=0x7f294c009780 comp rx=0 tx=0).stop 2023-10-06T03:01:25.600 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.591+0000 7f295862e700 1 -- 172.21.15.57:0/3865988388 shutdown_connections 2023-10-06T03:01:25.600 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.591+0000 7f295862e700 1 --2- 172.21.15.57:0/3865988388 >> v2:172.21.15.105:3300/0 conn(0x7f2950154d90 0x7f29501575d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:25.600 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.591+0000 7f295862e700 1 --2- 172.21.15.57:0/3865988388 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29500b10c0 0x7f295015b750 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:25.600 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.591+0000 7f295862e700 1 -- 172.21.15.57:0/3865988388 >> 172.21.15.57:0/3865988388 conn(0x7f29500cbdd0 msgr2=0x7f29500cc1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:25.600 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.591+0000 7f295862e700 1 -- 172.21.15.57:0/3865988388 shutdown_connections 2023-10-06T03:01:25.600 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.591+0000 7f295862e700 1 -- 172.21.15.57:0/3865988388 wait complete. 2023-10-06T03:01:25.601 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.595+0000 7f295862e700 1 Processor -- start 2023-10-06T03:01:25.601 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.595+0000 7f295862e700 1 -- start start 2023-10-06T03:01:25.603 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.599+0000 7f295862e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f29500b10c0 0x7f29500c0f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:25.603 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.599+0000 7f295862e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29500b1490 0x7f29500ac280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:25.603 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.599+0000 7f295862e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2950154d90 0x7f29500c7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:25.603 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.599+0000 7f295862e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29500a9390 con 0x7f29500b1490 2023-10-06T03:01:25.603 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.599+0000 7f295862e700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29500ac7c0 con 0x7f2950154d90 2023-10-06T03:01:25.603 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.599+0000 7f295862e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29500a8a60 con 0x7f29500b10c0 2023-10-06T03:01:25.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.599+0000 7f2955bc9700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29500b1490 0x7f29500ac280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:25.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.599+0000 7f2955bc9700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29500b1490 0x7f29500ac280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33082/0 (socket says 172.21.15.57:33082) 2023-10-06T03:01:25.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.599+0000 7f2955bc9700 1 -- 172.21.15.57:0/489110611 learned_addr learned my addr 172.21.15.57:0/489110611 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:25.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.599+0000 7f2956bcb700 1 --2- 172.21.15.57:0/489110611 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2950154d90 0x7f29500c7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:25.605 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.599+0000 7f29563ca700 1 --2- 172.21.15.57:0/489110611 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f29500b10c0 0x7f29500c0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:25.605 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.599+0000 7f2955bc9700 1 -- 172.21.15.57:0/489110611 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f29500b10c0 msgr2=0x7f29500c0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:25.605 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.599+0000 7f2955bc9700 1 --2- 172.21.15.57:0/489110611 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f29500b10c0 0x7f29500c0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:25.605 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.599+0000 7f2955bc9700 1 -- 172.21.15.57:0/489110611 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2950154d90 msgr2=0x7f29500c7cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:25.605 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.599+0000 7f2955bc9700 1 --2- 172.21.15.57:0/489110611 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2950154d90 0x7f29500c7cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:25.605 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.599+0000 7f2955bc9700 1 -- 172.21.15.57:0/489110611 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f294c009a20 con 0x7f29500b1490 2023-10-06T03:01:25.605 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.599+0000 7f29563ca700 1 --2- 172.21.15.57:0/489110611 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f29500b10c0 0x7f29500c0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:25.606 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.599+0000 7f2955bc9700 1 --2- 172.21.15.57:0/489110611 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29500b1490 0x7f29500ac280 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f294000c7f0 tx=0x7f2940007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:25.606 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.599+0000 7f29467fc700 1 -- 172.21.15.57:0/489110611 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2940005b30 con 0x7f29500b1490 2023-10-06T03:01:25.606 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.599+0000 7f29467fc700 1 -- 172.21.15.57:0/489110611 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2940005cb0 con 0x7f29500b1490 2023-10-06T03:01:25.607 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.599+0000 7f29467fc700 1 -- 172.21.15.57:0/489110611 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2940007320 con 0x7f29500b1490 2023-10-06T03:01:25.607 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.599+0000 7f295862e700 1 -- 172.21.15.57:0/489110611 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29500a8d40 con 0x7f29500b1490 2023-10-06T03:01:25.607 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.599+0000 7f295862e700 1 -- 172.21.15.57:0/489110611 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29500c8210 con 0x7f29500b1490 2023-10-06T03:01:25.608 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.603+0000 7f295862e700 1 -- 172.21.15.57:0/489110611 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29500a9540 con 0x7f29500b1490 2023-10-06T03:01:25.608 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.603+0000 7f29467fc700 1 -- 172.21.15.57:0/489110611 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f294001b3b0 con 0x7f29500b1490 2023-10-06T03:01:25.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.603+0000 7f29467fc700 1 --2- 172.21.15.57:0/489110611 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f2934060550 0x7f2934062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:25.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.603+0000 7f29467fc700 1 -- 172.21.15.57:0/489110611 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f294007bf70 con 0x7f29500b1490 2023-10-06T03:01:25.610 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.603+0000 7f29563ca700 1 --2- 172.21.15.57:0/489110611 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f2934060550 0x7f2934062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:25.610 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.607+0000 7f29563ca700 1 --2- 172.21.15.57:0/489110611 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f2934060550 0x7f2934062a00 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f294c0097c0 tx=0x7f294c019000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:25.618 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.611+0000 7f29467fc700 1 -- 172.21.15.57:0/489110611 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f29500a9540 con 0x7f29500b1490 2023-10-06T03:01:25.789 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.783+0000 7f295862e700 1 -- 172.21.15.57:0/489110611 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f29500a9540 con 0x7f29500b1490 2023-10-06T03:01:25.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.783+0000 7f29467fc700 1 -- 172.21.15.57:0/489110611 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16866 (secure 0 0 0) 0x7f29500a9540 con 0x7f29500b1490 2023-10-06T03:01:25.790 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:01:25.791 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":23,"fsid":"eb56dc0f-9213-41cb-9aad-8ade6c802e98","created":"2023-10-06T03:00:30.806197+0000","modified":"2023-10-06T03:00:58.975366+0000","last_up_change":"2023-10-06T03:00:43.607454+0000","last_in_change":"2023-10-06T03:00:33.943513+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T03:00:44.360651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T03:00:50.466601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:00:55.472586+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T03:00:56.400884+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"58cf6c90-d704-43e0-b2db-dffe526d5e8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":33053},{"type":"v1","addr":"172.21.15.57:6801","nonce":33053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":33053},{"type":"v1","addr":"172.21.15.57:6803","nonce":33053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":33053},{"type":"v1","addr":"172.21.15.57:6807","nonce":33053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":33053},{"type":"v1","addr":"172.21.15.57:6805","nonce":33053}]},"public_addr":"172.21.15.57:6801/33053","cluster_addr":"172.21.15.57:6803/33053","heartbeat_back_addr":"172.21.15.57:6807/33053","heartbeat_front_addr":"172.21.15.57:6805/33053","state":["exists","up"]},{"osd":1,"uuid":"16afbe70-7f9e-4568-9c92-763e6e348119","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6809","nonce":33052},{"type":"v1","addr":"172.21.15.57:6810","nonce":33052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":33052},{"type":"v1","addr":"172.21.15.57:6813","nonce":33052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":33052},{"type":"v1","addr":"172.21.15.57:6822","nonce":33052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6815","nonce":33052},{"type":"v1","addr":"172.21.15.57:6818","nonce":33052}]},"public_addr":"172.21.15.57:6810/33052","cluster_addr":"172.21.15.57:6813/33052","heartbeat_back_addr":"172.21.15.57:6822/33052","heartbeat_front_addr":"172.21.15.57:6818/33052","state":["exists","up"]},{"osd":2,"uuid":"7255c62e-f92f-470f-a5ce-30228920d9f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":33058},{"type":"v1","addr":"172.21.15.57:6825","nonce":33058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":33058},{"type":"v1","addr":"172.21.15.57:6827","nonce":33058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":33058},{"type":"v1","addr":"172.21.15.57:6831","nonce":33058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":33058},{"type":"v1","addr":"172.21.15.57:6829","nonce":33058}]},"public_addr":"172.21.15.57:6825/33058","cluster_addr":"172.21.15.57:6827/33058","heartbeat_back_addr":"172.21.15.57:6831/33058","heartbeat_front_addr":"172.21.15.57:6829/33058","state":["exists","up"]},{"osd":3,"uuid":"152a236d-f799-4888-8544-74865508d5a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":33057},{"type":"v1","addr":"172.21.15.57:6811","nonce":33057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":33057},{"type":"v1","addr":"172.21.15.57:6816","nonce":33057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6821","nonce":33057},{"type":"v1","addr":"172.21.15.57:6823","nonce":33057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6817","nonce":33057},{"type":"v1","addr":"172.21.15.57:6819","nonce":33057}]},"public_addr":"172.21.15.57:6811/33057","cluster_addr":"172.21.15.57:6816/33057","heartbeat_back_addr":"172.21.15.57:6823/33057","heartbeat_front_addr":"172.21.15.57:6819/33057","state":["exists","up"]},{"osd":4,"uuid":"37db2a65-3566-41d0-9d60-e66c49e1e68e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":33368},{"type":"v1","addr":"172.21.15.105:6801","nonce":33368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":33368},{"type":"v1","addr":"172.21.15.105:6803","nonce":33368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":33368},{"type":"v1","addr":"172.21.15.105:6807","nonce":33368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":33368},{"type":"v1","addr":"172.21.15.105:6805","nonce":33368}]},"public_addr":"172.21.15.105:6801/33368","cluster_addr":"172.21.15.105:6803/33368","heartbeat_back_addr":"172.21.15.105:6807/33368","heartbeat_front_addr":"172.21.15.105:6805/33368","state":["exists","up"]},{"osd":5,"uuid":"35e77918-1bb4-42ca-9b20-f3c14eaa0c04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":33379},{"type":"v1","addr":"172.21.15.105:6818","nonce":33379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":33379},{"type":"v1","addr":"172.21.15.105:6823","nonce":33379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":33379},{"type":"v1","addr":"172.21.15.105:6831","nonce":33379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":33379},{"type":"v1","addr":"172.21.15.105:6827","nonce":33379}]},"public_addr":"172.21.15.105:6818/33379","cluster_addr":"172.21.15.105:6823/33379","heartbeat_back_addr":"172.21.15.105:6831/33379","heartbeat_front_addr":"172.21.15.105:6827/33379","state":["exists","up"]},{"osd":6,"uuid":"b4d9d510-7a45-4173-8287-c6c8d6547f2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":33369},{"type":"v1","addr":"172.21.15.105:6819","nonce":33369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":33369},{"type":"v1","addr":"172.21.15.105:6822","nonce":33369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":33369},{"type":"v1","addr":"172.21.15.105:6830","nonce":33369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":33369},{"type":"v1","addr":"172.21.15.105:6826","nonce":33369}]},"public_addr":"172.21.15.105:6819/33369","cluster_addr":"172.21.15.105:6822/33369","heartbeat_back_addr":"172.21.15.105:6830/33369","heartbeat_front_addr":"172.21.15.105:6826/33369","state":["exists","up"]},{"osd":7,"uuid":"74266fb0-cd84-463f-8bf0-092652a71dc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":33370},{"type":"v1","addr":"172.21.15.105:6809","nonce":33370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":33370},{"type":"v1","addr":"172.21.15.105:6811","nonce":33370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":33370},{"type":"v1","addr":"172.21.15.105:6815","nonce":33370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":33370},{"type":"v1","addr":"172.21.15.105:6813","nonce":33370}]},"public_addr":"172.21.15.105:6809/33370","cluster_addr":"172.21.15.105:6811/33370","heartbeat_back_addr":"172.21.15.105:6815/33370","heartbeat_front_addr":"172.21.15.105:6813/33370","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.596864+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.633851+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.636993+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.529681+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.608601+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.659752+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.661717+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.642221+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:01:25.794 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.787+0000 7f295862e700 1 -- 172.21.15.57:0/489110611 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f2934060550 msgr2=0x7f2934062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:25.794 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.787+0000 7f295862e700 1 --2- 172.21.15.57:0/489110611 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f2934060550 0x7f2934062a00 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f294c0097c0 tx=0x7f294c019000 comp rx=0 tx=0).stop 2023-10-06T03:01:25.795 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.787+0000 7f295862e700 1 -- 172.21.15.57:0/489110611 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29500b1490 msgr2=0x7f29500ac280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:25.795 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.787+0000 7f295862e700 1 --2- 172.21.15.57:0/489110611 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29500b1490 0x7f29500ac280 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f294000c7f0 tx=0x7f2940007e00 comp rx=0 tx=0).stop 2023-10-06T03:01:25.795 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.791+0000 7f295862e700 1 -- 172.21.15.57:0/489110611 shutdown_connections 2023-10-06T03:01:25.795 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.791+0000 7f295862e700 1 --2- 172.21.15.57:0/489110611 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2950154d90 0x7f29500c7cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:25.795 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.791+0000 7f295862e700 1 --2- 172.21.15.57:0/489110611 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29500b1490 0x7f29500ac280 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:25.797 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.791+0000 7f295862e700 1 --2- 172.21.15.57:0/489110611 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f2934060550 0x7f2934062a00 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:25.797 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.791+0000 7f295862e700 1 --2- 172.21.15.57:0/489110611 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f29500b10c0 0x7f29500c0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:25.797 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.791+0000 7f295862e700 1 -- 172.21.15.57:0/489110611 >> 172.21.15.57:0/489110611 conn(0x7f29500cbdd0 msgr2=0x7f2950158f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:25.798 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.791+0000 7f295862e700 1 -- 172.21.15.57:0/489110611 shutdown_connections 2023-10-06T03:01:25.798 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.791+0000 7f295862e700 1 -- 172.21.15.57:0/489110611 wait complete. 2023-10-06T03:01:25.815 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T03:00:44.360651+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T03:00:50.466601+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T03:00:55.472586+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T03:00:56.400884+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T03:01:25.815 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T03:01:25.981 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.975+0000 7f0c05c16700 1 Processor -- start 2023-10-06T03:01:25.982 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.975+0000 7f0c05c16700 1 -- start start 2023-10-06T03:01:25.985 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.979+0000 7f0c05c16700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f0c000cb140 0x7f0c000cb510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:25.985 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.979+0000 7f0c05c16700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0c000b0080 0x7f0c000b04d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:25.985 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.979+0000 7f0c05c16700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0c0006d930 0x7f0c0006ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:25.986 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.979+0000 7f0c05c16700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c0006e2f0 con 0x7f0c0006d930 2023-10-06T03:01:25.986 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.979+0000 7f0c05c16700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c0006c920 con 0x7f0c000cb140 2023-10-06T03:01:25.986 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.979+0000 7f0c05c16700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c0006d4a0 con 0x7f0c000b0080 2023-10-06T03:01:25.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.979+0000 7f0c05415700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0c0006d930 0x7f0c0006ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:25.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.979+0000 7f0c05415700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0c0006d930 0x7f0c0006ddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33094/0 (socket says 172.21.15.57:33094) 2023-10-06T03:01:25.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.979+0000 7f0c05415700 1 -- 172.21.15.57:0/731669018 learned_addr learned my addr 172.21.15.57:0/731669018 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:25.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.979+0000 7f0c04c14700 1 --2- 172.21.15.57:0/731669018 >> v2:172.21.15.105:3300/0 conn(0x7f0c000cb140 0x7f0c000cb510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:25.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.979+0000 7f0bfffff700 1 --2- 172.21.15.57:0/731669018 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0c000b0080 0x7f0c000b04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:25.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.983+0000 7f0c05415700 1 -- 172.21.15.57:0/731669018 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0c000b0080 msgr2=0x7f0c000b04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:25.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.983+0000 7f0c05415700 1 --2- 172.21.15.57:0/731669018 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0c000b0080 0x7f0c000b04d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:25.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.983+0000 7f0c05415700 1 -- 172.21.15.57:0/731669018 >> v2:172.21.15.105:3300/0 conn(0x7f0c000cb140 msgr2=0x7f0c000cb510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:25.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.983+0000 7f0c05415700 1 --2- 172.21.15.57:0/731669018 >> v2:172.21.15.105:3300/0 conn(0x7f0c000cb140 0x7f0c000cb510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:25.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.983+0000 7f0c05415700 1 -- 172.21.15.57:0/731669018 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c0006cb70 con 0x7f0c0006d930 2023-10-06T03:01:25.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.983+0000 7f0bfffff700 1 --2- 172.21.15.57:0/731669018 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0c000b0080 0x7f0c000b04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:01:25.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.983+0000 7f0c05415700 1 --2- 172.21.15.57:0/731669018 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0c0006d930 0x7f0c0006ddb0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0c00063620 tx=0x7f0bf8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd77886f8f63ad9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:25.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.983+0000 7f0bff7fe700 1 -- 172.21.15.57:0/731669018 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bf800e070 con 0x7f0c0006d930 2023-10-06T03:01:25.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.983+0000 7f0bff7fe700 1 -- 172.21.15.57:0/731669018 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bf800ba20 con 0x7f0c0006d930 2023-10-06T03:01:25.989 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.983+0000 7f0bff7fe700 1 -- 172.21.15.57:0/731669018 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bf80092e0 con 0x7f0c0006d930 2023-10-06T03:01:25.989 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.983+0000 7f0c05c16700 1 -- 172.21.15.57:0/731669018 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0c0006d930 msgr2=0x7f0c0006ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:25.989 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.983+0000 7f0c05c16700 1 --2- 172.21.15.57:0/731669018 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0c0006d930 0x7f0c0006ddb0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0c00063620 tx=0x7f0bf8009840 comp rx=0 tx=0).stop 2023-10-06T03:01:25.990 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.983+0000 7f0c05c16700 1 -- 172.21.15.57:0/731669018 shutdown_connections 2023-10-06T03:01:25.990 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.983+0000 7f0c05c16700 1 --2- 172.21.15.57:0/731669018 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0c0006d930 0x7f0c0006ddb0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:25.990 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.983+0000 7f0c05c16700 1 --2- 172.21.15.57:0/731669018 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0c000b0080 0x7f0c000b04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:25.990 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.983+0000 7f0c05c16700 1 --2- 172.21.15.57:0/731669018 >> v2:172.21.15.105:3300/0 conn(0x7f0c000cb140 0x7f0c000cb510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:25.990 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.983+0000 7f0c05c16700 1 -- 172.21.15.57:0/731669018 >> 172.21.15.57:0/731669018 conn(0x7f0c000d0a50 msgr2=0x7f0c000cca60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:25.990 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.983+0000 7f0c05c16700 1 -- 172.21.15.57:0/731669018 shutdown_connections 2023-10-06T03:01:25.990 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.983+0000 7f0c05c16700 1 -- 172.21.15.57:0/731669018 wait complete. 2023-10-06T03:01:25.990 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.983+0000 7f0c05c16700 1 Processor -- start 2023-10-06T03:01:25.991 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.987+0000 7f0c05c16700 1 -- start start 2023-10-06T03:01:25.992 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.987+0000 7f0c05c16700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0c0006d930 0x7f0c0015ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:25.992 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.987+0000 7f0c05c16700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0c000b0080 0x7f0c000c5b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:25.992 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.987+0000 7f0c05c16700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0c000cb140 0x7f0c000c8670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:25.992 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.987+0000 7f0c05c16700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c000c7d40 con 0x7f0c0006d930 2023-10-06T03:01:25.992 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.987+0000 7f0c05c16700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c000c7130 con 0x7f0c000cb140 2023-10-06T03:01:25.992 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.987+0000 7f0c05c16700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c000c7410 con 0x7f0c000b0080 2023-10-06T03:01:25.993 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.987+0000 7f0c04c14700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0c0006d930 0x7f0c0015ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:25.994 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.987+0000 7f0c04c14700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0c0006d930 0x7f0c0015ac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33102/0 (socket says 172.21.15.57:33102) 2023-10-06T03:01:25.994 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.987+0000 7f0c04c14700 1 -- 172.21.15.57:0/1138081173 learned_addr learned my addr 172.21.15.57:0/1138081173 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:25.994 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.987+0000 7f0c05415700 1 --2- 172.21.15.57:0/1138081173 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0c000cb140 0x7f0c000c8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:25.994 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.987+0000 7f0bfffff700 1 --2- 172.21.15.57:0/1138081173 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0c000b0080 0x7f0c000c5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:25.994 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.987+0000 7f0c04c14700 1 -- 172.21.15.57:0/1138081173 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0c000b0080 msgr2=0x7f0c000c5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:25.994 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.987+0000 7f0c04c14700 1 --2- 172.21.15.57:0/1138081173 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0c000b0080 0x7f0c000c5b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:25.994 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.987+0000 7f0c04c14700 1 -- 172.21.15.57:0/1138081173 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0c000cb140 msgr2=0x7f0c000c8670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:25.994 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.987+0000 7f0c04c14700 1 --2- 172.21.15.57:0/1138081173 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0c000cb140 0x7f0c000c8670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:25.994 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.987+0000 7f0c04c14700 1 -- 172.21.15.57:0/1138081173 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bf8009ae0 con 0x7f0c0006d930 2023-10-06T03:01:25.994 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.987+0000 7f0c04c14700 1 --2- 172.21.15.57:0/1138081173 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0c0006d930 0x7f0c0015ac60 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f0bf400e930 tx=0x7f0bf40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:25.995 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.987+0000 7f0bfcff9700 1 -- 172.21.15.57:0/1138081173 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bf4009510 con 0x7f0c0006d930 2023-10-06T03:01:25.995 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.987+0000 7f0bfcff9700 1 -- 172.21.15.57:0/1138081173 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bf400c850 con 0x7f0c0006d930 2023-10-06T03:01:25.995 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.991+0000 7f0c05c16700 1 -- 172.21.15.57:0/1138081173 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c000c76f0 con 0x7f0c0006d930 2023-10-06T03:01:25.995 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.991+0000 7f0bfcff9700 1 -- 172.21.15.57:0/1138081173 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bf400cc10 con 0x7f0c0006d930 2023-10-06T03:01:25.995 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.991+0000 7f0c05c16700 1 -- 172.21.15.57:0/1138081173 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c0016dbe0 con 0x7f0c0006d930 2023-10-06T03:01:25.996 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.991+0000 7f0c05c16700 1 -- 172.21.15.57:0/1138081173 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c0004be40 con 0x7f0c0006d930 2023-10-06T03:01:25.997 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.991+0000 7f0bfcff9700 1 -- 172.21.15.57:0/1138081173 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f0bf4013470 con 0x7f0c0006d930 2023-10-06T03:01:26.001 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.995+0000 7f0bfcff9700 1 --2- 172.21.15.57:0/1138081173 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f0be4060620 0x7f0be4062ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:26.001 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.995+0000 7f0bfcff9700 1 -- 172.21.15.57:0/1138081173 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0bf407cab0 con 0x7f0c0006d930 2023-10-06T03:01:26.002 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.995+0000 7f0bfffff700 1 --2- 172.21.15.57:0/1138081173 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f0be4060620 0x7f0be4062ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:26.002 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:25.995+0000 7f0bfffff700 1 --2- 172.21.15.57:0/1138081173 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f0be4060620 0x7f0be4062ad0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0c0006e010 tx=0x7f0bec008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:26.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.003+0000 7f0bfcff9700 1 -- 172.21.15.57:0/1138081173 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f0bf404cf20 con 0x7f0c0006d930 2023-10-06T03:01:26.175 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.171+0000 7f0c05c16700 1 -- 172.21.15.57:0/1138081173 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0c000cd670 con 0x7f0c0006d930 2023-10-06T03:01:26.176 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.171+0000 7f0bfcff9700 1 -- 172.21.15.57:0/1138081173 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0bf4050540 con 0x7f0c0006d930 2023-10-06T03:01:26.176 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2023-10-06T03:01:26.179 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.175+0000 7f0c05c16700 1 -- 172.21.15.57:0/1138081173 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f0be4060620 msgr2=0x7f0be4062ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:26.179 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.175+0000 7f0c05c16700 1 --2- 172.21.15.57:0/1138081173 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f0be4060620 0x7f0be4062ad0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0c0006e010 tx=0x7f0bec008040 comp rx=0 tx=0).stop 2023-10-06T03:01:26.179 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.175+0000 7f0c05c16700 1 -- 172.21.15.57:0/1138081173 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0c0006d930 msgr2=0x7f0c0015ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:26.179 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.175+0000 7f0c05c16700 1 --2- 172.21.15.57:0/1138081173 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0c0006d930 0x7f0c0015ac60 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f0bf400e930 tx=0x7f0bf40091a0 comp rx=0 tx=0).stop 2023-10-06T03:01:26.180 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.175+0000 7f0c05c16700 1 -- 172.21.15.57:0/1138081173 shutdown_connections 2023-10-06T03:01:26.180 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.175+0000 7f0c05c16700 1 --2- 172.21.15.57:0/1138081173 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0c000cb140 0x7f0c000c8670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:26.180 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.175+0000 7f0c05c16700 1 --2- 172.21.15.57:0/1138081173 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f0be4060620 0x7f0be4062ad0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:26.180 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.175+0000 7f0c05c16700 1 --2- 172.21.15.57:0/1138081173 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0c000b0080 0x7f0c000c5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:26.180 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.175+0000 7f0c05c16700 1 --2- 172.21.15.57:0/1138081173 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0c0006d930 0x7f0c0015ac60 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:26.180 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.175+0000 7f0c05c16700 1 -- 172.21.15.57:0/1138081173 >> 172.21.15.57:0/1138081173 conn(0x7f0c000d0a50 msgr2=0x7f0c0006ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:26.180 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.175+0000 7f0c05c16700 1 -- 172.21.15.57:0/1138081173 shutdown_connections 2023-10-06T03:01:26.180 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.175+0000 7f0c05c16700 1 -- 172.21.15.57:0/1138081173 wait complete. 2023-10-06T03:01:26.198 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T03:01:26.366 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.359+0000 7f252208e700 1 Processor -- start 2023-10-06T03:01:26.366 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.359+0000 7f252208e700 1 -- start start 2023-10-06T03:01:26.369 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.363+0000 7f252208e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f251c0ae240 0x7f251c0ca1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:26.369 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.363+0000 7f252208e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f251c067f30 0x7f251c162c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:26.370 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.363+0000 7f252208e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f251c0cab70 con 0x7f251c0ca710 2023-10-06T03:01:26.370 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.363+0000 7f252208e700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f251c068370 con 0x7f251c0ae240 2023-10-06T03:01:26.370 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.363+0000 7f252208e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f251c06cc70 con 0x7f251c067f30 2023-10-06T03:01:26.370 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.363+0000 7f252108c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f251c0ae240 0x7f251c0ca1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:26.371 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.363+0000 7f252088b700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f251c0ca710 0x7f251c067820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:55468/0 (socket says 172.21.15.57:55468) 2023-10-06T03:01:26.371 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.363+0000 7f252088b700 1 -- 172.21.15.57:0/1562032572 learned_addr learned my addr 172.21.15.57:0/1562032572 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:01:26.371 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.363+0000 7f252188d700 1 --2- 172.21.15.57:0/1562032572 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f251c067f30 0x7f251c162c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:26.371 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.367+0000 7f252108c700 1 -- 172.21.15.57:0/1562032572 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f251c067f30 msgr2=0x7f251c162c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:26.371 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.367+0000 7f252108c700 1 --2- 172.21.15.57:0/1562032572 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f251c067f30 0x7f251c162c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:26.372 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.367+0000 7f252108c700 1 -- 172.21.15.57:0/1562032572 >> v1:172.21.15.57:6789/0 conn(0x7f251c0ca710 legacy=0x7f251c067820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:26.372 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.367+0000 7f252108c700 1 -- 172.21.15.57:0/1562032572 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f251c0ae610 con 0x7f251c0ae240 2023-10-06T03:01:26.372 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.367+0000 7f252188d700 1 --2- 172.21.15.57:0/1562032572 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f251c067f30 0x7f251c162c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:26.372 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.367+0000 7f252108c700 1 --2- 172.21.15.57:0/1562032572 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f251c0ae240 0x7f251c0ca1d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f2518009e60 tx=0x7f2518009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac1fdc770f095d25 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:26.372 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.367+0000 7f2513fff700 1 -- 172.21.15.57:0/1562032572 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f251800e070 con 0x7f251c0ae240 2023-10-06T03:01:26.372 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.367+0000 7f2513fff700 1 -- 172.21.15.57:0/1562032572 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f251800bc30 con 0x7f251c0ae240 2023-10-06T03:01:26.372 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.367+0000 7f2513fff700 1 -- 172.21.15.57:0/1562032572 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2518012430 con 0x7f251c0ae240 2023-10-06T03:01:26.374 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.367+0000 7f252208e700 1 -- 172.21.15.57:0/1562032572 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f251c0ae240 msgr2=0x7f251c0ca1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:26.374 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.367+0000 7f252208e700 1 --2- 172.21.15.57:0/1562032572 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f251c0ae240 0x7f251c0ca1d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f2518009e60 tx=0x7f2518009780 comp rx=0 tx=0).stop 2023-10-06T03:01:26.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.367+0000 7f252208e700 1 -- 172.21.15.57:0/1562032572 shutdown_connections 2023-10-06T03:01:26.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.367+0000 7f252208e700 1 --2- 172.21.15.57:0/1562032572 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f251c067f30 0x7f251c162c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:26.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.367+0000 7f252208e700 1 --2- 172.21.15.57:0/1562032572 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f251c0ae240 0x7f251c0ca1d0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:26.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.367+0000 7f252208e700 1 -- 172.21.15.57:0/1562032572 >> 172.21.15.57:0/1562032572 conn(0x7f251c0c8660 msgr2=0x7f251c0c8a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:26.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.371+0000 7f252208e700 1 -- 172.21.15.57:0/1562032572 shutdown_connections 2023-10-06T03:01:26.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.371+0000 7f252208e700 1 -- 172.21.15.57:0/1562032572 wait complete. 2023-10-06T03:01:26.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.371+0000 7f252208e700 1 Processor -- start 2023-10-06T03:01:26.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.371+0000 7f252208e700 1 -- start start 2023-10-06T03:01:26.378 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.371+0000 7f252208e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f251c067f30 0x7f251c14f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:26.378 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.371+0000 7f252208e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f251c0ae240 0x7f251c15b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:26.378 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.371+0000 7f252208e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f251c0ca710 0x7f251c15efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:26.378 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.371+0000 7f252208e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f251c0c3540 con 0x7f251c0ae240 2023-10-06T03:01:26.378 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.371+0000 7f252208e700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f251c0c36d0 con 0x7f251c067f30 2023-10-06T03:01:26.378 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.371+0000 7f252208e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f251c14fd00 con 0x7f251c0ca710 2023-10-06T03:01:26.379 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.371+0000 7f252088b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f251c0ae240 0x7f251c15b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:26.380 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.375+0000 7f252088b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f251c0ae240 0x7f251c15b6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33116/0 (socket says 172.21.15.57:33116) 2023-10-06T03:01:26.380 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.375+0000 7f252088b700 1 -- 172.21.15.57:0/620930336 learned_addr learned my addr 172.21.15.57:0/620930336 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:26.380 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.375+0000 7f252108c700 1 --2- 172.21.15.57:0/620930336 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f251c067f30 0x7f251c14f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:26.380 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.375+0000 7f252188d700 1 --2- 172.21.15.57:0/620930336 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f251c0ca710 0x7f251c15efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:26.380 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.375+0000 7f252088b700 1 -- 172.21.15.57:0/620930336 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f251c0ca710 msgr2=0x7f251c15efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:26.380 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.375+0000 7f252088b700 1 --2- 172.21.15.57:0/620930336 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f251c0ca710 0x7f251c15efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:26.380 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.375+0000 7f252088b700 1 -- 172.21.15.57:0/620930336 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f251c067f30 msgr2=0x7f251c14f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:26.380 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.375+0000 7f252088b700 1 --2- 172.21.15.57:0/620930336 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f251c067f30 0x7f251c14f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:26.380 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.375+0000 7f252088b700 1 -- 172.21.15.57:0/620930336 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2518009a20 con 0x7f251c0ae240 2023-10-06T03:01:26.380 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.375+0000 7f252088b700 1 --2- 172.21.15.57:0/620930336 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f251c0ae240 0x7f251c15b6d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f250c00c560 tx=0x7f250c001020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:26.381 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.375+0000 7f25117fa700 1 -- 172.21.15.57:0/620930336 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f250c005b30 con 0x7f251c0ae240 2023-10-06T03:01:26.381 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.375+0000 7f25117fa700 1 -- 172.21.15.57:0/620930336 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f250c005c90 con 0x7f251c0ae240 2023-10-06T03:01:26.381 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.375+0000 7f252208e700 1 -- 172.21.15.57:0/620930336 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f251c15c250 con 0x7f251c0ae240 2023-10-06T03:01:26.381 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.375+0000 7f25117fa700 1 -- 172.21.15.57:0/620930336 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f250c007320 con 0x7f251c0ae240 2023-10-06T03:01:26.381 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.375+0000 7f252208e700 1 -- 172.21.15.57:0/620930336 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f251c15c810 con 0x7f251c0ae240 2023-10-06T03:01:26.382 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.375+0000 7f252208e700 1 -- 172.21.15.57:0/620930336 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f251c04be40 con 0x7f251c0ae240 2023-10-06T03:01:26.383 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.379+0000 7f25117fa700 1 -- 172.21.15.57:0/620930336 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f250c01b3b0 con 0x7f251c0ae240 2023-10-06T03:01:26.385 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.379+0000 7f25117fa700 1 --2- 172.21.15.57:0/620930336 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f2500060580 0x7f2500062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:26.385 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.379+0000 7f25117fa700 1 -- 172.21.15.57:0/620930336 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f250c07bb70 con 0x7f251c0ae240 2023-10-06T03:01:26.385 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.379+0000 7f252108c700 1 --2- 172.21.15.57:0/620930336 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f2500060580 0x7f2500062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:26.386 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.379+0000 7f252108c700 1 --2- 172.21.15.57:0/620930336 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f2500060580 0x7f2500062a30 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2518009e60 tx=0x7f2518019000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:26.390 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.387+0000 7f25117fa700 1 -- 172.21.15.57:0/620930336 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f250c04bf60 con 0x7f251c0ae240 2023-10-06T03:01:26.560 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.555+0000 7f252208e700 1 -- 172.21.15.57:0/620930336 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f251c0cab70 con 0x7f251c0ae240 2023-10-06T03:01:26.561 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.555+0000 7f25117fa700 1 -- 172.21.15.57:0/620930336 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f251c0cab70 con 0x7f251c0ae240 2023-10-06T03:01:26.561 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2023-10-06T03:01:26.564 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.559+0000 7f252208e700 1 -- 172.21.15.57:0/620930336 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f2500060580 msgr2=0x7f2500062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:26.564 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.559+0000 7f252208e700 1 --2- 172.21.15.57:0/620930336 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f2500060580 0x7f2500062a30 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2518009e60 tx=0x7f2518019000 comp rx=0 tx=0).stop 2023-10-06T03:01:26.564 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.559+0000 7f252208e700 1 -- 172.21.15.57:0/620930336 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f251c0ae240 msgr2=0x7f251c15b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:26.564 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.559+0000 7f252208e700 1 --2- 172.21.15.57:0/620930336 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f251c0ae240 0x7f251c15b6d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f250c00c560 tx=0x7f250c001020 comp rx=0 tx=0).stop 2023-10-06T03:01:26.565 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.559+0000 7f252208e700 1 -- 172.21.15.57:0/620930336 shutdown_connections 2023-10-06T03:01:26.565 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.559+0000 7f252208e700 1 --2- 172.21.15.57:0/620930336 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f2500060580 0x7f2500062a30 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:26.565 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.559+0000 7f252208e700 1 --2- 172.21.15.57:0/620930336 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f251c0ca710 0x7f251c15efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:26.565 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.559+0000 7f252208e700 1 --2- 172.21.15.57:0/620930336 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f251c0ae240 0x7f251c15b6d0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:26.565 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.559+0000 7f252208e700 1 --2- 172.21.15.57:0/620930336 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f251c067f30 0x7f251c14f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:26.565 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.559+0000 7f252208e700 1 -- 172.21.15.57:0/620930336 >> 172.21.15.57:0/620930336 conn(0x7f251c0c8660 msgr2=0x7f251c157120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:26.565 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.559+0000 7f252208e700 1 -- 172.21.15.57:0/620930336 shutdown_connections 2023-10-06T03:01:26.565 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.559+0000 7f252208e700 1 -- 172.21.15.57:0/620930336 wait complete. 2023-10-06T03:01:26.585 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T03:01:26.749 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.743+0000 7f14b0425700 1 Processor -- start 2023-10-06T03:01:26.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.743+0000 7f14b0425700 1 -- start start 2023-10-06T03:01:26.751 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.747+0000 7f14b0425700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f14a806b450 0x7f14a8153950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:26.751 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.747+0000 7f14b0425700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14a80cb3e0 con 0x7f14a80c5910 2023-10-06T03:01:26.752 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.747+0000 7f14b0425700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14a8159b80 con 0x7f14a8153580 2023-10-06T03:01:26.752 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.747+0000 7f14b0425700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14a806c920 con 0x7f14a806b450 2023-10-06T03:01:26.752 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.747+0000 7f14ae9c2700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f14a80c5910 0x7f14a80cb870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:55484/0 (socket says 172.21.15.57:55484) 2023-10-06T03:01:26.752 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.747+0000 7f14ae9c2700 1 -- 172.21.15.57:0/3600158038 learned_addr learned my addr 172.21.15.57:0/3600158038 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:01:26.752 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.747+0000 7f14ad9c0700 1 --2- 172.21.15.57:0/3600158038 >> v2:172.21.15.105:3300/0 conn(0x7f14a806b450 0x7f14a8153950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:26.753 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.747+0000 7f14ad9c0700 1 -- 172.21.15.57:0/3600158038 >> v1:172.21.15.105:6789/0 conn(0x7f14a8153580 legacy=0x7f14a806ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:26.753 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.747+0000 7f14ad9c0700 1 -- 172.21.15.57:0/3600158038 >> v1:172.21.15.57:6789/0 conn(0x7f14a80c5910 legacy=0x7f14a80cb870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:26.753 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.747+0000 7f14ad9c0700 1 -- 172.21.15.57:0/3600158038 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14a806b920 con 0x7f14a806b450 2023-10-06T03:01:26.754 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.747+0000 7f14ad9c0700 1 --2- 172.21.15.57:0/3600158038 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f14a806b450 0x7f14a8153950 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1498009910 tx=0x7f14980091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=56076e9e2bc27429 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:26.760 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.755+0000 7f14ad1bf700 1 -- 172.21.15.57:0/3600158038 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f149800b820 con 0x7f14a806b450 2023-10-06T03:01:26.760 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.755+0000 7f14ad1bf700 1 -- 172.21.15.57:0/3600158038 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f149800b980 con 0x7f14a806b450 2023-10-06T03:01:26.761 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.755+0000 7f14ad1bf700 1 -- 172.21.15.57:0/3600158038 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f149800bd20 con 0x7f14a806b450 2023-10-06T03:01:26.761 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.755+0000 7f14b0425700 1 -- 172.21.15.57:0/3600158038 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f14a806b450 msgr2=0x7f14a8153950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:26.761 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.755+0000 7f14b0425700 1 --2- 172.21.15.57:0/3600158038 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f14a806b450 0x7f14a8153950 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1498009910 tx=0x7f14980091a0 comp rx=0 tx=0).stop 2023-10-06T03:01:26.762 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.759+0000 7f14b0425700 1 -- 172.21.15.57:0/3600158038 shutdown_connections 2023-10-06T03:01:26.763 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.759+0000 7f14b0425700 1 --2- 172.21.15.57:0/3600158038 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f14a806b450 0x7f14a8153950 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:26.763 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.759+0000 7f14b0425700 1 -- 172.21.15.57:0/3600158038 >> 172.21.15.57:0/3600158038 conn(0x7f14a80ccbd0 msgr2=0x7f14a80ccfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:26.763 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.759+0000 7f14b0425700 1 -- 172.21.15.57:0/3600158038 shutdown_connections 2023-10-06T03:01:26.763 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.759+0000 7f14b0425700 1 -- 172.21.15.57:0/3600158038 wait complete. 2023-10-06T03:01:26.765 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.759+0000 7f14b0425700 1 Processor -- start 2023-10-06T03:01:26.766 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.759+0000 7f14b0425700 1 -- start start 2023-10-06T03:01:26.768 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.763+0000 7f14b0425700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14a806b450 0x7f14a80b5640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:26.768 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.763+0000 7f14b0425700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f14a80c5910 0x7f14a80c8b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:26.768 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.763+0000 7f14b0425700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f14a8153580 0x7f14a8158420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:26.768 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.763+0000 7f14b0425700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14a80c9530 con 0x7f14a806b450 2023-10-06T03:01:26.768 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.763+0000 7f14b0425700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14a80c9810 con 0x7f14a8153580 2023-10-06T03:01:26.768 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.763+0000 7f14b0425700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14a80c9af0 con 0x7f14a80c5910 2023-10-06T03:01:26.769 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.763+0000 7f14ae1c1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14a806b450 0x7f14a80b5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:26.769 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.763+0000 7f14ad9c0700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f14a80c5910 0x7f14a80c8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:26.769 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.763+0000 7f14ae9c2700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f14a8153580 0x7f14a8158420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:26.770 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.763+0000 7f14ae9c2700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f14a8153580 0x7f14a8158420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.57:55318/0 (socket says 172.21.15.57:55318) 2023-10-06T03:01:26.770 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.763+0000 7f14ae9c2700 1 -- 172.21.15.57:0/4175503070 learned_addr learned my addr 172.21.15.57:0/4175503070 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:26.770 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.763+0000 7f14ae1c1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14a806b450 0x7f14a80b5640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33126/0 (socket says 172.21.15.57:33126) 2023-10-06T03:01:26.770 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.763+0000 7f14ae9c2700 1 -- 172.21.15.57:0/4175503070 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f14a80c5910 msgr2=0x7f14a80c8b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:26.770 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.763+0000 7f14ae9c2700 1 --2- 172.21.15.57:0/4175503070 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f14a80c5910 0x7f14a80c8b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:26.770 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.763+0000 7f14ae9c2700 1 -- 172.21.15.57:0/4175503070 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14a806b450 msgr2=0x7f14a80b5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:26.770 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.763+0000 7f14ae9c2700 1 --2- 172.21.15.57:0/4175503070 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14a806b450 0x7f14a80b5640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:26.770 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.763+0000 7f14ae9c2700 1 -- 172.21.15.57:0/4175503070 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1498009420 con 0x7f14a8153580 2023-10-06T03:01:26.771 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.763+0000 7f14ae9c2700 1 --2- 172.21.15.57:0/4175503070 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f14a8153580 0x7f14a8158420 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f14a000cc40 tx=0x7f14a0001a50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:26.771 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.763+0000 7f149e7fc700 1 -- 172.21.15.57:0/4175503070 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a000a8b0 con 0x7f14a8153580 2023-10-06T03:01:26.771 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.763+0000 7f149e7fc700 1 -- 172.21.15.57:0/4175503070 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14a000aa10 con 0x7f14a8153580 2023-10-06T03:01:26.771 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.763+0000 7f149e7fc700 1 -- 172.21.15.57:0/4175503070 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a000add0 con 0x7f14a8153580 2023-10-06T03:01:26.771 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.763+0000 7f14b0425700 1 -- 172.21.15.57:0/4175503070 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14a80c9dd0 con 0x7f14a8153580 2023-10-06T03:01:26.771 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.767+0000 7f14b0425700 1 -- 172.21.15.57:0/4175503070 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14a80b5b80 con 0x7f14a8153580 2023-10-06T03:01:26.772 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.767+0000 7f14b0425700 1 -- 172.21.15.57:0/4175503070 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14a80ca2b0 con 0x7f14a8153580 2023-10-06T03:01:26.774 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.767+0000 7f149e7fc700 1 -- 172.21.15.57:0/4175503070 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f14a0007300 con 0x7f14a8153580 2023-10-06T03:01:26.774 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.771+0000 7f149e7fc700 1 --2- 172.21.15.57:0/4175503070 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f148c060550 0x7f148c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:26.774 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.771+0000 7f149e7fc700 1 -- 172.21.15.57:0/4175503070 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f14a007cc60 con 0x7f14a8153580 2023-10-06T03:01:26.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.771+0000 7f14ae1c1700 1 --2- 172.21.15.57:0/4175503070 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f148c060550 0x7f148c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:26.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.771+0000 7f14ae1c1700 1 --2- 172.21.15.57:0/4175503070 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f148c060550 0x7f148c062a00 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f14a4000c00 tx=0x7f14a4007ea0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:26.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.775+0000 7f149e7fc700 1 -- 172.21.15.57:0/4175503070 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f14a004d0d0 con 0x7f14a8153580 2023-10-06T03:01:26.948 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.943+0000 7f14b0425700 1 -- 172.21.15.57:0/4175503070 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f14a80712e0 con 0x7f14a8153580 2023-10-06T03:01:26.949 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.943+0000 7f149e7fc700 1 -- 172.21.15.57:0/4175503070 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f14a00506f0 con 0x7f14a8153580 2023-10-06T03:01:26.949 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2023-10-06T03:01:26.954 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.947+0000 7f14b0425700 1 -- 172.21.15.57:0/4175503070 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f148c060550 msgr2=0x7f148c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:26.954 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.947+0000 7f14b0425700 1 --2- 172.21.15.57:0/4175503070 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f148c060550 0x7f148c062a00 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f14a4000c00 tx=0x7f14a4007ea0 comp rx=0 tx=0).stop 2023-10-06T03:01:26.954 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.947+0000 7f14b0425700 1 -- 172.21.15.57:0/4175503070 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f14a8153580 msgr2=0x7f14a8158420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:26.954 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.947+0000 7f14b0425700 1 --2- 172.21.15.57:0/4175503070 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f14a8153580 0x7f14a8158420 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f14a000cc40 tx=0x7f14a0001a50 comp rx=0 tx=0).stop 2023-10-06T03:01:26.954 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.947+0000 7f14b0425700 1 -- 172.21.15.57:0/4175503070 shutdown_connections 2023-10-06T03:01:26.954 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.947+0000 7f14b0425700 1 --2- 172.21.15.57:0/4175503070 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f14a8153580 0x7f14a8158420 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:26.954 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.947+0000 7f14b0425700 1 --2- 172.21.15.57:0/4175503070 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f148c060550 0x7f148c062a00 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:26.955 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.947+0000 7f14b0425700 1 --2- 172.21.15.57:0/4175503070 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f14a80c5910 0x7f14a80c8b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:26.955 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.947+0000 7f14b0425700 1 --2- 172.21.15.57:0/4175503070 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14a806b450 0x7f14a80b5640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:26.955 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.947+0000 7f14b0425700 1 -- 172.21.15.57:0/4175503070 >> 172.21.15.57:0/4175503070 conn(0x7f14a80ccbd0 msgr2=0x7f14a80c4f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:26.955 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.947+0000 7f14b0425700 1 -- 172.21.15.57:0/4175503070 shutdown_connections 2023-10-06T03:01:26.955 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:26.947+0000 7f14b0425700 1 -- 172.21.15.57:0/4175503070 wait complete. 2023-10-06T03:01:26.974 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T03:01:27.144 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.139+0000 7f8e40345700 1 Processor -- start 2023-10-06T03:01:27.145 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.139+0000 7f8e40345700 1 -- start start 2023-10-06T03:01:27.149 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.143+0000 7f8e40345700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f8e38156e20 0x7f8e380adf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:27.149 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.143+0000 7f8e40345700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f8e381571f0 0x7f8e3806d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:27.149 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.143+0000 7f8e40345700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e3806afd0 con 0x7f8e380aeb10 2023-10-06T03:01:27.149 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.143+0000 7f8e40345700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e380ac6c0 con 0x7f8e381571f0 2023-10-06T03:01:27.149 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.143+0000 7f8e40345700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e380ac9a0 con 0x7f8e38156e20 2023-10-06T03:01:27.150 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.143+0000 7f8e3e8e2700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f8e381571f0 0x7f8e3806d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:27.150 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.143+0000 7f8e3e8e2700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f8e381571f0 0x7f8e3806d030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33140/0 (socket says 172.21.15.57:33140) 2023-10-06T03:01:27.150 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.143+0000 7f8e3e8e2700 1 -- 172.21.15.57:0/543110790 learned_addr learned my addr 172.21.15.57:0/543110790 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:27.150 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.143+0000 7f8e3e0e1700 1 --2- 172.21.15.57:0/543110790 >> v2:172.21.15.105:3300/0 conn(0x7f8e38156e20 0x7f8e380adf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:27.151 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.147+0000 7f8e3e8e2700 1 -- 172.21.15.57:0/543110790 >> v2:172.21.15.105:3300/0 conn(0x7f8e38156e20 msgr2=0x7f8e380adf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:27.151 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.147+0000 7f8e3e8e2700 1 --2- 172.21.15.57:0/543110790 >> v2:172.21.15.105:3300/0 conn(0x7f8e38156e20 0x7f8e380adf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:27.151 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.147+0000 7f8e3e8e2700 1 -- 172.21.15.57:0/543110790 >> v1:172.21.15.105:6789/0 conn(0x7f8e380aeb10 legacy=0x7f8e3806c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:27.151 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.147+0000 7f8e3e8e2700 1 -- 172.21.15.57:0/543110790 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e3806a980 con 0x7f8e381571f0 2023-10-06T03:01:27.151 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.147+0000 7f8e3e8e2700 1 --2- 172.21.15.57:0/543110790 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e381571f0 0x7f8e3806d030 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f8e380ccdb0 tx=0x7f8e30009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cba7bfebb5b65df6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:27.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.147+0000 7f8e3d0df700 1 -- 172.21.15.57:0/543110790 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e3000e070 con 0x7f8e381571f0 2023-10-06T03:01:27.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.147+0000 7f8e3d0df700 1 -- 172.21.15.57:0/543110790 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e3000ba20 con 0x7f8e381571f0 2023-10-06T03:01:27.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.147+0000 7f8e3d0df700 1 -- 172.21.15.57:0/543110790 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e300092e0 con 0x7f8e381571f0 2023-10-06T03:01:27.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.147+0000 7f8e40345700 1 -- 172.21.15.57:0/543110790 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e381571f0 msgr2=0x7f8e3806d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:27.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.147+0000 7f8e40345700 1 --2- 172.21.15.57:0/543110790 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e381571f0 0x7f8e3806d030 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f8e380ccdb0 tx=0x7f8e30009840 comp rx=0 tx=0).stop 2023-10-06T03:01:27.153 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.147+0000 7f8e40345700 1 -- 172.21.15.57:0/543110790 shutdown_connections 2023-10-06T03:01:27.153 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.147+0000 7f8e40345700 1 --2- 172.21.15.57:0/543110790 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e381571f0 0x7f8e3806d030 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:27.153 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.147+0000 7f8e40345700 1 --2- 172.21.15.57:0/543110790 >> v2:172.21.15.105:3300/0 conn(0x7f8e38156e20 0x7f8e380adf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:27.153 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.147+0000 7f8e40345700 1 -- 172.21.15.57:0/543110790 >> 172.21.15.57:0/543110790 conn(0x7f8e380c87b0 msgr2=0x7f8e380c8bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:27.154 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.147+0000 7f8e40345700 1 -- 172.21.15.57:0/543110790 shutdown_connections 2023-10-06T03:01:27.154 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.147+0000 7f8e40345700 1 -- 172.21.15.57:0/543110790 wait complete. 2023-10-06T03:01:27.155 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.151+0000 7f8e40345700 1 Processor -- start 2023-10-06T03:01:27.155 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.151+0000 7f8e40345700 1 -- start start 2023-10-06T03:01:27.157 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.151+0000 7f8e40345700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e380aeb10 0x7f8e380c62e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:27.157 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.151+0000 7f8e40345700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8e38156e20 0x7f8e381560a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:27.157 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.151+0000 7f8e40345700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8e381571f0 0x7f8e380a88d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:27.157 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.151+0000 7f8e40345700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e380c69e0 con 0x7f8e380aeb10 2023-10-06T03:01:27.157 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.151+0000 7f8e40345700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e380c6cc0 con 0x7f8e381571f0 2023-10-06T03:01:27.157 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.151+0000 7f8e40345700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e380c6fa0 con 0x7f8e38156e20 2023-10-06T03:01:27.158 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.151+0000 7f8e3e0e1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e380aeb10 0x7f8e380c62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:27.158 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.151+0000 7f8e3e0e1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e380aeb10 0x7f8e380c62e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33142/0 (socket says 172.21.15.57:33142) 2023-10-06T03:01:27.159 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.151+0000 7f8e3e0e1700 1 -- 172.21.15.57:0/3527628100 learned_addr learned my addr 172.21.15.57:0/3527628100 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:27.159 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.151+0000 7f8e3e8e2700 1 --2- 172.21.15.57:0/3527628100 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8e381571f0 0x7f8e380a88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:27.159 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.151+0000 7f8e3d8e0700 1 --2- 172.21.15.57:0/3527628100 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8e38156e20 0x7f8e381560a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:27.159 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.151+0000 7f8e3e0e1700 1 -- 172.21.15.57:0/3527628100 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8e38156e20 msgr2=0x7f8e381560a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:27.159 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.151+0000 7f8e3e0e1700 1 --2- 172.21.15.57:0/3527628100 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8e38156e20 0x7f8e381560a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:27.159 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.151+0000 7f8e3e0e1700 1 -- 172.21.15.57:0/3527628100 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8e381571f0 msgr2=0x7f8e380a88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:27.159 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.151+0000 7f8e3e0e1700 1 --2- 172.21.15.57:0/3527628100 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8e381571f0 0x7f8e380a88d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:27.159 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.151+0000 7f8e3e0e1700 1 -- 172.21.15.57:0/3527628100 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e30009ae0 con 0x7f8e380aeb10 2023-10-06T03:01:27.159 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.151+0000 7f8e3e8e2700 1 --2- 172.21.15.57:0/3527628100 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8e381571f0 0x7f8e380a88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:01:27.160 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.155+0000 7f8e3e0e1700 1 --2- 172.21.15.57:0/3527628100 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e380aeb10 0x7f8e380c62e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f8e3400ec80 tx=0x7f8e340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:27.160 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.155+0000 7f8e2e7fc700 1 -- 172.21.15.57:0/3527628100 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e3400c850 con 0x7f8e380aeb10 2023-10-06T03:01:27.160 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.155+0000 7f8e2e7fc700 1 -- 172.21.15.57:0/3527628100 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e3400c9b0 con 0x7f8e380aeb10 2023-10-06T03:01:27.160 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.155+0000 7f8e40345700 1 -- 172.21.15.57:0/3527628100 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e380c7280 con 0x7f8e380aeb10 2023-10-06T03:01:27.160 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.155+0000 7f8e2e7fc700 1 -- 172.21.15.57:0/3527628100 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e3400cd50 con 0x7f8e380aeb10 2023-10-06T03:01:27.160 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.155+0000 7f8e40345700 1 -- 172.21.15.57:0/3527628100 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e381565e0 con 0x7f8e380aeb10 2023-10-06T03:01:27.161 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.155+0000 7f8e40345700 1 -- 172.21.15.57:0/3527628100 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e380712e0 con 0x7f8e380aeb10 2023-10-06T03:01:27.163 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.159+0000 7f8e2e7fc700 1 -- 172.21.15.57:0/3527628100 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f8e34013680 con 0x7f8e380aeb10 2023-10-06T03:01:27.165 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.159+0000 7f8e2e7fc700 1 --2- 172.21.15.57:0/3527628100 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f8e1c060550 0x7f8e1c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:27.165 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.159+0000 7f8e2e7fc700 1 -- 172.21.15.57:0/3527628100 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8e3407cc30 con 0x7f8e380aeb10 2023-10-06T03:01:27.165 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.159+0000 7f8e3d8e0700 1 --2- 172.21.15.57:0/3527628100 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f8e1c060550 0x7f8e1c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:27.166 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.159+0000 7f8e3d8e0700 1 --2- 172.21.15.57:0/3527628100 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f8e1c060550 0x7f8e1c062a00 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8e380b0d60 tx=0x7f8e28007ec0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:27.170 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.167+0000 7f8e2e7fc700 1 -- 172.21.15.57:0/3527628100 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f8e3404d020 con 0x7f8e380aeb10 2023-10-06T03:01:27.343 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.339+0000 7f8e40345700 1 -- 172.21.15.57:0/3527628100 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8e3806ac60 con 0x7f8e380aeb10 2023-10-06T03:01:27.344 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.339+0000 7f8e2e7fc700 1 -- 172.21.15.57:0/3527628100 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8e34050640 con 0x7f8e380aeb10 2023-10-06T03:01:27.344 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 64 2023-10-06T03:01:27.347 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.339+0000 7f8e40345700 1 -- 172.21.15.57:0/3527628100 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f8e1c060550 msgr2=0x7f8e1c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:27.347 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.339+0000 7f8e40345700 1 --2- 172.21.15.57:0/3527628100 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f8e1c060550 0x7f8e1c062a00 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8e380b0d60 tx=0x7f8e28007ec0 comp rx=0 tx=0).stop 2023-10-06T03:01:27.347 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.339+0000 7f8e40345700 1 -- 172.21.15.57:0/3527628100 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e380aeb10 msgr2=0x7f8e380c62e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:27.347 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.339+0000 7f8e40345700 1 --2- 172.21.15.57:0/3527628100 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e380aeb10 0x7f8e380c62e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f8e3400ec80 tx=0x7f8e340091a0 comp rx=0 tx=0).stop 2023-10-06T03:01:27.347 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.343+0000 7f8e40345700 1 -- 172.21.15.57:0/3527628100 shutdown_connections 2023-10-06T03:01:27.347 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.343+0000 7f8e40345700 1 --2- 172.21.15.57:0/3527628100 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8e381571f0 0x7f8e380a88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:27.347 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.343+0000 7f8e40345700 1 --2- 172.21.15.57:0/3527628100 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f8e1c060550 0x7f8e1c062a00 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:27.347 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.343+0000 7f8e40345700 1 --2- 172.21.15.57:0/3527628100 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8e38156e20 0x7f8e381560a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:27.347 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.343+0000 7f8e40345700 1 --2- 172.21.15.57:0/3527628100 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e380aeb10 0x7f8e380c62e0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:27.347 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.343+0000 7f8e40345700 1 -- 172.21.15.57:0/3527628100 >> 172.21.15.57:0/3527628100 conn(0x7f8e380c87b0 msgr2=0x7f8e38067050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:27.348 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.343+0000 7f8e40345700 1 -- 172.21.15.57:0/3527628100 shutdown_connections 2023-10-06T03:01:27.348 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.343+0000 7f8e40345700 1 -- 172.21.15.57:0/3527628100 wait complete. 2023-10-06T03:01:27.368 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:01:27.533 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.527+0000 7fcdc14a3700 1 Processor -- start 2023-10-06T03:01:27.534 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.527+0000 7fcdc14a3700 1 -- start start 2023-10-06T03:01:27.537 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.531+0000 7fcdc14a3700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcdbc0aa7e0 0x7fcdbc06bba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:27.537 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.531+0000 7fcdc14a3700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdbc06de50 con 0x7fcdbc06c920 2023-10-06T03:01:27.537 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.531+0000 7fcdc14a3700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdbc06e130 con 0x7fcdbc0aae90 2023-10-06T03:01:27.537 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.531+0000 7fcdc14a3700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdbc06b3a0 con 0x7fcdbc0aa7e0 2023-10-06T03:01:27.537 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.531+0000 7fcdbbfff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fcdbc06c920 0x7fcdbc06ccf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:55496/0 (socket says 172.21.15.57:55496) 2023-10-06T03:01:27.537 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.531+0000 7fcdbbfff700 1 -- 172.21.15.57:0/3629659392 learned_addr learned my addr 172.21.15.57:0/3629659392 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:01:27.538 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.531+0000 7fcdc0ca2700 1 --2- 172.21.15.57:0/3629659392 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcdbc0aa7e0 0x7fcdbc06bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:27.538 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.531+0000 7fcdbb7fe700 1 -- 172.21.15.57:0/3629659392 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 917648957 0 0) 0x7fcdbc06de50 con 0x7fcdbc06c920 2023-10-06T03:01:27.538 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.531+0000 7fcdbb7fe700 1 -- 172.21.15.57:0/3629659392 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcda8003570 con 0x7fcdbc06c920 2023-10-06T03:01:27.538 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.531+0000 7fcdbb7fe700 1 -- 172.21.15.57:0/3629659392 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1315175162 0 0) 0x7fcdbc06e130 con 0x7fcdbc0aae90 2023-10-06T03:01:27.539 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.531+0000 7fcdbb7fe700 1 -- 172.21.15.57:0/3629659392 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcdbc06de50 con 0x7fcdbc0aae90 2023-10-06T03:01:27.539 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.531+0000 7fcdc0ca2700 1 -- 172.21.15.57:0/3629659392 >> v1:172.21.15.105:6789/0 conn(0x7fcdbc0aae90 legacy=0x7fcdbc0ab970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:27.539 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.531+0000 7fcdc0ca2700 1 -- 172.21.15.57:0/3629659392 >> v1:172.21.15.57:6789/0 conn(0x7fcdbc06c920 legacy=0x7fcdbc06ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:27.539 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.531+0000 7fcdbb7fe700 1 -- 172.21.15.57:0/3629659392 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1048360585 0 0) 0x7fcda8003570 con 0x7fcdbc06c920 2023-10-06T03:01:27.539 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.535+0000 7fcdc0ca2700 1 -- 172.21.15.57:0/3629659392 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdbc06b680 con 0x7fcdbc0aa7e0 2023-10-06T03:01:27.539 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.535+0000 7fcdc0ca2700 1 --2- 172.21.15.57:0/3629659392 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcdbc0aa7e0 0x7fcdbc06bba0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fcdb4009e90 tx=0x7fcdb4009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6513cff75b273252 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:27.540 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.535+0000 7fcdbb7fe700 1 -- 172.21.15.57:0/3629659392 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdb400e070 con 0x7fcdbc0aa7e0 2023-10-06T03:01:27.540 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.535+0000 7fcdbb7fe700 1 -- 172.21.15.57:0/3629659392 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdb400b870 con 0x7fcdbc0aa7e0 2023-10-06T03:01:27.540 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.535+0000 7fcdbb7fe700 1 -- 172.21.15.57:0/3629659392 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdac001490 con 0x7fcdbc0aa7e0 2023-10-06T03:01:27.540 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.535+0000 7fcdc14a3700 1 -- 172.21.15.57:0/3629659392 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcdbc0aa7e0 msgr2=0x7fcdbc06bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:27.540 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.535+0000 7fcdc14a3700 1 --2- 172.21.15.57:0/3629659392 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcdbc0aa7e0 0x7fcdbc06bba0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fcdb4009e90 tx=0x7fcdb4009780 comp rx=0 tx=0).stop 2023-10-06T03:01:27.541 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.535+0000 7fcdc14a3700 1 -- 172.21.15.57:0/3629659392 shutdown_connections 2023-10-06T03:01:27.541 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.535+0000 7fcdc14a3700 1 --2- 172.21.15.57:0/3629659392 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcdbc0aa7e0 0x7fcdbc06bba0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:27.541 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.535+0000 7fcdc14a3700 1 -- 172.21.15.57:0/3629659392 >> 172.21.15.57:0/3629659392 conn(0x7fcdbc0c85e0 msgr2=0x7fcdbc0c89e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:27.541 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.535+0000 7fcdc14a3700 1 -- 172.21.15.57:0/3629659392 shutdown_connections 2023-10-06T03:01:27.541 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.535+0000 7fcdc14a3700 1 -- 172.21.15.57:0/3629659392 wait complete. 2023-10-06T03:01:27.543 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.539+0000 7fcdc14a3700 1 Processor -- start 2023-10-06T03:01:27.543 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.539+0000 7fcdc14a3700 1 -- start start 2023-10-06T03:01:27.545 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.539+0000 7fcdc14a3700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcdbc06c920 0x7fcdbc154c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:27.545 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.539+0000 7fcdc14a3700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcdbc0aa7e0 0x7fcdbc0b1040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:27.545 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.539+0000 7fcdc14a3700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcdbc0aae90 0x7fcdbc0abab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:27.545 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.539+0000 7fcdc14a3700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdbc0af5d0 con 0x7fcdbc06c920 2023-10-06T03:01:27.545 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.539+0000 7fcdc14a3700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdbc0c22c0 con 0x7fcdbc0aae90 2023-10-06T03:01:27.545 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.539+0000 7fcdc14a3700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdbc0ae9c0 con 0x7fcdbc0aa7e0 2023-10-06T03:01:27.546 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.539+0000 7fcdbbfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcdbc06c920 0x7fcdbc154c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:27.546 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.539+0000 7fcdbbfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcdbc06c920 0x7fcdbc154c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33144/0 (socket says 172.21.15.57:33144) 2023-10-06T03:01:27.546 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.539+0000 7fcdbbfff700 1 -- 172.21.15.57:0/2326954104 learned_addr learned my addr 172.21.15.57:0/2326954104 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:27.546 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.539+0000 7fcdc0ca2700 1 --2- 172.21.15.57:0/2326954104 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcdbc0aae90 0x7fcdbc0abab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:27.546 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.539+0000 7fcdb3fff700 1 --2- 172.21.15.57:0/2326954104 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcdbc0aa7e0 0x7fcdbc0b1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:27.547 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.539+0000 7fcdbbfff700 1 -- 172.21.15.57:0/2326954104 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcdbc0aa7e0 msgr2=0x7fcdbc0b1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:27.547 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.539+0000 7fcdbbfff700 1 --2- 172.21.15.57:0/2326954104 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcdbc0aa7e0 0x7fcdbc0b1040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:27.547 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.539+0000 7fcdbbfff700 1 -- 172.21.15.57:0/2326954104 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcdbc0aae90 msgr2=0x7fcdbc0abab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:27.547 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.539+0000 7fcdbbfff700 1 --2- 172.21.15.57:0/2326954104 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcdbc0aae90 0x7fcdbc0abab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:27.547 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.539+0000 7fcdbbfff700 1 -- 172.21.15.57:0/2326954104 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdb4009a20 con 0x7fcdbc06c920 2023-10-06T03:01:27.548 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.543+0000 7fcdbbfff700 1 --2- 172.21.15.57:0/2326954104 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcdbc06c920 0x7fcdbc154c20 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fcdac00cb60 tx=0x7fcdac001af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:27.548 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.543+0000 7fcdb8ff9700 1 -- 172.21.15.57:0/2326954104 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdac007e90 con 0x7fcdbc06c920 2023-10-06T03:01:27.548 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.543+0000 7fcdb8ff9700 1 -- 172.21.15.57:0/2326954104 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdac00ce70 con 0x7fcdbc06c920 2023-10-06T03:01:27.548 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.543+0000 7fcdc14a3700 1 -- 172.21.15.57:0/2326954104 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdbc0aeca0 con 0x7fcdbc06c920 2023-10-06T03:01:27.548 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.543+0000 7fcdb8ff9700 1 -- 172.21.15.57:0/2326954104 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdac007590 con 0x7fcdbc06c920 2023-10-06T03:01:27.548 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.543+0000 7fcdc14a3700 1 -- 172.21.15.57:0/2326954104 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdbc0af260 con 0x7fcdbc06c920 2023-10-06T03:01:27.549 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.543+0000 7fcdc14a3700 1 -- 172.21.15.57:0/2326954104 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdbc04be40 con 0x7fcdbc06c920 2023-10-06T03:01:27.551 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.547+0000 7fcdb8ff9700 1 -- 172.21.15.57:0/2326954104 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fcdac004a40 con 0x7fcdbc06c920 2023-10-06T03:01:27.553 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.547+0000 7fcdb8ff9700 1 --2- 172.21.15.57:0/2326954104 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fcd9c060550 0x7fcd9c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:27.553 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.547+0000 7fcdb8ff9700 1 -- 172.21.15.57:0/2326954104 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fcdac07bfc0 con 0x7fcdbc06c920 2023-10-06T03:01:27.553 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.547+0000 7fcdb3fff700 1 --2- 172.21.15.57:0/2326954104 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fcd9c060550 0x7fcd9c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:27.554 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.547+0000 7fcdb3fff700 1 --2- 172.21.15.57:0/2326954104 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fcd9c060550 0x7fcd9c062a00 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc15e8d0 tx=0x7fcda4007d50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:27.560 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.555+0000 7fcdb8ff9700 1 -- 172.21.15.57:0/2326954104 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fcdac04abe0 con 0x7fcdbc06c920 2023-10-06T03:01:27.730 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.723+0000 7fcdc14a3700 1 -- 172.21.15.57:0/2326954104 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcdbc0add60 con 0x7fcdbc06c920 2023-10-06T03:01:27.732 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.727+0000 7fcdb8ff9700 1 -- 172.21.15.57:0/2326954104 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16866 (secure 0 0 0) 0x7fcdac018020 con 0x7fcdbc06c920 2023-10-06T03:01:27.733 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:01:27.733 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":23,"fsid":"eb56dc0f-9213-41cb-9aad-8ade6c802e98","created":"2023-10-06T03:00:30.806197+0000","modified":"2023-10-06T03:00:58.975366+0000","last_up_change":"2023-10-06T03:00:43.607454+0000","last_in_change":"2023-10-06T03:00:33.943513+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T03:00:44.360651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T03:00:50.466601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:00:55.472586+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T03:00:56.400884+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"58cf6c90-d704-43e0-b2db-dffe526d5e8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":33053},{"type":"v1","addr":"172.21.15.57:6801","nonce":33053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":33053},{"type":"v1","addr":"172.21.15.57:6803","nonce":33053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":33053},{"type":"v1","addr":"172.21.15.57:6807","nonce":33053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":33053},{"type":"v1","addr":"172.21.15.57:6805","nonce":33053}]},"public_addr":"172.21.15.57:6801/33053","cluster_addr":"172.21.15.57:6803/33053","heartbeat_back_addr":"172.21.15.57:6807/33053","heartbeat_front_addr":"172.21.15.57:6805/33053","state":["exists","up"]},{"osd":1,"uuid":"16afbe70-7f9e-4568-9c92-763e6e348119","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6809","nonce":33052},{"type":"v1","addr":"172.21.15.57:6810","nonce":33052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":33052},{"type":"v1","addr":"172.21.15.57:6813","nonce":33052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":33052},{"type":"v1","addr":"172.21.15.57:6822","nonce":33052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6815","nonce":33052},{"type":"v1","addr":"172.21.15.57:6818","nonce":33052}]},"public_addr":"172.21.15.57:6810/33052","cluster_addr":"172.21.15.57:6813/33052","heartbeat_back_addr":"172.21.15.57:6822/33052","heartbeat_front_addr":"172.21.15.57:6818/33052","state":["exists","up"]},{"osd":2,"uuid":"7255c62e-f92f-470f-a5ce-30228920d9f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":33058},{"type":"v1","addr":"172.21.15.57:6825","nonce":33058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":33058},{"type":"v1","addr":"172.21.15.57:6827","nonce":33058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":33058},{"type":"v1","addr":"172.21.15.57:6831","nonce":33058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":33058},{"type":"v1","addr":"172.21.15.57:6829","nonce":33058}]},"public_addr":"172.21.15.57:6825/33058","cluster_addr":"172.21.15.57:6827/33058","heartbeat_back_addr":"172.21.15.57:6831/33058","heartbeat_front_addr":"172.21.15.57:6829/33058","state":["exists","up"]},{"osd":3,"uuid":"152a236d-f799-4888-8544-74865508d5a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":33057},{"type":"v1","addr":"172.21.15.57:6811","nonce":33057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":33057},{"type":"v1","addr":"172.21.15.57:6816","nonce":33057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6821","nonce":33057},{"type":"v1","addr":"172.21.15.57:6823","nonce":33057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6817","nonce":33057},{"type":"v1","addr":"172.21.15.57:6819","nonce":33057}]},"public_addr":"172.21.15.57:6811/33057","cluster_addr":"172.21.15.57:6816/33057","heartbeat_back_addr":"172.21.15.57:6823/33057","heartbeat_front_addr":"172.21.15.57:6819/33057","state":["exists","up"]},{"osd":4,"uuid":"37db2a65-3566-41d0-9d60-e66c49e1e68e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":33368},{"type":"v1","addr":"172.21.15.105:6801","nonce":33368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":33368},{"type":"v1","addr":"172.21.15.105:6803","nonce":33368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":33368},{"type":"v1","addr":"172.21.15.105:6807","nonce":33368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":33368},{"type":"v1","addr":"172.21.15.105:6805","nonce":33368}]},"public_addr":"172.21.15.105:6801/33368","cluster_addr":"172.21.15.105:6803/33368","heartbeat_back_addr":"172.21.15.105:6807/33368","heartbeat_front_addr":"172.21.15.105:6805/33368","state":["exists","up"]},{"osd":5,"uuid":"35e77918-1bb4-42ca-9b20-f3c14eaa0c04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":33379},{"type":"v1","addr":"172.21.15.105:6818","nonce":33379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":33379},{"type":"v1","addr":"172.21.15.105:6823","nonce":33379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":33379},{"type":"v1","addr":"172.21.15.105:6831","nonce":33379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":33379},{"type":"v1","addr":"172.21.15.105:6827","nonce":33379}]},"public_addr":"172.21.15.105:6818/33379","cluster_addr":"172.21.15.105:6823/33379","heartbeat_back_addr":"172.21.15.105:6831/33379","heartbeat_front_addr":"172.21.15.105:6827/33379","state":["exists","up"]},{"osd":6,"uuid":"b4d9d510-7a45-4173-8287-c6c8d6547f2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":33369},{"type":"v1","addr":"172.21.15.105:6819","nonce":33369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":33369},{"type":"v1","addr":"172.21.15.105:6822","nonce":33369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":33369},{"type":"v1","addr":"172.21.15.105:6830","nonce":33369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":33369},{"type":"v1","addr":"172.21.15.105:6826","nonce":33369}]},"public_addr":"172.21.15.105:6819/33369","cluster_addr":"172.21.15.105:6822/33369","heartbeat_back_addr":"172.21.15.105:6830/33369","heartbeat_front_addr":"172.21.15.105:6826/33369","state":["exists","up"]},{"osd":7,"uuid":"74266fb0-cd84-463f-8bf0-092652a71dc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":33370},{"type":"v1","addr":"172.21.15.105:6809","nonce":33370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":33370},{"type":"v1","addr":"172.21.15.105:6811","nonce":33370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":33370},{"type":"v1","addr":"172.21.15.105:6815","nonce":33370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":33370},{"type":"v1","addr":"172.21.15.105:6813","nonce":33370}]},"public_addr":"172.21.15.105:6809/33370","cluster_addr":"172.21.15.105:6811/33370","heartbeat_back_addr":"172.21.15.105:6815/33370","heartbeat_front_addr":"172.21.15.105:6813/33370","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.596864+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.633851+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.636993+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.529681+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.608601+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.659752+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.661717+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.642221+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:01:27.735 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.731+0000 7fcdc14a3700 1 -- 172.21.15.57:0/2326954104 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fcd9c060550 msgr2=0x7fcd9c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:27.735 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.731+0000 7fcdc14a3700 1 --2- 172.21.15.57:0/2326954104 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fcd9c060550 0x7fcd9c062a00 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc15e8d0 tx=0x7fcda4007d50 comp rx=0 tx=0).stop 2023-10-06T03:01:27.735 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.731+0000 7fcdc14a3700 1 -- 172.21.15.57:0/2326954104 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcdbc06c920 msgr2=0x7fcdbc154c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:27.736 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.731+0000 7fcdc14a3700 1 --2- 172.21.15.57:0/2326954104 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcdbc06c920 0x7fcdbc154c20 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fcdac00cb60 tx=0x7fcdac001af0 comp rx=0 tx=0).stop 2023-10-06T03:01:27.736 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.731+0000 7fcdc14a3700 1 -- 172.21.15.57:0/2326954104 shutdown_connections 2023-10-06T03:01:27.736 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.731+0000 7fcdc14a3700 1 --2- 172.21.15.57:0/2326954104 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcdbc0aae90 0x7fcdbc0abab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:27.736 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.731+0000 7fcdc14a3700 1 --2- 172.21.15.57:0/2326954104 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fcd9c060550 0x7fcd9c062a00 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:27.736 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.731+0000 7fcdc14a3700 1 --2- 172.21.15.57:0/2326954104 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcdbc0aa7e0 0x7fcdbc0b1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:27.736 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.731+0000 7fcdc14a3700 1 --2- 172.21.15.57:0/2326954104 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcdbc06c920 0x7fcdbc154c20 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:27.736 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.731+0000 7fcdc14a3700 1 -- 172.21.15.57:0/2326954104 >> 172.21.15.57:0/2326954104 conn(0x7fcdbc0c85e0 msgr2=0x7fcdbc06ccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:27.736 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.731+0000 7fcdc14a3700 1 -- 172.21.15.57:0/2326954104 shutdown_connections 2023-10-06T03:01:27.736 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.731+0000 7fcdc14a3700 1 -- 172.21.15.57:0/2326954104 wait complete. 2023-10-06T03:01:27.756 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T03:00:44.360651+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T03:00:50.466601+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T03:00:55.472586+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T03:00:56.400884+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T03:01:27.757 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T03:01:27.923 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.919+0000 7fa84c6ae700 1 Processor -- start 2023-10-06T03:01:27.923 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.919+0000 7fa84c6ae700 1 -- start start 2023-10-06T03:01:27.925 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.919+0000 7fa84c6ae700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa844156e20 0x7fa8440adf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:27.926 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.919+0000 7fa84c6ae700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa84406afd0 con 0x7fa8440aeb10 2023-10-06T03:01:27.926 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.919+0000 7fa84c6ae700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa84406d740 con 0x7fa8441571f0 2023-10-06T03:01:27.926 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.919+0000 7fa84c6ae700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8440ac6c0 con 0x7fa844156e20 2023-10-06T03:01:27.926 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.919+0000 7fa849c49700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fa8440aeb10 0x7fa84406c920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:55512/0 (socket says 172.21.15.57:55512) 2023-10-06T03:01:27.926 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.919+0000 7fa849c49700 1 -- 172.21.15.57:0/54635953 learned_addr learned my addr 172.21.15.57:0/54635953 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:01:27.927 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.919+0000 7fa84a44a700 1 --2- 172.21.15.57:0/54635953 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa844156e20 0x7fa8440adf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:27.928 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.919+0000 7fa849448700 1 -- 172.21.15.57:0/54635953 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3982740357 0 0) 0x7fa84406afd0 con 0x7fa8440aeb10 2023-10-06T03:01:27.928 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.919+0000 7fa849448700 1 -- 172.21.15.57:0/54635953 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa830003570 con 0x7fa8440aeb10 2023-10-06T03:01:27.928 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.923+0000 7fa849448700 1 -- 172.21.15.57:0/54635953 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3429322023 0 0) 0x7fa830003570 con 0x7fa8440aeb10 2023-10-06T03:01:27.928 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.923+0000 7fa849448700 1 -- 172.21.15.57:0/54635953 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa844156e20 msgr2=0x7fa8440adf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:27.928 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.923+0000 7fa849448700 1 --2- 172.21.15.57:0/54635953 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa844156e20 0x7fa8440adf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:27.928 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.923+0000 7fa849448700 1 -- 172.21.15.57:0/54635953 >> v1:172.21.15.105:6789/0 conn(0x7fa8441571f0 legacy=0x7fa84406d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:27.928 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.923+0000 7fa849448700 1 -- 172.21.15.57:0/54635953 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8440ac9a0 con 0x7fa8440aeb10 2023-10-06T03:01:27.928 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.923+0000 7fa849448700 1 -- 172.21.15.57:0/54635953 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2482400018 0 0) 0x7fa834001470 con 0x7fa8440aeb10 2023-10-06T03:01:27.928 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.923+0000 7fa849448700 1 -- 172.21.15.57:0/54635953 >> v1:172.21.15.57:6789/0 conn(0x7fa8440aeb10 legacy=0x7fa84406c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:27.928 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.923+0000 7fa849448700 1 --2- 172.21.15.57:0/54635953 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa830003a90 0x7fa830003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:27.928 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.923+0000 7fa849448700 1 --2- 172.21.15.57:0/54635953 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa844156e20 0x7fa830004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:27.928 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.923+0000 7fa849448700 1 --2- 172.21.15.57:0/54635953 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa830004d50 0x7fa8300051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:27.929 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.923+0000 7fa849448700 1 -- 172.21.15.57:0/54635953 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8440ac6c0 con 0x7fa830003a90 2023-10-06T03:01:27.929 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.923+0000 7fa849448700 1 -- 172.21.15.57:0/54635953 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa83000bb70 con 0x7fa830004d50 2023-10-06T03:01:27.929 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.923+0000 7fa849448700 1 -- 172.21.15.57:0/54635953 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa83000bd30 con 0x7fa844156e20 2023-10-06T03:01:27.929 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.923+0000 7fa84a44a700 1 --2- 172.21.15.57:0/54635953 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa830003a90 0x7fa830003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:27.931 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.923+0000 7fa849c49700 1 --2- 172.21.15.57:0/54635953 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa844156e20 0x7fa830004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:27.931 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.923+0000 7fa84ac4b700 1 --2- 172.21.15.57:0/54635953 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa830004d50 0x7fa8300051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:27.931 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.923+0000 7fa84a44a700 1 -- 172.21.15.57:0/54635953 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa844156e20 msgr2=0x7fa830004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:27.931 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.923+0000 7fa84a44a700 1 --2- 172.21.15.57:0/54635953 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa844156e20 0x7fa830004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:27.931 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.923+0000 7fa84a44a700 1 -- 172.21.15.57:0/54635953 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa830004d50 msgr2=0x7fa8300051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:27.931 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.923+0000 7fa84a44a700 1 --2- 172.21.15.57:0/54635953 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa830004d50 0x7fa8300051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:27.931 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.923+0000 7fa84a44a700 1 -- 172.21.15.57:0/54635953 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa830003570 con 0x7fa830003a90 2023-10-06T03:01:27.931 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.923+0000 7fa849c49700 1 --2- 172.21.15.57:0/54635953 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa844156e20 0x7fa830004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:27.931 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.923+0000 7fa84a44a700 1 --2- 172.21.15.57:0/54635953 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa830003a90 0x7fa830003ea0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fa840009c00 tx=0x7fa8400091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46628858c444d41 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:27.931 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.923+0000 7fa849448700 1 -- 172.21.15.57:0/54635953 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa84000e710 con 0x7fa830003a90 2023-10-06T03:01:27.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.923+0000 7fa849448700 1 -- 172.21.15.57:0/54635953 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa84000e870 con 0x7fa830003a90 2023-10-06T03:01:27.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.923+0000 7fa849448700 1 -- 172.21.15.57:0/54635953 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa84000ec30 con 0x7fa830003a90 2023-10-06T03:01:27.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.923+0000 7fa84c6ae700 1 -- 172.21.15.57:0/54635953 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa830003a90 msgr2=0x7fa830003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:27.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.923+0000 7fa84c6ae700 1 --2- 172.21.15.57:0/54635953 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa830003a90 0x7fa830003ea0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fa840009c00 tx=0x7fa8400091a0 comp rx=0 tx=0).stop 2023-10-06T03:01:27.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.923+0000 7fa84ac4b700 1 -- 172.21.15.57:0/54635953 reap_dead start 2023-10-06T03:01:27.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.923+0000 7fa84c6ae700 1 -- 172.21.15.57:0/54635953 shutdown_connections 2023-10-06T03:01:27.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.923+0000 7fa84c6ae700 1 -- 172.21.15.57:0/54635953 >> 172.21.15.57:0/54635953 conn(0x7fa8440c87b0 msgr2=0x7fa8440c8bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:27.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.923+0000 7fa84c6ae700 1 -- 172.21.15.57:0/54635953 shutdown_connections 2023-10-06T03:01:27.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.923+0000 7fa84c6ae700 1 -- 172.21.15.57:0/54635953 wait complete. 2023-10-06T03:01:27.933 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.927+0000 7fa84c6ae700 1 Processor -- start 2023-10-06T03:01:27.933 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.927+0000 7fa84c6ae700 1 -- start start 2023-10-06T03:01:27.936 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.931+0000 7fa84c6ae700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa830003a90 0x7fa84415a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:27.936 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.931+0000 7fa84c6ae700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa844158870 0x7fa8441543e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:27.936 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.931+0000 7fa84c6ae700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa84406b180 0x7fa84406b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:27.936 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.931+0000 7fa84c6ae700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa84406bb30 con 0x7fa844158870 2023-10-06T03:01:27.936 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.931+0000 7fa84c6ae700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa844166ff0 con 0x7fa830003a90 2023-10-06T03:01:27.936 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.931+0000 7fa84c6ae700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa844158ce0 con 0x7fa84406b180 2023-10-06T03:01:27.937 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.931+0000 7fa849c49700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa844158870 0x7fa8441543e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:27.937 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.931+0000 7fa849c49700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa844158870 0x7fa8441543e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33166/0 (socket says 172.21.15.57:33166) 2023-10-06T03:01:27.937 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.931+0000 7fa849c49700 1 -- 172.21.15.57:0/2758334935 learned_addr learned my addr 172.21.15.57:0/2758334935 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:27.937 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.931+0000 7fa84a44a700 1 --2- 172.21.15.57:0/2758334935 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa830003a90 0x7fa84415a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:27.937 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.931+0000 7fa849c49700 1 -- 172.21.15.57:0/2758334935 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa84406b180 msgr2=0x7fa84406b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:27.937 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.931+0000 7fa849c49700 1 --2- 172.21.15.57:0/2758334935 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa84406b180 0x7fa84406b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:27.937 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.931+0000 7fa849c49700 1 -- 172.21.15.57:0/2758334935 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa830003a90 msgr2=0x7fa84415a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:27.937 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.931+0000 7fa849c49700 1 --2- 172.21.15.57:0/2758334935 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa830003a90 0x7fa84415a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:27.937 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.931+0000 7fa849c49700 1 -- 172.21.15.57:0/2758334935 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa844154920 con 0x7fa844158870 2023-10-06T03:01:27.938 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.931+0000 7fa849c49700 1 --2- 172.21.15.57:0/2758334935 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa844158870 0x7fa8441543e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa834000fd0 tx=0x7fa8340010f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:27.939 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.931+0000 7fa83a7fc700 1 -- 172.21.15.57:0/2758334935 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa83400c7b0 con 0x7fa844158870 2023-10-06T03:01:27.939 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.931+0000 7fa83a7fc700 1 -- 172.21.15.57:0/2758334935 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa83400c930 con 0x7fa844158870 2023-10-06T03:01:27.939 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.931+0000 7fa84c6ae700 1 -- 172.21.15.57:0/2758334935 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa844158f50 con 0x7fa844158870 2023-10-06T03:01:27.939 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.931+0000 7fa83a7fc700 1 -- 172.21.15.57:0/2758334935 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa83400ccf0 con 0x7fa844158870 2023-10-06T03:01:27.939 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.931+0000 7fa84c6ae700 1 -- 172.21.15.57:0/2758334935 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa844159510 con 0x7fa844158870 2023-10-06T03:01:27.939 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.935+0000 7fa84c6ae700 1 -- 172.21.15.57:0/2758334935 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8440712e0 con 0x7fa844158870 2023-10-06T03:01:27.940 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.935+0000 7fa83a7fc700 1 -- 172.21.15.57:0/2758334935 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fa834013630 con 0x7fa844158870 2023-10-06T03:01:27.941 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.935+0000 7fa83a7fc700 1 --2- 172.21.15.57:0/2758334935 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fa828060580 0x7fa828062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:27.941 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.935+0000 7fa83a7fc700 1 -- 172.21.15.57:0/2758334935 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa83407c940 con 0x7fa844158870 2023-10-06T03:01:27.941 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.935+0000 7fa84a44a700 1 --2- 172.21.15.57:0/2758334935 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fa828060580 0x7fa828062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:27.942 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.935+0000 7fa84a44a700 1 --2- 172.21.15.57:0/2758334935 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fa828060580 0x7fa828062a30 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa8400091e0 tx=0x7fa84001a000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:27.948 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:27.943+0000 7fa83a7fc700 1 -- 172.21.15.57:0/2758334935 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fa83404cd30 con 0x7fa844158870 2023-10-06T03:01:28.122 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.115+0000 7fa84c6ae700 1 -- 172.21.15.57:0/2758334935 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa84406a980 con 0x7fa844158870 2023-10-06T03:01:28.123 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.119+0000 7fa83a7fc700 1 -- 172.21.15.57:0/2758334935 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa834050350 con 0x7fa844158870 2023-10-06T03:01:28.123 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2023-10-06T03:01:28.126 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.119+0000 7fa84c6ae700 1 -- 172.21.15.57:0/2758334935 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fa828060580 msgr2=0x7fa828062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:28.126 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.119+0000 7fa84c6ae700 1 --2- 172.21.15.57:0/2758334935 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fa828060580 0x7fa828062a30 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa8400091e0 tx=0x7fa84001a000 comp rx=0 tx=0).stop 2023-10-06T03:01:28.126 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.119+0000 7fa84c6ae700 1 -- 172.21.15.57:0/2758334935 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa844158870 msgr2=0x7fa8441543e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:28.126 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.119+0000 7fa84c6ae700 1 --2- 172.21.15.57:0/2758334935 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa844158870 0x7fa8441543e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa834000fd0 tx=0x7fa8340010f0 comp rx=0 tx=0).stop 2023-10-06T03:01:28.126 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.119+0000 7fa84c6ae700 1 -- 172.21.15.57:0/2758334935 shutdown_connections 2023-10-06T03:01:28.127 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.119+0000 7fa84c6ae700 1 --2- 172.21.15.57:0/2758334935 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fa828060580 0x7fa828062a30 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:28.127 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.119+0000 7fa84c6ae700 1 --2- 172.21.15.57:0/2758334935 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa84406b180 0x7fa84406b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:28.127 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.119+0000 7fa84c6ae700 1 --2- 172.21.15.57:0/2758334935 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa844158870 0x7fa8441543e0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:28.127 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.119+0000 7fa84c6ae700 1 --2- 172.21.15.57:0/2758334935 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa830003a90 0x7fa84415a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:28.127 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.119+0000 7fa84c6ae700 1 -- 172.21.15.57:0/2758334935 >> 172.21.15.57:0/2758334935 conn(0x7fa8440c87b0 msgr2=0x7fa8441561a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:28.127 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.119+0000 7fa84c6ae700 1 -- 172.21.15.57:0/2758334935 shutdown_connections 2023-10-06T03:01:28.127 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.119+0000 7fa84c6ae700 1 -- 172.21.15.57:0/2758334935 wait complete. 2023-10-06T03:01:28.144 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T03:01:28.316 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.311+0000 7fb450c8e700 1 Processor -- start 2023-10-06T03:01:28.316 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.311+0000 7fb450c8e700 1 -- start start 2023-10-06T03:01:28.318 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.311+0000 7fb450c8e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb44c140540 0x7fb44c067490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:28.318 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.311+0000 7fb450c8e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb44c140910 0x7fb44c0679d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:28.318 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.311+0000 7fb450c8e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb44c157740 con 0x7fb44c0c6b20 2023-10-06T03:01:28.319 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.311+0000 7fb450c8e700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb44c068070 con 0x7fb44c140910 2023-10-06T03:01:28.319 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.311+0000 7fb450c8e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb44c068350 con 0x7fb44c140540 2023-10-06T03:01:28.319 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.315+0000 7fb44affd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb44c140910 0x7fb44c0679d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:28.319 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.315+0000 7fb44bfff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fb44c0c6b20 0x7fb44c15a9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:55518/0 (socket says 172.21.15.57:55518) 2023-10-06T03:01:28.319 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.315+0000 7fb44bfff700 1 -- 172.21.15.57:0/2234569545 learned_addr learned my addr 172.21.15.57:0/2234569545 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:01:28.319 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.315+0000 7fb44b7fe700 1 --2- 172.21.15.57:0/2234569545 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb44c140540 0x7fb44c067490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:28.320 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.315+0000 7fb44a7fc700 1 -- 172.21.15.57:0/2234569545 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2413506008 0 0) 0x7fb44c157740 con 0x7fb44c0c6b20 2023-10-06T03:01:28.320 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.315+0000 7fb44a7fc700 1 -- 172.21.15.57:0/2234569545 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb434003570 con 0x7fb44c0c6b20 2023-10-06T03:01:28.320 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.315+0000 7fb44affd700 1 -- 172.21.15.57:0/2234569545 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb44c140540 msgr2=0x7fb44c067490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:28.320 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.315+0000 7fb44affd700 1 --2- 172.21.15.57:0/2234569545 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb44c140540 0x7fb44c067490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:28.321 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.315+0000 7fb44affd700 1 -- 172.21.15.57:0/2234569545 >> v1:172.21.15.57:6789/0 conn(0x7fb44c0c6b20 legacy=0x7fb44c15a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:28.321 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.315+0000 7fb44affd700 1 -- 172.21.15.57:0/2234569545 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb44c068630 con 0x7fb44c140910 2023-10-06T03:01:28.321 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.315+0000 7fb44b7fe700 1 --2- 172.21.15.57:0/2234569545 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb44c140540 0x7fb44c067490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:01:28.321 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.315+0000 7fb44affd700 1 --2- 172.21.15.57:0/2234569545 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb44c140910 0x7fb44c0679d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb4400098e0 tx=0x7fb4400091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=551ef37cf18cb70b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:28.321 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.315+0000 7fb44a7fc700 1 -- 172.21.15.57:0/2234569545 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb440011630 con 0x7fb44c140910 2023-10-06T03:01:28.322 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.315+0000 7fb44a7fc700 1 -- 172.21.15.57:0/2234569545 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb440011790 con 0x7fb44c140910 2023-10-06T03:01:28.322 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.315+0000 7fb44a7fc700 1 -- 172.21.15.57:0/2234569545 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb440011b30 con 0x7fb44c140910 2023-10-06T03:01:28.322 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.315+0000 7fb450c8e700 1 -- 172.21.15.57:0/2234569545 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb44c140910 msgr2=0x7fb44c0679d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:28.322 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.315+0000 7fb450c8e700 1 --2- 172.21.15.57:0/2234569545 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb44c140910 0x7fb44c0679d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb4400098e0 tx=0x7fb4400091a0 comp rx=0 tx=0).stop 2023-10-06T03:01:28.322 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.315+0000 7fb450c8e700 1 -- 172.21.15.57:0/2234569545 shutdown_connections 2023-10-06T03:01:28.323 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.315+0000 7fb450c8e700 1 --2- 172.21.15.57:0/2234569545 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb44c140910 0x7fb44c0679d0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:28.323 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.315+0000 7fb450c8e700 1 --2- 172.21.15.57:0/2234569545 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb44c140540 0x7fb44c067490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:28.323 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.315+0000 7fb450c8e700 1 -- 172.21.15.57:0/2234569545 >> 172.21.15.57:0/2234569545 conn(0x7fb44c0c8660 msgr2=0x7fb44c0c8a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:28.323 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.315+0000 7fb450c8e700 1 -- 172.21.15.57:0/2234569545 shutdown_connections 2023-10-06T03:01:28.323 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.315+0000 7fb450c8e700 1 -- 172.21.15.57:0/2234569545 wait complete. 2023-10-06T03:01:28.324 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.319+0000 7fb450c8e700 1 Processor -- start 2023-10-06T03:01:28.324 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.319+0000 7fb450c8e700 1 -- start start 2023-10-06T03:01:28.325 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.319+0000 7fb450c8e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb44c0c6b20 0x7fb44c1584e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:28.326 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.319+0000 7fb450c8e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb44c140540 0x7fb44c169fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:28.326 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.319+0000 7fb450c8e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb44c140910 0x7fb44c13b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:28.326 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.319+0000 7fb450c8e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb44c16a520 con 0x7fb44c140540 2023-10-06T03:01:28.326 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.319+0000 7fb450c8e700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb44c0a9ea0 con 0x7fb44c0c6b20 2023-10-06T03:01:28.326 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.319+0000 7fb450c8e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb44c169810 con 0x7fb44c140910 2023-10-06T03:01:28.326 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.319+0000 7fb44affd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb44c140540 0x7fb44c169fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:28.326 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.319+0000 7fb44affd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb44c140540 0x7fb44c169fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33184/0 (socket says 172.21.15.57:33184) 2023-10-06T03:01:28.326 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.319+0000 7fb44affd700 1 -- 172.21.15.57:0/3758349434 learned_addr learned my addr 172.21.15.57:0/3758349434 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:28.327 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.319+0000 7fb44b7fe700 1 --2- 172.21.15.57:0/3758349434 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb44c0c6b20 0x7fb44c1584e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:28.327 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.319+0000 7fb44bfff700 1 --2- 172.21.15.57:0/3758349434 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb44c140910 0x7fb44c13b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:28.328 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.319+0000 7fb44affd700 1 -- 172.21.15.57:0/3758349434 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb44c140910 msgr2=0x7fb44c13b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:28.328 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.323+0000 7fb44affd700 1 --2- 172.21.15.57:0/3758349434 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb44c140910 0x7fb44c13b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:28.328 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.323+0000 7fb44affd700 1 -- 172.21.15.57:0/3758349434 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb44c0c6b20 msgr2=0x7fb44c1584e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:28.328 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.323+0000 7fb44affd700 1 --2- 172.21.15.57:0/3758349434 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb44c0c6b20 0x7fb44c1584e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:28.328 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.323+0000 7fb44affd700 1 -- 172.21.15.57:0/3758349434 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb43c009420 con 0x7fb44c140540 2023-10-06T03:01:28.328 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.323+0000 7fb44b7fe700 1 --2- 172.21.15.57:0/3758349434 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb44c0c6b20 0x7fb44c1584e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:28.328 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.323+0000 7fb44affd700 1 --2- 172.21.15.57:0/3758349434 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb44c140540 0x7fb44c169fe0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb440013000 tx=0x7fb440017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:28.328 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.323+0000 7fb4337fe700 1 -- 172.21.15.57:0/3758349434 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb440011b10 con 0x7fb44c140540 2023-10-06T03:01:28.328 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.323+0000 7fb4337fe700 1 -- 172.21.15.57:0/3758349434 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4400253f0 con 0x7fb44c140540 2023-10-06T03:01:28.328 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.323+0000 7fb4337fe700 1 -- 172.21.15.57:0/3758349434 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb440025790 con 0x7fb44c140540 2023-10-06T03:01:28.328 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.323+0000 7fb450c8e700 1 -- 172.21.15.57:0/3758349434 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb440009420 con 0x7fb44c140540 2023-10-06T03:01:28.328 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.323+0000 7fb450c8e700 1 -- 172.21.15.57:0/3758349434 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb44c13c380 con 0x7fb44c140540 2023-10-06T03:01:28.329 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.323+0000 7fb450c8e700 1 -- 172.21.15.57:0/3758349434 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb44c06de60 con 0x7fb44c140540 2023-10-06T03:01:28.330 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.323+0000 7fb4337fe700 1 -- 172.21.15.57:0/3758349434 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fb440025b80 con 0x7fb44c140540 2023-10-06T03:01:28.332 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.327+0000 7fb4337fe700 1 --2- 172.21.15.57:0/3758349434 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fb438060550 0x7fb438062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:28.332 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.327+0000 7fb4337fe700 1 -- 172.21.15.57:0/3758349434 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb44007e150 con 0x7fb44c140540 2023-10-06T03:01:28.332 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.327+0000 7fb44b7fe700 1 --2- 172.21.15.57:0/3758349434 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fb438060550 0x7fb438062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:28.333 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.327+0000 7fb44b7fe700 1 --2- 172.21.15.57:0/3758349434 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fb438060550 0x7fb438062a00 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb43c0093f0 tx=0x7fb43c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:28.339 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.335+0000 7fb4337fe700 1 -- 172.21.15.57:0/3758349434 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fb44c06de60 con 0x7fb44c140540 2023-10-06T03:01:28.510 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.503+0000 7fb450c8e700 1 -- 172.21.15.57:0/3758349434 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb44c06de60 con 0x7fb44c140540 2023-10-06T03:01:28.511 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.507+0000 7fb4337fe700 1 -- 172.21.15.57:0/3758349434 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb44c06de60 con 0x7fb44c140540 2023-10-06T03:01:28.511 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2023-10-06T03:01:28.514 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.507+0000 7fb450c8e700 1 -- 172.21.15.57:0/3758349434 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fb438060550 msgr2=0x7fb438062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:28.514 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.507+0000 7fb450c8e700 1 --2- 172.21.15.57:0/3758349434 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fb438060550 0x7fb438062a00 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb43c0093f0 tx=0x7fb43c008040 comp rx=0 tx=0).stop 2023-10-06T03:01:28.514 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.507+0000 7fb450c8e700 1 -- 172.21.15.57:0/3758349434 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb44c140540 msgr2=0x7fb44c169fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:28.514 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.507+0000 7fb450c8e700 1 --2- 172.21.15.57:0/3758349434 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb44c140540 0x7fb44c169fe0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb440013000 tx=0x7fb440017000 comp rx=0 tx=0).stop 2023-10-06T03:01:28.514 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.507+0000 7fb450c8e700 1 -- 172.21.15.57:0/3758349434 shutdown_connections 2023-10-06T03:01:28.515 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.507+0000 7fb450c8e700 1 --2- 172.21.15.57:0/3758349434 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fb438060550 0x7fb438062a00 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:28.515 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.507+0000 7fb450c8e700 1 --2- 172.21.15.57:0/3758349434 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb44c140910 0x7fb44c13b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:28.515 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.507+0000 7fb450c8e700 1 --2- 172.21.15.57:0/3758349434 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb44c140540 0x7fb44c169fe0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:28.515 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.507+0000 7fb450c8e700 1 --2- 172.21.15.57:0/3758349434 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb44c0c6b20 0x7fb44c1584e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:28.515 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.507+0000 7fb450c8e700 1 -- 172.21.15.57:0/3758349434 >> 172.21.15.57:0/3758349434 conn(0x7fb44c0c8660 msgr2=0x7fb44c067330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:28.515 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.507+0000 7fb450c8e700 1 -- 172.21.15.57:0/3758349434 shutdown_connections 2023-10-06T03:01:28.515 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.507+0000 7fb450c8e700 1 -- 172.21.15.57:0/3758349434 wait complete. 2023-10-06T03:01:28.534 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T03:01:28.695 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.691+0000 7f60fdf45700 1 Processor -- start 2023-10-06T03:01:28.695 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.691+0000 7f60fdf45700 1 -- start start 2023-10-06T03:01:28.699 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.691+0000 7f60fdf45700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f60f80c60b0 0x7f60f80cb0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:28.699 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.691+0000 7f60fdf45700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60f806b0e0 con 0x7f60f8142d40 2023-10-06T03:01:28.699 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.695+0000 7f60fdf45700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60f80cc3a0 con 0x7f60f80c5ce0 2023-10-06T03:01:28.699 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.695+0000 7f60fdf45700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60f80c6530 con 0x7f60f80c60b0 2023-10-06T03:01:28.699 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.695+0000 7f60f6ffd700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f60f8142d40 0x7f60f806c920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:55530/0 (socket says 172.21.15.57:55530) 2023-10-06T03:01:28.699 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.695+0000 7f60f6ffd700 1 -- 172.21.15.57:0/1295274734 learned_addr learned my addr 172.21.15.57:0/1295274734 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:01:28.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.695+0000 7f60f7fff700 1 --2- 172.21.15.57:0/1295274734 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f60f80c60b0 0x7f60f80cb0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:28.702 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.695+0000 7f60f67fc700 1 -- 172.21.15.57:0/1295274734 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 185589528 0 0) 0x7f60f806b0e0 con 0x7f60f8142d40 2023-10-06T03:01:28.702 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.695+0000 7f60f67fc700 1 -- 172.21.15.57:0/1295274734 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60e0003570 con 0x7f60f8142d40 2023-10-06T03:01:28.702 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.695+0000 7f60f67fc700 1 -- 172.21.15.57:0/1295274734 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2040355994 0 0) 0x7f60f80cc3a0 con 0x7f60f80c5ce0 2023-10-06T03:01:28.702 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.695+0000 7f60f67fc700 1 -- 172.21.15.57:0/1295274734 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60f806b0e0 con 0x7f60f80c5ce0 2023-10-06T03:01:28.702 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.695+0000 7f60f67fc700 1 -- 172.21.15.57:0/1295274734 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 117687683 0 0) 0x7f60e0003570 con 0x7f60f8142d40 2023-10-06T03:01:28.702 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.695+0000 7f60f67fc700 1 -- 172.21.15.57:0/1295274734 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f60f80c60b0 msgr2=0x7f60f80cb0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:28.702 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.695+0000 7f60f67fc700 1 --2- 172.21.15.57:0/1295274734 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f60f80c60b0 0x7f60f80cb0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:28.702 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.695+0000 7f60f67fc700 1 -- 172.21.15.57:0/1295274734 >> v1:172.21.15.105:6789/0 conn(0x7f60f80c5ce0 legacy=0x7f60f8142630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:28.702 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.695+0000 7f60f67fc700 1 -- 172.21.15.57:0/1295274734 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60f80cb790 con 0x7f60f8142d40 2023-10-06T03:01:28.702 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.695+0000 7f60f67fc700 1 -- 172.21.15.57:0/1295274734 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2482400018 0 0) 0x7f60ec001470 con 0x7f60f8142d40 2023-10-06T03:01:28.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.695+0000 7f60f67fc700 1 -- 172.21.15.57:0/1295274734 >> v1:172.21.15.57:6789/0 conn(0x7f60f8142d40 legacy=0x7f60f806c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:28.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.695+0000 7f60f67fc700 1 --2- 172.21.15.57:0/1295274734 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f60e0003c20 0x7f60e0004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:28.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.695+0000 7f60f67fc700 1 --2- 172.21.15.57:0/1295274734 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60e0004810 0x7f60e0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:28.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.695+0000 7f60f67fc700 1 --2- 172.21.15.57:0/1295274734 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f60f80c60b0 0x7f60e00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:28.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.695+0000 7f60f67fc700 1 -- 172.21.15.57:0/1295274734 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e000bb10 con 0x7f60e0004810 2023-10-06T03:01:28.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.695+0000 7f60f67fc700 1 -- 172.21.15.57:0/1295274734 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e000bc80 con 0x7f60e0003c20 2023-10-06T03:01:28.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.695+0000 7f60f67fc700 1 -- 172.21.15.57:0/1295274734 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60e000be40 con 0x7f60f80c60b0 2023-10-06T03:01:28.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.695+0000 7f60f6ffd700 1 --2- 172.21.15.57:0/1295274734 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60e0004810 0x7f60e0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:28.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.695+0000 7f60f7fff700 1 --2- 172.21.15.57:0/1295274734 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f60f80c60b0 0x7f60e00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:28.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.695+0000 7f60f77fe700 1 --2- 172.21.15.57:0/1295274734 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f60e0003c20 0x7f60e0004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:28.704 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.695+0000 7f60f7fff700 1 -- 172.21.15.57:0/1295274734 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f60e0003c20 msgr2=0x7f60e0004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:28.704 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.695+0000 7f60f7fff700 1 --2- 172.21.15.57:0/1295274734 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f60e0003c20 0x7f60e0004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:28.704 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.695+0000 7f60f7fff700 1 -- 172.21.15.57:0/1295274734 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60e0004810 msgr2=0x7f60e0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:28.704 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.695+0000 7f60f7fff700 1 --2- 172.21.15.57:0/1295274734 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60e0004810 0x7f60e0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:28.704 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.695+0000 7f60f7fff700 1 -- 172.21.15.57:0/1295274734 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60e0003570 con 0x7f60f80c60b0 2023-10-06T03:01:28.705 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.695+0000 7f60f7fff700 1 --2- 172.21.15.57:0/1295274734 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f60f80c60b0 0x7f60e00051c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f60f000e210 tx=0x7f60f000b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a9b80e123e7b72a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:28.705 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.699+0000 7f60f67fc700 1 -- 172.21.15.57:0/1295274734 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f000eac0 con 0x7f60f80c60b0 2023-10-06T03:01:28.705 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.699+0000 7f60f67fc700 1 -- 172.21.15.57:0/1295274734 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60f000f040 con 0x7f60f80c60b0 2023-10-06T03:01:28.705 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.699+0000 7f60f67fc700 1 -- 172.21.15.57:0/1295274734 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f000ee70 con 0x7f60f80c60b0 2023-10-06T03:01:28.705 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.699+0000 7f60fdf45700 1 -- 172.21.15.57:0/1295274734 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f60f80c60b0 msgr2=0x7f60e00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:28.705 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.699+0000 7f60fdf45700 1 --2- 172.21.15.57:0/1295274734 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f60f80c60b0 0x7f60e00051c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f60f000e210 tx=0x7f60f000b040 comp rx=0 tx=0).stop 2023-10-06T03:01:28.705 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.699+0000 7f60f7fff700 1 -- 172.21.15.57:0/1295274734 reap_dead start 2023-10-06T03:01:28.706 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.699+0000 7f60fdf45700 1 -- 172.21.15.57:0/1295274734 shutdown_connections 2023-10-06T03:01:28.706 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.699+0000 7f60fdf45700 1 -- 172.21.15.57:0/1295274734 >> 172.21.15.57:0/1295274734 conn(0x7f60f80ccbd0 msgr2=0x7f60f80ccfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:28.706 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.699+0000 7f60fdf45700 1 -- 172.21.15.57:0/1295274734 shutdown_connections 2023-10-06T03:01:28.706 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.699+0000 7f60fdf45700 1 -- 172.21.15.57:0/1295274734 wait complete. 2023-10-06T03:01:28.706 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.703+0000 7f60fdf45700 1 Processor -- start 2023-10-06T03:01:28.707 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.703+0000 7f60fdf45700 1 -- start start 2023-10-06T03:01:28.710 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.703+0000 7f60fdf45700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f60f80c60b0 0x7f60f80c7210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:28.710 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.703+0000 7f60fdf45700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60f8159100 0x7f60f80c7750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:28.710 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.703+0000 7f60fdf45700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f60f80b3ef0 0x7f60f80b4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:28.711 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.703+0000 7f60fdf45700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60f816d3b0 con 0x7f60f8159100 2023-10-06T03:01:28.711 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.703+0000 7f60fdf45700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60f815e3a0 con 0x7f60f80c60b0 2023-10-06T03:01:28.711 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.703+0000 7f60fdf45700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60f80b48a0 con 0x7f60f80b3ef0 2023-10-06T03:01:28.711 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.703+0000 7f60f6ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60f8159100 0x7f60f80c7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:28.711 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.703+0000 7f60f6ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60f8159100 0x7f60f80c7750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33202/0 (socket says 172.21.15.57:33202) 2023-10-06T03:01:28.711 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.703+0000 7f60f6ffd700 1 -- 172.21.15.57:0/818354755 learned_addr learned my addr 172.21.15.57:0/818354755 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:28.711 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.703+0000 7f60f7fff700 1 --2- 172.21.15.57:0/818354755 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f60f80b3ef0 0x7f60f80b4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:28.712 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.703+0000 7f60f77fe700 1 --2- 172.21.15.57:0/818354755 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f60f80c60b0 0x7f60f80c7210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:28.712 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.703+0000 7f60f6ffd700 1 -- 172.21.15.57:0/818354755 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f60f80b3ef0 msgr2=0x7f60f80b4360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:28.712 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.703+0000 7f60f6ffd700 1 --2- 172.21.15.57:0/818354755 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f60f80b3ef0 0x7f60f80b4360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:28.712 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.703+0000 7f60f6ffd700 1 -- 172.21.15.57:0/818354755 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f60f80c60b0 msgr2=0x7f60f80c7210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:28.712 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.703+0000 7f60f6ffd700 1 --2- 172.21.15.57:0/818354755 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f60f80c60b0 0x7f60f80c7210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:28.712 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.703+0000 7f60f6ffd700 1 -- 172.21.15.57:0/818354755 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60f80c8620 con 0x7f60f8159100 2023-10-06T03:01:28.712 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.703+0000 7f60f6ffd700 1 --2- 172.21.15.57:0/818354755 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60f8159100 0x7f60f80c7750 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f60ec0073c0 tx=0x7f60ec001e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:28.713 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.707+0000 7f60df7fe700 1 -- 172.21.15.57:0/818354755 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60ec018030 con 0x7f60f8159100 2023-10-06T03:01:28.713 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.707+0000 7f60df7fe700 1 -- 172.21.15.57:0/818354755 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60ec007850 con 0x7f60f8159100 2023-10-06T03:01:28.713 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.707+0000 7f60fdf45700 1 -- 172.21.15.57:0/818354755 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60f815e660 con 0x7f60f8159100 2023-10-06T03:01:28.713 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.707+0000 7f60df7fe700 1 -- 172.21.15.57:0/818354755 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60ec00faa0 con 0x7f60f8159100 2023-10-06T03:01:28.713 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.707+0000 7f60fdf45700 1 -- 172.21.15.57:0/818354755 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60f80c7d80 con 0x7f60f8159100 2023-10-06T03:01:28.713 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.707+0000 7f60fdf45700 1 -- 172.21.15.57:0/818354755 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60f815e7f0 con 0x7f60f8159100 2023-10-06T03:01:28.714 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.707+0000 7f60df7fe700 1 -- 172.21.15.57:0/818354755 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f60ec01b070 con 0x7f60f8159100 2023-10-06T03:01:28.716 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.711+0000 7f60df7fe700 1 --2- 172.21.15.57:0/818354755 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f60e4060580 0x7f60e4062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:28.716 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.711+0000 7f60df7fe700 1 -- 172.21.15.57:0/818354755 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f60ec019070 con 0x7f60f8159100 2023-10-06T03:01:28.717 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.711+0000 7f60f77fe700 1 --2- 172.21.15.57:0/818354755 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f60e4060580 0x7f60e4062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:28.718 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.711+0000 7f60f77fe700 1 --2- 172.21.15.57:0/818354755 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f60e4060580 0x7f60e4062a30 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f60e8007e40 tx=0x7f60e8007d30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:28.722 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.719+0000 7f60df7fe700 1 -- 172.21.15.57:0/818354755 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f60ec04cb90 con 0x7f60f8159100 2023-10-06T03:01:28.895 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.891+0000 7f60fdf45700 1 -- 172.21.15.57:0/818354755 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f60f80712e0 con 0x7f60f8159100 2023-10-06T03:01:28.896 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.891+0000 7f60df7fe700 1 -- 172.21.15.57:0/818354755 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f60ec0501b0 con 0x7f60f8159100 2023-10-06T03:01:28.896 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2023-10-06T03:01:28.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.895+0000 7f60fdf45700 1 -- 172.21.15.57:0/818354755 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f60e4060580 msgr2=0x7f60e4062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:28.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.895+0000 7f60fdf45700 1 --2- 172.21.15.57:0/818354755 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f60e4060580 0x7f60e4062a30 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f60e8007e40 tx=0x7f60e8007d30 comp rx=0 tx=0).stop 2023-10-06T03:01:28.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.895+0000 7f60fdf45700 1 -- 172.21.15.57:0/818354755 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60f8159100 msgr2=0x7f60f80c7750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:28.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.895+0000 7f60fdf45700 1 --2- 172.21.15.57:0/818354755 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60f8159100 0x7f60f80c7750 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f60ec0073c0 tx=0x7f60ec001e10 comp rx=0 tx=0).stop 2023-10-06T03:01:28.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.895+0000 7f60fdf45700 1 -- 172.21.15.57:0/818354755 shutdown_connections 2023-10-06T03:01:28.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.895+0000 7f60fdf45700 1 --2- 172.21.15.57:0/818354755 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f60e4060580 0x7f60e4062a30 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:28.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.895+0000 7f60fdf45700 1 --2- 172.21.15.57:0/818354755 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f60f80b3ef0 0x7f60f80b4360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:28.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.895+0000 7f60fdf45700 1 --2- 172.21.15.57:0/818354755 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60f8159100 0x7f60f80c7750 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:28.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.895+0000 7f60fdf45700 1 --2- 172.21.15.57:0/818354755 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f60f80c60b0 0x7f60f80c7210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:28.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.895+0000 7f60fdf45700 1 -- 172.21.15.57:0/818354755 >> 172.21.15.57:0/818354755 conn(0x7f60f80ccbd0 msgr2=0x7f60f806bbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:28.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.895+0000 7f60fdf45700 1 -- 172.21.15.57:0/818354755 shutdown_connections 2023-10-06T03:01:28.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:28.895+0000 7f60fdf45700 1 -- 172.21.15.57:0/818354755 wait complete. 2023-10-06T03:01:28.919 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T03:01:29.084 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.079+0000 7f5c4324c700 1 Processor -- start 2023-10-06T03:01:29.085 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.079+0000 7f5c4324c700 1 -- start start 2023-10-06T03:01:29.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.083+0000 7f5c4324c700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5c3c0cb140 0x7f5c3c0cb510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:29.089 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.083+0000 7f5c4324c700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c3c06c920 con 0x7f5c3c0b0080 2023-10-06T03:01:29.089 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.083+0000 7f5c4324c700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c3c06d4a0 con 0x7f5c3c06e040 2023-10-06T03:01:29.089 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.083+0000 7f5c4324c700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c3c06cb70 con 0x7f5c3c0cb140 2023-10-06T03:01:29.089 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.083+0000 7f5c41a49700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f5c3c0b0080 0x7f5c3c06d930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:55540/0 (socket says 172.21.15.57:55540) 2023-10-06T03:01:29.089 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.083+0000 7f5c41a49700 1 -- 172.21.15.57:0/1431375973 learned_addr learned my addr 172.21.15.57:0/1431375973 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:01:29.089 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.083+0000 7f5c4224a700 1 --2- 172.21.15.57:0/1431375973 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5c3c0cb140 0x7f5c3c0cb510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:29.090 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.083+0000 7f5c41248700 1 -- 172.21.15.57:0/1431375973 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1425226901 0 0) 0x7f5c3c06c920 con 0x7f5c3c0b0080 2023-10-06T03:01:29.090 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.083+0000 7f5c41248700 1 -- 172.21.15.57:0/1431375973 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c28003570 con 0x7f5c3c0b0080 2023-10-06T03:01:29.090 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.083+0000 7f5c4224a700 1 -- 172.21.15.57:0/1431375973 >> v1:172.21.15.105:6789/0 conn(0x7f5c3c06e040 legacy=0x7f5c3c06b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:29.090 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.083+0000 7f5c41248700 1 -- 172.21.15.57:0/1431375973 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 232225640 0 0) 0x7f5c3c06d4a0 con 0x7f5c3c06e040 2023-10-06T03:01:29.090 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.083+0000 7f5c4224a700 1 -- 172.21.15.57:0/1431375973 >> v1:172.21.15.57:6789/0 conn(0x7f5c3c0b0080 legacy=0x7f5c3c06d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:29.091 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.083+0000 7f5c4224a700 1 -- 172.21.15.57:0/1431375973 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c3c06ce50 con 0x7f5c3c0cb140 2023-10-06T03:01:29.091 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.087+0000 7f5c4224a700 1 --2- 172.21.15.57:0/1431375973 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5c3c0cb140 0x7f5c3c0cb510 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5c38009910 tx=0x7f5c380091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=44cc95c513c8671d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:29.091 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.087+0000 7f5c41248700 1 -- 172.21.15.57:0/1431375973 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c3800b680 con 0x7f5c3c0cb140 2023-10-06T03:01:29.091 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.087+0000 7f5c41248700 1 -- 172.21.15.57:0/1431375973 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c3800b7e0 con 0x7f5c3c0cb140 2023-10-06T03:01:29.091 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.087+0000 7f5c41248700 1 -- 172.21.15.57:0/1431375973 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c3800bba0 con 0x7f5c3c0cb140 2023-10-06T03:01:29.092 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.087+0000 7f5c4324c700 1 -- 172.21.15.57:0/1431375973 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5c3c0cb140 msgr2=0x7f5c3c0cb510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:29.092 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.087+0000 7f5c4324c700 1 --2- 172.21.15.57:0/1431375973 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5c3c0cb140 0x7f5c3c0cb510 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5c38009910 tx=0x7f5c380091a0 comp rx=0 tx=0).stop 2023-10-06T03:01:29.093 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.087+0000 7f5c4324c700 1 -- 172.21.15.57:0/1431375973 shutdown_connections 2023-10-06T03:01:29.093 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.087+0000 7f5c4324c700 1 --2- 172.21.15.57:0/1431375973 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5c3c0cb140 0x7f5c3c0cb510 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:29.093 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.087+0000 7f5c4324c700 1 -- 172.21.15.57:0/1431375973 >> 172.21.15.57:0/1431375973 conn(0x7f5c3c0d0a50 msgr2=0x7f5c3c0cca60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:29.093 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.087+0000 7f5c4324c700 1 -- 172.21.15.57:0/1431375973 shutdown_connections 2023-10-06T03:01:29.093 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.087+0000 7f5c4324c700 1 -- 172.21.15.57:0/1431375973 wait complete. 2023-10-06T03:01:29.096 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.091+0000 7f5c4324c700 1 Processor -- start 2023-10-06T03:01:29.096 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.091+0000 7f5c4324c700 1 -- start start 2023-10-06T03:01:29.098 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.091+0000 7f5c4324c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5c3c06e040 0x7f5c3c15c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:29.098 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.091+0000 7f5c4324c700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5c3c0b0080 0x7f5c3c0c8de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:29.098 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.091+0000 7f5c4324c700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5c3c0cb140 0x7f5c3c0c5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:29.098 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.091+0000 7f5c4324c700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c3c0c8950 con 0x7f5c3c06e040 2023-10-06T03:01:29.098 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.091+0000 7f5c4324c700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c3c0af890 con 0x7f5c3c0cb140 2023-10-06T03:01:29.098 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.091+0000 7f5c4324c700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c3c15c850 con 0x7f5c3c0b0080 2023-10-06T03:01:29.099 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.095+0000 7f5c4224a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5c3c06e040 0x7f5c3c15c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:29.099 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.095+0000 7f5c4224a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5c3c06e040 0x7f5c3c15c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33218/0 (socket says 172.21.15.57:33218) 2023-10-06T03:01:29.099 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.095+0000 7f5c4224a700 1 -- 172.21.15.57:0/3232583212 learned_addr learned my addr 172.21.15.57:0/3232583212 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:29.099 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.095+0000 7f5c41a49700 1 --2- 172.21.15.57:0/3232583212 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5c3c0b0080 0x7f5c3c0c8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:29.100 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.095+0000 7f5c42a4b700 1 --2- 172.21.15.57:0/3232583212 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5c3c0cb140 0x7f5c3c0c5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:29.100 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.095+0000 7f5c4224a700 1 -- 172.21.15.57:0/3232583212 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5c3c0b0080 msgr2=0x7f5c3c0c8de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:29.100 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.095+0000 7f5c4224a700 1 --2- 172.21.15.57:0/3232583212 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5c3c0b0080 0x7f5c3c0c8de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:29.100 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.095+0000 7f5c4224a700 1 -- 172.21.15.57:0/3232583212 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5c3c0cb140 msgr2=0x7f5c3c0c5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:29.100 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.095+0000 7f5c4224a700 1 --2- 172.21.15.57:0/3232583212 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5c3c0cb140 0x7f5c3c0c5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:29.100 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.095+0000 7f5c4224a700 1 -- 172.21.15.57:0/3232583212 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c38009420 con 0x7f5c3c06e040 2023-10-06T03:01:29.101 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.095+0000 7f5c4224a700 1 --2- 172.21.15.57:0/3232583212 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5c3c06e040 0x7f5c3c15c310 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c06a150 tx=0x7f5c38017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:29.101 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.095+0000 7f5c327fc700 1 -- 172.21.15.57:0/3232583212 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c3800bb60 con 0x7f5c3c06e040 2023-10-06T03:01:29.101 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.095+0000 7f5c327fc700 1 -- 172.21.15.57:0/3232583212 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c38000c90 con 0x7f5c3c06e040 2023-10-06T03:01:29.101 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.095+0000 7f5c327fc700 1 -- 172.21.15.57:0/3232583212 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c38027680 con 0x7f5c3c06e040 2023-10-06T03:01:29.101 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.095+0000 7f5c4324c700 1 -- 172.21.15.57:0/3232583212 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c3c0c7d40 con 0x7f5c3c06e040 2023-10-06T03:01:29.101 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.095+0000 7f5c4324c700 1 -- 172.21.15.57:0/3232583212 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c3c0c8300 con 0x7f5c3c06e040 2023-10-06T03:01:29.102 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.095+0000 7f5c4324c700 1 -- 172.21.15.57:0/3232583212 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c3c06f230 con 0x7f5c3c06e040 2023-10-06T03:01:29.104 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.099+0000 7f5c327fc700 1 -- 172.21.15.57:0/3232583212 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f5c3801a430 con 0x7f5c3c06e040 2023-10-06T03:01:29.105 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.099+0000 7f5c327fc700 1 --2- 172.21.15.57:0/3232583212 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f5c20060580 0x7f5c20062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:29.106 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.099+0000 7f5c327fc700 1 -- 172.21.15.57:0/3232583212 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5c3807e6e0 con 0x7f5c3c06e040 2023-10-06T03:01:29.106 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.099+0000 7f5c41a49700 1 --2- 172.21.15.57:0/3232583212 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f5c20060580 0x7f5c20062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:29.107 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.103+0000 7f5c41a49700 1 --2- 172.21.15.57:0/3232583212 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f5c20060580 0x7f5c20062a30 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c0ca620 tx=0x7f5c2c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:29.111 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.107+0000 7f5c327fc700 1 -- 172.21.15.57:0/3232583212 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f5c3c06f230 con 0x7f5c3c06e040 2023-10-06T03:01:29.278 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.271+0000 7f5c4324c700 1 -- 172.21.15.57:0/3232583212 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5c3c06f230 con 0x7f5c3c06e040 2023-10-06T03:01:29.279 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.275+0000 7f5c327fc700 1 -- 172.21.15.57:0/3232583212 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5c3c06f230 con 0x7f5c3c06e040 2023-10-06T03:01:29.279 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 64 2023-10-06T03:01:29.282 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.275+0000 7f5c4324c700 1 -- 172.21.15.57:0/3232583212 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f5c20060580 msgr2=0x7f5c20062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:29.282 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.275+0000 7f5c4324c700 1 --2- 172.21.15.57:0/3232583212 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f5c20060580 0x7f5c20062a30 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c0ca620 tx=0x7f5c2c009040 comp rx=0 tx=0).stop 2023-10-06T03:01:29.282 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.275+0000 7f5c4324c700 1 -- 172.21.15.57:0/3232583212 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5c3c06e040 msgr2=0x7f5c3c15c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:29.282 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.275+0000 7f5c4324c700 1 --2- 172.21.15.57:0/3232583212 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5c3c06e040 0x7f5c3c15c310 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c06a150 tx=0x7f5c38017000 comp rx=0 tx=0).stop 2023-10-06T03:01:29.282 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.275+0000 7f5c4324c700 1 -- 172.21.15.57:0/3232583212 shutdown_connections 2023-10-06T03:01:29.283 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.275+0000 7f5c4324c700 1 --2- 172.21.15.57:0/3232583212 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5c3c0cb140 0x7f5c3c0c5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:29.283 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.275+0000 7f5c4324c700 1 --2- 172.21.15.57:0/3232583212 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f5c20060580 0x7f5c20062a30 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:29.283 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.275+0000 7f5c4324c700 1 --2- 172.21.15.57:0/3232583212 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5c3c0b0080 0x7f5c3c0c8de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:29.283 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.275+0000 7f5c4324c700 1 --2- 172.21.15.57:0/3232583212 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5c3c06e040 0x7f5c3c15c310 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:29.283 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.275+0000 7f5c4324c700 1 -- 172.21.15.57:0/3232583212 >> 172.21.15.57:0/3232583212 conn(0x7f5c3c0d0a50 msgr2=0x7f5c3c06aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:29.283 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.275+0000 7f5c4324c700 1 -- 172.21.15.57:0/3232583212 shutdown_connections 2023-10-06T03:01:29.283 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.275+0000 7f5c4324c700 1 -- 172.21.15.57:0/3232583212 wait complete. 2023-10-06T03:01:29.330 INFO:tasks.cephfs_test_runner:Starting test: test_max_items_per_obj (tasks.cephfs.test_openfiletable.OpenFileTable) The maximum number of openfiles omap objects keys are now equal to 2023-10-06T03:01:29.331 INFO:tasks.cephfs_test_runner:test_max_items_per_obj (tasks.cephfs.test_openfiletable.OpenFileTable) 2023-10-06T03:01:29.331 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_openfiletable.OpenFileTable.test_max_items_per_obj' 2023-10-06T03:01:29.495 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.491+0000 7faf29585700 1 Processor -- start 2023-10-06T03:01:29.495 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.491+0000 7faf29585700 1 -- start start 2023-10-06T03:01:29.498 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.491+0000 7faf29585700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7faf24154d90 0x7faf2415b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:29.498 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.491+0000 7faf29585700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf240b18d0 con 0x7faf240b1490 2023-10-06T03:01:29.498 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.491+0000 7faf29585700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf24158530 con 0x7faf240b10c0 2023-10-06T03:01:29.498 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.491+0000 7faf29585700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf2406bb10 con 0x7faf24154d90 2023-10-06T03:01:29.499 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.491+0000 7faf227fc700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7faf24154d90 0x7faf2415b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:29.499 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.491+0000 7faf227fc700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7faf24154d90 0x7faf2415b750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33224/0 (socket says 172.21.15.57:33224) 2023-10-06T03:01:29.499 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.491+0000 7faf227fc700 1 -- 172.21.15.57:0/4106741592 learned_addr learned my addr 172.21.15.57:0/4106741592 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:29.499 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.491+0000 7faf237fe700 1 --1- 172.21.15.57:0/4106741592 >> v1:172.21.15.57:6789/0 conn(0x7faf240b1490 0x7faf241575d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:55544/0 (socket says 172.21.15.57:55544) 2023-10-06T03:01:29.499 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.495+0000 7faf227fc700 1 -- 172.21.15.57:0/4106741592 >> v1:172.21.15.105:6789/0 conn(0x7faf240b10c0 legacy=0x7faf24154680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:29.499 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.495+0000 7faf227fc700 1 -- 172.21.15.57:0/4106741592 >> v1:172.21.15.57:6789/0 conn(0x7faf240b1490 legacy=0x7faf241575d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:29.499 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.495+0000 7faf227fc700 1 -- 172.21.15.57:0/4106741592 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf24158250 con 0x7faf24154d90 2023-10-06T03:01:29.500 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.495+0000 7faf227fc700 1 --2- 172.21.15.57:0/4106741592 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf24154d90 0x7faf2415b750 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7faf180099b0 tx=0x7faf18009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=505ff958d857f7c5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:29.500 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.495+0000 7faf21ffb700 1 -- 172.21.15.57:0/4106741592 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf1800b860 con 0x7faf24154d90 2023-10-06T03:01:29.500 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.495+0000 7faf21ffb700 1 -- 172.21.15.57:0/4106741592 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf1800b9c0 con 0x7faf24154d90 2023-10-06T03:01:29.500 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.495+0000 7faf21ffb700 1 -- 172.21.15.57:0/4106741592 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf1800bd60 con 0x7faf24154d90 2023-10-06T03:01:29.501 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.495+0000 7faf29585700 1 -- 172.21.15.57:0/4106741592 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf24154d90 msgr2=0x7faf2415b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:29.501 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.495+0000 7faf29585700 1 --2- 172.21.15.57:0/4106741592 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf24154d90 0x7faf2415b750 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7faf180099b0 tx=0x7faf18009250 comp rx=0 tx=0).stop 2023-10-06T03:01:29.501 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.495+0000 7faf29585700 1 -- 172.21.15.57:0/4106741592 shutdown_connections 2023-10-06T03:01:29.501 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.495+0000 7faf29585700 1 --2- 172.21.15.57:0/4106741592 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf24154d90 0x7faf2415b750 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:29.502 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.495+0000 7faf29585700 1 -- 172.21.15.57:0/4106741592 >> 172.21.15.57:0/4106741592 conn(0x7faf240cbdd0 msgr2=0x7faf240cc1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:29.502 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.495+0000 7faf29585700 1 -- 172.21.15.57:0/4106741592 shutdown_connections 2023-10-06T03:01:29.502 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.495+0000 7faf29585700 1 -- 172.21.15.57:0/4106741592 wait complete. 2023-10-06T03:01:29.504 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.499+0000 7faf29585700 1 Processor -- start 2023-10-06T03:01:29.505 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.499+0000 7faf29585700 1 -- start start 2023-10-06T03:01:29.507 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.503+0000 7faf29585700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faf240b10c0 0x7faf241567c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:29.507 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.503+0000 7faf29585700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faf240b1490 0x7faf2416a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:29.507 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.503+0000 7faf29585700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf24154d90 0x7faf24143fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:29.507 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.503+0000 7faf29585700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf24153f20 con 0x7faf24154d90 2023-10-06T03:01:29.507 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.503+0000 7faf29585700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf24156330 con 0x7faf240b10c0 2023-10-06T03:01:29.507 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.503+0000 7faf29585700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf2416a5f0 con 0x7faf240b1490 2023-10-06T03:01:29.507 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.503+0000 7faf237fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf24154d90 0x7faf24143fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:29.508 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.503+0000 7faf237fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf24154d90 0x7faf24143fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33228/0 (socket says 172.21.15.57:33228) 2023-10-06T03:01:29.508 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.503+0000 7faf237fe700 1 -- 172.21.15.57:0/2882539248 learned_addr learned my addr 172.21.15.57:0/2882539248 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:29.508 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.503+0000 7faf22ffd700 1 --2- 172.21.15.57:0/2882539248 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faf240b10c0 0x7faf241567c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:29.508 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.503+0000 7faf227fc700 1 --2- 172.21.15.57:0/2882539248 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faf240b1490 0x7faf2416a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:29.509 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.503+0000 7faf237fe700 1 -- 172.21.15.57:0/2882539248 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faf240b1490 msgr2=0x7faf2416a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:29.509 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.503+0000 7faf237fe700 1 --2- 172.21.15.57:0/2882539248 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faf240b1490 0x7faf2416a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:29.509 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.503+0000 7faf237fe700 1 -- 172.21.15.57:0/2882539248 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faf240b10c0 msgr2=0x7faf241567c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:29.509 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.503+0000 7faf237fe700 1 --2- 172.21.15.57:0/2882539248 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faf240b10c0 0x7faf241567c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:29.509 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.503+0000 7faf237fe700 1 -- 172.21.15.57:0/2882539248 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf180094f0 con 0x7faf24154d90 2023-10-06T03:01:29.509 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.503+0000 7faf237fe700 1 --2- 172.21.15.57:0/2882539248 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf24154d90 0x7faf24143fa0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7faf1c00cd30 tx=0x7faf1c001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:29.509 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.503+0000 7faf0affd700 1 -- 172.21.15.57:0/2882539248 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf1c00ce90 con 0x7faf24154d90 2023-10-06T03:01:29.510 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.503+0000 7faf0affd700 1 -- 172.21.15.57:0/2882539248 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf1c005df0 con 0x7faf24154d90 2023-10-06T03:01:29.510 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.503+0000 7faf0affd700 1 -- 172.21.15.57:0/2882539248 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf1c00aac0 con 0x7faf24154d90 2023-10-06T03:01:29.510 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.503+0000 7faf29585700 1 -- 172.21.15.57:0/2882539248 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf24155720 con 0x7faf24154d90 2023-10-06T03:01:29.510 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.503+0000 7faf29585700 1 -- 172.21.15.57:0/2882539248 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf24155ce0 con 0x7faf24154d90 2023-10-06T03:01:29.511 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.507+0000 7faf29585700 1 -- 172.21.15.57:0/2882539248 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf241564a0 con 0x7faf24154d90 2023-10-06T03:01:29.512 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.507+0000 7faf0affd700 1 -- 172.21.15.57:0/2882539248 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7faf1c0070f0 con 0x7faf24154d90 2023-10-06T03:01:29.514 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.507+0000 7faf0affd700 1 --2- 172.21.15.57:0/2882539248 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7faf10060580 0x7faf10062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:29.514 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.507+0000 7faf0affd700 1 -- 172.21.15.57:0/2882539248 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7faf1c07c9c0 con 0x7faf24154d90 2023-10-06T03:01:29.514 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.511+0000 7faf22ffd700 1 --2- 172.21.15.57:0/2882539248 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7faf10060580 0x7faf10062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:29.515 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.511+0000 7faf22ffd700 1 --2- 172.21.15.57:0/2882539248 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7faf10060580 0x7faf10062a30 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7faf2416dd80 tx=0x7faf14009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:29.520 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.515+0000 7faf0affd700 1 -- 172.21.15.57:0/2882539248 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7faf1c04ce30 con 0x7faf24154d90 2023-10-06T03:01:29.749 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.743+0000 7faf29585700 1 -- 172.21.15.57:0/2882539248 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_openfiletable.OpenFileTable.test_max_items_per_obj"]} v 0) v1 -- 0x7faf2415ac70 con 0x7faf24154d90 2023-10-06T03:01:29.789 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.783+0000 7faf0affd700 1 -- 172.21.15.57:0/2882539248 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_openfiletable.OpenFileTable.test_max_items_per_obj"]}]=0 v57) v1 ==== 150+0+0 (secure 0 0 0) 0x7faf1c050450 con 0x7faf24154d90 2023-10-06T03:01:29.793 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.787+0000 7faf29585700 1 -- 172.21.15.57:0/2882539248 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7faf10060580 msgr2=0x7faf10062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:29.793 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.787+0000 7faf29585700 1 --2- 172.21.15.57:0/2882539248 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7faf10060580 0x7faf10062a30 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7faf2416dd80 tx=0x7faf14009040 comp rx=0 tx=0).stop 2023-10-06T03:01:29.794 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.787+0000 7faf29585700 1 -- 172.21.15.57:0/2882539248 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf24154d90 msgr2=0x7faf24143fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:29.794 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.787+0000 7faf29585700 1 --2- 172.21.15.57:0/2882539248 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf24154d90 0x7faf24143fa0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7faf1c00cd30 tx=0x7faf1c001b10 comp rx=0 tx=0).stop 2023-10-06T03:01:29.794 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.787+0000 7faf29585700 1 -- 172.21.15.57:0/2882539248 shutdown_connections 2023-10-06T03:01:29.794 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.787+0000 7faf29585700 1 --2- 172.21.15.57:0/2882539248 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf24154d90 0x7faf24143fa0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:29.794 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.787+0000 7faf29585700 1 --2- 172.21.15.57:0/2882539248 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7faf10060580 0x7faf10062a30 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:29.794 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.787+0000 7faf29585700 1 --2- 172.21.15.57:0/2882539248 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faf240b1490 0x7faf2416a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:29.794 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.787+0000 7faf29585700 1 --2- 172.21.15.57:0/2882539248 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faf240b10c0 0x7faf241567c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:29.794 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.787+0000 7faf29585700 1 -- 172.21.15.57:0/2882539248 >> 172.21.15.57:0/2882539248 conn(0x7faf240cbdd0 msgr2=0x7faf24158750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:29.794 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.787+0000 7faf29585700 1 -- 172.21.15.57:0/2882539248 shutdown_connections 2023-10-06T03:01:29.794 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.787+0000 7faf29585700 1 -- 172.21.15.57:0/2882539248 wait complete. 2023-10-06T03:01:29.813 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-06T03:01:29.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.975+0000 7fc8f42f0700 1 Processor -- start 2023-10-06T03:01:29.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.975+0000 7fc8f42f0700 1 -- start start 2023-10-06T03:01:29.983 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.979+0000 7fc8f42f0700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc8ec14fd10 0x7fc8ec150180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:29.983 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.979+0000 7fc8f42f0700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8ec1506c0 con 0x7fc8ec15cd50 2023-10-06T03:01:29.983 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.979+0000 7fc8f42f0700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8ec06afb0 con 0x7fc8ec06c920 2023-10-06T03:01:29.984 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.979+0000 7fc8f42f0700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8ec06e300 con 0x7fc8ec14fd10 2023-10-06T03:01:29.984 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.979+0000 7fc8f208c700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fc8ec15cd50 0x7fc8ec15d120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:55560/0 (socket says 172.21.15.57:55560) 2023-10-06T03:01:29.984 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.979+0000 7fc8f208c700 1 -- 172.21.15.57:0/2756838099 learned_addr learned my addr 172.21.15.57:0/2756838099 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:01:29.985 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.979+0000 7fc8f188b700 1 --2- 172.21.15.57:0/2756838099 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc8ec14fd10 0x7fc8ec150180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:29.985 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.979+0000 7fc8f108a700 1 -- 172.21.15.57:0/2756838099 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3856576422 0 0) 0x7fc8ec1506c0 con 0x7fc8ec15cd50 2023-10-06T03:01:29.985 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.979+0000 7fc8f108a700 1 -- 172.21.15.57:0/2756838099 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8d8003570 con 0x7fc8ec15cd50 2023-10-06T03:01:29.985 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.979+0000 7fc8f108a700 1 -- 172.21.15.57:0/2756838099 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1033255912 0 0) 0x7fc8ec06afb0 con 0x7fc8ec06c920 2023-10-06T03:01:29.985 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.979+0000 7fc8f108a700 1 -- 172.21.15.57:0/2756838099 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8ec1506c0 con 0x7fc8ec06c920 2023-10-06T03:01:29.985 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.979+0000 7fc8f108a700 1 -- 172.21.15.57:0/2756838099 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3833186912 0 0) 0x7fc8d8003570 con 0x7fc8ec15cd50 2023-10-06T03:01:29.985 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.979+0000 7fc8f108a700 1 -- 172.21.15.57:0/2756838099 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc8ec14fd10 msgr2=0x7fc8ec150180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:29.985 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.979+0000 7fc8f108a700 1 --2- 172.21.15.57:0/2756838099 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc8ec14fd10 0x7fc8ec150180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:29.985 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.979+0000 7fc8f108a700 1 -- 172.21.15.57:0/2756838099 >> v1:172.21.15.105:6789/0 conn(0x7fc8ec06c920 legacy=0x7fc8ec06cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:29.986 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.979+0000 7fc8f108a700 1 -- 172.21.15.57:0/2756838099 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8ec06b290 con 0x7fc8ec15cd50 2023-10-06T03:01:29.986 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.979+0000 7fc8f108a700 1 -- 172.21.15.57:0/2756838099 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2482400018 0 0) 0x7fc8e8001470 con 0x7fc8ec15cd50 2023-10-06T03:01:29.986 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.979+0000 7fc8f108a700 1 -- 172.21.15.57:0/2756838099 >> v1:172.21.15.57:6789/0 conn(0x7fc8ec15cd50 legacy=0x7fc8ec15d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:29.986 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.979+0000 7fc8f108a700 1 --2- 172.21.15.57:0/2756838099 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc8d8003c20 0x7fc8d8004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:29.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.979+0000 7fc8f108a700 1 --2- 172.21.15.57:0/2756838099 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc8d8004810 0x7fc8d8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:29.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.979+0000 7fc8f108a700 1 --2- 172.21.15.57:0/2756838099 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc8ec14fd10 0x7fc8d8005270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:29.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.979+0000 7fc8f108a700 1 -- 172.21.15.57:0/2756838099 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8ec06e300 con 0x7fc8d8004810 2023-10-06T03:01:29.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.979+0000 7fc8f108a700 1 -- 172.21.15.57:0/2756838099 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d800bc20 con 0x7fc8d8003c20 2023-10-06T03:01:29.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.979+0000 7fc8f108a700 1 -- 172.21.15.57:0/2756838099 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d800bde0 con 0x7fc8ec14fd10 2023-10-06T03:01:29.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.979+0000 7fc8f188b700 1 --2- 172.21.15.57:0/2756838099 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc8d8004810 0x7fc8d8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:29.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.979+0000 7fc8f288d700 1 --2- 172.21.15.57:0/2756838099 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc8ec14fd10 0x7fc8d8005270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:29.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.979+0000 7fc8f208c700 1 --2- 172.21.15.57:0/2756838099 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc8d8003c20 0x7fc8d8004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:29.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.983+0000 7fc8f288d700 1 -- 172.21.15.57:0/2756838099 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc8d8003c20 msgr2=0x7fc8d8004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:29.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.983+0000 7fc8f288d700 1 --2- 172.21.15.57:0/2756838099 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc8d8003c20 0x7fc8d8004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:29.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.983+0000 7fc8f288d700 1 -- 172.21.15.57:0/2756838099 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc8d8004810 msgr2=0x7fc8d8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:29.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.983+0000 7fc8f288d700 1 --2- 172.21.15.57:0/2756838099 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc8d8004810 0x7fc8d8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:29.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.983+0000 7fc8f288d700 1 -- 172.21.15.57:0/2756838099 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8d8003570 con 0x7fc8ec14fd10 2023-10-06T03:01:29.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.983+0000 7fc8f288d700 1 --2- 172.21.15.57:0/2756838099 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc8ec14fd10 0x7fc8d8005270 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc8e4002120 tx=0x7fc8e40017a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=56f499eacd791eb9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:29.989 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.983+0000 7fc8f108a700 1 -- 172.21.15.57:0/2756838099 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e4001ab0 con 0x7fc8ec14fd10 2023-10-06T03:01:29.989 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.983+0000 7fc8f108a700 1 -- 172.21.15.57:0/2756838099 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8e400c980 con 0x7fc8ec14fd10 2023-10-06T03:01:29.990 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.983+0000 7fc8f108a700 1 -- 172.21.15.57:0/2756838099 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e400cd20 con 0x7fc8ec14fd10 2023-10-06T03:01:29.990 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.983+0000 7fc8f42f0700 1 -- 172.21.15.57:0/2756838099 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc8ec14fd10 msgr2=0x7fc8d8005270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:29.990 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.983+0000 7fc8f42f0700 1 --2- 172.21.15.57:0/2756838099 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc8ec14fd10 0x7fc8d8005270 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc8e4002120 tx=0x7fc8e40017a0 comp rx=0 tx=0).stop 2023-10-06T03:01:29.990 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.983+0000 7fc8f288d700 1 -- 172.21.15.57:0/2756838099 reap_dead start 2023-10-06T03:01:29.990 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.983+0000 7fc8f42f0700 1 -- 172.21.15.57:0/2756838099 shutdown_connections 2023-10-06T03:01:29.990 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.983+0000 7fc8f42f0700 1 -- 172.21.15.57:0/2756838099 >> 172.21.15.57:0/2756838099 conn(0x7fc8ec0ccbc0 msgr2=0x7fc8ec0ccfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:29.990 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.983+0000 7fc8f42f0700 1 -- 172.21.15.57:0/2756838099 shutdown_connections 2023-10-06T03:01:29.990 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.983+0000 7fc8f42f0700 1 -- 172.21.15.57:0/2756838099 wait complete. 2023-10-06T03:01:29.991 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.987+0000 7fc8f42f0700 1 Processor -- start 2023-10-06T03:01:29.991 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.987+0000 7fc8f42f0700 1 -- start start 2023-10-06T03:01:29.993 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.987+0000 7fc8f42f0700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc8ec14fd10 0x7fc8ec0b5af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:29.993 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.987+0000 7fc8f42f0700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc8ec0b33d0 0x7fc8ec14e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:29.993 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.987+0000 7fc8f42f0700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc8ec15ac80 0x7fc8ec15b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:29.993 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.987+0000 7fc8f42f0700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8ec15b630 con 0x7fc8ec0b33d0 2023-10-06T03:01:29.993 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.987+0000 7fc8f42f0700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8ec0b4550 con 0x7fc8ec14fd10 2023-10-06T03:01:29.993 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.987+0000 7fc8f42f0700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8ec0b3940 con 0x7fc8ec15ac80 2023-10-06T03:01:29.993 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.987+0000 7fc8f188b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc8ec0b33d0 0x7fc8ec14e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:29.994 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.987+0000 7fc8f188b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc8ec0b33d0 0x7fc8ec14e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33242/0 (socket says 172.21.15.57:33242) 2023-10-06T03:01:29.994 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.987+0000 7fc8f188b700 1 -- 172.21.15.57:0/1504007522 learned_addr learned my addr 172.21.15.57:0/1504007522 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:29.994 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.987+0000 7fc8f208c700 1 --2- 172.21.15.57:0/1504007522 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc8ec14fd10 0x7fc8ec0b5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:29.994 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.987+0000 7fc8f288d700 1 --2- 172.21.15.57:0/1504007522 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc8ec15ac80 0x7fc8ec15b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:29.994 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.987+0000 7fc8f208c700 1 -- 172.21.15.57:0/1504007522 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc8ec15ac80 msgr2=0x7fc8ec15b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:29.994 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.987+0000 7fc8f208c700 1 --2- 172.21.15.57:0/1504007522 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc8ec15ac80 0x7fc8ec15b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:29.995 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.987+0000 7fc8f208c700 1 -- 172.21.15.57:0/1504007522 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc8ec0b33d0 msgr2=0x7fc8ec14e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:29.995 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.987+0000 7fc8f208c700 1 --2- 172.21.15.57:0/1504007522 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc8ec0b33d0 0x7fc8ec14e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:29.995 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.987+0000 7fc8f208c700 1 -- 172.21.15.57:0/1504007522 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8ec0b3c20 con 0x7fc8ec14fd10 2023-10-06T03:01:29.995 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.987+0000 7fc8f288d700 1 --2- 172.21.15.57:0/1504007522 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc8ec15ac80 0x7fc8ec15b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:01:29.995 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.987+0000 7fc8f208c700 1 --2- 172.21.15.57:0/1504007522 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc8ec14fd10 0x7fc8ec0b5af0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc8e800e7e0 tx=0x7fc8e8000c50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:29.995 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.991+0000 7fc8e27fc700 1 -- 172.21.15.57:0/1504007522 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e8010490 con 0x7fc8ec14fd10 2023-10-06T03:01:29.996 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.991+0000 7fc8e27fc700 1 -- 172.21.15.57:0/1504007522 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8e8010040 con 0x7fc8ec14fd10 2023-10-06T03:01:29.996 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.991+0000 7fc8f42f0700 1 -- 172.21.15.57:0/1504007522 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8ec0b3f00 con 0x7fc8ec14fd10 2023-10-06T03:01:29.996 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.991+0000 7fc8e27fc700 1 -- 172.21.15.57:0/1504007522 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e8010840 con 0x7fc8ec14fd10 2023-10-06T03:01:29.996 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.991+0000 7fc8f42f0700 1 -- 172.21.15.57:0/1504007522 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8ec14ee20 con 0x7fc8ec14fd10 2023-10-06T03:01:29.996 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.991+0000 7fc8f42f0700 1 -- 172.21.15.57:0/1504007522 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8ec0cc8a0 con 0x7fc8ec14fd10 2023-10-06T03:01:29.997 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.991+0000 7fc8e27fc700 1 -- 172.21.15.57:0/1504007522 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fc8e8010bb0 con 0x7fc8ec14fd10 2023-10-06T03:01:29.999 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.995+0000 7fc8e27fc700 1 --2- 172.21.15.57:0/1504007522 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fc8d0060580 0x7fc8d0062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:29.999 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.995+0000 7fc8e27fc700 1 -- 172.21.15.57:0/1504007522 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc8e807bba0 con 0x7fc8ec14fd10 2023-10-06T03:01:30.000 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.995+0000 7fc8f188b700 1 --2- 172.21.15.57:0/1504007522 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fc8d0060580 0x7fc8d0062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:30.000 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:29.995+0000 7fc8f188b700 1 --2- 172.21.15.57:0/1504007522 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fc8d0060580 0x7fc8d0062a30 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc8ec15b8b0 tx=0x7fc8dc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:30.008 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:30.003+0000 7fc8e27fc700 1 -- 172.21.15.57:0/1504007522 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fc8ec0cc8a0 con 0x7fc8ec14fd10 2023-10-06T03:01:30.180 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:30.175+0000 7fc8f42f0700 1 -- 172.21.15.57:0/1504007522 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fc8ec0cc8a0 con 0x7fc8ec14fd10 2023-10-06T03:01:30.191 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:30.187+0000 7fc8e27fc700 1 -- 172.21.15.57:0/1504007522 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc8ec0cc8a0 con 0x7fc8ec14fd10 2023-10-06T03:01:30.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:30.187+0000 7fc8f42f0700 1 -- 172.21.15.57:0/1504007522 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fc8d0060580 msgr2=0x7fc8d0062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:30.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:30.187+0000 7fc8f42f0700 1 --2- 172.21.15.57:0/1504007522 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fc8d0060580 0x7fc8d0062a30 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc8ec15b8b0 tx=0x7fc8dc008040 comp rx=0 tx=0).stop 2023-10-06T03:01:30.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:30.187+0000 7fc8f42f0700 1 -- 172.21.15.57:0/1504007522 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc8ec14fd10 msgr2=0x7fc8ec0b5af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:30.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:30.187+0000 7fc8f42f0700 1 --2- 172.21.15.57:0/1504007522 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc8ec14fd10 0x7fc8ec0b5af0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc8e800e7e0 tx=0x7fc8e8000c50 comp rx=0 tx=0).stop 2023-10-06T03:01:30.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:30.191+0000 7fc8f42f0700 1 -- 172.21.15.57:0/1504007522 shutdown_connections 2023-10-06T03:01:30.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:30.191+0000 7fc8f42f0700 1 --2- 172.21.15.57:0/1504007522 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fc8d0060580 0x7fc8d0062a30 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:30.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:30.191+0000 7fc8f42f0700 1 --2- 172.21.15.57:0/1504007522 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc8ec15ac80 0x7fc8ec15b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:30.196 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:30.191+0000 7fc8f42f0700 1 --2- 172.21.15.57:0/1504007522 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc8ec0b33d0 0x7fc8ec14e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:30.196 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:30.191+0000 7fc8f42f0700 1 --2- 172.21.15.57:0/1504007522 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc8ec14fd10 0x7fc8ec0b5af0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:30.196 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:30.191+0000 7fc8f42f0700 1 -- 172.21.15.57:0/1504007522 >> 172.21.15.57:0/1504007522 conn(0x7fc8ec0ccbc0 msgr2=0x7fc8ec15c040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:30.196 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:30.191+0000 7fc8f42f0700 1 -- 172.21.15.57:0/1504007522 shutdown_connections 2023-10-06T03:01:30.196 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:30.191+0000 7fc8f42f0700 1 -- 172.21.15.57:0/1504007522 wait complete. 2023-10-06T03:01:30.215 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T03:01:30.216 DEBUG:teuthology.orchestra.run.smithi057:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T03:01:30.256 DEBUG:teuthology.orchestra.run.smithi105:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T03:01:30.301 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T03:01:30.301 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-06T03:01:30.301 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:01:30.302 DEBUG:teuthology.orchestra.run.smithi057:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-10-06T03:01:30.401 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi057.front.sepia.ceph.com 2023-10-06T03:01:30.401 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:01:30.401 DEBUG:teuthology.orchestra.run.smithi057:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T03:01:30.427 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-06T03:01:30.428 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:01:30.428 DEBUG:teuthology.orchestra.run.smithi105:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-10-06T03:01:30.516 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi105.front.sepia.ceph.com 2023-10-06T03:01:30.516 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:01:30.516 DEBUG:teuthology.orchestra.run.smithi105:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-06T03:01:30.543 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2023-10-06T03:01:30.543 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:01:30.543 DEBUG:teuthology.orchestra.run.smithi057:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2023-10-06T03:01:30.611 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi057.front.sepia.ceph.com 2023-10-06T03:01:30.612 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:01:30.612 DEBUG:teuthology.orchestra.run.smithi057:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-06T03:01:30.627 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2023-10-06T03:01:30.627 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:01:30.628 DEBUG:teuthology.orchestra.run.smithi105:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2023-10-06T03:01:30.703 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi105.front.sepia.ceph.com 2023-10-06T03:01:30.704 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:01:30.704 DEBUG:teuthology.orchestra.run.smithi105:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-06T03:01:30.724 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-06T03:01:30.724 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:01:30.893 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:30.887+0000 7fca4359e700 1 Processor -- start 2023-10-06T03:01:30.894 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:30.887+0000 7fca4359e700 1 -- start start 2023-10-06T03:01:30.897 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:30.891+0000 7fca4359e700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fca44156e50 0x7fca440c9030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:30.897 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:30.891+0000 7fca4359e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca440cd870 0x7fca440cc010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:30.897 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:30.891+0000 7fca4359e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca440cd3e0 con 0x7fca44157220 2023-10-06T03:01:30.897 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:30.891+0000 7fca4359e700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca440ae930 con 0x7fca44156e50 2023-10-06T03:01:30.897 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:30.891+0000 7fca4359e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca440cc550 con 0x7fca440cd870 2023-10-06T03:01:30.897 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:30.891+0000 7fca4259c700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fca44156e50 0x7fca440c9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:30.898 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:30.891+0000 7fca42d9d700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fca44157220 0x7fca4415aba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:55568/0 (socket says 172.21.15.57:55568) 2023-10-06T03:01:30.898 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:30.891+0000 7fca42d9d700 1 -- 172.21.15.57:0/156651822 learned_addr learned my addr 172.21.15.57:0/156651822 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:01:30.898 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:30.891+0000 7fca39d9b700 1 --2- 172.21.15.57:0/156651822 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca440cd870 0x7fca440cc010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:30.898 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:30.891+0000 7fca4259c700 1 -- 172.21.15.57:0/156651822 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca440cd870 msgr2=0x7fca440cc010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:30.898 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:30.891+0000 7fca4259c700 1 --2- 172.21.15.57:0/156651822 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca440cd870 0x7fca440cc010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:30.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:30.891+0000 7fca41d9b700 1 -- 172.21.15.57:0/156651822 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1321034083 0 0) 0x7fca440cd3e0 con 0x7fca44157220 2023-10-06T03:01:30.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:30.891+0000 7fca4259c700 1 -- 172.21.15.57:0/156651822 >> v1:172.21.15.57:6789/0 conn(0x7fca44157220 legacy=0x7fca4415aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:30.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:30.891+0000 7fca4259c700 1 -- 172.21.15.57:0/156651822 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca440cc7d0 con 0x7fca44156e50 2023-10-06T03:01:30.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:30.895+0000 7fca4259c700 1 --2- 172.21.15.57:0/156651822 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca44156e50 0x7fca440c9030 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fca34009e60 tx=0x7fca34009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fcc955941904a3b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:30.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:30.895+0000 7fca41d9b700 1 -- 172.21.15.57:0/156651822 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca3400e070 con 0x7fca44156e50 2023-10-06T03:01:30.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:30.895+0000 7fca41d9b700 1 -- 172.21.15.57:0/156651822 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca3400bb60 con 0x7fca44156e50 2023-10-06T03:01:30.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:30.895+0000 7fca41d9b700 1 -- 172.21.15.57:0/156651822 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca34012430 con 0x7fca44156e50 2023-10-06T03:01:30.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:30.895+0000 7fca4359e700 1 -- 172.21.15.57:0/156651822 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca44156e50 msgr2=0x7fca440c9030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:30.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:30.895+0000 7fca4359e700 1 --2- 172.21.15.57:0/156651822 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca44156e50 0x7fca440c9030 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fca34009e60 tx=0x7fca34009780 comp rx=0 tx=0).stop 2023-10-06T03:01:30.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:30.895+0000 7fca4359e700 1 -- 172.21.15.57:0/156651822 shutdown_connections 2023-10-06T03:01:30.902 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:30.895+0000 7fca4359e700 1 --2- 172.21.15.57:0/156651822 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca440cd870 0x7fca440cc010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:30.902 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:30.895+0000 7fca4359e700 1 --2- 172.21.15.57:0/156651822 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca44156e50 0x7fca440c9030 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:30.902 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:30.895+0000 7fca4359e700 1 -- 172.21.15.57:0/156651822 >> 172.21.15.57:0/156651822 conn(0x7fca440cdd80 msgr2=0x7fca440ce180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:30.902 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:30.895+0000 7fca4359e700 1 -- 172.21.15.57:0/156651822 shutdown_connections 2023-10-06T03:01:30.902 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:30.895+0000 7fca4359e700 1 -- 172.21.15.57:0/156651822 wait complete. 2023-10-06T03:01:30.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:30.899+0000 7fca4359e700 1 Processor -- start 2023-10-06T03:01:30.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:30.899+0000 7fca4359e700 1 -- start start 2023-10-06T03:01:30.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:30.899+0000 7fca4359e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca440cd870 0x7fca441690b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:30.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:30.899+0000 7fca4359e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca44156e50 0x7fca44067f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:30.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:30.899+0000 7fca4359e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca44157220 0x7fca44068450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:30.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:30.899+0000 7fca4359e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca440c4260 con 0x7fca44156e50 2023-10-06T03:01:30.906 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:30.899+0000 7fca4359e700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca440c4fd0 con 0x7fca440cd870 2023-10-06T03:01:30.906 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:30.899+0000 7fca4359e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca440c52b0 con 0x7fca44157220 2023-10-06T03:01:30.906 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:30.899+0000 7fca39d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca44156e50 0x7fca44067f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:30.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:30.899+0000 7fca4259c700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca440cd870 0x7fca441690b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:30.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:30.899+0000 7fca39d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca44156e50 0x7fca44067f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33246/0 (socket says 172.21.15.57:33246) 2023-10-06T03:01:30.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:30.899+0000 7fca39d9b700 1 -- 172.21.15.57:0/1886984816 learned_addr learned my addr 172.21.15.57:0/1886984816 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:30.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:30.899+0000 7fca42d9d700 1 --2- 172.21.15.57:0/1886984816 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca44157220 0x7fca44068450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:30.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:30.903+0000 7fca39d9b700 1 -- 172.21.15.57:0/1886984816 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca44157220 msgr2=0x7fca44068450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:30.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:30.903+0000 7fca39d9b700 1 --2- 172.21.15.57:0/1886984816 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca44157220 0x7fca44068450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:30.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:30.903+0000 7fca39d9b700 1 -- 172.21.15.57:0/1886984816 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca440cd870 msgr2=0x7fca441690b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:30.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:30.903+0000 7fca39d9b700 1 --2- 172.21.15.57:0/1886984816 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca440cd870 0x7fca441690b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:30.908 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:30.903+0000 7fca39d9b700 1 -- 172.21.15.57:0/1886984816 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca34009a20 con 0x7fca44156e50 2023-10-06T03:01:30.908 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:30.903+0000 7fca39d9b700 1 --2- 172.21.15.57:0/1886984816 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca44156e50 0x7fca44067f10 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fca2c00e930 tx=0x7fca2c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:30.908 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:30.903+0000 7fca3affd700 1 -- 172.21.15.57:0/1886984816 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca2c013680 con 0x7fca44156e50 2023-10-06T03:01:30.909 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:30.903+0000 7fca3affd700 1 -- 172.21.15.57:0/1886984816 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca2c0137e0 con 0x7fca44156e50 2023-10-06T03:01:30.909 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:30.903+0000 7fca4359e700 1 -- 172.21.15.57:0/1886984816 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca440c5590 con 0x7fca44156e50 2023-10-06T03:01:30.909 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:30.903+0000 7fca3affd700 1 -- 172.21.15.57:0/1886984816 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca2c013b80 con 0x7fca44156e50 2023-10-06T03:01:30.909 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:30.903+0000 7fca4359e700 1 -- 172.21.15.57:0/1886984816 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca440c3530 con 0x7fca44156e50 2023-10-06T03:01:30.909 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:30.903+0000 7fca4359e700 1 -- 172.21.15.57:0/1886984816 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca440c57d0 con 0x7fca44156e50 2023-10-06T03:01:30.911 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:30.907+0000 7fca3affd700 1 -- 172.21.15.57:0/1886984816 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fca2c00c3e0 con 0x7fca44156e50 2023-10-06T03:01:30.912 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:30.907+0000 7fca3affd700 1 --2- 172.21.15.57:0/1886984816 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fca24060550 0x7fca24062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:30.913 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:30.907+0000 7fca3affd700 1 -- 172.21.15.57:0/1886984816 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fca2c07ca60 con 0x7fca44156e50 2023-10-06T03:01:30.913 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:30.907+0000 7fca4259c700 1 --2- 172.21.15.57:0/1886984816 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fca24060550 0x7fca24062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:30.914 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:30.907+0000 7fca4259c700 1 --2- 172.21.15.57:0/1886984816 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fca24060550 0x7fca24062a00 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fca340097c0 tx=0x7fca34019000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:30.919 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:30.915+0000 7fca3affd700 1 -- 172.21.15.57:0/1886984816 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fca440c57d0 con 0x7fca44156e50 2023-10-06T03:01:31.126 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.119+0000 7fca4359e700 1 -- 172.21.15.57:0/1886984816 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fca440c57d0 con 0x7fca44156e50 2023-10-06T03:01:31.128 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.123+0000 7fca3affd700 1 -- 172.21.15.57:0/1886984816 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4594 (secure 0 0 0) 0x7fca440c57d0 con 0x7fca44156e50 2023-10-06T03:01:31.128 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:01:31.128 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6834/1042131376","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":1042131376},{"type":"v1","addr":"172.21.15.105:6834","nonce":1042131376}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4287,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6836/3619570714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":3619570714},{"type":"v1","addr":"172.21.15.57:6836","nonce":3619570714}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6837/645924568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6835","nonce":645924568},{"type":"v1","addr":"172.21.15.57:6837","nonce":645924568}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:00:57.411689+0000","modified":"2023-10-06T03:01:00.999490+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4303},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4303":{"gid":4303,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6835/1286071598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":1286071598},{"type":"v1","addr":"172.21.15.105:6835","nonce":1286071598}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T03:01:31.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.123+0000 7fca4359e700 1 -- 172.21.15.57:0/1886984816 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fca24060550 msgr2=0x7fca24062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:31.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.123+0000 7fca4359e700 1 --2- 172.21.15.57:0/1886984816 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fca24060550 0x7fca24062a00 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fca340097c0 tx=0x7fca34019000 comp rx=0 tx=0).stop 2023-10-06T03:01:31.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.123+0000 7fca4359e700 1 -- 172.21.15.57:0/1886984816 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca44156e50 msgr2=0x7fca44067f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:31.131 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.123+0000 7fca4359e700 1 --2- 172.21.15.57:0/1886984816 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca44156e50 0x7fca44067f10 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fca2c00e930 tx=0x7fca2c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:01:31.131 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.123+0000 7fca4359e700 1 -- 172.21.15.57:0/1886984816 shutdown_connections 2023-10-06T03:01:31.131 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.123+0000 7fca4359e700 1 --2- 172.21.15.57:0/1886984816 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fca24060550 0x7fca24062a00 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:31.131 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.123+0000 7fca4359e700 1 --2- 172.21.15.57:0/1886984816 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca44157220 0x7fca44068450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:31.131 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.123+0000 7fca4359e700 1 --2- 172.21.15.57:0/1886984816 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca44156e50 0x7fca44067f10 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:31.131 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.123+0000 7fca4359e700 1 --2- 172.21.15.57:0/1886984816 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca440cd870 0x7fca441690b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:31.131 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.123+0000 7fca4359e700 1 -- 172.21.15.57:0/1886984816 >> 172.21.15.57:0/1886984816 conn(0x7fca440cdd80 msgr2=0x7fca44150790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:31.131 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.123+0000 7fca4359e700 1 -- 172.21.15.57:0/1886984816 shutdown_connections 2023-10-06T03:01:31.131 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.127+0000 7fca4359e700 1 -- 172.21.15.57:0/1886984816 wait complete. 2023-10-06T03:01:31.133 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 8 2023-10-06T03:01:31.150 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:01:31.306 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.299+0000 7fe815ae3700 1 Processor -- start 2023-10-06T03:01:31.307 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.303+0000 7fe815ae3700 1 -- start start 2023-10-06T03:01:31.309 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.303+0000 7fe815ae3700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe81006c920 0x7fe81006ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:31.309 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.303+0000 7fe815ae3700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fe8100af0d0 0x7fe8100af530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:31.309 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.303+0000 7fe815ae3700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe81006b4a0 con 0x7fe81006d230 2023-10-06T03:01:31.309 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.303+0000 7fe815ae3700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe81006a890 con 0x7fe81006c920 2023-10-06T03:01:31.309 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.303+0000 7fe815ae3700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe81006ab70 con 0x7fe8100af0d0 2023-10-06T03:01:31.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.303+0000 7fe814ae1700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe81006c920 0x7fe81006ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:31.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.303+0000 7fe80ffff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fe81006d230 0x7fe8100ae9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:55580/0 (socket says 172.21.15.57:55580) 2023-10-06T03:01:31.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.303+0000 7fe80ffff700 1 -- 172.21.15.57:0/1420850279 learned_addr learned my addr 172.21.15.57:0/1420850279 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:01:31.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.303+0000 7fe8152e2700 1 --2- 172.21.15.57:0/1420850279 >> v2:172.21.15.105:3300/0 conn(0x7fe8100af0d0 0x7fe8100af530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:31.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.303+0000 7fe814ae1700 1 -- 172.21.15.57:0/1420850279 >> v2:172.21.15.105:3300/0 conn(0x7fe8100af0d0 msgr2=0x7fe8100af530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:31.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.303+0000 7fe814ae1700 1 --2- 172.21.15.57:0/1420850279 >> v2:172.21.15.105:3300/0 conn(0x7fe8100af0d0 0x7fe8100af530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:31.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.303+0000 7fe814ae1700 1 -- 172.21.15.57:0/1420850279 >> v1:172.21.15.57:6789/0 conn(0x7fe81006d230 legacy=0x7fe8100ae9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:31.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.307+0000 7fe814ae1700 1 -- 172.21.15.57:0/1420850279 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe81006ae50 con 0x7fe81006c920 2023-10-06T03:01:31.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.307+0000 7fe8152e2700 1 --2- 172.21.15.57:0/1420850279 >> v2:172.21.15.105:3300/0 conn(0x7fe8100af0d0 0x7fe8100af530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:31.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.307+0000 7fe814ae1700 1 --2- 172.21.15.57:0/1420850279 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe81006c920 0x7fe81006ccf0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe8100ae760 tx=0x7fe8040091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97029033f68ab179 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:31.312 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.307+0000 7fe80f7fe700 1 -- 172.21.15.57:0/1420850279 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe80400b6b0 con 0x7fe81006c920 2023-10-06T03:01:31.312 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.307+0000 7fe80f7fe700 1 -- 172.21.15.57:0/1420850279 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe80400b810 con 0x7fe81006c920 2023-10-06T03:01:31.312 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.307+0000 7fe80f7fe700 1 -- 172.21.15.57:0/1420850279 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe80400bbb0 con 0x7fe81006c920 2023-10-06T03:01:31.312 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.307+0000 7fe815ae3700 1 -- 172.21.15.57:0/1420850279 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe81006c920 msgr2=0x7fe81006ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:31.312 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.307+0000 7fe815ae3700 1 --2- 172.21.15.57:0/1420850279 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe81006c920 0x7fe81006ccf0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe8100ae760 tx=0x7fe8040091a0 comp rx=0 tx=0).stop 2023-10-06T03:01:31.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.307+0000 7fe815ae3700 1 -- 172.21.15.57:0/1420850279 shutdown_connections 2023-10-06T03:01:31.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.307+0000 7fe815ae3700 1 --2- 172.21.15.57:0/1420850279 >> v2:172.21.15.105:3300/0 conn(0x7fe8100af0d0 0x7fe8100af530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:31.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.307+0000 7fe815ae3700 1 --2- 172.21.15.57:0/1420850279 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe81006c920 0x7fe81006ccf0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:31.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.307+0000 7fe815ae3700 1 -- 172.21.15.57:0/1420850279 >> 172.21.15.57:0/1420850279 conn(0x7fe8100c85e0 msgr2=0x7fe8100c89e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:31.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.307+0000 7fe815ae3700 1 -- 172.21.15.57:0/1420850279 shutdown_connections 2023-10-06T03:01:31.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.307+0000 7fe815ae3700 1 -- 172.21.15.57:0/1420850279 wait complete. 2023-10-06T03:01:31.314 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.311+0000 7fe815ae3700 1 Processor -- start 2023-10-06T03:01:31.315 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.311+0000 7fe815ae3700 1 -- start start 2023-10-06T03:01:31.316 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.311+0000 7fe815ae3700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe81006c920 0x7fe8100ab770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:31.316 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.311+0000 7fe815ae3700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe81006d230 0x7fe810158610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:31.316 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.311+0000 7fe815ae3700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe8100af0d0 0x7fe8100a9df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:31.316 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.311+0000 7fe815ae3700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8100ab2e0 con 0x7fe81006c920 2023-10-06T03:01:31.316 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.311+0000 7fe815ae3700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8100abcb0 con 0x7fe8100af0d0 2023-10-06T03:01:31.317 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.311+0000 7fe815ae3700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8100aa9b0 con 0x7fe81006d230 2023-10-06T03:01:31.317 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.311+0000 7fe814ae1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe81006c920 0x7fe8100ab770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:31.318 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.311+0000 7fe814ae1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe81006c920 0x7fe8100ab770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33266/0 (socket says 172.21.15.57:33266) 2023-10-06T03:01:31.318 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.311+0000 7fe814ae1700 1 -- 172.21.15.57:0/3136182010 learned_addr learned my addr 172.21.15.57:0/3136182010 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:31.318 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.311+0000 7fe8152e2700 1 --2- 172.21.15.57:0/3136182010 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe8100af0d0 0x7fe8100a9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:31.318 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.311+0000 7fe80ffff700 1 --2- 172.21.15.57:0/3136182010 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe81006d230 0x7fe810158610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:31.318 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.311+0000 7fe814ae1700 1 -- 172.21.15.57:0/3136182010 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe81006d230 msgr2=0x7fe810158610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:31.318 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.311+0000 7fe814ae1700 1 --2- 172.21.15.57:0/3136182010 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe81006d230 0x7fe810158610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:31.318 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.311+0000 7fe814ae1700 1 -- 172.21.15.57:0/3136182010 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe8100af0d0 msgr2=0x7fe8100a9df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:31.318 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.311+0000 7fe814ae1700 1 --2- 172.21.15.57:0/3136182010 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe8100af0d0 0x7fe8100a9df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:31.318 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.311+0000 7fe814ae1700 1 -- 172.21.15.57:0/3136182010 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe804009420 con 0x7fe81006c920 2023-10-06T03:01:31.319 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.311+0000 7fe814ae1700 1 --2- 172.21.15.57:0/3136182010 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe81006c920 0x7fe8100ab770 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe81006a1d0 tx=0x7fe804017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:31.319 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.315+0000 7fe80cff9700 1 -- 172.21.15.57:0/3136182010 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe80400bb90 con 0x7fe81006c920 2023-10-06T03:01:31.319 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.315+0000 7fe80cff9700 1 -- 172.21.15.57:0/3136182010 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe804011420 con 0x7fe81006c920 2023-10-06T03:01:31.319 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.315+0000 7fe815ae3700 1 -- 172.21.15.57:0/3136182010 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8100aac90 con 0x7fe81006c920 2023-10-06T03:01:31.319 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.315+0000 7fe80cff9700 1 -- 172.21.15.57:0/3136182010 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8040117a0 con 0x7fe81006c920 2023-10-06T03:01:31.319 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.315+0000 7fe815ae3700 1 -- 172.21.15.57:0/3136182010 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8100aa6b0 con 0x7fe81006c920 2023-10-06T03:01:31.321 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.315+0000 7fe815ae3700 1 -- 172.21.15.57:0/3136182010 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe81004be40 con 0x7fe81006c920 2023-10-06T03:01:31.322 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.319+0000 7fe80cff9700 1 -- 172.21.15.57:0/3136182010 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fe804011b90 con 0x7fe81006c920 2023-10-06T03:01:31.324 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.319+0000 7fe80cff9700 1 --2- 172.21.15.57:0/3136182010 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fe7f4060550 0x7fe7f4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:31.324 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.319+0000 7fe80cff9700 1 -- 172.21.15.57:0/3136182010 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe80407e140 con 0x7fe81006c920 2023-10-06T03:01:31.324 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.319+0000 7fe80ffff700 1 --2- 172.21.15.57:0/3136182010 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fe7f4060550 0x7fe7f4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:31.325 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.319+0000 7fe80ffff700 1 --2- 172.21.15.57:0/3136182010 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fe7f4060550 0x7fe7f4062a00 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe8100b1450 tx=0x7fe7fc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:31.329 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.323+0000 7fe80cff9700 1 -- 172.21.15.57:0/3136182010 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fe80404e5d0 con 0x7fe81006c920 2023-10-06T03:01:31.497 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.491+0000 7fe815ae3700 1 -- 172.21.15.57:0/3136182010 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe8100ae520 con 0x7fe81006c920 2023-10-06T03:01:31.499 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.495+0000 7fe80cff9700 1 -- 172.21.15.57:0/3136182010 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16866 (secure 0 0 0) 0x7fe804051bf0 con 0x7fe81006c920 2023-10-06T03:01:31.499 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:01:31.500 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":23,"fsid":"eb56dc0f-9213-41cb-9aad-8ade6c802e98","created":"2023-10-06T03:00:30.806197+0000","modified":"2023-10-06T03:00:58.975366+0000","last_up_change":"2023-10-06T03:00:43.607454+0000","last_in_change":"2023-10-06T03:00:33.943513+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T03:00:44.360651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T03:00:50.466601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:00:55.472586+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T03:00:56.400884+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"58cf6c90-d704-43e0-b2db-dffe526d5e8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":33053},{"type":"v1","addr":"172.21.15.57:6801","nonce":33053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":33053},{"type":"v1","addr":"172.21.15.57:6803","nonce":33053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":33053},{"type":"v1","addr":"172.21.15.57:6807","nonce":33053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":33053},{"type":"v1","addr":"172.21.15.57:6805","nonce":33053}]},"public_addr":"172.21.15.57:6801/33053","cluster_addr":"172.21.15.57:6803/33053","heartbeat_back_addr":"172.21.15.57:6807/33053","heartbeat_front_addr":"172.21.15.57:6805/33053","state":["exists","up"]},{"osd":1,"uuid":"16afbe70-7f9e-4568-9c92-763e6e348119","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6809","nonce":33052},{"type":"v1","addr":"172.21.15.57:6810","nonce":33052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":33052},{"type":"v1","addr":"172.21.15.57:6813","nonce":33052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":33052},{"type":"v1","addr":"172.21.15.57:6822","nonce":33052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6815","nonce":33052},{"type":"v1","addr":"172.21.15.57:6818","nonce":33052}]},"public_addr":"172.21.15.57:6810/33052","cluster_addr":"172.21.15.57:6813/33052","heartbeat_back_addr":"172.21.15.57:6822/33052","heartbeat_front_addr":"172.21.15.57:6818/33052","state":["exists","up"]},{"osd":2,"uuid":"7255c62e-f92f-470f-a5ce-30228920d9f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":33058},{"type":"v1","addr":"172.21.15.57:6825","nonce":33058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":33058},{"type":"v1","addr":"172.21.15.57:6827","nonce":33058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":33058},{"type":"v1","addr":"172.21.15.57:6831","nonce":33058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":33058},{"type":"v1","addr":"172.21.15.57:6829","nonce":33058}]},"public_addr":"172.21.15.57:6825/33058","cluster_addr":"172.21.15.57:6827/33058","heartbeat_back_addr":"172.21.15.57:6831/33058","heartbeat_front_addr":"172.21.15.57:6829/33058","state":["exists","up"]},{"osd":3,"uuid":"152a236d-f799-4888-8544-74865508d5a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":33057},{"type":"v1","addr":"172.21.15.57:6811","nonce":33057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":33057},{"type":"v1","addr":"172.21.15.57:6816","nonce":33057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6821","nonce":33057},{"type":"v1","addr":"172.21.15.57:6823","nonce":33057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6817","nonce":33057},{"type":"v1","addr":"172.21.15.57:6819","nonce":33057}]},"public_addr":"172.21.15.57:6811/33057","cluster_addr":"172.21.15.57:6816/33057","heartbeat_back_addr":"172.21.15.57:6823/33057","heartbeat_front_addr":"172.21.15.57:6819/33057","state":["exists","up"]},{"osd":4,"uuid":"37db2a65-3566-41d0-9d60-e66c49e1e68e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":33368},{"type":"v1","addr":"172.21.15.105:6801","nonce":33368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":33368},{"type":"v1","addr":"172.21.15.105:6803","nonce":33368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":33368},{"type":"v1","addr":"172.21.15.105:6807","nonce":33368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":33368},{"type":"v1","addr":"172.21.15.105:6805","nonce":33368}]},"public_addr":"172.21.15.105:6801/33368","cluster_addr":"172.21.15.105:6803/33368","heartbeat_back_addr":"172.21.15.105:6807/33368","heartbeat_front_addr":"172.21.15.105:6805/33368","state":["exists","up"]},{"osd":5,"uuid":"35e77918-1bb4-42ca-9b20-f3c14eaa0c04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":33379},{"type":"v1","addr":"172.21.15.105:6818","nonce":33379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":33379},{"type":"v1","addr":"172.21.15.105:6823","nonce":33379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":33379},{"type":"v1","addr":"172.21.15.105:6831","nonce":33379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":33379},{"type":"v1","addr":"172.21.15.105:6827","nonce":33379}]},"public_addr":"172.21.15.105:6818/33379","cluster_addr":"172.21.15.105:6823/33379","heartbeat_back_addr":"172.21.15.105:6831/33379","heartbeat_front_addr":"172.21.15.105:6827/33379","state":["exists","up"]},{"osd":6,"uuid":"b4d9d510-7a45-4173-8287-c6c8d6547f2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":33369},{"type":"v1","addr":"172.21.15.105:6819","nonce":33369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":33369},{"type":"v1","addr":"172.21.15.105:6822","nonce":33369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":33369},{"type":"v1","addr":"172.21.15.105:6830","nonce":33369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":33369},{"type":"v1","addr":"172.21.15.105:6826","nonce":33369}]},"public_addr":"172.21.15.105:6819/33369","cluster_addr":"172.21.15.105:6822/33369","heartbeat_back_addr":"172.21.15.105:6830/33369","heartbeat_front_addr":"172.21.15.105:6826/33369","state":["exists","up"]},{"osd":7,"uuid":"74266fb0-cd84-463f-8bf0-092652a71dc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":33370},{"type":"v1","addr":"172.21.15.105:6809","nonce":33370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":33370},{"type":"v1","addr":"172.21.15.105:6811","nonce":33370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":33370},{"type":"v1","addr":"172.21.15.105:6815","nonce":33370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":33370},{"type":"v1","addr":"172.21.15.105:6813","nonce":33370}]},"public_addr":"172.21.15.105:6809/33370","cluster_addr":"172.21.15.105:6811/33370","heartbeat_back_addr":"172.21.15.105:6815/33370","heartbeat_front_addr":"172.21.15.105:6813/33370","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.596864+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.633851+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.636993+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.529681+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.608601+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.659752+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.661717+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.642221+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:01:31.502 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.495+0000 7fe815ae3700 1 -- 172.21.15.57:0/3136182010 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fe7f4060550 msgr2=0x7fe7f4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:31.502 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.495+0000 7fe815ae3700 1 --2- 172.21.15.57:0/3136182010 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fe7f4060550 0x7fe7f4062a00 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe8100b1450 tx=0x7fe7fc009040 comp rx=0 tx=0).stop 2023-10-06T03:01:31.502 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.495+0000 7fe815ae3700 1 -- 172.21.15.57:0/3136182010 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe81006c920 msgr2=0x7fe8100ab770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:31.502 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.495+0000 7fe815ae3700 1 --2- 172.21.15.57:0/3136182010 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe81006c920 0x7fe8100ab770 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe81006a1d0 tx=0x7fe804017000 comp rx=0 tx=0).stop 2023-10-06T03:01:31.502 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.495+0000 7fe815ae3700 1 -- 172.21.15.57:0/3136182010 shutdown_connections 2023-10-06T03:01:31.502 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.495+0000 7fe815ae3700 1 --2- 172.21.15.57:0/3136182010 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe8100af0d0 0x7fe8100a9df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:31.502 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.495+0000 7fe815ae3700 1 --2- 172.21.15.57:0/3136182010 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fe7f4060550 0x7fe7f4062a00 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:31.503 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.495+0000 7fe815ae3700 1 --2- 172.21.15.57:0/3136182010 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe81006d230 0x7fe810158610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:31.503 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.495+0000 7fe815ae3700 1 --2- 172.21.15.57:0/3136182010 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe81006c920 0x7fe8100ab770 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:31.503 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.495+0000 7fe815ae3700 1 -- 172.21.15.57:0/3136182010 >> 172.21.15.57:0/3136182010 conn(0x7fe8100c85e0 msgr2=0x7fe810159f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:31.503 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.495+0000 7fe815ae3700 1 -- 172.21.15.57:0/3136182010 shutdown_connections 2023-10-06T03:01:31.503 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.495+0000 7fe815ae3700 1 -- 172.21.15.57:0/3136182010 wait complete. 2023-10-06T03:01:31.524 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T03:00:44.360651+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T03:00:50.466601+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T03:00:55.472586+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T03:00:56.400884+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T03:01:31.524 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T03:01:31.693 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.687+0000 7fd700b45700 1 Processor -- start 2023-10-06T03:01:31.693 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.687+0000 7fd700b45700 1 -- start start 2023-10-06T03:01:31.696 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.691+0000 7fd700b45700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd6fc156e20 0x7fd6fc0adf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:31.696 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.691+0000 7fd700b45700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fd6fc1571f0 0x7fd6fc06d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:31.696 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.691+0000 7fd700b45700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6fc06afd0 con 0x7fd6fc0aeb10 2023-10-06T03:01:31.696 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.691+0000 7fd700b45700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6fc0ac6c0 con 0x7fd6fc156e20 2023-10-06T03:01:31.696 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.691+0000 7fd700b45700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6fc0ac9a0 con 0x7fd6fc1571f0 2023-10-06T03:01:31.696 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.691+0000 7fd6f1d9b700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fd6fc0aeb10 0x7fd6fc06c920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:55582/0 (socket says 172.21.15.57:55582) 2023-10-06T03:01:31.696 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.691+0000 7fd6f1d9b700 1 -- 172.21.15.57:0/1428235922 learned_addr learned my addr 172.21.15.57:0/1428235922 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:01:31.697 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.691+0000 7fd6fa59c700 1 --2- 172.21.15.57:0/1428235922 >> v2:172.21.15.57:3300/0 conn(0x7fd6fc156e20 0x7fd6fc0adf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:31.697 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.691+0000 7fd6fad9d700 1 --2- 172.21.15.57:0/1428235922 >> v2:172.21.15.105:3300/0 conn(0x7fd6fc1571f0 0x7fd6fc06d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:31.697 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.691+0000 7fd6f9d9b700 1 -- 172.21.15.57:0/1428235922 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3866590358 0 0) 0x7fd6fc06afd0 con 0x7fd6fc0aeb10 2023-10-06T03:01:31.698 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.691+0000 7fd6f9d9b700 1 -- 172.21.15.57:0/1428235922 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6e8003570 con 0x7fd6fc0aeb10 2023-10-06T03:01:31.698 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.691+0000 7fd6fa59c700 1 -- 172.21.15.57:0/1428235922 >> v2:172.21.15.105:3300/0 conn(0x7fd6fc1571f0 msgr2=0x7fd6fc06d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:31.698 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.691+0000 7fd6fa59c700 1 --2- 172.21.15.57:0/1428235922 >> v2:172.21.15.105:3300/0 conn(0x7fd6fc1571f0 0x7fd6fc06d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:31.698 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.691+0000 7fd6f9d9b700 1 -- 172.21.15.57:0/1428235922 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3708414313 0 0) 0x7fd6e8003570 con 0x7fd6fc0aeb10 2023-10-06T03:01:31.698 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.691+0000 7fd6fa59c700 1 -- 172.21.15.57:0/1428235922 >> v1:172.21.15.57:6789/0 conn(0x7fd6fc0aeb10 legacy=0x7fd6fc06c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:31.698 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.691+0000 7fd6fa59c700 1 -- 172.21.15.57:0/1428235922 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6fc06a980 con 0x7fd6fc156e20 2023-10-06T03:01:31.699 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.691+0000 7fd6fa59c700 1 --2- 172.21.15.57:0/1428235922 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd6fc156e20 0x7fd6fc0adf80 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc0ae8a0 tx=0x7fd6ec009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=379c7793246bc77b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:31.699 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.691+0000 7fd6f9d9b700 1 -- 172.21.15.57:0/1428235922 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6ec00e070 con 0x7fd6fc156e20 2023-10-06T03:01:31.699 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.691+0000 7fd6f9d9b700 1 -- 172.21.15.57:0/1428235922 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6ec00b7a0 con 0x7fd6fc156e20 2023-10-06T03:01:31.699 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.691+0000 7fd6f9d9b700 1 -- 172.21.15.57:0/1428235922 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e4001470 con 0x7fd6fc156e20 2023-10-06T03:01:31.700 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.695+0000 7fd700b45700 1 -- 172.21.15.57:0/1428235922 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd6fc156e20 msgr2=0x7fd6fc0adf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:31.700 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.695+0000 7fd700b45700 1 --2- 172.21.15.57:0/1428235922 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd6fc156e20 0x7fd6fc0adf80 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc0ae8a0 tx=0x7fd6ec009780 comp rx=0 tx=0).stop 2023-10-06T03:01:31.700 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.695+0000 7fd700b45700 1 -- 172.21.15.57:0/1428235922 shutdown_connections 2023-10-06T03:01:31.700 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.695+0000 7fd700b45700 1 --2- 172.21.15.57:0/1428235922 >> v2:172.21.15.105:3300/0 conn(0x7fd6fc1571f0 0x7fd6fc06d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:31.700 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.695+0000 7fd700b45700 1 --2- 172.21.15.57:0/1428235922 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd6fc156e20 0x7fd6fc0adf80 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:31.700 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.695+0000 7fd700b45700 1 -- 172.21.15.57:0/1428235922 >> 172.21.15.57:0/1428235922 conn(0x7fd6fc0c87b0 msgr2=0x7fd6fc0c8bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:31.700 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.695+0000 7fd700b45700 1 -- 172.21.15.57:0/1428235922 shutdown_connections 2023-10-06T03:01:31.700 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.695+0000 7fd700b45700 1 -- 172.21.15.57:0/1428235922 wait complete. 2023-10-06T03:01:31.704 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.699+0000 7fd700b45700 1 Processor -- start 2023-10-06T03:01:31.704 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.699+0000 7fd700b45700 1 -- start start 2023-10-06T03:01:31.706 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.699+0000 7fd700b45700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd6fc0aeb10 0x7fd6fc0aae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:31.706 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.699+0000 7fd700b45700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd6fc156e20 0x7fd6fc0c7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:31.706 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.699+0000 7fd700b45700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd6fc1571f0 0x7fd6fc15d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:31.706 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.699+0000 7fd700b45700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6fc16a030 con 0x7fd6fc156e20 2023-10-06T03:01:31.706 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.699+0000 7fd700b45700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6fc1691c0 con 0x7fd6fc1571f0 2023-10-06T03:01:31.706 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.699+0000 7fd700b45700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6fc1693b0 con 0x7fd6fc0aeb10 2023-10-06T03:01:31.706 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.699+0000 7fd6f1d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd6fc156e20 0x7fd6fc0c7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:31.706 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.699+0000 7fd6f1d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd6fc156e20 0x7fd6fc0c7cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33294/0 (socket says 172.21.15.57:33294) 2023-10-06T03:01:31.707 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.699+0000 7fd6f1d9b700 1 -- 172.21.15.57:0/933845795 learned_addr learned my addr 172.21.15.57:0/933845795 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:31.707 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.699+0000 7fd6fad9d700 1 --2- 172.21.15.57:0/933845795 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd6fc1571f0 0x7fd6fc15d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:31.707 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.699+0000 7fd6fa59c700 1 --2- 172.21.15.57:0/933845795 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd6fc0aeb10 0x7fd6fc0aae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:31.708 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.703+0000 7fd6f1d9b700 1 -- 172.21.15.57:0/933845795 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd6fc0aeb10 msgr2=0x7fd6fc0aae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:31.708 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.703+0000 7fd6f1d9b700 1 --2- 172.21.15.57:0/933845795 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd6fc0aeb10 0x7fd6fc0aae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:31.708 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.703+0000 7fd6f1d9b700 1 -- 172.21.15.57:0/933845795 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd6fc1571f0 msgr2=0x7fd6fc15d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:31.708 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.703+0000 7fd6f1d9b700 1 --2- 172.21.15.57:0/933845795 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd6fc1571f0 0x7fd6fc15d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:31.708 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.703+0000 7fd6f1d9b700 1 -- 172.21.15.57:0/933845795 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6ec009a20 con 0x7fd6fc156e20 2023-10-06T03:01:31.708 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.703+0000 7fd6fa59c700 1 --2- 172.21.15.57:0/933845795 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd6fc0aeb10 0x7fd6fc0aae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:31.708 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.703+0000 7fd6f1d9b700 1 --2- 172.21.15.57:0/933845795 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd6fc156e20 0x7fd6fc0c7cf0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd6e400cb90 tx=0x7fd6e4001b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:31.708 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.703+0000 7fd6f2ffd700 1 -- 172.21.15.57:0/933845795 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e4007360 con 0x7fd6fc156e20 2023-10-06T03:01:31.709 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.703+0000 7fd6f2ffd700 1 -- 172.21.15.57:0/933845795 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6e40074e0 con 0x7fd6fc156e20 2023-10-06T03:01:31.709 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.703+0000 7fd700b45700 1 -- 172.21.15.57:0/933845795 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6fc169690 con 0x7fd6fc156e20 2023-10-06T03:01:31.709 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.703+0000 7fd6f2ffd700 1 -- 172.21.15.57:0/933845795 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e4004830 con 0x7fd6fc156e20 2023-10-06T03:01:31.709 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.703+0000 7fd700b45700 1 -- 172.21.15.57:0/933845795 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6fc169c50 con 0x7fd6fc156e20 2023-10-06T03:01:31.709 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.703+0000 7fd700b45700 1 -- 172.21.15.57:0/933845795 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6fc16a170 con 0x7fd6fc156e20 2023-10-06T03:01:31.711 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.707+0000 7fd6f2ffd700 1 -- 172.21.15.57:0/933845795 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fd6e4004bc0 con 0x7fd6fc156e20 2023-10-06T03:01:31.713 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.707+0000 7fd6f2ffd700 1 --2- 172.21.15.57:0/933845795 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fd6dc060550 0x7fd6dc062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:31.713 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.707+0000 7fd6f2ffd700 1 -- 172.21.15.57:0/933845795 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd6e407c240 con 0x7fd6fc156e20 2023-10-06T03:01:31.714 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.707+0000 7fd6fa59c700 1 --2- 172.21.15.57:0/933845795 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fd6dc060550 0x7fd6dc062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:31.715 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.711+0000 7fd6fa59c700 1 --2- 172.21.15.57:0/933845795 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fd6dc060550 0x7fd6dc062a00 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec0097c0 tx=0x7fd6ec018000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:31.720 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.715+0000 7fd6f2ffd700 1 -- 172.21.15.57:0/933845795 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fd6fc16a170 con 0x7fd6fc156e20 2023-10-06T03:01:31.894 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.887+0000 7fd700b45700 1 -- 172.21.15.57:0/933845795 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd6fc16a170 con 0x7fd6fc156e20 2023-10-06T03:01:31.896 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.891+0000 7fd6f2ffd700 1 -- 172.21.15.57:0/933845795 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd6fc16a170 con 0x7fd6fc156e20 2023-10-06T03:01:31.896 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2023-10-06T03:01:31.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.895+0000 7fd700b45700 1 -- 172.21.15.57:0/933845795 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fd6dc060550 msgr2=0x7fd6dc062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:31.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.895+0000 7fd700b45700 1 --2- 172.21.15.57:0/933845795 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fd6dc060550 0x7fd6dc062a00 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec0097c0 tx=0x7fd6ec018000 comp rx=0 tx=0).stop 2023-10-06T03:01:31.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.895+0000 7fd700b45700 1 -- 172.21.15.57:0/933845795 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd6fc156e20 msgr2=0x7fd6fc0c7cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:31.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.895+0000 7fd700b45700 1 --2- 172.21.15.57:0/933845795 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd6fc156e20 0x7fd6fc0c7cf0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd6e400cb90 tx=0x7fd6e4001b50 comp rx=0 tx=0).stop 2023-10-06T03:01:31.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.895+0000 7fd700b45700 1 -- 172.21.15.57:0/933845795 shutdown_connections 2023-10-06T03:01:31.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.895+0000 7fd700b45700 1 --2- 172.21.15.57:0/933845795 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd6fc1571f0 0x7fd6fc15d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:31.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.895+0000 7fd700b45700 1 --2- 172.21.15.57:0/933845795 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd6fc156e20 0x7fd6fc0c7cf0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:31.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.895+0000 7fd700b45700 1 --2- 172.21.15.57:0/933845795 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fd6dc060550 0x7fd6dc062a00 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:31.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.895+0000 7fd700b45700 1 --2- 172.21.15.57:0/933845795 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd6fc0aeb10 0x7fd6fc0aae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:31.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.895+0000 7fd700b45700 1 -- 172.21.15.57:0/933845795 >> 172.21.15.57:0/933845795 conn(0x7fd6fc0c87b0 msgr2=0x7fd6fc0b0530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:31.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.895+0000 7fd700b45700 1 -- 172.21.15.57:0/933845795 shutdown_connections 2023-10-06T03:01:31.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:31.895+0000 7fd700b45700 1 -- 172.21.15.57:0/933845795 wait complete. 2023-10-06T03:01:31.921 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T03:01:32.093 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.087+0000 7f8458078700 1 Processor -- start 2023-10-06T03:01:32.093 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.087+0000 7f8458078700 1 -- start start 2023-10-06T03:01:32.096 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.091+0000 7f8458078700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f84500bef40 0x7f84500c6a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:32.096 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.091+0000 7f8458078700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f845006b9b0 0x7f84500c6f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:32.096 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.091+0000 7f8458078700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84500ac530 con 0x7f84500bf310 2023-10-06T03:01:32.096 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.091+0000 7f8458078700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f845006dc60 con 0x7f84500bef40 2023-10-06T03:01:32.096 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.091+0000 7f8458078700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f845006bed0 con 0x7f845006b9b0 2023-10-06T03:01:32.097 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.091+0000 7f8455e14700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f84500bef40 0x7f84500c6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:32.097 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.091+0000 7f8455613700 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f84500bf310 0x7f845006b2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.57:60472/0 (socket says 172.21.15.57:60472) 2023-10-06T03:01:32.097 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.091+0000 7f8455613700 1 -- 172.21.15.57:0/2592221770 learned_addr learned my addr 172.21.15.57:0/2592221770 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:01:32.097 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.091+0000 7f8456615700 1 --2- 172.21.15.57:0/2592221770 >> v2:172.21.15.105:3300/0 conn(0x7f845006b9b0 0x7f84500c6f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:32.097 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.091+0000 7f8455e14700 1 -- 172.21.15.57:0/2592221770 >> v2:172.21.15.105:3300/0 conn(0x7f845006b9b0 msgr2=0x7f84500c6f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:32.098 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.091+0000 7f8455e14700 1 --2- 172.21.15.57:0/2592221770 >> v2:172.21.15.105:3300/0 conn(0x7f845006b9b0 0x7f84500c6f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:32.098 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.091+0000 7f8455e14700 1 -- 172.21.15.57:0/2592221770 >> v1:172.21.15.105:6789/0 conn(0x7f84500bf310 legacy=0x7f845006b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:32.098 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.091+0000 7f8455e14700 1 -- 172.21.15.57:0/2592221770 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f845006c1b0 con 0x7f84500bef40 2023-10-06T03:01:32.098 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.091+0000 7f8454e12700 1 -- 172.21.15.57:0/2592221770 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2375216005 0 0) 0x7f84500ac530 con 0x7f84500bf310 2023-10-06T03:01:32.098 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.091+0000 7f8455e14700 1 --2- 172.21.15.57:0/2592221770 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84500bef40 0x7f84500c6a50 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f84500cba30 tx=0x7f844c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd7d5443885c4948 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:32.099 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.095+0000 7f8454e12700 1 -- 172.21.15.57:0/2592221770 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f844c00b690 con 0x7f84500bef40 2023-10-06T03:01:32.099 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.095+0000 7f8454e12700 1 -- 172.21.15.57:0/2592221770 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f844c00b7f0 con 0x7f84500bef40 2023-10-06T03:01:32.099 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.095+0000 7f8454e12700 1 -- 172.21.15.57:0/2592221770 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f844c00bb90 con 0x7f84500bef40 2023-10-06T03:01:32.100 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.095+0000 7f8458078700 1 -- 172.21.15.57:0/2592221770 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84500bef40 msgr2=0x7f84500c6a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:32.100 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.095+0000 7f8458078700 1 --2- 172.21.15.57:0/2592221770 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84500bef40 0x7f84500c6a50 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f84500cba30 tx=0x7f844c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:01:32.100 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.095+0000 7f8458078700 1 -- 172.21.15.57:0/2592221770 shutdown_connections 2023-10-06T03:01:32.100 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.095+0000 7f8458078700 1 --2- 172.21.15.57:0/2592221770 >> v2:172.21.15.105:3300/0 conn(0x7f845006b9b0 0x7f84500c6f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:32.101 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.095+0000 7f8458078700 1 --2- 172.21.15.57:0/2592221770 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84500bef40 0x7f84500c6a50 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:32.101 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.095+0000 7f8458078700 1 -- 172.21.15.57:0/2592221770 >> 172.21.15.57:0/2592221770 conn(0x7f84500c87b0 msgr2=0x7f84500c8bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:32.101 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.095+0000 7f8458078700 1 -- 172.21.15.57:0/2592221770 shutdown_connections 2023-10-06T03:01:32.101 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.095+0000 7f8458078700 1 -- 172.21.15.57:0/2592221770 wait complete. 2023-10-06T03:01:32.104 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.099+0000 7f8458078700 1 Processor -- start 2023-10-06T03:01:32.104 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.099+0000 7f8458078700 1 -- start start 2023-10-06T03:01:32.105 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.099+0000 7f8458078700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f845006b9b0 0x7f84500aff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:32.105 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.099+0000 7f8458078700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84500bef40 0x7f8450163c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:32.105 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.099+0000 7f8458078700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f84500bf310 0x7f845016d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:32.105 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.099+0000 7f8458078700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84500b04c0 con 0x7f84500bef40 2023-10-06T03:01:32.105 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.099+0000 7f8458078700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84500c1ee0 con 0x7f845006b9b0 2023-10-06T03:01:32.106 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.099+0000 7f8458078700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84500c12d0 con 0x7f84500bf310 2023-10-06T03:01:32.107 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.099+0000 7f8455613700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84500bef40 0x7f8450163c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:32.107 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.099+0000 7f8455613700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84500bef40 0x7f8450163c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33310/0 (socket says 172.21.15.57:33310) 2023-10-06T03:01:32.107 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.099+0000 7f8455613700 1 -- 172.21.15.57:0/3028318678 learned_addr learned my addr 172.21.15.57:0/3028318678 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:32.107 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.099+0000 7f8456615700 1 --2- 172.21.15.57:0/3028318678 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f84500bf310 0x7f845016d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:32.107 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.099+0000 7f8455e14700 1 --2- 172.21.15.57:0/3028318678 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f845006b9b0 0x7f84500aff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:32.107 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.103+0000 7f8455613700 1 -- 172.21.15.57:0/3028318678 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f84500bf310 msgr2=0x7f845016d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:32.107 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.103+0000 7f8455613700 1 --2- 172.21.15.57:0/3028318678 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f84500bf310 0x7f845016d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:32.107 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.103+0000 7f8455613700 1 -- 172.21.15.57:0/3028318678 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f845006b9b0 msgr2=0x7f84500aff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:32.107 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.103+0000 7f8455613700 1 --2- 172.21.15.57:0/3028318678 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f845006b9b0 0x7f84500aff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:32.107 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.103+0000 7f8455613700 1 -- 172.21.15.57:0/3028318678 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f844c009420 con 0x7f84500bef40 2023-10-06T03:01:32.108 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.103+0000 7f8455613700 1 --2- 172.21.15.57:0/3028318678 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84500bef40 0x7f8450163c60 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f844000c5e0 tx=0x7f8440000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:32.108 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.103+0000 7f8445ffb700 1 -- 172.21.15.57:0/3028318678 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8440005b30 con 0x7f84500bef40 2023-10-06T03:01:32.108 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.103+0000 7f8445ffb700 1 -- 172.21.15.57:0/3028318678 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8440005c90 con 0x7f84500bef40 2023-10-06T03:01:32.108 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.103+0000 7f8445ffb700 1 -- 172.21.15.57:0/3028318678 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8440007300 con 0x7f84500bef40 2023-10-06T03:01:32.108 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.103+0000 7f8458078700 1 -- 172.21.15.57:0/3028318678 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84500c15b0 con 0x7f84500bef40 2023-10-06T03:01:32.109 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.103+0000 7f8458078700 1 -- 172.21.15.57:0/3028318678 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84500c1b70 con 0x7f84500bef40 2023-10-06T03:01:32.110 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.103+0000 7f8458078700 1 -- 172.21.15.57:0/3028318678 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84500712e0 con 0x7f84500bef40 2023-10-06T03:01:32.112 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.107+0000 7f8445ffb700 1 -- 172.21.15.57:0/3028318678 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f844001b3b0 con 0x7f84500bef40 2023-10-06T03:01:32.114 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.107+0000 7f8445ffb700 1 --2- 172.21.15.57:0/3028318678 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f8434060550 0x7f8434062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:32.114 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.107+0000 7f8445ffb700 1 -- 172.21.15.57:0/3028318678 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f844007bdf0 con 0x7f84500bef40 2023-10-06T03:01:32.114 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.111+0000 7f8455e14700 1 --2- 172.21.15.57:0/3028318678 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f8434060550 0x7f8434062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:32.116 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.111+0000 7f8455e14700 1 --2- 172.21.15.57:0/3028318678 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f8434060550 0x7f8434062a00 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f844c0093f0 tx=0x7f844c017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:32.120 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.115+0000 7f8445ffb700 1 -- 172.21.15.57:0/3028318678 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f844004c1e0 con 0x7f84500bef40 2023-10-06T03:01:32.289 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.283+0000 7f8458078700 1 -- 172.21.15.57:0/3028318678 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f84500c2020 con 0x7f84500bef40 2023-10-06T03:01:32.290 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.283+0000 7f8445ffb700 1 -- 172.21.15.57:0/3028318678 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f844004f800 con 0x7f84500bef40 2023-10-06T03:01:32.290 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2023-10-06T03:01:32.293 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.287+0000 7f8458078700 1 -- 172.21.15.57:0/3028318678 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f8434060550 msgr2=0x7f8434062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:32.293 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.287+0000 7f8458078700 1 --2- 172.21.15.57:0/3028318678 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f8434060550 0x7f8434062a00 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f844c0093f0 tx=0x7f844c017000 comp rx=0 tx=0).stop 2023-10-06T03:01:32.293 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.287+0000 7f8458078700 1 -- 172.21.15.57:0/3028318678 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84500bef40 msgr2=0x7f8450163c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:32.293 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.287+0000 7f8458078700 1 --2- 172.21.15.57:0/3028318678 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84500bef40 0x7f8450163c60 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f844000c5e0 tx=0x7f8440000fe0 comp rx=0 tx=0).stop 2023-10-06T03:01:32.293 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.287+0000 7f8458078700 1 -- 172.21.15.57:0/3028318678 shutdown_connections 2023-10-06T03:01:32.293 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.287+0000 7f8458078700 1 --2- 172.21.15.57:0/3028318678 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f8434060550 0x7f8434062a00 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:32.294 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.287+0000 7f8458078700 1 --2- 172.21.15.57:0/3028318678 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f84500bf310 0x7f845016d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:32.294 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.287+0000 7f8458078700 1 --2- 172.21.15.57:0/3028318678 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84500bef40 0x7f8450163c60 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:32.294 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.287+0000 7f8458078700 1 --2- 172.21.15.57:0/3028318678 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f845006b9b0 0x7f84500aff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:32.294 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.287+0000 7f8458078700 1 -- 172.21.15.57:0/3028318678 >> 172.21.15.57:0/3028318678 conn(0x7f84500c87b0 msgr2=0x7f845015c270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:32.294 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.287+0000 7f8458078700 1 -- 172.21.15.57:0/3028318678 shutdown_connections 2023-10-06T03:01:32.294 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.287+0000 7f8458078700 1 -- 172.21.15.57:0/3028318678 wait complete. 2023-10-06T03:01:32.312 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T03:01:32.473 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.467+0000 7f5a3e0ae700 1 Processor -- start 2023-10-06T03:01:32.473 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.467+0000 7f5a3e0ae700 1 -- start start 2023-10-06T03:01:32.475 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.471+0000 7f5a3e0ae700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5a3806b9b0 0x7f5a38168440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:32.476 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.471+0000 7f5a3e0ae700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a380ac530 con 0x7f5a380bef40 2023-10-06T03:01:32.476 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.471+0000 7f5a3e0ae700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a3806bed0 con 0x7f5a380c7160 2023-10-06T03:01:32.476 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.471+0000 7f5a3e0ae700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a3806dc60 con 0x7f5a3806b9b0 2023-10-06T03:01:32.476 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.471+0000 7f5a377fe700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f5a380bef40 0x7f5a380c6a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:55586/0 (socket says 172.21.15.57:55586) 2023-10-06T03:01:32.476 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.471+0000 7f5a377fe700 1 -- 172.21.15.57:0/2517555031 learned_addr learned my addr 172.21.15.57:0/2517555031 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:01:32.476 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.471+0000 7f5a37fff700 1 --2- 172.21.15.57:0/2517555031 >> v2:172.21.15.57:3300/0 conn(0x7f5a3806b9b0 0x7f5a38168440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:32.477 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.471+0000 7f5a36ffd700 1 -- 172.21.15.57:0/2517555031 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3650883039 0 0) 0x7f5a380ac530 con 0x7f5a380bef40 2023-10-06T03:01:32.477 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.471+0000 7f5a36ffd700 1 -- 172.21.15.57:0/2517555031 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a24003570 con 0x7f5a380bef40 2023-10-06T03:01:32.478 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.471+0000 7f5a36ffd700 1 -- 172.21.15.57:0/2517555031 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3986890828 0 0) 0x7f5a3806bed0 con 0x7f5a380c7160 2023-10-06T03:01:32.478 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.471+0000 7f5a36ffd700 1 -- 172.21.15.57:0/2517555031 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a380ac530 con 0x7f5a380c7160 2023-10-06T03:01:32.478 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.471+0000 7f5a36ffd700 1 -- 172.21.15.57:0/2517555031 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4269070336 0 0) 0x7f5a24003570 con 0x7f5a380bef40 2023-10-06T03:01:32.478 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.471+0000 7f5a37fff700 1 -- 172.21.15.57:0/2517555031 >> v1:172.21.15.105:6789/0 conn(0x7f5a380c7160 legacy=0x7f5a3806b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:32.478 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.471+0000 7f5a37fff700 1 -- 172.21.15.57:0/2517555031 >> v1:172.21.15.57:6789/0 conn(0x7f5a380bef40 legacy=0x7f5a380c6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:32.478 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.471+0000 7f5a37fff700 1 -- 172.21.15.57:0/2517555031 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a3806c1b0 con 0x7f5a3806b9b0 2023-10-06T03:01:32.479 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.471+0000 7f5a37fff700 1 --2- 172.21.15.57:0/2517555031 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5a3806b9b0 0x7f5a38168440 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f5a30009e60 tx=0x7f5a30009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=404cb8165861c0e9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:32.479 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.471+0000 7f5a36ffd700 1 -- 172.21.15.57:0/2517555031 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a3000e070 con 0x7f5a3806b9b0 2023-10-06T03:01:32.479 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.475+0000 7f5a36ffd700 1 -- 172.21.15.57:0/2517555031 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a3000b830 con 0x7f5a3806b9b0 2023-10-06T03:01:32.479 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.475+0000 7f5a36ffd700 1 -- 172.21.15.57:0/2517555031 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a28001470 con 0x7f5a3806b9b0 2023-10-06T03:01:32.480 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.475+0000 7f5a3e0ae700 1 -- 172.21.15.57:0/2517555031 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5a3806b9b0 msgr2=0x7f5a38168440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:32.480 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.475+0000 7f5a3e0ae700 1 --2- 172.21.15.57:0/2517555031 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5a3806b9b0 0x7f5a38168440 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f5a30009e60 tx=0x7f5a30009780 comp rx=0 tx=0).stop 2023-10-06T03:01:32.480 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.475+0000 7f5a3e0ae700 1 -- 172.21.15.57:0/2517555031 shutdown_connections 2023-10-06T03:01:32.480 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.475+0000 7f5a3e0ae700 1 --2- 172.21.15.57:0/2517555031 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5a3806b9b0 0x7f5a38168440 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:32.480 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.475+0000 7f5a3e0ae700 1 -- 172.21.15.57:0/2517555031 >> 172.21.15.57:0/2517555031 conn(0x7f5a380c87b0 msgr2=0x7f5a380c8bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:32.480 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.475+0000 7f5a3e0ae700 1 -- 172.21.15.57:0/2517555031 shutdown_connections 2023-10-06T03:01:32.480 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.475+0000 7f5a3e0ae700 1 -- 172.21.15.57:0/2517555031 wait complete. 2023-10-06T03:01:32.482 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.475+0000 7f5a3e0ae700 1 Processor -- start 2023-10-06T03:01:32.482 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.475+0000 7f5a3e0ae700 1 -- start start 2023-10-06T03:01:32.483 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.479+0000 7f5a3e0ae700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5a3806b9b0 0x7f5a38147af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:32.483 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.479+0000 7f5a3e0ae700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5a380bef40 0x7f5a38148170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:32.484 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.479+0000 7f5a3e0ae700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5a380c7160 0x7f5a380bf310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:32.484 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.479+0000 7f5a3e0ae700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a3815f7d0 con 0x7f5a380bef40 2023-10-06T03:01:32.484 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.479+0000 7f5a3e0ae700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a381486b0 con 0x7f5a380c7160 2023-10-06T03:01:32.484 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.479+0000 7f5a3e0ae700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a3815eee0 con 0x7f5a3806b9b0 2023-10-06T03:01:32.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.479+0000 7f5a2ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5a380bef40 0x7f5a38148170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:32.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.479+0000 7f5a377fe700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5a3806b9b0 0x7f5a38147af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:32.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.479+0000 7f5a2ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5a380bef40 0x7f5a38148170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33324/0 (socket says 172.21.15.57:33324) 2023-10-06T03:01:32.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.479+0000 7f5a2ffff700 1 -- 172.21.15.57:0/3655821660 learned_addr learned my addr 172.21.15.57:0/3655821660 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:32.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.479+0000 7f5a37fff700 1 --2- 172.21.15.57:0/3655821660 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5a380c7160 0x7f5a380bf310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:32.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.479+0000 7f5a2ffff700 1 -- 172.21.15.57:0/3655821660 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5a3806b9b0 msgr2=0x7f5a38147af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:32.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.479+0000 7f5a2ffff700 1 --2- 172.21.15.57:0/3655821660 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5a3806b9b0 0x7f5a38147af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:32.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.479+0000 7f5a2ffff700 1 -- 172.21.15.57:0/3655821660 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5a380c7160 msgr2=0x7f5a380bf310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:32.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.479+0000 7f5a2ffff700 1 --2- 172.21.15.57:0/3655821660 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5a380c7160 0x7f5a380bf310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:32.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.479+0000 7f5a2ffff700 1 -- 172.21.15.57:0/3655821660 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a30009a20 con 0x7f5a380bef40 2023-10-06T03:01:32.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.479+0000 7f5a2ffff700 1 --2- 172.21.15.57:0/3655821660 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5a380bef40 0x7f5a38148170 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f5a2000c590 tx=0x7f5a20007de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:32.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.479+0000 7f5a2f7fe700 1 -- 172.21.15.57:0/3655821660 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a20010510 con 0x7f5a380bef40 2023-10-06T03:01:32.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.479+0000 7f5a2f7fe700 1 -- 172.21.15.57:0/3655821660 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a20010690 con 0x7f5a380bef40 2023-10-06T03:01:32.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.479+0000 7f5a2f7fe700 1 -- 172.21.15.57:0/3655821660 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a20010a50 con 0x7f5a380bef40 2023-10-06T03:01:32.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.479+0000 7f5a3e0ae700 1 -- 172.21.15.57:0/3655821660 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a380c29f0 con 0x7f5a380bef40 2023-10-06T03:01:32.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.479+0000 7f5a3e0ae700 1 -- 172.21.15.57:0/3655821660 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a3815f460 con 0x7f5a380bef40 2023-10-06T03:01:32.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.483+0000 7f5a3e0ae700 1 -- 172.21.15.57:0/3655821660 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a380712e0 con 0x7f5a380bef40 2023-10-06T03:01:32.489 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.483+0000 7f5a2f7fe700 1 -- 172.21.15.57:0/3655821660 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f5a2001b3b0 con 0x7f5a380bef40 2023-10-06T03:01:32.491 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.487+0000 7f5a2f7fe700 1 --2- 172.21.15.57:0/3655821660 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f5a18060550 0x7f5a18062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:32.491 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.487+0000 7f5a2f7fe700 1 -- 172.21.15.57:0/3655821660 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5a2007bff0 con 0x7f5a380bef40 2023-10-06T03:01:32.491 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.487+0000 7f5a377fe700 1 --2- 172.21.15.57:0/3655821660 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f5a18060550 0x7f5a18062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:32.492 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.487+0000 7f5a377fe700 1 --2- 172.21.15.57:0/3655821660 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f5a18060550 0x7f5a18062a00 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5a280015a0 tx=0x7f5a28000bc0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:32.496 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.491+0000 7f5a2f7fe700 1 -- 172.21.15.57:0/3655821660 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f5a2004c420 con 0x7f5a380bef40 2023-10-06T03:01:32.665 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.659+0000 7f5a3e0ae700 1 -- 172.21.15.57:0/3655821660 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5a380ac1c0 con 0x7f5a380bef40 2023-10-06T03:01:32.666 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.659+0000 7f5a2f7fe700 1 -- 172.21.15.57:0/3655821660 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5a20017020 con 0x7f5a380bef40 2023-10-06T03:01:32.666 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2023-10-06T03:01:32.671 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.663+0000 7f5a3e0ae700 1 -- 172.21.15.57:0/3655821660 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f5a18060550 msgr2=0x7f5a18062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:32.671 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.667+0000 7f5a3e0ae700 1 --2- 172.21.15.57:0/3655821660 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f5a18060550 0x7f5a18062a00 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5a280015a0 tx=0x7f5a28000bc0 comp rx=0 tx=0).stop 2023-10-06T03:01:32.671 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.667+0000 7f5a3e0ae700 1 -- 172.21.15.57:0/3655821660 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5a380bef40 msgr2=0x7f5a38148170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:32.671 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.667+0000 7f5a3e0ae700 1 --2- 172.21.15.57:0/3655821660 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5a380bef40 0x7f5a38148170 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f5a2000c590 tx=0x7f5a20007de0 comp rx=0 tx=0).stop 2023-10-06T03:01:32.671 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.667+0000 7f5a3e0ae700 1 -- 172.21.15.57:0/3655821660 shutdown_connections 2023-10-06T03:01:32.671 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.667+0000 7f5a3e0ae700 1 --2- 172.21.15.57:0/3655821660 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5a380c7160 0x7f5a380bf310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:32.672 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.667+0000 7f5a3e0ae700 1 --2- 172.21.15.57:0/3655821660 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5a380bef40 0x7f5a38148170 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:32.672 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.667+0000 7f5a3e0ae700 1 --2- 172.21.15.57:0/3655821660 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f5a18060550 0x7f5a18062a00 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:32.672 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.667+0000 7f5a3e0ae700 1 --2- 172.21.15.57:0/3655821660 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5a3806b9b0 0x7f5a38147af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:32.672 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.667+0000 7f5a3e0ae700 1 -- 172.21.15.57:0/3655821660 >> 172.21.15.57:0/3655821660 conn(0x7f5a380c87b0 msgr2=0x7f5a380b0b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:32.672 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.667+0000 7f5a3e0ae700 1 -- 172.21.15.57:0/3655821660 shutdown_connections 2023-10-06T03:01:32.672 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.667+0000 7f5a3e0ae700 1 -- 172.21.15.57:0/3655821660 wait complete. 2023-10-06T03:01:32.691 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T03:01:32.860 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.855+0000 7f3b5a385700 1 Processor -- start 2023-10-06T03:01:32.860 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.855+0000 7f3b5a385700 1 -- start start 2023-10-06T03:01:32.863 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.859+0000 7f3b5a385700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f3b540c7c10 0x7f3b5406b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:32.863 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.859+0000 7f3b5a385700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f3b54155950 0x7f3b5406b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:32.863 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.859+0000 7f3b5a385700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b540ad150 con 0x7f3b54155580 2023-10-06T03:01:32.863 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.859+0000 7f3b5a385700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b5406bf00 con 0x7f3b54155950 2023-10-06T03:01:32.864 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.859+0000 7f3b5a385700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b5406c1b0 con 0x7f3b540c7c10 2023-10-06T03:01:32.865 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.859+0000 7f3b58922700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f3b54155950 0x7f3b5406b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:32.865 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.859+0000 7f3b53fff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f3b54155580 0x7f3b540c7500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:55594/0 (socket says 172.21.15.57:55594) 2023-10-06T03:01:32.865 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.859+0000 7f3b53fff700 1 -- 172.21.15.57:0/522050606 learned_addr learned my addr 172.21.15.57:0/522050606 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:01:32.865 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.859+0000 7f3b537fe700 1 --2- 172.21.15.57:0/522050606 >> v2:172.21.15.105:3300/0 conn(0x7f3b540c7c10 0x7f3b5406b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:32.865 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.859+0000 7f3b52ffd700 1 -- 172.21.15.57:0/522050606 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1711628211 0 0) 0x7f3b540ad150 con 0x7f3b54155580 2023-10-06T03:01:32.865 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.859+0000 7f3b52ffd700 1 -- 172.21.15.57:0/522050606 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b3c003570 con 0x7f3b54155580 2023-10-06T03:01:32.865 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.859+0000 7f3b58922700 1 -- 172.21.15.57:0/522050606 >> v2:172.21.15.105:3300/0 conn(0x7f3b540c7c10 msgr2=0x7f3b5406b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:32.865 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.859+0000 7f3b58922700 1 --2- 172.21.15.57:0/522050606 >> v2:172.21.15.105:3300/0 conn(0x7f3b540c7c10 0x7f3b5406b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:32.865 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.859+0000 7f3b58922700 1 -- 172.21.15.57:0/522050606 >> v1:172.21.15.57:6789/0 conn(0x7f3b54155580 legacy=0x7f3b540c7500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:32.866 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.859+0000 7f3b58922700 1 -- 172.21.15.57:0/522050606 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b540ac820 con 0x7f3b54155950 2023-10-06T03:01:32.866 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.859+0000 7f3b58922700 1 --2- 172.21.15.57:0/522050606 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3b54155950 0x7f3b5406b9c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f3b5406a7e0 tx=0x7f3b4c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27432f133a830010 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:32.867 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.859+0000 7f3b52ffd700 1 -- 172.21.15.57:0/522050606 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b4c00e070 con 0x7f3b54155950 2023-10-06T03:01:32.867 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.859+0000 7f3b52ffd700 1 -- 172.21.15.57:0/522050606 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b4c00bab0 con 0x7f3b54155950 2023-10-06T03:01:32.867 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.859+0000 7f3b52ffd700 1 -- 172.21.15.57:0/522050606 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b4c00be70 con 0x7f3b54155950 2023-10-06T03:01:32.867 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.863+0000 7f3b5a385700 1 -- 172.21.15.57:0/522050606 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3b54155950 msgr2=0x7f3b5406b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:32.867 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.863+0000 7f3b5a385700 1 --2- 172.21.15.57:0/522050606 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3b54155950 0x7f3b5406b9c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f3b5406a7e0 tx=0x7f3b4c009780 comp rx=0 tx=0).stop 2023-10-06T03:01:32.868 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.863+0000 7f3b5a385700 1 -- 172.21.15.57:0/522050606 shutdown_connections 2023-10-06T03:01:32.868 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.863+0000 7f3b5a385700 1 --2- 172.21.15.57:0/522050606 >> v2:172.21.15.105:3300/0 conn(0x7f3b540c7c10 0x7f3b5406b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:32.868 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.863+0000 7f3b5a385700 1 --2- 172.21.15.57:0/522050606 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3b54155950 0x7f3b5406b9c0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:32.868 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.863+0000 7f3b5a385700 1 -- 172.21.15.57:0/522050606 >> 172.21.15.57:0/522050606 conn(0x7f3b540c87b0 msgr2=0x7f3b540c8bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:32.868 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.863+0000 7f3b5a385700 1 -- 172.21.15.57:0/522050606 shutdown_connections 2023-10-06T03:01:32.868 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.863+0000 7f3b5a385700 1 -- 172.21.15.57:0/522050606 wait complete. 2023-10-06T03:01:32.869 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.863+0000 7f3b5a385700 1 Processor -- start 2023-10-06T03:01:32.869 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.863+0000 7f3b5a385700 1 -- start start 2023-10-06T03:01:32.871 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.867+0000 7f3b5a385700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3b540c7c10 0x7f3b54148160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:32.871 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.867+0000 7f3b5a385700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3b54155580 0x7f3b540b0d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:32.871 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.867+0000 7f3b5a385700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3b54155950 0x7f3b5415e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:32.871 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.867+0000 7f3b5a385700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b540b1a80 con 0x7f3b540c7c10 2023-10-06T03:01:32.871 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.867+0000 7f3b5a385700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b541486a0 con 0x7f3b54155580 2023-10-06T03:01:32.871 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.867+0000 7f3b5a385700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b540b17a0 con 0x7f3b54155950 2023-10-06T03:01:32.872 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.867+0000 7f3b53fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3b540c7c10 0x7f3b54148160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:32.872 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.867+0000 7f3b53fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3b540c7c10 0x7f3b54148160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33344/0 (socket says 172.21.15.57:33344) 2023-10-06T03:01:32.873 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.867+0000 7f3b53fff700 1 -- 172.21.15.57:0/2324510056 learned_addr learned my addr 172.21.15.57:0/2324510056 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:32.873 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.867+0000 7f3b537fe700 1 --2- 172.21.15.57:0/2324510056 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3b54155580 0x7f3b540b0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:32.873 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.867+0000 7f3b58922700 1 --2- 172.21.15.57:0/2324510056 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3b54155950 0x7f3b5415e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:32.873 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.867+0000 7f3b53fff700 1 -- 172.21.15.57:0/2324510056 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3b54155950 msgr2=0x7f3b5415e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:32.873 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.867+0000 7f3b53fff700 1 --2- 172.21.15.57:0/2324510056 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3b54155950 0x7f3b5415e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:32.873 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.867+0000 7f3b53fff700 1 -- 172.21.15.57:0/2324510056 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3b54155580 msgr2=0x7f3b540b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:32.873 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.867+0000 7f3b53fff700 1 --2- 172.21.15.57:0/2324510056 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3b54155580 0x7f3b540b0d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:32.873 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.867+0000 7f3b53fff700 1 -- 172.21.15.57:0/2324510056 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b4c009a20 con 0x7f3b540c7c10 2023-10-06T03:01:32.873 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.867+0000 7f3b537fe700 1 --2- 172.21.15.57:0/2324510056 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3b54155580 0x7f3b540b0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:01:32.874 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.867+0000 7f3b53fff700 1 --2- 172.21.15.57:0/2324510056 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3b540c7c10 0x7f3b54148160 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f3b4400c7f0 tx=0x7f3b44007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:32.874 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.867+0000 7f3b3bfff700 1 -- 172.21.15.57:0/2324510056 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b44005cd0 con 0x7f3b540c7c10 2023-10-06T03:01:32.874 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.867+0000 7f3b3bfff700 1 -- 172.21.15.57:0/2324510056 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b44005e50 con 0x7f3b540c7c10 2023-10-06T03:01:32.874 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.867+0000 7f3b3bfff700 1 -- 172.21.15.57:0/2324510056 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b44007320 con 0x7f3b540c7c10 2023-10-06T03:01:32.874 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.867+0000 7f3b5a385700 1 -- 172.21.15.57:0/2324510056 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b540c0ac0 con 0x7f3b540c7c10 2023-10-06T03:01:32.874 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.867+0000 7f3b5a385700 1 -- 172.21.15.57:0/2324510056 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b540c1080 con 0x7f3b540c7c10 2023-10-06T03:01:32.875 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.871+0000 7f3b5a385700 1 -- 172.21.15.57:0/2324510056 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b540712e0 con 0x7f3b540c7c10 2023-10-06T03:01:32.876 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.871+0000 7f3b3bfff700 1 -- 172.21.15.57:0/2324510056 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f3b4401b3b0 con 0x7f3b540c7c10 2023-10-06T03:01:32.877 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.871+0000 7f3b3bfff700 1 --2- 172.21.15.57:0/2324510056 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f3b40060550 0x7f3b40062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:32.878 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.871+0000 7f3b3bfff700 1 -- 172.21.15.57:0/2324510056 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3b4407bff0 con 0x7f3b540c7c10 2023-10-06T03:01:32.878 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.871+0000 7f3b537fe700 1 --2- 172.21.15.57:0/2324510056 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f3b40060550 0x7f3b40062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:32.879 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.875+0000 7f3b537fe700 1 --2- 172.21.15.57:0/2324510056 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f3b40060550 0x7f3b40062a00 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3b5416c360 tx=0x7f3b480091a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:32.883 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:32.879+0000 7f3b3bfff700 1 -- 172.21.15.57:0/2324510056 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f3b4404c400 con 0x7f3b540c7c10 2023-10-06T03:01:33.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.051+0000 7f3b5a385700 1 -- 172.21.15.57:0/2324510056 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3b540acb00 con 0x7f3b540c7c10 2023-10-06T03:01:33.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.055+0000 7f3b3bfff700 1 -- 172.21.15.57:0/2324510056 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3b44017020 con 0x7f3b540c7c10 2023-10-06T03:01:33.059 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 64 2023-10-06T03:01:33.062 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.055+0000 7f3b5a385700 1 -- 172.21.15.57:0/2324510056 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f3b40060550 msgr2=0x7f3b40062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:33.062 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.055+0000 7f3b5a385700 1 --2- 172.21.15.57:0/2324510056 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f3b40060550 0x7f3b40062a00 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3b5416c360 tx=0x7f3b480091a0 comp rx=0 tx=0).stop 2023-10-06T03:01:33.062 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.055+0000 7f3b5a385700 1 -- 172.21.15.57:0/2324510056 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3b540c7c10 msgr2=0x7f3b54148160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:33.062 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.055+0000 7f3b5a385700 1 --2- 172.21.15.57:0/2324510056 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3b540c7c10 0x7f3b54148160 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f3b4400c7f0 tx=0x7f3b44007e00 comp rx=0 tx=0).stop 2023-10-06T03:01:33.062 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.055+0000 7f3b5a385700 1 -- 172.21.15.57:0/2324510056 shutdown_connections 2023-10-06T03:01:33.062 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.055+0000 7f3b5a385700 1 --2- 172.21.15.57:0/2324510056 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f3b40060550 0x7f3b40062a00 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:33.062 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.055+0000 7f3b5a385700 1 --2- 172.21.15.57:0/2324510056 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3b54155950 0x7f3b5415e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:33.062 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.055+0000 7f3b5a385700 1 --2- 172.21.15.57:0/2324510056 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3b54155580 0x7f3b540b0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:33.062 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.055+0000 7f3b5a385700 1 --2- 172.21.15.57:0/2324510056 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3b540c7c10 0x7f3b54148160 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:33.062 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.055+0000 7f3b5a385700 1 -- 172.21.15.57:0/2324510056 >> 172.21.15.57:0/2324510056 conn(0x7f3b540c87b0 msgr2=0x7f3b540ca4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:33.063 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.055+0000 7f3b5a385700 1 -- 172.21.15.57:0/2324510056 shutdown_connections 2023-10-06T03:01:33.063 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.055+0000 7f3b5a385700 1 -- 172.21.15.57:0/2324510056 wait complete. 2023-10-06T03:01:33.081 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:01:33.248 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.243+0000 7f1840dcc700 1 Processor -- start 2023-10-06T03:01:33.249 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.243+0000 7f1840dcc700 1 -- start start 2023-10-06T03:01:33.252 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.247+0000 7f1840dcc700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f183c0aae90 0x7f183c0aa7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:33.252 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.247+0000 7f1840dcc700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f183c06bba0 0x7f183c0ab970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:33.252 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.247+0000 7f1840dcc700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f183c06de50 con 0x7f183c06c920 2023-10-06T03:01:33.252 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.247+0000 7f1840dcc700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f183c06e130 con 0x7f183c06bba0 2023-10-06T03:01:33.252 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.247+0000 7f1840dcc700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f183c06b3a0 con 0x7f183c0aae90 2023-10-06T03:01:33.253 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.247+0000 7f183b7fe700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f183c06c920 0x7f183c06ccf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:55598/0 (socket says 172.21.15.57:55598) 2023-10-06T03:01:33.253 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.247+0000 7f183b7fe700 1 -- 172.21.15.57:0/69820409 learned_addr learned my addr 172.21.15.57:0/69820409 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:01:33.253 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.247+0000 7f1832ffd700 1 --2- 172.21.15.57:0/69820409 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f183c0aae90 0x7f183c0aa7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:33.253 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.247+0000 7f183bfff700 1 --2- 172.21.15.57:0/69820409 >> v2:172.21.15.105:3300/0 conn(0x7f183c06bba0 0x7f183c0ab970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:33.253 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.247+0000 7f183affd700 1 -- 172.21.15.57:0/69820409 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2331862859 0 0) 0x7f183c06de50 con 0x7f183c06c920 2023-10-06T03:01:33.253 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.247+0000 7f183affd700 1 -- 172.21.15.57:0/69820409 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1828003570 con 0x7f183c06c920 2023-10-06T03:01:33.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.247+0000 7f1832ffd700 1 -- 172.21.15.57:0/69820409 >> v2:172.21.15.105:3300/0 conn(0x7f183c06bba0 msgr2=0x7f183c0ab970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:33.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.247+0000 7f1832ffd700 1 --2- 172.21.15.57:0/69820409 >> v2:172.21.15.105:3300/0 conn(0x7f183c06bba0 0x7f183c0ab970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:33.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.247+0000 7f1832ffd700 1 -- 172.21.15.57:0/69820409 >> v1:172.21.15.57:6789/0 conn(0x7f183c06c920 legacy=0x7f183c06ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:33.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.247+0000 7f1832ffd700 1 -- 172.21.15.57:0/69820409 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f183c06b680 con 0x7f183c0aae90 2023-10-06T03:01:33.255 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.247+0000 7f1832ffd700 1 --2- 172.21.15.57:0/69820409 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f183c0aae90 0x7f183c0aa7e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f18240098e0 tx=0x7f18240091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8cae6cce6c1b7b0a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:33.255 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.251+0000 7f183affd700 1 -- 172.21.15.57:0/69820409 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1824011630 con 0x7f183c0aae90 2023-10-06T03:01:33.255 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.251+0000 7f183affd700 1 -- 172.21.15.57:0/69820409 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1824011790 con 0x7f183c0aae90 2023-10-06T03:01:33.255 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.251+0000 7f183affd700 1 -- 172.21.15.57:0/69820409 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1824011b30 con 0x7f183c0aae90 2023-10-06T03:01:33.256 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.251+0000 7f1840dcc700 1 -- 172.21.15.57:0/69820409 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f183c0aae90 msgr2=0x7f183c0aa7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:33.256 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.251+0000 7f1840dcc700 1 --2- 172.21.15.57:0/69820409 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f183c0aae90 0x7f183c0aa7e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f18240098e0 tx=0x7f18240091a0 comp rx=0 tx=0).stop 2023-10-06T03:01:33.256 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.251+0000 7f1840dcc700 1 -- 172.21.15.57:0/69820409 shutdown_connections 2023-10-06T03:01:33.256 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.251+0000 7f1840dcc700 1 --2- 172.21.15.57:0/69820409 >> v2:172.21.15.105:3300/0 conn(0x7f183c06bba0 0x7f183c0ab970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:33.256 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.251+0000 7f1840dcc700 1 --2- 172.21.15.57:0/69820409 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f183c0aae90 0x7f183c0aa7e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:33.256 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.251+0000 7f1840dcc700 1 -- 172.21.15.57:0/69820409 >> 172.21.15.57:0/69820409 conn(0x7f183c0c85e0 msgr2=0x7f183c0c89e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:33.256 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.251+0000 7f1840dcc700 1 -- 172.21.15.57:0/69820409 shutdown_connections 2023-10-06T03:01:33.256 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.251+0000 7f1840dcc700 1 -- 172.21.15.57:0/69820409 wait complete. 2023-10-06T03:01:33.258 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.255+0000 7f1840dcc700 1 Processor -- start 2023-10-06T03:01:33.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.255+0000 7f1840dcc700 1 -- start start 2023-10-06T03:01:33.261 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.255+0000 7f1840dcc700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f183c06bba0 0x7f183c160360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:33.261 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.255+0000 7f1840dcc700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f183c06c920 0x7f183c16d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:33.261 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.255+0000 7f1840dcc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f183c0aae90 0x7f183c1616b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:33.261 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.255+0000 7f1840dcc700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f183c0bf5d0 con 0x7f183c0aae90 2023-10-06T03:01:33.261 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.255+0000 7f1840dcc700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f183c1608a0 con 0x7f183c06c920 2023-10-06T03:01:33.261 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.255+0000 7f1840dcc700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f183c0bf7b0 con 0x7f183c06bba0 2023-10-06T03:01:33.261 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.255+0000 7f183bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f183c0aae90 0x7f183c1616b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:33.261 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.255+0000 7f183bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f183c0aae90 0x7f183c1616b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33356/0 (socket says 172.21.15.57:33356) 2023-10-06T03:01:33.261 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.255+0000 7f183bfff700 1 -- 172.21.15.57:0/3994764959 learned_addr learned my addr 172.21.15.57:0/3994764959 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:33.263 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.255+0000 7f1832ffd700 1 --2- 172.21.15.57:0/3994764959 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f183c06c920 0x7f183c16d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:33.263 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.255+0000 7f183b7fe700 1 --2- 172.21.15.57:0/3994764959 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f183c06bba0 0x7f183c160360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:33.263 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.255+0000 7f183bfff700 1 -- 172.21.15.57:0/3994764959 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f183c06bba0 msgr2=0x7f183c160360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:33.263 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.255+0000 7f183bfff700 1 --2- 172.21.15.57:0/3994764959 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f183c06bba0 0x7f183c160360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:33.263 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.255+0000 7f183bfff700 1 -- 172.21.15.57:0/3994764959 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f183c06c920 msgr2=0x7f183c16d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:33.263 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.255+0000 7f183bfff700 1 --2- 172.21.15.57:0/3994764959 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f183c06c920 0x7f183c16d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:33.263 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.255+0000 7f183bfff700 1 -- 172.21.15.57:0/3994764959 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1824009420 con 0x7f183c0aae90 2023-10-06T03:01:33.263 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.255+0000 7f183b7fe700 1 --2- 172.21.15.57:0/3994764959 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f183c06bba0 0x7f183c160360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:33.263 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.255+0000 7f183bfff700 1 --2- 172.21.15.57:0/3994764959 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f183c0aae90 0x7f183c1616b0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f1834009e90 tx=0x7f183400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:33.263 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.259+0000 7f1833fff700 1 -- 172.21.15.57:0/3994764959 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f183400cc20 con 0x7f183c0aae90 2023-10-06T03:01:33.263 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.259+0000 7f1833fff700 1 -- 172.21.15.57:0/3994764959 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f183400f040 con 0x7f183c0aae90 2023-10-06T03:01:33.264 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.259+0000 7f1833fff700 1 -- 172.21.15.57:0/3994764959 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1834014480 con 0x7f183c0aae90 2023-10-06T03:01:33.264 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.259+0000 7f1840dcc700 1 -- 172.21.15.57:0/3994764959 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f183c0bfa90 con 0x7f183c0aae90 2023-10-06T03:01:33.264 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.259+0000 7f1840dcc700 1 -- 172.21.15.57:0/3994764959 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f183c0c0050 con 0x7f183c0aae90 2023-10-06T03:01:33.265 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.259+0000 7f1840dcc700 1 -- 172.21.15.57:0/3994764959 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f183c0c0240 con 0x7f183c0aae90 2023-10-06T03:01:33.265 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.259+0000 7f1833fff700 1 -- 172.21.15.57:0/3994764959 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f1834014830 con 0x7f183c0aae90 2023-10-06T03:01:33.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.263+0000 7f1833fff700 1 --2- 172.21.15.57:0/3994764959 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f181c060550 0x7f181c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:33.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.263+0000 7f1833fff700 1 -- 172.21.15.57:0/3994764959 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f183407d4e0 con 0x7f183c0aae90 2023-10-06T03:01:33.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.263+0000 7f183b7fe700 1 --2- 172.21.15.57:0/3994764959 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f181c060550 0x7f181c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:33.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.263+0000 7f183b7fe700 1 --2- 172.21.15.57:0/3994764959 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f181c060550 0x7f181c062a00 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f182c0058d0 tx=0x7f182c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:33.273 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.267+0000 7f1833fff700 1 -- 172.21.15.57:0/3994764959 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f1834051360 con 0x7f183c0aae90 2023-10-06T03:01:33.474 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.467+0000 7f1840dcc700 1 -- 172.21.15.57:0/3994764959 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f183c04be40 con 0x7f183c0aae90 2023-10-06T03:01:33.475 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.467+0000 7f1833fff700 1 -- 172.21.15.57:0/3994764959 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4594 (secure 0 0 0) 0x7f1834050ef0 con 0x7f183c0aae90 2023-10-06T03:01:33.475 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:01:33.475 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6834/1042131376","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":1042131376},{"type":"v1","addr":"172.21.15.105:6834","nonce":1042131376}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4287,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6836/3619570714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":3619570714},{"type":"v1","addr":"172.21.15.57:6836","nonce":3619570714}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6837/645924568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6835","nonce":645924568},{"type":"v1","addr":"172.21.15.57:6837","nonce":645924568}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:00:57.411689+0000","modified":"2023-10-06T03:01:00.999490+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4303},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4303":{"gid":4303,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6835/1286071598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":1286071598},{"type":"v1","addr":"172.21.15.105:6835","nonce":1286071598}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T03:01:33.478 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.471+0000 7f1840dcc700 1 -- 172.21.15.57:0/3994764959 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f181c060550 msgr2=0x7f181c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:33.478 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.471+0000 7f1840dcc700 1 --2- 172.21.15.57:0/3994764959 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f181c060550 0x7f181c062a00 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f182c0058d0 tx=0x7f182c009040 comp rx=0 tx=0).stop 2023-10-06T03:01:33.479 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.471+0000 7f1840dcc700 1 -- 172.21.15.57:0/3994764959 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f183c0aae90 msgr2=0x7f183c1616b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:33.479 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.471+0000 7f1840dcc700 1 --2- 172.21.15.57:0/3994764959 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f183c0aae90 0x7f183c1616b0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f1834009e90 tx=0x7f183400b040 comp rx=0 tx=0).stop 2023-10-06T03:01:33.479 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.471+0000 7f1840dcc700 1 -- 172.21.15.57:0/3994764959 shutdown_connections 2023-10-06T03:01:33.479 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.471+0000 7f1840dcc700 1 --2- 172.21.15.57:0/3994764959 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f183c0aae90 0x7f183c1616b0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:33.479 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.471+0000 7f1840dcc700 1 --2- 172.21.15.57:0/3994764959 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f183c06c920 0x7f183c16d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:33.480 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.471+0000 7f1840dcc700 1 --2- 172.21.15.57:0/3994764959 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f181c060550 0x7f181c062a00 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:33.480 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.471+0000 7f1840dcc700 1 --2- 172.21.15.57:0/3994764959 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f183c06bba0 0x7f183c160360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:33.480 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.471+0000 7f1840dcc700 1 -- 172.21.15.57:0/3994764959 >> 172.21.15.57:0/3994764959 conn(0x7f183c0c85e0 msgr2=0x7f183c0ac630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:33.480 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.471+0000 7f1840dcc700 1 -- 172.21.15.57:0/3994764959 shutdown_connections 2023-10-06T03:01:33.480 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.471+0000 7f1840dcc700 1 -- 172.21.15.57:0/3994764959 wait complete. 2023-10-06T03:01:33.481 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 8 2023-10-06T03:01:33.499 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:01:33.662 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.655+0000 7f8cd3185700 1 Processor -- start 2023-10-06T03:01:33.663 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.659+0000 7f8cd3185700 1 -- start start 2023-10-06T03:01:33.665 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.659+0000 7f8cd3185700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f8ccc0671f0 0x7f8ccc0675c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:33.665 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.659+0000 7f8cd3185700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8ccc150350 0x7f8ccc15ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:33.666 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.659+0000 7f8cd3185700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ccc06d7e0 con 0x7f8ccc06dc70 2023-10-06T03:01:33.666 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.659+0000 7f8cd3185700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ccc15dc00 con 0x7f8ccc0671f0 2023-10-06T03:01:33.666 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.659+0000 7f8cd3185700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ccc06ceb0 con 0x7f8ccc150350 2023-10-06T03:01:33.667 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.659+0000 7f8cd0f21700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f8ccc0671f0 0x7f8ccc0675c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:33.667 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.659+0000 7f8cd0f21700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f8ccc0671f0 0x7f8ccc0675c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33364/0 (socket says 172.21.15.57:33364) 2023-10-06T03:01:33.667 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.659+0000 7f8cd0f21700 1 -- 172.21.15.57:0/4205959923 learned_addr learned my addr 172.21.15.57:0/4205959923 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:33.667 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.659+0000 7f8cd1722700 1 --2- 172.21.15.57:0/4205959923 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8ccc150350 0x7f8ccc15ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:33.667 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.663+0000 7f8cd0f21700 1 -- 172.21.15.57:0/4205959923 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8ccc150350 msgr2=0x7f8ccc15ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:33.668 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.663+0000 7f8cd0f21700 1 --2- 172.21.15.57:0/4205959923 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8ccc150350 0x7f8ccc15ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:33.668 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.663+0000 7f8cd0f21700 1 -- 172.21.15.57:0/4205959923 >> v1:172.21.15.105:6789/0 conn(0x7f8ccc06dc70 legacy=0x7f8ccc14fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:33.668 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.663+0000 7f8cd0f21700 1 -- 172.21.15.57:0/4205959923 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ccc06d190 con 0x7f8ccc0671f0 2023-10-06T03:01:33.669 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.663+0000 7f8cd0f21700 1 --2- 172.21.15.57:0/4205959923 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8ccc0671f0 0x7f8ccc0675c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f8cc00099b0 tx=0x7f8cc0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13ddd78443696fd5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:33.669 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.663+0000 7f8ccb7fe700 1 -- 172.21.15.57:0/4205959923 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc000b860 con 0x7f8ccc0671f0 2023-10-06T03:01:33.669 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.663+0000 7f8ccb7fe700 1 -- 172.21.15.57:0/4205959923 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cc000b9c0 con 0x7f8ccc0671f0 2023-10-06T03:01:33.669 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.663+0000 7f8ccb7fe700 1 -- 172.21.15.57:0/4205959923 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc000bd60 con 0x7f8ccc0671f0 2023-10-06T03:01:33.669 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.663+0000 7f8cd3185700 1 -- 172.21.15.57:0/4205959923 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8ccc0671f0 msgr2=0x7f8ccc0675c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:33.670 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.663+0000 7f8cd3185700 1 --2- 172.21.15.57:0/4205959923 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8ccc0671f0 0x7f8ccc0675c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f8cc00099b0 tx=0x7f8cc0009250 comp rx=0 tx=0).stop 2023-10-06T03:01:33.670 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.663+0000 7f8cd3185700 1 -- 172.21.15.57:0/4205959923 shutdown_connections 2023-10-06T03:01:33.670 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.663+0000 7f8cd3185700 1 --2- 172.21.15.57:0/4205959923 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8ccc150350 0x7f8ccc15ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:33.670 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.663+0000 7f8cd3185700 1 --2- 172.21.15.57:0/4205959923 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8ccc0671f0 0x7f8ccc0675c0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:33.670 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.663+0000 7f8cd3185700 1 -- 172.21.15.57:0/4205959923 >> 172.21.15.57:0/4205959923 conn(0x7f8ccc0cbdd0 msgr2=0x7f8ccc0cc1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:33.670 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.663+0000 7f8cd3185700 1 -- 172.21.15.57:0/4205959923 shutdown_connections 2023-10-06T03:01:33.671 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.663+0000 7f8cd3185700 1 -- 172.21.15.57:0/4205959923 wait complete. 2023-10-06T03:01:33.672 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.667+0000 7f8cd3185700 1 Processor -- start 2023-10-06T03:01:33.672 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.667+0000 7f8cd3185700 1 -- start start 2023-10-06T03:01:33.674 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.667+0000 7f8cd3185700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8ccc0671f0 0x7f8ccc16eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:33.674 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.667+0000 7f8cd3185700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8ccc06dc70 0x7f8ccc1499d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:33.674 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.667+0000 7f8cd3185700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8ccc150350 0x7f8ccc0ad5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:33.674 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.667+0000 7f8cd3185700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ccc0adb20 con 0x7f8ccc06dc70 2023-10-06T03:01:33.674 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.667+0000 7f8cd3185700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ccc0add30 con 0x7f8ccc150350 2023-10-06T03:01:33.675 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.667+0000 7f8cd3185700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ccc0ae010 con 0x7f8ccc0671f0 2023-10-06T03:01:33.675 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.667+0000 7f8ccbfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8ccc06dc70 0x7f8ccc1499d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:33.675 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.667+0000 7f8ccbfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8ccc06dc70 0x7f8ccc1499d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33378/0 (socket says 172.21.15.57:33378) 2023-10-06T03:01:33.675 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.667+0000 7f8ccbfff700 1 -- 172.21.15.57:0/958107567 learned_addr learned my addr 172.21.15.57:0/958107567 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:33.675 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.667+0000 7f8cd0f21700 1 --2- 172.21.15.57:0/958107567 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8ccc0671f0 0x7f8ccc16eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:33.675 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.667+0000 7f8cd1722700 1 --2- 172.21.15.57:0/958107567 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8ccc150350 0x7f8ccc0ad5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:33.676 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.667+0000 7f8ccbfff700 1 -- 172.21.15.57:0/958107567 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8ccc0671f0 msgr2=0x7f8ccc16eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:33.676 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.667+0000 7f8ccbfff700 1 --2- 172.21.15.57:0/958107567 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8ccc0671f0 0x7f8ccc16eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:33.676 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.667+0000 7f8ccbfff700 1 -- 172.21.15.57:0/958107567 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8ccc150350 msgr2=0x7f8ccc0ad5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:33.676 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.667+0000 7f8ccbfff700 1 --2- 172.21.15.57:0/958107567 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8ccc150350 0x7f8ccc0ad5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:33.676 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.667+0000 7f8ccbfff700 1 -- 172.21.15.57:0/958107567 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cc00094f0 con 0x7f8ccc06dc70 2023-10-06T03:01:33.676 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.667+0000 7f8cd0f21700 1 --2- 172.21.15.57:0/958107567 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8ccc0671f0 0x7f8ccc16eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:01:33.676 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.667+0000 7f8cd1722700 1 --2- 172.21.15.57:0/958107567 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8ccc150350 0x7f8ccc0ad5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:01:33.677 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.667+0000 7f8ccbfff700 1 --2- 172.21.15.57:0/958107567 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8ccc06dc70 0x7f8ccc1499d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f8cb800c590 tx=0x7f8cb800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:33.678 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.667+0000 7f8cc8ff9700 1 -- 172.21.15.57:0/958107567 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cb8011590 con 0x7f8ccc06dc70 2023-10-06T03:01:33.678 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.671+0000 7f8cc8ff9700 1 -- 172.21.15.57:0/958107567 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cb80116f0 con 0x7f8ccc06dc70 2023-10-06T03:01:33.678 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.671+0000 7f8cc8ff9700 1 -- 172.21.15.57:0/958107567 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cb8011ab0 con 0x7f8ccc06dc70 2023-10-06T03:01:33.678 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.671+0000 7f8cd3185700 1 -- 172.21.15.57:0/958107567 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ccc0ae2f0 con 0x7f8ccc06dc70 2023-10-06T03:01:33.678 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.671+0000 7f8cd3185700 1 -- 172.21.15.57:0/958107567 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ccc15c2d0 con 0x7f8ccc06dc70 2023-10-06T03:01:33.678 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.671+0000 7f8cd3185700 1 -- 172.21.15.57:0/958107567 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ccc15c130 con 0x7f8ccc06dc70 2023-10-06T03:01:33.679 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.671+0000 7f8cc8ff9700 1 -- 172.21.15.57:0/958107567 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f8cb801b3b0 con 0x7f8ccc06dc70 2023-10-06T03:01:33.679 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.675+0000 7f8cc8ff9700 1 --2- 172.21.15.57:0/958107567 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f8cb0060550 0x7f8cb0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:33.679 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.675+0000 7f8cc8ff9700 1 -- 172.21.15.57:0/958107567 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8cb807bf20 con 0x7f8ccc06dc70 2023-10-06T03:01:33.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.675+0000 7f8cd0f21700 1 --2- 172.21.15.57:0/958107567 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f8cb0060550 0x7f8cb0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:33.681 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.675+0000 7f8cd0f21700 1 --2- 172.21.15.57:0/958107567 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f8cb0060550 0x7f8cb0062a00 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8cc00099b0 tx=0x7f8cc0017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:33.686 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.679+0000 7f8cc8ff9700 1 -- 172.21.15.57:0/958107567 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f8ccc15c130 con 0x7f8ccc06dc70 2023-10-06T03:01:33.857 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.851+0000 7f8cd3185700 1 -- 172.21.15.57:0/958107567 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8ccc15c130 con 0x7f8ccc06dc70 2023-10-06T03:01:33.860 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.855+0000 7f8cc8ff9700 1 -- 172.21.15.57:0/958107567 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16866 (secure 0 0 0) 0x7f8ccc15c130 con 0x7f8ccc06dc70 2023-10-06T03:01:33.860 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:01:33.861 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":23,"fsid":"eb56dc0f-9213-41cb-9aad-8ade6c802e98","created":"2023-10-06T03:00:30.806197+0000","modified":"2023-10-06T03:00:58.975366+0000","last_up_change":"2023-10-06T03:00:43.607454+0000","last_in_change":"2023-10-06T03:00:33.943513+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T03:00:44.360651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T03:00:50.466601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:00:55.472586+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T03:00:56.400884+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"58cf6c90-d704-43e0-b2db-dffe526d5e8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":33053},{"type":"v1","addr":"172.21.15.57:6801","nonce":33053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":33053},{"type":"v1","addr":"172.21.15.57:6803","nonce":33053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":33053},{"type":"v1","addr":"172.21.15.57:6807","nonce":33053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":33053},{"type":"v1","addr":"172.21.15.57:6805","nonce":33053}]},"public_addr":"172.21.15.57:6801/33053","cluster_addr":"172.21.15.57:6803/33053","heartbeat_back_addr":"172.21.15.57:6807/33053","heartbeat_front_addr":"172.21.15.57:6805/33053","state":["exists","up"]},{"osd":1,"uuid":"16afbe70-7f9e-4568-9c92-763e6e348119","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6809","nonce":33052},{"type":"v1","addr":"172.21.15.57:6810","nonce":33052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":33052},{"type":"v1","addr":"172.21.15.57:6813","nonce":33052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":33052},{"type":"v1","addr":"172.21.15.57:6822","nonce":33052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6815","nonce":33052},{"type":"v1","addr":"172.21.15.57:6818","nonce":33052}]},"public_addr":"172.21.15.57:6810/33052","cluster_addr":"172.21.15.57:6813/33052","heartbeat_back_addr":"172.21.15.57:6822/33052","heartbeat_front_addr":"172.21.15.57:6818/33052","state":["exists","up"]},{"osd":2,"uuid":"7255c62e-f92f-470f-a5ce-30228920d9f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":33058},{"type":"v1","addr":"172.21.15.57:6825","nonce":33058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":33058},{"type":"v1","addr":"172.21.15.57:6827","nonce":33058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":33058},{"type":"v1","addr":"172.21.15.57:6831","nonce":33058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":33058},{"type":"v1","addr":"172.21.15.57:6829","nonce":33058}]},"public_addr":"172.21.15.57:6825/33058","cluster_addr":"172.21.15.57:6827/33058","heartbeat_back_addr":"172.21.15.57:6831/33058","heartbeat_front_addr":"172.21.15.57:6829/33058","state":["exists","up"]},{"osd":3,"uuid":"152a236d-f799-4888-8544-74865508d5a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":33057},{"type":"v1","addr":"172.21.15.57:6811","nonce":33057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":33057},{"type":"v1","addr":"172.21.15.57:6816","nonce":33057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6821","nonce":33057},{"type":"v1","addr":"172.21.15.57:6823","nonce":33057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6817","nonce":33057},{"type":"v1","addr":"172.21.15.57:6819","nonce":33057}]},"public_addr":"172.21.15.57:6811/33057","cluster_addr":"172.21.15.57:6816/33057","heartbeat_back_addr":"172.21.15.57:6823/33057","heartbeat_front_addr":"172.21.15.57:6819/33057","state":["exists","up"]},{"osd":4,"uuid":"37db2a65-3566-41d0-9d60-e66c49e1e68e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":33368},{"type":"v1","addr":"172.21.15.105:6801","nonce":33368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":33368},{"type":"v1","addr":"172.21.15.105:6803","nonce":33368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":33368},{"type":"v1","addr":"172.21.15.105:6807","nonce":33368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":33368},{"type":"v1","addr":"172.21.15.105:6805","nonce":33368}]},"public_addr":"172.21.15.105:6801/33368","cluster_addr":"172.21.15.105:6803/33368","heartbeat_back_addr":"172.21.15.105:6807/33368","heartbeat_front_addr":"172.21.15.105:6805/33368","state":["exists","up"]},{"osd":5,"uuid":"35e77918-1bb4-42ca-9b20-f3c14eaa0c04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":33379},{"type":"v1","addr":"172.21.15.105:6818","nonce":33379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":33379},{"type":"v1","addr":"172.21.15.105:6823","nonce":33379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":33379},{"type":"v1","addr":"172.21.15.105:6831","nonce":33379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":33379},{"type":"v1","addr":"172.21.15.105:6827","nonce":33379}]},"public_addr":"172.21.15.105:6818/33379","cluster_addr":"172.21.15.105:6823/33379","heartbeat_back_addr":"172.21.15.105:6831/33379","heartbeat_front_addr":"172.21.15.105:6827/33379","state":["exists","up"]},{"osd":6,"uuid":"b4d9d510-7a45-4173-8287-c6c8d6547f2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":33369},{"type":"v1","addr":"172.21.15.105:6819","nonce":33369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":33369},{"type":"v1","addr":"172.21.15.105:6822","nonce":33369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":33369},{"type":"v1","addr":"172.21.15.105:6830","nonce":33369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":33369},{"type":"v1","addr":"172.21.15.105:6826","nonce":33369}]},"public_addr":"172.21.15.105:6819/33369","cluster_addr":"172.21.15.105:6822/33369","heartbeat_back_addr":"172.21.15.105:6830/33369","heartbeat_front_addr":"172.21.15.105:6826/33369","state":["exists","up"]},{"osd":7,"uuid":"74266fb0-cd84-463f-8bf0-092652a71dc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":33370},{"type":"v1","addr":"172.21.15.105:6809","nonce":33370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":33370},{"type":"v1","addr":"172.21.15.105:6811","nonce":33370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":33370},{"type":"v1","addr":"172.21.15.105:6815","nonce":33370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":33370},{"type":"v1","addr":"172.21.15.105:6813","nonce":33370}]},"public_addr":"172.21.15.105:6809/33370","cluster_addr":"172.21.15.105:6811/33370","heartbeat_back_addr":"172.21.15.105:6815/33370","heartbeat_front_addr":"172.21.15.105:6813/33370","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.596864+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.633851+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.636993+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.529681+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.608601+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.659752+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.661717+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.642221+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:01:33.863 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.855+0000 7f8cd3185700 1 -- 172.21.15.57:0/958107567 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f8cb0060550 msgr2=0x7f8cb0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:33.863 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.855+0000 7f8cd3185700 1 --2- 172.21.15.57:0/958107567 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f8cb0060550 0x7f8cb0062a00 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8cc00099b0 tx=0x7f8cc0017000 comp rx=0 tx=0).stop 2023-10-06T03:01:33.863 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.859+0000 7f8cd3185700 1 -- 172.21.15.57:0/958107567 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8ccc06dc70 msgr2=0x7f8ccc1499d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:33.863 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.859+0000 7f8cd3185700 1 --2- 172.21.15.57:0/958107567 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8ccc06dc70 0x7f8ccc1499d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f8cb800c590 tx=0x7f8cb800c950 comp rx=0 tx=0).stop 2023-10-06T03:01:33.863 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.859+0000 7f8cd3185700 1 -- 172.21.15.57:0/958107567 shutdown_connections 2023-10-06T03:01:33.863 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.859+0000 7f8cd3185700 1 --2- 172.21.15.57:0/958107567 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8ccc150350 0x7f8ccc0ad5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:33.863 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.859+0000 7f8cd3185700 1 --2- 172.21.15.57:0/958107567 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8ccc06dc70 0x7f8ccc1499d0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:33.863 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.859+0000 7f8cd3185700 1 --2- 172.21.15.57:0/958107567 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f8cb0060550 0x7f8cb0062a00 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:33.864 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.859+0000 7f8cd3185700 1 --2- 172.21.15.57:0/958107567 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8ccc0671f0 0x7f8ccc16eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:33.864 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.859+0000 7f8cd3185700 1 -- 172.21.15.57:0/958107567 >> 172.21.15.57:0/958107567 conn(0x7f8ccc0cbdd0 msgr2=0x7f8ccc14ddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:33.864 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.859+0000 7f8cd3185700 1 -- 172.21.15.57:0/958107567 shutdown_connections 2023-10-06T03:01:33.864 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:33.859+0000 7f8cd3185700 1 -- 172.21.15.57:0/958107567 wait complete. 2023-10-06T03:01:33.885 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T03:01:33.885 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:01:34.044 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.039+0000 7fdddcbcc700 1 Processor -- start 2023-10-06T03:01:34.044 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.039+0000 7fdddcbcc700 1 -- start start 2023-10-06T03:01:34.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.039+0000 7fdddcbcc700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fddd80aae90 0x7fddd80aa7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:34.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.039+0000 7fdddcbcc700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddd806de50 con 0x7fddd806c920 2023-10-06T03:01:34.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.039+0000 7fdddcbcc700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddd806e130 con 0x7fddd806bba0 2023-10-06T03:01:34.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.039+0000 7fdddcbcc700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddd806b3a0 con 0x7fddd80aae90 2023-10-06T03:01:34.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.039+0000 7fddd77fe700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fddd806c920 0x7fddd806ccf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:55602/0 (socket says 172.21.15.57:55602) 2023-10-06T03:01:34.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.039+0000 7fddd77fe700 1 -- 172.21.15.57:0/175937141 learned_addr learned my addr 172.21.15.57:0/175937141 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:01:34.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.039+0000 7fddd6ffd700 1 --2- 172.21.15.57:0/175937141 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fddd80aae90 0x7fddd80aa7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:34.047 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.043+0000 7fddd67fc700 1 -- 172.21.15.57:0/175937141 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3445238731 0 0) 0x7fddd806de50 con 0x7fddd806c920 2023-10-06T03:01:34.047 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.043+0000 7fddd67fc700 1 -- 172.21.15.57:0/175937141 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fddc0003570 con 0x7fddd806c920 2023-10-06T03:01:34.047 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.043+0000 7fddd67fc700 1 -- 172.21.15.57:0/175937141 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 229164915 0 0) 0x7fddd806e130 con 0x7fddd806bba0 2023-10-06T03:01:34.047 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.043+0000 7fddd67fc700 1 -- 172.21.15.57:0/175937141 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fddd806de50 con 0x7fddd806bba0 2023-10-06T03:01:34.047 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.043+0000 7fddd6ffd700 1 -- 172.21.15.57:0/175937141 >> v1:172.21.15.105:6789/0 conn(0x7fddd806bba0 legacy=0x7fddd80ab970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:34.047 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.043+0000 7fddd6ffd700 1 -- 172.21.15.57:0/175937141 >> v1:172.21.15.57:6789/0 conn(0x7fddd806c920 legacy=0x7fddd806ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:34.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.043+0000 7fddd6ffd700 1 -- 172.21.15.57:0/175937141 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddd806b680 con 0x7fddd80aae90 2023-10-06T03:01:34.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.043+0000 7fddd6ffd700 1 --2- 172.21.15.57:0/175937141 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fddd80aae90 0x7fddd80aa7e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fddcc009910 tx=0x7fddcc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=29d3aa9fe77fe074 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:34.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.043+0000 7fddd67fc700 1 -- 172.21.15.57:0/175937141 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddcc011630 con 0x7fddd80aae90 2023-10-06T03:01:34.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.043+0000 7fddd67fc700 1 -- 172.21.15.57:0/175937141 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddcc011790 con 0x7fddd80aae90 2023-10-06T03:01:34.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.043+0000 7fddd67fc700 1 -- 172.21.15.57:0/175937141 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddcc011b30 con 0x7fddd80aae90 2023-10-06T03:01:34.049 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.043+0000 7fdddcbcc700 1 -- 172.21.15.57:0/175937141 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fddd80aae90 msgr2=0x7fddd80aa7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:34.049 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.043+0000 7fdddcbcc700 1 --2- 172.21.15.57:0/175937141 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fddd80aae90 0x7fddd80aa7e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fddcc009910 tx=0x7fddcc0091a0 comp rx=0 tx=0).stop 2023-10-06T03:01:34.050 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.043+0000 7fdddcbcc700 1 -- 172.21.15.57:0/175937141 shutdown_connections 2023-10-06T03:01:34.050 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.043+0000 7fdddcbcc700 1 --2- 172.21.15.57:0/175937141 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fddd80aae90 0x7fddd80aa7e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:34.050 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.043+0000 7fdddcbcc700 1 -- 172.21.15.57:0/175937141 >> 172.21.15.57:0/175937141 conn(0x7fddd80c85e0 msgr2=0x7fddd80c89e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:34.050 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.043+0000 7fdddcbcc700 1 -- 172.21.15.57:0/175937141 shutdown_connections 2023-10-06T03:01:34.050 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.043+0000 7fdddcbcc700 1 -- 172.21.15.57:0/175937141 wait complete. 2023-10-06T03:01:34.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.047+0000 7fdddcbcc700 1 Processor -- start 2023-10-06T03:01:34.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.047+0000 7fdddcbcc700 1 -- start start 2023-10-06T03:01:34.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.047+0000 7fdddcbcc700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fddd806bba0 0x7fddd80b1320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:34.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.047+0000 7fdddcbcc700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fddd806c920 0x7fddd816d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:34.054 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.047+0000 7fdddcbcc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fddd80aae90 0x7fddd815c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:34.054 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.047+0000 7fdddcbcc700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddd8170780 con 0x7fddd80aae90 2023-10-06T03:01:34.054 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.047+0000 7fdddcbcc700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddd80b0550 con 0x7fddd806bba0 2023-10-06T03:01:34.054 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.047+0000 7fdddcbcc700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddd80b1860 con 0x7fddd806c920 2023-10-06T03:01:34.054 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.047+0000 7fddd7fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fddd80aae90 0x7fddd815c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:34.054 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.047+0000 7fddd7fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fddd80aae90 0x7fddd815c840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33390/0 (socket says 172.21.15.57:33390) 2023-10-06T03:01:34.054 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.047+0000 7fddd7fff700 1 -- 172.21.15.57:0/1717384434 learned_addr learned my addr 172.21.15.57:0/1717384434 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:34.054 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.047+0000 7fddd6ffd700 1 --2- 172.21.15.57:0/1717384434 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fddd806c920 0x7fddd816d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:34.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.047+0000 7fddd77fe700 1 --2- 172.21.15.57:0/1717384434 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fddd806bba0 0x7fddd80b1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:34.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.051+0000 7fddd7fff700 1 -- 172.21.15.57:0/1717384434 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fddd806c920 msgr2=0x7fddd816d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:34.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.051+0000 7fddd7fff700 1 --2- 172.21.15.57:0/1717384434 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fddd806c920 0x7fddd816d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:34.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.051+0000 7fddd7fff700 1 -- 172.21.15.57:0/1717384434 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fddd806bba0 msgr2=0x7fddd80b1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:34.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.051+0000 7fddd7fff700 1 --2- 172.21.15.57:0/1717384434 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fddd806bba0 0x7fddd80b1320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:34.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.051+0000 7fddd7fff700 1 -- 172.21.15.57:0/1717384434 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddcc009420 con 0x7fddd80aae90 2023-10-06T03:01:34.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.051+0000 7fddd77fe700 1 --2- 172.21.15.57:0/1717384434 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fddd806bba0 0x7fddd80b1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:34.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.051+0000 7fddd7fff700 1 --2- 172.21.15.57:0/1717384434 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fddd80aae90 0x7fddd815c840 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fddd000c910 tx=0x7fddd00027a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:34.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.051+0000 7fddbf7fe700 1 -- 172.21.15.57:0/1717384434 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd0012630 con 0x7fddd80aae90 2023-10-06T03:01:34.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.051+0000 7fddbf7fe700 1 -- 172.21.15.57:0/1717384434 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddd00127b0 con 0x7fddd80aae90 2023-10-06T03:01:34.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.051+0000 7fddbf7fe700 1 -- 172.21.15.57:0/1717384434 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd0012b70 con 0x7fddd80aae90 2023-10-06T03:01:34.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.051+0000 7fdddcbcc700 1 -- 172.21.15.57:0/1717384434 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddd80af940 con 0x7fddd80aae90 2023-10-06T03:01:34.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.051+0000 7fdddcbcc700 1 -- 172.21.15.57:0/1717384434 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddd80aff00 con 0x7fddd80aae90 2023-10-06T03:01:34.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.051+0000 7fdddcbcc700 1 -- 172.21.15.57:0/1717384434 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddd804be40 con 0x7fddd80aae90 2023-10-06T03:01:34.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.055+0000 7fddbf7fe700 1 -- 172.21.15.57:0/1717384434 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fddd001b400 con 0x7fddd80aae90 2023-10-06T03:01:34.060 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.055+0000 7fddbf7fe700 1 --2- 172.21.15.57:0/1717384434 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fddc4060550 0x7fddc4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:34.060 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.055+0000 7fddbf7fe700 1 -- 172.21.15.57:0/1717384434 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fddd007cdf0 con 0x7fddd80aae90 2023-10-06T03:01:34.061 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.055+0000 7fddd77fe700 1 --2- 172.21.15.57:0/1717384434 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fddc4060550 0x7fddc4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:34.061 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.055+0000 7fddd77fe700 1 --2- 172.21.15.57:0/1717384434 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fddc4060550 0x7fddc4062a00 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fddd80c7570 tx=0x7fddc8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:34.068 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.063+0000 7fddbf7fe700 1 -- 172.21.15.57:0/1717384434 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fddd004d1e0 con 0x7fddd80aae90 2023-10-06T03:01:34.271 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.267+0000 7fdddcbcc700 1 -- 172.21.15.57:0/1717384434 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fddd80aba60 con 0x7fddd80aae90 2023-10-06T03:01:34.272 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.267+0000 7fddbf7fe700 1 -- 172.21.15.57:0/1717384434 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4594 (secure 0 0 0) 0x7fddd0016090 con 0x7fddd80aae90 2023-10-06T03:01:34.273 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:01:34.273 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6834/1042131376","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":1042131376},{"type":"v1","addr":"172.21.15.105:6834","nonce":1042131376}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4287,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6836/3619570714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":3619570714},{"type":"v1","addr":"172.21.15.57:6836","nonce":3619570714}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6837/645924568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6835","nonce":645924568},{"type":"v1","addr":"172.21.15.57:6837","nonce":645924568}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:00:57.411689+0000","modified":"2023-10-06T03:01:00.999490+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4303},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4303":{"gid":4303,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6835/1286071598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":1286071598},{"type":"v1","addr":"172.21.15.105:6835","nonce":1286071598}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T03:01:34.276 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.271+0000 7fdddcbcc700 1 -- 172.21.15.57:0/1717384434 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fddc4060550 msgr2=0x7fddc4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:34.276 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.271+0000 7fdddcbcc700 1 --2- 172.21.15.57:0/1717384434 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fddc4060550 0x7fddc4062a00 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fddd80c7570 tx=0x7fddc8009040 comp rx=0 tx=0).stop 2023-10-06T03:01:34.276 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.271+0000 7fdddcbcc700 1 -- 172.21.15.57:0/1717384434 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fddd80aae90 msgr2=0x7fddd815c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:34.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.271+0000 7fdddcbcc700 1 --2- 172.21.15.57:0/1717384434 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fddd80aae90 0x7fddd815c840 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fddd000c910 tx=0x7fddd00027a0 comp rx=0 tx=0).stop 2023-10-06T03:01:34.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.271+0000 7fdddcbcc700 1 -- 172.21.15.57:0/1717384434 shutdown_connections 2023-10-06T03:01:34.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.271+0000 7fdddcbcc700 1 --2- 172.21.15.57:0/1717384434 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fddd80aae90 0x7fddd815c840 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:34.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.271+0000 7fdddcbcc700 1 --2- 172.21.15.57:0/1717384434 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fddc4060550 0x7fddc4062a00 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:34.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.271+0000 7fdddcbcc700 1 --2- 172.21.15.57:0/1717384434 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fddd806c920 0x7fddd816d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:34.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.271+0000 7fdddcbcc700 1 --2- 172.21.15.57:0/1717384434 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fddd806bba0 0x7fddd80b1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:34.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.271+0000 7fdddcbcc700 1 -- 172.21.15.57:0/1717384434 >> 172.21.15.57:0/1717384434 conn(0x7fddd80c85e0 msgr2=0x7fddd815f1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:34.278 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.271+0000 7fdddcbcc700 1 -- 172.21.15.57:0/1717384434 shutdown_connections 2023-10-06T03:01:34.278 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.271+0000 7fdddcbcc700 1 -- 172.21.15.57:0/1717384434 wait complete. 2023-10-06T03:01:34.278 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 8 2023-10-06T03:01:34.298 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:01:34.462 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.455+0000 7f008e345700 1 Processor -- start 2023-10-06T03:01:34.462 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.455+0000 7f008e345700 1 -- start start 2023-10-06T03:01:34.462 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.455+0000 7f008e345700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00880671f0 0x7f00880675c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:34.462 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.455+0000 7f008e345700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f0088150350 0x7f008815ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:34.462 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.455+0000 7f008e345700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f008806d7e0 con 0x7f008806dc70 2023-10-06T03:01:34.463 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.455+0000 7f008e345700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f008815dc00 con 0x7f0088150350 2023-10-06T03:01:34.463 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.455+0000 7f008e345700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f008806ceb0 con 0x7f00880671f0 2023-10-06T03:01:34.464 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.459+0000 7f007ffff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f008806dc70 0x7f008814fc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:55616/0 (socket says 172.21.15.57:55616) 2023-10-06T03:01:34.464 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.459+0000 7f007ffff700 1 -- 172.21.15.57:0/1986680040 learned_addr learned my addr 172.21.15.57:0/1986680040 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:01:34.464 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.459+0000 7f008c8e2700 1 --2- 172.21.15.57:0/1986680040 >> v2:172.21.15.105:3300/0 conn(0x7f0088150350 0x7f008815ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:34.464 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.459+0000 7f0087fff700 1 --2- 172.21.15.57:0/1986680040 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00880671f0 0x7f00880675c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:34.464 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.459+0000 7f00877fe700 1 -- 172.21.15.57:0/1986680040 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3064363992 0 0) 0x7f008806d7e0 con 0x7f008806dc70 2023-10-06T03:01:34.464 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.459+0000 7f00877fe700 1 -- 172.21.15.57:0/1986680040 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0074003570 con 0x7f008806dc70 2023-10-06T03:01:34.464 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.459+0000 7f0087fff700 1 -- 172.21.15.57:0/1986680040 >> v2:172.21.15.105:3300/0 conn(0x7f0088150350 msgr2=0x7f008815ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:34.464 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.459+0000 7f0087fff700 1 --2- 172.21.15.57:0/1986680040 >> v2:172.21.15.105:3300/0 conn(0x7f0088150350 0x7f008815ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:34.464 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.459+0000 7f0087fff700 1 -- 172.21.15.57:0/1986680040 >> v1:172.21.15.57:6789/0 conn(0x7f008806dc70 legacy=0x7f008814fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:34.465 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.459+0000 7f0087fff700 1 -- 172.21.15.57:0/1986680040 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f008806d190 con 0x7f00880671f0 2023-10-06T03:01:34.465 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.459+0000 7f0087fff700 1 --2- 172.21.15.57:0/1986680040 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00880671f0 0x7f00880675c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0078009910 tx=0x7f00780091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=31380850e6749033 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:34.465 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.459+0000 7f00877fe700 1 -- 172.21.15.57:0/1986680040 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0078011630 con 0x7f00880671f0 2023-10-06T03:01:34.465 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.459+0000 7f00877fe700 1 -- 172.21.15.57:0/1986680040 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0078011790 con 0x7f00880671f0 2023-10-06T03:01:34.466 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.459+0000 7f00877fe700 1 -- 172.21.15.57:0/1986680040 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0078011b30 con 0x7f00880671f0 2023-10-06T03:01:34.466 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.459+0000 7f008e345700 1 -- 172.21.15.57:0/1986680040 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00880671f0 msgr2=0x7f00880675c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:34.466 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.459+0000 7f008e345700 1 --2- 172.21.15.57:0/1986680040 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00880671f0 0x7f00880675c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0078009910 tx=0x7f00780091a0 comp rx=0 tx=0).stop 2023-10-06T03:01:34.467 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.463+0000 7f008e345700 1 -- 172.21.15.57:0/1986680040 shutdown_connections 2023-10-06T03:01:34.467 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.463+0000 7f008e345700 1 --2- 172.21.15.57:0/1986680040 >> v2:172.21.15.105:3300/0 conn(0x7f0088150350 0x7f008815ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:34.467 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.463+0000 7f008e345700 1 --2- 172.21.15.57:0/1986680040 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00880671f0 0x7f00880675c0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:34.467 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.463+0000 7f008e345700 1 -- 172.21.15.57:0/1986680040 >> 172.21.15.57:0/1986680040 conn(0x7f00880cbdd0 msgr2=0x7f00880cc1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:34.467 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.463+0000 7f008e345700 1 -- 172.21.15.57:0/1986680040 shutdown_connections 2023-10-06T03:01:34.467 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.463+0000 7f008e345700 1 -- 172.21.15.57:0/1986680040 wait complete. 2023-10-06T03:01:34.469 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.463+0000 7f008e345700 1 Processor -- start 2023-10-06T03:01:34.470 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.463+0000 7f008e345700 1 -- start start 2023-10-06T03:01:34.471 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.467+0000 7f008e345700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00880671f0 0x7f008814ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:34.471 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.467+0000 7f008e345700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f008806dc70 0x7f0088169d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:34.471 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.467+0000 7f008e345700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0088150350 0x7f008816d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:34.471 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.467+0000 7f008e345700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f008815d160 con 0x7f00880671f0 2023-10-06T03:01:34.472 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.467+0000 7f008e345700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f008816a260 con 0x7f0088150350 2023-10-06T03:01:34.472 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.467+0000 7f008e345700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f008815d930 con 0x7f008806dc70 2023-10-06T03:01:34.472 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.467+0000 7f0087fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00880671f0 0x7f008814ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:34.473 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.467+0000 7f0087fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00880671f0 0x7f008814ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60486/0 (socket says 172.21.15.57:60486) 2023-10-06T03:01:34.473 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.467+0000 7f0087fff700 1 -- 172.21.15.57:0/4154084062 learned_addr learned my addr 172.21.15.57:0/4154084062 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:34.473 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.467+0000 7f008c8e2700 1 --2- 172.21.15.57:0/4154084062 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0088150350 0x7f008816d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:34.473 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.467+0000 7f007ffff700 1 --2- 172.21.15.57:0/4154084062 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f008806dc70 0x7f0088169d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:34.473 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.467+0000 7f0087fff700 1 -- 172.21.15.57:0/4154084062 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f008806dc70 msgr2=0x7f0088169d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:34.473 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.467+0000 7f0087fff700 1 --2- 172.21.15.57:0/4154084062 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f008806dc70 0x7f0088169d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:34.473 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.467+0000 7f0087fff700 1 -- 172.21.15.57:0/4154084062 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0088150350 msgr2=0x7f008816d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:34.473 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.467+0000 7f0087fff700 1 --2- 172.21.15.57:0/4154084062 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0088150350 0x7f008816d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:34.473 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.467+0000 7f0087fff700 1 -- 172.21.15.57:0/4154084062 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0078009420 con 0x7f00880671f0 2023-10-06T03:01:34.474 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.467+0000 7f0087fff700 1 --2- 172.21.15.57:0/4154084062 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00880671f0 0x7f008814ccf0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f0078009f00 tx=0x7f0078017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:34.474 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.467+0000 7f0084ff9700 1 -- 172.21.15.57:0/4154084062 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0078011900 con 0x7f00880671f0 2023-10-06T03:01:34.474 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.467+0000 7f008e345700 1 -- 172.21.15.57:0/4154084062 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f008815d370 con 0x7f00880671f0 2023-10-06T03:01:34.474 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.467+0000 7f0084ff9700 1 -- 172.21.15.57:0/4154084062 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0078011a80 con 0x7f00880671f0 2023-10-06T03:01:34.474 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.467+0000 7f0084ff9700 1 -- 172.21.15.57:0/4154084062 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0078025640 con 0x7f00880671f0 2023-10-06T03:01:34.475 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.467+0000 7f008e345700 1 -- 172.21.15.57:0/4154084062 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f008816c970 con 0x7f00880671f0 2023-10-06T03:01:34.475 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.471+0000 7f008e345700 1 -- 172.21.15.57:0/4154084062 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00880712e0 con 0x7f00880671f0 2023-10-06T03:01:34.477 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.471+0000 7f0084ff9700 1 -- 172.21.15.57:0/4154084062 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f0078025a30 con 0x7f00880671f0 2023-10-06T03:01:34.479 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.475+0000 7f0084ff9700 1 --2- 172.21.15.57:0/4154084062 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f0068060550 0x7f0068062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:34.479 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.475+0000 7f0084ff9700 1 -- 172.21.15.57:0/4154084062 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f007807e180 con 0x7f00880671f0 2023-10-06T03:01:34.479 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.475+0000 7f007ffff700 1 --2- 172.21.15.57:0/4154084062 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f0068060550 0x7f0068062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:34.481 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.475+0000 7f007ffff700 1 --2- 172.21.15.57:0/4154084062 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f0068060550 0x7f0068062a00 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f008806b680 tx=0x7f0070009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:34.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.479+0000 7f0084ff9700 1 -- 172.21.15.57:0/4154084062 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f007804e570 con 0x7f00880671f0 2023-10-06T03:01:34.685 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.679+0000 7f008e345700 1 -- 172.21.15.57:0/4154084062 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f008806d470 con 0x7f00880671f0 2023-10-06T03:01:34.685 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.679+0000 7f0084ff9700 1 -- 172.21.15.57:0/4154084062 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4594 (secure 0 0 0) 0x7f0078051b90 con 0x7f00880671f0 2023-10-06T03:01:34.686 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:01:34.686 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6834/1042131376","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":1042131376},{"type":"v1","addr":"172.21.15.105:6834","nonce":1042131376}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4287,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6836/3619570714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":3619570714},{"type":"v1","addr":"172.21.15.57:6836","nonce":3619570714}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6837/645924568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6835","nonce":645924568},{"type":"v1","addr":"172.21.15.57:6837","nonce":645924568}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:00:57.411689+0000","modified":"2023-10-06T03:01:00.999490+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4303},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4303":{"gid":4303,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6835/1286071598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":1286071598},{"type":"v1","addr":"172.21.15.105:6835","nonce":1286071598}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T03:01:34.689 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.683+0000 7f008e345700 1 -- 172.21.15.57:0/4154084062 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f0068060550 msgr2=0x7f0068062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:34.689 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.683+0000 7f008e345700 1 --2- 172.21.15.57:0/4154084062 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f0068060550 0x7f0068062a00 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f008806b680 tx=0x7f0070009040 comp rx=0 tx=0).stop 2023-10-06T03:01:34.689 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.683+0000 7f008e345700 1 -- 172.21.15.57:0/4154084062 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00880671f0 msgr2=0x7f008814ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:34.689 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.683+0000 7f008e345700 1 --2- 172.21.15.57:0/4154084062 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00880671f0 0x7f008814ccf0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f0078009f00 tx=0x7f0078017000 comp rx=0 tx=0).stop 2023-10-06T03:01:34.689 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.683+0000 7f008e345700 1 -- 172.21.15.57:0/4154084062 shutdown_connections 2023-10-06T03:01:34.689 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.683+0000 7f008e345700 1 --2- 172.21.15.57:0/4154084062 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0088150350 0x7f008816d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:34.690 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.683+0000 7f008e345700 1 --2- 172.21.15.57:0/4154084062 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f0068060550 0x7f0068062a00 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:34.690 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.683+0000 7f008e345700 1 --2- 172.21.15.57:0/4154084062 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f008806dc70 0x7f0088169d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:34.690 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.683+0000 7f008e345700 1 --2- 172.21.15.57:0/4154084062 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00880671f0 0x7f008814ccf0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:34.690 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.683+0000 7f008e345700 1 -- 172.21.15.57:0/4154084062 >> 172.21.15.57:0/4154084062 conn(0x7f00880cbdd0 msgr2=0x7f008814e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:34.690 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.683+0000 7f008e345700 1 -- 172.21.15.57:0/4154084062 shutdown_connections 2023-10-06T03:01:34.690 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.683+0000 7f008e345700 1 -- 172.21.15.57:0/4154084062 wait complete. 2023-10-06T03:01:34.691 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 8 2023-10-06T03:01:34.710 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:01:34.864 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.859+0000 7f3e4a6f0700 1 Processor -- start 2023-10-06T03:01:34.864 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.859+0000 7f3e4a6f0700 1 -- start start 2023-10-06T03:01:34.866 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.859+0000 7f3e4a6f0700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f3e440671f0 0x7f3e440675c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:34.866 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.859+0000 7f3e4a6f0700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e4415a790 con 0x7f3e44153570 2023-10-06T03:01:34.866 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.859+0000 7f3e4a6f0700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e44157810 con 0x7f3e4415a1b0 2023-10-06T03:01:34.866 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.859+0000 7f3e4a6f0700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e4415aa70 con 0x7f3e440671f0 2023-10-06T03:01:34.866 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.859+0000 7f3e3b7fe700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f3e44153570 0x7f3e44159aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:56988/0 (socket says 172.21.15.57:56988) 2023-10-06T03:01:34.866 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.859+0000 7f3e3b7fe700 1 -- 172.21.15.57:0/3348926658 learned_addr learned my addr 172.21.15.57:0/3348926658 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:01:34.868 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.863+0000 7f3e43fff700 1 --2- 172.21.15.57:0/3348926658 >> v2:172.21.15.105:3300/0 conn(0x7f3e440671f0 0x7f3e440675c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:34.868 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.863+0000 7f3e437fe700 1 -- 172.21.15.57:0/3348926658 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2264100040 0 0) 0x7f3e4415a790 con 0x7f3e44153570 2023-10-06T03:01:34.868 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.863+0000 7f3e437fe700 1 -- 172.21.15.57:0/3348926658 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e30003570 con 0x7f3e44153570 2023-10-06T03:01:34.868 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.863+0000 7f3e437fe700 1 -- 172.21.15.57:0/3348926658 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2967285814 0 0) 0x7f3e30003570 con 0x7f3e44153570 2023-10-06T03:01:34.868 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.863+0000 7f3e437fe700 1 -- 172.21.15.57:0/3348926658 >> v2:172.21.15.105:3300/0 conn(0x7f3e440671f0 msgr2=0x7f3e440675c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:34.868 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.863+0000 7f3e437fe700 1 --2- 172.21.15.57:0/3348926658 >> v2:172.21.15.105:3300/0 conn(0x7f3e440671f0 0x7f3e440675c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:34.868 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.863+0000 7f3e437fe700 1 -- 172.21.15.57:0/3348926658 >> v1:172.21.15.105:6789/0 conn(0x7f3e4415a1b0 legacy=0x7f3e441582f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:34.868 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.863+0000 7f3e437fe700 1 -- 172.21.15.57:0/3348926658 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e44157af0 con 0x7f3e44153570 2023-10-06T03:01:34.868 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.863+0000 7f3e437fe700 1 -- 172.21.15.57:0/3348926658 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2482400018 0 0) 0x7f3e2c0017f0 con 0x7f3e44153570 2023-10-06T03:01:34.868 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.863+0000 7f3e437fe700 1 -- 172.21.15.57:0/3348926658 >> v1:172.21.15.57:6789/0 conn(0x7f3e44153570 legacy=0x7f3e44159aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:34.868 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.863+0000 7f3e437fe700 1 --2- 172.21.15.57:0/3348926658 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e30003a60 0x7f3e30003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:34.869 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.863+0000 7f3e437fe700 1 --2- 172.21.15.57:0/3348926658 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3e30004810 0x7f3e30004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:34.869 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.863+0000 7f3e437fe700 1 --2- 172.21.15.57:0/3348926658 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3e300051c0 0x7f3e3000dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:34.869 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.863+0000 7f3e437fe700 1 -- 172.21.15.57:0/3348926658 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e4415aa70 con 0x7f3e30003a60 2023-10-06T03:01:34.869 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.863+0000 7f3e437fe700 1 -- 172.21.15.57:0/3348926658 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e3000e370 con 0x7f3e30004810 2023-10-06T03:01:34.869 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.863+0000 7f3e437fe700 1 -- 172.21.15.57:0/3348926658 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e3000e530 con 0x7f3e300051c0 2023-10-06T03:01:34.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.863+0000 7f3e3b7fe700 1 --2- 172.21.15.57:0/3348926658 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3e30004810 0x7f3e30004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:34.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.863+0000 7f3e43fff700 1 --2- 172.21.15.57:0/3348926658 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e30003a60 0x7f3e30003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:34.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.863+0000 7f3e48c8d700 1 --2- 172.21.15.57:0/3348926658 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3e300051c0 0x7f3e3000dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:34.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.863+0000 7f3e43fff700 1 -- 172.21.15.57:0/3348926658 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3e300051c0 msgr2=0x7f3e3000dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:34.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.863+0000 7f3e43fff700 1 --2- 172.21.15.57:0/3348926658 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3e300051c0 0x7f3e3000dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:34.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.863+0000 7f3e43fff700 1 -- 172.21.15.57:0/3348926658 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3e30004810 msgr2=0x7f3e30004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:34.871 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.863+0000 7f3e43fff700 1 --2- 172.21.15.57:0/3348926658 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3e30004810 0x7f3e30004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:34.871 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.863+0000 7f3e48c8d700 1 -- 172.21.15.57:0/3348926658 reap_dead start 2023-10-06T03:01:34.871 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.863+0000 7f3e43fff700 1 -- 172.21.15.57:0/3348926658 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e30003570 con 0x7f3e30003a60 2023-10-06T03:01:34.871 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.863+0000 7f3e3b7fe700 1 --2- 172.21.15.57:0/3348926658 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3e30004810 0x7f3e30004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:01:34.871 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.863+0000 7f3e43fff700 1 --2- 172.21.15.57:0/3348926658 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e30003a60 0x7f3e30003e70 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f3e34009c00 tx=0x7f3e340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8ab92bb0db19a4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:34.871 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.863+0000 7f3e437fe700 1 -- 172.21.15.57:0/3348926658 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e3400e710 con 0x7f3e30003a60 2023-10-06T03:01:34.871 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.863+0000 7f3e437fe700 1 -- 172.21.15.57:0/3348926658 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e3400e870 con 0x7f3e30003a60 2023-10-06T03:01:34.871 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.863+0000 7f3e437fe700 1 -- 172.21.15.57:0/3348926658 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e3400ec30 con 0x7f3e30003a60 2023-10-06T03:01:34.872 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.867+0000 7f3e4a6f0700 1 -- 172.21.15.57:0/3348926658 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e30003a60 msgr2=0x7f3e30003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:34.872 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.867+0000 7f3e4a6f0700 1 --2- 172.21.15.57:0/3348926658 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e30003a60 0x7f3e30003e70 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f3e34009c00 tx=0x7f3e340091a0 comp rx=0 tx=0).stop 2023-10-06T03:01:34.872 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.867+0000 7f3e4a6f0700 1 -- 172.21.15.57:0/3348926658 shutdown_connections 2023-10-06T03:01:34.872 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.867+0000 7f3e4a6f0700 1 --2- 172.21.15.57:0/3348926658 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e30003a60 0x7f3e30003e70 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:34.872 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.867+0000 7f3e4a6f0700 1 -- 172.21.15.57:0/3348926658 >> 172.21.15.57:0/3348926658 conn(0x7f3e440cbdd0 msgr2=0x7f3e440cc1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:34.872 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.867+0000 7f3e4a6f0700 1 -- 172.21.15.57:0/3348926658 shutdown_connections 2023-10-06T03:01:34.872 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.867+0000 7f3e4a6f0700 1 -- 172.21.15.57:0/3348926658 wait complete. 2023-10-06T03:01:34.873 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.867+0000 7f3e4a6f0700 1 Processor -- start 2023-10-06T03:01:34.874 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.867+0000 7f3e4a6f0700 1 -- start start 2023-10-06T03:01:34.876 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.871+0000 7f3e4a6f0700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e30003a60 0x7f3e4414bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:34.876 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.871+0000 7f3e4a6f0700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3e44151a20 0x7f3e44151e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:34.876 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.871+0000 7f3e4a6f0700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3e44154300 0x7f3e44154770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:34.876 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.871+0000 7f3e4a6f0700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e44155c20 con 0x7f3e30003a60 2023-10-06T03:01:34.876 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.871+0000 7f3e4a6f0700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e44150490 con 0x7f3e44151a20 2023-10-06T03:01:34.876 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.871+0000 7f3e4a6f0700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e441523d0 con 0x7f3e44154300 2023-10-06T03:01:34.876 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.871+0000 7f3e43fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e30003a60 0x7f3e4414bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:34.876 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.871+0000 7f3e43fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e30003a60 0x7f3e4414bd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60514/0 (socket says 172.21.15.57:60514) 2023-10-06T03:01:34.876 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.871+0000 7f3e43fff700 1 -- 172.21.15.57:0/2392226583 learned_addr learned my addr 172.21.15.57:0/2392226583 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:34.878 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.871+0000 7f3e3b7fe700 1 --2- 172.21.15.57:0/2392226583 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3e44151a20 0x7f3e44151e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:34.878 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.871+0000 7f3e48c8d700 1 --2- 172.21.15.57:0/2392226583 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3e44154300 0x7f3e44154770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:34.878 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.871+0000 7f3e43fff700 1 -- 172.21.15.57:0/2392226583 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3e44154300 msgr2=0x7f3e44154770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:34.878 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.871+0000 7f3e43fff700 1 --2- 172.21.15.57:0/2392226583 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3e44154300 0x7f3e44154770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:34.878 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.871+0000 7f3e43fff700 1 -- 172.21.15.57:0/2392226583 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3e44151a20 msgr2=0x7f3e44151e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:34.878 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.871+0000 7f3e43fff700 1 --2- 172.21.15.57:0/2392226583 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3e44151a20 0x7f3e44151e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:34.878 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.871+0000 7f3e43fff700 1 -- 172.21.15.57:0/2392226583 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e4414c250 con 0x7f3e30003a60 2023-10-06T03:01:34.878 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.871+0000 7f3e43fff700 1 --2- 172.21.15.57:0/2392226583 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e30003a60 0x7f3e4414bd10 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f3e3400e4b0 tx=0x7f3e3401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:34.878 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.871+0000 7f3e40ff9700 1 -- 172.21.15.57:0/2392226583 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e34022070 con 0x7f3e30003a60 2023-10-06T03:01:34.878 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.871+0000 7f3e40ff9700 1 -- 172.21.15.57:0/2392226583 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e3400e9e0 con 0x7f3e30003a60 2023-10-06T03:01:34.879 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.871+0000 7f3e4a6f0700 1 -- 172.21.15.57:0/2392226583 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e44154fa0 con 0x7f3e30003a60 2023-10-06T03:01:34.879 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.871+0000 7f3e40ff9700 1 -- 172.21.15.57:0/2392226583 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e340276a0 con 0x7f3e30003a60 2023-10-06T03:01:34.879 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.871+0000 7f3e4a6f0700 1 -- 172.21.15.57:0/2392226583 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e44155560 con 0x7f3e30003a60 2023-10-06T03:01:34.880 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.875+0000 7f3e4a6f0700 1 -- 172.21.15.57:0/2392226583 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e440aba10 con 0x7f3e30003a60 2023-10-06T03:01:34.881 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.875+0000 7f3e40ff9700 1 -- 172.21.15.57:0/2392226583 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f3e3401c450 con 0x7f3e30003a60 2023-10-06T03:01:34.883 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.879+0000 7f3e40ff9700 1 --2- 172.21.15.57:0/2392226583 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f3e24060580 0x7f3e24062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:34.883 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.879+0000 7f3e40ff9700 1 -- 172.21.15.57:0/2392226583 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3e3407e470 con 0x7f3e30003a60 2023-10-06T03:01:34.883 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.879+0000 7f3e3b7fe700 1 --2- 172.21.15.57:0/2392226583 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f3e24060580 0x7f3e24062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:34.884 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.879+0000 7f3e3b7fe700 1 --2- 172.21.15.57:0/2392226583 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f3e24060580 0x7f3e24062a30 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3e440c8210 tx=0x7f3e2c006040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:34.889 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:34.883+0000 7f3e40ff9700 1 -- 172.21.15.57:0/2392226583 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f3e3404e860 con 0x7f3e30003a60 2023-10-06T03:01:35.061 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.055+0000 7f3e4a6f0700 1 -- 172.21.15.57:0/2392226583 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3e440ca800 con 0x7f3e30003a60 2023-10-06T03:01:35.063 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.059+0000 7f3e40ff9700 1 -- 172.21.15.57:0/2392226583 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16866 (secure 0 0 0) 0x7f3e440ca800 con 0x7f3e30003a60 2023-10-06T03:01:35.064 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:01:35.064 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":23,"fsid":"eb56dc0f-9213-41cb-9aad-8ade6c802e98","created":"2023-10-06T03:00:30.806197+0000","modified":"2023-10-06T03:00:58.975366+0000","last_up_change":"2023-10-06T03:00:43.607454+0000","last_in_change":"2023-10-06T03:00:33.943513+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T03:00:44.360651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T03:00:50.466601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:00:55.472586+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T03:00:56.400884+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"58cf6c90-d704-43e0-b2db-dffe526d5e8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":33053},{"type":"v1","addr":"172.21.15.57:6801","nonce":33053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":33053},{"type":"v1","addr":"172.21.15.57:6803","nonce":33053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":33053},{"type":"v1","addr":"172.21.15.57:6807","nonce":33053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":33053},{"type":"v1","addr":"172.21.15.57:6805","nonce":33053}]},"public_addr":"172.21.15.57:6801/33053","cluster_addr":"172.21.15.57:6803/33053","heartbeat_back_addr":"172.21.15.57:6807/33053","heartbeat_front_addr":"172.21.15.57:6805/33053","state":["exists","up"]},{"osd":1,"uuid":"16afbe70-7f9e-4568-9c92-763e6e348119","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6809","nonce":33052},{"type":"v1","addr":"172.21.15.57:6810","nonce":33052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":33052},{"type":"v1","addr":"172.21.15.57:6813","nonce":33052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":33052},{"type":"v1","addr":"172.21.15.57:6822","nonce":33052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6815","nonce":33052},{"type":"v1","addr":"172.21.15.57:6818","nonce":33052}]},"public_addr":"172.21.15.57:6810/33052","cluster_addr":"172.21.15.57:6813/33052","heartbeat_back_addr":"172.21.15.57:6822/33052","heartbeat_front_addr":"172.21.15.57:6818/33052","state":["exists","up"]},{"osd":2,"uuid":"7255c62e-f92f-470f-a5ce-30228920d9f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":33058},{"type":"v1","addr":"172.21.15.57:6825","nonce":33058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":33058},{"type":"v1","addr":"172.21.15.57:6827","nonce":33058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":33058},{"type":"v1","addr":"172.21.15.57:6831","nonce":33058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":33058},{"type":"v1","addr":"172.21.15.57:6829","nonce":33058}]},"public_addr":"172.21.15.57:6825/33058","cluster_addr":"172.21.15.57:6827/33058","heartbeat_back_addr":"172.21.15.57:6831/33058","heartbeat_front_addr":"172.21.15.57:6829/33058","state":["exists","up"]},{"osd":3,"uuid":"152a236d-f799-4888-8544-74865508d5a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":33057},{"type":"v1","addr":"172.21.15.57:6811","nonce":33057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":33057},{"type":"v1","addr":"172.21.15.57:6816","nonce":33057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6821","nonce":33057},{"type":"v1","addr":"172.21.15.57:6823","nonce":33057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6817","nonce":33057},{"type":"v1","addr":"172.21.15.57:6819","nonce":33057}]},"public_addr":"172.21.15.57:6811/33057","cluster_addr":"172.21.15.57:6816/33057","heartbeat_back_addr":"172.21.15.57:6823/33057","heartbeat_front_addr":"172.21.15.57:6819/33057","state":["exists","up"]},{"osd":4,"uuid":"37db2a65-3566-41d0-9d60-e66c49e1e68e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":33368},{"type":"v1","addr":"172.21.15.105:6801","nonce":33368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":33368},{"type":"v1","addr":"172.21.15.105:6803","nonce":33368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":33368},{"type":"v1","addr":"172.21.15.105:6807","nonce":33368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":33368},{"type":"v1","addr":"172.21.15.105:6805","nonce":33368}]},"public_addr":"172.21.15.105:6801/33368","cluster_addr":"172.21.15.105:6803/33368","heartbeat_back_addr":"172.21.15.105:6807/33368","heartbeat_front_addr":"172.21.15.105:6805/33368","state":["exists","up"]},{"osd":5,"uuid":"35e77918-1bb4-42ca-9b20-f3c14eaa0c04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":33379},{"type":"v1","addr":"172.21.15.105:6818","nonce":33379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":33379},{"type":"v1","addr":"172.21.15.105:6823","nonce":33379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":33379},{"type":"v1","addr":"172.21.15.105:6831","nonce":33379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":33379},{"type":"v1","addr":"172.21.15.105:6827","nonce":33379}]},"public_addr":"172.21.15.105:6818/33379","cluster_addr":"172.21.15.105:6823/33379","heartbeat_back_addr":"172.21.15.105:6831/33379","heartbeat_front_addr":"172.21.15.105:6827/33379","state":["exists","up"]},{"osd":6,"uuid":"b4d9d510-7a45-4173-8287-c6c8d6547f2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":33369},{"type":"v1","addr":"172.21.15.105:6819","nonce":33369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":33369},{"type":"v1","addr":"172.21.15.105:6822","nonce":33369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":33369},{"type":"v1","addr":"172.21.15.105:6830","nonce":33369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":33369},{"type":"v1","addr":"172.21.15.105:6826","nonce":33369}]},"public_addr":"172.21.15.105:6819/33369","cluster_addr":"172.21.15.105:6822/33369","heartbeat_back_addr":"172.21.15.105:6830/33369","heartbeat_front_addr":"172.21.15.105:6826/33369","state":["exists","up"]},{"osd":7,"uuid":"74266fb0-cd84-463f-8bf0-092652a71dc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":33370},{"type":"v1","addr":"172.21.15.105:6809","nonce":33370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":33370},{"type":"v1","addr":"172.21.15.105:6811","nonce":33370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":33370},{"type":"v1","addr":"172.21.15.105:6815","nonce":33370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":33370},{"type":"v1","addr":"172.21.15.105:6813","nonce":33370}]},"public_addr":"172.21.15.105:6809/33370","cluster_addr":"172.21.15.105:6811/33370","heartbeat_back_addr":"172.21.15.105:6815/33370","heartbeat_front_addr":"172.21.15.105:6813/33370","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.596864+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.633851+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.636993+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.529681+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.608601+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.659752+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.661717+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.642221+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:01:35.066 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.059+0000 7f3e4a6f0700 1 -- 172.21.15.57:0/2392226583 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f3e24060580 msgr2=0x7f3e24062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:35.066 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.059+0000 7f3e4a6f0700 1 --2- 172.21.15.57:0/2392226583 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f3e24060580 0x7f3e24062a30 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3e440c8210 tx=0x7f3e2c006040 comp rx=0 tx=0).stop 2023-10-06T03:01:35.066 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.059+0000 7f3e4a6f0700 1 -- 172.21.15.57:0/2392226583 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e30003a60 msgr2=0x7f3e4414bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:35.067 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.059+0000 7f3e4a6f0700 1 --2- 172.21.15.57:0/2392226583 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e30003a60 0x7f3e4414bd10 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f3e3400e4b0 tx=0x7f3e3401a000 comp rx=0 tx=0).stop 2023-10-06T03:01:35.067 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.059+0000 7f3e4a6f0700 1 -- 172.21.15.57:0/2392226583 shutdown_connections 2023-10-06T03:01:35.067 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.059+0000 7f3e4a6f0700 1 --2- 172.21.15.57:0/2392226583 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f3e24060580 0x7f3e24062a30 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:35.067 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.059+0000 7f3e4a6f0700 1 --2- 172.21.15.57:0/2392226583 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3e44154300 0x7f3e44154770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:35.067 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.059+0000 7f3e4a6f0700 1 --2- 172.21.15.57:0/2392226583 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3e44151a20 0x7f3e44151e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:35.067 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.059+0000 7f3e4a6f0700 1 --2- 172.21.15.57:0/2392226583 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e30003a60 0x7f3e4414bd10 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:35.068 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.059+0000 7f3e4a6f0700 1 -- 172.21.15.57:0/2392226583 >> 172.21.15.57:0/2392226583 conn(0x7f3e440cbdd0 msgr2=0x7f3e44151250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:35.068 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.059+0000 7f3e4a6f0700 1 -- 172.21.15.57:0/2392226583 shutdown_connections 2023-10-06T03:01:35.068 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.059+0000 7f3e4a6f0700 1 -- 172.21.15.57:0/2392226583 wait complete. 2023-10-06T03:01:35.087 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T03:01:35.252 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.247+0000 7f2e28785700 1 Processor -- start 2023-10-06T03:01:35.252 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.247+0000 7f2e28785700 1 -- start start 2023-10-06T03:01:35.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.247+0000 7f2e28785700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e20158ec0 0x7f2e2006d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:35.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.247+0000 7f2e28785700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2e20159290 0x7f2e200b00d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:35.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.247+0000 7f2e28785700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e2006d320 con 0x7f2e2006dcf0 2023-10-06T03:01:35.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.247+0000 7f2e28785700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e200cb8f0 con 0x7f2e20159290 2023-10-06T03:01:35.255 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.247+0000 7f2e28785700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e2006ccd0 con 0x7f2e20158ec0 2023-10-06T03:01:35.255 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.251+0000 7f2e26d22700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2e20159290 0x7f2e200b00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:35.255 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.251+0000 7f2e26521700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e20158ec0 0x7f2e2006d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:35.255 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.251+0000 7f2e25d20700 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f2e2006dcf0 0x7f2e200cc880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.57:39818/0 (socket says 172.21.15.57:39818) 2023-10-06T03:01:35.256 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.251+0000 7f2e26d22700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2e20159290 0x7f2e200b00d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60516/0 (socket says 172.21.15.57:60516) 2023-10-06T03:01:35.256 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.251+0000 7f2e25d20700 1 -- 172.21.15.57:0/2959153377 learned_addr learned my addr 172.21.15.57:0/2959153377 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:01:35.256 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.251+0000 7f2e26d22700 1 -- 172.21.15.57:0/2959153377 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e20158ec0 msgr2=0x7f2e2006d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:35.256 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.251+0000 7f2e26d22700 1 --2- 172.21.15.57:0/2959153377 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e20158ec0 0x7f2e2006d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:35.256 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.251+0000 7f2e26d22700 1 -- 172.21.15.57:0/2959153377 >> v1:172.21.15.105:6789/0 conn(0x7f2e2006dcf0 legacy=0x7f2e200cc880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:35.257 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.251+0000 7f2e26d22700 1 -- 172.21.15.57:0/2959153377 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e2006cfb0 con 0x7f2e20159290 2023-10-06T03:01:35.257 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.251+0000 7f2e26d22700 1 --2- 172.21.15.57:0/2959153377 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2e20159290 0x7f2e200b00d0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f2e18009e60 tx=0x7f2e18009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eef4cb5ed6d82db5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:35.257 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.251+0000 7f2e2551f700 1 -- 172.21.15.57:0/2959153377 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e1800e070 con 0x7f2e20159290 2023-10-06T03:01:35.257 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.251+0000 7f2e2551f700 1 -- 172.21.15.57:0/2959153377 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e1800bb60 con 0x7f2e20159290 2023-10-06T03:01:35.257 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.251+0000 7f2e2551f700 1 -- 172.21.15.57:0/2959153377 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e18012430 con 0x7f2e20159290 2023-10-06T03:01:35.258 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.251+0000 7f2e28785700 1 -- 172.21.15.57:0/2959153377 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2e20159290 msgr2=0x7f2e200b00d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:35.258 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.251+0000 7f2e28785700 1 --2- 172.21.15.57:0/2959153377 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2e20159290 0x7f2e200b00d0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f2e18009e60 tx=0x7f2e18009780 comp rx=0 tx=0).stop 2023-10-06T03:01:35.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.255+0000 7f2e28785700 1 -- 172.21.15.57:0/2959153377 shutdown_connections 2023-10-06T03:01:35.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.255+0000 7f2e28785700 1 --2- 172.21.15.57:0/2959153377 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2e20159290 0x7f2e200b00d0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:35.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.255+0000 7f2e28785700 1 --2- 172.21.15.57:0/2959153377 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e20158ec0 0x7f2e2006d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:35.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.255+0000 7f2e28785700 1 -- 172.21.15.57:0/2959153377 >> 172.21.15.57:0/2959153377 conn(0x7f2e20067050 msgr2=0x7f2e20067450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:35.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.255+0000 7f2e28785700 1 -- 172.21.15.57:0/2959153377 shutdown_connections 2023-10-06T03:01:35.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.255+0000 7f2e28785700 1 -- 172.21.15.57:0/2959153377 wait complete. 2023-10-06T03:01:35.262 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.255+0000 7f2e28785700 1 Processor -- start 2023-10-06T03:01:35.262 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.255+0000 7f2e28785700 1 -- start start 2023-10-06T03:01:35.264 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.259+0000 7f2e28785700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2e2006dcf0 0x7f2e2014a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:35.264 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.259+0000 7f2e28785700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e20158ec0 0x7f2e200c9620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:35.264 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.259+0000 7f2e28785700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2e20159290 0x7f2e200c9b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:35.264 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.259+0000 7f2e28785700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e200c3aa0 con 0x7f2e20159290 2023-10-06T03:01:35.264 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.259+0000 7f2e28785700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e200c3d80 con 0x7f2e2006dcf0 2023-10-06T03:01:35.264 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.259+0000 7f2e28785700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e200c4060 con 0x7f2e20158ec0 2023-10-06T03:01:35.264 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.259+0000 7f2e26d22700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2e20159290 0x7f2e200c9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:35.264 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.259+0000 7f2e26d22700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2e20159290 0x7f2e200c9b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60530/0 (socket says 172.21.15.57:60530) 2023-10-06T03:01:35.264 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.259+0000 7f2e26d22700 1 -- 172.21.15.57:0/3357308019 learned_addr learned my addr 172.21.15.57:0/3357308019 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:35.264 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.259+0000 7f2e26521700 1 --2- 172.21.15.57:0/3357308019 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2e2006dcf0 0x7f2e2014a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:35.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.259+0000 7f2e25d20700 1 --2- 172.21.15.57:0/3357308019 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e20158ec0 0x7f2e200c9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:35.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.259+0000 7f2e26d22700 1 -- 172.21.15.57:0/3357308019 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e20158ec0 msgr2=0x7f2e200c9620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:35.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.259+0000 7f2e26d22700 1 --2- 172.21.15.57:0/3357308019 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e20158ec0 0x7f2e200c9620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:35.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.259+0000 7f2e26d22700 1 -- 172.21.15.57:0/3357308019 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2e2006dcf0 msgr2=0x7f2e2014a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:35.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.259+0000 7f2e26d22700 1 --2- 172.21.15.57:0/3357308019 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2e2006dcf0 0x7f2e2014a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:35.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.259+0000 7f2e26d22700 1 -- 172.21.15.57:0/3357308019 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e18009a20 con 0x7f2e20159290 2023-10-06T03:01:35.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.259+0000 7f2e25d20700 1 --2- 172.21.15.57:0/3357308019 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e20158ec0 0x7f2e200c9620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:35.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.259+0000 7f2e26d22700 1 --2- 172.21.15.57:0/3357308019 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2e20159290 0x7f2e200c9b60 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f2e200cfed0 tx=0x7f2e18019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:35.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.259+0000 7f2e167fc700 1 -- 172.21.15.57:0/3357308019 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e18027470 con 0x7f2e20159290 2023-10-06T03:01:35.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.259+0000 7f2e167fc700 1 -- 172.21.15.57:0/3357308019 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e180275f0 con 0x7f2e20159290 2023-10-06T03:01:35.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.259+0000 7f2e28785700 1 -- 172.21.15.57:0/3357308019 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e200c4340 con 0x7f2e20159290 2023-10-06T03:01:35.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.259+0000 7f2e167fc700 1 -- 172.21.15.57:0/3357308019 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e180279b0 con 0x7f2e20159290 2023-10-06T03:01:35.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.259+0000 7f2e28785700 1 -- 172.21.15.57:0/3357308019 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e200c4900 con 0x7f2e20159290 2023-10-06T03:01:35.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.263+0000 7f2e28785700 1 -- 172.21.15.57:0/3357308019 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e200c4b20 con 0x7f2e20159290 2023-10-06T03:01:35.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.263+0000 7f2e167fc700 1 -- 172.21.15.57:0/3357308019 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f2e18024070 con 0x7f2e20159290 2023-10-06T03:01:35.270 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.263+0000 7f2e167fc700 1 --2- 172.21.15.57:0/3357308019 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f2e04060550 0x7f2e04062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:35.270 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.267+0000 7f2e167fc700 1 -- 172.21.15.57:0/3357308019 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2e1807f380 con 0x7f2e20159290 2023-10-06T03:01:35.271 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.267+0000 7f2e26521700 1 --2- 172.21.15.57:0/3357308019 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f2e04060550 0x7f2e04062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:35.272 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.267+0000 7f2e26521700 1 --2- 172.21.15.57:0/3357308019 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f2e04060550 0x7f2e04062a00 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c009db0 tx=0x7f2e1c0091a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:35.278 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.271+0000 7f2e167fc700 1 -- 172.21.15.57:0/3357308019 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f2e1804f770 con 0x7f2e20159290 2023-10-06T03:01:35.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.479+0000 7f2e28785700 1 -- 172.21.15.57:0/3357308019 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f2e2004be40 con 0x7f2e20159290 2023-10-06T03:01:35.487 INFO:tasks.ceph.mon.a.smithi057.stderr:2023-10-06T03:01:35.483+0000 7f3ec61a3700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T03:01:35.498 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.491+0000 7f2e167fc700 1 -- 172.21.15.57:0/3357308019 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7f2e18052d90 con 0x7f2e20159290 2023-10-06T03:01:35.503 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.499+0000 7f2e28785700 1 -- 172.21.15.57:0/3357308019 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f2e04060550 msgr2=0x7f2e04062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:35.503 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.499+0000 7f2e28785700 1 --2- 172.21.15.57:0/3357308019 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f2e04060550 0x7f2e04062a00 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c009db0 tx=0x7f2e1c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:01:35.503 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.499+0000 7f2e28785700 1 -- 172.21.15.57:0/3357308019 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2e20159290 msgr2=0x7f2e200c9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:35.503 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.499+0000 7f2e28785700 1 --2- 172.21.15.57:0/3357308019 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2e20159290 0x7f2e200c9b60 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f2e200cfed0 tx=0x7f2e18019000 comp rx=0 tx=0).stop 2023-10-06T03:01:35.504 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.499+0000 7f2e28785700 1 -- 172.21.15.57:0/3357308019 shutdown_connections 2023-10-06T03:01:35.504 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.499+0000 7f2e28785700 1 --2- 172.21.15.57:0/3357308019 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2e20159290 0x7f2e200c9b60 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:35.504 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.499+0000 7f2e28785700 1 --2- 172.21.15.57:0/3357308019 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f2e04060550 0x7f2e04062a00 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:35.504 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.499+0000 7f2e28785700 1 --2- 172.21.15.57:0/3357308019 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e20158ec0 0x7f2e200c9620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:35.504 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.499+0000 7f2e28785700 1 --2- 172.21.15.57:0/3357308019 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2e2006dcf0 0x7f2e2014a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:35.504 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.499+0000 7f2e28785700 1 -- 172.21.15.57:0/3357308019 >> 172.21.15.57:0/3357308019 conn(0x7f2e20067050 msgr2=0x7f2e2006aeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:35.504 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.499+0000 7f2e28785700 1 -- 172.21.15.57:0/3357308019 shutdown_connections 2023-10-06T03:01:35.504 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.499+0000 7f2e28785700 1 -- 172.21.15.57:0/3357308019 wait complete. 2023-10-06T03:01:35.505 INFO:teuthology.orchestra.run.smithi057.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T03:01:35.505 INFO:tasks.ceph.mds.b.smithi105.stderr: -1791> 2023-10-06T03:01:03.069+0000 7fb6a4521700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T03:01:35.521 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-06T03:01:35.553 INFO:tasks.ceph.mds.b.smithi105.stdout:starting mds.b at 2023-10-06T03:01:35.686 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.679+0000 7f120759e700 1 Processor -- start 2023-10-06T03:01:35.687 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.683+0000 7f120759e700 1 -- start start 2023-10-06T03:01:35.691 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.683+0000 7f120759e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f12080ae240 0x7f12080ca1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:35.691 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.683+0000 7f120759e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f12080ca710 0x7f1208067820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:35.692 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.683+0000 7f120759e700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f120806cc70 con 0x7f1208067d60 2023-10-06T03:01:35.692 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.683+0000 7f120759e700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12080cab40 con 0x7f12080ae240 2023-10-06T03:01:35.692 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.683+0000 7f120759e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12080ae610 con 0x7f12080ca710 2023-10-06T03:01:35.692 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.683+0000 7f120659c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f12080ae240 0x7f12080ca1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:35.692 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.683+0000 7f120659c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f12080ae240 0x7f12080ca1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60546/0 (socket says 172.21.15.57:60546) 2023-10-06T03:01:35.692 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.683+0000 7f120659c700 1 -- 172.21.15.57:0/987179756 learned_addr learned my addr 172.21.15.57:0/987179756 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:35.692 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.683+0000 7f1205d9b700 1 --2- 172.21.15.57:0/987179756 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f12080ca710 0x7f1208067820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:35.693 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.687+0000 7f120659c700 1 -- 172.21.15.57:0/987179756 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f12080ca710 msgr2=0x7f1208067820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:35.693 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.687+0000 7f120659c700 1 --2- 172.21.15.57:0/987179756 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f12080ca710 0x7f1208067820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:35.693 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.687+0000 7f120659c700 1 -- 172.21.15.57:0/987179756 >> v1:172.21.15.105:6789/0 conn(0x7f1208067d60 legacy=0x7f120806d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:35.693 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.687+0000 7f120659c700 1 -- 172.21.15.57:0/987179756 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f120806c920 con 0x7f12080ae240 2023-10-06T03:01:35.693 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.687+0000 7f120659c700 1 --2- 172.21.15.57:0/987179756 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f12080ae240 0x7f12080ca1d0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f11f80099b0 tx=0x7f11f8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d723bec07af51250 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:35.695 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.687+0000 7f120559a700 1 -- 172.21.15.57:0/987179756 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f800b860 con 0x7f12080ae240 2023-10-06T03:01:35.696 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.687+0000 7f120559a700 1 -- 172.21.15.57:0/987179756 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11f800b9c0 con 0x7f12080ae240 2023-10-06T03:01:35.696 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.687+0000 7f120559a700 1 -- 172.21.15.57:0/987179756 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f800bd60 con 0x7f12080ae240 2023-10-06T03:01:35.696 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.687+0000 7f120759e700 1 -- 172.21.15.57:0/987179756 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f12080ae240 msgr2=0x7f12080ca1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:35.696 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.687+0000 7f120759e700 1 --2- 172.21.15.57:0/987179756 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f12080ae240 0x7f12080ca1d0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f11f80099b0 tx=0x7f11f8009250 comp rx=0 tx=0).stop 2023-10-06T03:01:35.696 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.687+0000 7f120759e700 1 -- 172.21.15.57:0/987179756 shutdown_connections 2023-10-06T03:01:35.696 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.687+0000 7f120759e700 1 --2- 172.21.15.57:0/987179756 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f12080ca710 0x7f1208067820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:35.697 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.687+0000 7f120759e700 1 --2- 172.21.15.57:0/987179756 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f12080ae240 0x7f12080ca1d0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:35.697 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.687+0000 7f120759e700 1 -- 172.21.15.57:0/987179756 >> 172.21.15.57:0/987179756 conn(0x7f12080c8660 msgr2=0x7f12080c8a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:35.697 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.687+0000 7f120759e700 1 -- 172.21.15.57:0/987179756 shutdown_connections 2023-10-06T03:01:35.697 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.687+0000 7f120759e700 1 -- 172.21.15.57:0/987179756 wait complete. 2023-10-06T03:01:35.697 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.691+0000 7f120759e700 1 Processor -- start 2023-10-06T03:01:35.697 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.691+0000 7f120759e700 1 -- start start 2023-10-06T03:01:35.700 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.691+0000 7f120759e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1208067d60 0x7f1208155170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:35.700 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.691+0000 7f120759e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f12080ae240 0x7f12080c2290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:35.700 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.691+0000 7f120759e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f12080ca710 0x7f1208159b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:35.700 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.691+0000 7f120759e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f120814d2b0 con 0x7f12080ca710 2023-10-06T03:01:35.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.691+0000 7f120759e700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12080b0830 con 0x7f12080ae240 2023-10-06T03:01:35.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.691+0000 7f120759e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12081556b0 con 0x7f1208067d60 2023-10-06T03:01:35.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.691+0000 7f1206d9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f12080ca710 0x7f1208159b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:35.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.691+0000 7f1206d9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f12080ca710 0x7f1208159b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60558/0 (socket says 172.21.15.57:60558) 2023-10-06T03:01:35.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.691+0000 7f1206d9d700 1 -- 172.21.15.57:0/2331273123 learned_addr learned my addr 172.21.15.57:0/2331273123 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:35.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.691+0000 7f1205d9b700 1 --2- 172.21.15.57:0/2331273123 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f12080ae240 0x7f12080c2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:35.702 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.691+0000 7f120659c700 1 --2- 172.21.15.57:0/2331273123 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1208067d60 0x7f1208155170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:35.702 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.691+0000 7f1206d9d700 1 -- 172.21.15.57:0/2331273123 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1208067d60 msgr2=0x7f1208155170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:35.702 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.691+0000 7f1206d9d700 1 --2- 172.21.15.57:0/2331273123 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1208067d60 0x7f1208155170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:35.702 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.691+0000 7f1206d9d700 1 -- 172.21.15.57:0/2331273123 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f12080ae240 msgr2=0x7f12080c2290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:35.702 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.691+0000 7f1206d9d700 1 --2- 172.21.15.57:0/2331273123 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f12080ae240 0x7f12080c2290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:35.702 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.691+0000 7f1206d9d700 1 -- 172.21.15.57:0/2331273123 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11f80094f0 con 0x7f12080ca710 2023-10-06T03:01:35.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.695+0000 7f1206d9d700 1 --2- 172.21.15.57:0/2331273123 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f12080ca710 0x7f1208159b70 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f120000c840 tx=0x7f1200001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:35.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.695+0000 7f11f67fc700 1 -- 172.21.15.57:0/2331273123 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1200012630 con 0x7f12080ca710 2023-10-06T03:01:35.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.695+0000 7f11f67fc700 1 -- 172.21.15.57:0/2331273123 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12000127b0 con 0x7f12080ca710 2023-10-06T03:01:35.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.695+0000 7f11f67fc700 1 -- 172.21.15.57:0/2331273123 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1200012b70 con 0x7f12080ca710 2023-10-06T03:01:35.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.695+0000 7f120759e700 1 -- 172.21.15.57:0/2331273123 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f120814dc70 con 0x7f12080ca710 2023-10-06T03:01:35.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.695+0000 7f120759e700 1 -- 172.21.15.57:0/2331273123 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12080b0d90 con 0x7f12080ca710 2023-10-06T03:01:35.705 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.695+0000 7f120759e700 1 -- 172.21.15.57:0/2331273123 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f120804be40 con 0x7f12080ca710 2023-10-06T03:01:35.705 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.699+0000 7f11f67fc700 1 -- 172.21.15.57:0/2331273123 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f1200003030 con 0x7f12080ca710 2023-10-06T03:01:35.705 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.699+0000 7f11f67fc700 1 --2- 172.21.15.57:0/2331273123 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f11e8060550 0x7f11e8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:35.705 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.699+0000 7f11f67fc700 1 -- 172.21.15.57:0/2331273123 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6144+0+0 (secure 0 0 0) 0x7f120007c8d0 con 0x7f12080ca710 2023-10-06T03:01:35.705 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.699+0000 7f120659c700 1 --2- 172.21.15.57:0/2331273123 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f11e8060550 0x7f11e8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:35.706 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.699+0000 7f120659c700 1 --2- 172.21.15.57:0/2331273123 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f11e8060550 0x7f11e8062a00 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f11f80099b0 tx=0x7f11f8017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:35.711 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.707+0000 7f11f67fc700 1 -- 172.21.15.57:0/2331273123 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f120004ccd0 con 0x7f12080ca710 2023-10-06T03:01:35.919 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:35.915+0000 7f120759e700 1 -- 172.21.15.57:0/2331273123 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f1208068550 con 0x7f12080ca710 2023-10-06T03:01:36.500 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:36.495+0000 7f11f67fc700 1 -- 172.21.15.57:0/2331273123 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7f12000502f0 con 0x7f12080ca710 2023-10-06T03:01:36.505 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:36.499+0000 7f120759e700 1 -- 172.21.15.57:0/2331273123 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f11e8060550 msgr2=0x7f11e8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:36.505 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:36.499+0000 7f120759e700 1 --2- 172.21.15.57:0/2331273123 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f11e8060550 0x7f11e8062a00 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f11f80099b0 tx=0x7f11f8017000 comp rx=0 tx=0).stop 2023-10-06T03:01:36.505 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:36.499+0000 7f120759e700 1 -- 172.21.15.57:0/2331273123 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f12080ca710 msgr2=0x7f1208159b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:36.505 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:36.499+0000 7f120759e700 1 --2- 172.21.15.57:0/2331273123 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f12080ca710 0x7f1208159b70 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f120000c840 tx=0x7f1200001670 comp rx=0 tx=0).stop 2023-10-06T03:01:36.505 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:36.499+0000 7f120759e700 1 -- 172.21.15.57:0/2331273123 shutdown_connections 2023-10-06T03:01:36.505 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:36.499+0000 7f120759e700 1 --2- 172.21.15.57:0/2331273123 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f12080ca710 0x7f1208159b70 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:36.505 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:36.499+0000 7f120759e700 1 --2- 172.21.15.57:0/2331273123 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f12080ae240 0x7f12080c2290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:36.505 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:36.499+0000 7f120759e700 1 --2- 172.21.15.57:0/2331273123 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f11e8060550 0x7f11e8062a00 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:36.505 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:36.499+0000 7f120759e700 1 --2- 172.21.15.57:0/2331273123 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1208067d60 0x7f1208155170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:36.506 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:36.499+0000 7f120759e700 1 -- 172.21.15.57:0/2331273123 >> 172.21.15.57:0/2331273123 conn(0x7f12080c8660 msgr2=0x7f12080c6ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:36.506 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:36.499+0000 7f120759e700 1 -- 172.21.15.57:0/2331273123 shutdown_connections 2023-10-06T03:01:36.506 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:36.499+0000 7f120759e700 1 -- 172.21.15.57:0/2331273123 wait complete. 2023-10-06T03:01:36.527 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-06T03:01:36.699 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:36.695+0000 7f0b72fc5700 1 Processor -- start 2023-10-06T03:01:36.700 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:36.695+0000 7f0b72fc5700 1 -- start start 2023-10-06T03:01:36.704 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:36.699+0000 7f0b72fc5700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f0b6c0cb0f0 0x7f0b6c1591f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:36.704 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:36.699+0000 7f0b72fc5700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b6c0cecd0 con 0x7f0b6c067280 2023-10-06T03:01:36.704 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:36.699+0000 7f0b72fc5700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b6c0cb510 con 0x7f0b6c067650 2023-10-06T03:01:36.704 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:36.699+0000 7f0b72fc5700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b6c0cb7b0 con 0x7f0b6c0cb0f0 2023-10-06T03:01:36.705 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:36.699+0000 7f0b70d61700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f0b6c067280 0x7f0b6c06d680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:56996/0 (socket says 172.21.15.57:56996) 2023-10-06T03:01:36.705 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:36.699+0000 7f0b70d61700 1 -- 172.21.15.57:0/972094015 learned_addr learned my addr 172.21.15.57:0/972094015 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:01:36.705 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:36.699+0000 7f0b71562700 1 --2- 172.21.15.57:0/972094015 >> v2:172.21.15.105:3300/0 conn(0x7f0b6c0cb0f0 0x7f0b6c1591f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:36.706 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:36.699+0000 7f0b6b7fe700 1 -- 172.21.15.57:0/972094015 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1710100191 0 0) 0x7f0b6c0cecd0 con 0x7f0b6c067280 2023-10-06T03:01:36.706 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:36.699+0000 7f0b6b7fe700 1 -- 172.21.15.57:0/972094015 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b5c003570 con 0x7f0b6c067280 2023-10-06T03:01:36.706 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:36.699+0000 7f0b6b7fe700 1 -- 172.21.15.57:0/972094015 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1332216695 0 0) 0x7f0b6c0cb510 con 0x7f0b6c067650 2023-10-06T03:01:36.706 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:36.699+0000 7f0b6b7fe700 1 -- 172.21.15.57:0/972094015 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b6c0cecd0 con 0x7f0b6c067650 2023-10-06T03:01:36.706 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:36.699+0000 7f0b71562700 1 -- 172.21.15.57:0/972094015 >> v1:172.21.15.105:6789/0 conn(0x7f0b6c067650 legacy=0x7f0b6c158ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:36.707 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:36.699+0000 7f0b71562700 1 -- 172.21.15.57:0/972094015 >> v1:172.21.15.57:6789/0 conn(0x7f0b6c067280 legacy=0x7f0b6c06d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:36.707 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:36.699+0000 7f0b71562700 1 -- 172.21.15.57:0/972094015 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b6c0cba90 con 0x7f0b6c0cb0f0 2023-10-06T03:01:36.707 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:36.703+0000 7f0b71562700 1 --2- 172.21.15.57:0/972094015 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0b6c0cb0f0 0x7f0b6c1591f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f0b64009e60 tx=0x7f0b64009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=16491c89dabd3667 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:36.708 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:36.703+0000 7f0b6b7fe700 1 -- 172.21.15.57:0/972094015 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b6400e070 con 0x7f0b6c0cb0f0 2023-10-06T03:01:36.708 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:36.703+0000 7f0b6b7fe700 1 -- 172.21.15.57:0/972094015 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b6400bab0 con 0x7f0b6c0cb0f0 2023-10-06T03:01:36.708 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:36.703+0000 7f0b6b7fe700 1 -- 172.21.15.57:0/972094015 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b6400be70 con 0x7f0b6c0cb0f0 2023-10-06T03:01:36.709 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:36.703+0000 7f0b72fc5700 1 -- 172.21.15.57:0/972094015 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0b6c0cb0f0 msgr2=0x7f0b6c1591f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:36.709 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:36.703+0000 7f0b72fc5700 1 --2- 172.21.15.57:0/972094015 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0b6c0cb0f0 0x7f0b6c1591f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f0b64009e60 tx=0x7f0b64009780 comp rx=0 tx=0).stop 2023-10-06T03:01:36.709 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:36.703+0000 7f0b72fc5700 1 -- 172.21.15.57:0/972094015 shutdown_connections 2023-10-06T03:01:36.709 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:36.703+0000 7f0b72fc5700 1 --2- 172.21.15.57:0/972094015 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0b6c0cb0f0 0x7f0b6c1591f0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:36.709 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:36.703+0000 7f0b72fc5700 1 -- 172.21.15.57:0/972094015 >> 172.21.15.57:0/972094015 conn(0x7f0b6c0d0bc0 msgr2=0x7f0b6c0ccb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:36.709 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:36.703+0000 7f0b72fc5700 1 -- 172.21.15.57:0/972094015 shutdown_connections 2023-10-06T03:01:36.709 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:36.703+0000 7f0b72fc5700 1 -- 172.21.15.57:0/972094015 wait complete. 2023-10-06T03:01:36.711 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:36.707+0000 7f0b72fc5700 1 Processor -- start 2023-10-06T03:01:36.712 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:36.707+0000 7f0b72fc5700 1 -- start start 2023-10-06T03:01:36.714 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:36.707+0000 7f0b72fc5700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0b6c067280 0x7f0b6c148d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:36.714 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:36.707+0000 7f0b72fc5700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0b6c067650 0x7f0b6c0afa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:36.714 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:36.707+0000 7f0b72fc5700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b6c0cb0f0 0x7f0b6c1576e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:36.714 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:36.707+0000 7f0b72fc5700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6c169780 con 0x7f0b6c0cb0f0 2023-10-06T03:01:36.714 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:36.707+0000 7f0b72fc5700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6c1492c0 con 0x7f0b6c067650 2023-10-06T03:01:36.714 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:36.707+0000 7f0b72fc5700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6c0b04a0 con 0x7f0b6c067280 2023-10-06T03:01:36.715 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:36.707+0000 7f0b71562700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b6c0cb0f0 0x7f0b6c1576e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:36.715 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:36.707+0000 7f0b71562700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b6c0cb0f0 0x7f0b6c1576e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60570/0 (socket says 172.21.15.57:60570) 2023-10-06T03:01:36.716 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:36.711+0000 7f0b71562700 1 -- 172.21.15.57:0/3888919613 learned_addr learned my addr 172.21.15.57:0/3888919613 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:36.716 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:36.711+0000 7f0b70d61700 1 --2- 172.21.15.57:0/3888919613 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0b6c067280 0x7f0b6c148d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:36.716 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:36.711+0000 7f0b6bfff700 1 --2- 172.21.15.57:0/3888919613 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0b6c067650 0x7f0b6c0afa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:36.716 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:36.711+0000 7f0b71562700 1 -- 172.21.15.57:0/3888919613 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0b6c067280 msgr2=0x7f0b6c148d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:36.716 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:36.711+0000 7f0b71562700 1 --2- 172.21.15.57:0/3888919613 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0b6c067280 0x7f0b6c148d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:36.716 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:36.711+0000 7f0b71562700 1 -- 172.21.15.57:0/3888919613 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0b6c067650 msgr2=0x7f0b6c0afa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:36.716 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:36.711+0000 7f0b71562700 1 --2- 172.21.15.57:0/3888919613 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0b6c067650 0x7f0b6c0afa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:36.716 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:36.711+0000 7f0b71562700 1 -- 172.21.15.57:0/3888919613 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b64009a20 con 0x7f0b6c0cb0f0 2023-10-06T03:01:36.716 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:36.711+0000 7f0b6bfff700 1 --2- 172.21.15.57:0/3888919613 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0b6c067650 0x7f0b6c0afa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:36.717 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:36.711+0000 7f0b71562700 1 --2- 172.21.15.57:0/3888919613 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b6c0cb0f0 0x7f0b6c1576e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f0b6c069e90 tx=0x7f0b64019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:36.717 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:36.711+0000 7f0b68ff9700 1 -- 172.21.15.57:0/3888919613 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b64012e80 con 0x7f0b6c0cb0f0 2023-10-06T03:01:36.717 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:36.711+0000 7f0b68ff9700 1 -- 172.21.15.57:0/3888919613 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b64026480 con 0x7f0b6c0cb0f0 2023-10-06T03:01:36.717 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:36.711+0000 7f0b68ff9700 1 -- 172.21.15.57:0/3888919613 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b64026820 con 0x7f0b6c0cb0f0 2023-10-06T03:01:36.717 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:36.711+0000 7f0b72fc5700 1 -- 172.21.15.57:0/3888919613 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b6c0b0780 con 0x7f0b6c0cb0f0 2023-10-06T03:01:36.718 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:36.711+0000 7f0b72fc5700 1 -- 172.21.15.57:0/3888919613 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b6c0b0e10 con 0x7f0b6c0cb0f0 2023-10-06T03:01:36.719 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:36.715+0000 7f0b72fc5700 1 -- 172.21.15.57:0/3888919613 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b6c0712e0 con 0x7f0b6c0cb0f0 2023-10-06T03:01:36.720 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:36.715+0000 7f0b68ff9700 1 -- 172.21.15.57:0/3888919613 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f0b6401c400 con 0x7f0b6c0cb0f0 2023-10-06T03:01:36.722 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:36.715+0000 7f0b68ff9700 1 --2- 172.21.15.57:0/3888919613 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f0b50060550 0x7f0b50062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:36.722 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:36.715+0000 7f0b68ff9700 1 -- 172.21.15.57:0/3888919613 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6144+0+0 (secure 0 0 0) 0x7f0b6407ead0 con 0x7f0b6c0cb0f0 2023-10-06T03:01:36.723 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:36.719+0000 7f0b70d61700 1 --2- 172.21.15.57:0/3888919613 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f0b50060550 0x7f0b50062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:36.723 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:36.719+0000 7f0b70d61700 1 --2- 172.21.15.57:0/3888919613 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f0b50060550 0x7f0b50062a00 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0b60007fd0 tx=0x7f0b60009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:36.727 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:36.723+0000 7f0b68ff9700 1 -- 172.21.15.57:0/3888919613 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f0b6404ee90 con 0x7f0b6c0cb0f0 2023-10-06T03:01:36.906 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:36.899+0000 7f0b72fc5700 1 -- 172.21.15.57:0/3888919613 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f0b6c0cbd70 con 0x7f0b6c0cb0f0 2023-10-06T03:01:37.843 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:37.839+0000 7f0b68ff9700 1 -- 172.21.15.57:0/3888919613 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v26) v1 ==== 181+0+0 (secure 0 0 0) 0x7f0b640524b0 con 0x7f0b6c0cb0f0 2023-10-06T03:01:37.850 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:37.843+0000 7f0b72fc5700 1 -- 172.21.15.57:0/3888919613 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f0b50060550 msgr2=0x7f0b50062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:37.850 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:37.843+0000 7f0b72fc5700 1 --2- 172.21.15.57:0/3888919613 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f0b50060550 0x7f0b50062a00 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0b60007fd0 tx=0x7f0b60009040 comp rx=0 tx=0).stop 2023-10-06T03:01:37.850 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:37.843+0000 7f0b72fc5700 1 -- 172.21.15.57:0/3888919613 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b6c0cb0f0 msgr2=0x7f0b6c1576e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:37.850 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:37.843+0000 7f0b72fc5700 1 --2- 172.21.15.57:0/3888919613 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b6c0cb0f0 0x7f0b6c1576e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f0b6c069e90 tx=0x7f0b64019000 comp rx=0 tx=0).stop 2023-10-06T03:01:37.851 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:37.843+0000 7f0b72fc5700 1 -- 172.21.15.57:0/3888919613 shutdown_connections 2023-10-06T03:01:37.851 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:37.843+0000 7f0b72fc5700 1 --2- 172.21.15.57:0/3888919613 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b6c0cb0f0 0x7f0b6c1576e0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:37.851 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:37.843+0000 7f0b72fc5700 1 --2- 172.21.15.57:0/3888919613 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0b6c067650 0x7f0b6c0afa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:37.851 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:37.843+0000 7f0b72fc5700 1 --2- 172.21.15.57:0/3888919613 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f0b50060550 0x7f0b50062a00 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:37.851 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:37.843+0000 7f0b72fc5700 1 --2- 172.21.15.57:0/3888919613 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0b6c067280 0x7f0b6c148d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:37.851 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:37.843+0000 7f0b72fc5700 1 -- 172.21.15.57:0/3888919613 >> 172.21.15.57:0/3888919613 conn(0x7f0b6c0d0bc0 msgr2=0x7f0b6c0ce250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:37.851 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:37.847+0000 7f0b72fc5700 1 -- 172.21.15.57:0/3888919613 shutdown_connections 2023-10-06T03:01:37.853 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:37.847+0000 7f0b72fc5700 1 -- 172.21.15.57:0/3888919613 wait complete. 2023-10-06T03:01:37.857 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_metadata' removed 2023-10-06T03:01:37.874 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-06T03:01:38.042 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:38.035+0000 7fd48e68e700 1 Processor -- start 2023-10-06T03:01:38.043 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:38.039+0000 7fd48e68e700 1 -- start start 2023-10-06T03:01:38.047 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:38.039+0000 7fd48e68e700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fd488156880 0x7fd488159f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:38.047 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:38.043+0000 7fd48e68e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd48806be50 0x7fd4880ce7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:38.047 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:38.043+0000 7fd48e68e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4880cb090 con 0x7fd48815cb00 2023-10-06T03:01:38.047 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:38.043+0000 7fd48e68e700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4880cc600 con 0x7fd48806be50 2023-10-06T03:01:38.047 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:38.043+0000 7fd48e68e700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd48815a4c0 con 0x7fd488156880 2023-10-06T03:01:38.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:38.043+0000 7fd48de8d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd48806be50 0x7fd4880ce7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:38.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:38.043+0000 7fd48ce8b700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fd48815cb00 0x7fd48806b740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:57010/0 (socket says 172.21.15.57:57010) 2023-10-06T03:01:38.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:38.043+0000 7fd48ce8b700 1 -- 172.21.15.57:0/3731894011 learned_addr learned my addr 172.21.15.57:0/3731894011 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:01:38.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:38.043+0000 7fd48d68c700 1 --2- 172.21.15.57:0/3731894011 >> v2:172.21.15.105:3300/0 conn(0x7fd488156880 0x7fd488159f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:38.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:38.043+0000 7fd48de8d700 1 -- 172.21.15.57:0/3731894011 >> v2:172.21.15.105:3300/0 conn(0x7fd488156880 msgr2=0x7fd488159f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:38.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:38.043+0000 7fd48de8d700 1 --2- 172.21.15.57:0/3731894011 >> v2:172.21.15.105:3300/0 conn(0x7fd488156880 0x7fd488159f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:38.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:38.043+0000 7fd48de8d700 1 -- 172.21.15.57:0/3731894011 >> v1:172.21.15.57:6789/0 conn(0x7fd48815cb00 legacy=0x7fd48806b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:38.049 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:38.043+0000 7fd48de8d700 1 -- 172.21.15.57:0/3731894011 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd48815cf90 con 0x7fd48806be50 2023-10-06T03:01:38.049 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:38.043+0000 7fd47ffff700 1 -- 172.21.15.57:0/3731894011 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 953213026 0 0) 0x7fd4880cb090 con 0x7fd48815cb00 2023-10-06T03:01:38.049 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:38.043+0000 7fd48d68c700 1 --2- 172.21.15.57:0/3731894011 >> v2:172.21.15.105:3300/0 conn(0x7fd488156880 0x7fd488159f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:38.049 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:38.043+0000 7fd48de8d700 1 --2- 172.21.15.57:0/3731894011 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd48806be50 0x7fd4880ce7e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fd4880695c0 tx=0x7fd480009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c7a9e3f5a6d91e7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:38.049 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:38.043+0000 7fd47ffff700 1 -- 172.21.15.57:0/3731894011 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd48000e070 con 0x7fd48806be50 2023-10-06T03:01:38.050 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:38.043+0000 7fd47ffff700 1 -- 172.21.15.57:0/3731894011 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd48000bc30 con 0x7fd48806be50 2023-10-06T03:01:38.050 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:38.043+0000 7fd47ffff700 1 -- 172.21.15.57:0/3731894011 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd480012430 con 0x7fd48806be50 2023-10-06T03:01:38.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:38.043+0000 7fd48e68e700 1 -- 172.21.15.57:0/3731894011 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd48806be50 msgr2=0x7fd4880ce7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:38.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:38.043+0000 7fd48e68e700 1 --2- 172.21.15.57:0/3731894011 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd48806be50 0x7fd4880ce7e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fd4880695c0 tx=0x7fd480009780 comp rx=0 tx=0).stop 2023-10-06T03:01:38.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:38.043+0000 7fd48e68e700 1 -- 172.21.15.57:0/3731894011 shutdown_connections 2023-10-06T03:01:38.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:38.043+0000 7fd48e68e700 1 --2- 172.21.15.57:0/3731894011 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd48806be50 0x7fd4880ce7e0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:38.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:38.043+0000 7fd48e68e700 1 --2- 172.21.15.57:0/3731894011 >> v2:172.21.15.105:3300/0 conn(0x7fd488156880 0x7fd488159f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:38.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:38.043+0000 7fd48e68e700 1 -- 172.21.15.57:0/3731894011 >> 172.21.15.57:0/3731894011 conn(0x7fd4880cc9b0 msgr2=0x7fd4880ccdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:38.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:38.047+0000 7fd48e68e700 1 -- 172.21.15.57:0/3731894011 shutdown_connections 2023-10-06T03:01:38.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:38.047+0000 7fd48e68e700 1 -- 172.21.15.57:0/3731894011 wait complete. 2023-10-06T03:01:38.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:38.047+0000 7fd48e68e700 1 Processor -- start 2023-10-06T03:01:38.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:38.047+0000 7fd48e68e700 1 -- start start 2023-10-06T03:01:38.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:38.051+0000 7fd48e68e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd48806be50 0x7fd4880c9e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:38.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:38.051+0000 7fd48e68e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd488156880 0x7fd488155a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:38.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:38.051+0000 7fd48e68e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd48815cb00 0x7fd488157450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:38.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:38.051+0000 7fd48e68e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd488156fc0 con 0x7fd48815cb00 2023-10-06T03:01:38.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:38.051+0000 7fd48e68e700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4880ca380 con 0x7fd488156880 2023-10-06T03:01:38.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:38.051+0000 7fd48e68e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd488158ec0 con 0x7fd48806be50 2023-10-06T03:01:38.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:38.051+0000 7fd48de8d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd48815cb00 0x7fd488157450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:38.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:38.051+0000 7fd48de8d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd48815cb00 0x7fd488157450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60580/0 (socket says 172.21.15.57:60580) 2023-10-06T03:01:38.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:38.051+0000 7fd48de8d700 1 -- 172.21.15.57:0/2495982895 learned_addr learned my addr 172.21.15.57:0/2495982895 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:38.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:38.051+0000 7fd48d68c700 1 --2- 172.21.15.57:0/2495982895 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd48806be50 0x7fd4880c9e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:38.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:38.051+0000 7fd48ce8b700 1 --2- 172.21.15.57:0/2495982895 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd488156880 0x7fd488155a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:38.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:38.051+0000 7fd48de8d700 1 -- 172.21.15.57:0/2495982895 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd48806be50 msgr2=0x7fd4880c9e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:38.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:38.051+0000 7fd48de8d700 1 --2- 172.21.15.57:0/2495982895 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd48806be50 0x7fd4880c9e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:38.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:38.051+0000 7fd48de8d700 1 -- 172.21.15.57:0/2495982895 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd488156880 msgr2=0x7fd488155a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:38.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:38.051+0000 7fd48de8d700 1 --2- 172.21.15.57:0/2495982895 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd488156880 0x7fd488155a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:38.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:38.051+0000 7fd48de8d700 1 -- 172.21.15.57:0/2495982895 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd480009a20 con 0x7fd48815cb00 2023-10-06T03:01:38.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:38.051+0000 7fd48d68c700 1 --2- 172.21.15.57:0/2495982895 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd48806be50 0x7fd4880c9e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:38.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:38.051+0000 7fd48de8d700 1 --2- 172.21.15.57:0/2495982895 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd48815cb00 0x7fd488157450 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fd4880cd810 tx=0x7fd480019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:38.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:38.051+0000 7fd47d7fa700 1 -- 172.21.15.57:0/2495982895 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd480027470 con 0x7fd48815cb00 2023-10-06T03:01:38.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:38.051+0000 7fd47d7fa700 1 -- 172.21.15.57:0/2495982895 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4800275d0 con 0x7fd48815cb00 2023-10-06T03:01:38.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:38.051+0000 7fd48e68e700 1 -- 172.21.15.57:0/2495982895 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4881591a0 con 0x7fd48815cb00 2023-10-06T03:01:38.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:38.051+0000 7fd47d7fa700 1 -- 172.21.15.57:0/2495982895 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd480027990 con 0x7fd48815cb00 2023-10-06T03:01:38.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:38.051+0000 7fd48e68e700 1 -- 172.21.15.57:0/2495982895 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd488156c50 con 0x7fd48815cb00 2023-10-06T03:01:38.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:38.055+0000 7fd48e68e700 1 -- 172.21.15.57:0/2495982895 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd488157170 con 0x7fd48815cb00 2023-10-06T03:01:38.061 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:38.055+0000 7fd47d7fa700 1 -- 172.21.15.57:0/2495982895 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fd480024070 con 0x7fd48815cb00 2023-10-06T03:01:38.062 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:38.059+0000 7fd47d7fa700 1 --2- 172.21.15.57:0/2495982895 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fd46c060600 0x7fd46c062ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:38.063 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:38.059+0000 7fd47d7fa700 1 -- 172.21.15.57:0/2495982895 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 5764+0+0 (secure 0 0 0) 0x7fd48007f000 con 0x7fd48815cb00 2023-10-06T03:01:38.063 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:38.059+0000 7fd48d68c700 1 --2- 172.21.15.57:0/2495982895 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fd46c060600 0x7fd46c062ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:38.064 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:38.059+0000 7fd48d68c700 1 --2- 172.21.15.57:0/2495982895 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fd46c060600 0x7fd46c062ab0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd484006f00 tx=0x7fd484008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:38.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:38.063+0000 7fd47d7fa700 1 -- 172.21.15.57:0/2495982895 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fd488157170 con 0x7fd48815cb00 2023-10-06T03:01:38.239 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:38.235+0000 7fd48e68e700 1 -- 172.21.15.57:0/2495982895 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd48804be40 con 0x7fd48815cb00 2023-10-06T03:01:38.875 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:38.871+0000 7fd47d7fa700 1 -- 172.21.15.57:0/2495982895 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v27) v1 ==== 169+0+0 (secure 0 0 0) 0x7fd48002c0d0 con 0x7fd48815cb00 2023-10-06T03:01:38.879 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:38.875+0000 7fd48e68e700 1 -- 172.21.15.57:0/2495982895 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fd46c060600 msgr2=0x7fd46c062ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:38.879 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:38.875+0000 7fd48e68e700 1 --2- 172.21.15.57:0/2495982895 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fd46c060600 0x7fd46c062ab0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd484006f00 tx=0x7fd484008040 comp rx=0 tx=0).stop 2023-10-06T03:01:38.879 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:38.875+0000 7fd48e68e700 1 -- 172.21.15.57:0/2495982895 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd48815cb00 msgr2=0x7fd488157450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:38.879 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:38.875+0000 7fd48e68e700 1 --2- 172.21.15.57:0/2495982895 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd48815cb00 0x7fd488157450 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fd4880cd810 tx=0x7fd480019000 comp rx=0 tx=0).stop 2023-10-06T03:01:38.880 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:38.875+0000 7fd48e68e700 1 -- 172.21.15.57:0/2495982895 shutdown_connections 2023-10-06T03:01:38.880 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:38.875+0000 7fd48e68e700 1 --2- 172.21.15.57:0/2495982895 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd48815cb00 0x7fd488157450 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:38.880 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:38.875+0000 7fd48e68e700 1 --2- 172.21.15.57:0/2495982895 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd488156880 0x7fd488155a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:38.880 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:38.875+0000 7fd48e68e700 1 --2- 172.21.15.57:0/2495982895 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fd46c060600 0x7fd46c062ab0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:38.880 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:38.875+0000 7fd48e68e700 1 --2- 172.21.15.57:0/2495982895 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd48806be50 0x7fd4880c9e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:38.880 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:38.875+0000 7fd48e68e700 1 -- 172.21.15.57:0/2495982895 >> 172.21.15.57:0/2495982895 conn(0x7fd4880cc9b0 msgr2=0x7fd488067c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:38.880 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:38.875+0000 7fd48e68e700 1 -- 172.21.15.57:0/2495982895 shutdown_connections 2023-10-06T03:01:38.881 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:38.875+0000 7fd48e68e700 1 -- 172.21.15.57:0/2495982895 wait complete. 2023-10-06T03:01:38.881 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_data' removed 2023-10-06T03:01:38.900 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-06T03:01:38.901 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-06T03:01:38.901 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-06T03:01:38.901 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:01:38.901 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-06T03:01:38.901 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-06T03:01:38.901 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-06T03:01:38.902 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:01:38.902 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-06T03:01:38.902 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-06T03:01:38.902 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-06T03:01:38.902 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:01:38.902 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-06T03:01:38.902 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-06T03:01:38.903 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-06T03:01:38.903 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:01:38.919 INFO:tasks.ceph.mds.a:Stopped 2023-10-06T03:01:38.919 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-06T03:01:38.921 INFO:tasks.ceph.mds.c:Stopped 2023-10-06T03:01:38.921 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-06T03:01:38.922 INFO:tasks.ceph.mds.d:Stopped 2023-10-06T03:01:38.922 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-06T03:01:38.923 INFO:tasks.ceph.mds.b:Stopped 2023-10-06T03:01:38.923 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-06T03:01:38.968 INFO:tasks.ceph.mds.a:Started 2023-10-06T03:01:38.969 DEBUG:teuthology.parallel:result is None 2023-10-06T03:01:38.971 INFO:tasks.ceph.mds.d:Started 2023-10-06T03:01:38.971 DEBUG:teuthology.parallel:result is None 2023-10-06T03:01:38.975 INFO:tasks.ceph.mds.c:Started 2023-10-06T03:01:38.975 DEBUG:teuthology.parallel:result is None 2023-10-06T03:01:38.976 INFO:tasks.ceph.mds.b:Started 2023-10-06T03:01:38.977 DEBUG:teuthology.parallel:result is None 2023-10-06T03:01:38.977 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-06T03:01:39.076 INFO:tasks.ceph.mds.a.smithi057.stdout:starting mds.a at 2023-10-06T03:01:39.078 INFO:tasks.ceph.mds.c.smithi057.stdout:starting mds.c at 2023-10-06T03:01:39.085 INFO:tasks.ceph.mds.b.smithi105.stdout:starting mds.b at 2023-10-06T03:01:39.086 INFO:tasks.ceph.mds.d.smithi105.stdout:starting mds.d at 2023-10-06T03:01:39.137 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:39.131+0000 7fcfa9d45700 1 Processor -- start 2023-10-06T03:01:39.137 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:39.131+0000 7fcfa9d45700 1 -- start start 2023-10-06T03:01:39.140 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:39.135+0000 7fcfa9d45700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fcfa4156d60 0x7fcfa406d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:39.141 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:39.135+0000 7fcfa9d45700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfa406d250 con 0x7fcfa415a510 2023-10-06T03:01:39.141 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:39.135+0000 7fcfa9d45700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfa4067af0 con 0x7fcfa40c6c40 2023-10-06T03:01:39.141 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:39.135+0000 7fcfa9d45700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfa406c920 con 0x7fcfa4156d60 2023-10-06T03:01:39.142 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:39.135+0000 7fcfa37fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fcfa4156d60 0x7fcfa406d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:39.142 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:39.135+0000 7fcfa37fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fcfa4156d60 0x7fcfa406d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60608/0 (socket says 172.21.15.57:60608) 2023-10-06T03:01:39.142 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:39.135+0000 7fcfa37fe700 1 -- 172.21.15.57:0/2217568928 learned_addr learned my addr 172.21.15.57:0/2217568928 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:39.142 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:39.139+0000 7fcfa37fe700 1 -- 172.21.15.57:0/2217568928 >> v1:172.21.15.105:6789/0 conn(0x7fcfa40c6c40 legacy=0x7fcfa40c70e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:39.143 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:39.139+0000 7fcfa37fe700 1 -- 172.21.15.57:0/2217568928 >> v1:172.21.15.57:6789/0 conn(0x7fcfa415a510 legacy=0x7fcfa4067050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:39.143 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:39.139+0000 7fcfa27fc700 1 -- 172.21.15.57:0/2217568928 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3262735485 0 0) 0x7fcfa4067af0 con 0x7fcfa40c6c40 2023-10-06T03:01:39.143 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:39.139+0000 7fcfa37fe700 1 -- 172.21.15.57:0/2217568928 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfa406cc00 con 0x7fcfa4156d60 2023-10-06T03:01:39.143 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:39.139+0000 7fcfa37fe700 1 --2- 172.21.15.57:0/2217568928 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcfa4156d60 0x7fcfa406d6e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fcf940099b0 tx=0x7fcf94009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fe557ebd44af9a7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:39.144 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:39.139+0000 7fcfa27fc700 1 -- 172.21.15.57:0/2217568928 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf9400b760 con 0x7fcfa4156d60 2023-10-06T03:01:39.144 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:39.139+0000 7fcfa27fc700 1 -- 172.21.15.57:0/2217568928 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf9400b8c0 con 0x7fcfa4156d60 2023-10-06T03:01:39.144 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:39.139+0000 7fcfa27fc700 1 -- 172.21.15.57:0/2217568928 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf9400bc60 con 0x7fcfa4156d60 2023-10-06T03:01:39.145 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:39.139+0000 7fcfa9d45700 1 -- 172.21.15.57:0/2217568928 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcfa4156d60 msgr2=0x7fcfa406d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:39.145 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:39.139+0000 7fcfa9d45700 1 --2- 172.21.15.57:0/2217568928 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcfa4156d60 0x7fcfa406d6e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fcf940099b0 tx=0x7fcf94009250 comp rx=0 tx=0).stop 2023-10-06T03:01:39.145 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:39.139+0000 7fcfa9d45700 1 -- 172.21.15.57:0/2217568928 shutdown_connections 2023-10-06T03:01:39.145 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:39.139+0000 7fcfa9d45700 1 --2- 172.21.15.57:0/2217568928 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcfa4156d60 0x7fcfa406d6e0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:39.146 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:39.139+0000 7fcfa9d45700 1 -- 172.21.15.57:0/2217568928 >> 172.21.15.57:0/2217568928 conn(0x7fcfa40cbc90 msgr2=0x7fcfa40cc090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:39.146 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:39.139+0000 7fcfa9d45700 1 -- 172.21.15.57:0/2217568928 shutdown_connections 2023-10-06T03:01:39.146 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:39.139+0000 7fcfa9d45700 1 -- 172.21.15.57:0/2217568928 wait complete. 2023-10-06T03:01:39.149 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:39.143+0000 7fcfa9d45700 1 Processor -- start 2023-10-06T03:01:39.149 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:39.143+0000 7fcfa9d45700 1 -- start start 2023-10-06T03:01:39.150 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:39.147+0000 7fcfa9d45700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcfa40c6c40 0x7fcfa4154330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:39.151 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:39.147+0000 7fcfa9d45700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcfa4156d60 0x7fcfa415dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:39.151 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:39.147+0000 7fcfa9d45700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcfa415a510 0x7fcfa415e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:39.151 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:39.147+0000 7fcfa9d45700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa40a98c0 con 0x7fcfa415a510 2023-10-06T03:01:39.151 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:39.147+0000 7fcfa9d45700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa4154870 con 0x7fcfa4156d60 2023-10-06T03:01:39.151 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:39.147+0000 7fcfa9d45700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa40acdf0 con 0x7fcfa40c6c40 2023-10-06T03:01:39.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:39.147+0000 7fcfa3fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcfa415a510 0x7fcfa415e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:39.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:39.147+0000 7fcfa37fe700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcfa40c6c40 0x7fcfa4154330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:39.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:39.147+0000 7fcfa3fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcfa415a510 0x7fcfa415e250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60620/0 (socket says 172.21.15.57:60620) 2023-10-06T03:01:39.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:39.147+0000 7fcfa3fff700 1 -- 172.21.15.57:0/2285606532 learned_addr learned my addr 172.21.15.57:0/2285606532 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:39.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:39.147+0000 7fcfa2ffd700 1 --2- 172.21.15.57:0/2285606532 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcfa4156d60 0x7fcfa415dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:39.154 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:39.147+0000 7fcfa3fff700 1 -- 172.21.15.57:0/2285606532 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcfa40c6c40 msgr2=0x7fcfa4154330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:39.154 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:39.147+0000 7fcfa3fff700 1 --2- 172.21.15.57:0/2285606532 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcfa40c6c40 0x7fcfa4154330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:39.155 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:39.147+0000 7fcfa3fff700 1 -- 172.21.15.57:0/2285606532 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcfa4156d60 msgr2=0x7fcfa415dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:39.155 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:39.147+0000 7fcfa3fff700 1 --2- 172.21.15.57:0/2285606532 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcfa4156d60 0x7fcfa415dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:39.155 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:39.147+0000 7fcfa3fff700 1 -- 172.21.15.57:0/2285606532 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf940094f0 con 0x7fcfa415a510 2023-10-06T03:01:39.155 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:39.147+0000 7fcfa2ffd700 1 --2- 172.21.15.57:0/2285606532 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcfa4156d60 0x7fcfa415dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:01:39.155 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:39.147+0000 7fcfa37fe700 1 --2- 172.21.15.57:0/2285606532 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcfa40c6c40 0x7fcfa4154330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:01:39.155 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:39.147+0000 7fcfa3fff700 1 --2- 172.21.15.57:0/2285606532 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcfa415a510 0x7fcfa415e250 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fcf9c00c910 tx=0x7fcf9c001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:39.155 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:39.147+0000 7fcf8b7fe700 1 -- 172.21.15.57:0/2285606532 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf9c012630 con 0x7fcfa415a510 2023-10-06T03:01:39.155 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:39.147+0000 7fcf8b7fe700 1 -- 172.21.15.57:0/2285606532 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf9c012790 con 0x7fcfa415a510 2023-10-06T03:01:39.155 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:39.147+0000 7fcf8b7fe700 1 -- 172.21.15.57:0/2285606532 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf9c012b50 con 0x7fcfa415a510 2023-10-06T03:01:39.155 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:39.147+0000 7fcfa9d45700 1 -- 172.21.15.57:0/2285606532 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfa40a8f90 con 0x7fcfa415a510 2023-10-06T03:01:39.155 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:39.147+0000 7fcfa9d45700 1 -- 172.21.15.57:0/2285606532 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfa40a9550 con 0x7fcfa415a510 2023-10-06T03:01:39.156 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:39.151+0000 7fcfa9d45700 1 -- 172.21.15.57:0/2285606532 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfa40a9a30 con 0x7fcfa415a510 2023-10-06T03:01:39.157 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:39.151+0000 7fcf8b7fe700 1 -- 172.21.15.57:0/2285606532 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fcf9c01a3a0 con 0x7fcfa415a510 2023-10-06T03:01:39.160 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:39.155+0000 7fcf8b7fe700 1 --2- 172.21.15.57:0/2285606532 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fcf90060550 0x7fcf90062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:39.160 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:39.155+0000 7fcf8b7fe700 1 -- 172.21.15.57:0/2285606532 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fcf9c07c900 con 0x7fcfa415a510 2023-10-06T03:01:39.160 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:39.155+0000 7fcfa37fe700 1 --2- 172.21.15.57:0/2285606532 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fcf90060550 0x7fcf90062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:39.161 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:39.155+0000 7fcfa37fe700 1 --2- 172.21.15.57:0/2285606532 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fcf90060550 0x7fcf90062a00 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fcf940099b0 tx=0x7fcf94016000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:39.166 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:39.162+0000 7fcf8b7fe700 1 -- 172.21.15.57:0/2285606532 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fcf9c04cff0 con 0x7fcfa415a510 2023-10-06T03:01:39.345 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:39.338+0000 7fcfa9d45700 1 -- 172.21.15.57:0/2285606532 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fcfa404be40 con 0x7fcfa415a510 2023-10-06T03:01:39.897 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:39.890+0000 7fcf8b7fe700 1 -- 172.21.15.57:0/2285606532 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v30) v1 ==== 97+0+0 (secure 0 0 0) 0x7fcf9c050610 con 0x7fcfa415a510 2023-10-06T03:01:39.902 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:39.894+0000 7fcfa9d45700 1 -- 172.21.15.57:0/2285606532 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fcf90060550 msgr2=0x7fcf90062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:39.903 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:39.898+0000 7fcfa9d45700 1 --2- 172.21.15.57:0/2285606532 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fcf90060550 0x7fcf90062a00 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fcf940099b0 tx=0x7fcf94016000 comp rx=0 tx=0).stop 2023-10-06T03:01:39.903 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:39.898+0000 7fcfa9d45700 1 -- 172.21.15.57:0/2285606532 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcfa415a510 msgr2=0x7fcfa415e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:39.903 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:39.898+0000 7fcfa9d45700 1 --2- 172.21.15.57:0/2285606532 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcfa415a510 0x7fcfa415e250 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fcf9c00c910 tx=0x7fcf9c001710 comp rx=0 tx=0).stop 2023-10-06T03:01:39.903 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:39.898+0000 7fcfa9d45700 1 -- 172.21.15.57:0/2285606532 shutdown_connections 2023-10-06T03:01:39.903 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:39.898+0000 7fcfa9d45700 1 --2- 172.21.15.57:0/2285606532 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcfa415a510 0x7fcfa415e250 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:39.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:39.898+0000 7fcfa9d45700 1 --2- 172.21.15.57:0/2285606532 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcfa4156d60 0x7fcfa415dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:39.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:39.898+0000 7fcfa9d45700 1 --2- 172.21.15.57:0/2285606532 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fcf90060550 0x7fcf90062a00 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:39.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:39.898+0000 7fcfa9d45700 1 --2- 172.21.15.57:0/2285606532 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcfa40c6c40 0x7fcfa4154330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:39.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:39.898+0000 7fcfa9d45700 1 -- 172.21.15.57:0/2285606532 >> 172.21.15.57:0/2285606532 conn(0x7fcfa40cbc90 msgr2=0x7fcfa41560f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:39.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:39.898+0000 7fcfa9d45700 1 -- 172.21.15.57:0/2285606532 shutdown_connections 2023-10-06T03:01:39.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:39.898+0000 7fcfa9d45700 1 -- 172.21.15.57:0/2285606532 wait complete. 2023-10-06T03:01:39.905 INFO:teuthology.orchestra.run.smithi057.stderr: removed all blocklist entries 2023-10-06T03:01:39.923 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-06T03:01:40.082 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.074+0000 7fde51b63700 1 Processor -- start 2023-10-06T03:01:40.083 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.078+0000 7fde51b63700 1 -- start start 2023-10-06T03:01:40.085 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.078+0000 7fde51b63700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fde4c06dc10 0x7fde4c0cb230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:40.086 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.078+0000 7fde51b63700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fde4c0afe10 0x7fde4c0b0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:40.086 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.078+0000 7fde51b63700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde4c06c920 con 0x7fde4c0ca750 2023-10-06T03:01:40.086 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.078+0000 7fde51b63700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde4c06e0b0 con 0x7fde4c06dc10 2023-10-06T03:01:40.086 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.078+0000 7fde51b63700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde4c06d780 con 0x7fde4c0afe10 2023-10-06T03:01:40.087 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.078+0000 7fde4bfff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fde4c06dc10 0x7fde4c0cb230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:40.087 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.078+0000 7fde4bfff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fde4c06dc10 0x7fde4c0cb230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60622/0 (socket says 172.21.15.57:60622) 2023-10-06T03:01:40.087 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.078+0000 7fde4bfff700 1 -- 172.21.15.57:0/2250530816 learned_addr learned my addr 172.21.15.57:0/2250530816 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:40.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.078+0000 7fde4bfff700 1 -- 172.21.15.57:0/2250530816 >> v2:172.21.15.105:3300/0 conn(0x7fde4c0afe10 msgr2=0x7fde4c0b0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:40.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.078+0000 7fde51362700 1 --2- 172.21.15.57:0/2250530816 >> v2:172.21.15.105:3300/0 conn(0x7fde4c0afe10 0x7fde4c0b0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:40.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.082+0000 7fde4bfff700 1 --2- 172.21.15.57:0/2250530816 >> v2:172.21.15.105:3300/0 conn(0x7fde4c0afe10 0x7fde4c0b0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:40.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.082+0000 7fde4bfff700 1 -- 172.21.15.57:0/2250530816 >> v1:172.21.15.57:6789/0 conn(0x7fde4c0ca750 legacy=0x7fde4c0cab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:40.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.082+0000 7fde4bfff700 1 -- 172.21.15.57:0/2250530816 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde4c0af020 con 0x7fde4c06dc10 2023-10-06T03:01:40.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.082+0000 7fde51362700 1 --2- 172.21.15.57:0/2250530816 >> v2:172.21.15.105:3300/0 conn(0x7fde4c0afe10 0x7fde4c0b0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:01:40.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.082+0000 7fde4bfff700 1 --2- 172.21.15.57:0/2250530816 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fde4c06dc10 0x7fde4c0cb230 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fde4c0afbd0 tx=0x7fde38009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea6bf41b01222366 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:40.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.082+0000 7fde4b7fe700 1 -- 172.21.15.57:0/2250530816 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde3800b860 con 0x7fde4c06dc10 2023-10-06T03:01:40.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.082+0000 7fde4b7fe700 1 -- 172.21.15.57:0/2250530816 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde3800b9c0 con 0x7fde4c06dc10 2023-10-06T03:01:40.089 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.082+0000 7fde4b7fe700 1 -- 172.21.15.57:0/2250530816 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde3800bd60 con 0x7fde4c06dc10 2023-10-06T03:01:40.089 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.082+0000 7fde51b63700 1 -- 172.21.15.57:0/2250530816 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fde4c06dc10 msgr2=0x7fde4c0cb230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:40.090 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.082+0000 7fde51b63700 1 --2- 172.21.15.57:0/2250530816 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fde4c06dc10 0x7fde4c0cb230 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fde4c0afbd0 tx=0x7fde38009250 comp rx=0 tx=0).stop 2023-10-06T03:01:40.090 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.082+0000 7fde51b63700 1 -- 172.21.15.57:0/2250530816 shutdown_connections 2023-10-06T03:01:40.090 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.082+0000 7fde51b63700 1 --2- 172.21.15.57:0/2250530816 >> v2:172.21.15.105:3300/0 conn(0x7fde4c0afe10 0x7fde4c0b0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:40.090 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.082+0000 7fde51b63700 1 --2- 172.21.15.57:0/2250530816 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fde4c06dc10 0x7fde4c0cb230 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:40.090 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.082+0000 7fde51b63700 1 -- 172.21.15.57:0/2250530816 >> 172.21.15.57:0/2250530816 conn(0x7fde4c0cc9f0 msgr2=0x7fde4c0ccdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:40.090 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.082+0000 7fde51b63700 1 -- 172.21.15.57:0/2250530816 shutdown_connections 2023-10-06T03:01:40.090 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.082+0000 7fde51b63700 1 -- 172.21.15.57:0/2250530816 wait complete. 2023-10-06T03:01:40.091 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.086+0000 7fde51b63700 1 Processor -- start 2023-10-06T03:01:40.091 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.086+0000 7fde51b63700 1 -- start start 2023-10-06T03:01:40.093 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.086+0000 7fde51b63700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fde4c06dc10 0x7fde4c16d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:40.093 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.086+0000 7fde51b63700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fde4c0afe10 0x7fde4c0c9a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:40.093 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.086+0000 7fde51b63700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fde4c0ca750 0x7fde4c0c57a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:40.093 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.086+0000 7fde51b63700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde4c0c39a0 con 0x7fde4c06dc10 2023-10-06T03:01:40.093 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.086+0000 7fde51b63700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde4c0c54f0 con 0x7fde4c0afe10 2023-10-06T03:01:40.093 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.086+0000 7fde51b63700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde4c16de60 con 0x7fde4c0ca750 2023-10-06T03:01:40.093 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.086+0000 7fde50b61700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fde4c06dc10 0x7fde4c16d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:40.093 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.086+0000 7fde50b61700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fde4c06dc10 0x7fde4c16d920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60624/0 (socket says 172.21.15.57:60624) 2023-10-06T03:01:40.093 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.086+0000 7fde50b61700 1 -- 172.21.15.57:0/3768955198 learned_addr learned my addr 172.21.15.57:0/3768955198 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:40.095 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.086+0000 7fde50b61700 1 -- 172.21.15.57:0/3768955198 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fde4c0ca750 msgr2=0x7fde4c0c57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:40.095 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.086+0000 7fde50b61700 1 --2- 172.21.15.57:0/3768955198 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fde4c0ca750 0x7fde4c0c57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:40.095 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.086+0000 7fde50b61700 1 -- 172.21.15.57:0/3768955198 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fde4c0afe10 msgr2=0x7fde4c0c9a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:40.095 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.086+0000 7fde4bfff700 1 --2- 172.21.15.57:0/3768955198 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fde4c0afe10 0x7fde4c0c9a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:40.095 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.086+0000 7fde50b61700 1 --2- 172.21.15.57:0/3768955198 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fde4c0afe10 0x7fde4c0c9a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:40.095 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.086+0000 7fde50b61700 1 -- 172.21.15.57:0/3768955198 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde380094f0 con 0x7fde4c06dc10 2023-10-06T03:01:40.095 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.086+0000 7fde4bfff700 1 --2- 172.21.15.57:0/3768955198 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fde4c0afe10 0x7fde4c0c9a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:01:40.095 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.086+0000 7fde50b61700 1 --2- 172.21.15.57:0/3768955198 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fde4c06dc10 0x7fde4c16d920 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fde4000c4e0 tx=0x7fde4000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:40.095 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.086+0000 7fde48ff9700 1 -- 172.21.15.57:0/3768955198 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde40011590 con 0x7fde4c06dc10 2023-10-06T03:01:40.096 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.086+0000 7fde48ff9700 1 -- 172.21.15.57:0/3768955198 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde40011710 con 0x7fde4c06dc10 2023-10-06T03:01:40.096 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.086+0000 7fde51b63700 1 -- 172.21.15.57:0/3768955198 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde4c0c3bf0 con 0x7fde4c06dc10 2023-10-06T03:01:40.096 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.086+0000 7fde48ff9700 1 -- 172.21.15.57:0/3768955198 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde40011ad0 con 0x7fde4c06dc10 2023-10-06T03:01:40.096 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.086+0000 7fde51b63700 1 -- 172.21.15.57:0/3768955198 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde4c0c4490 con 0x7fde4c06dc10 2023-10-06T03:01:40.096 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.090+0000 7fde51b63700 1 -- 172.21.15.57:0/3768955198 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde4c0c3fe0 con 0x7fde4c06dc10 2023-10-06T03:01:40.097 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.090+0000 7fde48ff9700 1 -- 172.21.15.57:0/3768955198 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fde4001b3b0 con 0x7fde4c06dc10 2023-10-06T03:01:40.099 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.094+0000 7fde48ff9700 1 --2- 172.21.15.57:0/3768955198 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fde30060580 0x7fde30062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:40.099 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.094+0000 7fde48ff9700 1 -- 172.21.15.57:0/3768955198 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fde4007bbc0 con 0x7fde4c06dc10 2023-10-06T03:01:40.099 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.094+0000 7fde4bfff700 1 --2- 172.21.15.57:0/3768955198 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fde30060580 0x7fde30062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:40.100 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.094+0000 7fde4bfff700 1 --2- 172.21.15.57:0/3768955198 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fde30060580 0x7fde30062a30 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fde4c0afbd0 tx=0x7fde38017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:40.104 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.098+0000 7fde48ff9700 1 -- 172.21.15.57:0/3768955198 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fde4004c300 con 0x7fde4c06dc10 2023-10-06T03:01:40.335 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.330+0000 7fde51b63700 1 -- 172.21.15.57:0/3768955198 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fde4c04be40 con 0x7fde4c06dc10 2023-10-06T03:01:40.336 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.330+0000 7fde48ff9700 1 -- 172.21.15.57:0/3768955198 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) v1 ==== 80+0+6645 (secure 0 0 0) 0x7fde40017020 con 0x7fde4c06dc10 2023-10-06T03:01:40.336 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:01:40.336 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-10-06T03:01:40.336 INFO:teuthology.orchestra.run.smithi057.stdout: "auth_dump": [ 2023-10-06T03:01:40.336 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-10-06T03:01:40.336 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "mds.a", 2023-10-06T03:01:40.337 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQAmeB9lDqECMRAAhzW3Orr26rDBr/eQWsWeUw==", 2023-10-06T03:01:40.337 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2023-10-06T03:01:40.337 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow", 2023-10-06T03:01:40.337 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2023-10-06T03:01:40.337 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2023-10-06T03:01:40.337 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2023-10-06T03:01:40.337 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-10-06T03:01:40.337 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-06T03:01:40.337 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-10-06T03:01:40.337 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "mds.b", 2023-10-06T03:01:40.337 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQAneB9lMQOrBxAA14XFhuZexpkxXWbava72Lg==", 2023-10-06T03:01:40.337 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2023-10-06T03:01:40.338 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow", 2023-10-06T03:01:40.338 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2023-10-06T03:01:40.338 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2023-10-06T03:01:40.338 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2023-10-06T03:01:40.338 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-10-06T03:01:40.338 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-06T03:01:40.338 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-10-06T03:01:40.338 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "mds.c", 2023-10-06T03:01:40.338 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQAmeB9lfIxXOxAAMEjLV/EclZMH8LJnne8HpQ==", 2023-10-06T03:01:40.338 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2023-10-06T03:01:40.338 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow", 2023-10-06T03:01:40.338 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2023-10-06T03:01:40.339 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2023-10-06T03:01:40.339 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2023-10-06T03:01:40.339 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-10-06T03:01:40.339 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-06T03:01:40.339 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-10-06T03:01:40.339 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "mds.d", 2023-10-06T03:01:40.339 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQAneB9lxuy7ERAAhOixOLVBW+kzwcR/I2stMA==", 2023-10-06T03:01:40.339 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2023-10-06T03:01:40.339 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow", 2023-10-06T03:01:40.339 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2023-10-06T03:01:40.339 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2023-10-06T03:01:40.339 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2023-10-06T03:01:40.340 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-10-06T03:01:40.340 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-06T03:01:40.340 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-10-06T03:01:40.340 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.0", 2023-10-06T03:01:40.340 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQAueB9l1QweDRAAQOi85Hl7CxwynZ/2juWCDQ==", 2023-10-06T03:01:40.340 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2023-10-06T03:01:40.340 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow profile osd", 2023-10-06T03:01:40.340 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile osd", 2023-10-06T03:01:40.340 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2023-10-06T03:01:40.340 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-10-06T03:01:40.340 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-06T03:01:40.340 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-10-06T03:01:40.341 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.1", 2023-10-06T03:01:40.341 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQAxeB9l8TFyGhAANcAhbFzZWvou0nJxAAqB4g==", 2023-10-06T03:01:40.341 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2023-10-06T03:01:40.341 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow profile osd", 2023-10-06T03:01:40.341 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile osd", 2023-10-06T03:01:40.341 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2023-10-06T03:01:40.341 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-10-06T03:01:40.341 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-06T03:01:40.341 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-10-06T03:01:40.341 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.2", 2023-10-06T03:01:40.341 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQA0eB9lmivnJhAA+YySNbp4IJmZM+sQE3d7QA==", 2023-10-06T03:01:40.341 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2023-10-06T03:01:40.341 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow profile osd", 2023-10-06T03:01:40.342 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile osd", 2023-10-06T03:01:40.342 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2023-10-06T03:01:40.342 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-10-06T03:01:40.342 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-06T03:01:40.342 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-10-06T03:01:40.342 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.3", 2023-10-06T03:01:40.342 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQA3eB9lk0RkNBAAbD3gSyHwErEXlJUs84h15w==", 2023-10-06T03:01:40.342 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2023-10-06T03:01:40.342 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow profile osd", 2023-10-06T03:01:40.342 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile osd", 2023-10-06T03:01:40.342 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2023-10-06T03:01:40.342 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-10-06T03:01:40.343 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-06T03:01:40.343 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-10-06T03:01:40.343 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.4", 2023-10-06T03:01:40.343 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQA+eB9lAPSdEBAAKd8VkbfnUNVRzObt7KuAWA==", 2023-10-06T03:01:40.343 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2023-10-06T03:01:40.343 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow profile osd", 2023-10-06T03:01:40.343 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile osd", 2023-10-06T03:01:40.343 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2023-10-06T03:01:40.343 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-10-06T03:01:40.343 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-06T03:01:40.343 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-10-06T03:01:40.343 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.5", 2023-10-06T03:01:40.345 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQBBeB9lyBkAHxAAxDWxeDfTrM3HByhyw5sVlQ==", 2023-10-06T03:01:40.345 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2023-10-06T03:01:40.345 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow profile osd", 2023-10-06T03:01:40.345 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile osd", 2023-10-06T03:01:40.345 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2023-10-06T03:01:40.345 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-10-06T03:01:40.345 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-06T03:01:40.345 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-10-06T03:01:40.345 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.6", 2023-10-06T03:01:40.346 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQBEeB9lMveJKxAA/obatGTtFXAPoaXP7O+qbw==", 2023-10-06T03:01:40.346 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2023-10-06T03:01:40.346 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow profile osd", 2023-10-06T03:01:40.346 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile osd", 2023-10-06T03:01:40.346 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2023-10-06T03:01:40.346 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-10-06T03:01:40.346 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-06T03:01:40.346 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-10-06T03:01:40.346 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.7", 2023-10-06T03:01:40.346 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQBHeB9lePjINxAAlsT5e6FfWebTYG66oT+naw==", 2023-10-06T03:01:40.346 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2023-10-06T03:01:40.346 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow profile osd", 2023-10-06T03:01:40.347 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile osd", 2023-10-06T03:01:40.347 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2023-10-06T03:01:40.347 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-10-06T03:01:40.347 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-06T03:01:40.347 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-10-06T03:01:40.347 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "client.0", 2023-10-06T03:01:40.347 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQAneB9lXov9FxAA0z65F9trriebBUZKVxOUUA==", 2023-10-06T03:01:40.347 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2023-10-06T03:01:40.347 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow", 2023-10-06T03:01:40.347 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow r", 2023-10-06T03:01:40.347 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow rw", 2023-10-06T03:01:40.347 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow rwx" 2023-10-06T03:01:40.348 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-10-06T03:01:40.348 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-06T03:01:40.348 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-10-06T03:01:40.348 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "client.1", 2023-10-06T03:01:40.348 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQAneB9lRjCaIxAAI3gVmEJaBGQiBGfYbTOfvA==", 2023-10-06T03:01:40.348 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2023-10-06T03:01:40.348 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow", 2023-10-06T03:01:40.348 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow r", 2023-10-06T03:01:40.348 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow rw", 2023-10-06T03:01:40.348 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow rwx" 2023-10-06T03:01:40.348 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-10-06T03:01:40.348 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-06T03:01:40.348 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-10-06T03:01:40.349 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "client.2", 2023-10-06T03:01:40.349 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQAneB9lLCCVHRAA1mt8Mz7VVvX/2SyuqFq3NQ==", 2023-10-06T03:01:40.349 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2023-10-06T03:01:40.349 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow", 2023-10-06T03:01:40.349 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow r", 2023-10-06T03:01:40.349 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow rw", 2023-10-06T03:01:40.349 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow rwx" 2023-10-06T03:01:40.349 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-10-06T03:01:40.349 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-06T03:01:40.349 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-10-06T03:01:40.349 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "client.3", 2023-10-06T03:01:40.349 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQAneB9l5x/eKBAAQGb0VEfdnXA5BaUfbEJDOA==", 2023-10-06T03:01:40.350 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2023-10-06T03:01:40.350 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow", 2023-10-06T03:01:40.350 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow r", 2023-10-06T03:01:40.350 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow rw", 2023-10-06T03:01:40.350 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow rwx" 2023-10-06T03:01:40.350 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-10-06T03:01:40.350 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-06T03:01:40.350 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-10-06T03:01:40.350 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "client.admin", 2023-10-06T03:01:40.350 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQAmeB9laohwCRAA+ildmamovlX9F2Ea+EoNeA==", 2023-10-06T03:01:40.350 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2023-10-06T03:01:40.351 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow *", 2023-10-06T03:01:40.351 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2023-10-06T03:01:40.351 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2023-10-06T03:01:40.351 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2023-10-06T03:01:40.351 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-10-06T03:01:40.351 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-06T03:01:40.351 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-10-06T03:01:40.351 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "client.bootstrap-mds", 2023-10-06T03:01:40.351 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQBOeB9lzdwdMBAARLckD55okpJzItpmhlpxMg==", 2023-10-06T03:01:40.351 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2023-10-06T03:01:40.351 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile bootstrap-mds" 2023-10-06T03:01:40.351 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-10-06T03:01:40.352 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-06T03:01:40.352 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-10-06T03:01:40.352 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "client.bootstrap-mgr", 2023-10-06T03:01:40.352 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQBOeB9lOOwdMBAAG+e1ZQgk5ejTgntb8H9liQ==", 2023-10-06T03:01:40.352 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2023-10-06T03:01:40.352 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile bootstrap-mgr" 2023-10-06T03:01:40.352 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-10-06T03:01:40.352 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-06T03:01:40.352 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-10-06T03:01:40.352 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "client.bootstrap-osd", 2023-10-06T03:01:40.352 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQBOeB9lLv4dMBAAe0jEDIU3ZHZnW83rRm44bA==", 2023-10-06T03:01:40.352 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2023-10-06T03:01:40.352 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile bootstrap-osd" 2023-10-06T03:01:40.353 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-10-06T03:01:40.353 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-06T03:01:40.353 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-10-06T03:01:40.353 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "client.bootstrap-rbd", 2023-10-06T03:01:40.353 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQBOeB9l9QseMBAAhYDjRJFQ2iZBGdVCkegdrQ==", 2023-10-06T03:01:40.353 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2023-10-06T03:01:40.353 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile bootstrap-rbd" 2023-10-06T03:01:40.353 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-10-06T03:01:40.353 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-06T03:01:40.353 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-10-06T03:01:40.353 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-10-06T03:01:40.353 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQBOeB9lvBkeMBAAiRZmWG/E6a38SGTf4luvew==", 2023-10-06T03:01:40.354 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2023-10-06T03:01:40.354 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-10-06T03:01:40.354 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-10-06T03:01:40.354 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-06T03:01:40.354 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-10-06T03:01:40.354 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "client.bootstrap-rgw", 2023-10-06T03:01:40.354 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQBOeB9lcyceMBAApPgma53ILaaxf30s0wtw+Q==", 2023-10-06T03:01:40.354 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2023-10-06T03:01:40.354 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile bootstrap-rgw" 2023-10-06T03:01:40.354 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-10-06T03:01:40.354 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-06T03:01:40.354 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-10-06T03:01:40.355 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "mgr.x", 2023-10-06T03:01:40.355 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQAmeB9l9rLvKhAA/gcq8fCI3ZFihu9r1HGTlQ==", 2023-10-06T03:01:40.355 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2023-10-06T03:01:40.355 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow *", 2023-10-06T03:01:40.355 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile mgr", 2023-10-06T03:01:40.355 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2023-10-06T03:01:40.355 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-10-06T03:01:40.355 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-06T03:01:40.355 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-10-06T03:01:40.355 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "mgr.y", 2023-10-06T03:01:40.355 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQAmeB9lwOhTJRAAeQ+9At86XOHzhFNQPNQa5g==", 2023-10-06T03:01:40.355 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2023-10-06T03:01:40.356 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow *", 2023-10-06T03:01:40.356 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile mgr", 2023-10-06T03:01:40.356 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2023-10-06T03:01:40.356 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-10-06T03:01:40.356 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-10-06T03:01:40.356 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-10-06T03:01:40.356 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-10-06T03:01:40.357 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.334+0000 7fde51b63700 1 -- 172.21.15.57:0/3768955198 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fde30060580 msgr2=0x7fde30062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:40.357 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.334+0000 7fde51b63700 1 --2- 172.21.15.57:0/3768955198 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fde30060580 0x7fde30062a30 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fde4c0afbd0 tx=0x7fde38017000 comp rx=0 tx=0).stop 2023-10-06T03:01:40.357 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.334+0000 7fde51b63700 1 -- 172.21.15.57:0/3768955198 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fde4c06dc10 msgr2=0x7fde4c16d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:40.357 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.334+0000 7fde51b63700 1 --2- 172.21.15.57:0/3768955198 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fde4c06dc10 0x7fde4c16d920 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fde4000c4e0 tx=0x7fde4000c8a0 comp rx=0 tx=0).stop 2023-10-06T03:01:40.357 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.334+0000 7fde51b63700 1 -- 172.21.15.57:0/3768955198 shutdown_connections 2023-10-06T03:01:40.357 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.334+0000 7fde51b63700 1 --2- 172.21.15.57:0/3768955198 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fde30060580 0x7fde30062a30 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:40.357 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.334+0000 7fde51b63700 1 --2- 172.21.15.57:0/3768955198 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fde4c0ca750 0x7fde4c0c57a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:40.357 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.334+0000 7fde51b63700 1 --2- 172.21.15.57:0/3768955198 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fde4c0afe10 0x7fde4c0c9a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:40.357 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.334+0000 7fde51b63700 1 --2- 172.21.15.57:0/3768955198 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fde4c06dc10 0x7fde4c16d920 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:40.358 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.334+0000 7fde51b63700 1 -- 172.21.15.57:0/3768955198 >> 172.21.15.57:0/3768955198 conn(0x7fde4c0cc9f0 msgr2=0x7fde4c0ccdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:40.358 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.334+0000 7fde51b63700 1 -- 172.21.15.57:0/3768955198 shutdown_connections 2023-10-06T03:01:40.358 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.334+0000 7fde51b63700 1 -- 172.21.15.57:0/3768955198 wait complete. 2023-10-06T03:01:40.361 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-10-06T03:01:40.528 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.522+0000 7fcf9ba2e700 1 Processor -- start 2023-10-06T03:01:40.528 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.522+0000 7fcf9ba2e700 1 -- start start 2023-10-06T03:01:40.532 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.526+0000 7fcf9ba2e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fcf94158ec0 0x7fcf9406d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:40.532 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.526+0000 7fcf9ba2e700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fcf94159290 0x7fcf940b00d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:40.532 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.526+0000 7fcf9ba2e700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf9406d320 con 0x7fcf9406dcf0 2023-10-06T03:01:40.532 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.526+0000 7fcf9ba2e700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf940cb8f0 con 0x7fcf94158ec0 2023-10-06T03:01:40.532 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.526+0000 7fcf9ba2e700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf9406ccd0 con 0x7fcf94159290 2023-10-06T03:01:40.532 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.526+0000 7fcf997ca700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fcf94158ec0 0x7fcf9406d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:40.533 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.526+0000 7fcf997ca700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fcf94158ec0 0x7fcf9406d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60628/0 (socket says 172.21.15.57:60628) 2023-10-06T03:01:40.533 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.526+0000 7fcf997ca700 1 -- 172.21.15.57:0/2886903860 learned_addr learned my addr 172.21.15.57:0/2886903860 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:40.533 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.526+0000 7fcf99fcb700 1 --2- 172.21.15.57:0/2886903860 >> v2:172.21.15.105:3300/0 conn(0x7fcf94159290 0x7fcf940b00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:40.533 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.526+0000 7fcf997ca700 1 -- 172.21.15.57:0/2886903860 >> v2:172.21.15.105:3300/0 conn(0x7fcf94159290 msgr2=0x7fcf940b00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:40.534 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.526+0000 7fcf997ca700 1 --2- 172.21.15.57:0/2886903860 >> v2:172.21.15.105:3300/0 conn(0x7fcf94159290 0x7fcf940b00d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:40.534 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.526+0000 7fcf997ca700 1 -- 172.21.15.57:0/2886903860 >> v1:172.21.15.105:6789/0 conn(0x7fcf9406dcf0 legacy=0x7fcf940cc880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:40.534 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.526+0000 7fcf997ca700 1 -- 172.21.15.57:0/2886903860 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf9406cfb0 con 0x7fcf94158ec0 2023-10-06T03:01:40.534 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.526+0000 7fcf997ca700 1 --2- 172.21.15.57:0/2886903860 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcf94158ec0 0x7fcf9406d7b0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fcf940c7060 tx=0x7fcf90009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f263c2851d7e7e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:40.534 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.526+0000 7fcf8bfff700 1 -- 172.21.15.57:0/2886903860 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf9000b820 con 0x7fcf94158ec0 2023-10-06T03:01:40.535 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.526+0000 7fcf8bfff700 1 -- 172.21.15.57:0/2886903860 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf9000b980 con 0x7fcf94158ec0 2023-10-06T03:01:40.535 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.526+0000 7fcf8bfff700 1 -- 172.21.15.57:0/2886903860 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf9000bd20 con 0x7fcf94158ec0 2023-10-06T03:01:40.535 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.530+0000 7fcf9ba2e700 1 -- 172.21.15.57:0/2886903860 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcf94158ec0 msgr2=0x7fcf9406d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:40.535 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.530+0000 7fcf9ba2e700 1 --2- 172.21.15.57:0/2886903860 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcf94158ec0 0x7fcf9406d7b0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fcf940c7060 tx=0x7fcf90009250 comp rx=0 tx=0).stop 2023-10-06T03:01:40.535 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.530+0000 7fcf9ba2e700 1 -- 172.21.15.57:0/2886903860 shutdown_connections 2023-10-06T03:01:40.536 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.530+0000 7fcf9ba2e700 1 --2- 172.21.15.57:0/2886903860 >> v2:172.21.15.105:3300/0 conn(0x7fcf94159290 0x7fcf940b00d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:40.536 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.530+0000 7fcf9ba2e700 1 --2- 172.21.15.57:0/2886903860 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcf94158ec0 0x7fcf9406d7b0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:40.536 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.530+0000 7fcf9ba2e700 1 -- 172.21.15.57:0/2886903860 >> 172.21.15.57:0/2886903860 conn(0x7fcf94067050 msgr2=0x7fcf94067450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:40.536 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.530+0000 7fcf9ba2e700 1 -- 172.21.15.57:0/2886903860 shutdown_connections 2023-10-06T03:01:40.536 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.530+0000 7fcf9ba2e700 1 -- 172.21.15.57:0/2886903860 wait complete. 2023-10-06T03:01:40.538 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.530+0000 7fcf9ba2e700 1 Processor -- start 2023-10-06T03:01:40.538 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.530+0000 7fcf9ba2e700 1 -- start start 2023-10-06T03:01:40.539 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.534+0000 7fcf9ba2e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcf9406dcf0 0x7fcf94152490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:40.539 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.534+0000 7fcf9ba2e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcf94158ec0 0x7fcf94153540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:40.539 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.534+0000 7fcf9ba2e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcf94159290 0x7fcf9414f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:40.540 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.534+0000 7fcf9ba2e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf940b4ce0 con 0x7fcf9406dcf0 2023-10-06T03:01:40.540 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.534+0000 7fcf9ba2e700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf94153a80 con 0x7fcf94158ec0 2023-10-06T03:01:40.540 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.534+0000 7fcf9ba2e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf940b40d0 con 0x7fcf94159290 2023-10-06T03:01:40.541 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.534+0000 7fcf997ca700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcf9406dcf0 0x7fcf94152490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:40.541 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.534+0000 7fcf997ca700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcf9406dcf0 0x7fcf94152490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60630/0 (socket says 172.21.15.57:60630) 2023-10-06T03:01:40.541 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.534+0000 7fcf997ca700 1 -- 172.21.15.57:0/1605787693 learned_addr learned my addr 172.21.15.57:0/1605787693 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:40.541 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.534+0000 7fcf98fc9700 1 --2- 172.21.15.57:0/1605787693 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcf94158ec0 0x7fcf94153540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:40.541 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.534+0000 7fcf99fcb700 1 --2- 172.21.15.57:0/1605787693 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcf94159290 0x7fcf9414f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:40.541 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.534+0000 7fcf997ca700 1 -- 172.21.15.57:0/1605787693 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcf94159290 msgr2=0x7fcf9414f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:40.541 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.534+0000 7fcf997ca700 1 --2- 172.21.15.57:0/1605787693 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcf94159290 0x7fcf9414f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:40.541 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.534+0000 7fcf997ca700 1 -- 172.21.15.57:0/1605787693 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcf94158ec0 msgr2=0x7fcf94153540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:40.542 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.534+0000 7fcf997ca700 1 --2- 172.21.15.57:0/1605787693 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcf94158ec0 0x7fcf94153540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:40.542 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.534+0000 7fcf997ca700 1 -- 172.21.15.57:0/1605787693 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf900094f0 con 0x7fcf9406dcf0 2023-10-06T03:01:40.542 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.534+0000 7fcf99fcb700 1 --2- 172.21.15.57:0/1605787693 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcf94159290 0x7fcf9414f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:40.543 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.534+0000 7fcf997ca700 1 --2- 172.21.15.57:0/1605787693 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcf9406dcf0 0x7fcf94152490 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fcf90009290 tx=0x7fcf90016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:40.543 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.534+0000 7fcf897fa700 1 -- 172.21.15.57:0/1605787693 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf90011d70 con 0x7fcf9406dcf0 2023-10-06T03:01:40.543 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.534+0000 7fcf897fa700 1 -- 172.21.15.57:0/1605787693 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf90020070 con 0x7fcf9406dcf0 2023-10-06T03:01:40.543 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.534+0000 7fcf9ba2e700 1 -- 172.21.15.57:0/1605787693 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf940b43b0 con 0x7fcf9406dcf0 2023-10-06T03:01:40.543 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.534+0000 7fcf897fa700 1 -- 172.21.15.57:0/1605787693 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf9001b6a0 con 0x7fcf9406dcf0 2023-10-06T03:01:40.543 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.534+0000 7fcf9ba2e700 1 -- 172.21.15.57:0/1605787693 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf940b4970 con 0x7fcf9406dcf0 2023-10-06T03:01:40.544 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.538+0000 7fcf9ba2e700 1 -- 172.21.15.57:0/1605787693 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf9404be40 con 0x7fcf9406dcf0 2023-10-06T03:01:40.545 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.538+0000 7fcf897fa700 1 -- 172.21.15.57:0/1605787693 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fcf90022030 con 0x7fcf9406dcf0 2023-10-06T03:01:40.547 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.542+0000 7fcf897fa700 1 --2- 172.21.15.57:0/1605787693 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fcf78060550 0x7fcf78062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:40.547 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.542+0000 7fcf897fa700 1 -- 172.21.15.57:0/1605787693 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fcf9007e530 con 0x7fcf9406dcf0 2023-10-06T03:01:40.547 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.542+0000 7fcf98fc9700 1 --2- 172.21.15.57:0/1605787693 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fcf78060550 0x7fcf78062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:40.548 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.542+0000 7fcf98fc9700 1 --2- 172.21.15.57:0/1605787693 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fcf78060550 0x7fcf78062a00 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fcf94151150 tx=0x7fcf84007ea0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:40.554 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.546+0000 7fcf897fa700 1 -- 172.21.15.57:0/1605787693 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fcf9004ec70 con 0x7fcf9406dcf0 2023-10-06T03:01:40.792 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.786+0000 7fcf9ba2e700 1 -- 172.21.15.57:0/1605787693 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7fcf9404be40 con 0x7fcf9406dcf0 2023-10-06T03:01:40.802 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.794+0000 7fcf897fa700 1 -- 172.21.15.57:0/1605787693 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7fcf90052290 con 0x7fcf9406dcf0 2023-10-06T03:01:40.804 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.798+0000 7fcf9ba2e700 1 -- 172.21.15.57:0/1605787693 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fcf78060550 msgr2=0x7fcf78062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:40.805 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.798+0000 7fcf9ba2e700 1 --2- 172.21.15.57:0/1605787693 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fcf78060550 0x7fcf78062a00 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fcf94151150 tx=0x7fcf84007ea0 comp rx=0 tx=0).stop 2023-10-06T03:01:40.805 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.798+0000 7fcf9ba2e700 1 -- 172.21.15.57:0/1605787693 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcf9406dcf0 msgr2=0x7fcf94152490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:40.805 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.798+0000 7fcf9ba2e700 1 --2- 172.21.15.57:0/1605787693 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcf9406dcf0 0x7fcf94152490 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fcf90009290 tx=0x7fcf90016000 comp rx=0 tx=0).stop 2023-10-06T03:01:40.805 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.798+0000 7fcf9ba2e700 1 -- 172.21.15.57:0/1605787693 shutdown_connections 2023-10-06T03:01:40.806 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.798+0000 7fcf9ba2e700 1 --2- 172.21.15.57:0/1605787693 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fcf78060550 0x7fcf78062a00 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:40.806 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.798+0000 7fcf9ba2e700 1 --2- 172.21.15.57:0/1605787693 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcf94159290 0x7fcf9414f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:40.806 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.798+0000 7fcf9ba2e700 1 --2- 172.21.15.57:0/1605787693 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcf94158ec0 0x7fcf94153540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:40.806 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.798+0000 7fcf9ba2e700 1 --2- 172.21.15.57:0/1605787693 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcf9406dcf0 0x7fcf94152490 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:40.806 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.798+0000 7fcf9ba2e700 1 -- 172.21.15.57:0/1605787693 >> 172.21.15.57:0/1605787693 conn(0x7fcf94067050 msgr2=0x7fcf940cafb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:40.806 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.798+0000 7fcf9ba2e700 1 -- 172.21.15.57:0/1605787693 shutdown_connections 2023-10-06T03:01:40.806 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.798+0000 7fcf9ba2e700 1 -- 172.21.15.57:0/1605787693 wait complete. 2023-10-06T03:01:40.827 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-10-06T03:01:40.990 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.982+0000 7fc3c2f45700 1 Processor -- start 2023-10-06T03:01:40.990 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.982+0000 7fc3c2f45700 1 -- start start 2023-10-06T03:01:40.994 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.986+0000 7fc3c2f45700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc3bc14fe50 0x7fc3bc0ce4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:40.995 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.986+0000 7fc3c2f45700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3bc06ccf0 con 0x7fc3bc150220 2023-10-06T03:01:40.995 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.986+0000 7fc3c2f45700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3bc06c9c0 con 0x7fc3bc06b680 2023-10-06T03:01:40.995 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.986+0000 7fc3c2f45700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3bc06bae0 con 0x7fc3bc14fe50 2023-10-06T03:01:40.995 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.990+0000 7fc3b3fff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fc3bc150220 0x7fc3bc06af70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:57048/0 (socket says 172.21.15.57:57048) 2023-10-06T03:01:40.995 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.990+0000 7fc3b3fff700 1 -- 172.21.15.57:0/3639848703 learned_addr learned my addr 172.21.15.57:0/3639848703 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:01:40.996 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.990+0000 7fc3c0ce1700 1 --2- 172.21.15.57:0/3639848703 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc3bc14fe50 0x7fc3bc0ce4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:40.996 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.990+0000 7fc3b37fe700 1 -- 172.21.15.57:0/3639848703 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2174614574 0 0) 0x7fc3bc06ccf0 con 0x7fc3bc150220 2023-10-06T03:01:40.996 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.990+0000 7fc3b37fe700 1 -- 172.21.15.57:0/3639848703 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3a4003570 con 0x7fc3bc150220 2023-10-06T03:01:40.996 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.990+0000 7fc3b37fe700 1 -- 172.21.15.57:0/3639848703 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 179693680 0 0) 0x7fc3bc06c9c0 con 0x7fc3bc06b680 2023-10-06T03:01:40.996 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.990+0000 7fc3b37fe700 1 -- 172.21.15.57:0/3639848703 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3bc06ccf0 con 0x7fc3bc06b680 2023-10-06T03:01:40.996 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.990+0000 7fc3c0ce1700 1 -- 172.21.15.57:0/3639848703 >> v1:172.21.15.105:6789/0 conn(0x7fc3bc06b680 legacy=0x7fc3bc06d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:40.996 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.990+0000 7fc3c0ce1700 1 -- 172.21.15.57:0/3639848703 >> v1:172.21.15.57:6789/0 conn(0x7fc3bc150220 legacy=0x7fc3bc06af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:40.997 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.990+0000 7fc3c0ce1700 1 -- 172.21.15.57:0/3639848703 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3bc06bce0 con 0x7fc3bc14fe50 2023-10-06T03:01:40.997 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.990+0000 7fc3c0ce1700 1 --2- 172.21.15.57:0/3639848703 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc3bc14fe50 0x7fc3bc0ce4e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc3b8009e90 tx=0x7fc3b8009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d924bd3a1176cffd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:40.997 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.990+0000 7fc3b37fe700 1 -- 172.21.15.57:0/3639848703 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b800e070 con 0x7fc3bc14fe50 2023-10-06T03:01:40.998 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.990+0000 7fc3b37fe700 1 -- 172.21.15.57:0/3639848703 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3b800bb80 con 0x7fc3bc14fe50 2023-10-06T03:01:40.998 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.990+0000 7fc3b37fe700 1 -- 172.21.15.57:0/3639848703 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b8012430 con 0x7fc3bc14fe50 2023-10-06T03:01:40.998 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.990+0000 7fc3c2f45700 1 -- 172.21.15.57:0/3639848703 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc3bc14fe50 msgr2=0x7fc3bc0ce4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:40.998 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.990+0000 7fc3c2f45700 1 --2- 172.21.15.57:0/3639848703 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc3bc14fe50 0x7fc3bc0ce4e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc3b8009e90 tx=0x7fc3b8009780 comp rx=0 tx=0).stop 2023-10-06T03:01:40.999 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.994+0000 7fc3c2f45700 1 -- 172.21.15.57:0/3639848703 shutdown_connections 2023-10-06T03:01:40.999 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.994+0000 7fc3c2f45700 1 --2- 172.21.15.57:0/3639848703 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc3bc14fe50 0x7fc3bc0ce4e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:40.999 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.994+0000 7fc3c2f45700 1 -- 172.21.15.57:0/3639848703 >> 172.21.15.57:0/3639848703 conn(0x7fc3bc0d0bf0 msgr2=0x7fc3bc0ccb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:40.999 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.994+0000 7fc3c2f45700 1 -- 172.21.15.57:0/3639848703 shutdown_connections 2023-10-06T03:01:40.999 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.994+0000 7fc3c2f45700 1 -- 172.21.15.57:0/3639848703 wait complete. 2023-10-06T03:01:41.001 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.994+0000 7fc3c2f45700 1 Processor -- start 2023-10-06T03:01:41.002 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.994+0000 7fc3c2f45700 1 -- start start 2023-10-06T03:01:41.003 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.998+0000 7fc3c2f45700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3bc06b680 0x7fc3bc13d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:41.003 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.998+0000 7fc3c2f45700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc3bc14fe50 0x7fc3bc16a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:41.003 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.998+0000 7fc3c2f45700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc3bc150220 0x7fc3bc0b1c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:41.004 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.998+0000 7fc3c2f45700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3bc0b17e0 con 0x7fc3bc06b680 2023-10-06T03:01:41.004 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.998+0000 7fc3c2f45700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3bc16b210 con 0x7fc3bc150220 2023-10-06T03:01:41.004 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.998+0000 7fc3c2f45700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3bc0b0bd0 con 0x7fc3bc14fe50 2023-10-06T03:01:41.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.998+0000 7fc3c0ce1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3bc06b680 0x7fc3bc13d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:41.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.998+0000 7fc3c0ce1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3bc06b680 0x7fc3bc13d470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60644/0 (socket says 172.21.15.57:60644) 2023-10-06T03:01:41.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.998+0000 7fc3c0ce1700 1 -- 172.21.15.57:0/940290485 learned_addr learned my addr 172.21.15.57:0/940290485 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:41.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.998+0000 7fc3b3fff700 1 --2- 172.21.15.57:0/940290485 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc3bc14fe50 0x7fc3bc16a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:41.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.998+0000 7fc3c14e2700 1 --2- 172.21.15.57:0/940290485 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc3bc150220 0x7fc3bc0b1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:41.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.998+0000 7fc3c0ce1700 1 -- 172.21.15.57:0/940290485 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc3bc14fe50 msgr2=0x7fc3bc16a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:41.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.998+0000 7fc3c0ce1700 1 --2- 172.21.15.57:0/940290485 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc3bc14fe50 0x7fc3bc16a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:41.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.998+0000 7fc3c0ce1700 1 -- 172.21.15.57:0/940290485 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc3bc150220 msgr2=0x7fc3bc0b1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:41.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.998+0000 7fc3c0ce1700 1 --2- 172.21.15.57:0/940290485 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc3bc150220 0x7fc3bc0b1c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:41.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.998+0000 7fc3c0ce1700 1 -- 172.21.15.57:0/940290485 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3b8009a20 con 0x7fc3bc06b680 2023-10-06T03:01:41.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.998+0000 7fc3c0ce1700 1 --2- 172.21.15.57:0/940290485 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3bc06b680 0x7fc3bc13d470 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fc3bc0c6fc0 tx=0x7fc3b8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:41.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.998+0000 7fc3b0ff9700 1 -- 172.21.15.57:0/940290485 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b800be40 con 0x7fc3bc06b680 2023-10-06T03:01:41.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.998+0000 7fc3b0ff9700 1 -- 172.21.15.57:0/940290485 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3b8027470 con 0x7fc3bc06b680 2023-10-06T03:01:41.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.998+0000 7fc3c2f45700 1 -- 172.21.15.57:0/940290485 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3bc0b0eb0 con 0x7fc3bc06b680 2023-10-06T03:01:41.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.998+0000 7fc3b0ff9700 1 -- 172.21.15.57:0/940290485 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b8027830 con 0x7fc3bc06b680 2023-10-06T03:01:41.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:40.998+0000 7fc3c2f45700 1 -- 172.21.15.57:0/940290485 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3bc0b1470 con 0x7fc3bc06b680 2023-10-06T03:01:41.008 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.002+0000 7fc3c2f45700 1 -- 172.21.15.57:0/940290485 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3bc04be40 con 0x7fc3bc06b680 2023-10-06T03:01:41.009 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.002+0000 7fc3b0ff9700 1 -- 172.21.15.57:0/940290485 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fc3b8024070 con 0x7fc3bc06b680 2023-10-06T03:01:41.010 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.002+0000 7fc3b0ff9700 1 --2- 172.21.15.57:0/940290485 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fc3a8060580 0x7fc3a8062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:41.010 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.006+0000 7fc3b0ff9700 1 -- 172.21.15.57:0/940290485 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fc3b807ec50 con 0x7fc3bc06b680 2023-10-06T03:01:41.011 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.006+0000 7fc3b3fff700 1 --2- 172.21.15.57:0/940290485 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fc3a8060580 0x7fc3a8062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:41.012 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.006+0000 7fc3b3fff700 1 --2- 172.21.15.57:0/940290485 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fc3a8060580 0x7fc3a8062a30 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc3bc0cc9d0 tx=0x7fc3ac009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:41.016 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.010+0000 7fc3b0ff9700 1 -- 172.21.15.57:0/940290485 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fc3b804f390 con 0x7fc3bc06b680 2023-10-06T03:01:41.245 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.238+0000 7fc3c2f45700 1 -- 172.21.15.57:0/940290485 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7fc3bc06bfc0 con 0x7fc3bc06b680 2023-10-06T03:01:41.253 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.246+0000 7fc3b0ff9700 1 -- 172.21.15.57:0/940290485 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7fc3b802c020 con 0x7fc3bc06b680 2023-10-06T03:01:41.257 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.250+0000 7fc3c2f45700 1 -- 172.21.15.57:0/940290485 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fc3a8060580 msgr2=0x7fc3a8062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:41.257 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.250+0000 7fc3c2f45700 1 --2- 172.21.15.57:0/940290485 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fc3a8060580 0x7fc3a8062a30 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc3bc0cc9d0 tx=0x7fc3ac009040 comp rx=0 tx=0).stop 2023-10-06T03:01:41.257 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.250+0000 7fc3c2f45700 1 -- 172.21.15.57:0/940290485 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3bc06b680 msgr2=0x7fc3bc13d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:41.257 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.250+0000 7fc3c2f45700 1 --2- 172.21.15.57:0/940290485 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3bc06b680 0x7fc3bc13d470 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fc3bc0c6fc0 tx=0x7fc3b8019000 comp rx=0 tx=0).stop 2023-10-06T03:01:41.257 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.250+0000 7fc3c2f45700 1 -- 172.21.15.57:0/940290485 shutdown_connections 2023-10-06T03:01:41.257 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.250+0000 7fc3c2f45700 1 --2- 172.21.15.57:0/940290485 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc3bc150220 0x7fc3bc0b1c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:41.257 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.250+0000 7fc3c2f45700 1 --2- 172.21.15.57:0/940290485 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fc3a8060580 0x7fc3a8062a30 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:41.257 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.250+0000 7fc3c2f45700 1 --2- 172.21.15.57:0/940290485 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc3bc14fe50 0x7fc3bc16a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:41.257 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.250+0000 7fc3c2f45700 1 --2- 172.21.15.57:0/940290485 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3bc06b680 0x7fc3bc13d470 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:41.258 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.250+0000 7fc3c2f45700 1 -- 172.21.15.57:0/940290485 >> 172.21.15.57:0/940290485 conn(0x7fc3bc0d0bf0 msgr2=0x7fc3bc0cae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:41.258 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.250+0000 7fc3c2f45700 1 -- 172.21.15.57:0/940290485 shutdown_connections 2023-10-06T03:01:41.258 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.250+0000 7fc3c2f45700 1 -- 172.21.15.57:0/940290485 wait complete. 2023-10-06T03:01:41.277 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-10-06T03:01:41.438 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.430+0000 7f24d9c8e700 1 Processor -- start 2023-10-06T03:01:41.438 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.434+0000 7f24d9c8e700 1 -- start start 2023-10-06T03:01:41.442 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.434+0000 7f24d9c8e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f24d4158dc0 0x7f24d40cc660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:41.442 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.434+0000 7f24d9c8e700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f24d4159190 0x7f24d415d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:41.442 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.434+0000 7f24d9c8e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24d406b020 con 0x7f24d406b4b0 2023-10-06T03:01:41.442 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.434+0000 7f24d9c8e700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24d406a6f0 con 0x7f24d4159190 2023-10-06T03:01:41.442 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.434+0000 7f24d9c8e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24d406a9d0 con 0x7f24d4158dc0 2023-10-06T03:01:41.443 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.434+0000 7f24d3fff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f24d406b4b0 0x7f24d415ccb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:57062/0 (socket says 172.21.15.57:57062) 2023-10-06T03:01:41.443 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.434+0000 7f24d3fff700 1 -- 172.21.15.57:0/566788647 learned_addr learned my addr 172.21.15.57:0/566788647 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:01:41.443 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.434+0000 7f24d948d700 1 --2- 172.21.15.57:0/566788647 >> v2:172.21.15.105:3300/0 conn(0x7f24d4159190 0x7f24d415d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:41.443 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.434+0000 7f24d8c8c700 1 --2- 172.21.15.57:0/566788647 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f24d4158dc0 0x7f24d40cc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:41.443 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.438+0000 7f24d948d700 1 -- 172.21.15.57:0/566788647 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f24d4158dc0 msgr2=0x7f24d40cc660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:41.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.438+0000 7f24d948d700 1 --2- 172.21.15.57:0/566788647 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f24d4158dc0 0x7f24d40cc660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:41.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.438+0000 7f24d948d700 1 -- 172.21.15.57:0/566788647 >> v1:172.21.15.57:6789/0 conn(0x7f24d406b4b0 legacy=0x7f24d415ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:41.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.438+0000 7f24d948d700 1 -- 172.21.15.57:0/566788647 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24d406acb0 con 0x7f24d4159190 2023-10-06T03:01:41.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.438+0000 7f24d37fe700 1 -- 172.21.15.57:0/566788647 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2618292054 0 0) 0x7f24d406b020 con 0x7f24d406b4b0 2023-10-06T03:01:41.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.438+0000 7f24d948d700 1 --2- 172.21.15.57:0/566788647 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f24d4159190 0x7f24d415d3c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f24cc009e60 tx=0x7f24cc009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d11dd112b49e4dd6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:41.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.438+0000 7f24d37fe700 1 -- 172.21.15.57:0/566788647 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24cc00e070 con 0x7f24d4159190 2023-10-06T03:01:41.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.438+0000 7f24d37fe700 1 -- 172.21.15.57:0/566788647 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24cc00bb60 con 0x7f24d4159190 2023-10-06T03:01:41.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.438+0000 7f24d37fe700 1 -- 172.21.15.57:0/566788647 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24cc012430 con 0x7f24d4159190 2023-10-06T03:01:41.446 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.438+0000 7f24d9c8e700 1 -- 172.21.15.57:0/566788647 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f24d4159190 msgr2=0x7f24d415d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:41.446 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.438+0000 7f24d9c8e700 1 --2- 172.21.15.57:0/566788647 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f24d4159190 0x7f24d415d3c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f24cc009e60 tx=0x7f24cc009780 comp rx=0 tx=0).stop 2023-10-06T03:01:41.446 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.438+0000 7f24d9c8e700 1 -- 172.21.15.57:0/566788647 shutdown_connections 2023-10-06T03:01:41.446 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.438+0000 7f24d9c8e700 1 --2- 172.21.15.57:0/566788647 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f24d4159190 0x7f24d415d3c0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:41.446 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.438+0000 7f24d9c8e700 1 --2- 172.21.15.57:0/566788647 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f24d4158dc0 0x7f24d40cc660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:41.446 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.438+0000 7f24d9c8e700 1 -- 172.21.15.57:0/566788647 >> 172.21.15.57:0/566788647 conn(0x7f24d4067050 msgr2=0x7f24d4067450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:41.446 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.438+0000 7f24d9c8e700 1 -- 172.21.15.57:0/566788647 shutdown_connections 2023-10-06T03:01:41.446 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.438+0000 7f24d9c8e700 1 -- 172.21.15.57:0/566788647 wait complete. 2023-10-06T03:01:41.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.442+0000 7f24d9c8e700 1 Processor -- start 2023-10-06T03:01:41.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.442+0000 7f24d9c8e700 1 -- start start 2023-10-06T03:01:41.450 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.442+0000 7f24d9c8e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f24d406b4b0 0x7f24d4152450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:41.450 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.442+0000 7f24d9c8e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f24d4158dc0 0x7f24d40b3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:41.450 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.442+0000 7f24d9c8e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f24d4159190 0x7f24d40b0260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:41.450 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.442+0000 7f24d9c8e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24d41694e0 con 0x7f24d4159190 2023-10-06T03:01:41.450 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.442+0000 7f24d9c8e700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24d40b49d0 con 0x7f24d406b4b0 2023-10-06T03:01:41.450 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.442+0000 7f24d9c8e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24d40b4cb0 con 0x7f24d4158dc0 2023-10-06T03:01:41.451 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.442+0000 7f24d948d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f24d4159190 0x7f24d40b0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:41.451 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.446+0000 7f24d948d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f24d4159190 0x7f24d40b0260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60660/0 (socket says 172.21.15.57:60660) 2023-10-06T03:01:41.451 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.446+0000 7f24d948d700 1 -- 172.21.15.57:0/3697346892 learned_addr learned my addr 172.21.15.57:0/3697346892 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:41.451 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.446+0000 7f24d8c8c700 1 --2- 172.21.15.57:0/3697346892 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f24d406b4b0 0x7f24d4152450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:41.451 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.446+0000 7f24d3fff700 1 --2- 172.21.15.57:0/3697346892 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f24d4158dc0 0x7f24d40b3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:41.452 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.446+0000 7f24d948d700 1 -- 172.21.15.57:0/3697346892 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f24d4158dc0 msgr2=0x7f24d40b3ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:41.452 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.446+0000 7f24d948d700 1 --2- 172.21.15.57:0/3697346892 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f24d4158dc0 0x7f24d40b3ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:41.452 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.446+0000 7f24d948d700 1 -- 172.21.15.57:0/3697346892 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f24d406b4b0 msgr2=0x7f24d4152450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:41.452 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.446+0000 7f24d948d700 1 --2- 172.21.15.57:0/3697346892 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f24d406b4b0 0x7f24d4152450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:41.453 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.446+0000 7f24d948d700 1 -- 172.21.15.57:0/3697346892 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24cc009a20 con 0x7f24d4159190 2023-10-06T03:01:41.453 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.446+0000 7f24d948d700 1 --2- 172.21.15.57:0/3697346892 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f24d4159190 0x7f24d40b0260 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f24cc0099f0 tx=0x7f24cc019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:41.453 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.446+0000 7f24d0ff9700 1 -- 172.21.15.57:0/3697346892 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24cc027470 con 0x7f24d4159190 2023-10-06T03:01:41.453 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.446+0000 7f24d0ff9700 1 -- 172.21.15.57:0/3697346892 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24cc027610 con 0x7f24d4159190 2023-10-06T03:01:41.454 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.446+0000 7f24d0ff9700 1 -- 172.21.15.57:0/3697346892 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24cc0279d0 con 0x7f24d4159190 2023-10-06T03:01:41.454 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.446+0000 7f24d9c8e700 1 -- 172.21.15.57:0/3697346892 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24d40b4f90 con 0x7f24d4159190 2023-10-06T03:01:41.454 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.446+0000 7f24d9c8e700 1 -- 172.21.15.57:0/3697346892 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24d41690d0 con 0x7f24d4159190 2023-10-06T03:01:41.455 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.450+0000 7f24d9c8e700 1 -- 172.21.15.57:0/3697346892 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24d4169650 con 0x7f24d4159190 2023-10-06T03:01:41.456 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.450+0000 7f24d0ff9700 1 -- 172.21.15.57:0/3697346892 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f24cc024070 con 0x7f24d4159190 2023-10-06T03:01:41.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.450+0000 7f24d0ff9700 1 --2- 172.21.15.57:0/3697346892 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f24b8060550 0x7f24b8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:41.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.450+0000 7f24d0ff9700 1 -- 172.21.15.57:0/3697346892 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f24cc07ef80 con 0x7f24d4159190 2023-10-06T03:01:41.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.454+0000 7f24d8c8c700 1 --2- 172.21.15.57:0/3697346892 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f24b8060550 0x7f24b8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:41.459 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.454+0000 7f24d8c8c700 1 --2- 172.21.15.57:0/3697346892 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f24b8060550 0x7f24b8062a00 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f24c8009db0 tx=0x7f24c80091a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:41.464 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.458+0000 7f24d0ff9700 1 -- 172.21.15.57:0/3697346892 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f24cc04f6c0 con 0x7f24d4159190 2023-10-06T03:01:41.689 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.682+0000 7f24d9c8e700 1 -- 172.21.15.57:0/3697346892 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f24d404be40 con 0x7f24d4159190 2023-10-06T03:01:41.698 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.690+0000 7f24d0ff9700 1 -- 172.21.15.57:0/3697346892 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f24cc02c0a0 con 0x7f24d4159190 2023-10-06T03:01:41.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.698+0000 7f24d9c8e700 1 -- 172.21.15.57:0/3697346892 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f24b8060550 msgr2=0x7f24b8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:41.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.698+0000 7f24d9c8e700 1 --2- 172.21.15.57:0/3697346892 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f24b8060550 0x7f24b8062a00 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f24c8009db0 tx=0x7f24c80091a0 comp rx=0 tx=0).stop 2023-10-06T03:01:41.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.698+0000 7f24d9c8e700 1 -- 172.21.15.57:0/3697346892 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f24d4159190 msgr2=0x7f24d40b0260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:41.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.698+0000 7f24d9c8e700 1 --2- 172.21.15.57:0/3697346892 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f24d4159190 0x7f24d40b0260 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f24cc0099f0 tx=0x7f24cc019000 comp rx=0 tx=0).stop 2023-10-06T03:01:41.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.698+0000 7f24d9c8e700 1 -- 172.21.15.57:0/3697346892 shutdown_connections 2023-10-06T03:01:41.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.698+0000 7f24d9c8e700 1 --2- 172.21.15.57:0/3697346892 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f24d4159190 0x7f24d40b0260 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:41.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.698+0000 7f24d9c8e700 1 --2- 172.21.15.57:0/3697346892 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f24b8060550 0x7f24b8062a00 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:41.704 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.698+0000 7f24d9c8e700 1 --2- 172.21.15.57:0/3697346892 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f24d4158dc0 0x7f24d40b3ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:41.704 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.698+0000 7f24d9c8e700 1 --2- 172.21.15.57:0/3697346892 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f24d406b4b0 0x7f24d4152450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:41.704 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.698+0000 7f24d9c8e700 1 -- 172.21.15.57:0/3697346892 >> 172.21.15.57:0/3697346892 conn(0x7f24d4067050 msgr2=0x7f24d40ce310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:41.704 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.698+0000 7f24d9c8e700 1 -- 172.21.15.57:0/3697346892 shutdown_connections 2023-10-06T03:01:41.704 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.698+0000 7f24d9c8e700 1 -- 172.21.15.57:0/3697346892 wait complete. 2023-10-06T03:01:41.723 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-10-06T03:01:41.888 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.882+0000 7f00fd68e700 1 Processor -- start 2023-10-06T03:01:41.888 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.882+0000 7f00fd68e700 1 -- start start 2023-10-06T03:01:41.891 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.886+0000 7f00fd68e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00f8158dc0 0x7f00f80cc660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:41.891 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.886+0000 7f00fd68e700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f00f806b4b0 0x7f00f80ccba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:41.892 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.886+0000 7f00fd68e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00f806b020 con 0x7f00f8159190 2023-10-06T03:01:41.892 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.886+0000 7f00fd68e700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00f80cd0e0 con 0x7f00f806b4b0 2023-10-06T03:01:41.892 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.886+0000 7f00fd68e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00f806a6f0 con 0x7f00f8158dc0 2023-10-06T03:01:41.893 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.886+0000 7f00f77fe700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f00f806b4b0 0x7f00f80ccba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:41.893 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.886+0000 7f00f77fe700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f00f806b4b0 0x7f00f80ccba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.57:40828/0 (socket says 172.21.15.57:40828) 2023-10-06T03:01:41.893 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.886+0000 7f00f77fe700 1 -- 172.21.15.57:0/3257045862 learned_addr learned my addr 172.21.15.57:0/3257045862 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:41.893 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.886+0000 7f00fce8d700 1 --1- 172.21.15.57:0/3257045862 >> v1:172.21.15.57:6789/0 conn(0x7f00f8159190 0x7f00f815ccb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:57066/0 (socket says 172.21.15.57:57066) 2023-10-06T03:01:41.893 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.886+0000 7f00f7fff700 1 --2- 172.21.15.57:0/3257045862 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00f8158dc0 0x7f00f80cc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:41.894 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.886+0000 7f00f77fe700 1 -- 172.21.15.57:0/3257045862 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00f8158dc0 msgr2=0x7f00f80cc660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:41.894 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.886+0000 7f00f6ffd700 1 -- 172.21.15.57:0/3257045862 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2429187762 0 0) 0x7f00f806b020 con 0x7f00f8159190 2023-10-06T03:01:41.894 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.886+0000 7f00f77fe700 1 --2- 172.21.15.57:0/3257045862 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00f8158dc0 0x7f00f80cc660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:41.894 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.886+0000 7f00f77fe700 1 -- 172.21.15.57:0/3257045862 >> v1:172.21.15.57:6789/0 conn(0x7f00f8159190 legacy=0x7f00f815ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:41.894 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.886+0000 7f00f77fe700 1 -- 172.21.15.57:0/3257045862 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00f806a9d0 con 0x7f00f806b4b0 2023-10-06T03:01:41.894 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.886+0000 7f00f77fe700 1 --2- 172.21.15.57:0/3257045862 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f00f806b4b0 0x7f00f80ccba0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f00ec0099b0 tx=0x7f00ec009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=35df51d0d96f67d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:41.895 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.886+0000 7f00f6ffd700 1 -- 172.21.15.57:0/3257045862 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00ec009ea0 con 0x7f00f806b4b0 2023-10-06T03:01:41.895 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.886+0000 7f00f6ffd700 1 -- 172.21.15.57:0/3257045862 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00ec00b860 con 0x7f00f806b4b0 2023-10-06T03:01:41.895 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.890+0000 7f00f6ffd700 1 -- 172.21.15.57:0/3257045862 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00ec00bc00 con 0x7f00f806b4b0 2023-10-06T03:01:41.896 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.890+0000 7f00fd68e700 1 -- 172.21.15.57:0/3257045862 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f00f806b4b0 msgr2=0x7f00f80ccba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:41.896 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.890+0000 7f00fd68e700 1 --2- 172.21.15.57:0/3257045862 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f00f806b4b0 0x7f00f80ccba0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f00ec0099b0 tx=0x7f00ec009250 comp rx=0 tx=0).stop 2023-10-06T03:01:41.896 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.890+0000 7f00fd68e700 1 -- 172.21.15.57:0/3257045862 shutdown_connections 2023-10-06T03:01:41.896 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.890+0000 7f00fd68e700 1 --2- 172.21.15.57:0/3257045862 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f00f806b4b0 0x7f00f80ccba0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:41.896 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.890+0000 7f00fd68e700 1 --2- 172.21.15.57:0/3257045862 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00f8158dc0 0x7f00f80cc660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:41.896 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.890+0000 7f00fd68e700 1 -- 172.21.15.57:0/3257045862 >> 172.21.15.57:0/3257045862 conn(0x7f00f8067050 msgr2=0x7f00f8067450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:41.896 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.890+0000 7f00fd68e700 1 -- 172.21.15.57:0/3257045862 shutdown_connections 2023-10-06T03:01:41.896 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.890+0000 7f00fd68e700 1 -- 172.21.15.57:0/3257045862 wait complete. 2023-10-06T03:01:41.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.894+0000 7f00fd68e700 1 Processor -- start 2023-10-06T03:01:41.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.894+0000 7f00fd68e700 1 -- start start 2023-10-06T03:01:41.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.894+0000 7f00fd68e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00f806b4b0 0x7f00f80b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:41.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.894+0000 7f00fd68e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f00f8158dc0 0x7f00f816da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:41.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.894+0000 7f00fd68e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00f8159190 0x7f00f8151910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:41.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.894+0000 7f00fd68e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f80c8760 con 0x7f00f806b4b0 2023-10-06T03:01:41.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.894+0000 7f00fd68e700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f816dfa0 con 0x7f00f8158dc0 2023-10-06T03:01:41.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.894+0000 7f00fd68e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00f80b4380 con 0x7f00f8159190 2023-10-06T03:01:41.902 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.894+0000 7f00f7fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00f806b4b0 0x7f00f80b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:41.902 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.894+0000 7f00f7fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00f806b4b0 0x7f00f80b3da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60668/0 (socket says 172.21.15.57:60668) 2023-10-06T03:01:41.902 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.894+0000 7f00f7fff700 1 -- 172.21.15.57:0/1489696019 learned_addr learned my addr 172.21.15.57:0/1489696019 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:41.903 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.894+0000 7f00fce8d700 1 --2- 172.21.15.57:0/1489696019 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00f8159190 0x7f00f8151910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:41.903 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.894+0000 7f00f77fe700 1 --2- 172.21.15.57:0/1489696019 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f00f8158dc0 0x7f00f816da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:41.903 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.894+0000 7f00f7fff700 1 -- 172.21.15.57:0/1489696019 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00f8159190 msgr2=0x7f00f8151910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:41.903 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.894+0000 7f00f7fff700 1 --2- 172.21.15.57:0/1489696019 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00f8159190 0x7f00f8151910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:41.903 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.894+0000 7f00f7fff700 1 -- 172.21.15.57:0/1489696019 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f00f8158dc0 msgr2=0x7f00f816da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:41.903 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.894+0000 7f00f7fff700 1 --2- 172.21.15.57:0/1489696019 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f00f8158dc0 0x7f00f816da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:41.903 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.894+0000 7f00f7fff700 1 -- 172.21.15.57:0/1489696019 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00ec0094f0 con 0x7f00f806b4b0 2023-10-06T03:01:41.903 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.898+0000 7f00f7fff700 1 --2- 172.21.15.57:0/1489696019 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00f806b4b0 0x7f00f80b3da0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f00e800ec80 tx=0x7f00e80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:41.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.898+0000 7f00dffff700 1 -- 172.21.15.57:0/1489696019 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e800c850 con 0x7f00f806b4b0 2023-10-06T03:01:41.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.898+0000 7f00dffff700 1 -- 172.21.15.57:0/1489696019 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00e800c9b0 con 0x7f00f806b4b0 2023-10-06T03:01:41.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.898+0000 7f00fd68e700 1 -- 172.21.15.57:0/1489696019 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00f80b4660 con 0x7f00f806b4b0 2023-10-06T03:01:41.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.898+0000 7f00dffff700 1 -- 172.21.15.57:0/1489696019 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e800cd50 con 0x7f00f806b4b0 2023-10-06T03:01:41.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.898+0000 7f00fd68e700 1 -- 172.21.15.57:0/1489696019 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00f80b4c20 con 0x7f00f806b4b0 2023-10-06T03:01:41.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.898+0000 7f00fd68e700 1 -- 172.21.15.57:0/1489696019 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00f804be40 con 0x7f00f806b4b0 2023-10-06T03:01:41.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.902+0000 7f00dffff700 1 -- 172.21.15.57:0/1489696019 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f00e8013680 con 0x7f00f806b4b0 2023-10-06T03:01:41.909 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.902+0000 7f00dffff700 1 --2- 172.21.15.57:0/1489696019 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f00e4060550 0x7f00e4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:41.909 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.902+0000 7f00dffff700 1 -- 172.21.15.57:0/1489696019 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f00e807c8e0 con 0x7f00f806b4b0 2023-10-06T03:01:41.909 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.902+0000 7f00f77fe700 1 --2- 172.21.15.57:0/1489696019 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f00e4060550 0x7f00e4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:41.910 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.902+0000 7f00f77fe700 1 --2- 172.21.15.57:0/1489696019 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f00e4060550 0x7f00e4062a00 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f00ec0099b0 tx=0x7f00ec017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:41.915 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:41.910+0000 7f00dffff700 1 -- 172.21.15.57:0/1489696019 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f00e804d020 con 0x7f00f806b4b0 2023-10-06T03:01:42.142 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.134+0000 7f00fd68e700 1 -- 172.21.15.57:0/1489696019 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f00f806acb0 con 0x7f00f806b4b0 2023-10-06T03:01:42.148 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.142+0000 7f00dffff700 1 -- 172.21.15.57:0/1489696019 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f00e8050640 con 0x7f00f806b4b0 2023-10-06T03:01:42.151 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.146+0000 7f00fd68e700 1 -- 172.21.15.57:0/1489696019 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f00e4060550 msgr2=0x7f00e4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:42.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.146+0000 7f00fd68e700 1 --2- 172.21.15.57:0/1489696019 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f00e4060550 0x7f00e4062a00 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f00ec0099b0 tx=0x7f00ec017000 comp rx=0 tx=0).stop 2023-10-06T03:01:42.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.146+0000 7f00fd68e700 1 -- 172.21.15.57:0/1489696019 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00f806b4b0 msgr2=0x7f00f80b3da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:42.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.146+0000 7f00fd68e700 1 --2- 172.21.15.57:0/1489696019 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00f806b4b0 0x7f00f80b3da0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f00e800ec80 tx=0x7f00e80091a0 comp rx=0 tx=0).stop 2023-10-06T03:01:42.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.146+0000 7f00fd68e700 1 -- 172.21.15.57:0/1489696019 shutdown_connections 2023-10-06T03:01:42.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.146+0000 7f00fd68e700 1 --2- 172.21.15.57:0/1489696019 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f00e4060550 0x7f00e4062a00 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:42.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.146+0000 7f00fd68e700 1 --2- 172.21.15.57:0/1489696019 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00f8159190 0x7f00f8151910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:42.153 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.146+0000 7f00fd68e700 1 --2- 172.21.15.57:0/1489696019 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f00f8158dc0 0x7f00f816da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:42.153 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.146+0000 7f00fd68e700 1 --2- 172.21.15.57:0/1489696019 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00f806b4b0 0x7f00f80b3da0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:42.153 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.146+0000 7f00fd68e700 1 -- 172.21.15.57:0/1489696019 >> 172.21.15.57:0/1489696019 conn(0x7f00f8067050 msgr2=0x7f00f8062ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:42.153 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.146+0000 7f00fd68e700 1 -- 172.21.15.57:0/1489696019 shutdown_connections 2023-10-06T03:01:42.153 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.146+0000 7f00fd68e700 1 -- 172.21.15.57:0/1489696019 wait complete. 2023-10-06T03:01:42.171 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-10-06T03:01:42.335 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.330+0000 7fd39a68e700 1 Processor -- start 2023-10-06T03:01:42.335 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.330+0000 7fd39a68e700 1 -- start start 2023-10-06T03:01:42.336 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.330+0000 7fd39a68e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd39406c920 0x7fd39406ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:42.336 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.330+0000 7fd39a68e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd39406b4a0 con 0x7fd3940af0d0 2023-10-06T03:01:42.337 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.330+0000 7fd39a68e700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd39406a890 con 0x7fd39406d230 2023-10-06T03:01:42.337 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.330+0000 7fd39a68e700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd39406ab70 con 0x7fd39406c920 2023-10-06T03:01:42.337 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.330+0000 7fd39968c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd39406c920 0x7fd39406ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:42.337 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.330+0000 7fd399e8d700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fd3940af0d0 0x7fd394160cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:57074/0 (socket says 172.21.15.57:57074) 2023-10-06T03:01:42.337 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.330+0000 7fd399e8d700 1 -- 172.21.15.57:0/504867433 learned_addr learned my addr 172.21.15.57:0/504867433 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:01:42.338 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.330+0000 7fd39968c700 1 -- 172.21.15.57:0/504867433 >> v1:172.21.15.105:6789/0 conn(0x7fd39406d230 legacy=0x7fd3940ae9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:42.338 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.330+0000 7fd39968c700 1 -- 172.21.15.57:0/504867433 >> v1:172.21.15.57:6789/0 conn(0x7fd3940af0d0 legacy=0x7fd394160cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:42.338 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.330+0000 7fd38bfff700 1 -- 172.21.15.57:0/504867433 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3290272581 0 0) 0x7fd39406b4a0 con 0x7fd3940af0d0 2023-10-06T03:01:42.338 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.330+0000 7fd39968c700 1 -- 172.21.15.57:0/504867433 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd39406ae50 con 0x7fd39406c920 2023-10-06T03:01:42.338 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.334+0000 7fd39968c700 1 --2- 172.21.15.57:0/504867433 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd39406c920 0x7fd39406ccf0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fd3900098e0 tx=0x7fd3900091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87248c68c46c65df server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:42.339 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.334+0000 7fd38bfff700 1 -- 172.21.15.57:0/504867433 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd390009e80 con 0x7fd39406c920 2023-10-06T03:01:42.339 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.334+0000 7fd38bfff700 1 -- 172.21.15.57:0/504867433 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd39000b860 con 0x7fd39406c920 2023-10-06T03:01:42.339 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.334+0000 7fd38bfff700 1 -- 172.21.15.57:0/504867433 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd39000bbe0 con 0x7fd39406c920 2023-10-06T03:01:42.340 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.334+0000 7fd39a68e700 1 -- 172.21.15.57:0/504867433 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd39406c920 msgr2=0x7fd39406ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:42.340 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.334+0000 7fd39a68e700 1 --2- 172.21.15.57:0/504867433 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd39406c920 0x7fd39406ccf0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fd3900098e0 tx=0x7fd3900091a0 comp rx=0 tx=0).stop 2023-10-06T03:01:42.340 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.334+0000 7fd39a68e700 1 -- 172.21.15.57:0/504867433 shutdown_connections 2023-10-06T03:01:42.340 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.334+0000 7fd39a68e700 1 --2- 172.21.15.57:0/504867433 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd39406c920 0x7fd39406ccf0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:42.341 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.334+0000 7fd39a68e700 1 -- 172.21.15.57:0/504867433 >> 172.21.15.57:0/504867433 conn(0x7fd3940c85e0 msgr2=0x7fd3940c89e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:42.341 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.334+0000 7fd39a68e700 1 -- 172.21.15.57:0/504867433 shutdown_connections 2023-10-06T03:01:42.341 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.334+0000 7fd39a68e700 1 -- 172.21.15.57:0/504867433 wait complete. 2023-10-06T03:01:42.344 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.338+0000 7fd39a68e700 1 Processor -- start 2023-10-06T03:01:42.344 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.338+0000 7fd39a68e700 1 -- start start 2023-10-06T03:01:42.347 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.342+0000 7fd39a68e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd39406c920 0x7fd3940c3540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:42.347 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.342+0000 7fd39a68e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd39406d230 0x7fd394168d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:42.347 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.342+0000 7fd39a68e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd3940af0d0 0x7fd39416ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:42.347 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.342+0000 7fd39a68e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3940c8120 con 0x7fd39406c920 2023-10-06T03:01:42.347 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.342+0000 7fd39a68e700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3940c3c20 con 0x7fd39406d230 2023-10-06T03:01:42.347 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.342+0000 7fd39a68e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd39415bf30 con 0x7fd3940af0d0 2023-10-06T03:01:42.348 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.342+0000 7fd39968c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd39406c920 0x7fd3940c3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:42.348 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.342+0000 7fd39968c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd39406c920 0x7fd3940c3540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60690/0 (socket says 172.21.15.57:60690) 2023-10-06T03:01:42.349 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.342+0000 7fd39968c700 1 -- 172.21.15.57:0/1597466501 learned_addr learned my addr 172.21.15.57:0/1597466501 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:42.349 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.342+0000 7fd399e8d700 1 --2- 172.21.15.57:0/1597466501 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd3940af0d0 0x7fd39416ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:42.349 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.342+0000 7fd398e8b700 1 --2- 172.21.15.57:0/1597466501 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd39406d230 0x7fd394168d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:42.349 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.342+0000 7fd39968c700 1 -- 172.21.15.57:0/1597466501 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd3940af0d0 msgr2=0x7fd39416ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:42.349 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.342+0000 7fd39968c700 1 --2- 172.21.15.57:0/1597466501 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd3940af0d0 0x7fd39416ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:42.349 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.342+0000 7fd39968c700 1 -- 172.21.15.57:0/1597466501 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd39406d230 msgr2=0x7fd394168d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:42.349 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.342+0000 7fd39968c700 1 --2- 172.21.15.57:0/1597466501 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd39406d230 0x7fd394168d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:42.349 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.342+0000 7fd39968c700 1 -- 172.21.15.57:0/1597466501 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd390009420 con 0x7fd39406c920 2023-10-06T03:01:42.349 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.342+0000 7fd398e8b700 1 --2- 172.21.15.57:0/1597466501 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd39406d230 0x7fd394168d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:01:42.350 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.342+0000 7fd39968c700 1 --2- 172.21.15.57:0/1597466501 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd39406c920 0x7fd3940c3540 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fd39406a1d0 tx=0x7fd390017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:42.350 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.342+0000 7fd3897fa700 1 -- 172.21.15.57:0/1597466501 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd39001f070 con 0x7fd39406c920 2023-10-06T03:01:42.350 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.342+0000 7fd3897fa700 1 -- 172.21.15.57:0/1597466501 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd390011420 con 0x7fd39406c920 2023-10-06T03:01:42.350 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.342+0000 7fd39a68e700 1 -- 172.21.15.57:0/1597466501 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd39415c210 con 0x7fd39406c920 2023-10-06T03:01:42.350 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.342+0000 7fd3897fa700 1 -- 172.21.15.57:0/1597466501 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd39000bbe0 con 0x7fd39406c920 2023-10-06T03:01:42.350 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.342+0000 7fd39a68e700 1 -- 172.21.15.57:0/1597466501 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd39416bf60 con 0x7fd39406c920 2023-10-06T03:01:42.351 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.346+0000 7fd39a68e700 1 -- 172.21.15.57:0/1597466501 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd39415bd90 con 0x7fd39406c920 2023-10-06T03:01:42.352 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.346+0000 7fd3897fa700 1 -- 172.21.15.57:0/1597466501 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fd390011a50 con 0x7fd39406c920 2023-10-06T03:01:42.354 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.346+0000 7fd3897fa700 1 --2- 172.21.15.57:0/1597466501 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fd378060550 0x7fd378062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:42.354 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.350+0000 7fd3897fa700 1 -- 172.21.15.57:0/1597466501 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fd39007dc40 con 0x7fd39406c920 2023-10-06T03:01:42.355 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.350+0000 7fd398e8b700 1 --2- 172.21.15.57:0/1597466501 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fd378060550 0x7fd378062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:42.356 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.350+0000 7fd398e8b700 1 --2- 172.21.15.57:0/1597466501 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fd378060550 0x7fd378062a00 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd39415df70 tx=0x7fd384009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:42.360 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.354+0000 7fd3897fa700 1 -- 172.21.15.57:0/1597466501 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fd39415bd90 con 0x7fd39406c920 2023-10-06T03:01:42.585 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.578+0000 7fd39a68e700 1 -- 172.21.15.57:0/1597466501 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7fd3940cb3d0 con 0x7fd39406c920 2023-10-06T03:01:42.595 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.590+0000 7fd3897fa700 1 -- 172.21.15.57:0/1597466501 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) v1 ==== 97+0+0 (secure 0 0 0) 0x7fd3940cb3d0 con 0x7fd39406c920 2023-10-06T03:01:42.598 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.590+0000 7fd39a68e700 1 -- 172.21.15.57:0/1597466501 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fd378060550 msgr2=0x7fd378062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:42.598 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.590+0000 7fd39a68e700 1 --2- 172.21.15.57:0/1597466501 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fd378060550 0x7fd378062a00 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd39415df70 tx=0x7fd384009040 comp rx=0 tx=0).stop 2023-10-06T03:01:42.598 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.590+0000 7fd39a68e700 1 -- 172.21.15.57:0/1597466501 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd39406c920 msgr2=0x7fd3940c3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:42.598 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.590+0000 7fd39a68e700 1 --2- 172.21.15.57:0/1597466501 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd39406c920 0x7fd3940c3540 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fd39406a1d0 tx=0x7fd390017000 comp rx=0 tx=0).stop 2023-10-06T03:01:42.599 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.594+0000 7fd39a68e700 1 -- 172.21.15.57:0/1597466501 shutdown_connections 2023-10-06T03:01:42.599 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.594+0000 7fd39a68e700 1 --2- 172.21.15.57:0/1597466501 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fd378060550 0x7fd378062a00 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:42.599 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.594+0000 7fd39a68e700 1 --2- 172.21.15.57:0/1597466501 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd3940af0d0 0x7fd39416ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:42.599 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.594+0000 7fd39a68e700 1 --2- 172.21.15.57:0/1597466501 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd39406d230 0x7fd394168d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:42.599 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.594+0000 7fd39a68e700 1 --2- 172.21.15.57:0/1597466501 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd39406c920 0x7fd3940c3540 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:42.599 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.594+0000 7fd39a68e700 1 -- 172.21.15.57:0/1597466501 >> 172.21.15.57:0/1597466501 conn(0x7fd3940c85e0 msgr2=0x7fd394159190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:42.599 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.594+0000 7fd39a68e700 1 -- 172.21.15.57:0/1597466501 shutdown_connections 2023-10-06T03:01:42.600 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.594+0000 7fd39a68e700 1 -- 172.21.15.57:0/1597466501 wait complete. 2023-10-06T03:01:42.619 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-10-06T03:01:42.788 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.782+0000 7fece7e25700 1 Processor -- start 2023-10-06T03:01:42.788 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.782+0000 7fece7e25700 1 -- start start 2023-10-06T03:01:42.791 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.786+0000 7fece7e25700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fece015a510 0x7fece0067050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:42.791 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.786+0000 7fece7e25700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fece0067590 0x7fece00c6c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:42.792 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.786+0000 7fece7e25700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fece006d250 con 0x7fece0156d60 2023-10-06T03:01:42.792 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.786+0000 7fece7e25700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fece006ddf0 con 0x7fece015a510 2023-10-06T03:01:42.792 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.786+0000 7fece7e25700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fece0067af0 con 0x7fece0067590 2023-10-06T03:01:42.793 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.786+0000 7fece53c0700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fece015a510 0x7fece0067050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:42.793 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.786+0000 7fece53c0700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fece015a510 0x7fece0067050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60698/0 (socket says 172.21.15.57:60698) 2023-10-06T03:01:42.793 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.786+0000 7fece53c0700 1 -- 172.21.15.57:0/909023639 learned_addr learned my addr 172.21.15.57:0/909023639 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:42.793 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.786+0000 7fece63c2700 1 --2- 172.21.15.57:0/909023639 >> v2:172.21.15.105:3300/0 conn(0x7fece0067590 0x7fece00c6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:42.793 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.786+0000 7fece53c0700 1 -- 172.21.15.57:0/909023639 >> v2:172.21.15.105:3300/0 conn(0x7fece0067590 msgr2=0x7fece00c6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:42.793 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.786+0000 7fece53c0700 1 --2- 172.21.15.57:0/909023639 >> v2:172.21.15.105:3300/0 conn(0x7fece0067590 0x7fece00c6c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:42.793 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.786+0000 7fece53c0700 1 -- 172.21.15.57:0/909023639 >> v1:172.21.15.105:6789/0 conn(0x7fece0156d60 legacy=0x7fece006d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:42.793 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.786+0000 7fece53c0700 1 -- 172.21.15.57:0/909023639 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fece006c920 con 0x7fece015a510 2023-10-06T03:01:42.794 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.786+0000 7fece53c0700 1 --2- 172.21.15.57:0/909023639 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fece015a510 0x7fece0067050 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fece00bf6c0 tx=0x7fecd0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=221983aee9c30237 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:42.794 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.786+0000 7fece4bbf700 1 -- 172.21.15.57:0/909023639 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd0009e70 con 0x7fece015a510 2023-10-06T03:01:42.794 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.786+0000 7fece4bbf700 1 -- 172.21.15.57:0/909023639 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecd000b860 con 0x7fece015a510 2023-10-06T03:01:42.794 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.786+0000 7fece4bbf700 1 -- 172.21.15.57:0/909023639 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd000bc00 con 0x7fece015a510 2023-10-06T03:01:42.795 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.790+0000 7fece7e25700 1 -- 172.21.15.57:0/909023639 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fece015a510 msgr2=0x7fece0067050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:42.795 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.790+0000 7fece7e25700 1 --2- 172.21.15.57:0/909023639 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fece015a510 0x7fece0067050 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fece00bf6c0 tx=0x7fecd0009250 comp rx=0 tx=0).stop 2023-10-06T03:01:42.795 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.790+0000 7fece7e25700 1 -- 172.21.15.57:0/909023639 shutdown_connections 2023-10-06T03:01:42.796 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.790+0000 7fece7e25700 1 --2- 172.21.15.57:0/909023639 >> v2:172.21.15.105:3300/0 conn(0x7fece0067590 0x7fece00c6c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:42.796 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.790+0000 7fece7e25700 1 --2- 172.21.15.57:0/909023639 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fece015a510 0x7fece0067050 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:42.796 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.790+0000 7fece7e25700 1 -- 172.21.15.57:0/909023639 >> 172.21.15.57:0/909023639 conn(0x7fece00cbc90 msgr2=0x7fece00cc090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:42.796 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.790+0000 7fece7e25700 1 -- 172.21.15.57:0/909023639 shutdown_connections 2023-10-06T03:01:42.796 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.790+0000 7fece7e25700 1 -- 172.21.15.57:0/909023639 wait complete. 2023-10-06T03:01:42.797 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.790+0000 7fece7e25700 1 Processor -- start 2023-10-06T03:01:42.797 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.790+0000 7fece7e25700 1 -- start start 2023-10-06T03:01:42.799 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.794+0000 7fece7e25700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fece0067590 0x7fece0147c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:42.799 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.794+0000 7fece7e25700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fece0156d60 0x7fece01481b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:42.799 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.794+0000 7fece7e25700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fece015a510 0x7fece015a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:42.799 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.794+0000 7fece7e25700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fece00c0030 con 0x7fece015a510 2023-10-06T03:01:42.799 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.794+0000 7fece7e25700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fece00c0310 con 0x7fece0067590 2023-10-06T03:01:42.799 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.794+0000 7fece7e25700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fece00c05f0 con 0x7fece0156d60 2023-10-06T03:01:42.799 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.794+0000 7fece63c2700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fece015a510 0x7fece015a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:42.800 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.794+0000 7fece63c2700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fece015a510 0x7fece015a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60700/0 (socket says 172.21.15.57:60700) 2023-10-06T03:01:42.800 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.794+0000 7fece63c2700 1 -- 172.21.15.57:0/284673338 learned_addr learned my addr 172.21.15.57:0/284673338 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:42.800 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.794+0000 7fece5bc1700 1 --2- 172.21.15.57:0/284673338 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fece0067590 0x7fece0147c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:42.801 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.794+0000 7fece53c0700 1 --2- 172.21.15.57:0/284673338 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fece0156d60 0x7fece01481b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:42.801 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.794+0000 7fece63c2700 1 -- 172.21.15.57:0/284673338 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fece0156d60 msgr2=0x7fece01481b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:42.801 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.794+0000 7fece63c2700 1 --2- 172.21.15.57:0/284673338 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fece0156d60 0x7fece01481b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:42.801 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.794+0000 7fece63c2700 1 -- 172.21.15.57:0/284673338 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fece0067590 msgr2=0x7fece0147c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:42.801 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.794+0000 7fece63c2700 1 --2- 172.21.15.57:0/284673338 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fece0067590 0x7fece0147c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:42.801 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.794+0000 7fece63c2700 1 -- 172.21.15.57:0/284673338 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecd00094f0 con 0x7fece015a510 2023-10-06T03:01:42.801 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.794+0000 7fece63c2700 1 --2- 172.21.15.57:0/284673338 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fece015a510 0x7fece015a910 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fecd8009df0 tx=0x7fecd800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:42.801 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.794+0000 7fecd5ffb700 1 -- 172.21.15.57:0/284673338 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd800cb50 con 0x7fece015a510 2023-10-06T03:01:42.802 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.794+0000 7fecd5ffb700 1 -- 172.21.15.57:0/284673338 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecd800f040 con 0x7fece015a510 2023-10-06T03:01:42.802 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.794+0000 7fecd5ffb700 1 -- 172.21.15.57:0/284673338 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd8014480 con 0x7fece015a510 2023-10-06T03:01:42.802 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.794+0000 7fece7e25700 1 -- 172.21.15.57:0/284673338 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fece00c1f90 con 0x7fece015a510 2023-10-06T03:01:42.802 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.794+0000 7fece7e25700 1 -- 172.21.15.57:0/284673338 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fece0154680 con 0x7fece015a510 2023-10-06T03:01:42.803 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.798+0000 7fece7e25700 1 -- 172.21.15.57:0/284673338 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fece00c2180 con 0x7fece015a510 2023-10-06T03:01:42.804 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.798+0000 7fecd5ffb700 1 -- 172.21.15.57:0/284673338 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fecd8014830 con 0x7fece015a510 2023-10-06T03:01:42.805 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.798+0000 7fecd5ffb700 1 --2- 172.21.15.57:0/284673338 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fecc4060550 0x7fecc4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:42.805 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.798+0000 7fecd5ffb700 1 -- 172.21.15.57:0/284673338 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fecd807cf10 con 0x7fece015a510 2023-10-06T03:01:42.805 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.798+0000 7fece5bc1700 1 --2- 172.21.15.57:0/284673338 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fecc4060550 0x7fecc4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:42.807 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.802+0000 7fece5bc1700 1 --2- 172.21.15.57:0/284673338 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fecc4060550 0x7fecc4062a00 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fecdc003a80 tx=0x7fecdc007ec0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:42.812 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:42.806+0000 7fecd5ffb700 1 -- 172.21.15.57:0/284673338 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fecd804d650 con 0x7fece015a510 2023-10-06T03:01:43.042 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.034+0000 7fece7e25700 1 -- 172.21.15.57:0/284673338 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7fece004be40 con 0x7fece015a510 2023-10-06T03:01:43.050 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.042+0000 7fecd5ffb700 1 -- 172.21.15.57:0/284673338 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7fecd80180a0 con 0x7fece015a510 2023-10-06T03:01:43.054 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.046+0000 7fece7e25700 1 -- 172.21.15.57:0/284673338 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fecc4060550 msgr2=0x7fecc4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:43.054 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.046+0000 7fece7e25700 1 --2- 172.21.15.57:0/284673338 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fecc4060550 0x7fecc4062a00 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fecdc003a80 tx=0x7fecdc007ec0 comp rx=0 tx=0).stop 2023-10-06T03:01:43.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.046+0000 7fece7e25700 1 -- 172.21.15.57:0/284673338 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fece015a510 msgr2=0x7fece015a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:43.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.046+0000 7fece7e25700 1 --2- 172.21.15.57:0/284673338 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fece015a510 0x7fece015a910 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fecd8009df0 tx=0x7fecd800b040 comp rx=0 tx=0).stop 2023-10-06T03:01:43.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.046+0000 7fece7e25700 1 -- 172.21.15.57:0/284673338 shutdown_connections 2023-10-06T03:01:43.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.046+0000 7fece7e25700 1 --2- 172.21.15.57:0/284673338 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fece015a510 0x7fece015a910 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:43.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.046+0000 7fece7e25700 1 --2- 172.21.15.57:0/284673338 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fecc4060550 0x7fecc4062a00 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:43.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.046+0000 7fece7e25700 1 --2- 172.21.15.57:0/284673338 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fece0156d60 0x7fece01481b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:43.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.046+0000 7fece7e25700 1 --2- 172.21.15.57:0/284673338 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fece0067590 0x7fece0147c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:43.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.046+0000 7fece7e25700 1 -- 172.21.15.57:0/284673338 >> 172.21.15.57:0/284673338 conn(0x7fece00cbc90 msgr2=0x7fece00cadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:43.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.050+0000 7fece7e25700 1 -- 172.21.15.57:0/284673338 shutdown_connections 2023-10-06T03:01:43.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.050+0000 7fece7e25700 1 -- 172.21.15.57:0/284673338 wait complete. 2023-10-06T03:01:43.075 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:01:43.234 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.226+0000 7f0ec0065700 1 Processor -- start 2023-10-06T03:01:43.235 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.230+0000 7f0ec0065700 1 -- start start 2023-10-06T03:01:43.236 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.230+0000 7f0ec0065700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0eb815e600 0x7f0eb80675c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:43.237 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.230+0000 7f0ec0065700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0eb806da20 con 0x7f0eb80671f0 2023-10-06T03:01:43.237 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.230+0000 7f0ec0065700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0eb80b0650 con 0x7f0eb806deb0 2023-10-06T03:01:43.237 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.230+0000 7f0ec0065700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb815ea60 con 0x7f0eb815e600 2023-10-06T03:01:43.237 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.230+0000 7f0ebd600700 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f0eb806deb0 0x7f0eb815cee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.57:39898/0 (socket says 172.21.15.57:39898) 2023-10-06T03:01:43.237 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.230+0000 7f0ebd600700 1 -- 172.21.15.57:0/2990546080 learned_addr learned my addr 172.21.15.57:0/2990546080 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:01:43.238 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.230+0000 7f0ebe602700 1 --2- 172.21.15.57:0/2990546080 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0eb815e600 0x7f0eb80675c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:43.239 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.230+0000 7f0ebcdff700 1 -- 172.21.15.57:0/2990546080 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 175310644 0 0) 0x7f0eb806da20 con 0x7f0eb80671f0 2023-10-06T03:01:43.239 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.230+0000 7f0ebcdff700 1 -- 172.21.15.57:0/2990546080 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ea4003570 con 0x7f0eb80671f0 2023-10-06T03:01:43.239 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.234+0000 7f0ebcdff700 1 -- 172.21.15.57:0/2990546080 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1263128830 0 0) 0x7f0eb80b0650 con 0x7f0eb806deb0 2023-10-06T03:01:43.239 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.234+0000 7f0ebcdff700 1 -- 172.21.15.57:0/2990546080 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0eb806da20 con 0x7f0eb806deb0 2023-10-06T03:01:43.239 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.234+0000 7f0ebe602700 1 -- 172.21.15.57:0/2990546080 >> v1:172.21.15.105:6789/0 conn(0x7f0eb806deb0 legacy=0x7f0eb815cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:43.239 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.234+0000 7f0ebe602700 1 -- 172.21.15.57:0/2990546080 >> v1:172.21.15.57:6789/0 conn(0x7f0eb80671f0 legacy=0x7f0eb80aff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:43.239 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.234+0000 7f0ebe602700 1 -- 172.21.15.57:0/2990546080 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eb806ce10 con 0x7f0eb815e600 2023-10-06T03:01:43.240 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.234+0000 7f0ebe602700 1 --2- 172.21.15.57:0/2990546080 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0eb815e600 0x7f0eb80675c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0eb0009e90 tx=0x7f0eb0009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c44df28421a50001 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:43.240 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.234+0000 7f0ebcdff700 1 -- 172.21.15.57:0/2990546080 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb000e070 con 0x7f0eb815e600 2023-10-06T03:01:43.240 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.234+0000 7f0ebcdff700 1 -- 172.21.15.57:0/2990546080 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0eb000bb80 con 0x7f0eb815e600 2023-10-06T03:01:43.240 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.234+0000 7f0ebcdff700 1 -- 172.21.15.57:0/2990546080 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb0012430 con 0x7f0eb815e600 2023-10-06T03:01:43.241 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.234+0000 7f0ec0065700 1 -- 172.21.15.57:0/2990546080 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0eb815e600 msgr2=0x7f0eb80675c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:43.241 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.234+0000 7f0ec0065700 1 --2- 172.21.15.57:0/2990546080 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0eb815e600 0x7f0eb80675c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0eb0009e90 tx=0x7f0eb0009780 comp rx=0 tx=0).stop 2023-10-06T03:01:43.241 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.234+0000 7f0ec0065700 1 -- 172.21.15.57:0/2990546080 shutdown_connections 2023-10-06T03:01:43.241 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.234+0000 7f0ec0065700 1 --2- 172.21.15.57:0/2990546080 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0eb815e600 0x7f0eb80675c0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:43.241 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.234+0000 7f0ec0065700 1 -- 172.21.15.57:0/2990546080 >> 172.21.15.57:0/2990546080 conn(0x7f0eb80cbdd0 msgr2=0x7f0eb80cc1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:43.242 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.234+0000 7f0ec0065700 1 -- 172.21.15.57:0/2990546080 shutdown_connections 2023-10-06T03:01:43.242 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.234+0000 7f0ec0065700 1 -- 172.21.15.57:0/2990546080 wait complete. 2023-10-06T03:01:43.243 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.238+0000 7f0ec0065700 1 Processor -- start 2023-10-06T03:01:43.243 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.238+0000 7f0ec0065700 1 -- start start 2023-10-06T03:01:43.245 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.238+0000 7f0ec0065700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0eb80671f0 0x7f0eb8142c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:43.245 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.238+0000 7f0ec0065700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0eb806deb0 0x7f0eb80aad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:43.245 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.238+0000 7f0ec0065700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0eb815e600 0x7f0eb80ad700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:43.245 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.238+0000 7f0ec0065700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb81431c0 con 0x7f0eb806deb0 2023-10-06T03:01:43.245 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.238+0000 7f0ec0065700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb815af20 con 0x7f0eb80671f0 2023-10-06T03:01:43.245 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.238+0000 7f0ec0065700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb815a310 con 0x7f0eb815e600 2023-10-06T03:01:43.246 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.238+0000 7f0ebd600700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0eb806deb0 0x7f0eb80aad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:43.246 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.238+0000 7f0ebd600700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0eb806deb0 0x7f0eb80aad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60706/0 (socket says 172.21.15.57:60706) 2023-10-06T03:01:43.246 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.238+0000 7f0ebd600700 1 -- 172.21.15.57:0/537364303 learned_addr learned my addr 172.21.15.57:0/537364303 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:43.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.238+0000 7f0ebe602700 1 --2- 172.21.15.57:0/537364303 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0eb815e600 0x7f0eb80ad700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:43.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.238+0000 7f0ebde01700 1 --2- 172.21.15.57:0/537364303 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0eb80671f0 0x7f0eb8142c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:43.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.238+0000 7f0ebd600700 1 -- 172.21.15.57:0/537364303 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0eb815e600 msgr2=0x7f0eb80ad700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:43.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.238+0000 7f0ebd600700 1 --2- 172.21.15.57:0/537364303 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0eb815e600 0x7f0eb80ad700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:43.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.238+0000 7f0ebd600700 1 -- 172.21.15.57:0/537364303 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0eb80671f0 msgr2=0x7f0eb8142c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:43.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.238+0000 7f0ebd600700 1 --2- 172.21.15.57:0/537364303 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0eb80671f0 0x7f0eb8142c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:43.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.238+0000 7f0ebd600700 1 -- 172.21.15.57:0/537364303 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eb0009a20 con 0x7f0eb806deb0 2023-10-06T03:01:43.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.238+0000 7f0ebd600700 1 --2- 172.21.15.57:0/537364303 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0eb806deb0 0x7f0eb80aad00 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f0ea800c7c0 tx=0x7f0ea8007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:43.248 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.242+0000 7f0eadffb700 1 -- 172.21.15.57:0/537364303 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea8005b30 con 0x7f0eb806deb0 2023-10-06T03:01:43.248 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.242+0000 7f0eadffb700 1 -- 172.21.15.57:0/537364303 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ea8005c90 con 0x7f0eb806deb0 2023-10-06T03:01:43.248 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.242+0000 7f0eadffb700 1 -- 172.21.15.57:0/537364303 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea8007340 con 0x7f0eb806deb0 2023-10-06T03:01:43.248 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.242+0000 7f0ec0065700 1 -- 172.21.15.57:0/537364303 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0eb815a5f0 con 0x7f0eb806deb0 2023-10-06T03:01:43.248 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.242+0000 7f0ec0065700 1 -- 172.21.15.57:0/537364303 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0eb815abb0 con 0x7f0eb806deb0 2023-10-06T03:01:43.249 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.242+0000 7f0ec0065700 1 -- 172.21.15.57:0/537364303 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0eb80712e0 con 0x7f0eb806deb0 2023-10-06T03:01:43.250 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.242+0000 7f0eadffb700 1 -- 172.21.15.57:0/537364303 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f0ea801b400 con 0x7f0eb806deb0 2023-10-06T03:01:43.251 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.246+0000 7f0eadffb700 1 --2- 172.21.15.57:0/537364303 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f0e9c060580 0x7f0e9c062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:43.251 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.246+0000 7f0eadffb700 1 -- 172.21.15.57:0/537364303 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f0ea807c040 con 0x7f0eb806deb0 2023-10-06T03:01:43.252 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.246+0000 7f0ebde01700 1 --2- 172.21.15.57:0/537364303 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f0e9c060580 0x7f0e9c062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:43.253 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.246+0000 7f0ebde01700 1 --2- 172.21.15.57:0/537364303 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f0e9c060580 0x7f0e9c062a30 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0eb4003870 tx=0x7f0eb4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:43.257 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.250+0000 7f0eadffb700 1 -- 172.21.15.57:0/537364303 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f0ea804c8a0 con 0x7f0eb806deb0 2023-10-06T03:01:43.436 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.430+0000 7f0ec0065700 1 -- 172.21.15.57:0/537364303 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0eb806d0f0 con 0x7f0eb806deb0 2023-10-06T03:01:43.438 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.430+0000 7f0eadffb700 1 -- 172.21.15.57:0/537364303 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+13650 (secure 0 0 0) 0x7f0ea804fec0 con 0x7f0eb806deb0 2023-10-06T03:01:43.438 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:01:43.438 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":31,"fsid":"eb56dc0f-9213-41cb-9aad-8ade6c802e98","created":"2023-10-06T03:00:30.806197+0000","modified":"2023-10-06T03:01:39.891812+0000","last_up_change":"2023-10-06T03:00:43.607454+0000","last_in_change":"2023-10-06T03:00:33.943513+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T03:00:44.360651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T03:00:50.466601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"58cf6c90-d704-43e0-b2db-dffe526d5e8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":33053},{"type":"v1","addr":"172.21.15.57:6801","nonce":33053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":33053},{"type":"v1","addr":"172.21.15.57:6803","nonce":33053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":33053},{"type":"v1","addr":"172.21.15.57:6807","nonce":33053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":33053},{"type":"v1","addr":"172.21.15.57:6805","nonce":33053}]},"public_addr":"172.21.15.57:6801/33053","cluster_addr":"172.21.15.57:6803/33053","heartbeat_back_addr":"172.21.15.57:6807/33053","heartbeat_front_addr":"172.21.15.57:6805/33053","state":["exists","up"]},{"osd":1,"uuid":"16afbe70-7f9e-4568-9c92-763e6e348119","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6809","nonce":33052},{"type":"v1","addr":"172.21.15.57:6810","nonce":33052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":33052},{"type":"v1","addr":"172.21.15.57:6813","nonce":33052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":33052},{"type":"v1","addr":"172.21.15.57:6822","nonce":33052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6815","nonce":33052},{"type":"v1","addr":"172.21.15.57:6818","nonce":33052}]},"public_addr":"172.21.15.57:6810/33052","cluster_addr":"172.21.15.57:6813/33052","heartbeat_back_addr":"172.21.15.57:6822/33052","heartbeat_front_addr":"172.21.15.57:6818/33052","state":["exists","up"]},{"osd":2,"uuid":"7255c62e-f92f-470f-a5ce-30228920d9f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":33058},{"type":"v1","addr":"172.21.15.57:6825","nonce":33058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":33058},{"type":"v1","addr":"172.21.15.57:6827","nonce":33058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":33058},{"type":"v1","addr":"172.21.15.57:6831","nonce":33058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":33058},{"type":"v1","addr":"172.21.15.57:6829","nonce":33058}]},"public_addr":"172.21.15.57:6825/33058","cluster_addr":"172.21.15.57:6827/33058","heartbeat_back_addr":"172.21.15.57:6831/33058","heartbeat_front_addr":"172.21.15.57:6829/33058","state":["exists","up"]},{"osd":3,"uuid":"152a236d-f799-4888-8544-74865508d5a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":33057},{"type":"v1","addr":"172.21.15.57:6811","nonce":33057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":33057},{"type":"v1","addr":"172.21.15.57:6816","nonce":33057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6821","nonce":33057},{"type":"v1","addr":"172.21.15.57:6823","nonce":33057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6817","nonce":33057},{"type":"v1","addr":"172.21.15.57:6819","nonce":33057}]},"public_addr":"172.21.15.57:6811/33057","cluster_addr":"172.21.15.57:6816/33057","heartbeat_back_addr":"172.21.15.57:6823/33057","heartbeat_front_addr":"172.21.15.57:6819/33057","state":["exists","up"]},{"osd":4,"uuid":"37db2a65-3566-41d0-9d60-e66c49e1e68e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":33368},{"type":"v1","addr":"172.21.15.105:6801","nonce":33368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":33368},{"type":"v1","addr":"172.21.15.105:6803","nonce":33368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":33368},{"type":"v1","addr":"172.21.15.105:6807","nonce":33368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":33368},{"type":"v1","addr":"172.21.15.105:6805","nonce":33368}]},"public_addr":"172.21.15.105:6801/33368","cluster_addr":"172.21.15.105:6803/33368","heartbeat_back_addr":"172.21.15.105:6807/33368","heartbeat_front_addr":"172.21.15.105:6805/33368","state":["exists","up"]},{"osd":5,"uuid":"35e77918-1bb4-42ca-9b20-f3c14eaa0c04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":33379},{"type":"v1","addr":"172.21.15.105:6818","nonce":33379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":33379},{"type":"v1","addr":"172.21.15.105:6823","nonce":33379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":33379},{"type":"v1","addr":"172.21.15.105:6831","nonce":33379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":33379},{"type":"v1","addr":"172.21.15.105:6827","nonce":33379}]},"public_addr":"172.21.15.105:6818/33379","cluster_addr":"172.21.15.105:6823/33379","heartbeat_back_addr":"172.21.15.105:6831/33379","heartbeat_front_addr":"172.21.15.105:6827/33379","state":["exists","up"]},{"osd":6,"uuid":"b4d9d510-7a45-4173-8287-c6c8d6547f2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":33369},{"type":"v1","addr":"172.21.15.105:6819","nonce":33369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":33369},{"type":"v1","addr":"172.21.15.105:6822","nonce":33369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":33369},{"type":"v1","addr":"172.21.15.105:6830","nonce":33369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":33369},{"type":"v1","addr":"172.21.15.105:6826","nonce":33369}]},"public_addr":"172.21.15.105:6819/33369","cluster_addr":"172.21.15.105:6822/33369","heartbeat_back_addr":"172.21.15.105:6830/33369","heartbeat_front_addr":"172.21.15.105:6826/33369","state":["exists","up"]},{"osd":7,"uuid":"74266fb0-cd84-463f-8bf0-092652a71dc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":33370},{"type":"v1","addr":"172.21.15.105:6809","nonce":33370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":33370},{"type":"v1","addr":"172.21.15.105:6811","nonce":33370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":33370},{"type":"v1","addr":"172.21.15.105:6815","nonce":33370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":33370},{"type":"v1","addr":"172.21.15.105:6813","nonce":33370}]},"public_addr":"172.21.15.105:6809/33370","cluster_addr":"172.21.15.105:6811/33370","heartbeat_back_addr":"172.21.15.105:6815/33370","heartbeat_front_addr":"172.21.15.105:6813/33370","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.596864+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.633851+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.636993+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.529681+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.608601+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.659752+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.661717+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.642221+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:01:43.443 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.434+0000 7f0ec0065700 1 -- 172.21.15.57:0/537364303 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f0e9c060580 msgr2=0x7f0e9c062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:43.443 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.434+0000 7f0ec0065700 1 --2- 172.21.15.57:0/537364303 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f0e9c060580 0x7f0e9c062a30 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0eb4003870 tx=0x7f0eb4009040 comp rx=0 tx=0).stop 2023-10-06T03:01:43.443 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.438+0000 7f0ec0065700 1 -- 172.21.15.57:0/537364303 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0eb806deb0 msgr2=0x7f0eb80aad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:43.443 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.438+0000 7f0ec0065700 1 --2- 172.21.15.57:0/537364303 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0eb806deb0 0x7f0eb80aad00 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f0ea800c7c0 tx=0x7f0ea8007e00 comp rx=0 tx=0).stop 2023-10-06T03:01:43.443 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.438+0000 7f0ec0065700 1 -- 172.21.15.57:0/537364303 shutdown_connections 2023-10-06T03:01:43.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.438+0000 7f0ec0065700 1 --2- 172.21.15.57:0/537364303 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f0e9c060580 0x7f0e9c062a30 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:43.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.438+0000 7f0ec0065700 1 --2- 172.21.15.57:0/537364303 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0eb815e600 0x7f0eb80ad700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:43.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.438+0000 7f0ec0065700 1 --2- 172.21.15.57:0/537364303 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0eb806deb0 0x7f0eb80aad00 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:43.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.438+0000 7f0ec0065700 1 --2- 172.21.15.57:0/537364303 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0eb80671f0 0x7f0eb8142c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:43.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.438+0000 7f0ec0065700 1 -- 172.21.15.57:0/537364303 >> 172.21.15.57:0/537364303 conn(0x7f0eb80cbdd0 msgr2=0x7f0eb815c3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:43.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.438+0000 7f0ec0065700 1 -- 172.21.15.57:0/537364303 shutdown_connections 2023-10-06T03:01:43.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.438+0000 7f0ec0065700 1 -- 172.21.15.57:0/537364303 wait complete. 2023-10-06T03:01:43.464 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T03:00:44.360651+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T03:00:50.466601+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-10-06T03:01:43.464 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T03:01:43.636 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.630+0000 7f19ca945700 1 Processor -- start 2023-10-06T03:01:43.636 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.630+0000 7f19ca945700 1 -- start start 2023-10-06T03:01:43.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.634+0000 7f19ca945700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f19c40c5ce0 0x7f19c40c60b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:43.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.634+0000 7f19ca945700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19c406b0e0 con 0x7f19c40cb0f0 2023-10-06T03:01:43.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.634+0000 7f19ca945700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19c40cb560 con 0x7f19c4142d40 2023-10-06T03:01:43.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.634+0000 7f19ca945700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19c40cc3a0 con 0x7f19c40c5ce0 2023-10-06T03:01:43.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.634+0000 7f19c37fe700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f19c40cb0f0 0x7f19c4142630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:57092/0 (socket says 172.21.15.57:57092) 2023-10-06T03:01:43.641 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.634+0000 7f19c37fe700 1 -- 172.21.15.57:0/1647250857 learned_addr learned my addr 172.21.15.57:0/1647250857 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:01:43.641 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.634+0000 7f19c3fff700 1 --2- 172.21.15.57:0/1647250857 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f19c40c5ce0 0x7f19c40c60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:43.641 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.634+0000 7f19c2ffd700 1 -- 172.21.15.57:0/1647250857 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 503500070 0 0) 0x7f19c406b0e0 con 0x7f19c40cb0f0 2023-10-06T03:01:43.642 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.634+0000 7f19c2ffd700 1 -- 172.21.15.57:0/1647250857 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19ac003570 con 0x7f19c40cb0f0 2023-10-06T03:01:43.642 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.634+0000 7f19c2ffd700 1 -- 172.21.15.57:0/1647250857 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 640123270 0 0) 0x7f19c40cb560 con 0x7f19c4142d40 2023-10-06T03:01:43.642 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.634+0000 7f19c2ffd700 1 -- 172.21.15.57:0/1647250857 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19c406b0e0 con 0x7f19c4142d40 2023-10-06T03:01:43.642 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.634+0000 7f19c3fff700 1 -- 172.21.15.57:0/1647250857 >> v1:172.21.15.105:6789/0 conn(0x7f19c4142d40 legacy=0x7f19c406c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:43.642 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.634+0000 7f19c3fff700 1 -- 172.21.15.57:0/1647250857 >> v1:172.21.15.57:6789/0 conn(0x7f19c40cb0f0 legacy=0x7f19c4142630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:43.642 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.634+0000 7f19c3fff700 1 -- 172.21.15.57:0/1647250857 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19c40cb790 con 0x7f19c40c5ce0 2023-10-06T03:01:43.642 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.638+0000 7f19c3fff700 1 --2- 172.21.15.57:0/1647250857 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f19c40c5ce0 0x7f19c40c60b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f19b4009910 tx=0x7f19b40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=644eab9bc08fdc95 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:43.643 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.638+0000 7f19c2ffd700 1 -- 172.21.15.57:0/1647250857 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b4011630 con 0x7f19c40c5ce0 2023-10-06T03:01:43.644 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.638+0000 7f19c2ffd700 1 -- 172.21.15.57:0/1647250857 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19b4011790 con 0x7f19c40c5ce0 2023-10-06T03:01:43.644 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.638+0000 7f19c2ffd700 1 -- 172.21.15.57:0/1647250857 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b4011b30 con 0x7f19c40c5ce0 2023-10-06T03:01:43.644 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.638+0000 7f19ca945700 1 -- 172.21.15.57:0/1647250857 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f19c40c5ce0 msgr2=0x7f19c40c60b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:43.644 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.638+0000 7f19ca945700 1 --2- 172.21.15.57:0/1647250857 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f19c40c5ce0 0x7f19c40c60b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f19b4009910 tx=0x7f19b40091a0 comp rx=0 tx=0).stop 2023-10-06T03:01:43.645 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.638+0000 7f19ca945700 1 -- 172.21.15.57:0/1647250857 shutdown_connections 2023-10-06T03:01:43.645 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.638+0000 7f19ca945700 1 --2- 172.21.15.57:0/1647250857 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f19c40c5ce0 0x7f19c40c60b0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:43.645 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.638+0000 7f19ca945700 1 -- 172.21.15.57:0/1647250857 >> 172.21.15.57:0/1647250857 conn(0x7f19c40ccbd0 msgr2=0x7f19c40ccfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:43.645 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.638+0000 7f19ca945700 1 -- 172.21.15.57:0/1647250857 shutdown_connections 2023-10-06T03:01:43.645 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.638+0000 7f19ca945700 1 -- 172.21.15.57:0/1647250857 wait complete. 2023-10-06T03:01:43.646 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.638+0000 7f19ca945700 1 Processor -- start 2023-10-06T03:01:43.646 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.642+0000 7f19ca945700 1 -- start start 2023-10-06T03:01:43.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.642+0000 7f19ca945700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f19c40c5ce0 0x7f19c40a9bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:43.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.642+0000 7f19ca945700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f19c40cb0f0 0x7f19c40c9360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:43.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.642+0000 7f19ca945700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f19c4142d40 0x7f19c40c98a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:43.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.642+0000 7f19ca945700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19c40aa0f0 con 0x7f19c40c5ce0 2023-10-06T03:01:43.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.642+0000 7f19ca945700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19c415a4b0 con 0x7f19c40cb0f0 2023-10-06T03:01:43.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.642+0000 7f19ca945700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19c4159b80 con 0x7f19c4142d40 2023-10-06T03:01:43.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.642+0000 7f19c3fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f19c40c5ce0 0x7f19c40a9bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:43.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.642+0000 7f19c3fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f19c40c5ce0 0x7f19c40a9bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60712/0 (socket says 172.21.15.57:60712) 2023-10-06T03:01:43.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.642+0000 7f19c3fff700 1 -- 172.21.15.57:0/3606371414 learned_addr learned my addr 172.21.15.57:0/3606371414 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:43.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.642+0000 7f19c37fe700 1 --2- 172.21.15.57:0/3606371414 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f19c40cb0f0 0x7f19c40c9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:43.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.642+0000 7f19c8ee2700 1 --2- 172.21.15.57:0/3606371414 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f19c4142d40 0x7f19c40c98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:43.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.642+0000 7f19c3fff700 1 -- 172.21.15.57:0/3606371414 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f19c4142d40 msgr2=0x7f19c40c98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:43.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.642+0000 7f19c3fff700 1 --2- 172.21.15.57:0/3606371414 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f19c4142d40 0x7f19c40c98a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:43.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.642+0000 7f19c3fff700 1 -- 172.21.15.57:0/3606371414 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f19c40cb0f0 msgr2=0x7f19c40c9360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:43.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.642+0000 7f19c3fff700 1 --2- 172.21.15.57:0/3606371414 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f19c40cb0f0 0x7f19c40c9360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:43.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.642+0000 7f19c3fff700 1 -- 172.21.15.57:0/3606371414 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19b4009420 con 0x7f19c40c5ce0 2023-10-06T03:01:43.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.642+0000 7f19c37fe700 1 --2- 172.21.15.57:0/3606371414 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f19c40cb0f0 0x7f19c40c9360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:43.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.642+0000 7f19c3fff700 1 --2- 172.21.15.57:0/3606371414 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f19c40c5ce0 0x7f19c40a9bb0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f19b4009f00 tx=0x7f19b4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:43.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.642+0000 7f19abfff700 1 -- 172.21.15.57:0/3606371414 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b401f070 con 0x7f19c40c5ce0 2023-10-06T03:01:43.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.642+0000 7f19abfff700 1 -- 172.21.15.57:0/3606371414 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19b4000bc0 con 0x7f19c40c5ce0 2023-10-06T03:01:43.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.642+0000 7f19ca945700 1 -- 172.21.15.57:0/3606371414 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19c4159e60 con 0x7f19c40c5ce0 2023-10-06T03:01:43.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.642+0000 7f19abfff700 1 -- 172.21.15.57:0/3606371414 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b4025420 con 0x7f19c40c5ce0 2023-10-06T03:01:43.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.642+0000 7f19ca945700 1 -- 172.21.15.57:0/3606371414 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19c415a940 con 0x7f19c40c5ce0 2023-10-06T03:01:43.652 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.646+0000 7f19ca945700 1 -- 172.21.15.57:0/3606371414 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19c40712e0 con 0x7f19c40c5ce0 2023-10-06T03:01:43.653 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.646+0000 7f19abfff700 1 -- 172.21.15.57:0/3606371414 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f19b4023070 con 0x7f19c40c5ce0 2023-10-06T03:01:43.655 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.650+0000 7f19abfff700 1 --2- 172.21.15.57:0/3606371414 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f19b0060550 0x7f19b0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:43.655 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.650+0000 7f19abfff700 1 -- 172.21.15.57:0/3606371414 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f19b407d9e0 con 0x7f19c40c5ce0 2023-10-06T03:01:43.655 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.650+0000 7f19c37fe700 1 --2- 172.21.15.57:0/3606371414 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f19b0060550 0x7f19b0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:43.656 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.650+0000 7f19c37fe700 1 --2- 172.21.15.57:0/3606371414 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f19b0060550 0x7f19b0062a00 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f19c40cea80 tx=0x7f19b8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:43.660 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.654+0000 7f19abfff700 1 -- 172.21.15.57:0/3606371414 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f19b404e120 con 0x7f19c40c5ce0 2023-10-06T03:01:43.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.826+0000 7f19ca945700 1 -- 172.21.15.57:0/3606371414 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f19c406ab90 con 0x7f19c40c5ce0 2023-10-06T03:01:43.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.826+0000 7f19abfff700 1 -- 172.21.15.57:0/3606371414 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7f19b40150a0 con 0x7f19c40c5ce0 2023-10-06T03:01:43.833 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2023-10-06T03:01:43.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.830+0000 7f19ca945700 1 -- 172.21.15.57:0/3606371414 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f19b0060550 msgr2=0x7f19b0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:43.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.830+0000 7f19ca945700 1 --2- 172.21.15.57:0/3606371414 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f19b0060550 0x7f19b0062a00 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f19c40cea80 tx=0x7f19b8009040 comp rx=0 tx=0).stop 2023-10-06T03:01:43.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.830+0000 7f19ca945700 1 -- 172.21.15.57:0/3606371414 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f19c40c5ce0 msgr2=0x7f19c40a9bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:43.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.830+0000 7f19ca945700 1 --2- 172.21.15.57:0/3606371414 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f19c40c5ce0 0x7f19c40a9bb0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f19b4009f00 tx=0x7f19b4017000 comp rx=0 tx=0).stop 2023-10-06T03:01:43.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.830+0000 7f19ca945700 1 -- 172.21.15.57:0/3606371414 shutdown_connections 2023-10-06T03:01:43.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.830+0000 7f19ca945700 1 --2- 172.21.15.57:0/3606371414 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f19b0060550 0x7f19b0062a00 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:43.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.830+0000 7f19ca945700 1 --2- 172.21.15.57:0/3606371414 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f19c4142d40 0x7f19c40c98a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:43.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.830+0000 7f19ca945700 1 --2- 172.21.15.57:0/3606371414 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f19c40cb0f0 0x7f19c40c9360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:43.837 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.830+0000 7f19ca945700 1 --2- 172.21.15.57:0/3606371414 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f19c40c5ce0 0x7f19c40a9bb0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:43.837 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.830+0000 7f19ca945700 1 -- 172.21.15.57:0/3606371414 >> 172.21.15.57:0/3606371414 conn(0x7f19c40ccbd0 msgr2=0x7f19c4141ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:43.837 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.830+0000 7f19ca945700 1 -- 172.21.15.57:0/3606371414 shutdown_connections 2023-10-06T03:01:43.837 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:43.830+0000 7f19ca945700 1 -- 172.21.15.57:0/3606371414 wait complete. 2023-10-06T03:01:43.857 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T03:01:44.027 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.022+0000 7f6b6a665700 1 Processor -- start 2023-10-06T03:01:44.027 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.022+0000 7f6b6a665700 1 -- start start 2023-10-06T03:01:44.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.026+0000 7f6b6a665700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6b64156e20 0x7f6b640adf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:44.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.026+0000 7f6b6a665700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b6406afd0 con 0x7f6b640aeb10 2023-10-06T03:01:44.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.026+0000 7f6b6a665700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b6406d740 con 0x7f6b641571f0 2023-10-06T03:01:44.032 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.026+0000 7f6b6a665700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b640ac6c0 con 0x7f6b64156e20 2023-10-06T03:01:44.032 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.026+0000 7f6b63fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6b64156e20 0x7f6b640adf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:44.032 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.026+0000 7f6b63fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6b64156e20 0x7f6b640adf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60728/0 (socket says 172.21.15.57:60728) 2023-10-06T03:01:44.032 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.026+0000 7f6b63fff700 1 -- 172.21.15.57:0/3898121477 learned_addr learned my addr 172.21.15.57:0/3898121477 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:44.032 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.026+0000 7f6b63fff700 1 -- 172.21.15.57:0/3898121477 >> v1:172.21.15.105:6789/0 conn(0x7f6b641571f0 legacy=0x7f6b6406d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:44.032 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.026+0000 7f6b63fff700 1 -- 172.21.15.57:0/3898121477 >> v1:172.21.15.57:6789/0 conn(0x7f6b640aeb10 legacy=0x7f6b6406c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:44.032 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.026+0000 7f6b63fff700 1 -- 172.21.15.57:0/3898121477 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b640ac9a0 con 0x7f6b64156e20 2023-10-06T03:01:44.033 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.026+0000 7f6b63fff700 1 --2- 172.21.15.57:0/3898121477 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b64156e20 0x7f6b640adf80 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f6b540099b0 tx=0x7f6b54009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=437f5d452f8c90c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:44.033 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.026+0000 7f6b62ffd700 1 -- 172.21.15.57:0/3898121477 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b5400b7e0 con 0x7f6b64156e20 2023-10-06T03:01:44.033 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.026+0000 7f6b62ffd700 1 -- 172.21.15.57:0/3898121477 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b5400b940 con 0x7f6b64156e20 2023-10-06T03:01:44.033 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.026+0000 7f6b62ffd700 1 -- 172.21.15.57:0/3898121477 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b5400bce0 con 0x7f6b64156e20 2023-10-06T03:01:44.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.026+0000 7f6b6a665700 1 -- 172.21.15.57:0/3898121477 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b64156e20 msgr2=0x7f6b640adf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:44.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.026+0000 7f6b6a665700 1 --2- 172.21.15.57:0/3898121477 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b64156e20 0x7f6b640adf80 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f6b540099b0 tx=0x7f6b54009250 comp rx=0 tx=0).stop 2023-10-06T03:01:44.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.026+0000 7f6b6a665700 1 -- 172.21.15.57:0/3898121477 shutdown_connections 2023-10-06T03:01:44.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.026+0000 7f6b6a665700 1 --2- 172.21.15.57:0/3898121477 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b64156e20 0x7f6b640adf80 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:44.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.026+0000 7f6b6a665700 1 -- 172.21.15.57:0/3898121477 >> 172.21.15.57:0/3898121477 conn(0x7f6b640c87b0 msgr2=0x7f6b640c8bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:44.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.026+0000 7f6b6a665700 1 -- 172.21.15.57:0/3898121477 shutdown_connections 2023-10-06T03:01:44.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.026+0000 7f6b6a665700 1 -- 172.21.15.57:0/3898121477 wait complete. 2023-10-06T03:01:44.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.030+0000 7f6b6a665700 1 Processor -- start 2023-10-06T03:01:44.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.030+0000 7f6b6a665700 1 -- start start 2023-10-06T03:01:44.038 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.030+0000 7f6b6a665700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6b640aeb10 0x7f6b640a4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:44.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.034+0000 7f6b6a665700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6b64156e20 0x7f6b641576a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:44.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.034+0000 7f6b6a665700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b641571f0 0x7f6b64157be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:44.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.034+0000 7f6b6a665700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b64158e90 con 0x7f6b641571f0 2023-10-06T03:01:44.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.034+0000 7f6b6a665700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b64158280 con 0x7f6b640aeb10 2023-10-06T03:01:44.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.034+0000 7f6b6a665700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b64158560 con 0x7f6b64156e20 2023-10-06T03:01:44.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.034+0000 7f6b68c02700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b641571f0 0x7f6b64157be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:44.040 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.034+0000 7f6b63fff700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6b640aeb10 0x7f6b640a4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:44.040 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.034+0000 7f6b68c02700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b641571f0 0x7f6b64157be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60744/0 (socket says 172.21.15.57:60744) 2023-10-06T03:01:44.040 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.034+0000 7f6b68c02700 1 -- 172.21.15.57:0/536621756 learned_addr learned my addr 172.21.15.57:0/536621756 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:44.040 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.034+0000 7f6b637fe700 1 --2- 172.21.15.57:0/536621756 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6b64156e20 0x7f6b641576a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:44.040 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.034+0000 7f6b68c02700 1 -- 172.21.15.57:0/536621756 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6b64156e20 msgr2=0x7f6b641576a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:44.040 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.034+0000 7f6b68c02700 1 --2- 172.21.15.57:0/536621756 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6b64156e20 0x7f6b641576a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:44.041 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.034+0000 7f6b68c02700 1 -- 172.21.15.57:0/536621756 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6b640aeb10 msgr2=0x7f6b640a4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:44.041 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.034+0000 7f6b68c02700 1 --2- 172.21.15.57:0/536621756 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6b640aeb10 0x7f6b640a4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:44.041 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.034+0000 7f6b68c02700 1 -- 172.21.15.57:0/536621756 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b540094f0 con 0x7f6b641571f0 2023-10-06T03:01:44.041 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.034+0000 7f6b68c02700 1 --2- 172.21.15.57:0/536621756 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b641571f0 0x7f6b64157be0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c00bbb0 tx=0x7f6b5c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:44.041 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.034+0000 7f6b4bfff700 1 -- 172.21.15.57:0/536621756 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b5c00c630 con 0x7f6b641571f0 2023-10-06T03:01:44.042 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.034+0000 7f6b4bfff700 1 -- 172.21.15.57:0/536621756 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b5c00c7b0 con 0x7f6b641571f0 2023-10-06T03:01:44.042 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.034+0000 7f6b6a665700 1 -- 172.21.15.57:0/536621756 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b64158840 con 0x7f6b641571f0 2023-10-06T03:01:44.042 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.034+0000 7f6b4bfff700 1 -- 172.21.15.57:0/536621756 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b5c00cb70 con 0x7f6b641571f0 2023-10-06T03:01:44.042 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.034+0000 7f6b6a665700 1 -- 172.21.15.57:0/536621756 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b640a5130 con 0x7f6b641571f0 2023-10-06T03:01:44.043 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.038+0000 7f6b6a665700 1 -- 172.21.15.57:0/536621756 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b64159040 con 0x7f6b641571f0 2023-10-06T03:01:44.044 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.038+0000 7f6b4bfff700 1 -- 172.21.15.57:0/536621756 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f6b5c012070 con 0x7f6b641571f0 2023-10-06T03:01:44.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.038+0000 7f6b4bfff700 1 --2- 172.21.15.57:0/536621756 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f6b50060550 0x7f6b50062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:44.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.038+0000 7f6b4bfff700 1 -- 172.21.15.57:0/536621756 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f6b5c07c1b0 con 0x7f6b641571f0 2023-10-06T03:01:44.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.038+0000 7f6b63fff700 1 --2- 172.21.15.57:0/536621756 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f6b50060550 0x7f6b50062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:44.047 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.042+0000 7f6b63fff700 1 --2- 172.21.15.57:0/536621756 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f6b50060550 0x7f6b50062a00 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f6b540099b0 tx=0x7f6b54016000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:44.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.046+0000 7f6b4bfff700 1 -- 172.21.15.57:0/536621756 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f6b64159040 con 0x7f6b641571f0 2023-10-06T03:01:44.225 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.218+0000 7f6b6a665700 1 -- 172.21.15.57:0/536621756 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f6b640712e0 con 0x7f6b641571f0 2023-10-06T03:01:44.226 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.218+0000 7f6b4bfff700 1 -- 172.21.15.57:0/536621756 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v31) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6b5c04c8f0 con 0x7f6b641571f0 2023-10-06T03:01:44.226 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2023-10-06T03:01:44.231 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.226+0000 7f6b6a665700 1 -- 172.21.15.57:0/536621756 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f6b50060550 msgr2=0x7f6b50062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:44.231 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.226+0000 7f6b6a665700 1 --2- 172.21.15.57:0/536621756 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f6b50060550 0x7f6b50062a00 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f6b540099b0 tx=0x7f6b54016000 comp rx=0 tx=0).stop 2023-10-06T03:01:44.231 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.226+0000 7f6b6a665700 1 -- 172.21.15.57:0/536621756 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b641571f0 msgr2=0x7f6b64157be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:44.231 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.226+0000 7f6b6a665700 1 --2- 172.21.15.57:0/536621756 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b641571f0 0x7f6b64157be0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c00bbb0 tx=0x7f6b5c009840 comp rx=0 tx=0).stop 2023-10-06T03:01:44.231 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.226+0000 7f6b6a665700 1 -- 172.21.15.57:0/536621756 shutdown_connections 2023-10-06T03:01:44.231 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.226+0000 7f6b6a665700 1 --2- 172.21.15.57:0/536621756 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b641571f0 0x7f6b64157be0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:44.231 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.226+0000 7f6b6a665700 1 --2- 172.21.15.57:0/536621756 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f6b50060550 0x7f6b50062a00 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:44.231 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.226+0000 7f6b6a665700 1 --2- 172.21.15.57:0/536621756 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6b64156e20 0x7f6b641576a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:44.232 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.226+0000 7f6b6a665700 1 --2- 172.21.15.57:0/536621756 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6b640aeb10 0x7f6b640a4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:44.232 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.226+0000 7f6b6a665700 1 -- 172.21.15.57:0/536621756 >> 172.21.15.57:0/536621756 conn(0x7f6b640c87b0 msgr2=0x7f6b64155f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:44.232 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.226+0000 7f6b6a665700 1 -- 172.21.15.57:0/536621756 shutdown_connections 2023-10-06T03:01:44.232 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.226+0000 7f6b6a665700 1 -- 172.21.15.57:0/536621756 wait complete. 2023-10-06T03:01:44.252 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-06T03:01:44.418 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.410+0000 7ff61f545700 1 Processor -- start 2023-10-06T03:01:44.419 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.414+0000 7ff61f545700 1 -- start start 2023-10-06T03:01:44.421 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.414+0000 7ff61f545700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff6180b10c0 0x7ff61815b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:44.421 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.414+0000 7ff61f545700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7ff6180b1490 0x7ff618154680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:44.421 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.414+0000 7ff61f545700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff618154bc0 0x7ff6181575d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:44.421 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.414+0000 7ff61f545700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6180b1910 con 0x7ff6180b10c0 2023-10-06T03:01:44.421 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.414+0000 7ff61f545700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff61806bb10 con 0x7ff6180b1490 2023-10-06T03:01:44.421 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.414+0000 7ff61f545700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff618154fe0 con 0x7ff618154bc0 2023-10-06T03:01:44.422 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.414+0000 7ff61d2e1700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff6180b10c0 0x7ff61815b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:44.422 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.414+0000 7ff61cae0700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7ff6180b1490 0x7ff618154680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:44.423 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.414+0000 7ff61cae0700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7ff6180b1490 0x7ff618154680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.57:40880/0 (socket says 172.21.15.57:40880) 2023-10-06T03:01:44.423 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.414+0000 7ff61cae0700 1 -- 172.21.15.57:0/3189229693 learned_addr learned my addr 172.21.15.57:0/3189229693 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:44.423 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.414+0000 7ff61d2e1700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff6180b10c0 0x7ff61815b750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60750/0 (socket says 172.21.15.57:60750) 2023-10-06T03:01:44.423 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.414+0000 7ff61dae2700 1 --2- 172.21.15.57:0/3189229693 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff618154bc0 0x7ff6181575d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:44.423 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.414+0000 7ff61d2e1700 1 -- 172.21.15.57:0/3189229693 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff618154bc0 msgr2=0x7ff6181575d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:44.423 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.414+0000 7ff61d2e1700 1 --2- 172.21.15.57:0/3189229693 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff618154bc0 0x7ff6181575d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:44.423 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.414+0000 7ff61d2e1700 1 -- 172.21.15.57:0/3189229693 >> v2:172.21.15.105:3300/0 conn(0x7ff6180b1490 msgr2=0x7ff618154680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:44.423 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.414+0000 7ff61d2e1700 1 --2- 172.21.15.57:0/3189229693 >> v2:172.21.15.105:3300/0 conn(0x7ff6180b1490 0x7ff618154680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:44.423 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.414+0000 7ff61d2e1700 1 -- 172.21.15.57:0/3189229693 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff618158530 con 0x7ff6180b10c0 2023-10-06T03:01:44.424 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.418+0000 7ff61d2e1700 1 --2- 172.21.15.57:0/3189229693 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff6180b10c0 0x7ff61815b750 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ff6180ccec0 tx=0x7ff6140091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a498f4d9d98611b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:44.424 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.418+0000 7ff60ffff700 1 -- 172.21.15.57:0/3189229693 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff614011630 con 0x7ff6180b10c0 2023-10-06T03:01:44.424 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.418+0000 7ff60ffff700 1 -- 172.21.15.57:0/3189229693 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff614011790 con 0x7ff6180b10c0 2023-10-06T03:01:44.424 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.418+0000 7ff60ffff700 1 -- 172.21.15.57:0/3189229693 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff614011b30 con 0x7ff6180b10c0 2023-10-06T03:01:44.425 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.418+0000 7ff61f545700 1 -- 172.21.15.57:0/3189229693 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff6180b10c0 msgr2=0x7ff61815b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:44.425 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.418+0000 7ff61f545700 1 --2- 172.21.15.57:0/3189229693 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff6180b10c0 0x7ff61815b750 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ff6180ccec0 tx=0x7ff6140091a0 comp rx=0 tx=0).stop 2023-10-06T03:01:44.425 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.418+0000 7ff61f545700 1 -- 172.21.15.57:0/3189229693 shutdown_connections 2023-10-06T03:01:44.425 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.418+0000 7ff61f545700 1 --2- 172.21.15.57:0/3189229693 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff618154bc0 0x7ff6181575d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:44.426 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.418+0000 7ff61f545700 1 --2- 172.21.15.57:0/3189229693 >> v2:172.21.15.105:3300/0 conn(0x7ff6180b1490 0x7ff618154680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:44.426 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.418+0000 7ff61f545700 1 --2- 172.21.15.57:0/3189229693 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff6180b10c0 0x7ff61815b750 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:44.426 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.418+0000 7ff61f545700 1 -- 172.21.15.57:0/3189229693 >> 172.21.15.57:0/3189229693 conn(0x7ff6180cbdd0 msgr2=0x7ff6180cc1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:44.426 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.418+0000 7ff61f545700 1 -- 172.21.15.57:0/3189229693 shutdown_connections 2023-10-06T03:01:44.426 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.418+0000 7ff61f545700 1 -- 172.21.15.57:0/3189229693 wait complete. 2023-10-06T03:01:44.428 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.422+0000 7ff61f545700 1 Processor -- start 2023-10-06T03:01:44.428 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.422+0000 7ff61f545700 1 -- start start 2023-10-06T03:01:44.431 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.426+0000 7ff61f545700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff6180b10c0 0x7ff6180acf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:44.431 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.426+0000 7ff61f545700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff6180b1490 0x7ff618169cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:44.431 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.426+0000 7ff61f545700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff618154bc0 0x7ff618153a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:44.431 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.426+0000 7ff61f545700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6180acb00 con 0x7ff6180b10c0 2023-10-06T03:01:44.431 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.426+0000 7ff61f545700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6180abef0 con 0x7ff618154bc0 2023-10-06T03:01:44.431 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.426+0000 7ff61f545700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6180ac1d0 con 0x7ff6180b1490 2023-10-06T03:01:44.432 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.426+0000 7ff61d2e1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff6180b10c0 0x7ff6180acf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:44.432 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.426+0000 7ff61d2e1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff6180b10c0 0x7ff6180acf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60756/0 (socket says 172.21.15.57:60756) 2023-10-06T03:01:44.432 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.426+0000 7ff61d2e1700 1 -- 172.21.15.57:0/3477342350 learned_addr learned my addr 172.21.15.57:0/3477342350 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:44.432 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.426+0000 7ff61dae2700 1 --2- 172.21.15.57:0/3477342350 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff618154bc0 0x7ff618153a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:44.432 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.426+0000 7ff61cae0700 1 --2- 172.21.15.57:0/3477342350 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff6180b1490 0x7ff618169cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:44.432 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.426+0000 7ff61d2e1700 1 -- 172.21.15.57:0/3477342350 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff6180b1490 msgr2=0x7ff618169cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:44.432 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.426+0000 7ff61d2e1700 1 --2- 172.21.15.57:0/3477342350 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff6180b1490 0x7ff618169cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:44.432 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.426+0000 7ff61d2e1700 1 -- 172.21.15.57:0/3477342350 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff618154bc0 msgr2=0x7ff618153a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:44.433 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.426+0000 7ff61d2e1700 1 --2- 172.21.15.57:0/3477342350 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff618154bc0 0x7ff618153a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:44.433 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.426+0000 7ff61d2e1700 1 -- 172.21.15.57:0/3477342350 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff614009420 con 0x7ff6180b10c0 2023-10-06T03:01:44.433 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.426+0000 7ff61dae2700 1 --2- 172.21.15.57:0/3477342350 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff618154bc0 0x7ff618153a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:44.433 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.426+0000 7ff61d2e1700 1 --2- 172.21.15.57:0/3477342350 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff6180b10c0 0x7ff6180acf90 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7ff6180b1ce0 tx=0x7ff614017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:44.434 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.426+0000 7ff60d7fa700 1 -- 172.21.15.57:0/3477342350 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff614011b10 con 0x7ff6180b10c0 2023-10-06T03:01:44.434 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.426+0000 7ff60d7fa700 1 -- 172.21.15.57:0/3477342350 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6140253f0 con 0x7ff6180b10c0 2023-10-06T03:01:44.434 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.426+0000 7ff60d7fa700 1 -- 172.21.15.57:0/3477342350 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6140257b0 con 0x7ff6180b10c0 2023-10-06T03:01:44.434 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.426+0000 7ff61f545700 1 -- 172.21.15.57:0/3477342350 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6180ac4b0 con 0x7ff6180b10c0 2023-10-06T03:01:44.434 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.426+0000 7ff61f545700 1 -- 172.21.15.57:0/3477342350 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff61816a1f0 con 0x7ff6180b10c0 2023-10-06T03:01:44.437 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.430+0000 7ff61f545700 1 -- 172.21.15.57:0/3477342350 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6180712e0 con 0x7ff6180b10c0 2023-10-06T03:01:44.437 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.430+0000 7ff60d7fa700 1 -- 172.21.15.57:0/3477342350 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7ff614025b60 con 0x7ff6180b10c0 2023-10-06T03:01:44.439 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.434+0000 7ff60d7fa700 1 --2- 172.21.15.57:0/3477342350 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7ff5fc060580 0x7ff5fc062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:44.439 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.434+0000 7ff60d7fa700 1 -- 172.21.15.57:0/3477342350 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5206+0+0 (secure 0 0 0) 0x7ff61407dee0 con 0x7ff6180b10c0 2023-10-06T03:01:44.439 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.434+0000 7ff61cae0700 1 --2- 172.21.15.57:0/3477342350 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7ff5fc060580 0x7ff5fc062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:44.440 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.434+0000 7ff61cae0700 1 --2- 172.21.15.57:0/3477342350 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7ff5fc060580 0x7ff5fc062a30 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff618166e80 tx=0x7ff608008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:44.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.438+0000 7ff60d7fa700 1 -- 172.21.15.57:0/3477342350 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7ff61404e620 con 0x7ff6180b10c0 2023-10-06T03:01:44.622 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.614+0000 7ff61f545700 1 -- 172.21.15.57:0/3477342350 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7ff618158250 con 0x7ff6180b10c0 2023-10-06T03:01:44.623 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.618+0000 7ff60d7fa700 1 -- 172.21.15.57:0/3477342350 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v31) v1 ==== 84+0+126 (secure 0 0 0) 0x7ff614015090 con 0x7ff6180b10c0 2023-10-06T03:01:44.623 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:01:44.623 INFO:teuthology.orchestra.run.smithi057.stdout:[ 2023-10-06T03:01:44.623 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-10-06T03:01:44.624 INFO:teuthology.orchestra.run.smithi057.stdout: "poolnum": 1, 2023-10-06T03:01:44.624 INFO:teuthology.orchestra.run.smithi057.stdout: "poolname": ".mgr" 2023-10-06T03:01:44.624 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-06T03:01:44.624 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-10-06T03:01:44.624 INFO:teuthology.orchestra.run.smithi057.stdout: "poolnum": 2, 2023-10-06T03:01:44.624 INFO:teuthology.orchestra.run.smithi057.stdout: "poolname": "rbd" 2023-10-06T03:01:44.624 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-10-06T03:01:44.624 INFO:teuthology.orchestra.run.smithi057.stdout:] 2023-10-06T03:01:44.628 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.622+0000 7ff61f545700 1 -- 172.21.15.57:0/3477342350 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7ff5fc060580 msgr2=0x7ff5fc062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:44.628 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.622+0000 7ff61f545700 1 --2- 172.21.15.57:0/3477342350 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7ff5fc060580 0x7ff5fc062a30 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff618166e80 tx=0x7ff608008040 comp rx=0 tx=0).stop 2023-10-06T03:01:44.628 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.622+0000 7ff61f545700 1 -- 172.21.15.57:0/3477342350 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff6180b10c0 msgr2=0x7ff6180acf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:44.629 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.622+0000 7ff61f545700 1 --2- 172.21.15.57:0/3477342350 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff6180b10c0 0x7ff6180acf90 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7ff6180b1ce0 tx=0x7ff614017000 comp rx=0 tx=0).stop 2023-10-06T03:01:44.629 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.622+0000 7ff61f545700 1 -- 172.21.15.57:0/3477342350 shutdown_connections 2023-10-06T03:01:44.629 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.622+0000 7ff61f545700 1 --2- 172.21.15.57:0/3477342350 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff618154bc0 0x7ff618153a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:44.629 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.622+0000 7ff61f545700 1 --2- 172.21.15.57:0/3477342350 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7ff5fc060580 0x7ff5fc062a30 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:44.629 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.622+0000 7ff61f545700 1 --2- 172.21.15.57:0/3477342350 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff6180b1490 0x7ff618169cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:44.629 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.622+0000 7ff61f545700 1 --2- 172.21.15.57:0/3477342350 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff6180b10c0 0x7ff6180acf90 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:44.629 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.622+0000 7ff61f545700 1 -- 172.21.15.57:0/3477342350 >> 172.21.15.57:0/3477342350 conn(0x7ff6180cbdd0 msgr2=0x7ff6181590c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:44.629 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.622+0000 7ff61f545700 1 -- 172.21.15.57:0/3477342350 shutdown_connections 2023-10-06T03:01:44.629 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.622+0000 7ff61f545700 1 -- 172.21.15.57:0/3477342350 wait complete. 2023-10-06T03:01:44.648 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-06T03:01:44.648 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-06T03:01:44.814 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.806+0000 7f4dded63700 1 Processor -- start 2023-10-06T03:01:44.815 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.810+0000 7f4dded63700 1 -- start start 2023-10-06T03:01:44.819 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.810+0000 7f4dded63700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4dd80b1c70 0x7f4dd80b2040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:44.819 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.810+0000 7f4dded63700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4dd806dec0 0x7f4dd8159e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:44.819 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.814+0000 7f4dded63700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dd81599d0 con 0x7f4dd806cc80 2023-10-06T03:01:44.819 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.814+0000 7f4dded63700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dd806da90 con 0x7f4dd80b1c70 2023-10-06T03:01:44.819 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.814+0000 7f4dded63700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd806d4d0 con 0x7f4dd806dec0 2023-10-06T03:01:44.820 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.814+0000 7f4dddd61700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4dd80b1c70 0x7f4dd80b2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:44.820 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.814+0000 7f4dde562700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f4dd806cc80 0x7f4dd8156420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:51900/0 (socket says 172.21.15.57:51900) 2023-10-06T03:01:44.820 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.814+0000 7f4dde562700 1 -- 172.21.15.57:0/286818582 learned_addr learned my addr 172.21.15.57:0/286818582 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:01:44.820 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.814+0000 7f4ddd560700 1 --2- 172.21.15.57:0/286818582 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4dd806dec0 0x7f4dd8159e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:44.821 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.814+0000 7f4ddcd5f700 1 -- 172.21.15.57:0/286818582 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 428028809 0 0) 0x7f4dd81599d0 con 0x7f4dd806cc80 2023-10-06T03:01:44.821 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.814+0000 7f4ddcd5f700 1 -- 172.21.15.57:0/286818582 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4dc4003570 con 0x7f4dd806cc80 2023-10-06T03:01:44.821 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.814+0000 7f4dddd61700 1 -- 172.21.15.57:0/286818582 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4dd806dec0 msgr2=0x7f4dd8159e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:44.821 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.814+0000 7f4dddd61700 1 --2- 172.21.15.57:0/286818582 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4dd806dec0 0x7f4dd8159e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:44.821 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.814+0000 7f4dddd61700 1 -- 172.21.15.57:0/286818582 >> v1:172.21.15.57:6789/0 conn(0x7f4dd806cc80 legacy=0x7f4dd8156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:44.821 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.814+0000 7f4dddd61700 1 -- 172.21.15.57:0/286818582 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dd806d7b0 con 0x7f4dd80b1c70 2023-10-06T03:01:44.822 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.814+0000 7f4dddd61700 1 --2- 172.21.15.57:0/286818582 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4dd80b1c70 0x7f4dd80b2040 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f4dd40098e0 tx=0x7f4dd40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1760e3dc569c0cdf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:44.822 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.814+0000 7f4ddcd5f700 1 -- 172.21.15.57:0/286818582 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd4011630 con 0x7f4dd80b1c70 2023-10-06T03:01:44.822 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.814+0000 7f4ddcd5f700 1 -- 172.21.15.57:0/286818582 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dd4011790 con 0x7f4dd80b1c70 2023-10-06T03:01:44.823 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.814+0000 7f4ddcd5f700 1 -- 172.21.15.57:0/286818582 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd4011b30 con 0x7f4dd80b1c70 2023-10-06T03:01:44.823 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.814+0000 7f4dded63700 1 -- 172.21.15.57:0/286818582 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4dd80b1c70 msgr2=0x7f4dd80b2040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:44.823 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.814+0000 7f4dded63700 1 --2- 172.21.15.57:0/286818582 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4dd80b1c70 0x7f4dd80b2040 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f4dd40098e0 tx=0x7f4dd40091a0 comp rx=0 tx=0).stop 2023-10-06T03:01:44.823 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.814+0000 7f4dded63700 1 -- 172.21.15.57:0/286818582 shutdown_connections 2023-10-06T03:01:44.823 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.814+0000 7f4dded63700 1 --2- 172.21.15.57:0/286818582 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4dd806dec0 0x7f4dd8159e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:44.823 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.814+0000 7f4dded63700 1 --2- 172.21.15.57:0/286818582 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4dd80b1c70 0x7f4dd80b2040 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:44.823 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.814+0000 7f4dded63700 1 -- 172.21.15.57:0/286818582 >> 172.21.15.57:0/286818582 conn(0x7f4dd8067050 msgr2=0x7f4dd8067450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:44.823 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.814+0000 7f4dded63700 1 -- 172.21.15.57:0/286818582 shutdown_connections 2023-10-06T03:01:44.823 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.814+0000 7f4dded63700 1 -- 172.21.15.57:0/286818582 wait complete. 2023-10-06T03:01:44.825 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.818+0000 7f4dded63700 1 Processor -- start 2023-10-06T03:01:44.825 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.818+0000 7f4dded63700 1 -- start start 2023-10-06T03:01:44.827 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.822+0000 7f4dded63700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4dd806cc80 0x7f4dd813f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:44.827 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.822+0000 7f4dded63700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4dd806dec0 0x7f4dd815dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:44.827 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.822+0000 7f4dded63700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4dd80b1c70 0x7f4dd815e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:44.827 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.822+0000 7f4dded63700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd8153ba0 con 0x7f4dd806dec0 2023-10-06T03:01:44.828 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.822+0000 7f4dded63700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd814cd10 con 0x7f4dd80b1c70 2023-10-06T03:01:44.828 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.822+0000 7f4dded63700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd815e7d0 con 0x7f4dd806cc80 2023-10-06T03:01:44.828 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.822+0000 7f4ddd560700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4dd806dec0 0x7f4dd815dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:44.828 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.822+0000 7f4ddd560700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4dd806dec0 0x7f4dd815dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58776/0 (socket says 172.21.15.57:58776) 2023-10-06T03:01:44.828 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.822+0000 7f4ddd560700 1 -- 172.21.15.57:0/3189352627 learned_addr learned my addr 172.21.15.57:0/3189352627 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:44.829 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.822+0000 7f4dddd61700 1 --2- 172.21.15.57:0/3189352627 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4dd806cc80 0x7f4dd813f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:44.829 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.822+0000 7f4dde562700 1 --2- 172.21.15.57:0/3189352627 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4dd80b1c70 0x7f4dd815e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:44.830 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.822+0000 7f4ddd560700 1 -- 172.21.15.57:0/3189352627 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4dd806cc80 msgr2=0x7f4dd813f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:44.830 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.822+0000 7f4ddd560700 1 --2- 172.21.15.57:0/3189352627 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4dd806cc80 0x7f4dd813f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:44.830 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.822+0000 7f4ddd560700 1 -- 172.21.15.57:0/3189352627 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4dd80b1c70 msgr2=0x7f4dd815e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:44.830 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.822+0000 7f4ddd560700 1 --2- 172.21.15.57:0/3189352627 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4dd80b1c70 0x7f4dd815e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:44.830 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.822+0000 7f4ddd560700 1 -- 172.21.15.57:0/3189352627 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dd4009420 con 0x7f4dd806dec0 2023-10-06T03:01:44.830 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.822+0000 7f4dde562700 1 --2- 172.21.15.57:0/3189352627 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4dd80b1c70 0x7f4dd815e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:01:44.830 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.822+0000 7f4ddd560700 1 --2- 172.21.15.57:0/3189352627 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4dd806dec0 0x7f4dd815dc60 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f4dc800ec80 tx=0x7f4dc80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:44.830 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.822+0000 7f4dcdffb700 1 -- 172.21.15.57:0/3189352627 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dc800c9d0 con 0x7f4dd806dec0 2023-10-06T03:01:44.830 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.822+0000 7f4dcdffb700 1 -- 172.21.15.57:0/3189352627 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dc800cb30 con 0x7f4dd806dec0 2023-10-06T03:01:44.830 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.822+0000 7f4dcdffb700 1 -- 172.21.15.57:0/3189352627 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dc8013470 con 0x7f4dd806dec0 2023-10-06T03:01:44.831 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.822+0000 7f4dded63700 1 -- 172.21.15.57:0/3189352627 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dd815eab0 con 0x7f4dd806dec0 2023-10-06T03:01:44.831 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.822+0000 7f4dded63700 1 -- 172.21.15.57:0/3189352627 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dd8153830 con 0x7f4dd806dec0 2023-10-06T03:01:44.831 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.826+0000 7f4dded63700 1 -- 172.21.15.57:0/3189352627 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dd804be40 con 0x7f4dd806dec0 2023-10-06T03:01:44.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.826+0000 7f4dcdffb700 1 -- 172.21.15.57:0/3189352627 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f4dc8013820 con 0x7f4dd806dec0 2023-10-06T03:01:44.834 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.826+0000 7f4dcdffb700 1 --2- 172.21.15.57:0/3189352627 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f4dbc060550 0x7f4dbc062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:44.834 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.830+0000 7f4dcdffb700 1 -- 172.21.15.57:0/3189352627 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f4dc807c960 con 0x7f4dd806dec0 2023-10-06T03:01:44.835 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.830+0000 7f4dddd61700 1 --2- 172.21.15.57:0/3189352627 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f4dbc060550 0x7f4dbc062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:44.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.830+0000 7f4dddd61700 1 --2- 172.21.15.57:0/3189352627 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f4dbc060550 0x7f4dbc062a00 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f4dd40091e0 tx=0x7f4dd4017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:44.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:44.834+0000 7f4dcdffb700 1 -- 172.21.15.57:0/3189352627 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f4dc804d0a0 con 0x7f4dd806dec0 2023-10-06T03:01:45.012 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:45.006+0000 7f4dded63700 1 -- 172.21.15.57:0/3189352627 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f4dd8159660 con 0x7f4dd806dec0 2023-10-06T03:01:45.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:45.898+0000 7f4dcdffb700 1 -- 172.21.15.57:0/3189352627 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v32) v1 ==== 138+0+0 (secure 0 0 0) 0x7f4dc80506c0 con 0x7f4dd806dec0 2023-10-06T03:01:45.909 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:45.902+0000 7f4dded63700 1 -- 172.21.15.57:0/3189352627 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f4dbc060550 msgr2=0x7f4dbc062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:45.910 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:45.902+0000 7f4dded63700 1 --2- 172.21.15.57:0/3189352627 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f4dbc060550 0x7f4dbc062a00 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f4dd40091e0 tx=0x7f4dd4017000 comp rx=0 tx=0).stop 2023-10-06T03:01:45.910 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:45.902+0000 7f4dded63700 1 -- 172.21.15.57:0/3189352627 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4dd806dec0 msgr2=0x7f4dd815dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:45.910 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:45.902+0000 7f4dded63700 1 --2- 172.21.15.57:0/3189352627 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4dd806dec0 0x7f4dd815dc60 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f4dc800ec80 tx=0x7f4dc80091a0 comp rx=0 tx=0).stop 2023-10-06T03:01:45.910 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:45.902+0000 7f4dded63700 1 -- 172.21.15.57:0/3189352627 shutdown_connections 2023-10-06T03:01:45.910 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:45.902+0000 7f4dded63700 1 --2- 172.21.15.57:0/3189352627 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4dd80b1c70 0x7f4dd815e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:45.911 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:45.902+0000 7f4dded63700 1 --2- 172.21.15.57:0/3189352627 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4dd806dec0 0x7f4dd815dc60 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:45.911 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:45.902+0000 7f4dded63700 1 --2- 172.21.15.57:0/3189352627 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f4dbc060550 0x7f4dbc062a00 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:45.911 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:45.902+0000 7f4dded63700 1 --2- 172.21.15.57:0/3189352627 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4dd806cc80 0x7f4dd813f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:45.911 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:45.902+0000 7f4dded63700 1 -- 172.21.15.57:0/3189352627 >> 172.21.15.57:0/3189352627 conn(0x7f4dd8067050 msgr2=0x7f4dd815be70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:45.911 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:45.906+0000 7f4dded63700 1 -- 172.21.15.57:0/3189352627 shutdown_connections 2023-10-06T03:01:45.911 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:45.906+0000 7f4dded63700 1 -- 172.21.15.57:0/3189352627 wait complete. 2023-10-06T03:01:45.915 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_metadata' created 2023-10-06T03:01:45.932 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-06T03:01:46.105 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:46.098+0000 7f9869385700 1 Processor -- start 2023-10-06T03:01:46.294 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:46.098+0000 7f9869385700 1 -- start start 2023-10-06T03:01:46.294 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:46.102+0000 7f9869385700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9864158e50 0x7f98640b44a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:46.294 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:46.102+0000 7f9869385700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f98640b2e40 0x7f986406d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:46.294 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:46.102+0000 7f9869385700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f986406a8d0 0x7f986406acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:46.294 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:46.102+0000 7f9869385700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98640b4010 con 0x7f986406a8d0 2023-10-06T03:01:46.294 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:46.102+0000 7f9869385700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98640b49e0 con 0x7f98640b2e40 2023-10-06T03:01:46.294 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:46.102+0000 7f9869385700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f986406b230 con 0x7f9864158e50 2023-10-06T03:01:46.294 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:46.102+0000 7f98637fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f986406a8d0 0x7f986406acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:46.294 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:46.102+0000 7f98637fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f986406a8d0 0x7f986406acf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58786/0 (socket says 172.21.15.57:58786) 2023-10-06T03:01:46.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:46.102+0000 7f98637fe700 1 -- 172.21.15.57:0/742688509 learned_addr learned my addr 172.21.15.57:0/742688509 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:46.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:46.102+0000 7f98627fc700 1 --2- 172.21.15.57:0/742688509 >> v2:172.21.15.105:3300/0 conn(0x7f98640b2e40 0x7f986406d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:46.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:46.102+0000 7f9862ffd700 1 --2- 172.21.15.57:0/742688509 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9864158e50 0x7f98640b44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:46.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:46.106+0000 7f98637fe700 1 -- 172.21.15.57:0/742688509 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9864158e50 msgr2=0x7f98640b44a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:46.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:46.106+0000 7f98637fe700 1 --2- 172.21.15.57:0/742688509 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9864158e50 0x7f98640b44a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:46.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:46.106+0000 7f98637fe700 1 -- 172.21.15.57:0/742688509 >> v2:172.21.15.105:3300/0 conn(0x7f98640b2e40 msgr2=0x7f986406d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:46.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:46.106+0000 7f98637fe700 1 --2- 172.21.15.57:0/742688509 >> v2:172.21.15.105:3300/0 conn(0x7f98640b2e40 0x7f986406d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:46.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:46.106+0000 7f98637fe700 1 -- 172.21.15.57:0/742688509 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98640b3400 con 0x7f986406a8d0 2023-10-06T03:01:46.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:46.106+0000 7f9862ffd700 1 --2- 172.21.15.57:0/742688509 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9864158e50 0x7f98640b44a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:01:46.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:46.106+0000 7f98637fe700 1 --2- 172.21.15.57:0/742688509 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f986406a8d0 0x7f986406acf0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f986406eb90 tx=0x7f985c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23987af951019ec9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:46.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:46.106+0000 7f9861ffb700 1 -- 172.21.15.57:0/742688509 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f985c00e070 con 0x7f986406a8d0 2023-10-06T03:01:46.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:46.106+0000 7f9861ffb700 1 -- 172.21.15.57:0/742688509 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f985c00b970 con 0x7f986406a8d0 2023-10-06T03:01:46.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:46.106+0000 7f9861ffb700 1 -- 172.21.15.57:0/742688509 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f985c0092e0 con 0x7f986406a8d0 2023-10-06T03:01:46.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:46.106+0000 7f9869385700 1 -- 172.21.15.57:0/742688509 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f986406a8d0 msgr2=0x7f986406acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:46.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:46.106+0000 7f9869385700 1 --2- 172.21.15.57:0/742688509 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f986406a8d0 0x7f986406acf0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f986406eb90 tx=0x7f985c009840 comp rx=0 tx=0).stop 2023-10-06T03:01:46.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:46.106+0000 7f9869385700 1 -- 172.21.15.57:0/742688509 shutdown_connections 2023-10-06T03:01:46.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:46.106+0000 7f9869385700 1 --2- 172.21.15.57:0/742688509 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f986406a8d0 0x7f986406acf0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:46.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:46.106+0000 7f9869385700 1 --2- 172.21.15.57:0/742688509 >> v2:172.21.15.105:3300/0 conn(0x7f98640b2e40 0x7f986406d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:46.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:46.106+0000 7f9869385700 1 --2- 172.21.15.57:0/742688509 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9864158e50 0x7f98640b44a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:46.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:46.106+0000 7f9869385700 1 -- 172.21.15.57:0/742688509 >> 172.21.15.57:0/742688509 conn(0x7f9864067050 msgr2=0x7f98640b1ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:46.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:46.106+0000 7f9869385700 1 -- 172.21.15.57:0/742688509 shutdown_connections 2023-10-06T03:01:46.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:46.106+0000 7f9869385700 1 -- 172.21.15.57:0/742688509 wait complete. 2023-10-06T03:01:46.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:46.110+0000 7f9869385700 1 Processor -- start 2023-10-06T03:01:46.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:46.110+0000 7f9869385700 1 -- start start 2023-10-06T03:01:46.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:46.110+0000 7f9869385700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f986406a8d0 0x7f98640c97a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:46.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:46.110+0000 7f9869385700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f98640b2e40 0x7f986415b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:46.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:46.110+0000 7f9869385700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9864158e50 0x7f9864145900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:46.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:46.110+0000 7f9869385700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98640c9ce0 con 0x7f9864158e50 2023-10-06T03:01:46.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:46.110+0000 7f9869385700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98640c5f10 con 0x7f98640b2e40 2023-10-06T03:01:46.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:46.110+0000 7f9869385700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98640c5300 con 0x7f986406a8d0 2023-10-06T03:01:46.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:46.110+0000 7f98637fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9864158e50 0x7f9864145900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:46.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:46.110+0000 7f98637fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9864158e50 0x7f9864145900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58802/0 (socket says 172.21.15.57:58802) 2023-10-06T03:01:46.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:46.110+0000 7f98637fe700 1 -- 172.21.15.57:0/3960510849 learned_addr learned my addr 172.21.15.57:0/3960510849 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:46.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:46.110+0000 7f9862ffd700 1 --2- 172.21.15.57:0/3960510849 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f986406a8d0 0x7f98640c97a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:46.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:46.110+0000 7f98627fc700 1 --2- 172.21.15.57:0/3960510849 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f98640b2e40 0x7f986415b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:46.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:46.110+0000 7f98637fe700 1 -- 172.21.15.57:0/3960510849 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f986406a8d0 msgr2=0x7f98640c97a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:46.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:46.110+0000 7f98637fe700 1 --2- 172.21.15.57:0/3960510849 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f986406a8d0 0x7f98640c97a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:46.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:46.110+0000 7f98637fe700 1 -- 172.21.15.57:0/3960510849 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f98640b2e40 msgr2=0x7f986415b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:46.298 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:46.110+0000 7f98637fe700 1 --2- 172.21.15.57:0/3960510849 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f98640b2e40 0x7f986415b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:46.298 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:46.110+0000 7f98637fe700 1 -- 172.21.15.57:0/3960510849 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9854009420 con 0x7f9864158e50 2023-10-06T03:01:46.298 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:46.110+0000 7f9862ffd700 1 --2- 172.21.15.57:0/3960510849 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f986406a8d0 0x7f98640c97a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:46.298 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:46.114+0000 7f98637fe700 1 --2- 172.21.15.57:0/3960510849 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9864158e50 0x7f9864145900 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f985c00b610 tx=0x7f985c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:46.298 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:46.114+0000 7f984affd700 1 -- 172.21.15.57:0/3960510849 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f985c008b00 con 0x7f9864158e50 2023-10-06T03:01:46.298 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:46.114+0000 7f984affd700 1 -- 172.21.15.57:0/3960510849 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f985c008c60 con 0x7f9864158e50 2023-10-06T03:01:46.298 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:46.114+0000 7f9869385700 1 -- 172.21.15.57:0/3960510849 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f985c009ae0 con 0x7f9864158e50 2023-10-06T03:01:46.298 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:46.114+0000 7f984affd700 1 -- 172.21.15.57:0/3960510849 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f985c026460 con 0x7f9864158e50 2023-10-06T03:01:46.298 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:46.114+0000 7f9869385700 1 -- 172.21.15.57:0/3960510849 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98640c5ba0 con 0x7f9864158e50 2023-10-06T03:01:46.298 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:46.114+0000 7f9869385700 1 -- 172.21.15.57:0/3960510849 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98640c60a0 con 0x7f9864158e50 2023-10-06T03:01:46.298 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:46.114+0000 7f984affd700 1 -- 172.21.15.57:0/3960510849 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f985c003040 con 0x7f9864158e50 2023-10-06T03:01:46.298 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:46.118+0000 7f984affd700 1 --2- 172.21.15.57:0/3960510849 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f9850060550 0x7f9850062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:46.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:46.118+0000 7f984affd700 1 -- 172.21.15.57:0/3960510849 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5576+0+0 (secure 0 0 0) 0x7f985c07e310 con 0x7f9864158e50 2023-10-06T03:01:46.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:46.118+0000 7f9862ffd700 1 --2- 172.21.15.57:0/3960510849 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f9850060550 0x7f9850062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:46.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:46.118+0000 7f9862ffd700 1 --2- 172.21.15.57:0/3960510849 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f9850060550 0x7f9850062a00 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f98540093f0 tx=0x7f9854008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:46.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:46.126+0000 7f984affd700 1 -- 172.21.15.57:0/3960510849 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f985c04e990 con 0x7f9864158e50 2023-10-06T03:01:46.302 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:46.294+0000 7f9869385700 1 -- 172.21.15.57:0/3960510849 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f98640c56f0 con 0x7f9864158e50 2023-10-06T03:01:46.916 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:46.910+0000 7f984affd700 1 -- 172.21.15.57:0/3960510849 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v33) v1 ==== 170+0+0 (secure 0 0 0) 0x7f985c051fb0 con 0x7f9864158e50 2023-10-06T03:01:46.930 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:46.918+0000 7f9869385700 1 -- 172.21.15.57:0/3960510849 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f9850060550 msgr2=0x7f9850062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:46.930 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:46.918+0000 7f9869385700 1 --2- 172.21.15.57:0/3960510849 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f9850060550 0x7f9850062a00 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f98540093f0 tx=0x7f9854008040 comp rx=0 tx=0).stop 2023-10-06T03:01:46.930 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:46.918+0000 7f9869385700 1 -- 172.21.15.57:0/3960510849 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9864158e50 msgr2=0x7f9864145900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:46.930 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:46.918+0000 7f9869385700 1 --2- 172.21.15.57:0/3960510849 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9864158e50 0x7f9864145900 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f985c00b610 tx=0x7f985c018000 comp rx=0 tx=0).stop 2023-10-06T03:01:46.930 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:46.922+0000 7f9869385700 1 -- 172.21.15.57:0/3960510849 shutdown_connections 2023-10-06T03:01:46.930 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:46.922+0000 7f9869385700 1 --2- 172.21.15.57:0/3960510849 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9864158e50 0x7f9864145900 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:46.930 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:46.922+0000 7f9869385700 1 --2- 172.21.15.57:0/3960510849 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f98640b2e40 0x7f986415b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:46.930 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:46.922+0000 7f9869385700 1 --2- 172.21.15.57:0/3960510849 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f9850060550 0x7f9850062a00 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:46.930 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:46.922+0000 7f9869385700 1 --2- 172.21.15.57:0/3960510849 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f986406a8d0 0x7f98640c97a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:46.930 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:46.922+0000 7f9869385700 1 -- 172.21.15.57:0/3960510849 >> 172.21.15.57:0/3960510849 conn(0x7f9864067050 msgr2=0x7f9864154360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:46.931 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:46.922+0000 7f9869385700 1 -- 172.21.15.57:0/3960510849 shutdown_connections 2023-10-06T03:01:46.931 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:46.922+0000 7f9869385700 1 -- 172.21.15.57:0/3960510849 wait complete. 2023-10-06T03:01:46.936 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_data' created 2023-10-06T03:01:46.955 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-06T03:01:47.115 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:47.110+0000 7f989688e700 1 Processor -- start 2023-10-06T03:01:47.115 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:47.110+0000 7f989688e700 1 -- start start 2023-10-06T03:01:47.119 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:47.114+0000 7f989688e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f98900cb510 0x7f989006d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:47.119 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:47.114+0000 7f989688e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f989006de70 0x7f989006b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:47.119 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:47.114+0000 7f989688e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f989006c920 con 0x7f98900cb140 2023-10-06T03:01:47.119 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:47.114+0000 7f989688e700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98900cb960 con 0x7f989006de70 2023-10-06T03:01:47.119 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:47.114+0000 7f989688e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f989006e2f0 con 0x7f98900cb510 2023-10-06T03:01:47.119 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:47.114+0000 7f989588c700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f98900cb140 0x7f98900b0080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:51910/0 (socket says 172.21.15.57:51910) 2023-10-06T03:01:47.120 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:47.114+0000 7f989588c700 1 -- 172.21.15.57:0/2606069538 learned_addr learned my addr 172.21.15.57:0/2606069538 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:01:47.120 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:47.114+0000 7f989608d700 1 --2- 172.21.15.57:0/2606069538 >> v2:172.21.15.57:3300/0 conn(0x7f989006de70 0x7f989006b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:47.120 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:47.114+0000 7f989508b700 1 --2- 172.21.15.57:0/2606069538 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f98900cb510 0x7f989006d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:47.120 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:47.114+0000 7f989488a700 1 -- 172.21.15.57:0/2606069538 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 193058117 0 0) 0x7f989006c920 con 0x7f98900cb140 2023-10-06T03:01:47.120 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:47.114+0000 7f989488a700 1 -- 172.21.15.57:0/2606069538 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f987c003570 con 0x7f98900cb140 2023-10-06T03:01:47.121 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:47.114+0000 7f989488a700 1 -- 172.21.15.57:0/2606069538 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 412344391 0 0) 0x7f987c003570 con 0x7f98900cb140 2023-10-06T03:01:47.122 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:47.114+0000 7f989488a700 1 -- 172.21.15.57:0/2606069538 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f98900cb510 msgr2=0x7f989006d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:47.122 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:47.114+0000 7f989488a700 1 --2- 172.21.15.57:0/2606069538 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f98900cb510 0x7f989006d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:47.122 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:47.114+0000 7f989488a700 1 -- 172.21.15.57:0/2606069538 >> v2:172.21.15.57:3300/0 conn(0x7f989006de70 msgr2=0x7f989006b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:47.122 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:47.114+0000 7f989488a700 1 --2- 172.21.15.57:0/2606069538 >> v2:172.21.15.57:3300/0 conn(0x7f989006de70 0x7f989006b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:47.122 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:47.114+0000 7f989488a700 1 -- 172.21.15.57:0/2606069538 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f989006d4a0 con 0x7f98900cb140 2023-10-06T03:01:47.122 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:47.114+0000 7f989488a700 1 -- 172.21.15.57:0/2606069538 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2482400018 0 0) 0x7f988c001470 con 0x7f98900cb140 2023-10-06T03:01:47.122 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:47.114+0000 7f989608d700 1 --2- 172.21.15.57:0/2606069538 >> v2:172.21.15.57:3300/0 conn(0x7f989006de70 0x7f989006b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:01:47.122 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:47.114+0000 7f989488a700 1 -- 172.21.15.57:0/2606069538 >> v1:172.21.15.57:6789/0 conn(0x7f98900cb140 legacy=0x7f98900b0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:47.122 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:47.114+0000 7f989488a700 1 --2- 172.21.15.57:0/2606069538 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f987c003a90 0x7f987c003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:47.122 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:47.114+0000 7f989488a700 1 --2- 172.21.15.57:0/2606069538 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f98900cb510 0x7f987c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:47.122 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:47.114+0000 7f989488a700 1 --2- 172.21.15.57:0/2606069538 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f987c004d50 0x7f987c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:47.123 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:47.114+0000 7f989488a700 1 -- 172.21.15.57:0/2606069538 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98900cb960 con 0x7f987c003a90 2023-10-06T03:01:47.123 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:47.114+0000 7f989488a700 1 -- 172.21.15.57:0/2606069538 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f989006e2f0 con 0x7f987c004d50 2023-10-06T03:01:47.123 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:47.114+0000 7f989488a700 1 -- 172.21.15.57:0/2606069538 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f987c00ba60 con 0x7f98900cb510 2023-10-06T03:01:47.123 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:47.114+0000 7f989588c700 1 --2- 172.21.15.57:0/2606069538 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f987c003a90 0x7f987c003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:47.124 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:47.114+0000 7f989588c700 1 -- 172.21.15.57:0/2606069538 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f98900cb510 msgr2=0x7f987c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:47.124 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:47.114+0000 7f989508b700 1 --2- 172.21.15.57:0/2606069538 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f98900cb510 0x7f987c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:47.124 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:47.114+0000 7f989608d700 1 --2- 172.21.15.57:0/2606069538 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f987c004d50 0x7f987c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:47.124 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:47.114+0000 7f989588c700 1 --2- 172.21.15.57:0/2606069538 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f98900cb510 0x7f987c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:47.124 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:47.114+0000 7f989588c700 1 -- 172.21.15.57:0/2606069538 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f987c004d50 msgr2=0x7f987c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:47.124 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:47.114+0000 7f989588c700 1 --2- 172.21.15.57:0/2606069538 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f987c004d50 0x7f987c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:47.125 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:47.114+0000 7f989588c700 1 -- 172.21.15.57:0/2606069538 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f987c003570 con 0x7f987c003a90 2023-10-06T03:01:47.125 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:47.114+0000 7f989508b700 1 --2- 172.21.15.57:0/2606069538 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f98900cb510 0x7f987c004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:01:47.125 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:47.114+0000 7f989608d700 1 --2- 172.21.15.57:0/2606069538 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f987c004d50 0x7f987c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:01:47.125 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:47.118+0000 7f989588c700 1 --2- 172.21.15.57:0/2606069538 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f987c003a90 0x7f987c003e60 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f988c0051b0 tx=0x7f988c008bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b7ac5676481b651 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:47.125 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:47.118+0000 7f989488a700 1 -- 172.21.15.57:0/2606069538 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f988c005920 con 0x7f987c003a90 2023-10-06T03:01:47.125 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:47.118+0000 7f989488a700 1 -- 172.21.15.57:0/2606069538 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f988c005a80 con 0x7f987c003a90 2023-10-06T03:01:47.125 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:47.118+0000 7f989488a700 1 -- 172.21.15.57:0/2606069538 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f988c005e20 con 0x7f987c003a90 2023-10-06T03:01:47.125 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:47.118+0000 7f989688e700 1 -- 172.21.15.57:0/2606069538 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f987c003a90 msgr2=0x7f987c003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:47.125 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:47.118+0000 7f989688e700 1 --2- 172.21.15.57:0/2606069538 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f987c003a90 0x7f987c003e60 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f988c0051b0 tx=0x7f988c008bf0 comp rx=0 tx=0).stop 2023-10-06T03:01:47.125 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:47.118+0000 7f989608d700 1 -- 172.21.15.57:0/2606069538 reap_dead start 2023-10-06T03:01:47.125 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:47.118+0000 7f989688e700 1 -- 172.21.15.57:0/2606069538 shutdown_connections 2023-10-06T03:01:47.125 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:47.118+0000 7f989688e700 1 -- 172.21.15.57:0/2606069538 >> 172.21.15.57:0/2606069538 conn(0x7f98900d0a50 msgr2=0x7f98900cca60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:47.126 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:47.118+0000 7f989688e700 1 -- 172.21.15.57:0/2606069538 shutdown_connections 2023-10-06T03:01:47.126 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:47.118+0000 7f989688e700 1 -- 172.21.15.57:0/2606069538 wait complete. 2023-10-06T03:01:47.128 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:47.122+0000 7f989688e700 1 Processor -- start 2023-10-06T03:01:47.128 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:47.122+0000 7f989688e700 1 -- start start 2023-10-06T03:01:47.129 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:47.122+0000 7f989688e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f987c003a90 0x7f9890157e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:47.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:47.122+0000 7f989688e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f989015b2f0 0x7f989015b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:47.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:47.122+0000 7f989688e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9890169320 0x7f9890169790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:47.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:47.122+0000 7f989688e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f989016a520 con 0x7f9890169320 2023-10-06T03:01:47.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:47.122+0000 7f989688e700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98900c7110 con 0x7f989015b2f0 2023-10-06T03:01:47.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:47.122+0000 7f989688e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f989015bca0 con 0x7f987c003a90 2023-10-06T03:01:47.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:47.122+0000 7f989608d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9890169320 0x7f9890169790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:47.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:47.122+0000 7f989608d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9890169320 0x7f9890169790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58814/0 (socket says 172.21.15.57:58814) 2023-10-06T03:01:47.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:47.122+0000 7f989608d700 1 -- 172.21.15.57:0/4081786814 learned_addr learned my addr 172.21.15.57:0/4081786814 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:47.131 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:47.122+0000 7f989588c700 1 --2- 172.21.15.57:0/4081786814 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f987c003a90 0x7f9890157e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:47.131 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:47.122+0000 7f989508b700 1 --2- 172.21.15.57:0/4081786814 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f989015b2f0 0x7f989015b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:47.131 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:47.126+0000 7f989608d700 1 -- 172.21.15.57:0/4081786814 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f987c003a90 msgr2=0x7f9890157e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:47.131 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:47.126+0000 7f989608d700 1 --2- 172.21.15.57:0/4081786814 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f987c003a90 0x7f9890157e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:47.131 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:47.126+0000 7f989608d700 1 -- 172.21.15.57:0/4081786814 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f989015b2f0 msgr2=0x7f989015b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:47.131 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:47.126+0000 7f989608d700 1 --2- 172.21.15.57:0/4081786814 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f989015b2f0 0x7f989015b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:47.132 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:47.126+0000 7f989608d700 1 -- 172.21.15.57:0/4081786814 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98900b3490 con 0x7f9890169320 2023-10-06T03:01:47.132 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:47.126+0000 7f989508b700 1 --2- 172.21.15.57:0/4081786814 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f989015b2f0 0x7f989015b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:47.132 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:47.126+0000 7f989608d700 1 --2- 172.21.15.57:0/4081786814 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9890169320 0x7f9890169790 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f98900c6f90 tx=0x7f988800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:47.132 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:47.126+0000 7f9885ffb700 1 -- 172.21.15.57:0/4081786814 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f988800fd00 con 0x7f9890169320 2023-10-06T03:01:47.132 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:47.126+0000 7f9885ffb700 1 -- 172.21.15.57:0/4081786814 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f988800fe60 con 0x7f9890169320 2023-10-06T03:01:47.133 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:47.126+0000 7f989688e700 1 -- 172.21.15.57:0/4081786814 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9890158920 con 0x7f9890169320 2023-10-06T03:01:47.133 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:47.126+0000 7f9885ffb700 1 -- 172.21.15.57:0/4081786814 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9888016650 con 0x7f9890169320 2023-10-06T03:01:47.133 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:47.126+0000 7f989688e700 1 -- 172.21.15.57:0/4081786814 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9890169cd0 con 0x7f9890169320 2023-10-06T03:01:47.133 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:47.126+0000 7f989688e700 1 -- 172.21.15.57:0/4081786814 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98900b3620 con 0x7f9890169320 2023-10-06T03:01:47.135 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:47.130+0000 7f9885ffb700 1 -- 172.21.15.57:0/4081786814 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f9888016a00 con 0x7f9890169320 2023-10-06T03:01:47.136 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:47.130+0000 7f9885ffb700 1 --2- 172.21.15.57:0/4081786814 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f9874060550 0x7f9874062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:47.136 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:47.130+0000 7f9885ffb700 1 -- 172.21.15.57:0/4081786814 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5958+0+0 (secure 0 0 0) 0x7f988807d590 con 0x7f9890169320 2023-10-06T03:01:47.137 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:47.130+0000 7f989588c700 1 --2- 172.21.15.57:0/4081786814 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f9874060550 0x7f9874062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:47.138 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:47.130+0000 7f989588c700 1 --2- 172.21.15.57:0/4081786814 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f9874060550 0x7f9874062a00 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f988c008c30 tx=0x7f988c012000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:47.143 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:47.138+0000 7f9885ffb700 1 -- 172.21.15.57:0/4081786814 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f988804d9e0 con 0x7f9890169320 2023-10-06T03:01:47.352 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:47.346+0000 7f989688e700 1 -- 172.21.15.57:0/4081786814 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f989004be40 con 0x7f9890169320 2023-10-06T03:01:47.947 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:47.938+0000 7f9885ffb700 1 -- 172.21.15.57:0/4081786814 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v13) v1 ==== 172+0+0 (secure 0 0 0) 0x7f9888016cb0 con 0x7f9890169320 2023-10-06T03:01:47.957 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:47.950+0000 7f989688e700 1 -- 172.21.15.57:0/4081786814 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f9874060550 msgr2=0x7f9874062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:47.958 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:47.950+0000 7f989688e700 1 --2- 172.21.15.57:0/4081786814 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f9874060550 0x7f9874062a00 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f988c008c30 tx=0x7f988c012000 comp rx=0 tx=0).stop 2023-10-06T03:01:47.958 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:47.950+0000 7f989688e700 1 -- 172.21.15.57:0/4081786814 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9890169320 msgr2=0x7f9890169790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:47.958 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:47.950+0000 7f989688e700 1 --2- 172.21.15.57:0/4081786814 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9890169320 0x7f9890169790 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f98900c6f90 tx=0x7f988800b040 comp rx=0 tx=0).stop 2023-10-06T03:01:47.959 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:47.954+0000 7f989688e700 1 -- 172.21.15.57:0/4081786814 shutdown_connections 2023-10-06T03:01:47.959 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:47.954+0000 7f989688e700 1 --2- 172.21.15.57:0/4081786814 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9890169320 0x7f9890169790 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:47.959 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:47.954+0000 7f989688e700 1 --2- 172.21.15.57:0/4081786814 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f989015b2f0 0x7f989015b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:47.959 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:47.954+0000 7f989688e700 1 --2- 172.21.15.57:0/4081786814 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f9874060550 0x7f9874062a00 secure :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f988c008c30 tx=0x7f988c012000 comp rx=0 tx=0).stop 2023-10-06T03:01:47.959 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:47.954+0000 7f989688e700 1 --2- 172.21.15.57:0/4081786814 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f987c003a90 0x7f9890157e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:47.959 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:47.954+0000 7f989688e700 1 -- 172.21.15.57:0/4081786814 >> 172.21.15.57:0/4081786814 conn(0x7f98900d0a50 msgr2=0x7f989006b770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:47.967 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:47.962+0000 7f989688e700 1 -- 172.21.15.57:0/4081786814 shutdown_connections 2023-10-06T03:01:47.968 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:47.962+0000 7f989688e700 1 -- 172.21.15.57:0/4081786814 wait complete. 2023-10-06T03:01:47.973 INFO:teuthology.orchestra.run.smithi057.stderr:new fs with metadata pool 5 and data pool 6 2023-10-06T03:01:47.994 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:01:48.047 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:01:48.054 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:01:48.154 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.146+0000 7f7741b23700 1 Processor -- start 2023-10-06T03:01:48.154 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.150+0000 7f7741b23700 1 -- start start 2023-10-06T03:01:48.157 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.150+0000 7f7741b23700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f773c0ca750 0x7f773c06dc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:48.157 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.150+0000 7f7741b23700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f773c06c920 con 0x7f773c0cab20 2023-10-06T03:01:48.157 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.150+0000 7f7741b23700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f773c06d780 con 0x7f773c0afe10 2023-10-06T03:01:48.157 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.150+0000 7f7741b23700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f773c0af020 con 0x7f773c0ca750 2023-10-06T03:01:48.158 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.150+0000 7f7740b21700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f773c0ca750 0x7f773c06dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:48.158 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.150+0000 7f7740b21700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f773c0ca750 0x7f773c06dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58820/0 (socket says 172.21.15.57:58820) 2023-10-06T03:01:48.158 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.150+0000 7f7740b21700 1 -- 172.21.15.57:0/2314195289 learned_addr learned my addr 172.21.15.57:0/2314195289 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:48.158 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.150+0000 7f7733fff700 1 --1- 172.21.15.57:0/2314195289 >> v1:172.21.15.57:6789/0 conn(0x7f773c0cab20 0x7f773c0cafc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:51924/0 (socket says 172.21.15.57:51924) 2023-10-06T03:01:48.159 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.150+0000 7f7740b21700 1 -- 172.21.15.57:0/2314195289 >> v1:172.21.15.105:6789/0 conn(0x7f773c0afe10 legacy=0x7f773c0b0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:48.159 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.150+0000 7f7740b21700 1 -- 172.21.15.57:0/2314195289 >> v1:172.21.15.57:6789/0 conn(0x7f773c0cab20 legacy=0x7f773c0cafc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:48.159 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.150+0000 7f7740b21700 1 -- 172.21.15.57:0/2314195289 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f773c06cb70 con 0x7f773c0ca750 2023-10-06T03:01:48.159 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.154+0000 7f7740b21700 1 --2- 172.21.15.57:0/2314195289 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f773c0ca750 0x7f773c06dc10 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f77380099b0 tx=0x7f7738009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=438e29c54679b13 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:48.159 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.154+0000 7f77337fe700 1 -- 172.21.15.57:0/2314195289 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f773800b820 con 0x7f773c0ca750 2023-10-06T03:01:48.159 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.154+0000 7f77337fe700 1 -- 172.21.15.57:0/2314195289 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f773800b980 con 0x7f773c0ca750 2023-10-06T03:01:48.160 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.154+0000 7f77337fe700 1 -- 172.21.15.57:0/2314195289 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f773800bd20 con 0x7f773c0ca750 2023-10-06T03:01:48.161 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.154+0000 7f7741b23700 1 -- 172.21.15.57:0/2314195289 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f773c0ca750 msgr2=0x7f773c06dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:48.161 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.154+0000 7f7741b23700 1 --2- 172.21.15.57:0/2314195289 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f773c0ca750 0x7f773c06dc10 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f77380099b0 tx=0x7f7738009250 comp rx=0 tx=0).stop 2023-10-06T03:01:48.161 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.154+0000 7f7741b23700 1 -- 172.21.15.57:0/2314195289 shutdown_connections 2023-10-06T03:01:48.161 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.154+0000 7f7741b23700 1 --2- 172.21.15.57:0/2314195289 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f773c0ca750 0x7f773c06dc10 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:48.161 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.154+0000 7f7741b23700 1 -- 172.21.15.57:0/2314195289 >> 172.21.15.57:0/2314195289 conn(0x7f773c0cc9f0 msgr2=0x7f773c0ccdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:48.161 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.154+0000 7f7741b23700 1 -- 172.21.15.57:0/2314195289 shutdown_connections 2023-10-06T03:01:48.161 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.154+0000 7f7741b23700 1 -- 172.21.15.57:0/2314195289 wait complete. 2023-10-06T03:01:48.164 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.158+0000 7f7741b23700 1 Processor -- start 2023-10-06T03:01:48.165 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.158+0000 7f7741b23700 1 -- start start 2023-10-06T03:01:48.167 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.162+0000 7f7741b23700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f773c0afe10 0x7f773c0c6540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:48.167 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.162+0000 7f7741b23700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f773c0ca750 0x7f773c16a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:48.168 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.162+0000 7f7741b23700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f773c0cab20 0x7f773c0b1380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:48.168 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.162+0000 7f7741b23700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f773c16c9d0 con 0x7f773c0ca750 2023-10-06T03:01:48.168 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.162+0000 7f7741b23700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f773c0c42e0 con 0x7f773c0cab20 2023-10-06T03:01:48.168 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.162+0000 7f7741b23700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f773c0c45c0 con 0x7f773c0afe10 2023-10-06T03:01:48.168 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.162+0000 7f7733fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f773c0ca750 0x7f773c16a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:48.168 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.162+0000 7f7733fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f773c0ca750 0x7f773c16a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58832/0 (socket says 172.21.15.57:58832) 2023-10-06T03:01:48.168 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.162+0000 7f7733fff700 1 -- 172.21.15.57:0/978957041 learned_addr learned my addr 172.21.15.57:0/978957041 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:48.169 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.162+0000 7f7740b21700 1 --2- 172.21.15.57:0/978957041 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f773c0afe10 0x7f773c0c6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:48.169 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.162+0000 7f7741322700 1 --2- 172.21.15.57:0/978957041 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f773c0cab20 0x7f773c0b1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:48.169 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.162+0000 7f7733fff700 1 -- 172.21.15.57:0/978957041 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f773c0afe10 msgr2=0x7f773c0c6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:48.169 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.162+0000 7f7733fff700 1 --2- 172.21.15.57:0/978957041 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f773c0afe10 0x7f773c0c6540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:48.169 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.162+0000 7f7733fff700 1 -- 172.21.15.57:0/978957041 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f773c0cab20 msgr2=0x7f773c0b1380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:48.169 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.162+0000 7f7733fff700 1 --2- 172.21.15.57:0/978957041 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f773c0cab20 0x7f773c0b1380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:48.169 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.162+0000 7f7733fff700 1 -- 172.21.15.57:0/978957041 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77380094f0 con 0x7f773c0ca750 2023-10-06T03:01:48.170 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.162+0000 7f7733fff700 1 --2- 172.21.15.57:0/978957041 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f773c0ca750 0x7f773c16a320 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f772c00c560 tx=0x7f772c007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:48.170 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.162+0000 7f7730ff9700 1 -- 172.21.15.57:0/978957041 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f772c005a70 con 0x7f773c0ca750 2023-10-06T03:01:48.170 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.162+0000 7f7730ff9700 1 -- 172.21.15.57:0/978957041 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f772c005bd0 con 0x7f773c0ca750 2023-10-06T03:01:48.170 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.162+0000 7f7741b23700 1 -- 172.21.15.57:0/978957041 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f773c0c48a0 con 0x7f773c0ca750 2023-10-06T03:01:48.170 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.162+0000 7f7730ff9700 1 -- 172.21.15.57:0/978957041 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f772c0070d0 con 0x7f773c0ca750 2023-10-06T03:01:48.170 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.162+0000 7f7741b23700 1 -- 172.21.15.57:0/978957041 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f773c0c4b80 con 0x7f773c0ca750 2023-10-06T03:01:48.171 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.166+0000 7f7741b23700 1 -- 172.21.15.57:0/978957041 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f773c04be40 con 0x7f773c0ca750 2023-10-06T03:01:48.174 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.166+0000 7f7730ff9700 1 -- 172.21.15.57:0/978957041 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f772c007480 con 0x7f773c0ca750 2023-10-06T03:01:48.175 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.170+0000 7f7730ff9700 1 --2- 172.21.15.57:0/978957041 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f7728060550 0x7f7728062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:48.175 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.170+0000 7f7730ff9700 1 -- 172.21.15.57:0/978957041 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f772c07bc80 con 0x7f773c0ca750 2023-10-06T03:01:48.176 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.170+0000 7f7740b21700 1 --2- 172.21.15.57:0/978957041 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f7728060550 0x7f7728062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:48.177 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.170+0000 7f7740b21700 1 --2- 172.21.15.57:0/978957041 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f7728060550 0x7f7728062a00 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f77380099b0 tx=0x7f7738016000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:48.181 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.174+0000 7f7730ff9700 1 -- 172.21.15.57:0/978957041 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f772c04c110 con 0x7f773c0ca750 2023-10-06T03:01:48.351 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.346+0000 7f7741b23700 1 -- 172.21.15.57:0/978957041 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f773c06ce50 con 0x7f773c0ca750 2023-10-06T03:01:48.352 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.346+0000 7f7730ff9700 1 -- 172.21.15.57:0/978957041 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16879 (secure 0 0 0) 0x7f772c04f730 con 0x7f773c0ca750 2023-10-06T03:01:48.353 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:01:48.353 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":34,"fsid":"eb56dc0f-9213-41cb-9aad-8ade6c802e98","created":"2023-10-06T03:00:30.806197+0000","modified":"2023-10-06T03:01:47.352669+0000","last_up_change":"2023-10-06T03:00:43.607454+0000","last_in_change":"2023-10-06T03:00:33.943513+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T03:00:44.360651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T03:00:50.466601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:01:45.068952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-10-06T03:01:46.357714+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"58cf6c90-d704-43e0-b2db-dffe526d5e8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":33053},{"type":"v1","addr":"172.21.15.57:6801","nonce":33053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":33053},{"type":"v1","addr":"172.21.15.57:6803","nonce":33053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":33053},{"type":"v1","addr":"172.21.15.57:6807","nonce":33053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":33053},{"type":"v1","addr":"172.21.15.57:6805","nonce":33053}]},"public_addr":"172.21.15.57:6801/33053","cluster_addr":"172.21.15.57:6803/33053","heartbeat_back_addr":"172.21.15.57:6807/33053","heartbeat_front_addr":"172.21.15.57:6805/33053","state":["exists","up"]},{"osd":1,"uuid":"16afbe70-7f9e-4568-9c92-763e6e348119","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6809","nonce":33052},{"type":"v1","addr":"172.21.15.57:6810","nonce":33052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":33052},{"type":"v1","addr":"172.21.15.57:6813","nonce":33052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":33052},{"type":"v1","addr":"172.21.15.57:6822","nonce":33052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6815","nonce":33052},{"type":"v1","addr":"172.21.15.57:6818","nonce":33052}]},"public_addr":"172.21.15.57:6810/33052","cluster_addr":"172.21.15.57:6813/33052","heartbeat_back_addr":"172.21.15.57:6822/33052","heartbeat_front_addr":"172.21.15.57:6818/33052","state":["exists","up"]},{"osd":2,"uuid":"7255c62e-f92f-470f-a5ce-30228920d9f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":33058},{"type":"v1","addr":"172.21.15.57:6825","nonce":33058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":33058},{"type":"v1","addr":"172.21.15.57:6827","nonce":33058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":33058},{"type":"v1","addr":"172.21.15.57:6831","nonce":33058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":33058},{"type":"v1","addr":"172.21.15.57:6829","nonce":33058}]},"public_addr":"172.21.15.57:6825/33058","cluster_addr":"172.21.15.57:6827/33058","heartbeat_back_addr":"172.21.15.57:6831/33058","heartbeat_front_addr":"172.21.15.57:6829/33058","state":["exists","up"]},{"osd":3,"uuid":"152a236d-f799-4888-8544-74865508d5a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":33057},{"type":"v1","addr":"172.21.15.57:6811","nonce":33057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":33057},{"type":"v1","addr":"172.21.15.57:6816","nonce":33057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6821","nonce":33057},{"type":"v1","addr":"172.21.15.57:6823","nonce":33057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6817","nonce":33057},{"type":"v1","addr":"172.21.15.57:6819","nonce":33057}]},"public_addr":"172.21.15.57:6811/33057","cluster_addr":"172.21.15.57:6816/33057","heartbeat_back_addr":"172.21.15.57:6823/33057","heartbeat_front_addr":"172.21.15.57:6819/33057","state":["exists","up"]},{"osd":4,"uuid":"37db2a65-3566-41d0-9d60-e66c49e1e68e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":33368},{"type":"v1","addr":"172.21.15.105:6801","nonce":33368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":33368},{"type":"v1","addr":"172.21.15.105:6803","nonce":33368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":33368},{"type":"v1","addr":"172.21.15.105:6807","nonce":33368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":33368},{"type":"v1","addr":"172.21.15.105:6805","nonce":33368}]},"public_addr":"172.21.15.105:6801/33368","cluster_addr":"172.21.15.105:6803/33368","heartbeat_back_addr":"172.21.15.105:6807/33368","heartbeat_front_addr":"172.21.15.105:6805/33368","state":["exists","up"]},{"osd":5,"uuid":"35e77918-1bb4-42ca-9b20-f3c14eaa0c04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":33379},{"type":"v1","addr":"172.21.15.105:6818","nonce":33379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":33379},{"type":"v1","addr":"172.21.15.105:6823","nonce":33379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":33379},{"type":"v1","addr":"172.21.15.105:6831","nonce":33379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":33379},{"type":"v1","addr":"172.21.15.105:6827","nonce":33379}]},"public_addr":"172.21.15.105:6818/33379","cluster_addr":"172.21.15.105:6823/33379","heartbeat_back_addr":"172.21.15.105:6831/33379","heartbeat_front_addr":"172.21.15.105:6827/33379","state":["exists","up"]},{"osd":6,"uuid":"b4d9d510-7a45-4173-8287-c6c8d6547f2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":33369},{"type":"v1","addr":"172.21.15.105:6819","nonce":33369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":33369},{"type":"v1","addr":"172.21.15.105:6822","nonce":33369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":33369},{"type":"v1","addr":"172.21.15.105:6830","nonce":33369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":33369},{"type":"v1","addr":"172.21.15.105:6826","nonce":33369}]},"public_addr":"172.21.15.105:6819/33369","cluster_addr":"172.21.15.105:6822/33369","heartbeat_back_addr":"172.21.15.105:6830/33369","heartbeat_front_addr":"172.21.15.105:6826/33369","state":["exists","up"]},{"osd":7,"uuid":"74266fb0-cd84-463f-8bf0-092652a71dc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":33370},{"type":"v1","addr":"172.21.15.105:6809","nonce":33370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":33370},{"type":"v1","addr":"172.21.15.105:6811","nonce":33370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":33370},{"type":"v1","addr":"172.21.15.105:6815","nonce":33370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":33370},{"type":"v1","addr":"172.21.15.105:6813","nonce":33370}]},"public_addr":"172.21.15.105:6809/33370","cluster_addr":"172.21.15.105:6811/33370","heartbeat_back_addr":"172.21.15.105:6815/33370","heartbeat_front_addr":"172.21.15.105:6813/33370","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.596864+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.633851+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.636993+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.529681+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.608601+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.659752+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.661717+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.642221+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:01:48.357 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.350+0000 7f7741b23700 1 -- 172.21.15.57:0/978957041 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f7728060550 msgr2=0x7f7728062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:48.357 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.350+0000 7f7741b23700 1 --2- 172.21.15.57:0/978957041 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f7728060550 0x7f7728062a00 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f77380099b0 tx=0x7f7738016000 comp rx=0 tx=0).stop 2023-10-06T03:01:48.357 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.350+0000 7f7741b23700 1 -- 172.21.15.57:0/978957041 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f773c0ca750 msgr2=0x7f773c16a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:48.357 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.350+0000 7f7741b23700 1 --2- 172.21.15.57:0/978957041 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f773c0ca750 0x7f773c16a320 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f772c00c560 tx=0x7f772c007f70 comp rx=0 tx=0).stop 2023-10-06T03:01:48.358 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.350+0000 7f7741b23700 1 -- 172.21.15.57:0/978957041 shutdown_connections 2023-10-06T03:01:48.358 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.350+0000 7f7741b23700 1 --2- 172.21.15.57:0/978957041 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f773c0cab20 0x7f773c0b1380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:48.358 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.350+0000 7f7741b23700 1 --2- 172.21.15.57:0/978957041 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f773c0ca750 0x7f773c16a320 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:48.358 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.350+0000 7f7741b23700 1 --2- 172.21.15.57:0/978957041 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f7728060550 0x7f7728062a00 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:48.358 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.350+0000 7f7741b23700 1 --2- 172.21.15.57:0/978957041 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f773c0afe10 0x7f773c0c6540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:48.358 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.350+0000 7f7741b23700 1 -- 172.21.15.57:0/978957041 >> 172.21.15.57:0/978957041 conn(0x7f773c0cc9f0 msgr2=0x7f773c15c310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:48.358 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.350+0000 7f7741b23700 1 -- 172.21.15.57:0/978957041 shutdown_connections 2023-10-06T03:01:48.358 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.350+0000 7f7741b23700 1 -- 172.21.15.57:0/978957041 wait complete. 2023-10-06T03:01:48.377 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:01:48.580 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.574+0000 7f190359e700 1 Processor -- start 2023-10-06T03:01:48.581 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.574+0000 7f190359e700 1 -- start start 2023-10-06T03:01:48.584 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.578+0000 7f190359e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f190406c920 0x7f19040aa7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:48.584 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.578+0000 7f190359e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f190406de50 con 0x7f190406bba0 2023-10-06T03:01:48.584 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.578+0000 7f190359e700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f190406e130 con 0x7f19040aae90 2023-10-06T03:01:48.584 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.578+0000 7f190359e700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f190406c000 con 0x7f190406c920 2023-10-06T03:01:48.585 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.578+0000 7f190259c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f190406c920 0x7f19040aa7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:48.585 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.578+0000 7f1902d9d700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f190406bba0 0x7f19040ab970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:51934/0 (socket says 172.21.15.57:51934) 2023-10-06T03:01:48.585 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.578+0000 7f1902d9d700 1 -- 172.21.15.57:0/65766892 learned_addr learned my addr 172.21.15.57:0/65766892 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:01:48.586 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.578+0000 7f190159a700 1 -- 172.21.15.57:0/65766892 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3405252850 0 0) 0x7f190406de50 con 0x7f190406bba0 2023-10-06T03:01:48.586 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.578+0000 7f190259c700 1 -- 172.21.15.57:0/65766892 >> v1:172.21.15.105:6789/0 conn(0x7f19040aae90 legacy=0x7f190406ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:48.586 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.578+0000 7f190259c700 1 -- 172.21.15.57:0/65766892 >> v1:172.21.15.57:6789/0 conn(0x7f190406bba0 legacy=0x7f19040ab970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:48.586 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.578+0000 7f190259c700 1 -- 172.21.15.57:0/65766892 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f190406b3a0 con 0x7f190406c920 2023-10-06T03:01:48.586 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.578+0000 7f190259c700 1 --2- 172.21.15.57:0/65766892 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f190406c920 0x7f19040aa7e0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f18f40098e0 tx=0x7f18f40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45690a90d0c91f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:48.587 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.578+0000 7f190159a700 1 -- 172.21.15.57:0/65766892 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f4009e80 con 0x7f190406c920 2023-10-06T03:01:48.588 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.578+0000 7f190159a700 1 -- 172.21.15.57:0/65766892 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18f400b860 con 0x7f190406c920 2023-10-06T03:01:48.588 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.578+0000 7f190159a700 1 -- 172.21.15.57:0/65766892 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f400bbe0 con 0x7f190406c920 2023-10-06T03:01:48.588 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.578+0000 7f190359e700 1 -- 172.21.15.57:0/65766892 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f190406c920 msgr2=0x7f19040aa7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:48.588 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.578+0000 7f190359e700 1 --2- 172.21.15.57:0/65766892 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f190406c920 0x7f19040aa7e0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f18f40098e0 tx=0x7f18f40091a0 comp rx=0 tx=0).stop 2023-10-06T03:01:48.588 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.582+0000 7f190359e700 1 -- 172.21.15.57:0/65766892 shutdown_connections 2023-10-06T03:01:48.588 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.582+0000 7f190359e700 1 --2- 172.21.15.57:0/65766892 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f190406c920 0x7f19040aa7e0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:48.588 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.582+0000 7f190359e700 1 -- 172.21.15.57:0/65766892 >> 172.21.15.57:0/65766892 conn(0x7f19040c85e0 msgr2=0x7f19040c89e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:48.588 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.582+0000 7f190359e700 1 -- 172.21.15.57:0/65766892 shutdown_connections 2023-10-06T03:01:48.589 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.582+0000 7f190359e700 1 -- 172.21.15.57:0/65766892 wait complete. 2023-10-06T03:01:48.589 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.582+0000 7f190359e700 1 Processor -- start 2023-10-06T03:01:48.589 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.582+0000 7f190359e700 1 -- start start 2023-10-06T03:01:48.590 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.582+0000 7f190359e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f190406bba0 0x7f1904161640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:48.590 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.582+0000 7f190359e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f190406c920 0x7f19040c1580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:48.590 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.582+0000 7f190359e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f19040aae90 0x7f190415ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:48.590 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.582+0000 7f190359e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1904161b80 con 0x7f190406bba0 2023-10-06T03:01:48.591 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.582+0000 7f190359e700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1904162630 con 0x7f19040aae90 2023-10-06T03:01:48.591 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.582+0000 7f190359e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f190416d630 con 0x7f190406c920 2023-10-06T03:01:48.593 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.586+0000 7f190259c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f190406bba0 0x7f1904161640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:48.593 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.586+0000 7f190259c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f190406bba0 0x7f1904161640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58848/0 (socket says 172.21.15.57:58848) 2023-10-06T03:01:48.593 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.586+0000 7f190259c700 1 -- 172.21.15.57:0/1710592637 learned_addr learned my addr 172.21.15.57:0/1710592637 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:48.593 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.586+0000 7f1902d9d700 1 --2- 172.21.15.57:0/1710592637 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f19040aae90 0x7f190415ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:48.593 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.586+0000 7f1901d9b700 1 --2- 172.21.15.57:0/1710592637 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f190406c920 0x7f19040c1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:48.593 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.586+0000 7f190259c700 1 -- 172.21.15.57:0/1710592637 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f190406c920 msgr2=0x7f19040c1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:48.593 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.586+0000 7f190259c700 1 --2- 172.21.15.57:0/1710592637 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f190406c920 0x7f19040c1580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:48.594 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.586+0000 7f190259c700 1 -- 172.21.15.57:0/1710592637 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f19040aae90 msgr2=0x7f190415ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:48.594 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.586+0000 7f190259c700 1 --2- 172.21.15.57:0/1710592637 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f19040aae90 0x7f190415ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:48.594 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.586+0000 7f190259c700 1 -- 172.21.15.57:0/1710592637 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18f4009420 con 0x7f190406bba0 2023-10-06T03:01:48.594 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.586+0000 7f1902d9d700 1 --2- 172.21.15.57:0/1710592637 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f19040aae90 0x7f190415ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:48.594 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.586+0000 7f190259c700 1 --2- 172.21.15.57:0/1710592637 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f190406bba0 0x7f1904161640 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f190406a1d0 tx=0x7f18f4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:48.594 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.586+0000 7f18f27fc700 1 -- 172.21.15.57:0/1710592637 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f401f070 con 0x7f190406bba0 2023-10-06T03:01:48.594 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.586+0000 7f18f27fc700 1 -- 172.21.15.57:0/1710592637 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18f400b9d0 con 0x7f190406bba0 2023-10-06T03:01:48.594 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.586+0000 7f190359e700 1 -- 172.21.15.57:0/1710592637 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1904161d90 con 0x7f190406bba0 2023-10-06T03:01:48.594 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.586+0000 7f18f27fc700 1 -- 172.21.15.57:0/1710592637 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f4025670 con 0x7f190406bba0 2023-10-06T03:01:48.595 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.586+0000 7f190359e700 1 -- 172.21.15.57:0/1710592637 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1904162350 con 0x7f190406bba0 2023-10-06T03:01:48.595 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.590+0000 7f190359e700 1 -- 172.21.15.57:0/1710592637 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f190404be40 con 0x7f190406bba0 2023-10-06T03:01:48.595 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.590+0000 7f18f27fc700 1 -- 172.21.15.57:0/1710592637 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f18f4023070 con 0x7f190406bba0 2023-10-06T03:01:48.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.590+0000 7f18f27fc700 1 --2- 172.21.15.57:0/1710592637 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f18e4060550 0x7f18e4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:48.598 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.590+0000 7f18f27fc700 1 -- 172.21.15.57:0/1710592637 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f18f407dff0 con 0x7f190406bba0 2023-10-06T03:01:48.598 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.590+0000 7f1901d9b700 1 --2- 172.21.15.57:0/1710592637 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f18e4060550 0x7f18e4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:48.599 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.594+0000 7f1901d9b700 1 --2- 172.21.15.57:0/1710592637 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f18e4060550 0x7f18e4062a00 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f190415ef00 tx=0x7f18f8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:48.602 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.598+0000 7f18f27fc700 1 -- 172.21.15.57:0/1710592637 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f18f40adbe0 con 0x7f190406bba0 2023-10-06T03:01:48.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.770+0000 7f190359e700 1 -- 172.21.15.57:0/1710592637 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f19040aab00 con 0x7f190406bba0 2023-10-06T03:01:48.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.770+0000 7f18f27fc700 1 -- 172.21.15.57:0/1710592637 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16879 (secure 0 0 0) 0x7f18f402a090 con 0x7f190406bba0 2023-10-06T03:01:48.778 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:01:48.778 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":34,"fsid":"eb56dc0f-9213-41cb-9aad-8ade6c802e98","created":"2023-10-06T03:00:30.806197+0000","modified":"2023-10-06T03:01:47.352669+0000","last_up_change":"2023-10-06T03:00:43.607454+0000","last_in_change":"2023-10-06T03:00:33.943513+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T03:00:44.360651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T03:00:50.466601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:01:45.068952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-10-06T03:01:46.357714+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"58cf6c90-d704-43e0-b2db-dffe526d5e8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":33053},{"type":"v1","addr":"172.21.15.57:6801","nonce":33053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":33053},{"type":"v1","addr":"172.21.15.57:6803","nonce":33053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":33053},{"type":"v1","addr":"172.21.15.57:6807","nonce":33053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":33053},{"type":"v1","addr":"172.21.15.57:6805","nonce":33053}]},"public_addr":"172.21.15.57:6801/33053","cluster_addr":"172.21.15.57:6803/33053","heartbeat_back_addr":"172.21.15.57:6807/33053","heartbeat_front_addr":"172.21.15.57:6805/33053","state":["exists","up"]},{"osd":1,"uuid":"16afbe70-7f9e-4568-9c92-763e6e348119","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6809","nonce":33052},{"type":"v1","addr":"172.21.15.57:6810","nonce":33052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":33052},{"type":"v1","addr":"172.21.15.57:6813","nonce":33052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":33052},{"type":"v1","addr":"172.21.15.57:6822","nonce":33052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6815","nonce":33052},{"type":"v1","addr":"172.21.15.57:6818","nonce":33052}]},"public_addr":"172.21.15.57:6810/33052","cluster_addr":"172.21.15.57:6813/33052","heartbeat_back_addr":"172.21.15.57:6822/33052","heartbeat_front_addr":"172.21.15.57:6818/33052","state":["exists","up"]},{"osd":2,"uuid":"7255c62e-f92f-470f-a5ce-30228920d9f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":33058},{"type":"v1","addr":"172.21.15.57:6825","nonce":33058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":33058},{"type":"v1","addr":"172.21.15.57:6827","nonce":33058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":33058},{"type":"v1","addr":"172.21.15.57:6831","nonce":33058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":33058},{"type":"v1","addr":"172.21.15.57:6829","nonce":33058}]},"public_addr":"172.21.15.57:6825/33058","cluster_addr":"172.21.15.57:6827/33058","heartbeat_back_addr":"172.21.15.57:6831/33058","heartbeat_front_addr":"172.21.15.57:6829/33058","state":["exists","up"]},{"osd":3,"uuid":"152a236d-f799-4888-8544-74865508d5a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":33057},{"type":"v1","addr":"172.21.15.57:6811","nonce":33057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":33057},{"type":"v1","addr":"172.21.15.57:6816","nonce":33057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6821","nonce":33057},{"type":"v1","addr":"172.21.15.57:6823","nonce":33057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6817","nonce":33057},{"type":"v1","addr":"172.21.15.57:6819","nonce":33057}]},"public_addr":"172.21.15.57:6811/33057","cluster_addr":"172.21.15.57:6816/33057","heartbeat_back_addr":"172.21.15.57:6823/33057","heartbeat_front_addr":"172.21.15.57:6819/33057","state":["exists","up"]},{"osd":4,"uuid":"37db2a65-3566-41d0-9d60-e66c49e1e68e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":33368},{"type":"v1","addr":"172.21.15.105:6801","nonce":33368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":33368},{"type":"v1","addr":"172.21.15.105:6803","nonce":33368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":33368},{"type":"v1","addr":"172.21.15.105:6807","nonce":33368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":33368},{"type":"v1","addr":"172.21.15.105:6805","nonce":33368}]},"public_addr":"172.21.15.105:6801/33368","cluster_addr":"172.21.15.105:6803/33368","heartbeat_back_addr":"172.21.15.105:6807/33368","heartbeat_front_addr":"172.21.15.105:6805/33368","state":["exists","up"]},{"osd":5,"uuid":"35e77918-1bb4-42ca-9b20-f3c14eaa0c04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":33379},{"type":"v1","addr":"172.21.15.105:6818","nonce":33379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":33379},{"type":"v1","addr":"172.21.15.105:6823","nonce":33379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":33379},{"type":"v1","addr":"172.21.15.105:6831","nonce":33379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":33379},{"type":"v1","addr":"172.21.15.105:6827","nonce":33379}]},"public_addr":"172.21.15.105:6818/33379","cluster_addr":"172.21.15.105:6823/33379","heartbeat_back_addr":"172.21.15.105:6831/33379","heartbeat_front_addr":"172.21.15.105:6827/33379","state":["exists","up"]},{"osd":6,"uuid":"b4d9d510-7a45-4173-8287-c6c8d6547f2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":33369},{"type":"v1","addr":"172.21.15.105:6819","nonce":33369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":33369},{"type":"v1","addr":"172.21.15.105:6822","nonce":33369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":33369},{"type":"v1","addr":"172.21.15.105:6830","nonce":33369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":33369},{"type":"v1","addr":"172.21.15.105:6826","nonce":33369}]},"public_addr":"172.21.15.105:6819/33369","cluster_addr":"172.21.15.105:6822/33369","heartbeat_back_addr":"172.21.15.105:6830/33369","heartbeat_front_addr":"172.21.15.105:6826/33369","state":["exists","up"]},{"osd":7,"uuid":"74266fb0-cd84-463f-8bf0-092652a71dc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":33370},{"type":"v1","addr":"172.21.15.105:6809","nonce":33370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":33370},{"type":"v1","addr":"172.21.15.105:6811","nonce":33370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":33370},{"type":"v1","addr":"172.21.15.105:6815","nonce":33370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":33370},{"type":"v1","addr":"172.21.15.105:6813","nonce":33370}]},"public_addr":"172.21.15.105:6809/33370","cluster_addr":"172.21.15.105:6811/33370","heartbeat_back_addr":"172.21.15.105:6815/33370","heartbeat_front_addr":"172.21.15.105:6813/33370","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.596864+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.633851+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.636993+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.529681+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.608601+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.659752+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.661717+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.642221+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:01:48.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.774+0000 7f190359e700 1 -- 172.21.15.57:0/1710592637 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f18e4060550 msgr2=0x7f18e4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:48.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.774+0000 7f190359e700 1 --2- 172.21.15.57:0/1710592637 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f18e4060550 0x7f18e4062a00 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f190415ef00 tx=0x7f18f8009040 comp rx=0 tx=0).stop 2023-10-06T03:01:48.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.774+0000 7f190359e700 1 -- 172.21.15.57:0/1710592637 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f190406bba0 msgr2=0x7f1904161640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:48.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.774+0000 7f190359e700 1 --2- 172.21.15.57:0/1710592637 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f190406bba0 0x7f1904161640 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f190406a1d0 tx=0x7f18f4017000 comp rx=0 tx=0).stop 2023-10-06T03:01:48.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.774+0000 7f190359e700 1 -- 172.21.15.57:0/1710592637 shutdown_connections 2023-10-06T03:01:48.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.774+0000 7f190359e700 1 --2- 172.21.15.57:0/1710592637 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f19040aae90 0x7f190415ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:48.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.774+0000 7f190359e700 1 --2- 172.21.15.57:0/1710592637 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f18e4060550 0x7f18e4062a00 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:48.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.774+0000 7f190359e700 1 --2- 172.21.15.57:0/1710592637 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f190406c920 0x7f19040c1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:48.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.774+0000 7f190359e700 1 --2- 172.21.15.57:0/1710592637 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f190406bba0 0x7f1904161640 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:48.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.774+0000 7f190359e700 1 -- 172.21.15.57:0/1710592637 >> 172.21.15.57:0/1710592637 conn(0x7f19040c85e0 msgr2=0x7f19040b0f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:48.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.774+0000 7f190359e700 1 -- 172.21.15.57:0/1710592637 shutdown_connections 2023-10-06T03:01:48.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.774+0000 7f190359e700 1 -- 172.21.15.57:0/1710592637 wait complete. 2023-10-06T03:01:48.804 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-06T03:01:48.960 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.954+0000 7f9edb82e700 1 Processor -- start 2023-10-06T03:01:48.961 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.954+0000 7f9edb82e700 1 -- start start 2023-10-06T03:01:48.964 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.958+0000 7f9edb82e700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f9ed4153580 0x7f9ed4153950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:48.964 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.958+0000 7f9edb82e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ed40cb3e0 con 0x7f9ed40c6020 2023-10-06T03:01:48.964 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.958+0000 7f9edb82e700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ed4159b80 con 0x7f9ed406ad40 2023-10-06T03:01:48.964 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.958+0000 7f9edb82e700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ed406c920 con 0x7f9ed4153580 2023-10-06T03:01:48.964 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.958+0000 7f9ed9dcb700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f9ed40c6020 0x7f9ed40cb870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:51946/0 (socket says 172.21.15.57:51946) 2023-10-06T03:01:48.965 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.958+0000 7f9ed9dcb700 1 -- 172.21.15.57:0/323273085 learned_addr learned my addr 172.21.15.57:0/323273085 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:01:48.965 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.958+0000 7f9ed95ca700 1 --2- 172.21.15.57:0/323273085 >> v2:172.21.15.105:3300/0 conn(0x7f9ed4153580 0x7f9ed4153950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:48.966 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.958+0000 7f9ed95ca700 1 -- 172.21.15.57:0/323273085 >> v1:172.21.15.105:6789/0 conn(0x7f9ed406ad40 legacy=0x7f9ed40c5910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:48.966 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.958+0000 7f9ed95ca700 1 -- 172.21.15.57:0/323273085 >> v1:172.21.15.57:6789/0 conn(0x7f9ed40c6020 legacy=0x7f9ed40cb870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:48.967 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.958+0000 7f9ed95ca700 1 -- 172.21.15.57:0/323273085 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ed406b920 con 0x7f9ed4153580 2023-10-06T03:01:48.967 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.958+0000 7f9ed95ca700 1 --2- 172.21.15.57:0/323273085 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9ed4153580 0x7f9ed4153950 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9ed0009e60 tx=0x7f9ed0009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=792d052710a836d0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:48.970 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.962+0000 7f9ecbfff700 1 -- 172.21.15.57:0/323273085 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed000e070 con 0x7f9ed4153580 2023-10-06T03:01:48.970 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.962+0000 7f9ecbfff700 1 -- 172.21.15.57:0/323273085 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ed000bc30 con 0x7f9ed4153580 2023-10-06T03:01:48.970 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.962+0000 7f9ecbfff700 1 -- 172.21.15.57:0/323273085 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed0012430 con 0x7f9ed4153580 2023-10-06T03:01:48.971 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.966+0000 7f9edb82e700 1 -- 172.21.15.57:0/323273085 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9ed4153580 msgr2=0x7f9ed4153950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:48.971 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.966+0000 7f9edb82e700 1 --2- 172.21.15.57:0/323273085 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9ed4153580 0x7f9ed4153950 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9ed0009e60 tx=0x7f9ed0009780 comp rx=0 tx=0).stop 2023-10-06T03:01:48.972 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.966+0000 7f9edb82e700 1 -- 172.21.15.57:0/323273085 shutdown_connections 2023-10-06T03:01:48.972 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.966+0000 7f9edb82e700 1 --2- 172.21.15.57:0/323273085 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9ed4153580 0x7f9ed4153950 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:48.972 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.966+0000 7f9edb82e700 1 -- 172.21.15.57:0/323273085 >> 172.21.15.57:0/323273085 conn(0x7f9ed40ccbd0 msgr2=0x7f9ed40ccfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:48.972 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.966+0000 7f9edb82e700 1 -- 172.21.15.57:0/323273085 shutdown_connections 2023-10-06T03:01:48.972 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.966+0000 7f9edb82e700 1 -- 172.21.15.57:0/323273085 wait complete. 2023-10-06T03:01:48.973 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.966+0000 7f9edb82e700 1 Processor -- start 2023-10-06T03:01:48.974 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.966+0000 7f9edb82e700 1 -- start start 2023-10-06T03:01:48.976 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.970+0000 7f9edb82e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9ed406ad40 0x7f9ed40b57a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:48.976 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.970+0000 7f9edb82e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ed40c6020 0x7f9ed40b4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:48.976 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.970+0000 7f9edb82e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9ed4153580 0x7f9ed40b4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:48.976 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.970+0000 7f9edb82e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed4150030 con 0x7f9ed40c6020 2023-10-06T03:01:48.976 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.970+0000 7f9edb82e700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed4154420 con 0x7f9ed4153580 2023-10-06T03:01:48.976 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.970+0000 7f9edb82e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed40b5180 con 0x7f9ed406ad40 2023-10-06T03:01:48.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.970+0000 7f9ed95ca700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9ed406ad40 0x7f9ed40b57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:48.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.970+0000 7f9ed95ca700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9ed406ad40 0x7f9ed40b57a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.57:36234/0 (socket says 172.21.15.57:36234) 2023-10-06T03:01:48.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.970+0000 7f9ed8dc9700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ed40c6020 0x7f9ed40b4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:48.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.970+0000 7f9ed95ca700 1 -- 172.21.15.57:0/3705565016 learned_addr learned my addr 172.21.15.57:0/3705565016 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:48.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.970+0000 7f9ed9dcb700 1 --2- 172.21.15.57:0/3705565016 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9ed4153580 0x7f9ed40b4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:48.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.970+0000 7f9ed95ca700 1 -- 172.21.15.57:0/3705565016 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9ed4153580 msgr2=0x7f9ed40b4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:48.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.970+0000 7f9ed95ca700 1 --2- 172.21.15.57:0/3705565016 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9ed4153580 0x7f9ed40b4c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:48.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.970+0000 7f9ed95ca700 1 -- 172.21.15.57:0/3705565016 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ed40c6020 msgr2=0x7f9ed40b4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:48.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.970+0000 7f9ed95ca700 1 --2- 172.21.15.57:0/3705565016 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ed40c6020 0x7f9ed40b4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:48.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.970+0000 7f9ed95ca700 1 -- 172.21.15.57:0/3705565016 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ed0009a20 con 0x7f9ed406ad40 2023-10-06T03:01:48.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.970+0000 7f9ed8dc9700 1 --2- 172.21.15.57:0/3705565016 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ed40c6020 0x7f9ed40b4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:01:48.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.970+0000 7f9ed95ca700 1 --2- 172.21.15.57:0/3705565016 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9ed406ad40 0x7f9ed40b57a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9ed4159d10 tx=0x7f9ed0019000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:48.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.974+0000 7f9ec97fa700 1 -- 172.21.15.57:0/3705565016 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed0027470 con 0x7f9ed406ad40 2023-10-06T03:01:48.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.974+0000 7f9ec97fa700 1 -- 172.21.15.57:0/3705565016 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ed00275d0 con 0x7f9ed406ad40 2023-10-06T03:01:48.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.974+0000 7f9edb82e700 1 -- 172.21.15.57:0/3705565016 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ed4153af0 con 0x7f9ed406ad40 2023-10-06T03:01:48.980 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.974+0000 7f9ec97fa700 1 -- 172.21.15.57:0/3705565016 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed0027990 con 0x7f9ed406ad40 2023-10-06T03:01:48.980 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.974+0000 7f9edb82e700 1 -- 172.21.15.57:0/3705565016 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ed41540b0 con 0x7f9ed406ad40 2023-10-06T03:01:48.980 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.974+0000 7f9edb82e700 1 -- 172.21.15.57:0/3705565016 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ed40712e0 con 0x7f9ed406ad40 2023-10-06T03:01:48.982 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.974+0000 7f9ec97fa700 1 -- 172.21.15.57:0/3705565016 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f9ed0024070 con 0x7f9ed406ad40 2023-10-06T03:01:48.983 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.978+0000 7f9ec97fa700 1 --2- 172.21.15.57:0/3705565016 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f9eb8060620 0x7f9eb8062ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:48.983 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.978+0000 7f9ec97fa700 1 -- 172.21.15.57:0/3705565016 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9ed007f200 con 0x7f9ed406ad40 2023-10-06T03:01:48.983 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.978+0000 7f9ed8dc9700 1 --2- 172.21.15.57:0/3705565016 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f9eb8060620 0x7f9eb8062ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:48.984 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.978+0000 7f9ed8dc9700 1 --2- 172.21.15.57:0/3705565016 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f9eb8060620 0x7f9eb8062ad0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9ed415f550 tx=0x7f9ec4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:48.990 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:48.986+0000 7f9ec97fa700 1 -- 172.21.15.57:0/3705565016 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f9ed004f670 con 0x7f9ed406ad40 2023-10-06T03:01:49.199 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:49.194+0000 7f9edb82e700 1 -- 172.21.15.57:0/3705565016 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f9ed406ab20 con 0x7f9ed406ad40 2023-10-06T03:01:49.991 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:49.986+0000 7f9ec97fa700 1 -- 172.21.15.57:0/3705565016 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) v1 ==== 118+0+0 (secure 0 0 0) 0x7f9ed0052c90 con 0x7f9ed406ad40 2023-10-06T03:01:49.994 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:49.986+0000 7f9edb82e700 1 -- 172.21.15.57:0/3705565016 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f9eb8060620 msgr2=0x7f9eb8062ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:49.994 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:49.986+0000 7f9edb82e700 1 --2- 172.21.15.57:0/3705565016 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f9eb8060620 0x7f9eb8062ad0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9ed415f550 tx=0x7f9ec4009040 comp rx=0 tx=0).stop 2023-10-06T03:01:49.995 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:49.986+0000 7f9edb82e700 1 -- 172.21.15.57:0/3705565016 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9ed406ad40 msgr2=0x7f9ed40b57a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:49.995 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:49.986+0000 7f9edb82e700 1 --2- 172.21.15.57:0/3705565016 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9ed406ad40 0x7f9ed40b57a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9ed4159d10 tx=0x7f9ed0019000 comp rx=0 tx=0).stop 2023-10-06T03:01:49.995 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:49.990+0000 7f9edb82e700 1 -- 172.21.15.57:0/3705565016 shutdown_connections 2023-10-06T03:01:49.996 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:49.990+0000 7f9edb82e700 1 --2- 172.21.15.57:0/3705565016 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9ed4153580 0x7f9ed40b4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:49.996 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:49.990+0000 7f9edb82e700 1 --2- 172.21.15.57:0/3705565016 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ed40c6020 0x7f9ed40b4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:49.996 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:49.990+0000 7f9edb82e700 1 --2- 172.21.15.57:0/3705565016 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f9eb8060620 0x7f9eb8062ad0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:49.996 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:49.990+0000 7f9edb82e700 1 --2- 172.21.15.57:0/3705565016 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9ed406ad40 0x7f9ed40b57a0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:49.996 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:49.990+0000 7f9edb82e700 1 -- 172.21.15.57:0/3705565016 >> 172.21.15.57:0/3705565016 conn(0x7f9ed40ccbd0 msgr2=0x7f9ed40cf1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:49.996 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:49.990+0000 7f9edb82e700 1 -- 172.21.15.57:0/3705565016 shutdown_connections 2023-10-06T03:01:49.996 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:49.990+0000 7f9edb82e700 1 -- 172.21.15.57:0/3705565016 wait complete. 2023-10-06T03:01:50.016 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-06T03:01:50.192 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:50.186+0000 7f2a6228e700 1 Processor -- start 2023-10-06T03:01:50.193 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:50.186+0000 7f2a6228e700 1 -- start start 2023-10-06T03:01:50.196 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:50.190+0000 7f2a6228e700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f2a5c0cb510 0x7f2a5c06d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:50.196 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:50.190+0000 7f2a6228e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2a5c06de70 0x7f2a5c06b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:50.196 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:50.190+0000 7f2a6228e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a5c06c920 con 0x7f2a5c0cb140 2023-10-06T03:01:50.196 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:50.190+0000 7f2a6228e700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a5c0cb960 con 0x7f2a5c06de70 2023-10-06T03:01:50.196 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:50.190+0000 7f2a6228e700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a5c06d4a0 con 0x7f2a5c0cb510 2023-10-06T03:01:50.196 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:50.190+0000 7f2a6128c700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f2a5c0cb140 0x7f2a5c0b0080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:51956/0 (socket says 172.21.15.57:51956) 2023-10-06T03:01:50.197 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:50.190+0000 7f2a6128c700 1 -- 172.21.15.57:0/2656355072 learned_addr learned my addr 172.21.15.57:0/2656355072 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:01:50.197 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:50.190+0000 7f2a61a8d700 1 --2- 172.21.15.57:0/2656355072 >> v2:172.21.15.57:3300/0 conn(0x7f2a5c06de70 0x7f2a5c06b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:50.197 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:50.190+0000 7f2a60a8b700 1 --2- 172.21.15.57:0/2656355072 >> v2:172.21.15.105:3300/0 conn(0x7f2a5c0cb510 0x7f2a5c06d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:50.198 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:50.190+0000 7f2a61a8d700 1 -- 172.21.15.57:0/2656355072 >> v2:172.21.15.105:3300/0 conn(0x7f2a5c0cb510 msgr2=0x7f2a5c06d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:50.198 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:50.190+0000 7f2a61a8d700 1 --2- 172.21.15.57:0/2656355072 >> v2:172.21.15.105:3300/0 conn(0x7f2a5c0cb510 0x7f2a5c06d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:50.198 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:50.190+0000 7f2a61a8d700 1 -- 172.21.15.57:0/2656355072 >> v1:172.21.15.57:6789/0 conn(0x7f2a5c0cb140 legacy=0x7f2a5c0b0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:50.198 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:50.190+0000 7f2a61a8d700 1 -- 172.21.15.57:0/2656355072 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a5c06e290 con 0x7f2a5c06de70 2023-10-06T03:01:50.198 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:50.190+0000 7f2a53fff700 1 -- 172.21.15.57:0/2656355072 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2889003441 0 0) 0x7f2a5c06c920 con 0x7f2a5c0cb140 2023-10-06T03:01:50.198 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:50.190+0000 7f2a60a8b700 1 --2- 172.21.15.57:0/2656355072 >> v2:172.21.15.105:3300/0 conn(0x7f2a5c0cb510 0x7f2a5c06d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:50.198 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:50.190+0000 7f2a61a8d700 1 --2- 172.21.15.57:0/2656355072 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2a5c06de70 0x7f2a5c06b330 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c069da0 tx=0x7f2a54009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e448055ed7ad436 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:50.199 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:50.190+0000 7f2a53fff700 1 -- 172.21.15.57:0/2656355072 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a5400e070 con 0x7f2a5c06de70 2023-10-06T03:01:50.199 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:50.190+0000 7f2a53fff700 1 -- 172.21.15.57:0/2656355072 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a5400bc30 con 0x7f2a5c06de70 2023-10-06T03:01:50.199 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:50.190+0000 7f2a53fff700 1 -- 172.21.15.57:0/2656355072 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a54012430 con 0x7f2a5c06de70 2023-10-06T03:01:50.199 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:50.194+0000 7f2a6228e700 1 -- 172.21.15.57:0/2656355072 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2a5c06de70 msgr2=0x7f2a5c06b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:50.200 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:50.194+0000 7f2a6228e700 1 --2- 172.21.15.57:0/2656355072 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2a5c06de70 0x7f2a5c06b330 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c069da0 tx=0x7f2a54009780 comp rx=0 tx=0).stop 2023-10-06T03:01:50.200 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:50.194+0000 7f2a6228e700 1 -- 172.21.15.57:0/2656355072 shutdown_connections 2023-10-06T03:01:50.200 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:50.194+0000 7f2a6228e700 1 --2- 172.21.15.57:0/2656355072 >> v2:172.21.15.105:3300/0 conn(0x7f2a5c0cb510 0x7f2a5c06d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:50.200 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:50.194+0000 7f2a6228e700 1 --2- 172.21.15.57:0/2656355072 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2a5c06de70 0x7f2a5c06b330 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:50.200 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:50.194+0000 7f2a6228e700 1 -- 172.21.15.57:0/2656355072 >> 172.21.15.57:0/2656355072 conn(0x7f2a5c0d0a50 msgr2=0x7f2a5c0cca60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:50.200 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:50.194+0000 7f2a6228e700 1 -- 172.21.15.57:0/2656355072 shutdown_connections 2023-10-06T03:01:50.201 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:50.194+0000 7f2a6228e700 1 -- 172.21.15.57:0/2656355072 wait complete. 2023-10-06T03:01:50.203 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:50.198+0000 7f2a6228e700 1 Processor -- start 2023-10-06T03:01:50.204 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:50.198+0000 7f2a6228e700 1 -- start start 2023-10-06T03:01:50.206 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:50.198+0000 7f2a6228e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2a5c06de70 0x7f2a5c158ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:50.207 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:50.198+0000 7f2a6228e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2a5c0cb140 0x7f2a5c0c7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:50.207 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:50.198+0000 7f2a6228e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2a5c0cb510 0x7f2a5c16c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:50.207 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:50.198+0000 7f2a6228e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a5c159840 con 0x7f2a5c06de70 2023-10-06T03:01:50.207 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:50.198+0000 7f2a6228e700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a5c0c7110 con 0x7f2a5c0cb510 2023-10-06T03:01:50.207 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:50.198+0000 7f2a6228e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a5c0c73f0 con 0x7f2a5c0cb140 2023-10-06T03:01:50.207 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:50.202+0000 7f2a6128c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2a5c06de70 0x7f2a5c158ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:50.207 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:50.202+0000 7f2a6128c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2a5c06de70 0x7f2a5c158ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58878/0 (socket says 172.21.15.57:58878) 2023-10-06T03:01:50.207 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:50.202+0000 7f2a6128c700 1 -- 172.21.15.57:0/1093796653 learned_addr learned my addr 172.21.15.57:0/1093796653 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:50.208 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:50.202+0000 7f2a61a8d700 1 --2- 172.21.15.57:0/1093796653 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2a5c0cb510 0x7f2a5c16c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:50.208 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:50.202+0000 7f2a60a8b700 1 --2- 172.21.15.57:0/1093796653 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2a5c0cb140 0x7f2a5c0c7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:50.209 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:50.202+0000 7f2a6128c700 1 -- 172.21.15.57:0/1093796653 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2a5c0cb140 msgr2=0x7f2a5c0c7ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:50.209 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:50.202+0000 7f2a6128c700 1 --2- 172.21.15.57:0/1093796653 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2a5c0cb140 0x7f2a5c0c7ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:50.209 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:50.202+0000 7f2a6128c700 1 -- 172.21.15.57:0/1093796653 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2a5c0cb510 msgr2=0x7f2a5c16c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:50.209 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:50.202+0000 7f2a6128c700 1 --2- 172.21.15.57:0/1093796653 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2a5c0cb510 0x7f2a5c16c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:50.209 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:50.202+0000 7f2a6128c700 1 -- 172.21.15.57:0/1093796653 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a54009a20 con 0x7f2a5c06de70 2023-10-06T03:01:50.209 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:50.202+0000 7f2a61a8d700 1 --2- 172.21.15.57:0/1093796653 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2a5c0cb510 0x7f2a5c16c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:50.209 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:50.202+0000 7f2a6128c700 1 --2- 172.21.15.57:0/1093796653 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2a5c06de70 0x7f2a5c158ed0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f2a5800c5b0 tx=0x7f2a58001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:50.209 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:50.202+0000 7f2a517fa700 1 -- 172.21.15.57:0/1093796653 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a58005b30 con 0x7f2a5c06de70 2023-10-06T03:01:50.209 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:50.202+0000 7f2a517fa700 1 -- 172.21.15.57:0/1093796653 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a58005c90 con 0x7f2a5c06de70 2023-10-06T03:01:50.209 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:50.202+0000 7f2a6228e700 1 -- 172.21.15.57:0/1093796653 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a5c0c76d0 con 0x7f2a5c06de70 2023-10-06T03:01:50.209 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:50.202+0000 7f2a517fa700 1 -- 172.21.15.57:0/1093796653 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a58007300 con 0x7f2a5c06de70 2023-10-06T03:01:50.210 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:50.202+0000 7f2a6228e700 1 -- 172.21.15.57:0/1093796653 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a5c159410 con 0x7f2a5c06de70 2023-10-06T03:01:50.210 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:50.202+0000 7f2a6228e700 1 -- 172.21.15.57:0/1093796653 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a5c04be40 con 0x7f2a5c06de70 2023-10-06T03:01:50.212 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:50.206+0000 7f2a517fa700 1 -- 172.21.15.57:0/1093796653 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f2a5801b3b0 con 0x7f2a5c06de70 2023-10-06T03:01:50.214 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:50.206+0000 7f2a517fa700 1 --2- 172.21.15.57:0/1093796653 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f2a40060550 0x7f2a40062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:50.214 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:50.206+0000 7f2a517fa700 1 -- 172.21.15.57:0/1093796653 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2a5807bed0 con 0x7f2a5c06de70 2023-10-06T03:01:50.214 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:50.206+0000 7f2a60a8b700 1 --2- 172.21.15.57:0/1093796653 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f2a40060550 0x7f2a40062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:50.215 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:50.210+0000 7f2a60a8b700 1 --2- 172.21.15.57:0/1093796653 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f2a40060550 0x7f2a40062a00 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c006f00 tx=0x7f2a4c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:50.219 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:50.214+0000 7f2a517fa700 1 -- 172.21.15.57:0/1093796653 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f2a5804c2c0 con 0x7f2a5c06de70 2023-10-06T03:01:50.435 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:50.430+0000 7f2a6228e700 1 -- 172.21.15.57:0/1093796653 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f2a5c0cd670 con 0x7f2a5c06de70 2023-10-06T03:01:50.896 INFO:tasks.ceph.mds.b.smithi105.stderr:2023-10-06T03:01:50.893+0000 7f5425bf1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T03:01:51.008 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.002+0000 7f2a517fa700 1 -- 172.21.15.57:0/1093796653 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) v1 ==== 122+0+0 (secure 0 0 0) 0x7f2a580170c0 con 0x7f2a5c06de70 2023-10-06T03:01:51.013 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.006+0000 7f2a6228e700 1 -- 172.21.15.57:0/1093796653 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f2a40060550 msgr2=0x7f2a40062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:51.014 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.006+0000 7f2a6228e700 1 --2- 172.21.15.57:0/1093796653 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f2a40060550 0x7f2a40062a00 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c006f00 tx=0x7f2a4c008040 comp rx=0 tx=0).stop 2023-10-06T03:01:51.014 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.006+0000 7f2a6228e700 1 -- 172.21.15.57:0/1093796653 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2a5c06de70 msgr2=0x7f2a5c158ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:51.014 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.006+0000 7f2a6228e700 1 --2- 172.21.15.57:0/1093796653 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2a5c06de70 0x7f2a5c158ed0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f2a5800c5b0 tx=0x7f2a58001070 comp rx=0 tx=0).stop 2023-10-06T03:01:51.014 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.006+0000 7f2a6228e700 1 -- 172.21.15.57:0/1093796653 shutdown_connections 2023-10-06T03:01:51.014 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.006+0000 7f2a6228e700 1 --2- 172.21.15.57:0/1093796653 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2a5c0cb510 0x7f2a5c16c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:51.014 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.006+0000 7f2a6228e700 1 --2- 172.21.15.57:0/1093796653 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f2a40060550 0x7f2a40062a00 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:51.014 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.006+0000 7f2a6228e700 1 --2- 172.21.15.57:0/1093796653 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2a5c0cb140 0x7f2a5c0c7ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:51.014 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.006+0000 7f2a6228e700 1 --2- 172.21.15.57:0/1093796653 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2a5c06de70 0x7f2a5c158ed0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:51.015 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.006+0000 7f2a6228e700 1 -- 172.21.15.57:0/1093796653 >> 172.21.15.57:0/1093796653 conn(0x7f2a5c0d0a50 msgr2=0x7f2a5c0b0080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:51.015 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.006+0000 7f2a6228e700 1 -- 172.21.15.57:0/1093796653 shutdown_connections 2023-10-06T03:01:51.015 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.006+0000 7f2a6228e700 1 -- 172.21.15.57:0/1093796653 wait complete. 2023-10-06T03:01:51.035 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:01:51.199 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.190+0000 7f6c02acd700 1 Processor -- start 2023-10-06T03:01:51.199 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.194+0000 7f6c02acd700 1 -- start start 2023-10-06T03:01:51.201 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.194+0000 7f6c02acd700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6bfc0675c0 0x7f6bfc14fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:51.201 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.194+0000 7f6c02acd700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bfc06d7e0 con 0x7f6bfc0671f0 2023-10-06T03:01:51.201 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.194+0000 7f6c02acd700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bfc0679d0 con 0x7f6bfc150180 2023-10-06T03:01:51.202 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.194+0000 7f6c02acd700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bfc150600 con 0x7f6bfc0675c0 2023-10-06T03:01:51.202 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.194+0000 7f6c00869700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f6bfc0671f0 0x7f6bfc06dc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:51962/0 (socket says 172.21.15.57:51962) 2023-10-06T03:01:51.202 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.194+0000 7f6c00869700 1 -- 172.21.15.57:0/318111406 learned_addr learned my addr 172.21.15.57:0/318111406 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:01:51.203 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.194+0000 7f6bf3fff700 1 --2- 172.21.15.57:0/318111406 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6bfc0675c0 0x7f6bfc14fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:51.203 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.194+0000 7f6bf37fe700 1 -- 172.21.15.57:0/318111406 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4171281929 0 0) 0x7f6bfc06d7e0 con 0x7f6bfc0671f0 2023-10-06T03:01:51.203 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.194+0000 7f6bf37fe700 1 -- 172.21.15.57:0/318111406 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6be4003570 con 0x7f6bfc0671f0 2023-10-06T03:01:51.203 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.198+0000 7f6bf37fe700 1 -- 172.21.15.57:0/318111406 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3784076401 0 0) 0x7f6be4003570 con 0x7f6bfc0671f0 2023-10-06T03:01:51.203 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.198+0000 7f6bf37fe700 1 -- 172.21.15.57:0/318111406 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6bfc0675c0 msgr2=0x7f6bfc14fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:51.203 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.198+0000 7f6bf37fe700 1 --2- 172.21.15.57:0/318111406 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6bfc0675c0 0x7f6bfc14fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:51.203 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.198+0000 7f6bf37fe700 1 -- 172.21.15.57:0/318111406 >> v1:172.21.15.105:6789/0 conn(0x7f6bfc150180 legacy=0x7f6bfc15ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:51.203 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.198+0000 7f6bf37fe700 1 -- 172.21.15.57:0/318111406 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bfc15dc00 con 0x7f6bfc0671f0 2023-10-06T03:01:51.204 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.198+0000 7f6bf37fe700 1 -- 172.21.15.57:0/318111406 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2482400018 0 0) 0x7f6bf8001470 con 0x7f6bfc0671f0 2023-10-06T03:01:51.204 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.198+0000 7f6bf37fe700 1 -- 172.21.15.57:0/318111406 >> v1:172.21.15.57:6789/0 conn(0x7f6bfc0671f0 legacy=0x7f6bfc06dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:51.205 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.198+0000 7f6bf37fe700 1 --2- 172.21.15.57:0/318111406 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6bfc0675c0 0x7f6be4003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:51.205 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.198+0000 7f6bf37fe700 1 --2- 172.21.15.57:0/318111406 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6be4004010 0x7f6be4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:51.205 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.198+0000 7f6bf37fe700 1 --2- 172.21.15.57:0/318111406 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6be4004d50 0x7f6be40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:51.205 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.198+0000 7f6bf37fe700 1 -- 172.21.15.57:0/318111406 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bfc150600 con 0x7f6be4004d50 2023-10-06T03:01:51.205 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.198+0000 7f6bf37fe700 1 -- 172.21.15.57:0/318111406 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6be400bbf0 con 0x7f6be4004010 2023-10-06T03:01:51.205 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.198+0000 7f6bf37fe700 1 -- 172.21.15.57:0/318111406 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6be400bdb0 con 0x7f6bfc0675c0 2023-10-06T03:01:51.205 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.198+0000 7f6c0106a700 1 --2- 172.21.15.57:0/318111406 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6be4004d50 0x7f6be40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:51.205 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.198+0000 7f6c00869700 1 --2- 172.21.15.57:0/318111406 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6bfc0675c0 0x7f6be4003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:51.205 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.198+0000 7f6bf3fff700 1 --2- 172.21.15.57:0/318111406 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6be4004010 0x7f6be4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:51.206 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.198+0000 7f6c0106a700 1 -- 172.21.15.57:0/318111406 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6bfc0675c0 msgr2=0x7f6be4003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:51.206 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.198+0000 7f6c0106a700 1 --2- 172.21.15.57:0/318111406 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6bfc0675c0 0x7f6be4003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:51.206 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.198+0000 7f6c0106a700 1 -- 172.21.15.57:0/318111406 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6be4004010 msgr2=0x7f6be4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:51.206 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.198+0000 7f6c0106a700 1 --2- 172.21.15.57:0/318111406 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6be4004010 0x7f6be4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:51.206 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.198+0000 7f6c0106a700 1 -- 172.21.15.57:0/318111406 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6be4003570 con 0x7f6be4004d50 2023-10-06T03:01:51.206 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.198+0000 7f6bf3fff700 1 --2- 172.21.15.57:0/318111406 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6be4004010 0x7f6be4004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:51.206 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.198+0000 7f6c0106a700 1 --2- 172.21.15.57:0/318111406 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6be4004d50 0x7f6be40051c0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f6bf4001f90 tx=0x7f6bf4001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6459291fa1d2b0c8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:51.207 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.198+0000 7f6bf37fe700 1 -- 172.21.15.57:0/318111406 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bf4001950 con 0x7f6be4004d50 2023-10-06T03:01:51.207 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.198+0000 7f6bf37fe700 1 -- 172.21.15.57:0/318111406 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bf400c8b0 con 0x7f6be4004d50 2023-10-06T03:01:51.207 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.198+0000 7f6bf37fe700 1 -- 172.21.15.57:0/318111406 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bf400cc70 con 0x7f6be4004d50 2023-10-06T03:01:51.207 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.198+0000 7f6c02acd700 1 -- 172.21.15.57:0/318111406 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6be4004d50 msgr2=0x7f6be40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:51.207 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.198+0000 7f6c02acd700 1 --2- 172.21.15.57:0/318111406 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6be4004d50 0x7f6be40051c0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f6bf4001f90 tx=0x7f6bf4001640 comp rx=0 tx=0).stop 2023-10-06T03:01:51.207 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.198+0000 7f6c0106a700 1 -- 172.21.15.57:0/318111406 reap_dead start 2023-10-06T03:01:51.207 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.198+0000 7f6c02acd700 1 -- 172.21.15.57:0/318111406 shutdown_connections 2023-10-06T03:01:51.207 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.198+0000 7f6c02acd700 1 -- 172.21.15.57:0/318111406 >> 172.21.15.57:0/318111406 conn(0x7f6bfc0cbdd0 msgr2=0x7f6bfc0cc1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:51.208 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.198+0000 7f6c02acd700 1 -- 172.21.15.57:0/318111406 shutdown_connections 2023-10-06T03:01:51.208 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.202+0000 7f6c02acd700 1 -- 172.21.15.57:0/318111406 wait complete. 2023-10-06T03:01:51.209 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.202+0000 7f6c02acd700 1 Processor -- start 2023-10-06T03:01:51.210 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.202+0000 7f6c02acd700 1 -- start start 2023-10-06T03:01:51.212 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.206+0000 7f6c02acd700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6be4004d50 0x7f6bfc140bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:51.212 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.206+0000 7f6c02acd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6bfc0ad7e0 0x7f6bfc06aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:51.212 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.206+0000 7f6c02acd700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6bfc06b000 0x7f6bfc0c8f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:51.212 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.206+0000 7f6c02acd700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bfc06b450 con 0x7f6bfc0ad7e0 2023-10-06T03:01:51.212 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.206+0000 7f6c02acd700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bfc0ac740 con 0x7f6bfc06b000 2023-10-06T03:01:51.212 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.206+0000 7f6c02acd700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bfc0aca20 con 0x7f6be4004d50 2023-10-06T03:01:51.213 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.206+0000 7f6bf3fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6bfc0ad7e0 0x7f6bfc06aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:51.213 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.206+0000 7f6c00869700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6be4004d50 0x7f6bfc140bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:51.213 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.206+0000 7f6bf3fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6bfc0ad7e0 0x7f6bfc06aac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58898/0 (socket says 172.21.15.57:58898) 2023-10-06T03:01:51.214 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.206+0000 7f6bf3fff700 1 -- 172.21.15.57:0/3964406247 learned_addr learned my addr 172.21.15.57:0/3964406247 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:51.214 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.206+0000 7f6c0106a700 1 --2- 172.21.15.57:0/3964406247 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6bfc06b000 0x7f6bfc0c8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:51.214 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.206+0000 7f6bf3fff700 1 -- 172.21.15.57:0/3964406247 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6be4004d50 msgr2=0x7f6bfc140bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:51.214 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.206+0000 7f6bf3fff700 1 --2- 172.21.15.57:0/3964406247 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6be4004d50 0x7f6bfc140bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:51.214 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.206+0000 7f6bf3fff700 1 -- 172.21.15.57:0/3964406247 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6bfc06b000 msgr2=0x7f6bfc0c8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:51.214 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.206+0000 7f6bf3fff700 1 --2- 172.21.15.57:0/3964406247 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6bfc06b000 0x7f6bfc0c8f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:51.214 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.206+0000 7f6bf3fff700 1 -- 172.21.15.57:0/3964406247 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bfc0acd00 con 0x7f6bfc0ad7e0 2023-10-06T03:01:51.214 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.206+0000 7f6bf3fff700 1 --2- 172.21.15.57:0/3964406247 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6bfc0ad7e0 0x7f6bfc06aac0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f6bec011960 tx=0x7f6bec008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:51.215 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.206+0000 7f6bf0ff9700 1 -- 172.21.15.57:0/3964406247 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bec015670 con 0x7f6bfc0ad7e0 2023-10-06T03:01:51.215 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.206+0000 7f6bf0ff9700 1 -- 172.21.15.57:0/3964406247 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bec0157d0 con 0x7f6bfc0ad7e0 2023-10-06T03:01:51.215 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.206+0000 7f6c02acd700 1 -- 172.21.15.57:0/3964406247 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bfc0acfe0 con 0x7f6bfc0ad7e0 2023-10-06T03:01:51.215 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.206+0000 7f6bf0ff9700 1 -- 172.21.15.57:0/3964406247 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bec015b50 con 0x7f6bfc0ad7e0 2023-10-06T03:01:51.215 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.206+0000 7f6c02acd700 1 -- 172.21.15.57:0/3964406247 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bfc0adc50 con 0x7f6bfc0ad7e0 2023-10-06T03:01:51.216 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.210+0000 7f6c02acd700 1 -- 172.21.15.57:0/3964406247 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bfc0712e0 con 0x7f6bfc0ad7e0 2023-10-06T03:01:51.217 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.210+0000 7f6bf0ff9700 1 -- 172.21.15.57:0/3964406247 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f6bec013410 con 0x7f6bfc0ad7e0 2023-10-06T03:01:51.218 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.214+0000 7f6bf0ff9700 1 --2- 172.21.15.57:0/3964406247 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f6be8060580 0x7f6be8062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:51.219 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.214+0000 7f6bf0ff9700 1 -- 172.21.15.57:0/3964406247 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6bec07d0d0 con 0x7f6bfc0ad7e0 2023-10-06T03:01:51.219 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.214+0000 7f6c00869700 1 --2- 172.21.15.57:0/3964406247 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f6be8060580 0x7f6be8062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:51.220 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.214+0000 7f6c00869700 1 --2- 172.21.15.57:0/3964406247 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f6be8060580 0x7f6be8062a30 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f6bf8007ed0 tx=0x7f6bf8001e50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:51.223 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.218+0000 7f6bf0ff9700 1 -- 172.21.15.57:0/3964406247 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f6bec04d4c0 con 0x7f6bfc0ad7e0 2023-10-06T03:01:51.428 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.422+0000 7f6c02acd700 1 -- 172.21.15.57:0/3964406247 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6bfc06cbf0 con 0x7f6bfc0ad7e0 2023-10-06T03:01:51.429 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.422+0000 7f6bf0ff9700 1 -- 172.21.15.57:0/3964406247 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4603 (secure 0 0 0) 0x7f6bec050ae0 con 0x7f6bfc0ad7e0 2023-10-06T03:01:51.430 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:01:51.430 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/3196581081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":3196581081},{"type":"v1","addr":"172.21.15.105:6835","nonce":3196581081}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4980,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/3842897946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":3842897946},{"type":"v1","addr":"172.21.15.57:6835","nonce":3842897946}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4986,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6837/1629829999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6836","nonce":1629829999},{"type":"v1","addr":"172.21.15.57:6837","nonce":1629829999}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:01:47.353461+0000","modified":"2023-10-06T03:01:50.987438+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4989},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4989":{"gid":4989,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.105:6834/1325054263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":1325054263},{"type":"v1","addr":"172.21.15.105:6834","nonce":1325054263}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T03:01:51.434 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.426+0000 7f6c02acd700 1 -- 172.21.15.57:0/3964406247 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f6be8060580 msgr2=0x7f6be8062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:51.434 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.426+0000 7f6c02acd700 1 --2- 172.21.15.57:0/3964406247 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f6be8060580 0x7f6be8062a30 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f6bf8007ed0 tx=0x7f6bf8001e50 comp rx=0 tx=0).stop 2023-10-06T03:01:51.434 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.426+0000 7f6c02acd700 1 -- 172.21.15.57:0/3964406247 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6bfc0ad7e0 msgr2=0x7f6bfc06aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:51.435 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.426+0000 7f6c02acd700 1 --2- 172.21.15.57:0/3964406247 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6bfc0ad7e0 0x7f6bfc06aac0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f6bec011960 tx=0x7f6bec008040 comp rx=0 tx=0).stop 2023-10-06T03:01:51.435 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.426+0000 7f6c02acd700 1 -- 172.21.15.57:0/3964406247 shutdown_connections 2023-10-06T03:01:51.435 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.426+0000 7f6c02acd700 1 --2- 172.21.15.57:0/3964406247 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6bfc06b000 0x7f6bfc0c8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:51.435 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.426+0000 7f6c02acd700 1 --2- 172.21.15.57:0/3964406247 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6bfc0ad7e0 0x7f6bfc06aac0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:51.435 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.426+0000 7f6c02acd700 1 --2- 172.21.15.57:0/3964406247 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f6be8060580 0x7f6be8062a30 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:51.435 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.426+0000 7f6c02acd700 1 --2- 172.21.15.57:0/3964406247 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6be4004d50 0x7f6bfc140bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:51.435 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.426+0000 7f6c02acd700 1 -- 172.21.15.57:0/3964406247 >> 172.21.15.57:0/3964406247 conn(0x7f6bfc0cbdd0 msgr2=0x7f6bfc0aef50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:51.436 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.430+0000 7f6c02acd700 1 -- 172.21.15.57:0/3964406247 shutdown_connections 2023-10-06T03:01:51.436 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.430+0000 7f6c02acd700 1 -- 172.21.15.57:0/3964406247 wait complete. 2023-10-06T03:01:51.437 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 17 2023-10-06T03:01:51.455 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:01:51.614 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.606+0000 7fa607145700 1 Processor -- start 2023-10-06T03:01:51.615 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.610+0000 7fa607145700 1 -- start start 2023-10-06T03:01:51.619 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.610+0000 7fa607145700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fa6000671f0 0x7fa6000675c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:51.619 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.610+0000 7fa607145700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa60015a1b0 0x7fa6001539c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:51.619 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.614+0000 7fa607145700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa600153f00 con 0x7fa600153570 2023-10-06T03:01:51.619 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.614+0000 7fa607145700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa60015aa70 con 0x7fa60015a1b0 2023-10-06T03:01:51.619 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.614+0000 7fa607145700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa60015a790 con 0x7fa6000671f0 2023-10-06T03:01:51.620 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.614+0000 7fa5fffff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fa600153570 0x7fa600159aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:51976/0 (socket says 172.21.15.57:51976) 2023-10-06T03:01:51.620 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.614+0000 7fa5fffff700 1 -- 172.21.15.57:0/3240827100 learned_addr learned my addr 172.21.15.57:0/3240827100 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:01:51.620 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.614+0000 7fa6056e2700 1 --2- 172.21.15.57:0/3240827100 >> v2:172.21.15.57:3300/0 conn(0x7fa60015a1b0 0x7fa6001539c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:51.621 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.614+0000 7fa604ee1700 1 --2- 172.21.15.57:0/3240827100 >> v2:172.21.15.105:3300/0 conn(0x7fa6000671f0 0x7fa6000675c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:51.621 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.614+0000 7fa5ff7fe700 1 -- 172.21.15.57:0/3240827100 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 502446679 0 0) 0x7fa600153f00 con 0x7fa600153570 2023-10-06T03:01:51.621 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.614+0000 7fa5ff7fe700 1 -- 172.21.15.57:0/3240827100 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5f0003570 con 0x7fa600153570 2023-10-06T03:01:51.621 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.614+0000 7fa6056e2700 1 -- 172.21.15.57:0/3240827100 >> v2:172.21.15.105:3300/0 conn(0x7fa6000671f0 msgr2=0x7fa6000675c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:51.621 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.614+0000 7fa6056e2700 1 --2- 172.21.15.57:0/3240827100 >> v2:172.21.15.105:3300/0 conn(0x7fa6000671f0 0x7fa6000675c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:51.622 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.614+0000 7fa6056e2700 1 -- 172.21.15.57:0/3240827100 >> v1:172.21.15.57:6789/0 conn(0x7fa600153570 legacy=0x7fa600159aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:51.622 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.614+0000 7fa6056e2700 1 -- 172.21.15.57:0/3240827100 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa600157810 con 0x7fa60015a1b0 2023-10-06T03:01:51.622 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.614+0000 7fa6056e2700 1 --2- 172.21.15.57:0/3240827100 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa60015a1b0 0x7fa6001539c0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fa60006bcc0 tx=0x7fa5f8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c29585cbc2b32768 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:51.622 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.614+0000 7fa5ff7fe700 1 -- 172.21.15.57:0/3240827100 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5f800e070 con 0x7fa60015a1b0 2023-10-06T03:01:51.622 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.614+0000 7fa5ff7fe700 1 -- 172.21.15.57:0/3240827100 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5f800bab0 con 0x7fa60015a1b0 2023-10-06T03:01:51.622 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.614+0000 7fa5ff7fe700 1 -- 172.21.15.57:0/3240827100 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5f800be70 con 0x7fa60015a1b0 2023-10-06T03:01:51.623 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.614+0000 7fa607145700 1 -- 172.21.15.57:0/3240827100 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa60015a1b0 msgr2=0x7fa6001539c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:51.623 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.614+0000 7fa607145700 1 --2- 172.21.15.57:0/3240827100 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa60015a1b0 0x7fa6001539c0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fa60006bcc0 tx=0x7fa5f8009780 comp rx=0 tx=0).stop 2023-10-06T03:01:51.623 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.614+0000 7fa607145700 1 -- 172.21.15.57:0/3240827100 shutdown_connections 2023-10-06T03:01:51.623 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.614+0000 7fa607145700 1 --2- 172.21.15.57:0/3240827100 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa60015a1b0 0x7fa6001539c0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:51.623 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.614+0000 7fa607145700 1 --2- 172.21.15.57:0/3240827100 >> v2:172.21.15.105:3300/0 conn(0x7fa6000671f0 0x7fa6000675c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:51.623 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.614+0000 7fa607145700 1 -- 172.21.15.57:0/3240827100 >> 172.21.15.57:0/3240827100 conn(0x7fa6000cbdd0 msgr2=0x7fa6000cc1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:51.623 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.614+0000 7fa607145700 1 -- 172.21.15.57:0/3240827100 shutdown_connections 2023-10-06T03:01:51.623 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.614+0000 7fa607145700 1 -- 172.21.15.57:0/3240827100 wait complete. 2023-10-06T03:01:51.626 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.618+0000 7fa607145700 1 Processor -- start 2023-10-06T03:01:51.626 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.622+0000 7fa607145700 1 -- start start 2023-10-06T03:01:51.628 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.622+0000 7fa607145700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa6000671f0 0x7fa6000ae230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:51.629 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.622+0000 7fa607145700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa600153570 0x7fa6000af540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:51.629 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.622+0000 7fa607145700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa60015a1b0 0x7fa6000b0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:51.629 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.622+0000 7fa607145700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6000afa80 con 0x7fa60015a1b0 2023-10-06T03:01:51.629 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.622+0000 7fa607145700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6000b1300 con 0x7fa6000671f0 2023-10-06T03:01:51.629 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.622+0000 7fa607145700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6000afd20 con 0x7fa600153570 2023-10-06T03:01:51.629 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.622+0000 7fa6056e2700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa60015a1b0 0x7fa6000b0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:51.629 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.622+0000 7fa6056e2700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa60015a1b0 0x7fa6000b0dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58918/0 (socket says 172.21.15.57:58918) 2023-10-06T03:01:51.629 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.622+0000 7fa6056e2700 1 -- 172.21.15.57:0/1579160655 learned_addr learned my addr 172.21.15.57:0/1579160655 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:51.629 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.622+0000 7fa5fffff700 1 --2- 172.21.15.57:0/1579160655 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa600153570 0x7fa6000af540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:51.629 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.622+0000 7fa604ee1700 1 --2- 172.21.15.57:0/1579160655 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa6000671f0 0x7fa6000ae230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:51.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.622+0000 7fa6056e2700 1 -- 172.21.15.57:0/1579160655 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa600153570 msgr2=0x7fa6000af540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:51.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.622+0000 7fa6056e2700 1 --2- 172.21.15.57:0/1579160655 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa600153570 0x7fa6000af540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:51.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.622+0000 7fa6056e2700 1 -- 172.21.15.57:0/1579160655 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa6000671f0 msgr2=0x7fa6000ae230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:51.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.622+0000 7fa6056e2700 1 --2- 172.21.15.57:0/1579160655 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa6000671f0 0x7fa6000ae230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:51.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.622+0000 7fa6056e2700 1 -- 172.21.15.57:0/1579160655 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5f8009a20 con 0x7fa60015a1b0 2023-10-06T03:01:51.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.622+0000 7fa604ee1700 1 --2- 172.21.15.57:0/1579160655 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa6000671f0 0x7fa6000ae230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:51.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.622+0000 7fa6056e2700 1 --2- 172.21.15.57:0/1579160655 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa60015a1b0 0x7fa6000b0dc0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fa600154090 tx=0x7fa5f8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:51.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.622+0000 7fa5fcff9700 1 -- 172.21.15.57:0/1579160655 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5f8012e60 con 0x7fa60015a1b0 2023-10-06T03:01:51.632 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.622+0000 7fa5fcff9700 1 -- 172.21.15.57:0/1579160655 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5f8027470 con 0x7fa60015a1b0 2023-10-06T03:01:51.632 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.622+0000 7fa607145700 1 -- 172.21.15.57:0/1579160655 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6000b0000 con 0x7fa60015a1b0 2023-10-06T03:01:51.632 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.622+0000 7fa5fcff9700 1 -- 172.21.15.57:0/1579160655 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5f8027810 con 0x7fa60015a1b0 2023-10-06T03:01:51.632 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.622+0000 7fa607145700 1 -- 172.21.15.57:0/1579160655 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6000b05c0 con 0x7fa60015a1b0 2023-10-06T03:01:51.632 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.626+0000 7fa607145700 1 -- 172.21.15.57:0/1579160655 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6000712e0 con 0x7fa60015a1b0 2023-10-06T03:01:51.633 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.626+0000 7fa5fcff9700 1 -- 172.21.15.57:0/1579160655 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fa5f8024070 con 0x7fa60015a1b0 2023-10-06T03:01:51.635 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.630+0000 7fa5fcff9700 1 --2- 172.21.15.57:0/1579160655 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fa5e4060580 0x7fa5e4062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:51.636 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.630+0000 7fa5fcff9700 1 -- 172.21.15.57:0/1579160655 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa5f807efe0 con 0x7fa60015a1b0 2023-10-06T03:01:51.636 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.630+0000 7fa604ee1700 1 --2- 172.21.15.57:0/1579160655 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fa5e4060580 0x7fa5e4062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:51.638 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.630+0000 7fa604ee1700 1 --2- 172.21.15.57:0/1579160655 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fa5e4060580 0x7fa5e4062a30 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa6000c94e0 tx=0x7fa5f4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:51.643 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.638+0000 7fa5fcff9700 1 -- 172.21.15.57:0/1579160655 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fa5f804f3f0 con 0x7fa60015a1b0 2023-10-06T03:01:51.813 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.806+0000 7fa607145700 1 -- 172.21.15.57:0/1579160655 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa60006dd40 con 0x7fa60015a1b0 2023-10-06T03:01:51.815 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.810+0000 7fa5fcff9700 1 -- 172.21.15.57:0/1579160655 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+16866 (secure 0 0 0) 0x7fa5f802c090 con 0x7fa60015a1b0 2023-10-06T03:01:51.816 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:01:51.816 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":35,"fsid":"eb56dc0f-9213-41cb-9aad-8ade6c802e98","created":"2023-10-06T03:00:30.806197+0000","modified":"2023-10-06T03:01:48.932004+0000","last_up_change":"2023-10-06T03:00:43.607454+0000","last_in_change":"2023-10-06T03:00:33.943513+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T03:00:44.360651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T03:00:50.466601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:01:45.068952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-10-06T03:01:46.357714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"58cf6c90-d704-43e0-b2db-dffe526d5e8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":33053},{"type":"v1","addr":"172.21.15.57:6801","nonce":33053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":33053},{"type":"v1","addr":"172.21.15.57:6803","nonce":33053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":33053},{"type":"v1","addr":"172.21.15.57:6807","nonce":33053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":33053},{"type":"v1","addr":"172.21.15.57:6805","nonce":33053}]},"public_addr":"172.21.15.57:6801/33053","cluster_addr":"172.21.15.57:6803/33053","heartbeat_back_addr":"172.21.15.57:6807/33053","heartbeat_front_addr":"172.21.15.57:6805/33053","state":["exists","up"]},{"osd":1,"uuid":"16afbe70-7f9e-4568-9c92-763e6e348119","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6809","nonce":33052},{"type":"v1","addr":"172.21.15.57:6810","nonce":33052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":33052},{"type":"v1","addr":"172.21.15.57:6813","nonce":33052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":33052},{"type":"v1","addr":"172.21.15.57:6822","nonce":33052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6815","nonce":33052},{"type":"v1","addr":"172.21.15.57:6818","nonce":33052}]},"public_addr":"172.21.15.57:6810/33052","cluster_addr":"172.21.15.57:6813/33052","heartbeat_back_addr":"172.21.15.57:6822/33052","heartbeat_front_addr":"172.21.15.57:6818/33052","state":["exists","up"]},{"osd":2,"uuid":"7255c62e-f92f-470f-a5ce-30228920d9f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":33058},{"type":"v1","addr":"172.21.15.57:6825","nonce":33058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":33058},{"type":"v1","addr":"172.21.15.57:6827","nonce":33058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":33058},{"type":"v1","addr":"172.21.15.57:6831","nonce":33058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":33058},{"type":"v1","addr":"172.21.15.57:6829","nonce":33058}]},"public_addr":"172.21.15.57:6825/33058","cluster_addr":"172.21.15.57:6827/33058","heartbeat_back_addr":"172.21.15.57:6831/33058","heartbeat_front_addr":"172.21.15.57:6829/33058","state":["exists","up"]},{"osd":3,"uuid":"152a236d-f799-4888-8544-74865508d5a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":33057},{"type":"v1","addr":"172.21.15.57:6811","nonce":33057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":33057},{"type":"v1","addr":"172.21.15.57:6816","nonce":33057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6821","nonce":33057},{"type":"v1","addr":"172.21.15.57:6823","nonce":33057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6817","nonce":33057},{"type":"v1","addr":"172.21.15.57:6819","nonce":33057}]},"public_addr":"172.21.15.57:6811/33057","cluster_addr":"172.21.15.57:6816/33057","heartbeat_back_addr":"172.21.15.57:6823/33057","heartbeat_front_addr":"172.21.15.57:6819/33057","state":["exists","up"]},{"osd":4,"uuid":"37db2a65-3566-41d0-9d60-e66c49e1e68e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":33368},{"type":"v1","addr":"172.21.15.105:6801","nonce":33368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":33368},{"type":"v1","addr":"172.21.15.105:6803","nonce":33368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":33368},{"type":"v1","addr":"172.21.15.105:6807","nonce":33368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":33368},{"type":"v1","addr":"172.21.15.105:6805","nonce":33368}]},"public_addr":"172.21.15.105:6801/33368","cluster_addr":"172.21.15.105:6803/33368","heartbeat_back_addr":"172.21.15.105:6807/33368","heartbeat_front_addr":"172.21.15.105:6805/33368","state":["exists","up"]},{"osd":5,"uuid":"35e77918-1bb4-42ca-9b20-f3c14eaa0c04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":33379},{"type":"v1","addr":"172.21.15.105:6818","nonce":33379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":33379},{"type":"v1","addr":"172.21.15.105:6823","nonce":33379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":33379},{"type":"v1","addr":"172.21.15.105:6831","nonce":33379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":33379},{"type":"v1","addr":"172.21.15.105:6827","nonce":33379}]},"public_addr":"172.21.15.105:6818/33379","cluster_addr":"172.21.15.105:6823/33379","heartbeat_back_addr":"172.21.15.105:6831/33379","heartbeat_front_addr":"172.21.15.105:6827/33379","state":["exists","up"]},{"osd":6,"uuid":"b4d9d510-7a45-4173-8287-c6c8d6547f2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":33369},{"type":"v1","addr":"172.21.15.105:6819","nonce":33369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":33369},{"type":"v1","addr":"172.21.15.105:6822","nonce":33369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":33369},{"type":"v1","addr":"172.21.15.105:6830","nonce":33369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":33369},{"type":"v1","addr":"172.21.15.105:6826","nonce":33369}]},"public_addr":"172.21.15.105:6819/33369","cluster_addr":"172.21.15.105:6822/33369","heartbeat_back_addr":"172.21.15.105:6830/33369","heartbeat_front_addr":"172.21.15.105:6826/33369","state":["exists","up"]},{"osd":7,"uuid":"74266fb0-cd84-463f-8bf0-092652a71dc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":33370},{"type":"v1","addr":"172.21.15.105:6809","nonce":33370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":33370},{"type":"v1","addr":"172.21.15.105:6811","nonce":33370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":33370},{"type":"v1","addr":"172.21.15.105:6815","nonce":33370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":33370},{"type":"v1","addr":"172.21.15.105:6813","nonce":33370}]},"public_addr":"172.21.15.105:6809/33370","cluster_addr":"172.21.15.105:6811/33370","heartbeat_back_addr":"172.21.15.105:6815/33370","heartbeat_front_addr":"172.21.15.105:6813/33370","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.596864+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.633851+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.636993+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.529681+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.608601+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.659752+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.661717+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.642221+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:01:51.818 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.810+0000 7fa607145700 1 -- 172.21.15.57:0/1579160655 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fa5e4060580 msgr2=0x7fa5e4062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:51.818 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.810+0000 7fa607145700 1 --2- 172.21.15.57:0/1579160655 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fa5e4060580 0x7fa5e4062a30 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa6000c94e0 tx=0x7fa5f4008040 comp rx=0 tx=0).stop 2023-10-06T03:01:51.818 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.810+0000 7fa607145700 1 -- 172.21.15.57:0/1579160655 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa60015a1b0 msgr2=0x7fa6000b0dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:51.818 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.810+0000 7fa607145700 1 --2- 172.21.15.57:0/1579160655 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa60015a1b0 0x7fa6000b0dc0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fa600154090 tx=0x7fa5f8019000 comp rx=0 tx=0).stop 2023-10-06T03:01:51.818 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.810+0000 7fa607145700 1 -- 172.21.15.57:0/1579160655 shutdown_connections 2023-10-06T03:01:51.818 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.810+0000 7fa607145700 1 --2- 172.21.15.57:0/1579160655 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa60015a1b0 0x7fa6000b0dc0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:51.819 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.810+0000 7fa607145700 1 --2- 172.21.15.57:0/1579160655 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fa5e4060580 0x7fa5e4062a30 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:51.819 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.810+0000 7fa607145700 1 --2- 172.21.15.57:0/1579160655 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa600153570 0x7fa6000af540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:51.819 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.810+0000 7fa607145700 1 --2- 172.21.15.57:0/1579160655 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa6000671f0 0x7fa6000ae230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:51.819 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.810+0000 7fa607145700 1 -- 172.21.15.57:0/1579160655 >> 172.21.15.57:0/1579160655 conn(0x7fa6000cbdd0 msgr2=0x7fa600158bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:51.819 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.810+0000 7fa607145700 1 -- 172.21.15.57:0/1579160655 shutdown_connections 2023-10-06T03:01:51.819 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.814+0000 7fa607145700 1 -- 172.21.15.57:0/1579160655 wait complete. 2023-10-06T03:01:51.838 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-06T03:01:51.839 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:01:51.999 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.994+0000 7ff318a2d700 1 Processor -- start 2023-10-06T03:01:52.000 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.994+0000 7ff318a2d700 1 -- start start 2023-10-06T03:01:52.002 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.994+0000 7ff318a2d700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff3140aa7e0 0x7ff31406bba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:52.002 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.994+0000 7ff318a2d700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff31406de50 con 0x7ff31406c920 2023-10-06T03:01:52.002 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.994+0000 7ff318a2d700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff31406e130 con 0x7ff3140aae90 2023-10-06T03:01:52.002 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.994+0000 7ff318a2d700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff31406b3a0 con 0x7ff3140aa7e0 2023-10-06T03:01:52.002 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.994+0000 7ff312d9d700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7ff31406c920 0x7ff31406ccf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:51980/0 (socket says 172.21.15.57:51980) 2023-10-06T03:01:52.002 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.994+0000 7ff312d9d700 1 -- 172.21.15.57:0/749733603 learned_addr learned my addr 172.21.15.57:0/749733603 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:01:52.004 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.994+0000 7ff31359e700 1 --2- 172.21.15.57:0/749733603 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff3140aa7e0 0x7ff31406bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:52.004 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.998+0000 7ff31259c700 1 -- 172.21.15.57:0/749733603 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1620849348 0 0) 0x7ff31406de50 con 0x7ff31406c920 2023-10-06T03:01:52.004 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.998+0000 7ff31259c700 1 -- 172.21.15.57:0/749733603 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff300003570 con 0x7ff31406c920 2023-10-06T03:01:52.004 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.998+0000 7ff31259c700 1 -- 172.21.15.57:0/749733603 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3686372002 0 0) 0x7ff300003570 con 0x7ff31406c920 2023-10-06T03:01:52.004 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.998+0000 7ff31259c700 1 -- 172.21.15.57:0/749733603 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff3140aa7e0 msgr2=0x7ff31406bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:52.004 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.998+0000 7ff31259c700 1 --2- 172.21.15.57:0/749733603 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff3140aa7e0 0x7ff31406bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:52.004 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.998+0000 7ff31259c700 1 -- 172.21.15.57:0/749733603 >> v1:172.21.15.105:6789/0 conn(0x7ff3140aae90 legacy=0x7ff3140ab970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:52.004 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.998+0000 7ff31259c700 1 -- 172.21.15.57:0/749733603 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff31406b680 con 0x7ff31406c920 2023-10-06T03:01:52.004 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.998+0000 7ff31259c700 1 -- 172.21.15.57:0/749733603 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2482400018 0 0) 0x7ff304001490 con 0x7ff31406c920 2023-10-06T03:01:52.004 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.998+0000 7ff31259c700 1 -- 172.21.15.57:0/749733603 >> v1:172.21.15.57:6789/0 conn(0x7ff31406c920 legacy=0x7ff31406ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:52.004 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.998+0000 7ff31259c700 1 --2- 172.21.15.57:0/749733603 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff300003a90 0x7ff300003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:52.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.998+0000 7ff31259c700 1 --2- 172.21.15.57:0/749733603 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff300004810 0x7ff300004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:52.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.998+0000 7ff31259c700 1 --2- 172.21.15.57:0/749733603 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff3140aa7e0 0x7ff3000051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:52.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.998+0000 7ff31259c700 1 -- 172.21.15.57:0/749733603 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff31406b3a0 con 0x7ff300003a90 2023-10-06T03:01:52.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.998+0000 7ff31259c700 1 -- 172.21.15.57:0/749733603 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff30000bb40 con 0x7ff300004810 2023-10-06T03:01:52.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.998+0000 7ff31259c700 1 -- 172.21.15.57:0/749733603 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff30000bd00 con 0x7ff3140aa7e0 2023-10-06T03:01:52.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.998+0000 7ff31359e700 1 --2- 172.21.15.57:0/749733603 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff3140aa7e0 0x7ff3000051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:52.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.998+0000 7ff312d9d700 1 --2- 172.21.15.57:0/749733603 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff300003a90 0x7ff300003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:52.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.998+0000 7ff30bfff700 1 --2- 172.21.15.57:0/749733603 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff300004810 0x7ff300004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:52.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.998+0000 7ff31359e700 1 -- 172.21.15.57:0/749733603 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff300004810 msgr2=0x7ff300004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:52.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.998+0000 7ff31359e700 1 --2- 172.21.15.57:0/749733603 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff300004810 0x7ff300004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:52.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.998+0000 7ff31359e700 1 -- 172.21.15.57:0/749733603 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff300003a90 msgr2=0x7ff300003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:52.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.998+0000 7ff31359e700 1 --2- 172.21.15.57:0/749733603 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff300003a90 0x7ff300003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:52.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.998+0000 7ff31359e700 1 -- 172.21.15.57:0/749733603 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff300003570 con 0x7ff3140aa7e0 2023-10-06T03:01:52.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.998+0000 7ff31359e700 1 --2- 172.21.15.57:0/749733603 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff3140aa7e0 0x7ff3000051c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff30c00e210 tx=0x7ff30c00b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=70ebca0ecc8fd169 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:52.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.998+0000 7ff31259c700 1 -- 172.21.15.57:0/749733603 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff30c00eac0 con 0x7ff3140aa7e0 2023-10-06T03:01:52.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.998+0000 7ff31259c700 1 -- 172.21.15.57:0/749733603 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff30c00f040 con 0x7ff3140aa7e0 2023-10-06T03:01:52.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:51.998+0000 7ff31259c700 1 -- 172.21.15.57:0/749733603 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff30c00ee70 con 0x7ff3140aa7e0 2023-10-06T03:01:52.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.002+0000 7ff318a2d700 1 -- 172.21.15.57:0/749733603 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff3140aa7e0 msgr2=0x7ff3000051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:52.008 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.002+0000 7ff318a2d700 1 --2- 172.21.15.57:0/749733603 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff3140aa7e0 0x7ff3000051c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff30c00e210 tx=0x7ff30c00b040 comp rx=0 tx=0).stop 2023-10-06T03:01:52.008 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.002+0000 7ff31359e700 1 -- 172.21.15.57:0/749733603 reap_dead start 2023-10-06T03:01:52.008 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.002+0000 7ff318a2d700 1 -- 172.21.15.57:0/749733603 shutdown_connections 2023-10-06T03:01:52.008 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.002+0000 7ff318a2d700 1 -- 172.21.15.57:0/749733603 >> 172.21.15.57:0/749733603 conn(0x7ff3140c85e0 msgr2=0x7ff3140c89e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:52.008 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.002+0000 7ff318a2d700 1 -- 172.21.15.57:0/749733603 shutdown_connections 2023-10-06T03:01:52.008 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.002+0000 7ff318a2d700 1 -- 172.21.15.57:0/749733603 wait complete. 2023-10-06T03:01:52.009 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.002+0000 7ff318a2d700 1 Processor -- start 2023-10-06T03:01:52.009 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.002+0000 7ff318a2d700 1 -- start start 2023-10-06T03:01:52.011 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.002+0000 7ff318a2d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3140aa7e0 0x7ff3140babb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:52.011 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.002+0000 7ff318a2d700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff314154310 0x7ff3140c1df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:52.011 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.002+0000 7ff318a2d700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff3140ca820 0x7ff3140cac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:52.011 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.006+0000 7ff318a2d700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3140bd540 con 0x7ff3140aa7e0 2023-10-06T03:01:52.011 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.006+0000 7ff318a2d700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3140be410 con 0x7ff314154310 2023-10-06T03:01:52.011 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.006+0000 7ff318a2d700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff31416d220 con 0x7ff3140ca820 2023-10-06T03:01:52.011 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.006+0000 7ff312d9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3140aa7e0 0x7ff3140babb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:52.011 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.006+0000 7ff312d9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3140aa7e0 0x7ff3140babb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58950/0 (socket says 172.21.15.57:58950) 2023-10-06T03:01:52.011 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.006+0000 7ff312d9d700 1 -- 172.21.15.57:0/4031323992 learned_addr learned my addr 172.21.15.57:0/4031323992 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:52.012 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.006+0000 7ff30bfff700 1 --2- 172.21.15.57:0/4031323992 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff314154310 0x7ff3140c1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:52.012 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.006+0000 7ff31359e700 1 --2- 172.21.15.57:0/4031323992 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff3140ca820 0x7ff3140cac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:52.012 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.006+0000 7ff312d9d700 1 -- 172.21.15.57:0/4031323992 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff3140ca820 msgr2=0x7ff3140cac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:52.013 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.006+0000 7ff312d9d700 1 --2- 172.21.15.57:0/4031323992 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff3140ca820 0x7ff3140cac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:52.013 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.006+0000 7ff312d9d700 1 -- 172.21.15.57:0/4031323992 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff314154310 msgr2=0x7ff3140c1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:52.013 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.006+0000 7ff312d9d700 1 --2- 172.21.15.57:0/4031323992 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff314154310 0x7ff3140c1df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:52.013 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.006+0000 7ff312d9d700 1 -- 172.21.15.57:0/4031323992 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3140cb1d0 con 0x7ff3140aa7e0 2023-10-06T03:01:52.013 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.006+0000 7ff31359e700 1 --2- 172.21.15.57:0/4031323992 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff3140ca820 0x7ff3140cac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:01:52.013 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.006+0000 7ff312d9d700 1 --2- 172.21.15.57:0/4031323992 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3140aa7e0 0x7ff3140babb0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7ff304007390 tx=0x7ff304001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:52.016 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.010+0000 7ff30affd700 1 -- 172.21.15.57:0/4031323992 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff304018030 con 0x7ff3140aa7e0 2023-10-06T03:01:52.016 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.010+0000 7ff318a2d700 1 -- 172.21.15.57:0/4031323992 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff314154760 con 0x7ff3140aa7e0 2023-10-06T03:01:52.016 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.010+0000 7ff30affd700 1 -- 172.21.15.57:0/4031323992 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff30400f8d0 con 0x7ff3140aa7e0 2023-10-06T03:01:52.016 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.010+0000 7ff30affd700 1 -- 172.21.15.57:0/4031323992 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff30400fc70 con 0x7ff3140aa7e0 2023-10-06T03:01:52.016 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.010+0000 7ff318a2d700 1 -- 172.21.15.57:0/4031323992 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff31416d700 con 0x7ff3140aa7e0 2023-10-06T03:01:52.018 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.010+0000 7ff318a2d700 1 -- 172.21.15.57:0/4031323992 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff31404be40 con 0x7ff3140aa7e0 2023-10-06T03:01:52.019 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.014+0000 7ff30affd700 1 -- 172.21.15.57:0/4031323992 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7ff30401b070 con 0x7ff3140aa7e0 2023-10-06T03:01:52.020 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.014+0000 7ff30affd700 1 --2- 172.21.15.57:0/4031323992 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7ff2f4060550 0x7ff2f4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:52.021 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.014+0000 7ff30affd700 1 -- 172.21.15.57:0/4031323992 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff304019070 con 0x7ff3140aa7e0 2023-10-06T03:01:52.021 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.014+0000 7ff30bfff700 1 --2- 172.21.15.57:0/4031323992 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7ff2f4060550 0x7ff2f4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:52.022 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.014+0000 7ff30bfff700 1 --2- 172.21.15.57:0/4031323992 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7ff2f4060550 0x7ff2f4062a00 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc007e20 tx=0x7ff2fc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:52.028 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.022+0000 7ff30affd700 1 -- 172.21.15.57:0/4031323992 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7ff30404cca0 con 0x7ff3140aa7e0 2023-10-06T03:01:52.200 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.194+0000 7ff318a2d700 1 -- 172.21.15.57:0/4031323992 --> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff31406d630 con 0x7ff2f4060550 2023-10-06T03:01:52.219 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.214+0000 7ff30affd700 1 -- 172.21.15.57:0/4031323992 <== mgr.4103 v2:172.21.15.57:6832/32947 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+308706 (secure 0 0 0) 0x7ff31406d630 con 0x7ff2f4060550 2023-10-06T03:01:52.221 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:01:52.227 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.222+0000 7ff318a2d700 1 -- 172.21.15.57:0/4031323992 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7ff2f4060550 msgr2=0x7ff2f4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:52.227 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.222+0000 7ff318a2d700 1 --2- 172.21.15.57:0/4031323992 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7ff2f4060550 0x7ff2f4062a00 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc007e20 tx=0x7ff2fc009040 comp rx=0 tx=0).stop 2023-10-06T03:01:52.227 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.222+0000 7ff318a2d700 1 -- 172.21.15.57:0/4031323992 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3140aa7e0 msgr2=0x7ff3140babb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:52.227 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.222+0000 7ff318a2d700 1 --2- 172.21.15.57:0/4031323992 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3140aa7e0 0x7ff3140babb0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7ff304007390 tx=0x7ff304001e90 comp rx=0 tx=0).stop 2023-10-06T03:01:52.227 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.222+0000 7ff318a2d700 1 -- 172.21.15.57:0/4031323992 shutdown_connections 2023-10-06T03:01:52.227 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.222+0000 7ff318a2d700 1 --2- 172.21.15.57:0/4031323992 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7ff2f4060550 0x7ff2f4062a00 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:52.227 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.222+0000 7ff318a2d700 1 --2- 172.21.15.57:0/4031323992 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff3140ca820 0x7ff3140cac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:52.227 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.222+0000 7ff318a2d700 1 --2- 172.21.15.57:0/4031323992 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff314154310 0x7ff3140c1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:52.228 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.222+0000 7ff318a2d700 1 --2- 172.21.15.57:0/4031323992 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3140aa7e0 0x7ff3140babb0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:52.228 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.222+0000 7ff318a2d700 1 -- 172.21.15.57:0/4031323992 >> 172.21.15.57:0/4031323992 conn(0x7ff3140c85e0 msgr2=0x7ff3140ac170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:52.228 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.222+0000 7ff318a2d700 1 -- 172.21.15.57:0/4031323992 shutdown_connections 2023-10-06T03:01:52.228 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.222+0000 7ff318a2d700 1 -- 172.21.15.57:0/4031323992 wait complete. 2023-10-06T03:01:52.230 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2023-10-06T03:01:52.250 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":61,"stamp":"2023-10-06T03:01:50.289132+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":117,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2403028,"kb_used_data":4244,"kb_used_omap":0,"kb_used_meta":2398720,"kb_avail":752571692,"statfs":{"total":773094113280,"available":770633412608,"internally_reserved":0,"allocated":4345856,"data_stored":2442125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2456289280},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":55,"apply_latency_ms":55,"commit_latency_ns":55000000,"apply_latency_ns":55000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.386124"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":8,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.966837+0000","last_change":"2023-10-06T03:01:47.966837+0000","last_active":"2023-10-06T03:01:47.966837+0000","last_peered":"2023-10-06T03:01:47.966837+0000","last_clean":"2023-10-06T03:01:47.966837+0000","last_became_active":"2023-10-06T03:01:47.966443+0000","last_became_peered":"2023-10-06T03:01:47.966443+0000","last_unstale":"2023-10-06T03:01:47.966837+0000","last_undegraded":"2023-10-06T03:01:47.966837+0000","last_fullsized":"2023-10-06T03:01:47.966837+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:02:16.580758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":8,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.972092+0000","last_change":"2023-10-06T03:01:47.972092+0000","last_active":"2023-10-06T03:01:47.972092+0000","last_peered":"2023-10-06T03:01:47.972092+0000","last_clean":"2023-10-06T03:01:47.972092+0000","last_became_active":"2023-10-06T03:01:47.971585+0000","last_became_peered":"2023-10-06T03:01:47.971585+0000","last_unstale":"2023-10-06T03:01:47.972092+0000","last_undegraded":"2023-10-06T03:01:47.972092+0000","last_fullsized":"2023-10-06T03:01:47.972092+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:31:10.509111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":8,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.980114+0000","last_change":"2023-10-06T03:01:47.980114+0000","last_active":"2023-10-06T03:01:47.980114+0000","last_peered":"2023-10-06T03:01:47.980114+0000","last_clean":"2023-10-06T03:01:47.980114+0000","last_became_active":"2023-10-06T03:01:47.979801+0000","last_became_peered":"2023-10-06T03:01:47.979801+0000","last_unstale":"2023-10-06T03:01:47.980114+0000","last_undegraded":"2023-10-06T03:01:47.980114+0000","last_fullsized":"2023-10-06T03:01:47.980114+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:46:44.569591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.975063+0000","last_change":"2023-10-06T03:01:47.962972+0000","last_active":"2023-10-06T03:01:47.975063+0000","last_peered":"2023-10-06T03:01:47.975063+0000","last_clean":"2023-10-06T03:01:47.975063+0000","last_became_active":"2023-10-06T03:01:47.962541+0000","last_became_peered":"2023-10-06T03:01:47.962541+0000","last_unstale":"2023-10-06T03:01:47.975063+0000","last_undegraded":"2023-10-06T03:01:47.975063+0000","last_fullsized":"2023-10-06T03:01:47.975063+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:17:04.814930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.983133+0000","last_change":"2023-10-06T03:01:47.969888+0000","last_active":"2023-10-06T03:01:47.983133+0000","last_peered":"2023-10-06T03:01:47.983133+0000","last_clean":"2023-10-06T03:01:47.983133+0000","last_became_active":"2023-10-06T03:01:47.969393+0000","last_became_peered":"2023-10-06T03:01:47.969393+0000","last_unstale":"2023-10-06T03:01:47.983133+0000","last_undegraded":"2023-10-06T03:01:47.983133+0000","last_fullsized":"2023-10-06T03:01:47.983133+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:10:24.119762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.964854+0000","last_change":"2023-10-06T03:01:47.960785+0000","last_active":"2023-10-06T03:01:47.964854+0000","last_peered":"2023-10-06T03:01:47.964854+0000","last_clean":"2023-10-06T03:01:47.964854+0000","last_became_active":"2023-10-06T03:01:47.960528+0000","last_became_peered":"2023-10-06T03:01:47.960528+0000","last_unstale":"2023-10-06T03:01:47.964854+0000","last_undegraded":"2023-10-06T03:01:47.964854+0000","last_fullsized":"2023-10-06T03:01:47.964854+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:52:27.736299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.984708+0000","last_change":"2023-10-06T03:01:47.976648+0000","last_active":"2023-10-06T03:01:47.984708+0000","last_peered":"2023-10-06T03:01:47.984708+0000","last_clean":"2023-10-06T03:01:47.984708+0000","last_became_active":"2023-10-06T03:01:47.974061+0000","last_became_peered":"2023-10-06T03:01:47.974061+0000","last_unstale":"2023-10-06T03:01:47.984708+0000","last_undegraded":"2023-10-06T03:01:47.984708+0000","last_fullsized":"2023-10-06T03:01:47.984708+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:05:12.992756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":8,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.977189+0000","last_change":"2023-10-06T03:01:47.977189+0000","last_active":"2023-10-06T03:01:47.977189+0000","last_peered":"2023-10-06T03:01:47.977189+0000","last_clean":"2023-10-06T03:01:47.977189+0000","last_became_active":"2023-10-06T03:01:47.976902+0000","last_became_peered":"2023-10-06T03:01:47.976902+0000","last_unstale":"2023-10-06T03:01:47.977189+0000","last_undegraded":"2023-10-06T03:01:47.977189+0000","last_fullsized":"2023-10-06T03:01:47.977189+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:05:12.992756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":8,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.976540+0000","last_change":"2023-10-06T03:01:47.976540+0000","last_active":"2023-10-06T03:01:47.976540+0000","last_peered":"2023-10-06T03:01:47.976540+0000","last_clean":"2023-10-06T03:01:47.976540+0000","last_became_active":"2023-10-06T03:01:47.976184+0000","last_became_peered":"2023-10-06T03:01:47.976184+0000","last_unstale":"2023-10-06T03:01:47.976540+0000","last_undegraded":"2023-10-06T03:01:47.976540+0000","last_fullsized":"2023-10-06T03:01:47.976540+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:23:12.179782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.984854+0000","last_change":"2023-10-06T03:01:47.974795+0000","last_active":"2023-10-06T03:01:47.984854+0000","last_peered":"2023-10-06T03:01:47.984854+0000","last_clean":"2023-10-06T03:01:47.984854+0000","last_became_active":"2023-10-06T03:01:47.973901+0000","last_became_peered":"2023-10-06T03:01:47.973901+0000","last_unstale":"2023-10-06T03:01:47.984854+0000","last_undegraded":"2023-10-06T03:01:47.984854+0000","last_fullsized":"2023-10-06T03:01:47.984854+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:45:09.015376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.986155+0000","last_change":"2023-10-06T03:01:47.979896+0000","last_active":"2023-10-06T03:01:47.986155+0000","last_peered":"2023-10-06T03:01:47.986155+0000","last_clean":"2023-10-06T03:01:47.986155+0000","last_became_active":"2023-10-06T03:01:47.977880+0000","last_became_peered":"2023-10-06T03:01:47.977880+0000","last_unstale":"2023-10-06T03:01:47.986155+0000","last_undegraded":"2023-10-06T03:01:47.986155+0000","last_fullsized":"2023-10-06T03:01:47.986155+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:13:59.064942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":8,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.962271+0000","last_change":"2023-10-06T03:01:47.962271+0000","last_active":"2023-10-06T03:01:47.962271+0000","last_peered":"2023-10-06T03:01:47.962271+0000","last_clean":"2023-10-06T03:01:47.962271+0000","last_became_active":"2023-10-06T03:01:47.961502+0000","last_became_peered":"2023-10-06T03:01:47.961502+0000","last_unstale":"2023-10-06T03:01:47.962271+0000","last_undegraded":"2023-10-06T03:01:47.962271+0000","last_fullsized":"2023-10-06T03:01:47.962271+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:02:16.580758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.980475+0000","last_change":"2023-10-06T03:01:47.973462+0000","last_active":"2023-10-06T03:01:47.980475+0000","last_peered":"2023-10-06T03:01:47.980475+0000","last_clean":"2023-10-06T03:01:47.980475+0000","last_became_active":"2023-10-06T03:01:47.973074+0000","last_became_peered":"2023-10-06T03:01:47.973074+0000","last_unstale":"2023-10-06T03:01:47.980475+0000","last_undegraded":"2023-10-06T03:01:47.980475+0000","last_fullsized":"2023-10-06T03:01:47.980475+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:26:08.817720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.969059+0000","last_change":"2023-10-06T03:01:47.962824+0000","last_active":"2023-10-06T03:01:47.969059+0000","last_peered":"2023-10-06T03:01:47.969059+0000","last_clean":"2023-10-06T03:01:47.969059+0000","last_became_active":"2023-10-06T03:01:47.962329+0000","last_became_peered":"2023-10-06T03:01:47.962329+0000","last_unstale":"2023-10-06T03:01:47.969059+0000","last_undegraded":"2023-10-06T03:01:47.969059+0000","last_fullsized":"2023-10-06T03:01:47.969059+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:26:08.817720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.986293+0000","last_change":"2023-10-06T03:01:47.981598+0000","last_active":"2023-10-06T03:01:47.986293+0000","last_peered":"2023-10-06T03:01:47.986293+0000","last_clean":"2023-10-06T03:01:47.986293+0000","last_became_active":"2023-10-06T03:01:47.981409+0000","last_became_peered":"2023-10-06T03:01:47.981409+0000","last_unstale":"2023-10-06T03:01:47.986293+0000","last_undegraded":"2023-10-06T03:01:47.986293+0000","last_fullsized":"2023-10-06T03:01:47.986293+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:30:46.415498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":8,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.982174+0000","last_change":"2023-10-06T03:01:47.982174+0000","last_active":"2023-10-06T03:01:47.982174+0000","last_peered":"2023-10-06T03:01:47.982174+0000","last_clean":"2023-10-06T03:01:47.982174+0000","last_became_active":"2023-10-06T03:01:47.981846+0000","last_became_peered":"2023-10-06T03:01:47.981846+0000","last_unstale":"2023-10-06T03:01:47.982174+0000","last_undegraded":"2023-10-06T03:01:47.982174+0000","last_fullsized":"2023-10-06T03:01:47.982174+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:13:59.064942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":8,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.981105+0000","last_change":"2023-10-06T03:01:47.981105+0000","last_active":"2023-10-06T03:01:47.981105+0000","last_peered":"2023-10-06T03:01:47.981105+0000","last_clean":"2023-10-06T03:01:47.981105+0000","last_became_active":"2023-10-06T03:01:47.975645+0000","last_became_peered":"2023-10-06T03:01:47.975645+0000","last_unstale":"2023-10-06T03:01:47.981105+0000","last_undegraded":"2023-10-06T03:01:47.981105+0000","last_fullsized":"2023-10-06T03:01:47.981105+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:52:27.736299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":8,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.955924+0000","last_change":"2023-10-06T03:01:47.955924+0000","last_active":"2023-10-06T03:01:47.955924+0000","last_peered":"2023-10-06T03:01:47.955924+0000","last_clean":"2023-10-06T03:01:47.955924+0000","last_became_active":"2023-10-06T03:01:47.955612+0000","last_became_peered":"2023-10-06T03:01:47.955612+0000","last_unstale":"2023-10-06T03:01:47.955924+0000","last_undegraded":"2023-10-06T03:01:47.955924+0000","last_fullsized":"2023-10-06T03:01:47.955924+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:01:10.004545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.975663+0000","last_change":"2023-10-06T03:01:47.968406+0000","last_active":"2023-10-06T03:01:47.975663+0000","last_peered":"2023-10-06T03:01:47.975663+0000","last_clean":"2023-10-06T03:01:47.975663+0000","last_became_active":"2023-10-06T03:01:47.968087+0000","last_became_peered":"2023-10-06T03:01:47.968087+0000","last_unstale":"2023-10-06T03:01:47.975663+0000","last_undegraded":"2023-10-06T03:01:47.975663+0000","last_fullsized":"2023-10-06T03:01:47.975663+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:55:31.686994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":8,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.952932+0000","last_change":"2023-10-06T03:01:47.952932+0000","last_active":"2023-10-06T03:01:47.952932+0000","last_peered":"2023-10-06T03:01:47.952932+0000","last_clean":"2023-10-06T03:01:47.952932+0000","last_became_active":"2023-10-06T03:01:47.952509+0000","last_became_peered":"2023-10-06T03:01:47.952509+0000","last_unstale":"2023-10-06T03:01:47.952932+0000","last_undegraded":"2023-10-06T03:01:47.952932+0000","last_fullsized":"2023-10-06T03:01:47.952932+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:18:58.343998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.984792+0000","last_change":"2023-10-06T03:01:47.977714+0000","last_active":"2023-10-06T03:01:47.984792+0000","last_peered":"2023-10-06T03:01:47.984792+0000","last_clean":"2023-10-06T03:01:47.984792+0000","last_became_active":"2023-10-06T03:01:47.977335+0000","last_became_peered":"2023-10-06T03:01:47.977335+0000","last_unstale":"2023-10-06T03:01:47.984792+0000","last_undegraded":"2023-10-06T03:01:47.984792+0000","last_fullsized":"2023-10-06T03:01:47.984792+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:31:10.509111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.977165+0000","last_change":"2023-10-06T03:01:47.972271+0000","last_active":"2023-10-06T03:01:47.977165+0000","last_peered":"2023-10-06T03:01:47.977165+0000","last_clean":"2023-10-06T03:01:47.977165+0000","last_became_active":"2023-10-06T03:01:47.971962+0000","last_became_peered":"2023-10-06T03:01:47.971962+0000","last_unstale":"2023-10-06T03:01:47.977165+0000","last_undegraded":"2023-10-06T03:01:47.977165+0000","last_fullsized":"2023-10-06T03:01:47.977165+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:02:16.580758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":8,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.982574+0000","last_change":"2023-10-06T03:01:47.982574+0000","last_active":"2023-10-06T03:01:47.982574+0000","last_peered":"2023-10-06T03:01:47.982574+0000","last_clean":"2023-10-06T03:01:47.982574+0000","last_became_active":"2023-10-06T03:01:47.982286+0000","last_became_peered":"2023-10-06T03:01:47.982286+0000","last_unstale":"2023-10-06T03:01:47.982574+0000","last_undegraded":"2023-10-06T03:01:47.982574+0000","last_fullsized":"2023-10-06T03:01:47.982574+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:27:14.787514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.983024+0000","last_change":"2023-10-06T03:01:47.970149+0000","last_active":"2023-10-06T03:01:47.983024+0000","last_peered":"2023-10-06T03:01:47.983024+0000","last_clean":"2023-10-06T03:01:47.983024+0000","last_became_active":"2023-10-06T03:01:47.969724+0000","last_became_peered":"2023-10-06T03:01:47.969724+0000","last_unstale":"2023-10-06T03:01:47.983024+0000","last_undegraded":"2023-10-06T03:01:47.983024+0000","last_fullsized":"2023-10-06T03:01:47.983024+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:53:16.698160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":8,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.965879+0000","last_change":"2023-10-06T03:01:47.965879+0000","last_active":"2023-10-06T03:01:47.965879+0000","last_peered":"2023-10-06T03:01:47.965879+0000","last_clean":"2023-10-06T03:01:47.965879+0000","last_became_active":"2023-10-06T03:01:47.965457+0000","last_became_peered":"2023-10-06T03:01:47.965457+0000","last_unstale":"2023-10-06T03:01:47.965879+0000","last_undegraded":"2023-10-06T03:01:47.965879+0000","last_fullsized":"2023-10-06T03:01:47.965879+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:47.097485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.983557+0000","last_change":"2023-10-06T03:01:47.978006+0000","last_active":"2023-10-06T03:01:47.983557+0000","last_peered":"2023-10-06T03:01:47.983557+0000","last_clean":"2023-10-06T03:01:47.983557+0000","last_became_active":"2023-10-06T03:01:47.977664+0000","last_became_peered":"2023-10-06T03:01:47.977664+0000","last_unstale":"2023-10-06T03:01:47.983557+0000","last_undegraded":"2023-10-06T03:01:47.983557+0000","last_fullsized":"2023-10-06T03:01:47.983557+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:46:44.569591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":8,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.971942+0000","last_change":"2023-10-06T03:01:47.971942+0000","last_active":"2023-10-06T03:01:47.971942+0000","last_peered":"2023-10-06T03:01:47.971942+0000","last_clean":"2023-10-06T03:01:47.971942+0000","last_became_active":"2023-10-06T03:01:47.971642+0000","last_became_peered":"2023-10-06T03:01:47.971642+0000","last_unstale":"2023-10-06T03:01:47.971942+0000","last_undegraded":"2023-10-06T03:01:47.971942+0000","last_fullsized":"2023-10-06T03:01:47.971942+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:48:31.177237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.984818+0000","last_change":"2023-10-06T03:01:47.978268+0000","last_active":"2023-10-06T03:01:47.984818+0000","last_peered":"2023-10-06T03:01:47.984818+0000","last_clean":"2023-10-06T03:01:47.984818+0000","last_became_active":"2023-10-06T03:01:47.977838+0000","last_became_peered":"2023-10-06T03:01:47.977838+0000","last_unstale":"2023-10-06T03:01:47.984818+0000","last_undegraded":"2023-10-06T03:01:47.984818+0000","last_fullsized":"2023-10-06T03:01:47.984818+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:09:33.747749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":8,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.966282+0000","last_change":"2023-10-06T03:01:47.966282+0000","last_active":"2023-10-06T03:01:47.966282+0000","last_peered":"2023-10-06T03:01:47.966282+0000","last_clean":"2023-10-06T03:01:47.966282+0000","last_became_active":"2023-10-06T03:01:47.965914+0000","last_became_peered":"2023-10-06T03:01:47.965914+0000","last_unstale":"2023-10-06T03:01:47.966282+0000","last_undegraded":"2023-10-06T03:01:47.966282+0000","last_fullsized":"2023-10-06T03:01:47.966282+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:45:14.387596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":8,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.960023+0000","last_change":"2023-10-06T03:01:47.960023+0000","last_active":"2023-10-06T03:01:47.960023+0000","last_peered":"2023-10-06T03:01:47.960023+0000","last_clean":"2023-10-06T03:01:47.960023+0000","last_became_active":"2023-10-06T03:01:47.959665+0000","last_became_peered":"2023-10-06T03:01:47.959665+0000","last_unstale":"2023-10-06T03:01:47.960023+0000","last_undegraded":"2023-10-06T03:01:47.960023+0000","last_fullsized":"2023-10-06T03:01:47.960023+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:26:30.172046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":8,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.982682+0000","last_change":"2023-10-06T03:01:47.982682+0000","last_active":"2023-10-06T03:01:47.982682+0000","last_peered":"2023-10-06T03:01:47.982682+0000","last_clean":"2023-10-06T03:01:47.982682+0000","last_became_active":"2023-10-06T03:01:47.982298+0000","last_became_peered":"2023-10-06T03:01:47.982298+0000","last_unstale":"2023-10-06T03:01:47.982682+0000","last_undegraded":"2023-10-06T03:01:47.982682+0000","last_fullsized":"2023-10-06T03:01:47.982682+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:12:09.400466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.976677+0000","last_change":"2023-10-06T03:01:47.971192+0000","last_active":"2023-10-06T03:01:47.976677+0000","last_peered":"2023-10-06T03:01:47.976677+0000","last_clean":"2023-10-06T03:01:47.976677+0000","last_became_active":"2023-10-06T03:01:47.970854+0000","last_became_peered":"2023-10-06T03:01:47.970854+0000","last_unstale":"2023-10-06T03:01:47.976677+0000","last_undegraded":"2023-10-06T03:01:47.976677+0000","last_fullsized":"2023-10-06T03:01:47.976677+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:27:00.216138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":8,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.981009+0000","last_change":"2023-10-06T03:01:47.981009+0000","last_active":"2023-10-06T03:01:47.981009+0000","last_peered":"2023-10-06T03:01:47.981009+0000","last_clean":"2023-10-06T03:01:47.981009+0000","last_became_active":"2023-10-06T03:01:47.980664+0000","last_became_peered":"2023-10-06T03:01:47.980664+0000","last_unstale":"2023-10-06T03:01:47.981009+0000","last_undegraded":"2023-10-06T03:01:47.981009+0000","last_fullsized":"2023-10-06T03:01:47.981009+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:26:08.817720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"34'4","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.969452+0000","last_change":"2023-10-06T03:01:46.935881+0000","last_active":"2023-10-06T03:01:47.969452+0000","last_peered":"2023-10-06T03:01:47.969452+0000","last_clean":"2023-10-06T03:01:47.969452+0000","last_became_active":"2023-10-06T03:01:46.935607+0000","last_became_peered":"2023-10-06T03:01:46.935607+0000","last_unstale":"2023-10-06T03:01:47.969452+0000","last_undegraded":"2023-10-06T03:01:47.969452+0000","last_fullsized":"2023-10-06T03:01:47.969452+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_clean_scrub_stamp":"2023-10-06T03:01:45.882537+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:30:30.739598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.983657+0000","last_change":"2023-10-06T03:01:47.980675+0000","last_active":"2023-10-06T03:01:47.983657+0000","last_peered":"2023-10-06T03:01:47.983657+0000","last_clean":"2023-10-06T03:01:47.983657+0000","last_became_active":"2023-10-06T03:01:47.980283+0000","last_became_peered":"2023-10-06T03:01:47.980283+0000","last_unstale":"2023-10-06T03:01:47.983657+0000","last_undegraded":"2023-10-06T03:01:47.983657+0000","last_fullsized":"2023-10-06T03:01:47.983657+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:44:46.075266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"34'1","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.951890+0000","last_change":"2023-10-06T03:01:46.937386+0000","last_active":"2023-10-06T03:01:47.951890+0000","last_peered":"2023-10-06T03:01:47.951890+0000","last_clean":"2023-10-06T03:01:47.951890+0000","last_became_active":"2023-10-06T03:01:46.937022+0000","last_became_peered":"2023-10-06T03:01:46.937022+0000","last_unstale":"2023-10-06T03:01:47.951890+0000","last_undegraded":"2023-10-06T03:01:47.951890+0000","last_fullsized":"2023-10-06T03:01:47.951890+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_clean_scrub_stamp":"2023-10-06T03:01:45.882537+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:57:24.492317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.968938+0000","last_change":"2023-10-06T03:01:47.962442+0000","last_active":"2023-10-06T03:01:47.968938+0000","last_peered":"2023-10-06T03:01:47.968938+0000","last_clean":"2023-10-06T03:01:47.968938+0000","last_became_active":"2023-10-06T03:01:47.961910+0000","last_became_peered":"2023-10-06T03:01:47.961910+0000","last_unstale":"2023-10-06T03:01:47.968938+0000","last_undegraded":"2023-10-06T03:01:47.968938+0000","last_fullsized":"2023-10-06T03:01:47.968938+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:10:10.643033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"34'2","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.971501+0000","last_change":"2023-10-06T03:01:46.938448+0000","last_active":"2023-10-06T03:01:47.971501+0000","last_peered":"2023-10-06T03:01:47.971501+0000","last_clean":"2023-10-06T03:01:47.971501+0000","last_became_active":"2023-10-06T03:01:46.938160+0000","last_became_peered":"2023-10-06T03:01:46.938160+0000","last_unstale":"2023-10-06T03:01:47.971501+0000","last_undegraded":"2023-10-06T03:01:47.971501+0000","last_fullsized":"2023-10-06T03:01:47.971501+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_clean_scrub_stamp":"2023-10-06T03:01:45.882537+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:36:50.667930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":8,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.956862+0000","last_change":"2023-10-06T03:01:47.956862+0000","last_active":"2023-10-06T03:01:47.956862+0000","last_peered":"2023-10-06T03:01:47.956862+0000","last_clean":"2023-10-06T03:01:47.956862+0000","last_became_active":"2023-10-06T03:01:47.955923+0000","last_became_peered":"2023-10-06T03:01:47.955923+0000","last_unstale":"2023-10-06T03:01:47.956862+0000","last_undegraded":"2023-10-06T03:01:47.956862+0000","last_fullsized":"2023-10-06T03:01:47.956862+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:09:33.747749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"34'2","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.978265+0000","last_change":"2023-10-06T03:01:46.942148+0000","last_active":"2023-10-06T03:01:47.978265+0000","last_peered":"2023-10-06T03:01:47.978265+0000","last_clean":"2023-10-06T03:01:47.978265+0000","last_became_active":"2023-10-06T03:01:46.941869+0000","last_became_peered":"2023-10-06T03:01:46.941869+0000","last_unstale":"2023-10-06T03:01:47.978265+0000","last_undegraded":"2023-10-06T03:01:47.978265+0000","last_fullsized":"2023-10-06T03:01:47.978265+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_clean_scrub_stamp":"2023-10-06T03:01:45.882537+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:17:03.797659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":8,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.962933+0000","last_change":"2023-10-06T03:01:47.962933+0000","last_active":"2023-10-06T03:01:47.962933+0000","last_peered":"2023-10-06T03:01:47.962933+0000","last_clean":"2023-10-06T03:01:47.962933+0000","last_became_active":"2023-10-06T03:01:47.962637+0000","last_became_peered":"2023-10-06T03:01:47.962637+0000","last_unstale":"2023-10-06T03:01:47.962933+0000","last_undegraded":"2023-10-06T03:01:47.962933+0000","last_fullsized":"2023-10-06T03:01:47.962933+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:27:14.787514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"34'1","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.977157+0000","last_change":"2023-10-06T03:01:46.934993+0000","last_active":"2023-10-06T03:01:47.977157+0000","last_peered":"2023-10-06T03:01:47.977157+0000","last_clean":"2023-10-06T03:01:47.977157+0000","last_became_active":"2023-10-06T03:01:46.934634+0000","last_became_peered":"2023-10-06T03:01:46.934634+0000","last_unstale":"2023-10-06T03:01:47.977157+0000","last_undegraded":"2023-10-06T03:01:47.977157+0000","last_fullsized":"2023-10-06T03:01:47.977157+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_clean_scrub_stamp":"2023-10-06T03:01:45.882537+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:18:42.554199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.984684+0000","last_change":"2023-10-06T03:01:47.975183+0000","last_active":"2023-10-06T03:01:47.984684+0000","last_peered":"2023-10-06T03:01:47.984684+0000","last_clean":"2023-10-06T03:01:47.984684+0000","last_became_active":"2023-10-06T03:01:47.973861+0000","last_became_peered":"2023-10-06T03:01:47.973861+0000","last_unstale":"2023-10-06T03:01:47.984684+0000","last_undegraded":"2023-10-06T03:01:47.984684+0000","last_fullsized":"2023-10-06T03:01:47.984684+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:14:37.996899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"34'1","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.942355+0000","last_change":"2023-10-06T03:01:46.939131+0000","last_active":"2023-10-06T03:01:47.942355+0000","last_peered":"2023-10-06T03:01:47.942355+0000","last_clean":"2023-10-06T03:01:47.942355+0000","last_became_active":"2023-10-06T03:01:46.938870+0000","last_became_peered":"2023-10-06T03:01:46.938870+0000","last_unstale":"2023-10-06T03:01:47.942355+0000","last_undegraded":"2023-10-06T03:01:47.942355+0000","last_fullsized":"2023-10-06T03:01:47.942355+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_clean_scrub_stamp":"2023-10-06T03:01:45.882537+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:57:25.127564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.979051+0000","last_change":"2023-10-06T03:01:47.976939+0000","last_active":"2023-10-06T03:01:47.979051+0000","last_peered":"2023-10-06T03:01:47.979051+0000","last_clean":"2023-10-06T03:01:47.979051+0000","last_became_active":"2023-10-06T03:01:47.976585+0000","last_became_peered":"2023-10-06T03:01:47.976585+0000","last_unstale":"2023-10-06T03:01:47.979051+0000","last_undegraded":"2023-10-06T03:01:47.979051+0000","last_fullsized":"2023-10-06T03:01:47.979051+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:57:40.860316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.952482+0000","last_change":"2023-10-06T03:01:46.942708+0000","last_active":"2023-10-06T03:01:47.952482+0000","last_peered":"2023-10-06T03:01:47.952482+0000","last_clean":"2023-10-06T03:01:47.952482+0000","last_became_active":"2023-10-06T03:01:46.942308+0000","last_became_peered":"2023-10-06T03:01:46.942308+0000","last_unstale":"2023-10-06T03:01:47.952482+0000","last_undegraded":"2023-10-06T03:01:47.952482+0000","last_fullsized":"2023-10-06T03:01:47.952482+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_clean_scrub_stamp":"2023-10-06T03:01:45.882537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:27:48.405448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":8,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.954024+0000","last_change":"2023-10-06T03:01:47.954024+0000","last_active":"2023-10-06T03:01:47.954024+0000","last_peered":"2023-10-06T03:01:47.954024+0000","last_clean":"2023-10-06T03:01:47.954024+0000","last_became_active":"2023-10-06T03:01:47.952837+0000","last_became_peered":"2023-10-06T03:01:47.952837+0000","last_unstale":"2023-10-06T03:01:47.954024+0000","last_undegraded":"2023-10-06T03:01:47.954024+0000","last_fullsized":"2023-10-06T03:01:47.954024+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:14:37.996899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.949088+0000","last_change":"2023-10-06T03:01:46.937715+0000","last_active":"2023-10-06T03:01:47.949088+0000","last_peered":"2023-10-06T03:01:47.949088+0000","last_clean":"2023-10-06T03:01:47.949088+0000","last_became_active":"2023-10-06T03:01:46.937363+0000","last_became_peered":"2023-10-06T03:01:46.937363+0000","last_unstale":"2023-10-06T03:01:47.949088+0000","last_undegraded":"2023-10-06T03:01:47.949088+0000","last_fullsized":"2023-10-06T03:01:47.949088+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_clean_scrub_stamp":"2023-10-06T03:01:45.882537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:50:34.642508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.975009+0000","last_change":"2023-10-06T03:01:47.962545+0000","last_active":"2023-10-06T03:01:47.975009+0000","last_peered":"2023-10-06T03:01:47.975009+0000","last_clean":"2023-10-06T03:01:47.975009+0000","last_became_active":"2023-10-06T03:01:47.961916+0000","last_became_peered":"2023-10-06T03:01:47.961916+0000","last_unstale":"2023-10-06T03:01:47.975009+0000","last_undegraded":"2023-10-06T03:01:47.975009+0000","last_fullsized":"2023-10-06T03:01:47.975009+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:18:43.571471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T03:01:46.945469+0000","last_change":"2023-10-06T03:01:46.940690+0000","last_active":"2023-10-06T03:01:46.945469+0000","last_peered":"2023-10-06T03:01:46.945469+0000","last_clean":"2023-10-06T03:01:46.945469+0000","last_became_active":"2023-10-06T03:01:46.940082+0000","last_became_peered":"2023-10-06T03:01:46.940082+0000","last_unstale":"2023-10-06T03:01:46.945469+0000","last_undegraded":"2023-10-06T03:01:46.945469+0000","last_fullsized":"2023-10-06T03:01:46.945469+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_clean_scrub_stamp":"2023-10-06T03:01:45.882537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:18:42.554199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":8,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.952350+0000","last_change":"2023-10-06T03:01:47.952350+0000","last_active":"2023-10-06T03:01:47.952350+0000","last_peered":"2023-10-06T03:01:47.952350+0000","last_clean":"2023-10-06T03:01:47.952350+0000","last_became_active":"2023-10-06T03:01:47.952069+0000","last_became_peered":"2023-10-06T03:01:47.952069+0000","last_unstale":"2023-10-06T03:01:47.952350+0000","last_undegraded":"2023-10-06T03:01:47.952350+0000","last_fullsized":"2023-10-06T03:01:47.952350+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:23:12.179782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.953585+0000","last_change":"2023-10-06T03:01:46.941410+0000","last_active":"2023-10-06T03:01:47.953585+0000","last_peered":"2023-10-06T03:01:47.953585+0000","last_clean":"2023-10-06T03:01:47.953585+0000","last_became_active":"2023-10-06T03:01:46.940580+0000","last_became_peered":"2023-10-06T03:01:46.940580+0000","last_unstale":"2023-10-06T03:01:47.953585+0000","last_undegraded":"2023-10-06T03:01:47.953585+0000","last_fullsized":"2023-10-06T03:01:47.953585+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_clean_scrub_stamp":"2023-10-06T03:01:45.882537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:55:30.669723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":8,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.963512+0000","last_change":"2023-10-06T03:01:47.963512+0000","last_active":"2023-10-06T03:01:47.963512+0000","last_peered":"2023-10-06T03:01:47.963512+0000","last_clean":"2023-10-06T03:01:47.963512+0000","last_became_active":"2023-10-06T03:01:47.963230+0000","last_became_peered":"2023-10-06T03:01:47.963230+0000","last_unstale":"2023-10-06T03:01:47.963512+0000","last_undegraded":"2023-10-06T03:01:47.963512+0000","last_fullsized":"2023-10-06T03:01:47.963512+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:12:09.400466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"34'3","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.980073+0000","last_change":"2023-10-06T03:01:46.941008+0000","last_active":"2023-10-06T03:01:47.980073+0000","last_peered":"2023-10-06T03:01:47.980073+0000","last_clean":"2023-10-06T03:01:47.980073+0000","last_became_active":"2023-10-06T03:01:46.940690+0000","last_became_peered":"2023-10-06T03:01:46.940690+0000","last_unstale":"2023-10-06T03:01:47.980073+0000","last_undegraded":"2023-10-06T03:01:47.980073+0000","last_fullsized":"2023-10-06T03:01:47.980073+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_clean_scrub_stamp":"2023-10-06T03:01:45.882537+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:53:15.680889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.977560+0000","last_change":"2023-10-06T03:01:47.972323+0000","last_active":"2023-10-06T03:01:47.977560+0000","last_peered":"2023-10-06T03:01:47.977560+0000","last_clean":"2023-10-06T03:01:47.977560+0000","last_became_active":"2023-10-06T03:01:47.971960+0000","last_became_peered":"2023-10-06T03:01:47.971960+0000","last_unstale":"2023-10-06T03:01:47.977560+0000","last_undegraded":"2023-10-06T03:01:47.977560+0000","last_fullsized":"2023-10-06T03:01:47.977560+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:45:09.015376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"34'6","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.981553+0000","last_change":"2023-10-06T03:01:46.934711+0000","last_active":"2023-10-06T03:01:47.981553+0000","last_peered":"2023-10-06T03:01:47.981553+0000","last_clean":"2023-10-06T03:01:47.981553+0000","last_became_active":"2023-10-06T03:01:46.934386+0000","last_became_peered":"2023-10-06T03:01:46.934386+0000","last_unstale":"2023-10-06T03:01:47.981553+0000","last_undegraded":"2023-10-06T03:01:47.981553+0000","last_fullsized":"2023-10-06T03:01:47.981553+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_clean_scrub_stamp":"2023-10-06T03:01:45.882537+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:53:15.680889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":8,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.976266+0000","last_change":"2023-10-06T03:01:47.976266+0000","last_active":"2023-10-06T03:01:47.976266+0000","last_peered":"2023-10-06T03:01:47.976266+0000","last_clean":"2023-10-06T03:01:47.976266+0000","last_became_active":"2023-10-06T03:01:47.975543+0000","last_became_peered":"2023-10-06T03:01:47.975543+0000","last_unstale":"2023-10-06T03:01:47.976266+0000","last_undegraded":"2023-10-06T03:01:47.976266+0000","last_fullsized":"2023-10-06T03:01:47.976266+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:52:27.736299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"34'2","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.975258+0000","last_change":"2023-10-06T03:01:46.938837+0000","last_active":"2023-10-06T03:01:47.975258+0000","last_peered":"2023-10-06T03:01:47.975258+0000","last_clean":"2023-10-06T03:01:47.975258+0000","last_became_active":"2023-10-06T03:01:46.938547+0000","last_became_peered":"2023-10-06T03:01:46.938547+0000","last_unstale":"2023-10-06T03:01:47.975258+0000","last_undegraded":"2023-10-06T03:01:47.975258+0000","last_fullsized":"2023-10-06T03:01:47.975258+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_clean_scrub_stamp":"2023-10-06T03:01:45.882537+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:10:23.102491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":8,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.967440+0000","last_change":"2023-10-06T03:01:47.967440+0000","last_active":"2023-10-06T03:01:47.967440+0000","last_peered":"2023-10-06T03:01:47.967440+0000","last_clean":"2023-10-06T03:01:47.967440+0000","last_became_active":"2023-10-06T03:01:47.967076+0000","last_became_peered":"2023-10-06T03:01:47.967076+0000","last_unstale":"2023-10-06T03:01:47.967440+0000","last_undegraded":"2023-10-06T03:01:47.967440+0000","last_fullsized":"2023-10-06T03:01:47.967440+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:52:27.736299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.952159+0000","last_change":"2023-10-06T03:01:46.937621+0000","last_active":"2023-10-06T03:01:47.952159+0000","last_peered":"2023-10-06T03:01:47.952159+0000","last_clean":"2023-10-06T03:01:47.952159+0000","last_became_active":"2023-10-06T03:01:46.937312+0000","last_became_peered":"2023-10-06T03:01:46.937312+0000","last_unstale":"2023-10-06T03:01:47.952159+0000","last_undegraded":"2023-10-06T03:01:47.952159+0000","last_fullsized":"2023-10-06T03:01:47.952159+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_clean_scrub_stamp":"2023-10-06T03:01:45.882537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:17:54.301137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":8,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.972907+0000","last_change":"2023-10-06T03:01:47.972907+0000","last_active":"2023-10-06T03:01:47.972907+0000","last_peered":"2023-10-06T03:01:47.972907+0000","last_clean":"2023-10-06T03:01:47.972907+0000","last_became_active":"2023-10-06T03:01:47.972572+0000","last_became_peered":"2023-10-06T03:01:47.972572+0000","last_unstale":"2023-10-06T03:01:47.972907+0000","last_undegraded":"2023-10-06T03:01:47.972907+0000","last_fullsized":"2023-10-06T03:01:47.972907+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:57:40.860316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T03:01:46.942228+0000","last_change":"2023-10-06T03:01:46.937007+0000","last_active":"2023-10-06T03:01:46.942228+0000","last_peered":"2023-10-06T03:01:46.942228+0000","last_clean":"2023-10-06T03:01:46.942228+0000","last_became_active":"2023-10-06T03:01:46.936658+0000","last_became_peered":"2023-10-06T03:01:46.936658+0000","last_unstale":"2023-10-06T03:01:46.942228+0000","last_undegraded":"2023-10-06T03:01:46.942228+0000","last_fullsized":"2023-10-06T03:01:46.942228+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_clean_scrub_stamp":"2023-10-06T03:01:45.882537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:50:45.434465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":8,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.959506+0000","last_change":"2023-10-06T03:01:47.959506+0000","last_active":"2023-10-06T03:01:47.959506+0000","last_peered":"2023-10-06T03:01:47.959506+0000","last_clean":"2023-10-06T03:01:47.959506+0000","last_became_active":"2023-10-06T03:01:47.959181+0000","last_became_peered":"2023-10-06T03:01:47.959181+0000","last_unstale":"2023-10-06T03:01:47.959506+0000","last_undegraded":"2023-10-06T03:01:47.959506+0000","last_fullsized":"2023-10-06T03:01:47.959506+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:26:08.817720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"34'8","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.981563+0000","last_change":"2023-10-06T03:01:46.938990+0000","last_active":"2023-10-06T03:01:47.981563+0000","last_peered":"2023-10-06T03:01:47.981563+0000","last_clean":"2023-10-06T03:01:47.981563+0000","last_became_active":"2023-10-06T03:01:46.938685+0000","last_became_peered":"2023-10-06T03:01:46.938685+0000","last_unstale":"2023-10-06T03:01:47.981563+0000","last_undegraded":"2023-10-06T03:01:47.981563+0000","last_fullsized":"2023-10-06T03:01:47.981563+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_clean_scrub_stamp":"2023-10-06T03:01:45.882537+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:01:08.987274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":8,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.955166+0000","last_change":"2023-10-06T03:01:47.955166+0000","last_active":"2023-10-06T03:01:47.955166+0000","last_peered":"2023-10-06T03:01:47.955166+0000","last_clean":"2023-10-06T03:01:47.955166+0000","last_became_active":"2023-10-06T03:01:47.954853+0000","last_became_peered":"2023-10-06T03:01:47.954853+0000","last_unstale":"2023-10-06T03:01:47.955166+0000","last_undegraded":"2023-10-06T03:01:47.955166+0000","last_fullsized":"2023-10-06T03:01:47.955166+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:09:52.287614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'1","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.980603+0000","last_change":"2023-10-06T03:01:46.939332+0000","last_active":"2023-10-06T03:01:47.980603+0000","last_peered":"2023-10-06T03:01:47.980603+0000","last_clean":"2023-10-06T03:01:47.980603+0000","last_became_active":"2023-10-06T03:01:46.939036+0000","last_became_peered":"2023-10-06T03:01:46.939036+0000","last_unstale":"2023-10-06T03:01:47.980603+0000","last_undegraded":"2023-10-06T03:01:47.980603+0000","last_fullsized":"2023-10-06T03:01:47.980603+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_clean_scrub_stamp":"2023-10-06T03:01:45.882537+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:10:23.102491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.984785+0000","last_change":"2023-10-06T03:01:47.977610+0000","last_active":"2023-10-06T03:01:47.984785+0000","last_peered":"2023-10-06T03:01:47.984785+0000","last_clean":"2023-10-06T03:01:47.984785+0000","last_became_active":"2023-10-06T03:01:47.973982+0000","last_became_peered":"2023-10-06T03:01:47.973982+0000","last_unstale":"2023-10-06T03:01:47.984785+0000","last_undegraded":"2023-10-06T03:01:47.984785+0000","last_fullsized":"2023-10-06T03:01:47.984785+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:44:57.072987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"34'2","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.979264+0000","last_change":"2023-10-06T03:01:46.928642+0000","last_active":"2023-10-06T03:01:47.979264+0000","last_peered":"2023-10-06T03:01:47.979264+0000","last_clean":"2023-10-06T03:01:47.979264+0000","last_became_active":"2023-10-06T03:01:46.928335+0000","last_became_peered":"2023-10-06T03:01:46.928335+0000","last_unstale":"2023-10-06T03:01:47.979264+0000","last_undegraded":"2023-10-06T03:01:47.979264+0000","last_fullsized":"2023-10-06T03:01:47.979264+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_clean_scrub_stamp":"2023-10-06T03:01:45.882537+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:13:26.864290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.971918+0000","last_change":"2023-10-06T03:01:47.963208+0000","last_active":"2023-10-06T03:01:47.971918+0000","last_peered":"2023-10-06T03:01:47.971918+0000","last_clean":"2023-10-06T03:01:47.971918+0000","last_became_active":"2023-10-06T03:01:47.962918+0000","last_became_peered":"2023-10-06T03:01:47.962918+0000","last_unstale":"2023-10-06T03:01:47.971918+0000","last_undegraded":"2023-10-06T03:01:47.971918+0000","last_fullsized":"2023-10-06T03:01:47.971918+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:13:59.064942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"34'1","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.983258+0000","last_change":"2023-10-06T03:01:46.942179+0000","last_active":"2023-10-06T03:01:47.983258+0000","last_peered":"2023-10-06T03:01:47.983258+0000","last_clean":"2023-10-06T03:01:47.983258+0000","last_became_active":"2023-10-06T03:01:46.941798+0000","last_became_peered":"2023-10-06T03:01:46.941798+0000","last_unstale":"2023-10-06T03:01:47.983258+0000","last_undegraded":"2023-10-06T03:01:47.983258+0000","last_fullsized":"2023-10-06T03:01:47.983258+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_clean_scrub_stamp":"2023-10-06T03:01:45.882537+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:48:30.159965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.984190+0000","last_change":"2023-10-06T03:01:47.976336+0000","last_active":"2023-10-06T03:01:47.984190+0000","last_peered":"2023-10-06T03:01:47.984190+0000","last_clean":"2023-10-06T03:01:47.984190+0000","last_became_active":"2023-10-06T03:01:47.975962+0000","last_became_peered":"2023-10-06T03:01:47.975962+0000","last_unstale":"2023-10-06T03:01:47.984190+0000","last_undegraded":"2023-10-06T03:01:47.984190+0000","last_fullsized":"2023-10-06T03:01:47.984190+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:57:25.509588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.953127+0000","last_change":"2023-10-06T03:01:46.938512+0000","last_active":"2023-10-06T03:01:47.953127+0000","last_peered":"2023-10-06T03:01:47.953127+0000","last_clean":"2023-10-06T03:01:47.953127+0000","last_became_active":"2023-10-06T03:01:46.938216+0000","last_became_peered":"2023-10-06T03:01:46.938216+0000","last_unstale":"2023-10-06T03:01:47.953127+0000","last_undegraded":"2023-10-06T03:01:47.953127+0000","last_fullsized":"2023-10-06T03:01:47.953127+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_clean_scrub_stamp":"2023-10-06T03:01:45.882537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:55:30.669723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":8,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.971045+0000","last_change":"2023-10-06T03:01:47.971045+0000","last_active":"2023-10-06T03:01:47.971045+0000","last_peered":"2023-10-06T03:01:47.971045+0000","last_clean":"2023-10-06T03:01:47.971045+0000","last_became_active":"2023-10-06T03:01:47.970760+0000","last_became_peered":"2023-10-06T03:01:47.970760+0000","last_unstale":"2023-10-06T03:01:47.971045+0000","last_undegraded":"2023-10-06T03:01:47.971045+0000","last_fullsized":"2023-10-06T03:01:47.971045+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:02:16.580758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"34'2","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.975699+0000","last_change":"2023-10-06T03:01:46.939595+0000","last_active":"2023-10-06T03:01:47.975699+0000","last_peered":"2023-10-06T03:01:47.975699+0000","last_clean":"2023-10-06T03:01:47.975699+0000","last_became_active":"2023-10-06T03:01:46.939291+0000","last_became_peered":"2023-10-06T03:01:46.939291+0000","last_unstale":"2023-10-06T03:01:47.975699+0000","last_undegraded":"2023-10-06T03:01:47.975699+0000","last_fullsized":"2023-10-06T03:01:47.975699+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_clean_scrub_stamp":"2023-10-06T03:01:45.882537+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:46.080214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":8,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.963432+0000","last_change":"2023-10-06T03:01:47.963432+0000","last_active":"2023-10-06T03:01:47.963432+0000","last_peered":"2023-10-06T03:01:47.963432+0000","last_clean":"2023-10-06T03:01:47.963432+0000","last_became_active":"2023-10-06T03:01:47.963074+0000","last_became_peered":"2023-10-06T03:01:47.963074+0000","last_unstale":"2023-10-06T03:01:47.963432+0000","last_undegraded":"2023-10-06T03:01:47.963432+0000","last_fullsized":"2023-10-06T03:01:47.963432+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:44:46.075266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.956623+0000","last_change":"2023-10-06T03:01:46.934960+0000","last_active":"2023-10-06T03:01:47.956623+0000","last_peered":"2023-10-06T03:01:47.956623+0000","last_clean":"2023-10-06T03:01:47.956623+0000","last_became_active":"2023-10-06T03:01:46.934680+0000","last_became_peered":"2023-10-06T03:01:46.934680+0000","last_unstale":"2023-10-06T03:01:47.956623+0000","last_undegraded":"2023-10-06T03:01:47.956623+0000","last_fullsized":"2023-10-06T03:01:47.956623+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_clean_scrub_stamp":"2023-10-06T03:01:45.882537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:51:53.062850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.980023+0000","last_change":"2023-10-06T03:01:47.973443+0000","last_active":"2023-10-06T03:01:47.980023+0000","last_peered":"2023-10-06T03:01:47.980023+0000","last_clean":"2023-10-06T03:01:47.980023+0000","last_became_active":"2023-10-06T03:01:47.973143+0000","last_became_peered":"2023-10-06T03:01:47.973143+0000","last_unstale":"2023-10-06T03:01:47.980023+0000","last_undegraded":"2023-10-06T03:01:47.980023+0000","last_fullsized":"2023-10-06T03:01:47.980023+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:10:10.643033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T03:01:46.942347+0000","last_change":"2023-10-06T03:01:46.938217+0000","last_active":"2023-10-06T03:01:46.942347+0000","last_peered":"2023-10-06T03:01:46.942347+0000","last_clean":"2023-10-06T03:01:46.942347+0000","last_became_active":"2023-10-06T03:01:46.937894+0000","last_became_peered":"2023-10-06T03:01:46.937894+0000","last_unstale":"2023-10-06T03:01:46.942347+0000","last_undegraded":"2023-10-06T03:01:46.942347+0000","last_fullsized":"2023-10-06T03:01:46.942347+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_clean_scrub_stamp":"2023-10-06T03:01:45.882537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:36:50.667930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":8,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.954263+0000","last_change":"2023-10-06T03:01:47.954263+0000","last_active":"2023-10-06T03:01:47.954263+0000","last_peered":"2023-10-06T03:01:47.954263+0000","last_clean":"2023-10-06T03:01:47.954263+0000","last_became_active":"2023-10-06T03:01:47.953736+0000","last_became_peered":"2023-10-06T03:01:47.953736+0000","last_unstale":"2023-10-06T03:01:47.954263+0000","last_undegraded":"2023-10-06T03:01:47.954263+0000","last_fullsized":"2023-10-06T03:01:47.954263+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:45:09.015376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.956479+0000","last_change":"2023-10-06T03:01:46.939689+0000","last_active":"2023-10-06T03:01:47.956479+0000","last_peered":"2023-10-06T03:01:47.956479+0000","last_clean":"2023-10-06T03:01:47.956479+0000","last_became_active":"2023-10-06T03:01:46.939314+0000","last_became_peered":"2023-10-06T03:01:46.939314+0000","last_unstale":"2023-10-06T03:01:47.956479+0000","last_undegraded":"2023-10-06T03:01:47.956479+0000","last_fullsized":"2023-10-06T03:01:47.956479+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_clean_scrub_stamp":"2023-10-06T03:01:45.882537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:09:39.944812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.986197+0000","last_change":"2023-10-06T03:01:47.979997+0000","last_active":"2023-10-06T03:01:47.986197+0000","last_peered":"2023-10-06T03:01:47.986197+0000","last_clean":"2023-10-06T03:01:47.986197+0000","last_became_active":"2023-10-06T03:01:47.978303+0000","last_became_peered":"2023-10-06T03:01:47.978303+0000","last_unstale":"2023-10-06T03:01:47.986197+0000","last_undegraded":"2023-10-06T03:01:47.986197+0000","last_fullsized":"2023-10-06T03:01:47.986197+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:09:52.287614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T03:01:46.943844+0000","last_change":"2023-10-06T03:01:46.940299+0000","last_active":"2023-10-06T03:01:46.943844+0000","last_peered":"2023-10-06T03:01:46.943844+0000","last_clean":"2023-10-06T03:01:46.943844+0000","last_became_active":"2023-10-06T03:01:46.940095+0000","last_became_peered":"2023-10-06T03:01:46.940095+0000","last_unstale":"2023-10-06T03:01:46.943844+0000","last_undegraded":"2023-10-06T03:01:46.943844+0000","last_fullsized":"2023-10-06T03:01:46.943844+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_clean_scrub_stamp":"2023-10-06T03:01:45.882537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:17:54.301137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":174,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T03:01:46.926749+0000","last_change":"2023-10-06T03:00:45.709165+0000","last_active":"2023-10-06T03:01:46.926749+0000","last_peered":"2023-10-06T03:01:46.926749+0000","last_clean":"2023-10-06T03:01:46.926749+0000","last_became_active":"2023-10-06T03:00:45.707771+0000","last_became_peered":"2023-10-06T03:00:45.707771+0000","last_unstale":"2023-10-06T03:01:46.926749+0000","last_undegraded":"2023-10-06T03:01:46.926749+0000","last_fullsized":"2023-10-06T03:01:46.926749+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:44.625353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:44.625353+0000","last_clean_scrub_stamp":"2023-10-06T03:00:44.625353+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:31:31.774239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.960800+0000","last_change":"2023-10-06T03:00:51.905381+0000","last_active":"2023-10-06T03:01:47.960800+0000","last_peered":"2023-10-06T03:01:47.960800+0000","last_clean":"2023-10-06T03:01:47.960800+0000","last_became_active":"2023-10-06T03:00:51.904974+0000","last_became_peered":"2023-10-06T03:00:51.904974+0000","last_unstale":"2023-10-06T03:01:47.960800+0000","last_undegraded":"2023-10-06T03:01:47.960800+0000","last_fullsized":"2023-10-06T03:01:47.960800+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:15:19.182956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.983540+0000","last_change":"2023-10-06T03:01:47.977474+0000","last_active":"2023-10-06T03:01:47.983540+0000","last_peered":"2023-10-06T03:01:47.983540+0000","last_clean":"2023-10-06T03:01:47.983540+0000","last_became_active":"2023-10-06T03:01:47.977024+0000","last_became_peered":"2023-10-06T03:01:47.977024+0000","last_unstale":"2023-10-06T03:01:47.983540+0000","last_undegraded":"2023-10-06T03:01:47.983540+0000","last_fullsized":"2023-10-06T03:01:47.983540+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:57:45.017663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"34'2","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.980503+0000","last_change":"2023-10-06T03:01:46.943197+0000","last_active":"2023-10-06T03:01:47.980503+0000","last_peered":"2023-10-06T03:01:47.980503+0000","last_clean":"2023-10-06T03:01:47.980503+0000","last_became_active":"2023-10-06T03:01:46.942873+0000","last_became_peered":"2023-10-06T03:01:46.942873+0000","last_unstale":"2023-10-06T03:01:47.980503+0000","last_undegraded":"2023-10-06T03:01:47.980503+0000","last_fullsized":"2023-10-06T03:01:47.980503+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_clean_scrub_stamp":"2023-10-06T03:01:45.882537+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:17:03.797659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T03:01:46.926251+0000","last_change":"2023-10-06T03:00:51.906480+0000","last_active":"2023-10-06T03:01:46.926251+0000","last_peered":"2023-10-06T03:01:46.926251+0000","last_clean":"2023-10-06T03:01:46.926251+0000","last_became_active":"2023-10-06T03:00:51.905956+0000","last_became_peered":"2023-10-06T03:00:51.905956+0000","last_unstale":"2023-10-06T03:01:46.926251+0000","last_undegraded":"2023-10-06T03:01:46.926251+0000","last_fullsized":"2023-10-06T03:01:46.926251+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:15:19.182956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":8,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.970964+0000","last_change":"2023-10-06T03:01:47.970964+0000","last_active":"2023-10-06T03:01:47.970964+0000","last_peered":"2023-10-06T03:01:47.970964+0000","last_clean":"2023-10-06T03:01:47.970964+0000","last_became_active":"2023-10-06T03:01:47.970304+0000","last_became_peered":"2023-10-06T03:01:47.970304+0000","last_unstale":"2023-10-06T03:01:47.970964+0000","last_undegraded":"2023-10-06T03:01:47.970964+0000","last_fullsized":"2023-10-06T03:01:47.970964+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:46:44.569591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"35'1","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T03:01:49.099542+0000","last_change":"2023-10-06T03:01:46.942610+0000","last_active":"2023-10-06T03:01:49.099542+0000","last_peered":"2023-10-06T03:01:49.099542+0000","last_clean":"2023-10-06T03:01:49.099542+0000","last_became_active":"2023-10-06T03:01:46.942009+0000","last_became_peered":"2023-10-06T03:01:46.942009+0000","last_unstale":"2023-10-06T03:01:49.099542+0000","last_undegraded":"2023-10-06T03:01:49.099542+0000","last_fullsized":"2023-10-06T03:01:49.099542+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_clean_scrub_stamp":"2023-10-06T03:01:45.882537+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:30:13.839941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.959153+0000","last_change":"2023-10-06T03:00:51.902453+0000","last_active":"2023-10-06T03:01:47.959153+0000","last_peered":"2023-10-06T03:01:47.959153+0000","last_clean":"2023-10-06T03:01:47.959153+0000","last_became_active":"2023-10-06T03:00:51.901948+0000","last_became_peered":"2023-10-06T03:00:51.901948+0000","last_unstale":"2023-10-06T03:01:47.959153+0000","last_undegraded":"2023-10-06T03:01:47.959153+0000","last_fullsized":"2023-10-06T03:01:47.959153+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:13:30.721650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":8,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.955015+0000","last_change":"2023-10-06T03:01:47.955015+0000","last_active":"2023-10-06T03:01:47.955015+0000","last_peered":"2023-10-06T03:01:47.955015+0000","last_clean":"2023-10-06T03:01:47.955015+0000","last_became_active":"2023-10-06T03:01:47.954738+0000","last_became_peered":"2023-10-06T03:01:47.954738+0000","last_unstale":"2023-10-06T03:01:47.955015+0000","last_undegraded":"2023-10-06T03:01:47.955015+0000","last_fullsized":"2023-10-06T03:01:47.955015+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:10:10.643033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T03:01:46.944663+0000","last_change":"2023-10-06T03:01:46.935405+0000","last_active":"2023-10-06T03:01:46.944663+0000","last_peered":"2023-10-06T03:01:46.944663+0000","last_clean":"2023-10-06T03:01:46.944663+0000","last_became_active":"2023-10-06T03:01:46.935069+0000","last_became_peered":"2023-10-06T03:01:46.935069+0000","last_unstale":"2023-10-06T03:01:46.944663+0000","last_undegraded":"2023-10-06T03:01:46.944663+0000","last_fullsized":"2023-10-06T03:01:46.944663+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_clean_scrub_stamp":"2023-10-06T03:01:45.882537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:27:48.405448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.953164+0000","last_change":"2023-10-06T03:00:51.904148+0000","last_active":"2023-10-06T03:01:47.953164+0000","last_peered":"2023-10-06T03:01:47.953164+0000","last_clean":"2023-10-06T03:01:47.953164+0000","last_became_active":"2023-10-06T03:00:51.903729+0000","last_became_peered":"2023-10-06T03:00:51.903729+0000","last_unstale":"2023-10-06T03:01:47.953164+0000","last_undegraded":"2023-10-06T03:01:47.953164+0000","last_fullsized":"2023-10-06T03:01:47.953164+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:17:25.070478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":8,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.960275+0000","last_change":"2023-10-06T03:01:47.960275+0000","last_active":"2023-10-06T03:01:47.960275+0000","last_peered":"2023-10-06T03:01:47.960275+0000","last_clean":"2023-10-06T03:01:47.960275+0000","last_became_active":"2023-10-06T03:01:47.959968+0000","last_became_peered":"2023-10-06T03:01:47.959968+0000","last_unstale":"2023-10-06T03:01:47.960275+0000","last_undegraded":"2023-10-06T03:01:47.960275+0000","last_fullsized":"2023-10-06T03:01:47.960275+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:57:40.860316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T03:01:46.944868+0000","last_change":"2023-10-06T03:01:46.936762+0000","last_active":"2023-10-06T03:01:46.944868+0000","last_peered":"2023-10-06T03:01:46.944868+0000","last_clean":"2023-10-06T03:01:46.944868+0000","last_became_active":"2023-10-06T03:01:46.936494+0000","last_became_peered":"2023-10-06T03:01:46.936494+0000","last_unstale":"2023-10-06T03:01:46.944868+0000","last_undegraded":"2023-10-06T03:01:46.944868+0000","last_fullsized":"2023-10-06T03:01:46.944868+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_clean_scrub_stamp":"2023-10-06T03:01:45.882537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:55:30.669723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.953229+0000","last_change":"2023-10-06T03:00:52.484317+0000","last_active":"2023-10-06T03:01:47.953229+0000","last_peered":"2023-10-06T03:01:47.953229+0000","last_clean":"2023-10-06T03:01:47.953229+0000","last_became_active":"2023-10-06T03:00:52.483818+0000","last_became_peered":"2023-10-06T03:00:52.483818+0000","last_unstale":"2023-10-06T03:01:47.953229+0000","last_undegraded":"2023-10-06T03:01:47.953229+0000","last_fullsized":"2023-10-06T03:01:47.953229+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:17:24.136459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.971057+0000","last_change":"2023-10-06T03:01:47.965731+0000","last_active":"2023-10-06T03:01:47.971057+0000","last_peered":"2023-10-06T03:01:47.971057+0000","last_clean":"2023-10-06T03:01:47.971057+0000","last_became_active":"2023-10-06T03:01:47.965379+0000","last_became_peered":"2023-10-06T03:01:47.965379+0000","last_unstale":"2023-10-06T03:01:47.971057+0000","last_undegraded":"2023-10-06T03:01:47.971057+0000","last_fullsized":"2023-10-06T03:01:47.971057+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:16:01.218185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T03:01:46.943867+0000","last_change":"2023-10-06T03:01:46.941420+0000","last_active":"2023-10-06T03:01:46.943867+0000","last_peered":"2023-10-06T03:01:46.943867+0000","last_clean":"2023-10-06T03:01:46.943867+0000","last_became_active":"2023-10-06T03:01:46.941108+0000","last_became_peered":"2023-10-06T03:01:46.941108+0000","last_unstale":"2023-10-06T03:01:46.943867+0000","last_undegraded":"2023-10-06T03:01:46.943867+0000","last_fullsized":"2023-10-06T03:01:46.943867+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_clean_scrub_stamp":"2023-10-06T03:01:45.882537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:27:13.402698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T03:01:46.933168+0000","last_change":"2023-10-06T03:00:52.485186+0000","last_active":"2023-10-06T03:01:46.933168+0000","last_peered":"2023-10-06T03:01:46.933168+0000","last_clean":"2023-10-06T03:01:46.933168+0000","last_became_active":"2023-10-06T03:00:52.484615+0000","last_became_peered":"2023-10-06T03:00:52.484615+0000","last_unstale":"2023-10-06T03:01:46.933168+0000","last_undegraded":"2023-10-06T03:01:46.933168+0000","last_fullsized":"2023-10-06T03:01:46.933168+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:17:25.070478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.968789+0000","last_change":"2023-10-06T03:01:47.961847+0000","last_active":"2023-10-06T03:01:47.968789+0000","last_peered":"2023-10-06T03:01:47.968789+0000","last_clean":"2023-10-06T03:01:47.968789+0000","last_became_active":"2023-10-06T03:01:47.961540+0000","last_became_peered":"2023-10-06T03:01:47.961540+0000","last_unstale":"2023-10-06T03:01:47.968789+0000","last_undegraded":"2023-10-06T03:01:47.968789+0000","last_fullsized":"2023-10-06T03:01:47.968789+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:27:14.787514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.949236+0000","last_change":"2023-10-06T03:01:46.933507+0000","last_active":"2023-10-06T03:01:47.949236+0000","last_peered":"2023-10-06T03:01:47.949236+0000","last_clean":"2023-10-06T03:01:47.949236+0000","last_became_active":"2023-10-06T03:01:46.933232+0000","last_became_peered":"2023-10-06T03:01:46.933232+0000","last_unstale":"2023-10-06T03:01:47.949236+0000","last_undegraded":"2023-10-06T03:01:47.949236+0000","last_fullsized":"2023-10-06T03:01:47.949236+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_clean_scrub_stamp":"2023-10-06T03:01:45.882537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:53:15.680889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.952644+0000","last_change":"2023-10-06T03:00:51.903388+0000","last_active":"2023-10-06T03:01:47.952644+0000","last_peered":"2023-10-06T03:01:47.952644+0000","last_clean":"2023-10-06T03:01:47.952644+0000","last_became_active":"2023-10-06T03:00:51.902959+0000","last_became_peered":"2023-10-06T03:00:51.902959+0000","last_unstale":"2023-10-06T03:01:47.952644+0000","last_undegraded":"2023-10-06T03:01:47.952644+0000","last_fullsized":"2023-10-06T03:01:47.952644+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:30:16.907470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":8,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.951700+0000","last_change":"2023-10-06T03:01:47.951700+0000","last_active":"2023-10-06T03:01:47.951700+0000","last_peered":"2023-10-06T03:01:47.951700+0000","last_clean":"2023-10-06T03:01:47.951700+0000","last_became_active":"2023-10-06T03:01:47.951399+0000","last_became_peered":"2023-10-06T03:01:47.951399+0000","last_unstale":"2023-10-06T03:01:47.951700+0000","last_undegraded":"2023-10-06T03:01:47.951700+0000","last_fullsized":"2023-10-06T03:01:47.951700+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:44:46.075266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T03:01:46.941266+0000","last_change":"2023-10-06T03:01:46.935965+0000","last_active":"2023-10-06T03:01:46.941266+0000","last_peered":"2023-10-06T03:01:46.941266+0000","last_clean":"2023-10-06T03:01:46.941266+0000","last_became_active":"2023-10-06T03:01:46.935664+0000","last_became_peered":"2023-10-06T03:01:46.935664+0000","last_unstale":"2023-10-06T03:01:46.941266+0000","last_undegraded":"2023-10-06T03:01:46.941266+0000","last_fullsized":"2023-10-06T03:01:46.941266+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_clean_scrub_stamp":"2023-10-06T03:01:45.882537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:17:03.797659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T03:01:46.932602+0000","last_change":"2023-10-06T03:00:51.903242+0000","last_active":"2023-10-06T03:01:46.932602+0000","last_peered":"2023-10-06T03:01:46.932602+0000","last_clean":"2023-10-06T03:01:46.932602+0000","last_became_active":"2023-10-06T03:00:51.902929+0000","last_became_peered":"2023-10-06T03:00:51.902929+0000","last_unstale":"2023-10-06T03:01:46.932602+0000","last_undegraded":"2023-10-06T03:01:46.932602+0000","last_fullsized":"2023-10-06T03:01:46.932602+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:34:12.274158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302356,"kb_used_data":972,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069484,"statfs":{"total":96636764160,"available":96327151616,"internally_reserved":0,"allocated":995328,"data_stored":748241,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"min":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":4.7930000000000001,"5min":4.7930000000000001,"15min":4.7930000000000001},"last":0.86699999999999999},{"interface":"front","average":{"1min":1.5780000000000001,"5min":1.5780000000000001,"15min":1.5780000000000001},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":9.9689999999999994,"5min":9.9689999999999994,"15min":9.9689999999999994},"last":1.4159999999999999}]},{"osd":1,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":10.867000000000001,"5min":10.867000000000001,"15min":10.867000000000001},"last":1.1779999999999999},{"interface":"front","average":{"1min":1.6779999999999999,"5min":1.6779999999999999,"15min":1.6779999999999999},"min":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":10.255000000000001,"5min":10.255000000000001,"15min":10.255000000000001},"last":1.1339999999999999}]},{"osd":2,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.6799999999999999,"5min":1.6799999999999999,"15min":1.6799999999999999},"min":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"max":{"1min":7.9939999999999998,"5min":7.9939999999999998,"15min":7.9939999999999998},"last":1.091},{"interface":"front","average":{"1min":1.6970000000000001,"5min":1.6970000000000001,"15min":1.6970000000000001},"min":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"max":{"1min":10.098000000000001,"5min":10.098000000000001,"15min":10.098000000000001},"last":1.288}]},{"osd":3,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"min":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"max":{"1min":4.3090000000000002,"5min":4.3090000000000002,"15min":4.3090000000000002},"last":1.242},{"interface":"front","average":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"min":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":8.3770000000000007,"5min":8.3770000000000007,"15min":8.3770000000000007},"last":1.4670000000000001}]},{"osd":4,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.7889999999999999,"5min":1.7889999999999999,"15min":1.7889999999999999},"min":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"max":{"1min":11.391999999999999,"5min":11.391999999999999,"15min":11.391999999999999},"last":1.27},{"interface":"front","average":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"min":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"max":{"1min":3.9220000000000002,"5min":3.9220000000000002,"15min":3.9220000000000002},"last":1.014}]},{"osd":5,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.796,"5min":1.796,"15min":1.796},"min":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"max":{"1min":11.951000000000001,"5min":11.951000000000001,"15min":11.951000000000001},"last":0.97099999999999997},{"interface":"front","average":{"1min":1.9259999999999999,"5min":1.9259999999999999,"15min":1.9259999999999999},"min":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"max":{"1min":10.994999999999999,"5min":10.994999999999999,"15min":10.994999999999999},"last":1.0580000000000001}]},{"osd":6,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.9890000000000001,"5min":1.9890000000000001,"15min":1.9890000000000001},"min":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"max":{"1min":11.513,"5min":11.513,"15min":11.513},"last":1.216},{"interface":"front","average":{"1min":1.958,"5min":1.958,"15min":1.958},"min":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"max":{"1min":10.714,"5min":10.714,"15min":10.714},"last":0.93000000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297668,"kb_used_data":380,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074172,"statfs":{"total":96636764160,"available":96331952128,"internally_reserved":0,"allocated":389120,"data_stored":156821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":1.3480000000000001},{"interface":"front","average":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":2.1419999999999999,"5min":2.1419999999999999,"15min":2.1419999999999999},"last":1.0700000000000001}]},{"osd":1,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"min":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"max":{"1min":1.9159999999999999,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":1.2310000000000001},{"interface":"front","average":{"1min":1.256,"5min":1.256,"15min":1.256},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":1.677,"5min":1.677,"15min":1.677},"last":1.2529999999999999}]},{"osd":2,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.167,"15min":1.167},"min":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":1.659,"5min":1.659,"15min":1.659},"last":0.86599999999999999},{"interface":"front","average":{"1min":1.236,"5min":1.236,"15min":1.236},"min":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"max":{"1min":1.78,"5min":1.78,"15min":1.78},"last":1.111}]},{"osd":3,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.284,"5min":1.284,"15min":1.284},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":1.1830000000000001},{"interface":"front","average":{"1min":1.343,"5min":1.343,"15min":1.343},"min":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":2.2200000000000002,"5min":2.2200000000000002,"15min":2.2200000000000002},"last":1.2909999999999999}]},{"osd":4,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.286,"5min":1.286,"15min":1.286},"min":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"max":{"1min":1.889,"5min":1.889,"15min":1.889},"last":1.0289999999999999},{"interface":"front","average":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"min":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":2.2610000000000001,"5min":2.2610000000000001,"15min":2.2610000000000001},"last":1.1970000000000001}]},{"osd":5,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"min":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"max":{"1min":1.994,"5min":1.994,"15min":1.994},"last":0.97499999999999998},{"interface":"front","average":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"min":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"max":{"1min":2.0129999999999999,"5min":2.0129999999999999,"15min":2.0129999999999999},"last":1.145}]},{"osd":7,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"min":{"1min":1.016,"5min":1.016,"15min":1.016},"max":{"1min":2.0920000000000001,"5min":2.0920000000000001,"15min":2.0920000000000001},"last":1.387},{"interface":"front","average":{"1min":1.5469999999999999,"5min":1.5469999999999999,"15min":1.5469999999999999},"min":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"max":{"1min":2.0310000000000001,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":1.3220000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297684,"kb_used_data":396,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074156,"statfs":{"total":96636764160,"available":96331935744,"internally_reserved":0,"allocated":405504,"data_stored":163020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":0.85499999999999998},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.5,"5min":1.5,"15min":1.5},"last":0.81999999999999995}]},{"osd":1,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"min":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":1.984,"5min":1.984,"15min":1.984},"last":1.095},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.708,"5min":1.708,"15min":1.708},"last":1.157}]},{"osd":2,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.395,"5min":1.395,"15min":1.395},"min":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"max":{"1min":1.78,"5min":1.78,"15min":1.78},"last":1.262},{"interface":"front","average":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"min":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":2.8319999999999999,"5min":2.8319999999999999,"15min":2.8319999999999999},"last":1.0680000000000001}]},{"osd":3,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"min":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":3.1789999999999998,"5min":3.1789999999999998,"15min":3.1789999999999998},"last":1.0129999999999999},{"interface":"front","average":{"1min":1.272,"5min":1.272,"15min":1.272},"min":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"max":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":1.379}]},{"osd":4,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":1.302,"15min":1.302},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":2.5899999999999999,"5min":2.5899999999999999,"15min":2.5899999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":1.516,"5min":1.516,"15min":1.516},"min":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"max":{"1min":4.5419999999999998,"5min":4.5419999999999998,"15min":4.5419999999999998},"last":0.91900000000000004}]},{"osd":6,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.847,"5min":1.847,"15min":1.847},"last":1.327},{"interface":"front","average":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"min":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":2.9239999999999999,"5min":2.9239999999999999,"15min":2.9239999999999999},"last":0.97299999999999998}]},{"osd":7,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":4.4489999999999998,"5min":4.4489999999999998,"15min":4.4489999999999998},"last":1.208},{"interface":"front","average":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"min":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"max":{"1min":1.98,"5min":1.98,"15min":1.98},"last":1.4299999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297672,"kb_used_data":384,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074168,"statfs":{"total":96636764160,"available":96331948032,"internally_reserved":0,"allocated":393216,"data_stored":156843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.6040000000000001,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":0.98499999999999999},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.585,"5min":1.585,"15min":1.585},"last":0.81999999999999995}]},{"osd":1,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.403,"5min":1.403,"15min":1.403},"last":1.3799999999999999},{"interface":"front","average":{"1min":1.169,"5min":1.169,"15min":1.169},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.73,"5min":1.73,"15min":1.73},"last":1.1140000000000001}]},{"osd":2,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.696,"5min":1.696,"15min":1.696},"last":1.425},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":1.788,"5min":1.788,"15min":1.788},"last":1.2809999999999999}]},{"osd":3,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.248,"15min":1.248},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.625,"5min":1.625,"15min":1.625},"last":0.94499999999999995},{"interface":"front","average":{"1min":1.232,"5min":1.232,"15min":1.232},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.7629999999999999,"5min":1.7629999999999999,"15min":1.7629999999999999},"last":1.3129999999999999}]},{"osd":5,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.198,"5min":1.198,"15min":1.198},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.71,"5min":1.71,"15min":1.71},"last":1.23},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.7889999999999999,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":1.03}]},{"osd":6,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":2.9100000000000001,"5min":2.9100000000000001,"15min":2.9100000000000001},"last":1.5209999999999999},{"interface":"front","average":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":3.282,"5min":3.282,"15min":3.282},"last":1.1719999999999999}]},{"osd":7,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.544,"5min":1.544,"15min":1.544},"min":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"max":{"1min":2.145,"5min":2.145,"15min":2.145},"last":1.1359999999999999},{"interface":"front","average":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"min":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.927,"5min":1.927,"15min":1.927},"last":1.474}]}]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301776,"kb_used_data":392,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070064,"statfs":{"total":96636764160,"available":96327745536,"internally_reserved":0,"allocated":401408,"data_stored":157837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:01:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":2.298,"5min":2.298,"15min":2.298},"last":1.282},{"interface":"front","average":{"1min":0.998,"5min":0.998,"15min":0.998},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":2.1850000000000001,"5min":2.1850000000000001,"15min":2.1850000000000001},"last":1.024}]},{"osd":1,"last update":"Fri Oct 6 03:01:46 2023","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.974,"5min":1.974,"15min":1.974},"last":0.66300000000000003},{"interface":"front","average":{"1min":1.137,"5min":1.137,"15min":1.137},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.71,"5min":1.71,"15min":1.71},"last":1.1719999999999999}]},{"osd":2,"last update":"Fri Oct 6 03:01:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":2.8849999999999998,"5min":2.8849999999999998,"15min":2.8849999999999998},"last":0.58199999999999996},{"interface":"front","average":{"1min":1.095,"5min":1.095,"15min":1.095},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":2.8220000000000001,"5min":2.8220000000000001,"15min":2.8220000000000001},"last":0.93500000000000005}]},{"osd":4,"last update":"Fri Oct 6 03:01:46 2023","interfaces":[{"interface":"back","average":{"1min":1.456,"5min":1.456,"15min":1.456},"min":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"max":{"1min":3.6560000000000001,"5min":3.6560000000000001,"15min":3.6560000000000001},"last":0.97499999999999998},{"interface":"front","average":{"1min":1.466,"5min":1.466,"15min":1.466},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":3.7749999999999999,"5min":3.7749999999999999,"15min":3.7749999999999999},"last":0.72899999999999998}]},{"osd":5,"last update":"Fri Oct 6 03:01:46 2023","interfaces":[{"interface":"back","average":{"1min":1.534,"5min":1.534,"15min":1.534},"min":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"max":{"1min":3.4910000000000001,"5min":3.4910000000000001,"15min":3.4910000000000001},"last":0.88500000000000001},{"interface":"front","average":{"1min":1.494,"5min":1.494,"15min":1.494},"min":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"max":{"1min":2.6240000000000001,"5min":2.6240000000000001,"15min":2.6240000000000001},"last":1.3500000000000001}]},{"osd":6,"last update":"Fri Oct 6 03:01:46 2023","interfaces":[{"interface":"back","average":{"1min":1.5780000000000001,"5min":1.5780000000000001,"15min":1.5780000000000001},"min":{"1min":1.046,"5min":1.046,"15min":1.046},"max":{"1min":3.7050000000000001,"5min":3.7050000000000001,"15min":3.7050000000000001},"last":1.046},{"interface":"front","average":{"1min":1.583,"5min":1.583,"15min":1.583},"min":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"max":{"1min":3.9300000000000002,"5min":3.9300000000000002,"15min":3.9300000000000002},"last":1.151}]},{"osd":7,"last update":"Fri Oct 6 03:01:46 2023","interfaces":[{"interface":"back","average":{"1min":1.635,"5min":1.635,"15min":1.635},"min":{"1min":1.149,"5min":1.149,"15min":1.149},"max":{"1min":2.96,"5min":2.96,"15min":2.96},"last":1.409},{"interface":"front","average":{"1min":1.7729999999999999,"5min":1.7729999999999999,"15min":1.7729999999999999},"min":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"max":{"1min":3.8559999999999999,"5min":3.8559999999999999,"15min":3.8559999999999999},"last":1.2170000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301764,"kb_used_data":380,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070076,"statfs":{"total":96636764160,"available":96327757824,"internally_reserved":0,"allocated":389120,"data_stored":156337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.6950000000000001,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":0.98099999999999998}]},{"osd":1,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.5449999999999999,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":0.88700000000000001},{"interface":"front","average":{"1min":1.232,"5min":1.232,"15min":1.232},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":2.1800000000000002,"5min":2.1800000000000002,"15min":2.1800000000000002},"last":1.2010000000000001}]},{"osd":3,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.75900000000000001},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":2.806,"5min":2.806,"15min":2.806},"last":0.66200000000000003}]},{"osd":4,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.389,"5min":1.389,"15min":1.389},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":2.1739999999999999,"5min":2.1739999999999999,"15min":2.1739999999999999},"last":1.097},{"interface":"front","average":{"1min":1.458,"5min":1.458,"15min":1.458},"min":{"1min":1,"5min":1,"15min":1},"max":{"1min":3.028,"5min":3.028,"15min":3.028},"last":1.113}]},{"osd":5,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.55,"5min":1.55,"15min":1.55},"min":{"1min":1.036,"5min":1.036,"15min":1.036},"max":{"1min":3.1499999999999999,"5min":3.1499999999999999,"15min":3.1499999999999999},"last":1.292},{"interface":"front","average":{"1min":1.512,"5min":1.512,"15min":1.512},"min":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"max":{"1min":2.8580000000000001,"5min":2.8580000000000001,"15min":2.8580000000000001},"last":0.85899999999999999}]},{"osd":6,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"min":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"max":{"1min":2.6659999999999999,"5min":2.6659999999999999,"15min":2.6659999999999999},"last":1.079},{"interface":"front","average":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"min":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"max":{"1min":2.411,"5min":2.411,"15min":2.411},"last":1.0580000000000001}]},{"osd":7,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"min":{"1min":1.01,"5min":1.01,"15min":1.01},"max":{"1min":3.2160000000000002,"5min":3.2160000000000002,"15min":3.2160000000000002},"last":1.3700000000000001},{"interface":"front","average":{"1min":1.631,"5min":1.631,"15min":1.631},"min":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"max":{"1min":3.1059999999999999,"5min":3.1059999999999999,"15min":3.1059999999999999},"last":1.0349999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301764,"kb_used_data":380,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070076,"statfs":{"total":96636764160,"available":96327757824,"internally_reserved":0,"allocated":389120,"data_stored":156357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.7749999999999999,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":0.92000000000000004},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":2.3260000000000001,"5min":2.3260000000000001,"15min":2.3260000000000001},"last":1.0449999999999999}]},{"osd":2,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":3.5459999999999998,"5min":3.5459999999999998,"15min":3.5459999999999998},"last":1.141},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.706,"5min":1.706,"15min":1.706},"last":0.87}]},{"osd":3,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.625,"5min":1.625,"15min":1.625},"last":1.109},{"interface":"front","average":{"1min":1.196,"5min":1.196,"15min":1.196},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":3.331,"5min":3.331,"15min":3.331},"last":0.96499999999999997}]},{"osd":4,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.339,"5min":1.339,"15min":1.339},"min":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"max":{"1min":1.8660000000000001,"5min":1.8660000000000001,"15min":1.8660000000000001},"last":1.2370000000000001},{"interface":"front","average":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":3.2250000000000001,"5min":3.2250000000000001,"15min":3.2250000000000001},"last":2.0099999999999998}]},{"osd":5,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"min":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"max":{"1min":2.8439999999999999,"5min":2.8439999999999999,"15min":2.8439999999999999},"last":1.819},{"interface":"front","average":{"1min":1.484,"5min":1.484,"15min":1.484},"min":{"1min":1.01,"5min":1.01,"15min":1.01},"max":{"1min":2.4590000000000001,"5min":2.4590000000000001,"15min":2.4590000000000001},"last":1.542}]},{"osd":6,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"min":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"max":{"1min":2.96,"5min":2.96,"15min":2.96},"last":2.1160000000000001},{"interface":"front","average":{"1min":1.504,"5min":1.504,"15min":1.504},"min":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"max":{"1min":2.5859999999999999,"5min":2.5859999999999999,"15min":2.5859999999999999},"last":1.474}]},{"osd":7,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.6040000000000001,"5min":1.6040000000000001,"15min":1.6040000000000001},"min":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"max":{"1min":3.4460000000000002,"5min":3.4460000000000002,"15min":3.4460000000000002},"last":1.5660000000000001},{"interface":"front","average":{"1min":1.538,"5min":1.538,"15min":1.538},"min":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"max":{"1min":3.113,"5min":3.113,"15min":3.113},"last":2.214}]}]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302344,"kb_used_data":960,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069496,"statfs":{"total":96636764160,"available":96327163904,"internally_reserved":0,"allocated":983040,"data_stored":746669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.381,"5min":1.381,"15min":1.381},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.999,"5min":0.999,"15min":0.999},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.92200000000000004}]},{"osd":2,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.96499999999999997},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.794,"5min":1.794,"15min":1.794},"last":0.73799999999999999}]},{"osd":3,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.532,"5min":1.532,"15min":1.532},"last":0.89000000000000001},{"interface":"front","average":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.613,"5min":1.613,"15min":1.613},"last":0.77000000000000002}]},{"osd":4,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"min":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"max":{"1min":2.0680000000000001,"5min":2.0680000000000001,"15min":2.0680000000000001},"last":1.3460000000000001},{"interface":"front","average":{"1min":1.339,"5min":1.339,"15min":1.339},"min":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"max":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":1.325}]},{"osd":5,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"min":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"max":{"1min":1.893,"5min":1.893,"15min":1.893},"last":1.3999999999999999},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"min":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":2.2080000000000002,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":1.2310000000000001}]},{"osd":6,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.421,"5min":1.421,"15min":1.421},"min":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"max":{"1min":1.96,"5min":1.96,"15min":1.96},"last":1.177},{"interface":"front","average":{"1min":1.552,"5min":1.552,"15min":1.552},"min":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"max":{"1min":1.9910000000000001,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":1.29}]},{"osd":7,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.6319999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"min":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"max":{"1min":2.1019999999999999,"5min":2.1019999999999999,"15min":2.1019999999999999},"last":1.516},{"interface":"front","average":{"1min":1.431,"5min":1.431,"15min":1.431},"min":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"max":{"1min":2.1499999999999999,"5min":2.1499999999999999,"15min":2.1499999999999999},"last":1.1140000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:01:52.257 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:01:52.456 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.450+0000 7ff666785700 1 Processor -- start 2023-10-06T03:01:52.456 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.450+0000 7ff666785700 1 -- start start 2023-10-06T03:01:52.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.450+0000 7ff666785700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7ff66006deb0 0x7ff6600675c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:52.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.450+0000 7ff666785700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff66015cee0 0x7ff66015d340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:52.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.450+0000 7ff666785700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff66006da20 con 0x7ff6600671f0 2023-10-06T03:01:52.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.450+0000 7ff666785700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6600b0650 con 0x7ff66015cee0 2023-10-06T03:01:52.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.450+0000 7ff666785700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff66006ce10 con 0x7ff66006deb0 2023-10-06T03:01:52.459 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.454+0000 7ff664d22700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff66015cee0 0x7ff66015d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:52.459 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.454+0000 7ff65ffff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7ff6600671f0 0x7ff6600aff40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:51988/0 (socket says 172.21.15.57:51988) 2023-10-06T03:01:52.459 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.454+0000 7ff65ffff700 1 -- 172.21.15.57:0/3863878749 learned_addr learned my addr 172.21.15.57:0/3863878749 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:01:52.459 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.454+0000 7ff657fff700 1 --2- 172.21.15.57:0/3863878749 >> v2:172.21.15.105:3300/0 conn(0x7ff66006deb0 0x7ff6600675c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:52.460 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.454+0000 7ff664d22700 1 -- 172.21.15.57:0/3863878749 >> v2:172.21.15.105:3300/0 conn(0x7ff66006deb0 msgr2=0x7ff6600675c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:52.460 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.454+0000 7ff664d22700 1 --2- 172.21.15.57:0/3863878749 >> v2:172.21.15.105:3300/0 conn(0x7ff66006deb0 0x7ff6600675c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:52.460 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.454+0000 7ff664d22700 1 -- 172.21.15.57:0/3863878749 >> v1:172.21.15.57:6789/0 conn(0x7ff6600671f0 legacy=0x7ff6600aff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:52.460 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.454+0000 7ff664d22700 1 -- 172.21.15.57:0/3863878749 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff66006d0f0 con 0x7ff66015cee0 2023-10-06T03:01:52.460 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.454+0000 7ff664d22700 1 --2- 172.21.15.57:0/3863878749 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff66015cee0 0x7ff66015d340 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7ff66006e330 tx=0x7ff658009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=471342abe6b09939 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:52.461 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.454+0000 7ff65f7fe700 1 -- 172.21.15.57:0/3863878749 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff65800e070 con 0x7ff66015cee0 2023-10-06T03:01:52.461 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.454+0000 7ff65f7fe700 1 -- 172.21.15.57:0/3863878749 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff65800bb60 con 0x7ff66015cee0 2023-10-06T03:01:52.461 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.454+0000 7ff65f7fe700 1 -- 172.21.15.57:0/3863878749 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff658012430 con 0x7ff66015cee0 2023-10-06T03:01:52.462 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.454+0000 7ff666785700 1 -- 172.21.15.57:0/3863878749 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff66015cee0 msgr2=0x7ff66015d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:52.462 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.454+0000 7ff666785700 1 --2- 172.21.15.57:0/3863878749 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff66015cee0 0x7ff66015d340 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7ff66006e330 tx=0x7ff658009780 comp rx=0 tx=0).stop 2023-10-06T03:01:52.462 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.454+0000 7ff666785700 1 -- 172.21.15.57:0/3863878749 shutdown_connections 2023-10-06T03:01:52.462 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.454+0000 7ff666785700 1 --2- 172.21.15.57:0/3863878749 >> v2:172.21.15.105:3300/0 conn(0x7ff66006deb0 0x7ff6600675c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:52.462 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.454+0000 7ff666785700 1 --2- 172.21.15.57:0/3863878749 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff66015cee0 0x7ff66015d340 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:52.462 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.454+0000 7ff666785700 1 -- 172.21.15.57:0/3863878749 >> 172.21.15.57:0/3863878749 conn(0x7ff6600cbdd0 msgr2=0x7ff6600cc1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:52.462 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.454+0000 7ff666785700 1 -- 172.21.15.57:0/3863878749 shutdown_connections 2023-10-06T03:01:52.462 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.454+0000 7ff666785700 1 -- 172.21.15.57:0/3863878749 wait complete. 2023-10-06T03:01:52.464 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.458+0000 7ff666785700 1 Processor -- start 2023-10-06T03:01:52.464 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.458+0000 7ff666785700 1 -- start start 2023-10-06T03:01:52.465 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.458+0000 7ff666785700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff6600671f0 0x7ff660162310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:52.465 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.458+0000 7ff666785700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff66006deb0 0x7ff66013ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:52.465 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.458+0000 7ff666785700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff66015cee0 0x7ff66015b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:52.465 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.458+0000 7ff666785700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff660163220 con 0x7ff66015cee0 2023-10-06T03:01:52.466 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.458+0000 7ff666785700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff660163a60 con 0x7ff6600671f0 2023-10-06T03:01:52.466 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.458+0000 7ff666785700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff660162980 con 0x7ff66006deb0 2023-10-06T03:01:52.466 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.458+0000 7ff664d22700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff66015cee0 0x7ff66015b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:52.466 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.458+0000 7ff65ffff700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff6600671f0 0x7ff660162310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:52.467 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.458+0000 7ff664d22700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff66015cee0 0x7ff66015b640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58954/0 (socket says 172.21.15.57:58954) 2023-10-06T03:01:52.467 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.458+0000 7ff664d22700 1 -- 172.21.15.57:0/3424633544 learned_addr learned my addr 172.21.15.57:0/3424633544 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:52.467 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.458+0000 7ff657fff700 1 --2- 172.21.15.57:0/3424633544 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff66006deb0 0x7ff66013ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:52.467 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.462+0000 7ff664d22700 1 -- 172.21.15.57:0/3424633544 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff66006deb0 msgr2=0x7ff66013ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:52.467 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.462+0000 7ff664d22700 1 --2- 172.21.15.57:0/3424633544 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff66006deb0 0x7ff66013ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:52.467 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.462+0000 7ff664d22700 1 -- 172.21.15.57:0/3424633544 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff6600671f0 msgr2=0x7ff660162310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:52.468 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.462+0000 7ff664d22700 1 --2- 172.21.15.57:0/3424633544 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff6600671f0 0x7ff660162310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:52.468 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.462+0000 7ff664d22700 1 -- 172.21.15.57:0/3424633544 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff658009a20 con 0x7ff66015cee0 2023-10-06T03:01:52.468 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.462+0000 7ff664d22700 1 --2- 172.21.15.57:0/3424633544 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff66015cee0 0x7ff66015b640 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7ff6600ccab0 tx=0x7ff658019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:52.468 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.462+0000 7ff65cff9700 1 -- 172.21.15.57:0/3424633544 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff658027470 con 0x7ff66015cee0 2023-10-06T03:01:52.468 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.462+0000 7ff65cff9700 1 -- 172.21.15.57:0/3424633544 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6580275f0 con 0x7ff66015cee0 2023-10-06T03:01:52.469 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.462+0000 7ff65cff9700 1 -- 172.21.15.57:0/3424633544 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6580279b0 con 0x7ff66015cee0 2023-10-06T03:01:52.469 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.462+0000 7ff666785700 1 -- 172.21.15.57:0/3424633544 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff660162c60 con 0x7ff66015cee0 2023-10-06T03:01:52.469 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.462+0000 7ff666785700 1 -- 172.21.15.57:0/3424633544 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff660150e00 con 0x7ff66015cee0 2023-10-06T03:01:52.469 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.462+0000 7ff666785700 1 -- 172.21.15.57:0/3424633544 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff660163bf0 con 0x7ff66015cee0 2023-10-06T03:01:52.471 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.466+0000 7ff65cff9700 1 -- 172.21.15.57:0/3424633544 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7ff658024070 con 0x7ff66015cee0 2023-10-06T03:01:52.472 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.466+0000 7ff65cff9700 1 --2- 172.21.15.57:0/3424633544 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7ff640060550 0x7ff640062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:52.472 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.466+0000 7ff65cff9700 1 -- 172.21.15.57:0/3424633544 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff65807f220 con 0x7ff66015cee0 2023-10-06T03:01:52.473 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.466+0000 7ff65ffff700 1 --2- 172.21.15.57:0/3424633544 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7ff640060550 0x7ff640062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:52.474 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.466+0000 7ff65ffff700 1 --2- 172.21.15.57:0/3424633544 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7ff640060550 0x7ff640062a00 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ff650007130 tx=0x7ff650007eb0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:52.478 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.474+0000 7ff65cff9700 1 -- 172.21.15.57:0/3424633544 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7ff65804f610 con 0x7ff66015cee0 2023-10-06T03:01:52.647 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.642+0000 7ff666785700 1 -- 172.21.15.57:0/3424633544 --> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff6600712e0 con 0x7ff640060550 2023-10-06T03:01:52.663 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.658+0000 7ff65cff9700 1 -- 172.21.15.57:0/3424633544 <== mgr.4103 v2:172.21.15.57:6832/32947 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+308706 (secure 0 0 0) 0x7ff6600712e0 con 0x7ff640060550 2023-10-06T03:01:52.668 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:01:52.670 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.662+0000 7ff666785700 1 -- 172.21.15.57:0/3424633544 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7ff640060550 msgr2=0x7ff640062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:52.670 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.662+0000 7ff666785700 1 --2- 172.21.15.57:0/3424633544 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7ff640060550 0x7ff640062a00 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ff650007130 tx=0x7ff650007eb0 comp rx=0 tx=0).stop 2023-10-06T03:01:52.671 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.662+0000 7ff666785700 1 -- 172.21.15.57:0/3424633544 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff66015cee0 msgr2=0x7ff66015b640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:52.671 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.662+0000 7ff666785700 1 --2- 172.21.15.57:0/3424633544 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff66015cee0 0x7ff66015b640 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7ff6600ccab0 tx=0x7ff658019000 comp rx=0 tx=0).stop 2023-10-06T03:01:52.671 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.662+0000 7ff666785700 1 -- 172.21.15.57:0/3424633544 shutdown_connections 2023-10-06T03:01:52.671 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.662+0000 7ff666785700 1 --2- 172.21.15.57:0/3424633544 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff66015cee0 0x7ff66015b640 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:52.671 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.662+0000 7ff666785700 1 --2- 172.21.15.57:0/3424633544 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7ff640060550 0x7ff640062a00 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:52.671 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.662+0000 7ff666785700 1 --2- 172.21.15.57:0/3424633544 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff66006deb0 0x7ff66013ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:52.671 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.662+0000 7ff666785700 1 --2- 172.21.15.57:0/3424633544 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff6600671f0 0x7ff660162310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:52.671 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.662+0000 7ff666785700 1 -- 172.21.15.57:0/3424633544 >> 172.21.15.57:0/3424633544 conn(0x7ff6600cbdd0 msgr2=0x7ff6601595e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:52.671 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.662+0000 7ff666785700 1 -- 172.21.15.57:0/3424633544 shutdown_connections 2023-10-06T03:01:52.671 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.662+0000 7ff666785700 1 -- 172.21.15.57:0/3424633544 wait complete. 2023-10-06T03:01:52.673 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2023-10-06T03:01:52.692 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":62,"stamp":"2023-10-06T03:01:52.289819+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":117,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2403028,"kb_used_data":4244,"kb_used_omap":0,"kb_used_meta":2398720,"kb_avail":752571692,"statfs":{"total":773094113280,"available":770633412608,"internally_reserved":0,"allocated":4345856,"data_stored":2442125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2456289280},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":55,"apply_latency_ms":55,"commit_latency_ns":55000000,"apply_latency_ns":55000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001751"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":8,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.966837+0000","last_change":"2023-10-06T03:01:47.966837+0000","last_active":"2023-10-06T03:01:47.966837+0000","last_peered":"2023-10-06T03:01:47.966837+0000","last_clean":"2023-10-06T03:01:47.966837+0000","last_became_active":"2023-10-06T03:01:47.966443+0000","last_became_peered":"2023-10-06T03:01:47.966443+0000","last_unstale":"2023-10-06T03:01:47.966837+0000","last_undegraded":"2023-10-06T03:01:47.966837+0000","last_fullsized":"2023-10-06T03:01:47.966837+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:02:16.580758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":8,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.972092+0000","last_change":"2023-10-06T03:01:47.972092+0000","last_active":"2023-10-06T03:01:47.972092+0000","last_peered":"2023-10-06T03:01:47.972092+0000","last_clean":"2023-10-06T03:01:47.972092+0000","last_became_active":"2023-10-06T03:01:47.971585+0000","last_became_peered":"2023-10-06T03:01:47.971585+0000","last_unstale":"2023-10-06T03:01:47.972092+0000","last_undegraded":"2023-10-06T03:01:47.972092+0000","last_fullsized":"2023-10-06T03:01:47.972092+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:31:10.509111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":8,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.980114+0000","last_change":"2023-10-06T03:01:47.980114+0000","last_active":"2023-10-06T03:01:47.980114+0000","last_peered":"2023-10-06T03:01:47.980114+0000","last_clean":"2023-10-06T03:01:47.980114+0000","last_became_active":"2023-10-06T03:01:47.979801+0000","last_became_peered":"2023-10-06T03:01:47.979801+0000","last_unstale":"2023-10-06T03:01:47.980114+0000","last_undegraded":"2023-10-06T03:01:47.980114+0000","last_fullsized":"2023-10-06T03:01:47.980114+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:46:44.569591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.975063+0000","last_change":"2023-10-06T03:01:47.962972+0000","last_active":"2023-10-06T03:01:47.975063+0000","last_peered":"2023-10-06T03:01:47.975063+0000","last_clean":"2023-10-06T03:01:47.975063+0000","last_became_active":"2023-10-06T03:01:47.962541+0000","last_became_peered":"2023-10-06T03:01:47.962541+0000","last_unstale":"2023-10-06T03:01:47.975063+0000","last_undegraded":"2023-10-06T03:01:47.975063+0000","last_fullsized":"2023-10-06T03:01:47.975063+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:17:04.814930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.983133+0000","last_change":"2023-10-06T03:01:47.969888+0000","last_active":"2023-10-06T03:01:47.983133+0000","last_peered":"2023-10-06T03:01:47.983133+0000","last_clean":"2023-10-06T03:01:47.983133+0000","last_became_active":"2023-10-06T03:01:47.969393+0000","last_became_peered":"2023-10-06T03:01:47.969393+0000","last_unstale":"2023-10-06T03:01:47.983133+0000","last_undegraded":"2023-10-06T03:01:47.983133+0000","last_fullsized":"2023-10-06T03:01:47.983133+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:10:24.119762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.964854+0000","last_change":"2023-10-06T03:01:47.960785+0000","last_active":"2023-10-06T03:01:47.964854+0000","last_peered":"2023-10-06T03:01:47.964854+0000","last_clean":"2023-10-06T03:01:47.964854+0000","last_became_active":"2023-10-06T03:01:47.960528+0000","last_became_peered":"2023-10-06T03:01:47.960528+0000","last_unstale":"2023-10-06T03:01:47.964854+0000","last_undegraded":"2023-10-06T03:01:47.964854+0000","last_fullsized":"2023-10-06T03:01:47.964854+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:52:27.736299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.984708+0000","last_change":"2023-10-06T03:01:47.976648+0000","last_active":"2023-10-06T03:01:47.984708+0000","last_peered":"2023-10-06T03:01:47.984708+0000","last_clean":"2023-10-06T03:01:47.984708+0000","last_became_active":"2023-10-06T03:01:47.974061+0000","last_became_peered":"2023-10-06T03:01:47.974061+0000","last_unstale":"2023-10-06T03:01:47.984708+0000","last_undegraded":"2023-10-06T03:01:47.984708+0000","last_fullsized":"2023-10-06T03:01:47.984708+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:05:12.992756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":8,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.977189+0000","last_change":"2023-10-06T03:01:47.977189+0000","last_active":"2023-10-06T03:01:47.977189+0000","last_peered":"2023-10-06T03:01:47.977189+0000","last_clean":"2023-10-06T03:01:47.977189+0000","last_became_active":"2023-10-06T03:01:47.976902+0000","last_became_peered":"2023-10-06T03:01:47.976902+0000","last_unstale":"2023-10-06T03:01:47.977189+0000","last_undegraded":"2023-10-06T03:01:47.977189+0000","last_fullsized":"2023-10-06T03:01:47.977189+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:05:12.992756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":8,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.976540+0000","last_change":"2023-10-06T03:01:47.976540+0000","last_active":"2023-10-06T03:01:47.976540+0000","last_peered":"2023-10-06T03:01:47.976540+0000","last_clean":"2023-10-06T03:01:47.976540+0000","last_became_active":"2023-10-06T03:01:47.976184+0000","last_became_peered":"2023-10-06T03:01:47.976184+0000","last_unstale":"2023-10-06T03:01:47.976540+0000","last_undegraded":"2023-10-06T03:01:47.976540+0000","last_fullsized":"2023-10-06T03:01:47.976540+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:23:12.179782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.984854+0000","last_change":"2023-10-06T03:01:47.974795+0000","last_active":"2023-10-06T03:01:47.984854+0000","last_peered":"2023-10-06T03:01:47.984854+0000","last_clean":"2023-10-06T03:01:47.984854+0000","last_became_active":"2023-10-06T03:01:47.973901+0000","last_became_peered":"2023-10-06T03:01:47.973901+0000","last_unstale":"2023-10-06T03:01:47.984854+0000","last_undegraded":"2023-10-06T03:01:47.984854+0000","last_fullsized":"2023-10-06T03:01:47.984854+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:45:09.015376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.986155+0000","last_change":"2023-10-06T03:01:47.979896+0000","last_active":"2023-10-06T03:01:47.986155+0000","last_peered":"2023-10-06T03:01:47.986155+0000","last_clean":"2023-10-06T03:01:47.986155+0000","last_became_active":"2023-10-06T03:01:47.977880+0000","last_became_peered":"2023-10-06T03:01:47.977880+0000","last_unstale":"2023-10-06T03:01:47.986155+0000","last_undegraded":"2023-10-06T03:01:47.986155+0000","last_fullsized":"2023-10-06T03:01:47.986155+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:13:59.064942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":8,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.962271+0000","last_change":"2023-10-06T03:01:47.962271+0000","last_active":"2023-10-06T03:01:47.962271+0000","last_peered":"2023-10-06T03:01:47.962271+0000","last_clean":"2023-10-06T03:01:47.962271+0000","last_became_active":"2023-10-06T03:01:47.961502+0000","last_became_peered":"2023-10-06T03:01:47.961502+0000","last_unstale":"2023-10-06T03:01:47.962271+0000","last_undegraded":"2023-10-06T03:01:47.962271+0000","last_fullsized":"2023-10-06T03:01:47.962271+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:02:16.580758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.980475+0000","last_change":"2023-10-06T03:01:47.973462+0000","last_active":"2023-10-06T03:01:47.980475+0000","last_peered":"2023-10-06T03:01:47.980475+0000","last_clean":"2023-10-06T03:01:47.980475+0000","last_became_active":"2023-10-06T03:01:47.973074+0000","last_became_peered":"2023-10-06T03:01:47.973074+0000","last_unstale":"2023-10-06T03:01:47.980475+0000","last_undegraded":"2023-10-06T03:01:47.980475+0000","last_fullsized":"2023-10-06T03:01:47.980475+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:26:08.817720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.969059+0000","last_change":"2023-10-06T03:01:47.962824+0000","last_active":"2023-10-06T03:01:47.969059+0000","last_peered":"2023-10-06T03:01:47.969059+0000","last_clean":"2023-10-06T03:01:47.969059+0000","last_became_active":"2023-10-06T03:01:47.962329+0000","last_became_peered":"2023-10-06T03:01:47.962329+0000","last_unstale":"2023-10-06T03:01:47.969059+0000","last_undegraded":"2023-10-06T03:01:47.969059+0000","last_fullsized":"2023-10-06T03:01:47.969059+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:26:08.817720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.986293+0000","last_change":"2023-10-06T03:01:47.981598+0000","last_active":"2023-10-06T03:01:47.986293+0000","last_peered":"2023-10-06T03:01:47.986293+0000","last_clean":"2023-10-06T03:01:47.986293+0000","last_became_active":"2023-10-06T03:01:47.981409+0000","last_became_peered":"2023-10-06T03:01:47.981409+0000","last_unstale":"2023-10-06T03:01:47.986293+0000","last_undegraded":"2023-10-06T03:01:47.986293+0000","last_fullsized":"2023-10-06T03:01:47.986293+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:30:46.415498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":8,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.982174+0000","last_change":"2023-10-06T03:01:47.982174+0000","last_active":"2023-10-06T03:01:47.982174+0000","last_peered":"2023-10-06T03:01:47.982174+0000","last_clean":"2023-10-06T03:01:47.982174+0000","last_became_active":"2023-10-06T03:01:47.981846+0000","last_became_peered":"2023-10-06T03:01:47.981846+0000","last_unstale":"2023-10-06T03:01:47.982174+0000","last_undegraded":"2023-10-06T03:01:47.982174+0000","last_fullsized":"2023-10-06T03:01:47.982174+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:13:59.064942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":8,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.981105+0000","last_change":"2023-10-06T03:01:47.981105+0000","last_active":"2023-10-06T03:01:47.981105+0000","last_peered":"2023-10-06T03:01:47.981105+0000","last_clean":"2023-10-06T03:01:47.981105+0000","last_became_active":"2023-10-06T03:01:47.975645+0000","last_became_peered":"2023-10-06T03:01:47.975645+0000","last_unstale":"2023-10-06T03:01:47.981105+0000","last_undegraded":"2023-10-06T03:01:47.981105+0000","last_fullsized":"2023-10-06T03:01:47.981105+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:52:27.736299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":8,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.955924+0000","last_change":"2023-10-06T03:01:47.955924+0000","last_active":"2023-10-06T03:01:47.955924+0000","last_peered":"2023-10-06T03:01:47.955924+0000","last_clean":"2023-10-06T03:01:47.955924+0000","last_became_active":"2023-10-06T03:01:47.955612+0000","last_became_peered":"2023-10-06T03:01:47.955612+0000","last_unstale":"2023-10-06T03:01:47.955924+0000","last_undegraded":"2023-10-06T03:01:47.955924+0000","last_fullsized":"2023-10-06T03:01:47.955924+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:01:10.004545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.975663+0000","last_change":"2023-10-06T03:01:47.968406+0000","last_active":"2023-10-06T03:01:47.975663+0000","last_peered":"2023-10-06T03:01:47.975663+0000","last_clean":"2023-10-06T03:01:47.975663+0000","last_became_active":"2023-10-06T03:01:47.968087+0000","last_became_peered":"2023-10-06T03:01:47.968087+0000","last_unstale":"2023-10-06T03:01:47.975663+0000","last_undegraded":"2023-10-06T03:01:47.975663+0000","last_fullsized":"2023-10-06T03:01:47.975663+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:55:31.686994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":8,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.952932+0000","last_change":"2023-10-06T03:01:47.952932+0000","last_active":"2023-10-06T03:01:47.952932+0000","last_peered":"2023-10-06T03:01:47.952932+0000","last_clean":"2023-10-06T03:01:47.952932+0000","last_became_active":"2023-10-06T03:01:47.952509+0000","last_became_peered":"2023-10-06T03:01:47.952509+0000","last_unstale":"2023-10-06T03:01:47.952932+0000","last_undegraded":"2023-10-06T03:01:47.952932+0000","last_fullsized":"2023-10-06T03:01:47.952932+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:18:58.343998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.984792+0000","last_change":"2023-10-06T03:01:47.977714+0000","last_active":"2023-10-06T03:01:47.984792+0000","last_peered":"2023-10-06T03:01:47.984792+0000","last_clean":"2023-10-06T03:01:47.984792+0000","last_became_active":"2023-10-06T03:01:47.977335+0000","last_became_peered":"2023-10-06T03:01:47.977335+0000","last_unstale":"2023-10-06T03:01:47.984792+0000","last_undegraded":"2023-10-06T03:01:47.984792+0000","last_fullsized":"2023-10-06T03:01:47.984792+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:31:10.509111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.977165+0000","last_change":"2023-10-06T03:01:47.972271+0000","last_active":"2023-10-06T03:01:47.977165+0000","last_peered":"2023-10-06T03:01:47.977165+0000","last_clean":"2023-10-06T03:01:47.977165+0000","last_became_active":"2023-10-06T03:01:47.971962+0000","last_became_peered":"2023-10-06T03:01:47.971962+0000","last_unstale":"2023-10-06T03:01:47.977165+0000","last_undegraded":"2023-10-06T03:01:47.977165+0000","last_fullsized":"2023-10-06T03:01:47.977165+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:02:16.580758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":8,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.982574+0000","last_change":"2023-10-06T03:01:47.982574+0000","last_active":"2023-10-06T03:01:47.982574+0000","last_peered":"2023-10-06T03:01:47.982574+0000","last_clean":"2023-10-06T03:01:47.982574+0000","last_became_active":"2023-10-06T03:01:47.982286+0000","last_became_peered":"2023-10-06T03:01:47.982286+0000","last_unstale":"2023-10-06T03:01:47.982574+0000","last_undegraded":"2023-10-06T03:01:47.982574+0000","last_fullsized":"2023-10-06T03:01:47.982574+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:27:14.787514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.983024+0000","last_change":"2023-10-06T03:01:47.970149+0000","last_active":"2023-10-06T03:01:47.983024+0000","last_peered":"2023-10-06T03:01:47.983024+0000","last_clean":"2023-10-06T03:01:47.983024+0000","last_became_active":"2023-10-06T03:01:47.969724+0000","last_became_peered":"2023-10-06T03:01:47.969724+0000","last_unstale":"2023-10-06T03:01:47.983024+0000","last_undegraded":"2023-10-06T03:01:47.983024+0000","last_fullsized":"2023-10-06T03:01:47.983024+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:53:16.698160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":8,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.965879+0000","last_change":"2023-10-06T03:01:47.965879+0000","last_active":"2023-10-06T03:01:47.965879+0000","last_peered":"2023-10-06T03:01:47.965879+0000","last_clean":"2023-10-06T03:01:47.965879+0000","last_became_active":"2023-10-06T03:01:47.965457+0000","last_became_peered":"2023-10-06T03:01:47.965457+0000","last_unstale":"2023-10-06T03:01:47.965879+0000","last_undegraded":"2023-10-06T03:01:47.965879+0000","last_fullsized":"2023-10-06T03:01:47.965879+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:47.097485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.983557+0000","last_change":"2023-10-06T03:01:47.978006+0000","last_active":"2023-10-06T03:01:47.983557+0000","last_peered":"2023-10-06T03:01:47.983557+0000","last_clean":"2023-10-06T03:01:47.983557+0000","last_became_active":"2023-10-06T03:01:47.977664+0000","last_became_peered":"2023-10-06T03:01:47.977664+0000","last_unstale":"2023-10-06T03:01:47.983557+0000","last_undegraded":"2023-10-06T03:01:47.983557+0000","last_fullsized":"2023-10-06T03:01:47.983557+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:46:44.569591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":8,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.971942+0000","last_change":"2023-10-06T03:01:47.971942+0000","last_active":"2023-10-06T03:01:47.971942+0000","last_peered":"2023-10-06T03:01:47.971942+0000","last_clean":"2023-10-06T03:01:47.971942+0000","last_became_active":"2023-10-06T03:01:47.971642+0000","last_became_peered":"2023-10-06T03:01:47.971642+0000","last_unstale":"2023-10-06T03:01:47.971942+0000","last_undegraded":"2023-10-06T03:01:47.971942+0000","last_fullsized":"2023-10-06T03:01:47.971942+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:48:31.177237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.984818+0000","last_change":"2023-10-06T03:01:47.978268+0000","last_active":"2023-10-06T03:01:47.984818+0000","last_peered":"2023-10-06T03:01:47.984818+0000","last_clean":"2023-10-06T03:01:47.984818+0000","last_became_active":"2023-10-06T03:01:47.977838+0000","last_became_peered":"2023-10-06T03:01:47.977838+0000","last_unstale":"2023-10-06T03:01:47.984818+0000","last_undegraded":"2023-10-06T03:01:47.984818+0000","last_fullsized":"2023-10-06T03:01:47.984818+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:09:33.747749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":8,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.966282+0000","last_change":"2023-10-06T03:01:47.966282+0000","last_active":"2023-10-06T03:01:47.966282+0000","last_peered":"2023-10-06T03:01:47.966282+0000","last_clean":"2023-10-06T03:01:47.966282+0000","last_became_active":"2023-10-06T03:01:47.965914+0000","last_became_peered":"2023-10-06T03:01:47.965914+0000","last_unstale":"2023-10-06T03:01:47.966282+0000","last_undegraded":"2023-10-06T03:01:47.966282+0000","last_fullsized":"2023-10-06T03:01:47.966282+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:45:14.387596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":8,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.960023+0000","last_change":"2023-10-06T03:01:47.960023+0000","last_active":"2023-10-06T03:01:47.960023+0000","last_peered":"2023-10-06T03:01:47.960023+0000","last_clean":"2023-10-06T03:01:47.960023+0000","last_became_active":"2023-10-06T03:01:47.959665+0000","last_became_peered":"2023-10-06T03:01:47.959665+0000","last_unstale":"2023-10-06T03:01:47.960023+0000","last_undegraded":"2023-10-06T03:01:47.960023+0000","last_fullsized":"2023-10-06T03:01:47.960023+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:26:30.172046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":8,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.982682+0000","last_change":"2023-10-06T03:01:47.982682+0000","last_active":"2023-10-06T03:01:47.982682+0000","last_peered":"2023-10-06T03:01:47.982682+0000","last_clean":"2023-10-06T03:01:47.982682+0000","last_became_active":"2023-10-06T03:01:47.982298+0000","last_became_peered":"2023-10-06T03:01:47.982298+0000","last_unstale":"2023-10-06T03:01:47.982682+0000","last_undegraded":"2023-10-06T03:01:47.982682+0000","last_fullsized":"2023-10-06T03:01:47.982682+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:12:09.400466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.976677+0000","last_change":"2023-10-06T03:01:47.971192+0000","last_active":"2023-10-06T03:01:47.976677+0000","last_peered":"2023-10-06T03:01:47.976677+0000","last_clean":"2023-10-06T03:01:47.976677+0000","last_became_active":"2023-10-06T03:01:47.970854+0000","last_became_peered":"2023-10-06T03:01:47.970854+0000","last_unstale":"2023-10-06T03:01:47.976677+0000","last_undegraded":"2023-10-06T03:01:47.976677+0000","last_fullsized":"2023-10-06T03:01:47.976677+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:27:00.216138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":8,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.981009+0000","last_change":"2023-10-06T03:01:47.981009+0000","last_active":"2023-10-06T03:01:47.981009+0000","last_peered":"2023-10-06T03:01:47.981009+0000","last_clean":"2023-10-06T03:01:47.981009+0000","last_became_active":"2023-10-06T03:01:47.980664+0000","last_became_peered":"2023-10-06T03:01:47.980664+0000","last_unstale":"2023-10-06T03:01:47.981009+0000","last_undegraded":"2023-10-06T03:01:47.981009+0000","last_fullsized":"2023-10-06T03:01:47.981009+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:26:08.817720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"34'4","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.969452+0000","last_change":"2023-10-06T03:01:46.935881+0000","last_active":"2023-10-06T03:01:47.969452+0000","last_peered":"2023-10-06T03:01:47.969452+0000","last_clean":"2023-10-06T03:01:47.969452+0000","last_became_active":"2023-10-06T03:01:46.935607+0000","last_became_peered":"2023-10-06T03:01:46.935607+0000","last_unstale":"2023-10-06T03:01:47.969452+0000","last_undegraded":"2023-10-06T03:01:47.969452+0000","last_fullsized":"2023-10-06T03:01:47.969452+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_clean_scrub_stamp":"2023-10-06T03:01:45.882537+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:30:30.739598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.983657+0000","last_change":"2023-10-06T03:01:47.980675+0000","last_active":"2023-10-06T03:01:47.983657+0000","last_peered":"2023-10-06T03:01:47.983657+0000","last_clean":"2023-10-06T03:01:47.983657+0000","last_became_active":"2023-10-06T03:01:47.980283+0000","last_became_peered":"2023-10-06T03:01:47.980283+0000","last_unstale":"2023-10-06T03:01:47.983657+0000","last_undegraded":"2023-10-06T03:01:47.983657+0000","last_fullsized":"2023-10-06T03:01:47.983657+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:44:46.075266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"34'1","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.951890+0000","last_change":"2023-10-06T03:01:46.937386+0000","last_active":"2023-10-06T03:01:47.951890+0000","last_peered":"2023-10-06T03:01:47.951890+0000","last_clean":"2023-10-06T03:01:47.951890+0000","last_became_active":"2023-10-06T03:01:46.937022+0000","last_became_peered":"2023-10-06T03:01:46.937022+0000","last_unstale":"2023-10-06T03:01:47.951890+0000","last_undegraded":"2023-10-06T03:01:47.951890+0000","last_fullsized":"2023-10-06T03:01:47.951890+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_clean_scrub_stamp":"2023-10-06T03:01:45.882537+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:57:24.492317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.968938+0000","last_change":"2023-10-06T03:01:47.962442+0000","last_active":"2023-10-06T03:01:47.968938+0000","last_peered":"2023-10-06T03:01:47.968938+0000","last_clean":"2023-10-06T03:01:47.968938+0000","last_became_active":"2023-10-06T03:01:47.961910+0000","last_became_peered":"2023-10-06T03:01:47.961910+0000","last_unstale":"2023-10-06T03:01:47.968938+0000","last_undegraded":"2023-10-06T03:01:47.968938+0000","last_fullsized":"2023-10-06T03:01:47.968938+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:10:10.643033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"34'2","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.971501+0000","last_change":"2023-10-06T03:01:46.938448+0000","last_active":"2023-10-06T03:01:47.971501+0000","last_peered":"2023-10-06T03:01:47.971501+0000","last_clean":"2023-10-06T03:01:47.971501+0000","last_became_active":"2023-10-06T03:01:46.938160+0000","last_became_peered":"2023-10-06T03:01:46.938160+0000","last_unstale":"2023-10-06T03:01:47.971501+0000","last_undegraded":"2023-10-06T03:01:47.971501+0000","last_fullsized":"2023-10-06T03:01:47.971501+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_clean_scrub_stamp":"2023-10-06T03:01:45.882537+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:36:50.667930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":8,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.956862+0000","last_change":"2023-10-06T03:01:47.956862+0000","last_active":"2023-10-06T03:01:47.956862+0000","last_peered":"2023-10-06T03:01:47.956862+0000","last_clean":"2023-10-06T03:01:47.956862+0000","last_became_active":"2023-10-06T03:01:47.955923+0000","last_became_peered":"2023-10-06T03:01:47.955923+0000","last_unstale":"2023-10-06T03:01:47.956862+0000","last_undegraded":"2023-10-06T03:01:47.956862+0000","last_fullsized":"2023-10-06T03:01:47.956862+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:09:33.747749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"34'2","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.978265+0000","last_change":"2023-10-06T03:01:46.942148+0000","last_active":"2023-10-06T03:01:47.978265+0000","last_peered":"2023-10-06T03:01:47.978265+0000","last_clean":"2023-10-06T03:01:47.978265+0000","last_became_active":"2023-10-06T03:01:46.941869+0000","last_became_peered":"2023-10-06T03:01:46.941869+0000","last_unstale":"2023-10-06T03:01:47.978265+0000","last_undegraded":"2023-10-06T03:01:47.978265+0000","last_fullsized":"2023-10-06T03:01:47.978265+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_clean_scrub_stamp":"2023-10-06T03:01:45.882537+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:17:03.797659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":8,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.962933+0000","last_change":"2023-10-06T03:01:47.962933+0000","last_active":"2023-10-06T03:01:47.962933+0000","last_peered":"2023-10-06T03:01:47.962933+0000","last_clean":"2023-10-06T03:01:47.962933+0000","last_became_active":"2023-10-06T03:01:47.962637+0000","last_became_peered":"2023-10-06T03:01:47.962637+0000","last_unstale":"2023-10-06T03:01:47.962933+0000","last_undegraded":"2023-10-06T03:01:47.962933+0000","last_fullsized":"2023-10-06T03:01:47.962933+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:27:14.787514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"34'1","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.977157+0000","last_change":"2023-10-06T03:01:46.934993+0000","last_active":"2023-10-06T03:01:47.977157+0000","last_peered":"2023-10-06T03:01:47.977157+0000","last_clean":"2023-10-06T03:01:47.977157+0000","last_became_active":"2023-10-06T03:01:46.934634+0000","last_became_peered":"2023-10-06T03:01:46.934634+0000","last_unstale":"2023-10-06T03:01:47.977157+0000","last_undegraded":"2023-10-06T03:01:47.977157+0000","last_fullsized":"2023-10-06T03:01:47.977157+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_clean_scrub_stamp":"2023-10-06T03:01:45.882537+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:18:42.554199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.984684+0000","last_change":"2023-10-06T03:01:47.975183+0000","last_active":"2023-10-06T03:01:47.984684+0000","last_peered":"2023-10-06T03:01:47.984684+0000","last_clean":"2023-10-06T03:01:47.984684+0000","last_became_active":"2023-10-06T03:01:47.973861+0000","last_became_peered":"2023-10-06T03:01:47.973861+0000","last_unstale":"2023-10-06T03:01:47.984684+0000","last_undegraded":"2023-10-06T03:01:47.984684+0000","last_fullsized":"2023-10-06T03:01:47.984684+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:14:37.996899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"34'1","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.942355+0000","last_change":"2023-10-06T03:01:46.939131+0000","last_active":"2023-10-06T03:01:47.942355+0000","last_peered":"2023-10-06T03:01:47.942355+0000","last_clean":"2023-10-06T03:01:47.942355+0000","last_became_active":"2023-10-06T03:01:46.938870+0000","last_became_peered":"2023-10-06T03:01:46.938870+0000","last_unstale":"2023-10-06T03:01:47.942355+0000","last_undegraded":"2023-10-06T03:01:47.942355+0000","last_fullsized":"2023-10-06T03:01:47.942355+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_clean_scrub_stamp":"2023-10-06T03:01:45.882537+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:57:25.127564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.979051+0000","last_change":"2023-10-06T03:01:47.976939+0000","last_active":"2023-10-06T03:01:47.979051+0000","last_peered":"2023-10-06T03:01:47.979051+0000","last_clean":"2023-10-06T03:01:47.979051+0000","last_became_active":"2023-10-06T03:01:47.976585+0000","last_became_peered":"2023-10-06T03:01:47.976585+0000","last_unstale":"2023-10-06T03:01:47.979051+0000","last_undegraded":"2023-10-06T03:01:47.979051+0000","last_fullsized":"2023-10-06T03:01:47.979051+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:57:40.860316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.952482+0000","last_change":"2023-10-06T03:01:46.942708+0000","last_active":"2023-10-06T03:01:47.952482+0000","last_peered":"2023-10-06T03:01:47.952482+0000","last_clean":"2023-10-06T03:01:47.952482+0000","last_became_active":"2023-10-06T03:01:46.942308+0000","last_became_peered":"2023-10-06T03:01:46.942308+0000","last_unstale":"2023-10-06T03:01:47.952482+0000","last_undegraded":"2023-10-06T03:01:47.952482+0000","last_fullsized":"2023-10-06T03:01:47.952482+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_clean_scrub_stamp":"2023-10-06T03:01:45.882537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:27:48.405448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":8,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.954024+0000","last_change":"2023-10-06T03:01:47.954024+0000","last_active":"2023-10-06T03:01:47.954024+0000","last_peered":"2023-10-06T03:01:47.954024+0000","last_clean":"2023-10-06T03:01:47.954024+0000","last_became_active":"2023-10-06T03:01:47.952837+0000","last_became_peered":"2023-10-06T03:01:47.952837+0000","last_unstale":"2023-10-06T03:01:47.954024+0000","last_undegraded":"2023-10-06T03:01:47.954024+0000","last_fullsized":"2023-10-06T03:01:47.954024+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:14:37.996899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.949088+0000","last_change":"2023-10-06T03:01:46.937715+0000","last_active":"2023-10-06T03:01:47.949088+0000","last_peered":"2023-10-06T03:01:47.949088+0000","last_clean":"2023-10-06T03:01:47.949088+0000","last_became_active":"2023-10-06T03:01:46.937363+0000","last_became_peered":"2023-10-06T03:01:46.937363+0000","last_unstale":"2023-10-06T03:01:47.949088+0000","last_undegraded":"2023-10-06T03:01:47.949088+0000","last_fullsized":"2023-10-06T03:01:47.949088+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_clean_scrub_stamp":"2023-10-06T03:01:45.882537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:50:34.642508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.975009+0000","last_change":"2023-10-06T03:01:47.962545+0000","last_active":"2023-10-06T03:01:47.975009+0000","last_peered":"2023-10-06T03:01:47.975009+0000","last_clean":"2023-10-06T03:01:47.975009+0000","last_became_active":"2023-10-06T03:01:47.961916+0000","last_became_peered":"2023-10-06T03:01:47.961916+0000","last_unstale":"2023-10-06T03:01:47.975009+0000","last_undegraded":"2023-10-06T03:01:47.975009+0000","last_fullsized":"2023-10-06T03:01:47.975009+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:18:43.571471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T03:01:46.945469+0000","last_change":"2023-10-06T03:01:46.940690+0000","last_active":"2023-10-06T03:01:46.945469+0000","last_peered":"2023-10-06T03:01:46.945469+0000","last_clean":"2023-10-06T03:01:46.945469+0000","last_became_active":"2023-10-06T03:01:46.940082+0000","last_became_peered":"2023-10-06T03:01:46.940082+0000","last_unstale":"2023-10-06T03:01:46.945469+0000","last_undegraded":"2023-10-06T03:01:46.945469+0000","last_fullsized":"2023-10-06T03:01:46.945469+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_clean_scrub_stamp":"2023-10-06T03:01:45.882537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:18:42.554199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":8,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.952350+0000","last_change":"2023-10-06T03:01:47.952350+0000","last_active":"2023-10-06T03:01:47.952350+0000","last_peered":"2023-10-06T03:01:47.952350+0000","last_clean":"2023-10-06T03:01:47.952350+0000","last_became_active":"2023-10-06T03:01:47.952069+0000","last_became_peered":"2023-10-06T03:01:47.952069+0000","last_unstale":"2023-10-06T03:01:47.952350+0000","last_undegraded":"2023-10-06T03:01:47.952350+0000","last_fullsized":"2023-10-06T03:01:47.952350+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:23:12.179782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.953585+0000","last_change":"2023-10-06T03:01:46.941410+0000","last_active":"2023-10-06T03:01:47.953585+0000","last_peered":"2023-10-06T03:01:47.953585+0000","last_clean":"2023-10-06T03:01:47.953585+0000","last_became_active":"2023-10-06T03:01:46.940580+0000","last_became_peered":"2023-10-06T03:01:46.940580+0000","last_unstale":"2023-10-06T03:01:47.953585+0000","last_undegraded":"2023-10-06T03:01:47.953585+0000","last_fullsized":"2023-10-06T03:01:47.953585+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_clean_scrub_stamp":"2023-10-06T03:01:45.882537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:55:30.669723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":8,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.963512+0000","last_change":"2023-10-06T03:01:47.963512+0000","last_active":"2023-10-06T03:01:47.963512+0000","last_peered":"2023-10-06T03:01:47.963512+0000","last_clean":"2023-10-06T03:01:47.963512+0000","last_became_active":"2023-10-06T03:01:47.963230+0000","last_became_peered":"2023-10-06T03:01:47.963230+0000","last_unstale":"2023-10-06T03:01:47.963512+0000","last_undegraded":"2023-10-06T03:01:47.963512+0000","last_fullsized":"2023-10-06T03:01:47.963512+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:12:09.400466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"34'3","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.980073+0000","last_change":"2023-10-06T03:01:46.941008+0000","last_active":"2023-10-06T03:01:47.980073+0000","last_peered":"2023-10-06T03:01:47.980073+0000","last_clean":"2023-10-06T03:01:47.980073+0000","last_became_active":"2023-10-06T03:01:46.940690+0000","last_became_peered":"2023-10-06T03:01:46.940690+0000","last_unstale":"2023-10-06T03:01:47.980073+0000","last_undegraded":"2023-10-06T03:01:47.980073+0000","last_fullsized":"2023-10-06T03:01:47.980073+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_clean_scrub_stamp":"2023-10-06T03:01:45.882537+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:53:15.680889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.977560+0000","last_change":"2023-10-06T03:01:47.972323+0000","last_active":"2023-10-06T03:01:47.977560+0000","last_peered":"2023-10-06T03:01:47.977560+0000","last_clean":"2023-10-06T03:01:47.977560+0000","last_became_active":"2023-10-06T03:01:47.971960+0000","last_became_peered":"2023-10-06T03:01:47.971960+0000","last_unstale":"2023-10-06T03:01:47.977560+0000","last_undegraded":"2023-10-06T03:01:47.977560+0000","last_fullsized":"2023-10-06T03:01:47.977560+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:45:09.015376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"34'6","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.981553+0000","last_change":"2023-10-06T03:01:46.934711+0000","last_active":"2023-10-06T03:01:47.981553+0000","last_peered":"2023-10-06T03:01:47.981553+0000","last_clean":"2023-10-06T03:01:47.981553+0000","last_became_active":"2023-10-06T03:01:46.934386+0000","last_became_peered":"2023-10-06T03:01:46.934386+0000","last_unstale":"2023-10-06T03:01:47.981553+0000","last_undegraded":"2023-10-06T03:01:47.981553+0000","last_fullsized":"2023-10-06T03:01:47.981553+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_clean_scrub_stamp":"2023-10-06T03:01:45.882537+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:53:15.680889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":8,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.976266+0000","last_change":"2023-10-06T03:01:47.976266+0000","last_active":"2023-10-06T03:01:47.976266+0000","last_peered":"2023-10-06T03:01:47.976266+0000","last_clean":"2023-10-06T03:01:47.976266+0000","last_became_active":"2023-10-06T03:01:47.975543+0000","last_became_peered":"2023-10-06T03:01:47.975543+0000","last_unstale":"2023-10-06T03:01:47.976266+0000","last_undegraded":"2023-10-06T03:01:47.976266+0000","last_fullsized":"2023-10-06T03:01:47.976266+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:52:27.736299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"34'2","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.975258+0000","last_change":"2023-10-06T03:01:46.938837+0000","last_active":"2023-10-06T03:01:47.975258+0000","last_peered":"2023-10-06T03:01:47.975258+0000","last_clean":"2023-10-06T03:01:47.975258+0000","last_became_active":"2023-10-06T03:01:46.938547+0000","last_became_peered":"2023-10-06T03:01:46.938547+0000","last_unstale":"2023-10-06T03:01:47.975258+0000","last_undegraded":"2023-10-06T03:01:47.975258+0000","last_fullsized":"2023-10-06T03:01:47.975258+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_clean_scrub_stamp":"2023-10-06T03:01:45.882537+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:10:23.102491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":8,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.967440+0000","last_change":"2023-10-06T03:01:47.967440+0000","last_active":"2023-10-06T03:01:47.967440+0000","last_peered":"2023-10-06T03:01:47.967440+0000","last_clean":"2023-10-06T03:01:47.967440+0000","last_became_active":"2023-10-06T03:01:47.967076+0000","last_became_peered":"2023-10-06T03:01:47.967076+0000","last_unstale":"2023-10-06T03:01:47.967440+0000","last_undegraded":"2023-10-06T03:01:47.967440+0000","last_fullsized":"2023-10-06T03:01:47.967440+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:52:27.736299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.952159+0000","last_change":"2023-10-06T03:01:46.937621+0000","last_active":"2023-10-06T03:01:47.952159+0000","last_peered":"2023-10-06T03:01:47.952159+0000","last_clean":"2023-10-06T03:01:47.952159+0000","last_became_active":"2023-10-06T03:01:46.937312+0000","last_became_peered":"2023-10-06T03:01:46.937312+0000","last_unstale":"2023-10-06T03:01:47.952159+0000","last_undegraded":"2023-10-06T03:01:47.952159+0000","last_fullsized":"2023-10-06T03:01:47.952159+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_clean_scrub_stamp":"2023-10-06T03:01:45.882537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:17:54.301137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":8,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.972907+0000","last_change":"2023-10-06T03:01:47.972907+0000","last_active":"2023-10-06T03:01:47.972907+0000","last_peered":"2023-10-06T03:01:47.972907+0000","last_clean":"2023-10-06T03:01:47.972907+0000","last_became_active":"2023-10-06T03:01:47.972572+0000","last_became_peered":"2023-10-06T03:01:47.972572+0000","last_unstale":"2023-10-06T03:01:47.972907+0000","last_undegraded":"2023-10-06T03:01:47.972907+0000","last_fullsized":"2023-10-06T03:01:47.972907+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:57:40.860316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T03:01:46.942228+0000","last_change":"2023-10-06T03:01:46.937007+0000","last_active":"2023-10-06T03:01:46.942228+0000","last_peered":"2023-10-06T03:01:46.942228+0000","last_clean":"2023-10-06T03:01:46.942228+0000","last_became_active":"2023-10-06T03:01:46.936658+0000","last_became_peered":"2023-10-06T03:01:46.936658+0000","last_unstale":"2023-10-06T03:01:46.942228+0000","last_undegraded":"2023-10-06T03:01:46.942228+0000","last_fullsized":"2023-10-06T03:01:46.942228+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_clean_scrub_stamp":"2023-10-06T03:01:45.882537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:50:45.434465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":8,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.959506+0000","last_change":"2023-10-06T03:01:47.959506+0000","last_active":"2023-10-06T03:01:47.959506+0000","last_peered":"2023-10-06T03:01:47.959506+0000","last_clean":"2023-10-06T03:01:47.959506+0000","last_became_active":"2023-10-06T03:01:47.959181+0000","last_became_peered":"2023-10-06T03:01:47.959181+0000","last_unstale":"2023-10-06T03:01:47.959506+0000","last_undegraded":"2023-10-06T03:01:47.959506+0000","last_fullsized":"2023-10-06T03:01:47.959506+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:26:08.817720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"34'8","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.981563+0000","last_change":"2023-10-06T03:01:46.938990+0000","last_active":"2023-10-06T03:01:47.981563+0000","last_peered":"2023-10-06T03:01:47.981563+0000","last_clean":"2023-10-06T03:01:47.981563+0000","last_became_active":"2023-10-06T03:01:46.938685+0000","last_became_peered":"2023-10-06T03:01:46.938685+0000","last_unstale":"2023-10-06T03:01:47.981563+0000","last_undegraded":"2023-10-06T03:01:47.981563+0000","last_fullsized":"2023-10-06T03:01:47.981563+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_clean_scrub_stamp":"2023-10-06T03:01:45.882537+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:01:08.987274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":8,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.955166+0000","last_change":"2023-10-06T03:01:47.955166+0000","last_active":"2023-10-06T03:01:47.955166+0000","last_peered":"2023-10-06T03:01:47.955166+0000","last_clean":"2023-10-06T03:01:47.955166+0000","last_became_active":"2023-10-06T03:01:47.954853+0000","last_became_peered":"2023-10-06T03:01:47.954853+0000","last_unstale":"2023-10-06T03:01:47.955166+0000","last_undegraded":"2023-10-06T03:01:47.955166+0000","last_fullsized":"2023-10-06T03:01:47.955166+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:09:52.287614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'1","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.980603+0000","last_change":"2023-10-06T03:01:46.939332+0000","last_active":"2023-10-06T03:01:47.980603+0000","last_peered":"2023-10-06T03:01:47.980603+0000","last_clean":"2023-10-06T03:01:47.980603+0000","last_became_active":"2023-10-06T03:01:46.939036+0000","last_became_peered":"2023-10-06T03:01:46.939036+0000","last_unstale":"2023-10-06T03:01:47.980603+0000","last_undegraded":"2023-10-06T03:01:47.980603+0000","last_fullsized":"2023-10-06T03:01:47.980603+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_clean_scrub_stamp":"2023-10-06T03:01:45.882537+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:10:23.102491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.984785+0000","last_change":"2023-10-06T03:01:47.977610+0000","last_active":"2023-10-06T03:01:47.984785+0000","last_peered":"2023-10-06T03:01:47.984785+0000","last_clean":"2023-10-06T03:01:47.984785+0000","last_became_active":"2023-10-06T03:01:47.973982+0000","last_became_peered":"2023-10-06T03:01:47.973982+0000","last_unstale":"2023-10-06T03:01:47.984785+0000","last_undegraded":"2023-10-06T03:01:47.984785+0000","last_fullsized":"2023-10-06T03:01:47.984785+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:44:57.072987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"34'2","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.979264+0000","last_change":"2023-10-06T03:01:46.928642+0000","last_active":"2023-10-06T03:01:47.979264+0000","last_peered":"2023-10-06T03:01:47.979264+0000","last_clean":"2023-10-06T03:01:47.979264+0000","last_became_active":"2023-10-06T03:01:46.928335+0000","last_became_peered":"2023-10-06T03:01:46.928335+0000","last_unstale":"2023-10-06T03:01:47.979264+0000","last_undegraded":"2023-10-06T03:01:47.979264+0000","last_fullsized":"2023-10-06T03:01:47.979264+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_clean_scrub_stamp":"2023-10-06T03:01:45.882537+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:13:26.864290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.971918+0000","last_change":"2023-10-06T03:01:47.963208+0000","last_active":"2023-10-06T03:01:47.971918+0000","last_peered":"2023-10-06T03:01:47.971918+0000","last_clean":"2023-10-06T03:01:47.971918+0000","last_became_active":"2023-10-06T03:01:47.962918+0000","last_became_peered":"2023-10-06T03:01:47.962918+0000","last_unstale":"2023-10-06T03:01:47.971918+0000","last_undegraded":"2023-10-06T03:01:47.971918+0000","last_fullsized":"2023-10-06T03:01:47.971918+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:13:59.064942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"34'1","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.983258+0000","last_change":"2023-10-06T03:01:46.942179+0000","last_active":"2023-10-06T03:01:47.983258+0000","last_peered":"2023-10-06T03:01:47.983258+0000","last_clean":"2023-10-06T03:01:47.983258+0000","last_became_active":"2023-10-06T03:01:46.941798+0000","last_became_peered":"2023-10-06T03:01:46.941798+0000","last_unstale":"2023-10-06T03:01:47.983258+0000","last_undegraded":"2023-10-06T03:01:47.983258+0000","last_fullsized":"2023-10-06T03:01:47.983258+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_clean_scrub_stamp":"2023-10-06T03:01:45.882537+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:48:30.159965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.984190+0000","last_change":"2023-10-06T03:01:47.976336+0000","last_active":"2023-10-06T03:01:47.984190+0000","last_peered":"2023-10-06T03:01:47.984190+0000","last_clean":"2023-10-06T03:01:47.984190+0000","last_became_active":"2023-10-06T03:01:47.975962+0000","last_became_peered":"2023-10-06T03:01:47.975962+0000","last_unstale":"2023-10-06T03:01:47.984190+0000","last_undegraded":"2023-10-06T03:01:47.984190+0000","last_fullsized":"2023-10-06T03:01:47.984190+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:57:25.509588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.953127+0000","last_change":"2023-10-06T03:01:46.938512+0000","last_active":"2023-10-06T03:01:47.953127+0000","last_peered":"2023-10-06T03:01:47.953127+0000","last_clean":"2023-10-06T03:01:47.953127+0000","last_became_active":"2023-10-06T03:01:46.938216+0000","last_became_peered":"2023-10-06T03:01:46.938216+0000","last_unstale":"2023-10-06T03:01:47.953127+0000","last_undegraded":"2023-10-06T03:01:47.953127+0000","last_fullsized":"2023-10-06T03:01:47.953127+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_clean_scrub_stamp":"2023-10-06T03:01:45.882537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:55:30.669723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":8,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.971045+0000","last_change":"2023-10-06T03:01:47.971045+0000","last_active":"2023-10-06T03:01:47.971045+0000","last_peered":"2023-10-06T03:01:47.971045+0000","last_clean":"2023-10-06T03:01:47.971045+0000","last_became_active":"2023-10-06T03:01:47.970760+0000","last_became_peered":"2023-10-06T03:01:47.970760+0000","last_unstale":"2023-10-06T03:01:47.971045+0000","last_undegraded":"2023-10-06T03:01:47.971045+0000","last_fullsized":"2023-10-06T03:01:47.971045+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:02:16.580758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"34'2","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.975699+0000","last_change":"2023-10-06T03:01:46.939595+0000","last_active":"2023-10-06T03:01:47.975699+0000","last_peered":"2023-10-06T03:01:47.975699+0000","last_clean":"2023-10-06T03:01:47.975699+0000","last_became_active":"2023-10-06T03:01:46.939291+0000","last_became_peered":"2023-10-06T03:01:46.939291+0000","last_unstale":"2023-10-06T03:01:47.975699+0000","last_undegraded":"2023-10-06T03:01:47.975699+0000","last_fullsized":"2023-10-06T03:01:47.975699+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_clean_scrub_stamp":"2023-10-06T03:01:45.882537+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:20:46.080214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":8,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.963432+0000","last_change":"2023-10-06T03:01:47.963432+0000","last_active":"2023-10-06T03:01:47.963432+0000","last_peered":"2023-10-06T03:01:47.963432+0000","last_clean":"2023-10-06T03:01:47.963432+0000","last_became_active":"2023-10-06T03:01:47.963074+0000","last_became_peered":"2023-10-06T03:01:47.963074+0000","last_unstale":"2023-10-06T03:01:47.963432+0000","last_undegraded":"2023-10-06T03:01:47.963432+0000","last_fullsized":"2023-10-06T03:01:47.963432+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:44:46.075266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.956623+0000","last_change":"2023-10-06T03:01:46.934960+0000","last_active":"2023-10-06T03:01:47.956623+0000","last_peered":"2023-10-06T03:01:47.956623+0000","last_clean":"2023-10-06T03:01:47.956623+0000","last_became_active":"2023-10-06T03:01:46.934680+0000","last_became_peered":"2023-10-06T03:01:46.934680+0000","last_unstale":"2023-10-06T03:01:47.956623+0000","last_undegraded":"2023-10-06T03:01:47.956623+0000","last_fullsized":"2023-10-06T03:01:47.956623+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_clean_scrub_stamp":"2023-10-06T03:01:45.882537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:51:53.062850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.980023+0000","last_change":"2023-10-06T03:01:47.973443+0000","last_active":"2023-10-06T03:01:47.980023+0000","last_peered":"2023-10-06T03:01:47.980023+0000","last_clean":"2023-10-06T03:01:47.980023+0000","last_became_active":"2023-10-06T03:01:47.973143+0000","last_became_peered":"2023-10-06T03:01:47.973143+0000","last_unstale":"2023-10-06T03:01:47.980023+0000","last_undegraded":"2023-10-06T03:01:47.980023+0000","last_fullsized":"2023-10-06T03:01:47.980023+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:10:10.643033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T03:01:46.942347+0000","last_change":"2023-10-06T03:01:46.938217+0000","last_active":"2023-10-06T03:01:46.942347+0000","last_peered":"2023-10-06T03:01:46.942347+0000","last_clean":"2023-10-06T03:01:46.942347+0000","last_became_active":"2023-10-06T03:01:46.937894+0000","last_became_peered":"2023-10-06T03:01:46.937894+0000","last_unstale":"2023-10-06T03:01:46.942347+0000","last_undegraded":"2023-10-06T03:01:46.942347+0000","last_fullsized":"2023-10-06T03:01:46.942347+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_clean_scrub_stamp":"2023-10-06T03:01:45.882537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:36:50.667930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":8,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.954263+0000","last_change":"2023-10-06T03:01:47.954263+0000","last_active":"2023-10-06T03:01:47.954263+0000","last_peered":"2023-10-06T03:01:47.954263+0000","last_clean":"2023-10-06T03:01:47.954263+0000","last_became_active":"2023-10-06T03:01:47.953736+0000","last_became_peered":"2023-10-06T03:01:47.953736+0000","last_unstale":"2023-10-06T03:01:47.954263+0000","last_undegraded":"2023-10-06T03:01:47.954263+0000","last_fullsized":"2023-10-06T03:01:47.954263+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:45:09.015376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.956479+0000","last_change":"2023-10-06T03:01:46.939689+0000","last_active":"2023-10-06T03:01:47.956479+0000","last_peered":"2023-10-06T03:01:47.956479+0000","last_clean":"2023-10-06T03:01:47.956479+0000","last_became_active":"2023-10-06T03:01:46.939314+0000","last_became_peered":"2023-10-06T03:01:46.939314+0000","last_unstale":"2023-10-06T03:01:47.956479+0000","last_undegraded":"2023-10-06T03:01:47.956479+0000","last_fullsized":"2023-10-06T03:01:47.956479+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_clean_scrub_stamp":"2023-10-06T03:01:45.882537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:09:39.944812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.986197+0000","last_change":"2023-10-06T03:01:47.979997+0000","last_active":"2023-10-06T03:01:47.986197+0000","last_peered":"2023-10-06T03:01:47.986197+0000","last_clean":"2023-10-06T03:01:47.986197+0000","last_became_active":"2023-10-06T03:01:47.978303+0000","last_became_peered":"2023-10-06T03:01:47.978303+0000","last_unstale":"2023-10-06T03:01:47.986197+0000","last_undegraded":"2023-10-06T03:01:47.986197+0000","last_fullsized":"2023-10-06T03:01:47.986197+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:09:52.287614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T03:01:46.943844+0000","last_change":"2023-10-06T03:01:46.940299+0000","last_active":"2023-10-06T03:01:46.943844+0000","last_peered":"2023-10-06T03:01:46.943844+0000","last_clean":"2023-10-06T03:01:46.943844+0000","last_became_active":"2023-10-06T03:01:46.940095+0000","last_became_peered":"2023-10-06T03:01:46.940095+0000","last_unstale":"2023-10-06T03:01:46.943844+0000","last_undegraded":"2023-10-06T03:01:46.943844+0000","last_fullsized":"2023-10-06T03:01:46.943844+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_clean_scrub_stamp":"2023-10-06T03:01:45.882537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:17:54.301137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":174,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T03:01:46.926749+0000","last_change":"2023-10-06T03:00:45.709165+0000","last_active":"2023-10-06T03:01:46.926749+0000","last_peered":"2023-10-06T03:01:46.926749+0000","last_clean":"2023-10-06T03:01:46.926749+0000","last_became_active":"2023-10-06T03:00:45.707771+0000","last_became_peered":"2023-10-06T03:00:45.707771+0000","last_unstale":"2023-10-06T03:01:46.926749+0000","last_undegraded":"2023-10-06T03:01:46.926749+0000","last_fullsized":"2023-10-06T03:01:46.926749+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:44.625353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:44.625353+0000","last_clean_scrub_stamp":"2023-10-06T03:00:44.625353+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:31:31.774239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.960800+0000","last_change":"2023-10-06T03:00:51.905381+0000","last_active":"2023-10-06T03:01:47.960800+0000","last_peered":"2023-10-06T03:01:47.960800+0000","last_clean":"2023-10-06T03:01:47.960800+0000","last_became_active":"2023-10-06T03:00:51.904974+0000","last_became_peered":"2023-10-06T03:00:51.904974+0000","last_unstale":"2023-10-06T03:01:47.960800+0000","last_undegraded":"2023-10-06T03:01:47.960800+0000","last_fullsized":"2023-10-06T03:01:47.960800+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:15:19.182956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.983540+0000","last_change":"2023-10-06T03:01:47.977474+0000","last_active":"2023-10-06T03:01:47.983540+0000","last_peered":"2023-10-06T03:01:47.983540+0000","last_clean":"2023-10-06T03:01:47.983540+0000","last_became_active":"2023-10-06T03:01:47.977024+0000","last_became_peered":"2023-10-06T03:01:47.977024+0000","last_unstale":"2023-10-06T03:01:47.983540+0000","last_undegraded":"2023-10-06T03:01:47.983540+0000","last_fullsized":"2023-10-06T03:01:47.983540+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:57:45.017663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"34'2","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.980503+0000","last_change":"2023-10-06T03:01:46.943197+0000","last_active":"2023-10-06T03:01:47.980503+0000","last_peered":"2023-10-06T03:01:47.980503+0000","last_clean":"2023-10-06T03:01:47.980503+0000","last_became_active":"2023-10-06T03:01:46.942873+0000","last_became_peered":"2023-10-06T03:01:46.942873+0000","last_unstale":"2023-10-06T03:01:47.980503+0000","last_undegraded":"2023-10-06T03:01:47.980503+0000","last_fullsized":"2023-10-06T03:01:47.980503+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_clean_scrub_stamp":"2023-10-06T03:01:45.882537+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:17:03.797659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T03:01:46.926251+0000","last_change":"2023-10-06T03:00:51.906480+0000","last_active":"2023-10-06T03:01:46.926251+0000","last_peered":"2023-10-06T03:01:46.926251+0000","last_clean":"2023-10-06T03:01:46.926251+0000","last_became_active":"2023-10-06T03:00:51.905956+0000","last_became_peered":"2023-10-06T03:00:51.905956+0000","last_unstale":"2023-10-06T03:01:46.926251+0000","last_undegraded":"2023-10-06T03:01:46.926251+0000","last_fullsized":"2023-10-06T03:01:46.926251+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:15:19.182956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":8,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.970964+0000","last_change":"2023-10-06T03:01:47.970964+0000","last_active":"2023-10-06T03:01:47.970964+0000","last_peered":"2023-10-06T03:01:47.970964+0000","last_clean":"2023-10-06T03:01:47.970964+0000","last_became_active":"2023-10-06T03:01:47.970304+0000","last_became_peered":"2023-10-06T03:01:47.970304+0000","last_unstale":"2023-10-06T03:01:47.970964+0000","last_undegraded":"2023-10-06T03:01:47.970964+0000","last_fullsized":"2023-10-06T03:01:47.970964+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:46:44.569591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"35'1","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T03:01:49.099542+0000","last_change":"2023-10-06T03:01:46.942610+0000","last_active":"2023-10-06T03:01:49.099542+0000","last_peered":"2023-10-06T03:01:49.099542+0000","last_clean":"2023-10-06T03:01:49.099542+0000","last_became_active":"2023-10-06T03:01:46.942009+0000","last_became_peered":"2023-10-06T03:01:46.942009+0000","last_unstale":"2023-10-06T03:01:49.099542+0000","last_undegraded":"2023-10-06T03:01:49.099542+0000","last_fullsized":"2023-10-06T03:01:49.099542+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_clean_scrub_stamp":"2023-10-06T03:01:45.882537+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:30:13.839941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.959153+0000","last_change":"2023-10-06T03:00:51.902453+0000","last_active":"2023-10-06T03:01:47.959153+0000","last_peered":"2023-10-06T03:01:47.959153+0000","last_clean":"2023-10-06T03:01:47.959153+0000","last_became_active":"2023-10-06T03:00:51.901948+0000","last_became_peered":"2023-10-06T03:00:51.901948+0000","last_unstale":"2023-10-06T03:01:47.959153+0000","last_undegraded":"2023-10-06T03:01:47.959153+0000","last_fullsized":"2023-10-06T03:01:47.959153+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:13:30.721650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":8,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.955015+0000","last_change":"2023-10-06T03:01:47.955015+0000","last_active":"2023-10-06T03:01:47.955015+0000","last_peered":"2023-10-06T03:01:47.955015+0000","last_clean":"2023-10-06T03:01:47.955015+0000","last_became_active":"2023-10-06T03:01:47.954738+0000","last_became_peered":"2023-10-06T03:01:47.954738+0000","last_unstale":"2023-10-06T03:01:47.955015+0000","last_undegraded":"2023-10-06T03:01:47.955015+0000","last_fullsized":"2023-10-06T03:01:47.955015+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:10:10.643033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T03:01:46.944663+0000","last_change":"2023-10-06T03:01:46.935405+0000","last_active":"2023-10-06T03:01:46.944663+0000","last_peered":"2023-10-06T03:01:46.944663+0000","last_clean":"2023-10-06T03:01:46.944663+0000","last_became_active":"2023-10-06T03:01:46.935069+0000","last_became_peered":"2023-10-06T03:01:46.935069+0000","last_unstale":"2023-10-06T03:01:46.944663+0000","last_undegraded":"2023-10-06T03:01:46.944663+0000","last_fullsized":"2023-10-06T03:01:46.944663+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_clean_scrub_stamp":"2023-10-06T03:01:45.882537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:27:48.405448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.953164+0000","last_change":"2023-10-06T03:00:51.904148+0000","last_active":"2023-10-06T03:01:47.953164+0000","last_peered":"2023-10-06T03:01:47.953164+0000","last_clean":"2023-10-06T03:01:47.953164+0000","last_became_active":"2023-10-06T03:00:51.903729+0000","last_became_peered":"2023-10-06T03:00:51.903729+0000","last_unstale":"2023-10-06T03:01:47.953164+0000","last_undegraded":"2023-10-06T03:01:47.953164+0000","last_fullsized":"2023-10-06T03:01:47.953164+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:17:25.070478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":8,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.960275+0000","last_change":"2023-10-06T03:01:47.960275+0000","last_active":"2023-10-06T03:01:47.960275+0000","last_peered":"2023-10-06T03:01:47.960275+0000","last_clean":"2023-10-06T03:01:47.960275+0000","last_became_active":"2023-10-06T03:01:47.959968+0000","last_became_peered":"2023-10-06T03:01:47.959968+0000","last_unstale":"2023-10-06T03:01:47.960275+0000","last_undegraded":"2023-10-06T03:01:47.960275+0000","last_fullsized":"2023-10-06T03:01:47.960275+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:57:40.860316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T03:01:46.944868+0000","last_change":"2023-10-06T03:01:46.936762+0000","last_active":"2023-10-06T03:01:46.944868+0000","last_peered":"2023-10-06T03:01:46.944868+0000","last_clean":"2023-10-06T03:01:46.944868+0000","last_became_active":"2023-10-06T03:01:46.936494+0000","last_became_peered":"2023-10-06T03:01:46.936494+0000","last_unstale":"2023-10-06T03:01:46.944868+0000","last_undegraded":"2023-10-06T03:01:46.944868+0000","last_fullsized":"2023-10-06T03:01:46.944868+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_clean_scrub_stamp":"2023-10-06T03:01:45.882537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:55:30.669723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.953229+0000","last_change":"2023-10-06T03:00:52.484317+0000","last_active":"2023-10-06T03:01:47.953229+0000","last_peered":"2023-10-06T03:01:47.953229+0000","last_clean":"2023-10-06T03:01:47.953229+0000","last_became_active":"2023-10-06T03:00:52.483818+0000","last_became_peered":"2023-10-06T03:00:52.483818+0000","last_unstale":"2023-10-06T03:01:47.953229+0000","last_undegraded":"2023-10-06T03:01:47.953229+0000","last_fullsized":"2023-10-06T03:01:47.953229+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:17:24.136459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.971057+0000","last_change":"2023-10-06T03:01:47.965731+0000","last_active":"2023-10-06T03:01:47.971057+0000","last_peered":"2023-10-06T03:01:47.971057+0000","last_clean":"2023-10-06T03:01:47.971057+0000","last_became_active":"2023-10-06T03:01:47.965379+0000","last_became_peered":"2023-10-06T03:01:47.965379+0000","last_unstale":"2023-10-06T03:01:47.971057+0000","last_undegraded":"2023-10-06T03:01:47.971057+0000","last_fullsized":"2023-10-06T03:01:47.971057+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:16:01.218185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T03:01:46.943867+0000","last_change":"2023-10-06T03:01:46.941420+0000","last_active":"2023-10-06T03:01:46.943867+0000","last_peered":"2023-10-06T03:01:46.943867+0000","last_clean":"2023-10-06T03:01:46.943867+0000","last_became_active":"2023-10-06T03:01:46.941108+0000","last_became_peered":"2023-10-06T03:01:46.941108+0000","last_unstale":"2023-10-06T03:01:46.943867+0000","last_undegraded":"2023-10-06T03:01:46.943867+0000","last_fullsized":"2023-10-06T03:01:46.943867+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_clean_scrub_stamp":"2023-10-06T03:01:45.882537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:27:13.402698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T03:01:46.933168+0000","last_change":"2023-10-06T03:00:52.485186+0000","last_active":"2023-10-06T03:01:46.933168+0000","last_peered":"2023-10-06T03:01:46.933168+0000","last_clean":"2023-10-06T03:01:46.933168+0000","last_became_active":"2023-10-06T03:00:52.484615+0000","last_became_peered":"2023-10-06T03:00:52.484615+0000","last_unstale":"2023-10-06T03:01:46.933168+0000","last_undegraded":"2023-10-06T03:01:46.933168+0000","last_fullsized":"2023-10-06T03:01:46.933168+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:17:25.070478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.968789+0000","last_change":"2023-10-06T03:01:47.961847+0000","last_active":"2023-10-06T03:01:47.968789+0000","last_peered":"2023-10-06T03:01:47.968789+0000","last_clean":"2023-10-06T03:01:47.968789+0000","last_became_active":"2023-10-06T03:01:47.961540+0000","last_became_peered":"2023-10-06T03:01:47.961540+0000","last_unstale":"2023-10-06T03:01:47.968789+0000","last_undegraded":"2023-10-06T03:01:47.968789+0000","last_fullsized":"2023-10-06T03:01:47.968789+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:27:14.787514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.949236+0000","last_change":"2023-10-06T03:01:46.933507+0000","last_active":"2023-10-06T03:01:47.949236+0000","last_peered":"2023-10-06T03:01:47.949236+0000","last_clean":"2023-10-06T03:01:47.949236+0000","last_became_active":"2023-10-06T03:01:46.933232+0000","last_became_peered":"2023-10-06T03:01:46.933232+0000","last_unstale":"2023-10-06T03:01:47.949236+0000","last_undegraded":"2023-10-06T03:01:47.949236+0000","last_fullsized":"2023-10-06T03:01:47.949236+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_clean_scrub_stamp":"2023-10-06T03:01:45.882537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:53:15.680889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.952644+0000","last_change":"2023-10-06T03:00:51.903388+0000","last_active":"2023-10-06T03:01:47.952644+0000","last_peered":"2023-10-06T03:01:47.952644+0000","last_clean":"2023-10-06T03:01:47.952644+0000","last_became_active":"2023-10-06T03:00:51.902959+0000","last_became_peered":"2023-10-06T03:00:51.902959+0000","last_unstale":"2023-10-06T03:01:47.952644+0000","last_undegraded":"2023-10-06T03:01:47.952644+0000","last_fullsized":"2023-10-06T03:01:47.952644+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:30:16.907470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":8,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T03:01:47.951700+0000","last_change":"2023-10-06T03:01:47.951700+0000","last_active":"2023-10-06T03:01:47.951700+0000","last_peered":"2023-10-06T03:01:47.951700+0000","last_clean":"2023-10-06T03:01:47.951700+0000","last_became_active":"2023-10-06T03:01:47.951399+0000","last_became_peered":"2023-10-06T03:01:47.951399+0000","last_unstale":"2023-10-06T03:01:47.951700+0000","last_undegraded":"2023-10-06T03:01:47.951700+0000","last_fullsized":"2023-10-06T03:01:47.951700+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:46.899809+0000","last_clean_scrub_stamp":"2023-10-06T03:01:46.899809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:44:46.075266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T03:01:46.941266+0000","last_change":"2023-10-06T03:01:46.935965+0000","last_active":"2023-10-06T03:01:46.941266+0000","last_peered":"2023-10-06T03:01:46.941266+0000","last_clean":"2023-10-06T03:01:46.941266+0000","last_became_active":"2023-10-06T03:01:46.935664+0000","last_became_peered":"2023-10-06T03:01:46.935664+0000","last_unstale":"2023-10-06T03:01:46.941266+0000","last_undegraded":"2023-10-06T03:01:46.941266+0000","last_fullsized":"2023-10-06T03:01:46.941266+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:01:45.882537+0000","last_clean_scrub_stamp":"2023-10-06T03:01:45.882537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:17:03.797659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-06T03:01:46.932602+0000","last_change":"2023-10-06T03:00:51.903242+0000","last_active":"2023-10-06T03:01:46.932602+0000","last_peered":"2023-10-06T03:01:46.932602+0000","last_clean":"2023-10-06T03:01:46.932602+0000","last_became_active":"2023-10-06T03:00:51.902929+0000","last_became_peered":"2023-10-06T03:00:51.902929+0000","last_unstale":"2023-10-06T03:01:46.932602+0000","last_undegraded":"2023-10-06T03:01:46.932602+0000","last_fullsized":"2023-10-06T03:01:46.932602+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:34:12.274158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302356,"kb_used_data":972,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069484,"statfs":{"total":96636764160,"available":96327151616,"internally_reserved":0,"allocated":995328,"data_stored":748241,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"min":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":4.7930000000000001,"5min":4.7930000000000001,"15min":4.7930000000000001},"last":0.86699999999999999},{"interface":"front","average":{"1min":1.5780000000000001,"5min":1.5780000000000001,"15min":1.5780000000000001},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":9.9689999999999994,"5min":9.9689999999999994,"15min":9.9689999999999994},"last":1.4159999999999999}]},{"osd":1,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":10.867000000000001,"5min":10.867000000000001,"15min":10.867000000000001},"last":1.1779999999999999},{"interface":"front","average":{"1min":1.6779999999999999,"5min":1.6779999999999999,"15min":1.6779999999999999},"min":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":10.255000000000001,"5min":10.255000000000001,"15min":10.255000000000001},"last":1.1339999999999999}]},{"osd":2,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.6799999999999999,"5min":1.6799999999999999,"15min":1.6799999999999999},"min":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"max":{"1min":7.9939999999999998,"5min":7.9939999999999998,"15min":7.9939999999999998},"last":1.091},{"interface":"front","average":{"1min":1.6970000000000001,"5min":1.6970000000000001,"15min":1.6970000000000001},"min":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"max":{"1min":10.098000000000001,"5min":10.098000000000001,"15min":10.098000000000001},"last":1.288}]},{"osd":3,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"min":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"max":{"1min":4.3090000000000002,"5min":4.3090000000000002,"15min":4.3090000000000002},"last":1.242},{"interface":"front","average":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"min":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":8.3770000000000007,"5min":8.3770000000000007,"15min":8.3770000000000007},"last":1.4670000000000001}]},{"osd":4,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.7889999999999999,"5min":1.7889999999999999,"15min":1.7889999999999999},"min":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"max":{"1min":11.391999999999999,"5min":11.391999999999999,"15min":11.391999999999999},"last":1.27},{"interface":"front","average":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"min":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"max":{"1min":3.9220000000000002,"5min":3.9220000000000002,"15min":3.9220000000000002},"last":1.014}]},{"osd":5,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.796,"5min":1.796,"15min":1.796},"min":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"max":{"1min":11.951000000000001,"5min":11.951000000000001,"15min":11.951000000000001},"last":0.97099999999999997},{"interface":"front","average":{"1min":1.9259999999999999,"5min":1.9259999999999999,"15min":1.9259999999999999},"min":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"max":{"1min":10.994999999999999,"5min":10.994999999999999,"15min":10.994999999999999},"last":1.0580000000000001}]},{"osd":6,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.9890000000000001,"5min":1.9890000000000001,"15min":1.9890000000000001},"min":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"max":{"1min":11.513,"5min":11.513,"15min":11.513},"last":1.216},{"interface":"front","average":{"1min":1.958,"5min":1.958,"15min":1.958},"min":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"max":{"1min":10.714,"5min":10.714,"15min":10.714},"last":0.93000000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297668,"kb_used_data":380,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074172,"statfs":{"total":96636764160,"available":96331952128,"internally_reserved":0,"allocated":389120,"data_stored":156821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":1.3480000000000001},{"interface":"front","average":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":2.1419999999999999,"5min":2.1419999999999999,"15min":2.1419999999999999},"last":1.0700000000000001}]},{"osd":1,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"min":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"max":{"1min":1.9159999999999999,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":1.2310000000000001},{"interface":"front","average":{"1min":1.256,"5min":1.256,"15min":1.256},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":1.677,"5min":1.677,"15min":1.677},"last":1.2529999999999999}]},{"osd":2,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.167,"15min":1.167},"min":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":1.659,"5min":1.659,"15min":1.659},"last":0.86599999999999999},{"interface":"front","average":{"1min":1.236,"5min":1.236,"15min":1.236},"min":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"max":{"1min":1.78,"5min":1.78,"15min":1.78},"last":1.111}]},{"osd":3,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.284,"5min":1.284,"15min":1.284},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":1.1830000000000001},{"interface":"front","average":{"1min":1.343,"5min":1.343,"15min":1.343},"min":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":2.2200000000000002,"5min":2.2200000000000002,"15min":2.2200000000000002},"last":1.2909999999999999}]},{"osd":4,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.286,"5min":1.286,"15min":1.286},"min":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"max":{"1min":1.889,"5min":1.889,"15min":1.889},"last":1.0289999999999999},{"interface":"front","average":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"min":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":2.2610000000000001,"5min":2.2610000000000001,"15min":2.2610000000000001},"last":1.1970000000000001}]},{"osd":5,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"min":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"max":{"1min":1.994,"5min":1.994,"15min":1.994},"last":0.97499999999999998},{"interface":"front","average":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"min":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"max":{"1min":2.0129999999999999,"5min":2.0129999999999999,"15min":2.0129999999999999},"last":1.145}]},{"osd":7,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"min":{"1min":1.016,"5min":1.016,"15min":1.016},"max":{"1min":2.0920000000000001,"5min":2.0920000000000001,"15min":2.0920000000000001},"last":1.387},{"interface":"front","average":{"1min":1.5469999999999999,"5min":1.5469999999999999,"15min":1.5469999999999999},"min":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"max":{"1min":2.0310000000000001,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":1.3220000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297684,"kb_used_data":396,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074156,"statfs":{"total":96636764160,"available":96331935744,"internally_reserved":0,"allocated":405504,"data_stored":163020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":0.85499999999999998},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.5,"5min":1.5,"15min":1.5},"last":0.81999999999999995}]},{"osd":1,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"min":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":1.984,"5min":1.984,"15min":1.984},"last":1.095},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.708,"5min":1.708,"15min":1.708},"last":1.157}]},{"osd":2,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.395,"5min":1.395,"15min":1.395},"min":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"max":{"1min":1.78,"5min":1.78,"15min":1.78},"last":1.262},{"interface":"front","average":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"min":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":2.8319999999999999,"5min":2.8319999999999999,"15min":2.8319999999999999},"last":1.0680000000000001}]},{"osd":3,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"min":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":3.1789999999999998,"5min":3.1789999999999998,"15min":3.1789999999999998},"last":1.0129999999999999},{"interface":"front","average":{"1min":1.272,"5min":1.272,"15min":1.272},"min":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"max":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":1.379}]},{"osd":4,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":1.302,"15min":1.302},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":2.5899999999999999,"5min":2.5899999999999999,"15min":2.5899999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":1.516,"5min":1.516,"15min":1.516},"min":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"max":{"1min":4.5419999999999998,"5min":4.5419999999999998,"15min":4.5419999999999998},"last":0.91900000000000004}]},{"osd":6,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.847,"5min":1.847,"15min":1.847},"last":1.327},{"interface":"front","average":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"min":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":2.9239999999999999,"5min":2.9239999999999999,"15min":2.9239999999999999},"last":0.97299999999999998}]},{"osd":7,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":4.4489999999999998,"5min":4.4489999999999998,"15min":4.4489999999999998},"last":1.208},{"interface":"front","average":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"min":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"max":{"1min":1.98,"5min":1.98,"15min":1.98},"last":1.4299999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297672,"kb_used_data":384,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074168,"statfs":{"total":96636764160,"available":96331948032,"internally_reserved":0,"allocated":393216,"data_stored":156843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.6040000000000001,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":0.98499999999999999},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.585,"5min":1.585,"15min":1.585},"last":0.81999999999999995}]},{"osd":1,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.403,"5min":1.403,"15min":1.403},"last":1.3799999999999999},{"interface":"front","average":{"1min":1.169,"5min":1.169,"15min":1.169},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.73,"5min":1.73,"15min":1.73},"last":1.1140000000000001}]},{"osd":2,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.696,"5min":1.696,"15min":1.696},"last":1.425},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":1.788,"5min":1.788,"15min":1.788},"last":1.2809999999999999}]},{"osd":3,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.248,"15min":1.248},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.625,"5min":1.625,"15min":1.625},"last":0.94499999999999995},{"interface":"front","average":{"1min":1.232,"5min":1.232,"15min":1.232},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.7629999999999999,"5min":1.7629999999999999,"15min":1.7629999999999999},"last":1.3129999999999999}]},{"osd":5,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.198,"5min":1.198,"15min":1.198},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.71,"5min":1.71,"15min":1.71},"last":1.23},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.7889999999999999,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":1.03}]},{"osd":6,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":2.9100000000000001,"5min":2.9100000000000001,"15min":2.9100000000000001},"last":1.5209999999999999},{"interface":"front","average":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":3.282,"5min":3.282,"15min":3.282},"last":1.1719999999999999}]},{"osd":7,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.544,"5min":1.544,"15min":1.544},"min":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"max":{"1min":2.145,"5min":2.145,"15min":2.145},"last":1.1359999999999999},{"interface":"front","average":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"min":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.927,"5min":1.927,"15min":1.927},"last":1.474}]}]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301776,"kb_used_data":392,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070064,"statfs":{"total":96636764160,"available":96327745536,"internally_reserved":0,"allocated":401408,"data_stored":157837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:01:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":2.298,"5min":2.298,"15min":2.298},"last":1.282},{"interface":"front","average":{"1min":0.998,"5min":0.998,"15min":0.998},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":2.1850000000000001,"5min":2.1850000000000001,"15min":2.1850000000000001},"last":1.024}]},{"osd":1,"last update":"Fri Oct 6 03:01:46 2023","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.974,"5min":1.974,"15min":1.974},"last":0.66300000000000003},{"interface":"front","average":{"1min":1.137,"5min":1.137,"15min":1.137},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.71,"5min":1.71,"15min":1.71},"last":1.1719999999999999}]},{"osd":2,"last update":"Fri Oct 6 03:01:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":2.8849999999999998,"5min":2.8849999999999998,"15min":2.8849999999999998},"last":0.58199999999999996},{"interface":"front","average":{"1min":1.095,"5min":1.095,"15min":1.095},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":2.8220000000000001,"5min":2.8220000000000001,"15min":2.8220000000000001},"last":0.93500000000000005}]},{"osd":4,"last update":"Fri Oct 6 03:01:46 2023","interfaces":[{"interface":"back","average":{"1min":1.456,"5min":1.456,"15min":1.456},"min":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"max":{"1min":3.6560000000000001,"5min":3.6560000000000001,"15min":3.6560000000000001},"last":0.97499999999999998},{"interface":"front","average":{"1min":1.466,"5min":1.466,"15min":1.466},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":3.7749999999999999,"5min":3.7749999999999999,"15min":3.7749999999999999},"last":0.72899999999999998}]},{"osd":5,"last update":"Fri Oct 6 03:01:46 2023","interfaces":[{"interface":"back","average":{"1min":1.534,"5min":1.534,"15min":1.534},"min":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"max":{"1min":3.4910000000000001,"5min":3.4910000000000001,"15min":3.4910000000000001},"last":0.88500000000000001},{"interface":"front","average":{"1min":1.494,"5min":1.494,"15min":1.494},"min":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"max":{"1min":2.6240000000000001,"5min":2.6240000000000001,"15min":2.6240000000000001},"last":1.3500000000000001}]},{"osd":6,"last update":"Fri Oct 6 03:01:46 2023","interfaces":[{"interface":"back","average":{"1min":1.5780000000000001,"5min":1.5780000000000001,"15min":1.5780000000000001},"min":{"1min":1.046,"5min":1.046,"15min":1.046},"max":{"1min":3.7050000000000001,"5min":3.7050000000000001,"15min":3.7050000000000001},"last":1.046},{"interface":"front","average":{"1min":1.583,"5min":1.583,"15min":1.583},"min":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"max":{"1min":3.9300000000000002,"5min":3.9300000000000002,"15min":3.9300000000000002},"last":1.151}]},{"osd":7,"last update":"Fri Oct 6 03:01:46 2023","interfaces":[{"interface":"back","average":{"1min":1.635,"5min":1.635,"15min":1.635},"min":{"1min":1.149,"5min":1.149,"15min":1.149},"max":{"1min":2.96,"5min":2.96,"15min":2.96},"last":1.409},{"interface":"front","average":{"1min":1.7729999999999999,"5min":1.7729999999999999,"15min":1.7729999999999999},"min":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"max":{"1min":3.8559999999999999,"5min":3.8559999999999999,"15min":3.8559999999999999},"last":1.2170000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301764,"kb_used_data":380,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070076,"statfs":{"total":96636764160,"available":96327757824,"internally_reserved":0,"allocated":389120,"data_stored":156337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.6950000000000001,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":0.98099999999999998}]},{"osd":1,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.5449999999999999,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":0.88700000000000001},{"interface":"front","average":{"1min":1.232,"5min":1.232,"15min":1.232},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":2.1800000000000002,"5min":2.1800000000000002,"15min":2.1800000000000002},"last":1.2010000000000001}]},{"osd":3,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.75900000000000001},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":2.806,"5min":2.806,"15min":2.806},"last":0.66200000000000003}]},{"osd":4,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.389,"5min":1.389,"15min":1.389},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":2.1739999999999999,"5min":2.1739999999999999,"15min":2.1739999999999999},"last":1.097},{"interface":"front","average":{"1min":1.458,"5min":1.458,"15min":1.458},"min":{"1min":1,"5min":1,"15min":1},"max":{"1min":3.028,"5min":3.028,"15min":3.028},"last":1.113}]},{"osd":5,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.55,"5min":1.55,"15min":1.55},"min":{"1min":1.036,"5min":1.036,"15min":1.036},"max":{"1min":3.1499999999999999,"5min":3.1499999999999999,"15min":3.1499999999999999},"last":1.292},{"interface":"front","average":{"1min":1.512,"5min":1.512,"15min":1.512},"min":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"max":{"1min":2.8580000000000001,"5min":2.8580000000000001,"15min":2.8580000000000001},"last":0.85899999999999999}]},{"osd":6,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"min":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"max":{"1min":2.6659999999999999,"5min":2.6659999999999999,"15min":2.6659999999999999},"last":1.079},{"interface":"front","average":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"min":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"max":{"1min":2.411,"5min":2.411,"15min":2.411},"last":1.0580000000000001}]},{"osd":7,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"min":{"1min":1.01,"5min":1.01,"15min":1.01},"max":{"1min":3.2160000000000002,"5min":3.2160000000000002,"15min":3.2160000000000002},"last":1.3700000000000001},{"interface":"front","average":{"1min":1.631,"5min":1.631,"15min":1.631},"min":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"max":{"1min":3.1059999999999999,"5min":3.1059999999999999,"15min":3.1059999999999999},"last":1.0349999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301764,"kb_used_data":380,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070076,"statfs":{"total":96636764160,"available":96327757824,"internally_reserved":0,"allocated":389120,"data_stored":156357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.7749999999999999,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":0.92000000000000004},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":2.3260000000000001,"5min":2.3260000000000001,"15min":2.3260000000000001},"last":1.0449999999999999}]},{"osd":2,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":3.5459999999999998,"5min":3.5459999999999998,"15min":3.5459999999999998},"last":1.141},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.706,"5min":1.706,"15min":1.706},"last":0.87}]},{"osd":3,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.625,"5min":1.625,"15min":1.625},"last":1.109},{"interface":"front","average":{"1min":1.196,"5min":1.196,"15min":1.196},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":3.331,"5min":3.331,"15min":3.331},"last":0.96499999999999997}]},{"osd":4,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.339,"5min":1.339,"15min":1.339},"min":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"max":{"1min":1.8660000000000001,"5min":1.8660000000000001,"15min":1.8660000000000001},"last":1.2370000000000001},{"interface":"front","average":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":3.2250000000000001,"5min":3.2250000000000001,"15min":3.2250000000000001},"last":2.0099999999999998}]},{"osd":5,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"min":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"max":{"1min":2.8439999999999999,"5min":2.8439999999999999,"15min":2.8439999999999999},"last":1.819},{"interface":"front","average":{"1min":1.484,"5min":1.484,"15min":1.484},"min":{"1min":1.01,"5min":1.01,"15min":1.01},"max":{"1min":2.4590000000000001,"5min":2.4590000000000001,"15min":2.4590000000000001},"last":1.542}]},{"osd":6,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"min":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"max":{"1min":2.96,"5min":2.96,"15min":2.96},"last":2.1160000000000001},{"interface":"front","average":{"1min":1.504,"5min":1.504,"15min":1.504},"min":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"max":{"1min":2.5859999999999999,"5min":2.5859999999999999,"15min":2.5859999999999999},"last":1.474}]},{"osd":7,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.6040000000000001,"5min":1.6040000000000001,"15min":1.6040000000000001},"min":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"max":{"1min":3.4460000000000002,"5min":3.4460000000000002,"15min":3.4460000000000002},"last":1.5660000000000001},{"interface":"front","average":{"1min":1.538,"5min":1.538,"15min":1.538},"min":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"max":{"1min":3.113,"5min":3.113,"15min":3.113},"last":2.214}]}]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302344,"kb_used_data":960,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069496,"statfs":{"total":96636764160,"available":96327163904,"internally_reserved":0,"allocated":983040,"data_stored":746669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.381,"5min":1.381,"15min":1.381},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.999,"5min":0.999,"15min":0.999},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.92200000000000004}]},{"osd":2,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.96499999999999997},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.794,"5min":1.794,"15min":1.794},"last":0.73799999999999999}]},{"osd":3,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.532,"5min":1.532,"15min":1.532},"last":0.89000000000000001},{"interface":"front","average":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.613,"5min":1.613,"15min":1.613},"last":0.77000000000000002}]},{"osd":4,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"min":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"max":{"1min":2.0680000000000001,"5min":2.0680000000000001,"15min":2.0680000000000001},"last":1.3460000000000001},{"interface":"front","average":{"1min":1.339,"5min":1.339,"15min":1.339},"min":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"max":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":1.325}]},{"osd":5,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"min":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"max":{"1min":1.893,"5min":1.893,"15min":1.893},"last":1.3999999999999999},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"min":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":2.2080000000000002,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":1.2310000000000001}]},{"osd":6,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.421,"5min":1.421,"15min":1.421},"min":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"max":{"1min":1.96,"5min":1.96,"15min":1.96},"last":1.177},{"interface":"front","average":{"1min":1.552,"5min":1.552,"15min":1.552},"min":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"max":{"1min":1.9910000000000001,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":1.29}]},{"osd":7,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.6319999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"min":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"max":{"1min":2.1019999999999999,"5min":2.1019999999999999,"15min":2.1019999999999999},"last":1.516},{"interface":"front","average":{"1min":1.431,"5min":1.431,"15min":1.431},"min":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"max":{"1min":2.1499999999999999,"5min":2.1499999999999999,"15min":2.1499999999999999},"last":1.1140000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:01:52.698 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-06T03:01:52.698 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-06T03:01:52.911 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.906+0000 7f49e1123700 1 Processor -- start 2023-10-06T03:01:52.911 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.906+0000 7f49e1123700 1 -- start start 2023-10-06T03:01:52.915 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.910+0000 7f49e1123700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f49dc0cb140 0x7f49dc0cb510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:52.915 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.910+0000 7f49e1123700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f49dc0b0080 0x7f49dc0b04d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:52.915 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.910+0000 7f49e1123700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49dc06c920 con 0x7f49dc06d930 2023-10-06T03:01:52.915 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.910+0000 7f49e1123700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49dc06d4a0 con 0x7f49dc0b0080 2023-10-06T03:01:52.915 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.910+0000 7f49e1123700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49dc06cb70 con 0x7f49dc0cb140 2023-10-06T03:01:52.916 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.910+0000 7f49e0922700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f49dc06d930 0x7f49dc06b330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:51996/0 (socket says 172.21.15.57:51996) 2023-10-06T03:01:52.916 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.910+0000 7f49e0922700 1 -- 172.21.15.57:0/3440984169 learned_addr learned my addr 172.21.15.57:0/3440984169 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:01:52.916 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.910+0000 7f49dbfff700 1 --2- 172.21.15.57:0/3440984169 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f49dc0cb140 0x7f49dc0cb510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:52.916 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.910+0000 7f49db7fe700 1 --2- 172.21.15.57:0/3440984169 >> v2:172.21.15.105:3300/0 conn(0x7f49dc0b0080 0x7f49dc0b04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:52.917 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.910+0000 7f49daffd700 1 -- 172.21.15.57:0/3440984169 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 173545992 0 0) 0x7f49dc06c920 con 0x7f49dc06d930 2023-10-06T03:01:52.917 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.910+0000 7f49dbfff700 1 -- 172.21.15.57:0/3440984169 >> v2:172.21.15.105:3300/0 conn(0x7f49dc0b0080 msgr2=0x7f49dc0b04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:52.917 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.910+0000 7f49dbfff700 1 --2- 172.21.15.57:0/3440984169 >> v2:172.21.15.105:3300/0 conn(0x7f49dc0b0080 0x7f49dc0b04d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:52.917 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.910+0000 7f49dbfff700 1 -- 172.21.15.57:0/3440984169 >> v1:172.21.15.57:6789/0 conn(0x7f49dc06d930 legacy=0x7f49dc06b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:52.917 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.910+0000 7f49dbfff700 1 -- 172.21.15.57:0/3440984169 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49dc06ce50 con 0x7f49dc0cb140 2023-10-06T03:01:52.917 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.910+0000 7f49dbfff700 1 --2- 172.21.15.57:0/3440984169 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f49dc0cb140 0x7f49dc0cb510 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f49cc0098e0 tx=0x7f49cc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e01b3e24b8b05c10 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:52.918 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.910+0000 7f49daffd700 1 -- 172.21.15.57:0/3440984169 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49cc00b640 con 0x7f49dc0cb140 2023-10-06T03:01:52.918 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.910+0000 7f49daffd700 1 -- 172.21.15.57:0/3440984169 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49cc00b7a0 con 0x7f49dc0cb140 2023-10-06T03:01:52.918 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.910+0000 7f49daffd700 1 -- 172.21.15.57:0/3440984169 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49cc00bb40 con 0x7f49dc0cb140 2023-10-06T03:01:52.918 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.910+0000 7f49e1123700 1 -- 172.21.15.57:0/3440984169 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f49dc0cb140 msgr2=0x7f49dc0cb510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:52.918 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.910+0000 7f49e1123700 1 --2- 172.21.15.57:0/3440984169 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f49dc0cb140 0x7f49dc0cb510 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f49cc0098e0 tx=0x7f49cc0091a0 comp rx=0 tx=0).stop 2023-10-06T03:01:52.918 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.910+0000 7f49e1123700 1 -- 172.21.15.57:0/3440984169 shutdown_connections 2023-10-06T03:01:52.918 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.910+0000 7f49e1123700 1 --2- 172.21.15.57:0/3440984169 >> v2:172.21.15.105:3300/0 conn(0x7f49dc0b0080 0x7f49dc0b04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:52.918 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.910+0000 7f49e1123700 1 --2- 172.21.15.57:0/3440984169 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f49dc0cb140 0x7f49dc0cb510 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:52.919 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.910+0000 7f49e1123700 1 -- 172.21.15.57:0/3440984169 >> 172.21.15.57:0/3440984169 conn(0x7f49dc0d0a50 msgr2=0x7f49dc0cca60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:52.919 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.910+0000 7f49e1123700 1 -- 172.21.15.57:0/3440984169 shutdown_connections 2023-10-06T03:01:52.919 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.910+0000 7f49e1123700 1 -- 172.21.15.57:0/3440984169 wait complete. 2023-10-06T03:01:52.919 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.914+0000 7f49e1123700 1 Processor -- start 2023-10-06T03:01:52.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.914+0000 7f49e1123700 1 -- start start 2023-10-06T03:01:52.921 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.914+0000 7f49e1123700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f49dc06d930 0x7f49dc168960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:52.921 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.914+0000 7f49e1123700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f49dc0b0080 0x7f49dc0c5d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:52.921 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.914+0000 7f49e1123700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f49dc0cb140 0x7f49dc155bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:52.921 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.914+0000 7f49e1123700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49dc0b3990 con 0x7f49dc0cb140 2023-10-06T03:01:52.922 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.914+0000 7f49e1123700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49dc168ea0 con 0x7f49dc0b0080 2023-10-06T03:01:52.922 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.914+0000 7f49e1123700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49dc0b2da0 con 0x7f49dc06d930 2023-10-06T03:01:52.922 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.914+0000 7f49e0922700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f49dc0cb140 0x7f49dc155bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:52.923 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.914+0000 7f49e0922700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f49dc0cb140 0x7f49dc155bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58966/0 (socket says 172.21.15.57:58966) 2023-10-06T03:01:52.923 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.914+0000 7f49e0922700 1 -- 172.21.15.57:0/2997922414 learned_addr learned my addr 172.21.15.57:0/2997922414 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:52.923 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.914+0000 7f49db7fe700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f49dc0b0080 0x7f49dc0c5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:52.923 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.914+0000 7f49dbfff700 1 --2- 172.21.15.57:0/2997922414 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f49dc06d930 0x7f49dc168960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:52.923 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.918+0000 7f49e0922700 1 -- 172.21.15.57:0/2997922414 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f49dc06d930 msgr2=0x7f49dc168960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:52.923 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.918+0000 7f49e0922700 1 --2- 172.21.15.57:0/2997922414 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f49dc06d930 0x7f49dc168960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:52.923 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.918+0000 7f49e0922700 1 -- 172.21.15.57:0/2997922414 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f49dc0b0080 msgr2=0x7f49dc0c5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:52.923 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.918+0000 7f49e0922700 1 --2- 172.21.15.57:0/2997922414 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f49dc0b0080 0x7f49dc0c5d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:52.923 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.918+0000 7f49e0922700 1 -- 172.21.15.57:0/2997922414 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49cc009420 con 0x7f49dc0cb140 2023-10-06T03:01:52.923 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.918+0000 7f49db7fe700 1 --2- 172.21.15.57:0/2997922414 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f49dc0b0080 0x7f49dc0c5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:01:52.923 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.918+0000 7f49dbfff700 1 --2- 172.21.15.57:0/2997922414 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f49dc06d930 0x7f49dc168960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:01:52.924 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.918+0000 7f49e0922700 1 --2- 172.21.15.57:0/2997922414 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f49dc0cb140 0x7f49dc155bb0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f49d400cc40 tx=0x7f49d4001970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:52.924 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.918+0000 7f49c3fff700 1 -- 172.21.15.57:0/2997922414 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d400a810 con 0x7f49dc0cb140 2023-10-06T03:01:52.924 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.918+0000 7f49c3fff700 1 -- 172.21.15.57:0/2997922414 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49d400a990 con 0x7f49dc0cb140 2023-10-06T03:01:52.924 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.918+0000 7f49c3fff700 1 -- 172.21.15.57:0/2997922414 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d400ad50 con 0x7f49dc0cb140 2023-10-06T03:01:52.925 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.918+0000 7f49e1123700 1 -- 172.21.15.57:0/2997922414 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49dc0b2ff0 con 0x7f49dc0cb140 2023-10-06T03:01:52.925 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.918+0000 7f49e1123700 1 -- 172.21.15.57:0/2997922414 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49dc0b35b0 con 0x7f49dc0cb140 2023-10-06T03:01:52.926 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.918+0000 7f49e1123700 1 -- 172.21.15.57:0/2997922414 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49dc0b3ad0 con 0x7f49dc0cb140 2023-10-06T03:01:52.927 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.922+0000 7f49c3fff700 1 -- 172.21.15.57:0/2997922414 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f49d4007300 con 0x7f49dc0cb140 2023-10-06T03:01:52.929 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.922+0000 7f49c3fff700 1 --2- 172.21.15.57:0/2997922414 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f49c8060550 0x7f49c8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:52.929 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.922+0000 7f49c3fff700 1 -- 172.21.15.57:0/2997922414 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f49d407cc60 con 0x7f49dc0cb140 2023-10-06T03:01:52.929 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.922+0000 7f49dbfff700 1 --2- 172.21.15.57:0/2997922414 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f49c8060550 0x7f49c8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:52.930 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.922+0000 7f49dbfff700 1 --2- 172.21.15.57:0/2997922414 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f49c8060550 0x7f49c8062a00 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f49cc0091e0 tx=0x7f49cc017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:52.935 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:52.930+0000 7f49c3fff700 1 -- 172.21.15.57:0/2997922414 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f49dc0b3ad0 con 0x7f49dc0cb140 2023-10-06T03:01:53.165 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:53.158+0000 7f49e1123700 1 -- 172.21.15.57:0/2997922414 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f49dc0b3ad0 con 0x7f49dc0cb140 2023-10-06T03:01:53.176 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:53.170+0000 7f49c3fff700 1 -- 172.21.15.57:0/2997922414 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) v1 ==== 190+0+0 (secure 0 0 0) 0x7f49dc0b3ad0 con 0x7f49dc0cb140 2023-10-06T03:01:53.179 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:53.174+0000 7f49e1123700 1 -- 172.21.15.57:0/2997922414 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f49c8060550 msgr2=0x7f49c8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:53.180 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:53.174+0000 7f49e1123700 1 --2- 172.21.15.57:0/2997922414 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f49c8060550 0x7f49c8062a00 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f49cc0091e0 tx=0x7f49cc017000 comp rx=0 tx=0).stop 2023-10-06T03:01:53.180 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:53.174+0000 7f49e1123700 1 -- 172.21.15.57:0/2997922414 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f49dc0cb140 msgr2=0x7f49dc155bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:53.180 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:53.174+0000 7f49e1123700 1 --2- 172.21.15.57:0/2997922414 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f49dc0cb140 0x7f49dc155bb0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f49d400cc40 tx=0x7f49d4001970 comp rx=0 tx=0).stop 2023-10-06T03:01:53.180 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:53.174+0000 7f49e1123700 1 -- 172.21.15.57:0/2997922414 shutdown_connections 2023-10-06T03:01:53.180 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:53.174+0000 7f49e1123700 1 --2- 172.21.15.57:0/2997922414 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f49dc0cb140 0x7f49dc155bb0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:53.180 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:53.174+0000 7f49e1123700 1 --2- 172.21.15.57:0/2997922414 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f49dc0b0080 0x7f49dc0c5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:53.180 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:53.174+0000 7f49e1123700 1 --2- 172.21.15.57:0/2997922414 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f49c8060550 0x7f49c8062a00 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:53.180 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:53.174+0000 7f49e1123700 1 --2- 172.21.15.57:0/2997922414 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f49dc06d930 0x7f49dc168960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:53.180 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:53.174+0000 7f49e1123700 1 -- 172.21.15.57:0/2997922414 >> 172.21.15.57:0/2997922414 conn(0x7f49dc0d0a50 msgr2=0x7f49dc0b0aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:53.180 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:53.174+0000 7f49e1123700 1 -- 172.21.15.57:0/2997922414 shutdown_connections 2023-10-06T03:01:53.180 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:53.174+0000 7f49e1123700 1 -- 172.21.15.57:0/2997922414 wait complete. 2023-10-06T03:01:53.181 INFO:teuthology.orchestra.run.smithi057.stderr:updated caps for client.0 2023-10-06T03:01:53.199 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:01:53.362 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:53.354+0000 7f4fec82e700 1 Processor -- start 2023-10-06T03:01:53.362 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:53.354+0000 7f4fec82e700 1 -- start start 2023-10-06T03:01:53.365 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:53.358+0000 7f4fec82e700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f4fe8155f70 0x7f4fe8156340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:53.365 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:53.358+0000 7f4fec82e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4fe806eda0 0x7f4fe80ca9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:53.366 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:53.358+0000 7f4fec82e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fe80b0480 con 0x7f4fe806f1c0 2023-10-06T03:01:53.366 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:53.358+0000 7f4fec82e700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fe80b0c70 con 0x7f4fe8155f70 2023-10-06T03:01:53.366 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:53.358+0000 7f4fec82e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fe806e910 con 0x7f4fe806eda0 2023-10-06T03:01:53.366 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:53.358+0000 7f4fe6d9d700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f4fe806f1c0 0x7f4fe80b1e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:52000/0 (socket says 172.21.15.57:52000) 2023-10-06T03:01:53.366 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:53.358+0000 7f4fe5d9b700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4fe806eda0 0x7f4fe80ca9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:53.367 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:53.358+0000 7f4fe6d9d700 1 -- 172.21.15.57:0/2314284860 learned_addr learned my addr 172.21.15.57:0/2314284860 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:01:53.367 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:53.358+0000 7f4fe659c700 1 --2- 172.21.15.57:0/2314284860 >> v2:172.21.15.105:3300/0 conn(0x7f4fe8155f70 0x7f4fe8156340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:53.367 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:53.362+0000 7f4fe5d9b700 1 -- 172.21.15.57:0/2314284860 >> v2:172.21.15.105:3300/0 conn(0x7f4fe8155f70 msgr2=0x7f4fe8156340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:53.367 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:53.362+0000 7f4fe5d9b700 1 --2- 172.21.15.57:0/2314284860 >> v2:172.21.15.105:3300/0 conn(0x7f4fe8155f70 0x7f4fe8156340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:53.367 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:53.362+0000 7f4fe5d9b700 1 -- 172.21.15.57:0/2314284860 >> v1:172.21.15.57:6789/0 conn(0x7f4fe806f1c0 legacy=0x7f4fe80b1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:53.368 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:53.362+0000 7f4fe559a700 1 -- 172.21.15.57:0/2314284860 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3145364110 0 0) 0x7f4fe80b0480 con 0x7f4fe806f1c0 2023-10-06T03:01:53.368 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:53.362+0000 7f4fe5d9b700 1 -- 172.21.15.57:0/2314284860 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fe806e5e0 con 0x7f4fe806eda0 2023-10-06T03:01:53.368 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:53.362+0000 7f4fe5d9b700 1 --2- 172.21.15.57:0/2314284860 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4fe806eda0 0x7f4fe80ca9d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc00bb90 tx=0x7f4fdc00b430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1fc5699e341d058f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:53.369 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:53.362+0000 7f4fe559a700 1 -- 172.21.15.57:0/2314284860 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fdc00db40 con 0x7f4fe806eda0 2023-10-06T03:01:53.369 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:53.362+0000 7f4fe559a700 1 -- 172.21.15.57:0/2314284860 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fdc00dca0 con 0x7f4fe806eda0 2023-10-06T03:01:53.369 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:53.362+0000 7f4fe559a700 1 -- 172.21.15.57:0/2314284860 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fdc0196b0 con 0x7f4fe806eda0 2023-10-06T03:01:53.369 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:53.362+0000 7f4fec82e700 1 -- 172.21.15.57:0/2314284860 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4fe806eda0 msgr2=0x7f4fe80ca9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:53.369 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:53.362+0000 7f4fec82e700 1 --2- 172.21.15.57:0/2314284860 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4fe806eda0 0x7f4fe80ca9d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc00bb90 tx=0x7f4fdc00b430 comp rx=0 tx=0).stop 2023-10-06T03:01:53.370 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:53.362+0000 7f4fec82e700 1 -- 172.21.15.57:0/2314284860 shutdown_connections 2023-10-06T03:01:53.370 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:53.362+0000 7f4fec82e700 1 --2- 172.21.15.57:0/2314284860 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4fe806eda0 0x7f4fe80ca9d0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:53.370 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:53.362+0000 7f4fec82e700 1 --2- 172.21.15.57:0/2314284860 >> v2:172.21.15.105:3300/0 conn(0x7f4fe8155f70 0x7f4fe8156340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:53.370 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:53.362+0000 7f4fec82e700 1 -- 172.21.15.57:0/2314284860 >> 172.21.15.57:0/2314284860 conn(0x7f4fe80961f0 msgr2=0x7f4fe80afd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:53.370 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:53.362+0000 7f4fec82e700 1 -- 172.21.15.57:0/2314284860 shutdown_connections 2023-10-06T03:01:53.371 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:53.362+0000 7f4fec82e700 1 -- 172.21.15.57:0/2314284860 wait complete. 2023-10-06T03:01:53.372 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:53.366+0000 7f4fec82e700 1 Processor -- start 2023-10-06T03:01:53.372 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:53.366+0000 7f4fec82e700 1 -- start start 2023-10-06T03:01:53.373 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:53.366+0000 7f4fec82e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4fe806eda0 0x7f4fe81693b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:53.373 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:53.366+0000 7f4fec82e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4fe8155f70 0x7f4fe80c9c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:53.373 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:53.366+0000 7f4fec82e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4fe80c83c0 0x7f4fe815af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:53.373 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:53.366+0000 7f4fec82e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fe80c8830 con 0x7f4fe8155f70 2023-10-06T03:01:53.374 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:53.366+0000 7f4fec82e700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fe80c8b10 con 0x7f4fe80c83c0 2023-10-06T03:01:53.374 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:53.366+0000 7f4fec82e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fe80c8df0 con 0x7f4fe806eda0 2023-10-06T03:01:53.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:53.366+0000 7f4fe5d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4fe8155f70 0x7f4fe80c9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:53.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:53.366+0000 7f4fe5d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4fe8155f70 0x7f4fe80c9c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58974/0 (socket says 172.21.15.57:58974) 2023-10-06T03:01:53.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:53.366+0000 7f4fe5d9b700 1 -- 172.21.15.57:0/537741467 learned_addr learned my addr 172.21.15.57:0/537741467 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:53.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:53.366+0000 7f4fe659c700 1 --2- 172.21.15.57:0/537741467 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4fe806eda0 0x7f4fe81693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:53.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:53.366+0000 7f4fe6d9d700 1 --2- 172.21.15.57:0/537741467 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4fe80c83c0 0x7f4fe815af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:53.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:53.370+0000 7f4fe659c700 1 -- 172.21.15.57:0/537741467 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4fe80c83c0 msgr2=0x7f4fe815af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:53.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:53.370+0000 7f4fe659c700 1 --2- 172.21.15.57:0/537741467 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4fe80c83c0 0x7f4fe815af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:53.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:53.370+0000 7f4fe659c700 1 -- 172.21.15.57:0/537741467 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4fe8155f70 msgr2=0x7f4fe80c9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:53.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:53.370+0000 7f4fe659c700 1 --2- 172.21.15.57:0/537741467 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4fe8155f70 0x7f4fe80c9c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:53.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:53.370+0000 7f4fe659c700 1 -- 172.21.15.57:0/537741467 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fdc00b6d0 con 0x7f4fe806eda0 2023-10-06T03:01:53.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:53.370+0000 7f4fe5d9b700 1 --2- 172.21.15.57:0/537741467 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4fe8155f70 0x7f4fe80c9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:01:53.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:53.370+0000 7f4fe659c700 1 --2- 172.21.15.57:0/537741467 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4fe806eda0 0x7f4fe81693b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4fd800e980 tx=0x7f4fd8009120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:53.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:53.370+0000 7f4fd67fc700 1 -- 172.21.15.57:0/537741467 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fd800ee70 con 0x7f4fe806eda0 2023-10-06T03:01:53.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:53.370+0000 7f4fd67fc700 1 -- 172.21.15.57:0/537741467 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fd800c850 con 0x7f4fe806eda0 2023-10-06T03:01:53.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:53.370+0000 7f4fec82e700 1 -- 172.21.15.57:0/537741467 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fe80c90d0 con 0x7f4fe806eda0 2023-10-06T03:01:53.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:53.370+0000 7f4fd67fc700 1 -- 172.21.15.57:0/537741467 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fd800cbf0 con 0x7f4fe806eda0 2023-10-06T03:01:53.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:53.370+0000 7f4fec82e700 1 -- 172.21.15.57:0/537741467 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fe815b4c0 con 0x7f4fe806eda0 2023-10-06T03:01:53.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:53.370+0000 7f4fec82e700 1 -- 172.21.15.57:0/537741467 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fe80712e0 con 0x7f4fe806eda0 2023-10-06T03:01:53.379 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:53.374+0000 7f4fd67fc700 1 -- 172.21.15.57:0/537741467 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f4fd8013470 con 0x7f4fe806eda0 2023-10-06T03:01:53.381 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:53.374+0000 7f4fd67fc700 1 --2- 172.21.15.57:0/537741467 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f4fc8060550 0x7f4fc8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:53.381 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:53.374+0000 7f4fd67fc700 1 -- 172.21.15.57:0/537741467 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4fd807ceb0 con 0x7f4fe806eda0 2023-10-06T03:01:53.381 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:53.374+0000 7f4fe5d9b700 1 --2- 172.21.15.57:0/537741467 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f4fc8060550 0x7f4fc8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:53.382 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:53.378+0000 7f4fe5d9b700 1 --2- 172.21.15.57:0/537741467 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f4fc8060550 0x7f4fc8062a00 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f4fe8068cb0 tx=0x7f4fdc01b000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:53.389 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:53.382+0000 7f4fd67fc700 1 -- 172.21.15.57:0/537741467 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f4fd8050d30 con 0x7f4fe806eda0 2023-10-06T03:01:53.593 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:53.586+0000 7f4fec82e700 1 -- 172.21.15.57:0/537741467 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4fe80cc980 con 0x7f4fe806eda0 2023-10-06T03:01:53.595 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:53.590+0000 7f4fd67fc700 1 -- 172.21.15.57:0/537741467 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4603 (secure 0 0 0) 0x7f4fd80508c0 con 0x7f4fe806eda0 2023-10-06T03:01:53.595 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:01:53.595 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/3196581081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":3196581081},{"type":"v1","addr":"172.21.15.105:6835","nonce":3196581081}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4980,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/3842897946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":3842897946},{"type":"v1","addr":"172.21.15.57:6835","nonce":3842897946}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4986,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6837/1629829999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6836","nonce":1629829999},{"type":"v1","addr":"172.21.15.57:6837","nonce":1629829999}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:01:47.353461+0000","modified":"2023-10-06T03:01:50.987438+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4989},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4989":{"gid":4989,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.105:6834/1325054263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":1325054263},{"type":"v1","addr":"172.21.15.105:6834","nonce":1325054263}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T03:01:53.599 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:53.594+0000 7f4fec82e700 1 -- 172.21.15.57:0/537741467 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f4fc8060550 msgr2=0x7f4fc8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:53.599 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:53.594+0000 7f4fec82e700 1 --2- 172.21.15.57:0/537741467 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f4fc8060550 0x7f4fc8062a00 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f4fe8068cb0 tx=0x7f4fdc01b000 comp rx=0 tx=0).stop 2023-10-06T03:01:53.600 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:53.594+0000 7f4fec82e700 1 -- 172.21.15.57:0/537741467 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4fe806eda0 msgr2=0x7f4fe81693b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:53.600 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:53.594+0000 7f4fec82e700 1 --2- 172.21.15.57:0/537741467 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4fe806eda0 0x7f4fe81693b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4fd800e980 tx=0x7f4fd8009120 comp rx=0 tx=0).stop 2023-10-06T03:01:53.600 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:53.594+0000 7f4fec82e700 1 -- 172.21.15.57:0/537741467 shutdown_connections 2023-10-06T03:01:53.600 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:53.594+0000 7f4fec82e700 1 --2- 172.21.15.57:0/537741467 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4fe80c83c0 0x7f4fe815af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:53.600 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:53.594+0000 7f4fec82e700 1 --2- 172.21.15.57:0/537741467 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4fe8155f70 0x7f4fe80c9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:53.600 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:53.594+0000 7f4fec82e700 1 --2- 172.21.15.57:0/537741467 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f4fc8060550 0x7f4fc8062a00 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:53.600 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:53.594+0000 7f4fec82e700 1 --2- 172.21.15.57:0/537741467 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4fe806eda0 0x7f4fe81693b0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:53.600 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:53.594+0000 7f4fec82e700 1 -- 172.21.15.57:0/537741467 >> 172.21.15.57:0/537741467 conn(0x7f4fe80961f0 msgr2=0x7f4fe8067630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:53.600 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:53.594+0000 7f4fec82e700 1 -- 172.21.15.57:0/537741467 shutdown_connections 2023-10-06T03:01:53.600 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:53.594+0000 7f4fec82e700 1 -- 172.21.15.57:0/537741467 wait complete. 2023-10-06T03:01:53.602 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 17 2023-10-06T03:01:54.023 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T03:01:47.353461+0000', 'modified': '2023-10-06T03:01:50.987438+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4989}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4989': {'gid': 4989, 'name': 'b', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.105:6834/1325054263', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.105:6832', 'nonce': 1325054263}, {'type': 'v1', 'addr': '172.21.15.105:6834', 'nonce': 1325054263}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T03:01:54.023 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T03:01:54.024 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-06T03:01:54.187 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.182+0000 7fdf5640c700 1 Processor -- start 2023-10-06T03:01:54.187 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.182+0000 7fdf5640c700 1 -- start start 2023-10-06T03:01:54.190 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.182+0000 7fdf5640c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fdf50158dc0 0x7fdf500cc660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:54.191 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.182+0000 7fdf5640c700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf5006b020 con 0x7fdf5006b4b0 2023-10-06T03:01:54.191 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.186+0000 7fdf5640c700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf5006a6f0 con 0x7fdf50159190 2023-10-06T03:01:54.191 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.186+0000 7fdf5640c700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf5006a9d0 con 0x7fdf50158dc0 2023-10-06T03:01:54.191 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.186+0000 7fdf5540a700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fdf50158dc0 0x7fdf500cc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:54.191 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.186+0000 7fdf54c09700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fdf5006b4b0 0x7fdf5015ccb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:52016/0 (socket says 172.21.15.57:52016) 2023-10-06T03:01:54.191 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.186+0000 7fdf54c09700 1 -- 172.21.15.57:0/3505228120 learned_addr learned my addr 172.21.15.57:0/3505228120 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:01:54.192 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.186+0000 7fdf5540a700 1 -- 172.21.15.57:0/3505228120 >> v1:172.21.15.105:6789/0 conn(0x7fdf50159190 legacy=0x7fdf500ca4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:54.192 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.186+0000 7fdf5540a700 1 -- 172.21.15.57:0/3505228120 >> v1:172.21.15.57:6789/0 conn(0x7fdf5006b4b0 legacy=0x7fdf5015ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:54.192 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.186+0000 7fdf5540a700 1 -- 172.21.15.57:0/3505228120 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf5006acb0 con 0x7fdf50158dc0 2023-10-06T03:01:54.192 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.186+0000 7fdf5540a700 1 --2- 172.21.15.57:0/3505228120 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdf50158dc0 0x7fdf500cc660 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fdf4c0098e0 tx=0x7fdf4c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a15624e1b7d0303 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:54.193 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.186+0000 7fdf47fff700 1 -- 172.21.15.57:0/3505228120 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf4c009e80 con 0x7fdf50158dc0 2023-10-06T03:01:54.193 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.186+0000 7fdf47fff700 1 -- 172.21.15.57:0/3505228120 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf4c00b860 con 0x7fdf50158dc0 2023-10-06T03:01:54.193 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.186+0000 7fdf47fff700 1 -- 172.21.15.57:0/3505228120 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf4c00bbe0 con 0x7fdf50158dc0 2023-10-06T03:01:54.193 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.186+0000 7fdf5640c700 1 -- 172.21.15.57:0/3505228120 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdf50158dc0 msgr2=0x7fdf500cc660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:54.193 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.186+0000 7fdf5640c700 1 --2- 172.21.15.57:0/3505228120 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdf50158dc0 0x7fdf500cc660 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fdf4c0098e0 tx=0x7fdf4c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:01:54.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.186+0000 7fdf5640c700 1 -- 172.21.15.57:0/3505228120 shutdown_connections 2023-10-06T03:01:54.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.186+0000 7fdf5640c700 1 --2- 172.21.15.57:0/3505228120 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdf50158dc0 0x7fdf500cc660 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:54.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.186+0000 7fdf5640c700 1 -- 172.21.15.57:0/3505228120 >> 172.21.15.57:0/3505228120 conn(0x7fdf50067050 msgr2=0x7fdf50067450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:54.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.186+0000 7fdf5640c700 1 -- 172.21.15.57:0/3505228120 shutdown_connections 2023-10-06T03:01:54.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.186+0000 7fdf5640c700 1 -- 172.21.15.57:0/3505228120 wait complete. 2023-10-06T03:01:54.196 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.190+0000 7fdf5640c700 1 Processor -- start 2023-10-06T03:01:54.196 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.190+0000 7fdf5640c700 1 -- start start 2023-10-06T03:01:54.198 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.190+0000 7fdf5640c700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdf5006b4b0 0x7fdf500870c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:54.198 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.190+0000 7fdf5640c700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdf50158dc0 0x7fdf50087600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:54.198 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.190+0000 7fdf5640c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdf50159190 0x7fdf5015a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:54.199 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.190+0000 7fdf5640c700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf50088a40 con 0x7fdf50159190 2023-10-06T03:01:54.199 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.190+0000 7fdf5640c700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf50087e30 con 0x7fdf50158dc0 2023-10-06T03:01:54.199 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.190+0000 7fdf5640c700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf50088110 con 0x7fdf5006b4b0 2023-10-06T03:01:54.199 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.190+0000 7fdf55c0b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdf50159190 0x7fdf5015a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:54.199 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.194+0000 7fdf55c0b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdf50159190 0x7fdf5015a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:59002/0 (socket says 172.21.15.57:59002) 2023-10-06T03:01:54.199 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.194+0000 7fdf55c0b700 1 -- 172.21.15.57:0/3678370259 learned_addr learned my addr 172.21.15.57:0/3678370259 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:54.200 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.194+0000 7fdf54c09700 1 --2- 172.21.15.57:0/3678370259 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdf50158dc0 0x7fdf50087600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:54.200 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.194+0000 7fdf5540a700 1 --2- 172.21.15.57:0/3678370259 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdf5006b4b0 0x7fdf500870c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:54.200 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.194+0000 7fdf55c0b700 1 -- 172.21.15.57:0/3678370259 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdf5006b4b0 msgr2=0x7fdf500870c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:54.200 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.194+0000 7fdf55c0b700 1 --2- 172.21.15.57:0/3678370259 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdf5006b4b0 0x7fdf500870c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:54.201 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.194+0000 7fdf55c0b700 1 -- 172.21.15.57:0/3678370259 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdf50158dc0 msgr2=0x7fdf50087600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:54.201 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.194+0000 7fdf55c0b700 1 --2- 172.21.15.57:0/3678370259 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdf50158dc0 0x7fdf50087600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:54.201 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.194+0000 7fdf55c0b700 1 -- 172.21.15.57:0/3678370259 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf4c009420 con 0x7fdf50159190 2023-10-06T03:01:54.201 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.194+0000 7fdf55c0b700 1 --2- 172.21.15.57:0/3678370259 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdf50159190 0x7fdf5015a690 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fdf4800c840 tx=0x7fdf48001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:54.201 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.194+0000 7fdf457fa700 1 -- 172.21.15.57:0/3678370259 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf48012630 con 0x7fdf50159190 2023-10-06T03:01:54.201 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.194+0000 7fdf457fa700 1 -- 172.21.15.57:0/3678370259 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf480127b0 con 0x7fdf50159190 2023-10-06T03:01:54.201 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.194+0000 7fdf457fa700 1 -- 172.21.15.57:0/3678370259 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf48012b70 con 0x7fdf50159190 2023-10-06T03:01:54.201 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.194+0000 7fdf5640c700 1 -- 172.21.15.57:0/3678370259 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf500883f0 con 0x7fdf50159190 2023-10-06T03:01:54.201 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.194+0000 7fdf5640c700 1 -- 172.21.15.57:0/3678370259 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf50087b40 con 0x7fdf50159190 2023-10-06T03:01:54.203 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.198+0000 7fdf457fa700 1 -- 172.21.15.57:0/3678370259 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fdf48003030 con 0x7fdf50159190 2023-10-06T03:01:54.204 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.198+0000 7fdf457fa700 1 --2- 172.21.15.57:0/3678370259 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fdf34060580 0x7fdf34062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:54.205 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.198+0000 7fdf457fa700 1 -- 172.21.15.57:0/3678370259 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fdf4807c950 con 0x7fdf50159190 2023-10-06T03:01:54.205 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.198+0000 7fdf5540a700 1 --2- 172.21.15.57:0/3678370259 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fdf34060580 0x7fdf34062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:54.206 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.198+0000 7fdf5540a700 1 --2- 172.21.15.57:0/3678370259 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fdf34060580 0x7fdf34062a30 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fdf4c0093f0 tx=0x7fdf4c017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:54.207 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.202+0000 7fdf59913740 1 Processor -- start 2023-10-06T03:01:54.207 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.202+0000 7fdf59913740 1 -- start start 2023-10-06T03:01:54.208 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.202+0000 7fdf59913740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0xe79ae0 0x10f6e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:54.208 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.202+0000 7fdf59913740 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0xe79710 0x10f7390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:54.208 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.202+0000 7fdf59913740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0xec4790 0x10f78d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:54.208 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.202+0000 7fdf59913740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x1024f30 con 0xec4790 2023-10-06T03:01:54.208 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.202+0000 7fdf59913740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x1020ed0 con 0xe79ae0 2023-10-06T03:01:54.209 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.202+0000 7fdf59913740 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0xfe70b0 con 0xe79710 2023-10-06T03:01:54.209 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.202+0000 7fdf55c0b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0xec4790 0x10f78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:54.210 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.202+0000 7fdf55c0b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0xec4790 0x10f78d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:59010/0 (socket says 172.21.15.57:59010) 2023-10-06T03:01:54.210 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.202+0000 7fdf55c0b700 1 -- 172.21.15.57:0/3115563451 learned_addr learned my addr 172.21.15.57:0/3115563451 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:54.210 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.202+0000 7fdf5540a700 1 --2- 172.21.15.57:0/3115563451 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0xe79ae0 0x10f6e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:54.210 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.202+0000 7fdf54c09700 1 --2- 172.21.15.57:0/3115563451 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0xe79710 0x10f7390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:54.210 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.202+0000 7fdf55c0b700 1 -- 172.21.15.57:0/3115563451 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0xe79710 msgr2=0x10f7390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:54.210 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.202+0000 7fdf55c0b700 1 --2- 172.21.15.57:0/3115563451 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0xe79710 0x10f7390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:54.210 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.202+0000 7fdf55c0b700 1 -- 172.21.15.57:0/3115563451 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0xe79ae0 msgr2=0x10f6e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:54.210 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.202+0000 7fdf55c0b700 1 --2- 172.21.15.57:0/3115563451 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0xe79ae0 0x10f6e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:54.210 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.202+0000 7fdf55c0b700 1 -- 172.21.15.57:0/3115563451 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xec59e0 con 0xec4790 2023-10-06T03:01:54.210 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.202+0000 7fdf55c0b700 1 --2- 172.21.15.57:0/3115563451 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0xec4790 0x10f78d0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fdf48012040 tx=0x7fdf4807abd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8eb9d9cfdc30c412 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:54.211 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.202+0000 7fdf3a7fc700 1 -- 172.21.15.57:0/3115563451 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf48053d10 con 0xec4790 2023-10-06T03:01:54.211 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.202+0000 7fdf3a7fc700 1 -- 172.21.15.57:0/3115563451 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf480579e0 con 0xec4790 2023-10-06T03:01:54.212 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.202+0000 7fdf3a7fc700 1 -- 172.21.15.57:0/3115563451 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf4804eb40 con 0xec4790 2023-10-06T03:01:54.212 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.206+0000 7fdf59913740 1 -- 172.21.15.57:0/3115563451 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0xec4790 msgr2=0x10f78d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:54.212 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.206+0000 7fdf59913740 1 --2- 172.21.15.57:0/3115563451 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0xec4790 0x10f78d0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fdf48012040 tx=0x7fdf4807abd0 comp rx=0 tx=0).stop 2023-10-06T03:01:54.212 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.206+0000 7fdf59913740 1 -- 172.21.15.57:0/3115563451 shutdown_connections 2023-10-06T03:01:54.212 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.206+0000 7fdf59913740 1 --2- 172.21.15.57:0/3115563451 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0xec4790 0x10f78d0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:54.212 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.206+0000 7fdf59913740 1 --2- 172.21.15.57:0/3115563451 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0xe79710 0x10f7390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:54.212 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.206+0000 7fdf59913740 1 --2- 172.21.15.57:0/3115563451 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0xe79ae0 0x10f6e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:54.212 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.206+0000 7fdf59913740 1 -- 172.21.15.57:0/3115563451 >> 172.21.15.57:0/3115563451 conn(0xe79eb0 msgr2=0x10b3880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:54.212 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.206+0000 7fdf59913740 1 -- 172.21.15.57:0/3115563451 shutdown_connections 2023-10-06T03:01:54.212 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.206+0000 7fdf59913740 1 -- 172.21.15.57:0/3115563451 wait complete. 2023-10-06T03:01:54.213 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.206+0000 7fdf59913740 1 -- start start 2023-10-06T03:01:54.213 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.206+0000 7fdf59913740 1 Processor -- start 2023-10-06T03:01:54.215 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.210+0000 7fdf59913740 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0xe79710 0x10dcc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:54.215 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.210+0000 7fdf59913740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0xe79ae0 0x10dd140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:54.215 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.210+0000 7fdf59913740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0xec4790 0x10dd680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:54.216 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.210+0000 7fdf59913740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0xfe6d50 con 0xe79ae0 2023-10-06T03:01:54.216 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.210+0000 7fdf59913740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0xfbf970 con 0xec4790 2023-10-06T03:01:54.216 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.210+0000 7fdf59913740 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0xfe8be0 con 0xe79710 2023-10-06T03:01:54.216 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.210+0000 7fdf59913740 10 client.0 _ll_register_callbacks cb 0x106ab00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:01:54.217 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.210+0000 7fdf54c09700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0xe79ae0 0x10dd140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:54.217 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.210+0000 7fdf5540a700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0xe79710 0x10dcc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:54.217 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.210+0000 7fdf54c09700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0xe79ae0 0x10dd140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:59012/0 (socket says 172.21.15.57:59012) 2023-10-06T03:01:54.217 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.210+0000 7fdf55c0b700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0xec4790 0x10dd680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:54.217 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.210+0000 7fdf5540a700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0xe79710 0x10dcc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.57:36366/0 (socket says 172.21.15.57:36366) 2023-10-06T03:01:54.217 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.210+0000 7fdf54c09700 1 -- 172.21.15.57:0/1360323745 learned_addr learned my addr 172.21.15.57:0/1360323745 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:54.217 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.210+0000 7fdf54c09700 1 -- 172.21.15.57:0/1360323745 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0xe79710 msgr2=0x10dcc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:54.217 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.210+0000 7fdf54c09700 1 --2- 172.21.15.57:0/1360323745 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0xe79710 0x10dcc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:54.217 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.210+0000 7fdf54c09700 1 -- 172.21.15.57:0/1360323745 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0xec4790 msgr2=0x10dd680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:54.218 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.210+0000 7fdf54c09700 1 --2- 172.21.15.57:0/1360323745 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0xec4790 0x10dd680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:54.218 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.210+0000 7fdf54c09700 1 -- 172.21.15.57:0/1360323745 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf50087b40 con 0xe79ae0 2023-10-06T03:01:54.219 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.210+0000 7fdf54c09700 1 --2- 172.21.15.57:0/1360323745 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0xe79ae0 0x10dd140 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fdf40007740 tx=0x7fdf40009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db8d6ecf5699a82d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:54.219 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.210+0000 7fdf2f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-10-06T03:01:54.219 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.210+0000 7fdf2f7fe700 1 -- 172.21.15.57:0/1360323745 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf4001a070 con 0xe79ae0 2023-10-06T03:01:54.219 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.210+0000 7fdf2f7fe700 1 -- 172.21.15.57:0/1360323745 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(35..35 src has 1..35) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fdf40007770 con 0xe79ae0 2023-10-06T03:01:54.219 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.210+0000 7fdf59913740 1 -- 172.21.15.57:0/1360323745 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0xfbfcc0 con 0xe79ae0 2023-10-06T03:01:54.220 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.210+0000 7fdf2f7fe700 1 -- 172.21.15.57:0/1360323745 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdf4000cb00 con 0xe79ae0 2023-10-06T03:01:54.220 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.210+0000 7fdf59913740 10 client.5184 fetch_fsmap learned FSMap version 17 2023-10-06T03:01:54.220 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.210+0000 7fdf59913740 1 -- 172.21.15.57:0/1360323745 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0xfef370 con 0xe79ae0 2023-10-06T03:01:54.220 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.214+0000 7fdf2f7fe700 1 -- 172.21.15.57:0/1360323745 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf40024020 con 0xe79ae0 2023-10-06T03:01:54.220 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.214+0000 7fdf2f7fe700 1 -- 172.21.15.57:0/1360323745 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 17) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fdf4001d020 con 0xe79ae0 2023-10-06T03:01:54.220 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.214+0000 7fdf59913740 10 client.5184 fetch_fsmap finished waiting for FSMap version 17 2023-10-06T03:01:54.220 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.214+0000 7fdf59913740 10 client.5184 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-06T03:01:54.220 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.214+0000 7fdf59913740 20 client.5184 populate_metadata read hostname 'smithi057' 2023-10-06T03:01:54.220 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.214+0000 7fdf59913740 1 --2- 172.21.15.57:0/1360323745 >> [v2:172.21.15.105:6832/1325054263,v1:172.21.15.105:6834/1325054263] conn(0x11038c0 0x1105ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:54.220 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.214+0000 7fdf59913740 4 client.5184 mds_command: new command op to 4989 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T03:01:54.220 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.214+0000 7fdf59913740 1 -- 172.21.15.57:0/1360323745 --> [v2:172.21.15.105:6832/1325054263,v1:172.21.15.105:6834/1325054263] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0xfc33e0 con 0x11038c0 2023-10-06T03:01:54.221 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.214+0000 7fdf5540a700 1 --2- 172.21.15.57:0/1360323745 >> [v2:172.21.15.105:6832/1325054263,v1:172.21.15.105:6834/1325054263] conn(0x11038c0 0x1105ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:54.221 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.214+0000 7fdf5540a700 1 --2- 172.21.15.57:0/1360323745 >> [v2:172.21.15.105:6832/1325054263,v1:172.21.15.105:6834/1325054263] conn(0x11038c0 0x1105ca0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=68388dd990f10085 server_cookie=7c517bd521edd3fb in_seq=0 out_seq=0 2023-10-06T03:01:54.221 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.214+0000 7fdf2f7fe700 10 client.5184 ms_handle_connect on v2:172.21.15.105:6832/1325054263 2023-10-06T03:01:54.222 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.218+0000 7fdf2f7fe700 1 -- 172.21.15.57:0/1360323745 <== mds.0 v2:172.21.15.105:6832/1325054263 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0xfc33e0 con 0x11038c0 2023-10-06T03:01:54.223 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.218+0000 7fdf2f7fe700 10 client.5184 handle_command_reply: tid=0 2023-10-06T03:01:54.223 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.218+0000 7fdf59913740 1 client.5184 shutdown 2023-10-06T03:01:54.224 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.218+0000 7fdf59913740 1 -- 172.21.15.57:0/1360323745 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0xe79ae0 msgr2=0x10dd140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:54.224 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.218+0000 7fdf59913740 1 --2- 172.21.15.57:0/1360323745 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0xe79ae0 0x10dd140 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fdf40007740 tx=0x7fdf40009040 comp rx=0 tx=0).stop 2023-10-06T03:01:54.224 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.218+0000 7fdf59913740 1 -- 172.21.15.57:0/1360323745 shutdown_connections 2023-10-06T03:01:54.224 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.218+0000 7fdf59913740 1 --2- 172.21.15.57:0/1360323745 >> [v2:172.21.15.105:6832/1325054263,v1:172.21.15.105:6834/1325054263] conn(0x11038c0 0x1105ca0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:54.225 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.218+0000 7fdf59913740 1 --2- 172.21.15.57:0/1360323745 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0xec4790 0x10dd680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:54.225 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.218+0000 7fdf59913740 1 --2- 172.21.15.57:0/1360323745 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0xe79ae0 0x10dd140 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:54.225 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.218+0000 7fdf59913740 1 --2- 172.21.15.57:0/1360323745 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0xe79710 0x10dcc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:54.225 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.218+0000 7fdf59913740 1 -- 172.21.15.57:0/1360323745 >> 172.21.15.57:0/1360323745 conn(0xe79eb0 msgr2=0x10b38a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:54.225 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.218+0000 7fdf2f7fe700 0 client.5184 ms_handle_reset on v2:172.21.15.105:6832/1325054263 2023-10-06T03:01:54.225 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.218+0000 7fdf59913740 1 -- 172.21.15.57:0/1360323745 shutdown_connections 2023-10-06T03:01:54.225 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.218+0000 7fdf59913740 1 -- 172.21.15.57:0/1360323745 wait complete. 2023-10-06T03:01:54.225 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.218+0000 7fdf59913740 20 client.5184 trim_cache size 0 max 16384 2023-10-06T03:01:54.246 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.238+0000 7fdf59913740 1 Processor -- start 2023-10-06T03:01:54.246 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.238+0000 7fdf59913740 1 -- start start 2023-10-06T03:01:54.246 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.238+0000 7fdf59913740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0xe79710 0x114bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:54.246 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.238+0000 7fdf59913740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0xe79ae0 0x114c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:54.246 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.238+0000 7fdf59913740 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0xec4790 0x114c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:54.246 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.238+0000 7fdf59913740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x108ebb0 con 0xe79710 2023-10-06T03:01:54.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.238+0000 7fdf59913740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0xfcfc90 con 0xe79ae0 2023-10-06T03:01:54.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.238+0000 7fdf59913740 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0xff6010 con 0xec4790 2023-10-06T03:01:54.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.238+0000 7fdf5540a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0xe79710 0x114bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:54.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.238+0000 7fdf5540a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0xe79710 0x114bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:59022/0 (socket says 172.21.15.57:59022) 2023-10-06T03:01:54.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.238+0000 7fdf55c0b700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0xec4790 0x114c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:54.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.238+0000 7fdf5540a700 1 -- 172.21.15.57:0/1168857458 learned_addr learned my addr 172.21.15.57:0/1168857458 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:54.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.238+0000 7fdf54c09700 1 --2- 172.21.15.57:0/1168857458 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0xe79ae0 0x114c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:54.248 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.242+0000 7fdf5540a700 1 -- 172.21.15.57:0/1168857458 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0xec4790 msgr2=0x114c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:54.248 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.242+0000 7fdf5540a700 1 --2- 172.21.15.57:0/1168857458 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0xec4790 0x114c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:54.248 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.242+0000 7fdf5540a700 1 -- 172.21.15.57:0/1168857458 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0xe79ae0 msgr2=0x114c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:54.248 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.242+0000 7fdf5540a700 1 --2- 172.21.15.57:0/1168857458 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0xe79ae0 0x114c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:54.248 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.242+0000 7fdf5540a700 1 -- 172.21.15.57:0/1168857458 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf501582d0 con 0xe79710 2023-10-06T03:01:54.248 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.242+0000 7fdf5540a700 1 --2- 172.21.15.57:0/1168857458 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0xe79710 0x114bcf0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fdf4c003010 tx=0x7fdf4c02a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cef61fab455d4edb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:54.249 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.242+0000 7fdf3affd700 1 -- 172.21.15.57:0/1168857458 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf4c02f040 con 0xe79710 2023-10-06T03:01:54.249 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.242+0000 7fdf3affd700 1 -- 172.21.15.57:0/1168857458 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf4c01ad80 con 0xe79710 2023-10-06T03:01:54.249 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.242+0000 7fdf3affd700 1 -- 172.21.15.57:0/1168857458 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf4c020070 con 0xe79710 2023-10-06T03:01:54.250 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.242+0000 7fdf59913740 1 -- 172.21.15.57:0/1168857458 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0xe79710 msgr2=0x114bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:54.250 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.242+0000 7fdf59913740 1 --2- 172.21.15.57:0/1168857458 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0xe79710 0x114bcf0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fdf4c003010 tx=0x7fdf4c02a040 comp rx=0 tx=0).stop 2023-10-06T03:01:54.250 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.242+0000 7fdf59913740 1 -- 172.21.15.57:0/1168857458 shutdown_connections 2023-10-06T03:01:54.250 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.242+0000 7fdf59913740 1 --2- 172.21.15.57:0/1168857458 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0xec4790 0x114c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:54.250 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.242+0000 7fdf59913740 1 --2- 172.21.15.57:0/1168857458 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0xe79ae0 0x114c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:54.250 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.242+0000 7fdf59913740 1 --2- 172.21.15.57:0/1168857458 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0xe79710 0x114bcf0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:54.250 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.242+0000 7fdf59913740 1 -- 172.21.15.57:0/1168857458 >> 172.21.15.57:0/1168857458 conn(0xe79eb0 msgr2=0x10da910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:54.250 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.242+0000 7fdf59913740 1 -- 172.21.15.57:0/1168857458 shutdown_connections 2023-10-06T03:01:54.250 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.242+0000 7fdf59913740 1 -- 172.21.15.57:0/1168857458 wait complete. 2023-10-06T03:01:54.251 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.246+0000 7fdf59913740 1 -- start start 2023-10-06T03:01:54.252 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.246+0000 7fdf59913740 1 Processor -- start 2023-10-06T03:01:54.255 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.246+0000 7fdf59913740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0xe79710 0x10d77b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:54.255 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.246+0000 7fdf59913740 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0xe79ae0 0x10d7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:54.255 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.246+0000 7fdf59913740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0xec4790 0x10d8230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:54.255 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.246+0000 7fdf59913740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0xff4f40 con 0xe79710 2023-10-06T03:01:54.256 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.246+0000 7fdf59913740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x1025490 con 0xec4790 2023-10-06T03:01:54.256 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.246+0000 7fdf59913740 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0xef6650 con 0xe79ae0 2023-10-06T03:01:54.256 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.246+0000 7fdf59913740 10 client.0 _ll_register_callbacks cb 0xf3d0e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:01:54.256 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.250+0000 7fdf5540a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0xe79710 0x10d77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:54.256 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.250+0000 7fdf5540a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0xe79710 0x10d77b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:59028/0 (socket says 172.21.15.57:59028) 2023-10-06T03:01:54.256 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.250+0000 7fdf5540a700 1 -- 172.21.15.57:0/3523906585 learned_addr learned my addr 172.21.15.57:0/3523906585 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:54.256 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.250+0000 7fdf54c09700 1 --2- 172.21.15.57:0/3523906585 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0xe79ae0 0x10d7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:54.256 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.250+0000 7fdf55c0b700 1 --2- 172.21.15.57:0/3523906585 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0xec4790 0x10d8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:54.257 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.250+0000 7fdf5540a700 1 -- 172.21.15.57:0/3523906585 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0xe79ae0 msgr2=0x10d7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:54.257 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.250+0000 7fdf5540a700 1 --2- 172.21.15.57:0/3523906585 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0xe79ae0 0x10d7cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:54.257 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.250+0000 7fdf5540a700 1 -- 172.21.15.57:0/3523906585 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0xec4790 msgr2=0x10d8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:54.258 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.250+0000 7fdf5540a700 1 --2- 172.21.15.57:0/3523906585 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0xec4790 0x10d8230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:54.258 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.250+0000 7fdf5540a700 1 -- 172.21.15.57:0/3523906585 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf5006acb0 con 0xe79710 2023-10-06T03:01:54.258 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.250+0000 7fdf5540a700 1 --2- 172.21.15.57:0/3523906585 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0xe79710 0x10d77b0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fdf4c036040 tx=0x7fdf4c032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efb2d75fcdec29c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:54.258 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.250+0000 7fdf2f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-10-06T03:01:54.258 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.250+0000 7fdf2f7fe700 1 -- 172.21.15.57:0/3523906585 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf4c020050 con 0xe79710 2023-10-06T03:01:54.258 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.250+0000 7fdf59913740 1 -- 172.21.15.57:0/3523906585 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdf480579e0 con 0xe79710 2023-10-06T03:01:54.258 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.250+0000 7fdf2f7fe700 1 -- 172.21.15.57:0/3523906585 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(35..35 src has 1..35) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fdf4c028630 con 0xe79710 2023-10-06T03:01:54.258 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.250+0000 7fdf2f7fe700 1 -- 172.21.15.57:0/3523906585 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdf4c02f040 con 0xe79710 2023-10-06T03:01:54.258 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.250+0000 7fdf59913740 10 client.5190 fetch_fsmap learned FSMap version 17 2023-10-06T03:01:54.258 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.250+0000 7fdf59913740 1 -- 172.21.15.57:0/3523906585 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0xfd5d80 con 0xe79710 2023-10-06T03:01:54.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.250+0000 7fdf2f7fe700 1 -- 172.21.15.57:0/3523906585 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf480579e0 con 0xe79710 2023-10-06T03:01:54.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.250+0000 7fdf2f7fe700 1 -- 172.21.15.57:0/3523906585 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 17) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fdf4c028a00 con 0xe79710 2023-10-06T03:01:54.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.250+0000 7fdf59913740 10 client.5190 fetch_fsmap finished waiting for FSMap version 17 2023-10-06T03:01:54.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.250+0000 7fdf59913740 10 client.5190 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-06T03:01:54.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.250+0000 7fdf59913740 20 client.5190 populate_metadata read hostname 'smithi057' 2023-10-06T03:01:54.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.250+0000 7fdf59913740 1 --2- 172.21.15.57:0/3523906585 >> [v2:172.21.15.105:6832/1325054263,v1:172.21.15.105:6834/1325054263] conn(0x10d8bf0 0x1157f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:54.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.250+0000 7fdf59913740 4 client.5190 mds_command: new command op to 4989 tid=0[{"prefix": "status"}] 2023-10-06T03:01:54.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.250+0000 7fdf59913740 1 -- 172.21.15.57:0/3523906585 --> [v2:172.21.15.105:6832/1325054263,v1:172.21.15.105:6834/1325054263] -- command(tid 0: {"prefix": "status"}) v1 -- 0xff5410 con 0x10d8bf0 2023-10-06T03:01:54.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.254+0000 7fdf54c09700 1 --2- 172.21.15.57:0/3523906585 >> [v2:172.21.15.105:6832/1325054263,v1:172.21.15.105:6834/1325054263] conn(0x10d8bf0 0x1157f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:54.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.254+0000 7fdf54c09700 1 --2- 172.21.15.57:0/3523906585 >> [v2:172.21.15.105:6832/1325054263,v1:172.21.15.105:6834/1325054263] conn(0x10d8bf0 0x1157f80 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5cbde0a2f8d7bdd8 server_cookie=459e9b57c957fbcd in_seq=0 out_seq=0 2023-10-06T03:01:54.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.254+0000 7fdf2f7fe700 10 client.5190 ms_handle_connect on v2:172.21.15.105:6832/1325054263 2023-10-06T03:01:54.261 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.254+0000 7fdf2f7fe700 1 -- 172.21.15.57:0/3523906585 <== mds.0 v2:172.21.15.105:6832/1325054263 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0xff5410 con 0x10d8bf0 2023-10-06T03:01:54.261 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.254+0000 7fdf2f7fe700 10 client.5190 handle_command_reply: tid=0 2023-10-06T03:01:54.261 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.254+0000 7fdf59913740 1 client.5190 shutdown 2023-10-06T03:01:54.261 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.254+0000 7fdf59913740 1 -- 172.21.15.57:0/3523906585 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0xe79710 msgr2=0x10d77b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:54.261 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.254+0000 7fdf59913740 1 --2- 172.21.15.57:0/3523906585 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0xe79710 0x10d77b0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fdf4c036040 tx=0x7fdf4c032000 comp rx=0 tx=0).stop 2023-10-06T03:01:54.262 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.254+0000 7fdf59913740 1 -- 172.21.15.57:0/3523906585 shutdown_connections 2023-10-06T03:01:54.262 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.254+0000 7fdf59913740 1 --2- 172.21.15.57:0/3523906585 >> [v2:172.21.15.105:6832/1325054263,v1:172.21.15.105:6834/1325054263] conn(0x10d8bf0 0x1157f80 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:54.262 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.254+0000 7fdf59913740 1 --2- 172.21.15.57:0/3523906585 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0xec4790 0x10d8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:54.262 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.254+0000 7fdf59913740 1 --2- 172.21.15.57:0/3523906585 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0xe79ae0 0x10d7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:54.262 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.254+0000 7fdf59913740 1 --2- 172.21.15.57:0/3523906585 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0xe79710 0x10d77b0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:54.263 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.254+0000 7fdf2f7fe700 0 client.5190 ms_handle_reset on v2:172.21.15.105:6832/1325054263 2023-10-06T03:01:54.263 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.254+0000 7fdf59913740 1 -- 172.21.15.57:0/3523906585 >> 172.21.15.57:0/3523906585 conn(0xe79eb0 msgr2=0x10b1ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:54.263 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.254+0000 7fdf59913740 1 -- 172.21.15.57:0/3523906585 shutdown_connections 2023-10-06T03:01:54.263 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.254+0000 7fdf59913740 1 -- 172.21.15.57:0/3523906585 wait complete. 2023-10-06T03:01:54.263 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.258+0000 7fdf59913740 20 client.5190 trim_cache size 0 max 16384 2023-10-06T03:01:54.263 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-10-06T03:01:54.264 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_fsid": "eb56dc0f-9213-41cb-9aad-8ade6c802e98", 2023-10-06T03:01:54.264 INFO:teuthology.orchestra.run.smithi057.stdout: "whoami": 0, 2023-10-06T03:01:54.264 INFO:teuthology.orchestra.run.smithi057.stdout: "id": 4989, 2023-10-06T03:01:54.264 INFO:teuthology.orchestra.run.smithi057.stdout: "want_state": "up:active", 2023-10-06T03:01:54.264 INFO:teuthology.orchestra.run.smithi057.stdout: "state": "up:active", 2023-10-06T03:01:54.264 INFO:teuthology.orchestra.run.smithi057.stdout: "fs_name": "cephfs", 2023-10-06T03:01:54.264 INFO:teuthology.orchestra.run.smithi057.stdout: "rank_uptime": 6.3259638499999999, 2023-10-06T03:01:54.264 INFO:teuthology.orchestra.run.smithi057.stdout: "mdsmap_epoch": 17, 2023-10-06T03:01:54.264 INFO:teuthology.orchestra.run.smithi057.stdout: "osdmap_epoch": 35, 2023-10-06T03:01:54.264 INFO:teuthology.orchestra.run.smithi057.stdout: "osdmap_epoch_barrier": 35, 2023-10-06T03:01:54.264 INFO:teuthology.orchestra.run.smithi057.stdout: "uptime": 15.170981308 2023-10-06T03:01:54.265 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-10-06T03:01:54.265 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.258+0000 7fdf5640c700 1 -- 172.21.15.57:0/3678370259 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fdf34060580 msgr2=0x7fdf34062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:54.265 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.258+0000 7fdf5640c700 1 --2- 172.21.15.57:0/3678370259 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fdf34060580 0x7fdf34062a30 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fdf4c0093f0 tx=0x7fdf4c017000 comp rx=0 tx=0).stop 2023-10-06T03:01:54.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.258+0000 7fdf5640c700 1 -- 172.21.15.57:0/3678370259 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdf50159190 msgr2=0x7fdf5015a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:54.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.258+0000 7fdf5640c700 1 --2- 172.21.15.57:0/3678370259 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdf50159190 0x7fdf5015a690 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fdf4800c840 tx=0x7fdf48001670 comp rx=0 tx=0).stop 2023-10-06T03:01:54.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.258+0000 7fdf5640c700 1 -- 172.21.15.57:0/3678370259 shutdown_connections 2023-10-06T03:01:54.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.258+0000 7fdf5640c700 1 --2- 172.21.15.57:0/3678370259 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdf50159190 0x7fdf5015a690 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:54.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.258+0000 7fdf5640c700 1 --2- 172.21.15.57:0/3678370259 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdf50158dc0 0x7fdf50087600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:54.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.258+0000 7fdf5640c700 1 --2- 172.21.15.57:0/3678370259 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fdf34060580 0x7fdf34062a30 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:54.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.258+0000 7fdf5640c700 1 --2- 172.21.15.57:0/3678370259 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdf5006b4b0 0x7fdf500870c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:54.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.258+0000 7fdf5640c700 1 -- 172.21.15.57:0/3678370259 >> 172.21.15.57:0/3678370259 conn(0x7fdf50067050 msgr2=0x7fdf500b23f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:54.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.258+0000 7fdf5640c700 1 -- 172.21.15.57:0/3678370259 shutdown_connections 2023-10-06T03:01:54.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.258+0000 7fdf5640c700 1 -- 172.21.15.57:0/3678370259 wait complete. 2023-10-06T03:01:54.288 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T03:01:54.454 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.446+0000 7f17112e3700 1 Processor -- start 2023-10-06T03:01:54.454 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.446+0000 7f17112e3700 1 -- start start 2023-10-06T03:01:54.456 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.450+0000 7f17112e3700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f170c06c920 0x7f170c0aa7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:54.456 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.450+0000 7f17112e3700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f170c06de50 con 0x7f170c0aae90 2023-10-06T03:01:54.456 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.450+0000 7f17112e3700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f170c06e130 con 0x7f170c06bba0 2023-10-06T03:01:54.456 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.450+0000 7f17112e3700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f170c06c000 con 0x7f170c06c920 2023-10-06T03:01:54.457 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.450+0000 7f170bfff700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f170c06c920 0x7f170c0aa7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:54.457 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.450+0000 7f1710ae2700 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f170c06bba0 0x7f170c0ab970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.57:52700/0 (socket says 172.21.15.57:52700) 2023-10-06T03:01:54.457 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.450+0000 7f170bfff700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f170c06c920 0x7f170c0aa7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.57:51808/0 (socket says 172.21.15.57:51808) 2023-10-06T03:01:54.457 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.450+0000 7f1710ae2700 1 -- 172.21.15.57:0/2674036104 learned_addr learned my addr 172.21.15.57:0/2674036104 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:01:54.457 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.450+0000 7f17037fe700 1 --1- 172.21.15.57:0/2674036104 >> v1:172.21.15.57:6789/0 conn(0x7f170c0aae90 0x7f170c06ccf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:52032/0 (socket says 172.21.15.57:52032) 2023-10-06T03:01:54.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.450+0000 7f170bfff700 1 -- 172.21.15.57:0/2674036104 >> v1:172.21.15.105:6789/0 conn(0x7f170c06bba0 legacy=0x7f170c0ab970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:54.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.450+0000 7f170bfff700 1 -- 172.21.15.57:0/2674036104 >> v1:172.21.15.57:6789/0 conn(0x7f170c0aae90 legacy=0x7f170c06ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:54.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.450+0000 7f170bfff700 1 -- 172.21.15.57:0/2674036104 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f170c06b3a0 con 0x7f170c06c920 2023-10-06T03:01:54.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.450+0000 7f170bfff700 1 --2- 172.21.15.57:0/2674036104 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f170c06c920 0x7f170c0aa7e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f16fc0098e0 tx=0x7f16fc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=452675c3ab62628a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:54.459 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.454+0000 7f170b7fe700 1 -- 172.21.15.57:0/2674036104 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16fc009e80 con 0x7f170c06c920 2023-10-06T03:01:54.459 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.454+0000 7f170b7fe700 1 -- 172.21.15.57:0/2674036104 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16fc00b860 con 0x7f170c06c920 2023-10-06T03:01:54.459 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.454+0000 7f170b7fe700 1 -- 172.21.15.57:0/2674036104 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16fc00bbe0 con 0x7f170c06c920 2023-10-06T03:01:54.460 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.454+0000 7f17112e3700 1 -- 172.21.15.57:0/2674036104 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f170c06c920 msgr2=0x7f170c0aa7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:54.460 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.454+0000 7f17112e3700 1 --2- 172.21.15.57:0/2674036104 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f170c06c920 0x7f170c0aa7e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f16fc0098e0 tx=0x7f16fc0091a0 comp rx=0 tx=0).stop 2023-10-06T03:01:54.460 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.454+0000 7f17112e3700 1 -- 172.21.15.57:0/2674036104 shutdown_connections 2023-10-06T03:01:54.460 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.454+0000 7f17112e3700 1 --2- 172.21.15.57:0/2674036104 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f170c06c920 0x7f170c0aa7e0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:54.461 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.454+0000 7f17112e3700 1 -- 172.21.15.57:0/2674036104 >> 172.21.15.57:0/2674036104 conn(0x7f170c0c85e0 msgr2=0x7f170c0c89e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:54.461 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.454+0000 7f17112e3700 1 -- 172.21.15.57:0/2674036104 shutdown_connections 2023-10-06T03:01:54.461 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.454+0000 7f17112e3700 1 -- 172.21.15.57:0/2674036104 wait complete. 2023-10-06T03:01:54.463 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.458+0000 7f17112e3700 1 Processor -- start 2023-10-06T03:01:54.464 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.458+0000 7f17112e3700 1 -- start start 2023-10-06T03:01:54.466 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.458+0000 7f17112e3700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f170c06bba0 0x7f170c0afed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:54.466 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.458+0000 7f17112e3700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f170c06c920 0x7f170c15f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:54.466 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.458+0000 7f17112e3700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f170c0aae90 0x7f170c0bd760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:54.467 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.458+0000 7f17112e3700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f170c0afa40 con 0x7f170c06bba0 2023-10-06T03:01:54.467 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.458+0000 7f17112e3700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f170c15f550 con 0x7f170c0aae90 2023-10-06T03:01:54.467 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.458+0000 7f17112e3700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f170c0aee30 con 0x7f170c06c920 2023-10-06T03:01:54.467 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.458+0000 7f170bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f170c06bba0 0x7f170c0afed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:54.467 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.458+0000 7f170bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f170c06bba0 0x7f170c0afed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:59044/0 (socket says 172.21.15.57:59044) 2023-10-06T03:01:54.467 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.458+0000 7f170bfff700 1 -- 172.21.15.57:0/3414480850 learned_addr learned my addr 172.21.15.57:0/3414480850 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:54.467 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.462+0000 7f1710ae2700 1 --2- 172.21.15.57:0/3414480850 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f170c0aae90 0x7f170c0bd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:54.467 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.462+0000 7f17037fe700 1 --2- 172.21.15.57:0/3414480850 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f170c06c920 0x7f170c15f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:54.468 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.462+0000 7f170bfff700 1 -- 172.21.15.57:0/3414480850 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f170c06c920 msgr2=0x7f170c15f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:54.468 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.462+0000 7f170bfff700 1 --2- 172.21.15.57:0/3414480850 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f170c06c920 0x7f170c15f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:54.469 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.462+0000 7f170bfff700 1 -- 172.21.15.57:0/3414480850 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f170c0aae90 msgr2=0x7f170c0bd760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:54.469 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.462+0000 7f170bfff700 1 --2- 172.21.15.57:0/3414480850 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f170c0aae90 0x7f170c0bd760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:54.469 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.462+0000 7f170bfff700 1 -- 172.21.15.57:0/3414480850 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16fc009420 con 0x7f170c06bba0 2023-10-06T03:01:54.469 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.462+0000 7f17037fe700 1 --2- 172.21.15.57:0/3414480850 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f170c06c920 0x7f170c15f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:54.469 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.462+0000 7f170bfff700 1 --2- 172.21.15.57:0/3414480850 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f170c06bba0 0x7f170c0afed0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f170c06a1d0 tx=0x7f16fc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:54.469 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.462+0000 7f1708ff9700 1 -- 172.21.15.57:0/3414480850 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16fc00baa0 con 0x7f170c06bba0 2023-10-06T03:01:54.469 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.462+0000 7f1708ff9700 1 -- 172.21.15.57:0/3414480850 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16fc025420 con 0x7f170c06bba0 2023-10-06T03:01:54.469 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.462+0000 7f17112e3700 1 -- 172.21.15.57:0/3414480850 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f170c0af110 con 0x7f170c06bba0 2023-10-06T03:01:54.469 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.462+0000 7f1708ff9700 1 -- 172.21.15.57:0/3414480850 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16fc0257c0 con 0x7f170c06bba0 2023-10-06T03:01:54.469 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.462+0000 7f17112e3700 1 -- 172.21.15.57:0/3414480850 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f170c0af6d0 con 0x7f170c06bba0 2023-10-06T03:01:54.470 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.462+0000 7f17112e3700 1 -- 172.21.15.57:0/3414480850 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f170c04be40 con 0x7f170c06bba0 2023-10-06T03:01:54.472 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.466+0000 7f1708ff9700 1 -- 172.21.15.57:0/3414480850 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f16fc023070 con 0x7f170c06bba0 2023-10-06T03:01:54.473 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.466+0000 7f1708ff9700 1 --2- 172.21.15.57:0/3414480850 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f16ec060580 0x7f16ec062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:54.473 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.466+0000 7f1708ff9700 1 -- 172.21.15.57:0/3414480850 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f16fc07e040 con 0x7f170c06bba0 2023-10-06T03:01:54.474 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.466+0000 7f17037fe700 1 --2- 172.21.15.57:0/3414480850 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f16ec060580 0x7f16ec062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:54.475 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.470+0000 7f17037fe700 1 --2- 172.21.15.57:0/3414480850 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f16ec060580 0x7f16ec062a30 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f16f4007fd0 tx=0x7f16f4007d90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:54.481 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.474+0000 7f1708ff9700 1 -- 172.21.15.57:0/3414480850 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f16fc0adbe0 con 0x7f170c06bba0 2023-10-06T03:01:54.683 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.678+0000 7f17112e3700 1 -- 172.21.15.57:0/3414480850 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f170c160450 con 0x7f170c06bba0 2023-10-06T03:01:54.684 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.678+0000 7f1708ff9700 1 -- 172.21.15.57:0/3414480850 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7f16fc015070 con 0x7f170c06bba0 2023-10-06T03:01:54.684 INFO:teuthology.orchestra.run.smithi057.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T03:01:54.689 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.682+0000 7f17112e3700 1 -- 172.21.15.57:0/3414480850 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f16ec060580 msgr2=0x7f16ec062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:54.689 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.682+0000 7f17112e3700 1 --2- 172.21.15.57:0/3414480850 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f16ec060580 0x7f16ec062a30 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f16f4007fd0 tx=0x7f16f4007d90 comp rx=0 tx=0).stop 2023-10-06T03:01:54.689 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.682+0000 7f17112e3700 1 -- 172.21.15.57:0/3414480850 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f170c06bba0 msgr2=0x7f170c0afed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:54.689 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.682+0000 7f17112e3700 1 --2- 172.21.15.57:0/3414480850 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f170c06bba0 0x7f170c0afed0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f170c06a1d0 tx=0x7f16fc017000 comp rx=0 tx=0).stop 2023-10-06T03:01:54.689 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.682+0000 7f17112e3700 1 -- 172.21.15.57:0/3414480850 shutdown_connections 2023-10-06T03:01:54.689 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.682+0000 7f17112e3700 1 --2- 172.21.15.57:0/3414480850 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f170c0aae90 0x7f170c0bd760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:54.689 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.682+0000 7f17112e3700 1 --2- 172.21.15.57:0/3414480850 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f16ec060580 0x7f16ec062a30 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:54.690 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.682+0000 7f17112e3700 1 --2- 172.21.15.57:0/3414480850 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f170c06c920 0x7f170c15f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:54.690 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.682+0000 7f17112e3700 1 --2- 172.21.15.57:0/3414480850 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f170c06bba0 0x7f170c0afed0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:54.690 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.682+0000 7f17112e3700 1 -- 172.21.15.57:0/3414480850 >> 172.21.15.57:0/3414480850 conn(0x7f170c0c85e0 msgr2=0x7f170c0c89b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:54.690 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.682+0000 7f17112e3700 1 -- 172.21.15.57:0/3414480850 shutdown_connections 2023-10-06T03:01:54.690 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:54.682+0000 7f17112e3700 1 -- 172.21.15.57:0/3414480850 wait complete. 2023-10-06T03:01:54.708 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-06T03:01:54.709 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T03:01:54.709 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi057.front.sepia.ceph.com 2023-10-06T03:01:54.709 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T03:01:54.709 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T03:01:54.709 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-06T03:01:54.709 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-06T03:01:54.709 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T03:01:54.709 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T03:01:54.709 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:01:54.709 DEBUG:teuthology.orchestra.run.smithi057:> ip addr 2023-10-06T03:01:54.728 INFO:teuthology.orchestra.run.smithi057.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T03:01:54.728 INFO:teuthology.orchestra.run.smithi057.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T03:01:54.728 INFO:teuthology.orchestra.run.smithi057.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T03:01:54.728 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:01:54.728 INFO:teuthology.orchestra.run.smithi057.stdout: inet6 ::1/128 scope host 2023-10-06T03:01:54.728 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:01:54.728 INFO:teuthology.orchestra.run.smithi057.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-06T03:01:54.728 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether 0c:c4:7a:6b:ff:86 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:01:54.728 INFO:teuthology.orchestra.run.smithi057.stdout: altname enp7s0f0 2023-10-06T03:01:54.729 INFO:teuthology.orchestra.run.smithi057.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-06T03:01:54.729 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether 0c:c4:7a:6b:ff:87 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:01:54.729 INFO:teuthology.orchestra.run.smithi057.stdout: altname enp7s0f1 2023-10-06T03:01:54.729 INFO:teuthology.orchestra.run.smithi057.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T03:01:54.729 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether 0c:c4:7a:bd:15:62 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:01:54.729 INFO:teuthology.orchestra.run.smithi057.stdout: altname enp1s0f0 2023-10-06T03:01:54.729 INFO:teuthology.orchestra.run.smithi057.stdout: inet 172.21.15.57/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-10-06T03:01:54.729 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft 42370sec preferred_lft 42370sec 2023-10-06T03:01:54.729 INFO:teuthology.orchestra.run.smithi057.stdout: inet6 fe80::ec4:7aff:febd:1562/64 scope link 2023-10-06T03:01:54.729 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:01:54.729 INFO:teuthology.orchestra.run.smithi057.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-06T03:01:54.729 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether 0c:c4:7a:bd:15:63 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:01:54.730 INFO:teuthology.orchestra.run.smithi057.stdout: altname enp1s0f1 2023-10-06T03:01:54.730 INFO:teuthology.orchestra.run.smithi057.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-06T03:01:54.730 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether 02:42:3c:a1:4c:1b brd ff:ff:ff:ff:ff:ff 2023-10-06T03:01:54.730 INFO:teuthology.orchestra.run.smithi057.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-06T03:01:54.730 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:01:54.730 INFO:teuthology.orchestra.run.smithi057.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T03:01:54.730 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether 0a:8c:35:a4:dd:f1 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:01:54.730 INFO:teuthology.orchestra.run.smithi057.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T03:01:54.730 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:01:54.730 INFO:teuthology.orchestra.run.smithi057.stdout: inet6 fe80::581d:6bff:fe09:33c7/64 scope link 2023-10-06T03:01:54.730 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:01:54.730 INFO:teuthology.orchestra.run.smithi057.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T03:01:54.730 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether 0a:8c:35:a4:dd:f1 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T03:01:54.731 INFO:teuthology.orchestra.run.smithi057.stdout: inet6 fe80::88c:35ff:fea4:ddf1/64 scope link 2023-10-06T03:01:54.731 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:01:54.731 INFO:teuthology.orchestra.run.smithi057.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T03:01:54.731 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether 26:13:92:42:22:14 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T03:01:54.731 INFO:teuthology.orchestra.run.smithi057.stdout: inet6 fe80::2413:92ff:fe42:2214/64 scope link 2023-10-06T03:01:54.731 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:01:54.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:01:54.732 DEBUG:teuthology.orchestra.run.smithi057:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T03:01:54.812 INFO:teuthology.orchestra.run.smithi057.stdout:1 2023-10-06T03:01:54.815 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:01:54.816 DEBUG:teuthology.orchestra.run.smithi057:> route 2023-10-06T03:01:54.879 INFO:teuthology.orchestra.run.smithi057.stdout:Kernel IP routing table 2023-10-06T03:01:54.879 INFO:teuthology.orchestra.run.smithi057.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T03:01:54.879 INFO:teuthology.orchestra.run.smithi057.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-10-06T03:01:54.879 INFO:teuthology.orchestra.run.smithi057.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-06T03:01:54.879 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-10-06T03:01:54.879 INFO:teuthology.orchestra.run.smithi057.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T03:01:54.880 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:01:54.880 DEBUG:teuthology.orchestra.run.smithi057:> (cd / && exec bash -c ' 2023-10-06T03:01:54.881 DEBUG:teuthology.orchestra.run.smithi057:> set -e 2023-10-06T03:01:54.881 DEBUG:teuthology.orchestra.run.smithi057:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-06T03:01:54.881 DEBUG:teuthology.orchestra.run.smithi057:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-06T03:01:54.881 DEBUG:teuthology.orchestra.run.smithi057:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-06T03:01:54.881 DEBUG:teuthology.orchestra.run.smithi057:> ') 2023-10-06T03:01:55.015 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:01:55.015 DEBUG:teuthology.orchestra.run.smithi057:> ip netns list 2023-10-06T03:01:55.032 INFO:teuthology.orchestra.run.smithi057.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T03:01:55.032 INFO:teuthology.orchestra.run.smithi057.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T03:01:55.033 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T03:01:55.033 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:01:55.034 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip link set brx.0 up 2023-10-06T03:01:55.111 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:01:55.111 DEBUG:teuthology.orchestra.run.smithi057:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T03:01:55.173 INFO:teuthology.orchestra.run.smithi057.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T03:01:55.174 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:01:55.174 DEBUG:teuthology.orchestra.run.smithi057:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T03:01:55.236 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-06T03:01:55.236 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T03:01:55.237 DEBUG:teuthology.orchestra.run.smithi057:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-06T03:01:55.355 INFO:teuthology.orchestra.run.smithi057.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-06T03:01:55.356 INFO:teuthology.orchestra.run.smithi057.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-06T03:01:55.356 INFO:teuthology.orchestra.run.smithi057.stdout:invalid new device string format 2023-10-06T03:01:55.379 INFO:teuthology.orchestra.run.smithi057.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-06T03:01:55.379 INFO:teuthology.orchestra.run.smithi057.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-06T03:01:55.379 INFO:teuthology.orchestra.run.smithi057.stdout:invalid new device string format 2023-10-06T03:01:55.379 INFO:teuthology.orchestra.run.smithi057.stdout:mount.ceph: resolved to: "172.21.15.57:3300,172.21.15.105:3300,172.21.15.105:3301" 2023-10-06T03:01:55.379 INFO:teuthology.orchestra.run.smithi057.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T03:01:55.397 INFO:teuthology.orchestra.run.smithi057.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-06T03:01:55.397 INFO:teuthology.orchestra.run.smithi057.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-06T03:01:55.397 INFO:teuthology.orchestra.run.smithi057.stdout:invalid new device string format 2023-10-06T03:01:55.397 INFO:teuthology.orchestra.run.smithi057.stdout:mount.ceph: resolved to: "172.21.15.57:3300,172.21.15.105:3300,172.21.15.105:3301" 2023-10-06T03:01:55.397 INFO:teuthology.orchestra.run.smithi057.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T03:01:55.397 INFO:teuthology.orchestra.run.smithi057.stdout:mount.ceph: resolved to: "172.21.15.57:6789,172.21.15.105:6789,172.21.15.105:6790" 2023-10-06T03:01:55.397 INFO:teuthology.orchestra.run.smithi057.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.57:6789,172.21.15.105:6789,172.21.15.105:6790:/ 2023-10-06T03:01:55.398 INFO:teuthology.orchestra.run.smithi057.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=eb56dc0f-9213-41cb-9aad-8ade6c802e98" will pass to kernel 2023-10-06T03:01:55.403 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T03:01:55.403 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:01:55.403 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T03:01:55.434 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-06T03:01:55.484 DEBUG:teuthology.orchestra.run.smithi105:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-06T03:01:55.557 INFO:teuthology.orchestra.run.smithi057.stdout:[global] 2023-10-06T03:01:55.557 INFO:teuthology.orchestra.run.smithi057.stdout: chdir = "" 2023-10-06T03:01:55.557 INFO:teuthology.orchestra.run.smithi057.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-06T03:01:55.557 INFO:teuthology.orchestra.run.smithi057.stdout: auth supported = cephx 2023-10-06T03:01:55.557 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:01:55.557 INFO:teuthology.orchestra.run.smithi057.stdout: filestore xattr use omap = true 2023-10-06T03:01:55.557 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:01:55.557 INFO:teuthology.orchestra.run.smithi057.stdout: mon clock drift allowed = 1.000 2023-10-06T03:01:55.557 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:01:55.557 INFO:teuthology.orchestra.run.smithi057.stdout: osd crush chooseleaf type = 0 2023-10-06T03:01:55.558 INFO:teuthology.orchestra.run.smithi057.stdout: auth debug = true 2023-10-06T03:01:55.558 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:01:55.558 INFO:teuthology.orchestra.run.smithi057.stdout: ms die on old message = true 2023-10-06T03:01:55.558 INFO:teuthology.orchestra.run.smithi057.stdout: ms die on bug = true 2023-10-06T03:01:55.558 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:01:55.558 INFO:teuthology.orchestra.run.smithi057.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-06T03:01:55.558 INFO:teuthology.orchestra.run.smithi057.stdout: mon pg warn max object skew = 0 2023-10-06T03:01:55.558 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:01:55.558 INFO:teuthology.orchestra.run.smithi057.stdout: # disable pg_autoscaler by default for new pools 2023-10-06T03:01:55.558 INFO:teuthology.orchestra.run.smithi057.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-06T03:01:55.558 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:01:55.558 INFO:teuthology.orchestra.run.smithi057.stdout: osd pool default size = 2 2023-10-06T03:01:55.559 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:01:55.559 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd allow primary affinity = true 2023-10-06T03:01:55.559 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd allow pg remap = true 2023-10-06T03:01:55.559 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on legacy crush tunables = false 2023-10-06T03:01:55.559 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on crush straw calc version zero = false 2023-10-06T03:01:55.559 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on no sortbitwise = false 2023-10-06T03:01:55.559 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on osd down out interval zero = false 2023-10-06T03:01:55.559 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on too few osds = false 2023-10-06T03:01:55.559 INFO:teuthology.orchestra.run.smithi057.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-06T03:01:55.559 INFO:teuthology.orchestra.run.smithi057.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-06T03:01:55.559 INFO:teuthology.orchestra.run.smithi057.stdout: mon_allow_pool_size_one = true 2023-10-06T03:01:55.559 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:01:55.560 INFO:teuthology.orchestra.run.smithi057.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-06T03:01:55.560 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:01:55.560 INFO:teuthology.orchestra.run.smithi057.stdout: osd default data pool replay window = 5 2023-10-06T03:01:55.560 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:01:55.560 INFO:teuthology.orchestra.run.smithi057.stdout: mon allow pool delete = true 2023-10-06T03:01:55.560 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:01:55.560 INFO:teuthology.orchestra.run.smithi057.stdout: mon cluster log file level = debug 2023-10-06T03:01:55.560 INFO:teuthology.orchestra.run.smithi057.stdout: debug asserts on shutdown = true 2023-10-06T03:01:55.560 INFO:teuthology.orchestra.run.smithi057.stdout: mon health detail to clog = false 2023-10-06T03:01:55.560 INFO:teuthology.orchestra.run.smithi057.stdout: mon host = "172.21.15.57,172.21.15.105,[v2:172.21.15.105:3301,v1:172.21.15.105:6790]" 2023-10-06T03:01:55.560 INFO:teuthology.orchestra.run.smithi057.stdout: ms die on skipped message = False 2023-10-06T03:01:55.560 INFO:teuthology.orchestra.run.smithi057.stdout: fsid = eb56dc0f-9213-41cb-9aad-8ade6c802e98 2023-10-06T03:01:55.561 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:01:55.561 INFO:teuthology.orchestra.run.smithi057.stdout:[osd] 2023-10-06T03:01:55.561 INFO:teuthology.orchestra.run.smithi057.stdout: osd journal size = 100 2023-10-06T03:01:55.561 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:01:55.561 INFO:teuthology.orchestra.run.smithi057.stdout: osd scrub load threshold = 5.0 2023-10-06T03:01:55.561 INFO:teuthology.orchestra.run.smithi057.stdout: osd scrub max interval = 600 2023-10-06T03:01:55.561 INFO:teuthology.orchestra.run.smithi057.stdout: osd mclock profile = high_recovery_ops 2023-10-06T03:01:55.561 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:01:55.561 INFO:teuthology.orchestra.run.smithi057.stdout: osd recover clone overlap = true 2023-10-06T03:01:55.561 INFO:teuthology.orchestra.run.smithi057.stdout: osd recovery max chunk = 1048576 2023-10-06T03:01:55.561 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:01:55.561 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug shutdown = true 2023-10-06T03:01:55.561 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug op order = true 2023-10-06T03:01:55.562 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug verify stray on activate = true 2023-10-06T03:01:55.562 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:01:55.562 INFO:teuthology.orchestra.run.smithi057.stdout: osd open classes on start = true 2023-10-06T03:01:55.562 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug pg log writeout = true 2023-10-06T03:01:55.562 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:01:55.562 INFO:teuthology.orchestra.run.smithi057.stdout: osd deep scrub update digest min age = 30 2023-10-06T03:01:55.562 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:01:55.562 INFO:teuthology.orchestra.run.smithi057.stdout: osd map max advance = 10 2023-10-06T03:01:55.562 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:01:55.562 INFO:teuthology.orchestra.run.smithi057.stdout: journal zero on create = true 2023-10-06T03:01:55.562 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:01:55.563 INFO:teuthology.orchestra.run.smithi057.stdout: filestore ondisk finisher threads = 3 2023-10-06T03:01:55.563 INFO:teuthology.orchestra.run.smithi057.stdout: filestore apply finisher threads = 3 2023-10-06T03:01:55.563 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:01:55.563 INFO:teuthology.orchestra.run.smithi057.stdout: bdev debug aio = true 2023-10-06T03:01:55.563 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug misdirected ops = true 2023-10-06T03:01:55.563 INFO:teuthology.orchestra.run.smithi057.stdout: bdev async discard = True 2023-10-06T03:01:55.563 INFO:teuthology.orchestra.run.smithi057.stdout: bdev enable discard = True 2023-10-06T03:01:55.563 INFO:teuthology.orchestra.run.smithi057.stdout: bluestore allocator = bitmap 2023-10-06T03:01:55.563 INFO:teuthology.orchestra.run.smithi057.stdout: bluestore block size = 96636764160 2023-10-06T03:01:55.563 INFO:teuthology.orchestra.run.smithi057.stdout: bluestore fsck on mount = True 2023-10-06T03:01:55.563 INFO:teuthology.orchestra.run.smithi057.stdout: debug bluefs = 1/20 2023-10-06T03:01:55.563 INFO:teuthology.orchestra.run.smithi057.stdout: debug bluestore = 1/20 2023-10-06T03:01:55.563 INFO:teuthology.orchestra.run.smithi057.stdout: debug ms = 1 2023-10-06T03:01:55.564 INFO:teuthology.orchestra.run.smithi057.stdout: debug osd = 20 2023-10-06T03:01:55.564 INFO:teuthology.orchestra.run.smithi057.stdout: debug rocksdb = 4/10 2023-10-06T03:01:55.564 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd backfillfull_ratio = 0.85 2023-10-06T03:01:55.564 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd full ratio = 0.9 2023-10-06T03:01:55.564 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd nearfull ratio = 0.8 2023-10-06T03:01:55.564 INFO:teuthology.orchestra.run.smithi057.stdout: osd failsafe full ratio = 0.95 2023-10-06T03:01:55.564 INFO:teuthology.orchestra.run.smithi057.stdout: osd objectstore = bluestore 2023-10-06T03:01:55.564 INFO:teuthology.orchestra.run.smithi057.stdout: osd op complaint time = 180 2023-10-06T03:01:55.564 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:01:55.564 INFO:teuthology.orchestra.run.smithi057.stdout:[mgr] 2023-10-06T03:01:55.564 INFO:teuthology.orchestra.run.smithi057.stdout: debug ms = 1 2023-10-06T03:01:55.564 INFO:teuthology.orchestra.run.smithi057.stdout: debug mgr = 20 2023-10-06T03:01:55.565 INFO:teuthology.orchestra.run.smithi057.stdout: debug mon = 20 2023-10-06T03:01:55.565 INFO:teuthology.orchestra.run.smithi057.stdout: debug auth = 20 2023-10-06T03:01:55.565 INFO:teuthology.orchestra.run.smithi057.stdout: mon reweight min pgs per osd = 4 2023-10-06T03:01:55.565 INFO:teuthology.orchestra.run.smithi057.stdout: mon reweight min bytes per osd = 10 2023-10-06T03:01:55.565 INFO:teuthology.orchestra.run.smithi057.stdout: mgr/telemetry/nag = false 2023-10-06T03:01:55.565 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:01:55.565 INFO:teuthology.orchestra.run.smithi057.stdout:[mon] 2023-10-06T03:01:55.565 INFO:teuthology.orchestra.run.smithi057.stdout: debug ms = 1 2023-10-06T03:01:55.565 INFO:teuthology.orchestra.run.smithi057.stdout: debug mon = 20 2023-10-06T03:01:55.565 INFO:teuthology.orchestra.run.smithi057.stdout: debug paxos = 20 2023-10-06T03:01:55.565 INFO:teuthology.orchestra.run.smithi057.stdout: debug auth = 20 2023-10-06T03:01:55.565 INFO:teuthology.orchestra.run.smithi057.stdout: mon data avail warn = 5 2023-10-06T03:01:55.565 INFO:teuthology.orchestra.run.smithi057.stdout: mon mgr mkfs grace = 240 2023-10-06T03:01:55.566 INFO:teuthology.orchestra.run.smithi057.stdout: mon reweight min pgs per osd = 4 2023-10-06T03:01:55.566 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd reporter subtree level = osd 2023-10-06T03:01:55.566 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd prime pg temp = true 2023-10-06T03:01:55.566 INFO:teuthology.orchestra.run.smithi057.stdout: mon reweight min bytes per osd = 10 2023-10-06T03:01:55.566 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:01:55.566 INFO:teuthology.orchestra.run.smithi057.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-06T03:01:55.566 INFO:teuthology.orchestra.run.smithi057.stdout: auth mon ticket ttl = 660 # 11m 2023-10-06T03:01:55.566 INFO:teuthology.orchestra.run.smithi057.stdout: auth service ticket ttl = 240 # 4m 2023-10-06T03:01:55.566 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:01:55.566 INFO:teuthology.orchestra.run.smithi057.stdout: # don't complain about insecure global_id in the test suite 2023-10-06T03:01:55.566 INFO:teuthology.orchestra.run.smithi057.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-06T03:01:55.566 INFO:teuthology.orchestra.run.smithi057.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-06T03:01:55.567 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:01:55.567 INFO:teuthology.orchestra.run.smithi057.stdout: # 1m isn't quite enough 2023-10-06T03:01:55.567 INFO:teuthology.orchestra.run.smithi057.stdout: mon_down_mkfs_grace = 2m 2023-10-06T03:01:55.567 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:01:55.567 INFO:teuthology.orchestra.run.smithi057.stdout: mon_warn_on_filestore_osds = false 2023-10-06T03:01:55.567 INFO:teuthology.orchestra.run.smithi057.stdout: mon op complaint time = 120 2023-10-06T03:01:55.567 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:01:55.567 INFO:teuthology.orchestra.run.smithi057.stdout:[client] 2023-10-06T03:01:55.567 INFO:teuthology.orchestra.run.smithi057.stdout: rgw cache enabled = true 2023-10-06T03:01:55.567 INFO:teuthology.orchestra.run.smithi057.stdout: rgw enable ops log = true 2023-10-06T03:01:55.567 INFO:teuthology.orchestra.run.smithi057.stdout: rgw enable usage log = true 2023-10-06T03:01:55.567 INFO:teuthology.orchestra.run.smithi057.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-06T03:01:55.567 INFO:teuthology.orchestra.run.smithi057.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-06T03:01:55.568 INFO:teuthology.orchestra.run.smithi057.stdout: client mount timeout = 600 2023-10-06T03:01:55.568 INFO:teuthology.orchestra.run.smithi057.stdout: debug client = 20 2023-10-06T03:01:55.568 INFO:teuthology.orchestra.run.smithi057.stdout: debug ms = 1 2023-10-06T03:01:55.568 INFO:teuthology.orchestra.run.smithi057.stdout: pid file = "" 2023-10-06T03:01:55.568 INFO:teuthology.orchestra.run.smithi057.stdout: rados mon op timeout = 900 2023-10-06T03:01:55.568 INFO:teuthology.orchestra.run.smithi057.stdout: rados osd op timeout = 900 2023-10-06T03:01:55.568 INFO:teuthology.orchestra.run.smithi057.stdout:[mon.a] 2023-10-06T03:01:55.568 INFO:teuthology.orchestra.run.smithi057.stdout:[mon.b] 2023-10-06T03:01:55.568 INFO:teuthology.orchestra.run.smithi057.stdout:[mon.c] 2023-10-06T03:01:55.568 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.a] 2023-10-06T03:01:55.568 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.c] 2023-10-06T03:01:55.568 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.b] 2023-10-06T03:01:55.569 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.d] 2023-10-06T03:01:55.569 INFO:teuthology.orchestra.run.smithi057.stdout:[mds] 2023-10-06T03:01:55.569 INFO:teuthology.orchestra.run.smithi057.stdout: debug mds = 20 2023-10-06T03:01:55.569 INFO:teuthology.orchestra.run.smithi057.stdout: debug ms = 1 2023-10-06T03:01:55.569 INFO:teuthology.orchestra.run.smithi057.stdout: mds debug frag = True 2023-10-06T03:01:55.569 INFO:teuthology.orchestra.run.smithi057.stdout: mds debug scatterstat = True 2023-10-06T03:01:55.569 INFO:teuthology.orchestra.run.smithi057.stdout: mds op complaint time = 180 2023-10-06T03:01:55.569 INFO:teuthology.orchestra.run.smithi057.stdout: mds verify scatter = True 2023-10-06T03:01:55.569 INFO:teuthology.orchestra.run.smithi057.stdout: osd op complaint time = 180 2023-10-06T03:01:55.569 INFO:teuthology.orchestra.run.smithi057.stdout: rados mon op timeout = 900 2023-10-06T03:01:55.569 INFO:teuthology.orchestra.run.smithi057.stdout: rados osd op timeout = 900 2023-10-06T03:01:55.569 INFO:teuthology.orchestra.run.smithi057.stdout: osd_deep_scrub_large_omap_object_key_threshold = 5 2023-10-06T03:01:55.570 INFO:teuthology.orchestra.run.smithi105.stdout:[global] 2023-10-06T03:01:55.570 INFO:teuthology.orchestra.run.smithi105.stdout: chdir = "" 2023-10-06T03:01:55.570 INFO:teuthology.orchestra.run.smithi105.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-06T03:01:55.570 INFO:teuthology.orchestra.run.smithi105.stdout: auth supported = cephx 2023-10-06T03:01:55.570 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:01:55.570 INFO:teuthology.orchestra.run.smithi105.stdout: filestore xattr use omap = true 2023-10-06T03:01:55.570 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:01:55.570 INFO:teuthology.orchestra.run.smithi105.stdout: mon clock drift allowed = 1.000 2023-10-06T03:01:55.570 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:01:55.571 INFO:teuthology.orchestra.run.smithi105.stdout: osd crush chooseleaf type = 0 2023-10-06T03:01:55.571 INFO:teuthology.orchestra.run.smithi105.stdout: auth debug = true 2023-10-06T03:01:55.571 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:01:55.571 INFO:teuthology.orchestra.run.smithi105.stdout: ms die on old message = true 2023-10-06T03:01:55.571 INFO:teuthology.orchestra.run.smithi105.stdout: ms die on bug = true 2023-10-06T03:01:55.571 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:01:55.571 INFO:teuthology.orchestra.run.smithi105.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-06T03:01:55.571 INFO:teuthology.orchestra.run.smithi105.stdout: mon pg warn max object skew = 0 2023-10-06T03:01:55.571 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:01:55.571 INFO:teuthology.orchestra.run.smithi105.stdout: # disable pg_autoscaler by default for new pools 2023-10-06T03:01:55.571 INFO:teuthology.orchestra.run.smithi105.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-06T03:01:55.571 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:01:55.571 INFO:teuthology.orchestra.run.smithi105.stdout: osd pool default size = 2 2023-10-06T03:01:55.572 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:01:55.572 INFO:teuthology.orchestra.run.smithi105.stdout: mon osd allow primary affinity = true 2023-10-06T03:01:55.572 INFO:teuthology.orchestra.run.smithi105.stdout: mon osd allow pg remap = true 2023-10-06T03:01:55.572 INFO:teuthology.orchestra.run.smithi105.stdout: mon warn on legacy crush tunables = false 2023-10-06T03:01:55.572 INFO:teuthology.orchestra.run.smithi105.stdout: mon warn on crush straw calc version zero = false 2023-10-06T03:01:55.572 INFO:teuthology.orchestra.run.smithi105.stdout: mon warn on no sortbitwise = false 2023-10-06T03:01:55.572 INFO:teuthology.orchestra.run.smithi105.stdout: mon warn on osd down out interval zero = false 2023-10-06T03:01:55.572 INFO:teuthology.orchestra.run.smithi105.stdout: mon warn on too few osds = false 2023-10-06T03:01:55.572 INFO:teuthology.orchestra.run.smithi105.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-06T03:01:55.572 INFO:teuthology.orchestra.run.smithi105.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-06T03:01:55.572 INFO:teuthology.orchestra.run.smithi105.stdout: mon_allow_pool_size_one = true 2023-10-06T03:01:55.573 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:01:55.573 INFO:teuthology.orchestra.run.smithi105.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-06T03:01:55.573 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:01:55.573 INFO:teuthology.orchestra.run.smithi105.stdout: osd default data pool replay window = 5 2023-10-06T03:01:55.573 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:01:55.573 INFO:teuthology.orchestra.run.smithi105.stdout: mon allow pool delete = true 2023-10-06T03:01:55.573 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:01:55.573 INFO:teuthology.orchestra.run.smithi105.stdout: mon cluster log file level = debug 2023-10-06T03:01:55.573 INFO:teuthology.orchestra.run.smithi105.stdout: debug asserts on shutdown = true 2023-10-06T03:01:55.573 INFO:teuthology.orchestra.run.smithi105.stdout: mon health detail to clog = false 2023-10-06T03:01:55.573 INFO:teuthology.orchestra.run.smithi105.stdout: mon host = "172.21.15.57,172.21.15.105,[v2:172.21.15.105:3301,v1:172.21.15.105:6790]" 2023-10-06T03:01:55.573 INFO:teuthology.orchestra.run.smithi105.stdout: ms die on skipped message = False 2023-10-06T03:01:55.574 INFO:teuthology.orchestra.run.smithi105.stdout: fsid = eb56dc0f-9213-41cb-9aad-8ade6c802e98 2023-10-06T03:01:55.574 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:01:55.574 INFO:teuthology.orchestra.run.smithi105.stdout:[osd] 2023-10-06T03:01:55.574 INFO:teuthology.orchestra.run.smithi105.stdout: osd journal size = 100 2023-10-06T03:01:55.574 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:01:55.574 INFO:teuthology.orchestra.run.smithi105.stdout: osd scrub load threshold = 5.0 2023-10-06T03:01:55.574 INFO:teuthology.orchestra.run.smithi105.stdout: osd scrub max interval = 600 2023-10-06T03:01:55.574 INFO:teuthology.orchestra.run.smithi105.stdout: osd mclock profile = high_recovery_ops 2023-10-06T03:01:55.574 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:01:55.574 INFO:teuthology.orchestra.run.smithi105.stdout: osd recover clone overlap = true 2023-10-06T03:01:55.574 INFO:teuthology.orchestra.run.smithi105.stdout: osd recovery max chunk = 1048576 2023-10-06T03:01:55.574 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:01:55.575 INFO:teuthology.orchestra.run.smithi105.stdout: osd debug shutdown = true 2023-10-06T03:01:55.575 INFO:teuthology.orchestra.run.smithi105.stdout: osd debug op order = true 2023-10-06T03:01:55.575 INFO:teuthology.orchestra.run.smithi105.stdout: osd debug verify stray on activate = true 2023-10-06T03:01:55.575 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:01:55.575 INFO:teuthology.orchestra.run.smithi105.stdout: osd open classes on start = true 2023-10-06T03:01:55.575 INFO:teuthology.orchestra.run.smithi105.stdout: osd debug pg log writeout = true 2023-10-06T03:01:55.575 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:01:55.575 INFO:teuthology.orchestra.run.smithi105.stdout: osd deep scrub update digest min age = 30 2023-10-06T03:01:55.575 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:01:55.575 INFO:teuthology.orchestra.run.smithi105.stdout: osd map max advance = 10 2023-10-06T03:01:55.575 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:01:55.576 INFO:teuthology.orchestra.run.smithi105.stdout: journal zero on create = true 2023-10-06T03:01:55.576 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:01:55.576 INFO:teuthology.orchestra.run.smithi105.stdout: filestore ondisk finisher threads = 3 2023-10-06T03:01:55.576 INFO:teuthology.orchestra.run.smithi105.stdout: filestore apply finisher threads = 3 2023-10-06T03:01:55.576 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:01:55.576 INFO:teuthology.orchestra.run.smithi105.stdout: bdev debug aio = true 2023-10-06T03:01:55.576 INFO:teuthology.orchestra.run.smithi105.stdout: osd debug misdirected ops = true 2023-10-06T03:01:55.576 INFO:teuthology.orchestra.run.smithi105.stdout: bdev async discard = True 2023-10-06T03:01:55.576 INFO:teuthology.orchestra.run.smithi105.stdout: bdev enable discard = True 2023-10-06T03:01:55.576 INFO:teuthology.orchestra.run.smithi105.stdout: bluestore allocator = bitmap 2023-10-06T03:01:55.576 INFO:teuthology.orchestra.run.smithi105.stdout: bluestore block size = 96636764160 2023-10-06T03:01:55.576 INFO:teuthology.orchestra.run.smithi105.stdout: bluestore fsck on mount = True 2023-10-06T03:01:55.577 INFO:teuthology.orchestra.run.smithi105.stdout: debug bluefs = 1/20 2023-10-06T03:01:55.577 INFO:teuthology.orchestra.run.smithi105.stdout: debug bluestore = 1/20 2023-10-06T03:01:55.577 INFO:teuthology.orchestra.run.smithi105.stdout: debug ms = 1 2023-10-06T03:01:55.577 INFO:teuthology.orchestra.run.smithi105.stdout: debug osd = 20 2023-10-06T03:01:55.577 INFO:teuthology.orchestra.run.smithi105.stdout: debug rocksdb = 4/10 2023-10-06T03:01:55.577 INFO:teuthology.orchestra.run.smithi105.stdout: mon osd backfillfull_ratio = 0.85 2023-10-06T03:01:55.577 INFO:teuthology.orchestra.run.smithi105.stdout: mon osd full ratio = 0.9 2023-10-06T03:01:55.577 INFO:teuthology.orchestra.run.smithi105.stdout: mon osd nearfull ratio = 0.8 2023-10-06T03:01:55.577 INFO:teuthology.orchestra.run.smithi105.stdout: osd failsafe full ratio = 0.95 2023-10-06T03:01:55.577 INFO:teuthology.orchestra.run.smithi105.stdout: osd objectstore = bluestore 2023-10-06T03:01:55.577 INFO:teuthology.orchestra.run.smithi105.stdout: osd op complaint time = 180 2023-10-06T03:01:55.577 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:01:55.578 INFO:teuthology.orchestra.run.smithi105.stdout:[mgr] 2023-10-06T03:01:55.578 INFO:teuthology.orchestra.run.smithi105.stdout: debug ms = 1 2023-10-06T03:01:55.578 INFO:teuthology.orchestra.run.smithi105.stdout: debug mgr = 20 2023-10-06T03:01:55.578 INFO:teuthology.orchestra.run.smithi105.stdout: debug mon = 20 2023-10-06T03:01:55.578 INFO:teuthology.orchestra.run.smithi105.stdout: debug auth = 20 2023-10-06T03:01:55.578 INFO:teuthology.orchestra.run.smithi105.stdout: mon reweight min pgs per osd = 4 2023-10-06T03:01:55.578 INFO:teuthology.orchestra.run.smithi105.stdout: mon reweight min bytes per osd = 10 2023-10-06T03:01:55.578 INFO:teuthology.orchestra.run.smithi105.stdout: mgr/telemetry/nag = false 2023-10-06T03:01:55.578 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:01:55.578 INFO:teuthology.orchestra.run.smithi105.stdout:[mon] 2023-10-06T03:01:55.578 INFO:teuthology.orchestra.run.smithi105.stdout: debug ms = 1 2023-10-06T03:01:55.578 INFO:teuthology.orchestra.run.smithi105.stdout: debug mon = 20 2023-10-06T03:01:55.579 INFO:teuthology.orchestra.run.smithi105.stdout: debug paxos = 20 2023-10-06T03:01:55.579 INFO:teuthology.orchestra.run.smithi105.stdout: debug auth = 20 2023-10-06T03:01:55.579 INFO:teuthology.orchestra.run.smithi105.stdout: mon data avail warn = 5 2023-10-06T03:01:55.579 INFO:teuthology.orchestra.run.smithi105.stdout: mon mgr mkfs grace = 240 2023-10-06T03:01:55.579 INFO:teuthology.orchestra.run.smithi105.stdout: mon reweight min pgs per osd = 4 2023-10-06T03:01:55.579 INFO:teuthology.orchestra.run.smithi105.stdout: mon osd reporter subtree level = osd 2023-10-06T03:01:55.579 INFO:teuthology.orchestra.run.smithi105.stdout: mon osd prime pg temp = true 2023-10-06T03:01:55.579 INFO:teuthology.orchestra.run.smithi105.stdout: mon reweight min bytes per osd = 10 2023-10-06T03:01:55.579 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:01:55.579 INFO:teuthology.orchestra.run.smithi105.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-06T03:01:55.579 INFO:teuthology.orchestra.run.smithi105.stdout: auth mon ticket ttl = 660 # 11m 2023-10-06T03:01:55.579 INFO:teuthology.orchestra.run.smithi105.stdout: auth service ticket ttl = 240 # 4m 2023-10-06T03:01:55.580 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:01:55.580 INFO:teuthology.orchestra.run.smithi105.stdout: # don't complain about insecure global_id in the test suite 2023-10-06T03:01:55.580 INFO:teuthology.orchestra.run.smithi105.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-06T03:01:55.580 INFO:teuthology.orchestra.run.smithi105.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-06T03:01:55.580 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:01:55.580 INFO:teuthology.orchestra.run.smithi105.stdout: # 1m isn't quite enough 2023-10-06T03:01:55.580 INFO:teuthology.orchestra.run.smithi105.stdout: mon_down_mkfs_grace = 2m 2023-10-06T03:01:55.580 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:01:55.580 INFO:teuthology.orchestra.run.smithi105.stdout: mon_warn_on_filestore_osds = false 2023-10-06T03:01:55.580 INFO:teuthology.orchestra.run.smithi105.stdout: mon op complaint time = 120 2023-10-06T03:01:55.580 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:01:55.580 INFO:teuthology.orchestra.run.smithi105.stdout:[client] 2023-10-06T03:01:55.580 INFO:teuthology.orchestra.run.smithi105.stdout: rgw cache enabled = true 2023-10-06T03:01:55.581 INFO:teuthology.orchestra.run.smithi105.stdout: rgw enable ops log = true 2023-10-06T03:01:55.581 INFO:teuthology.orchestra.run.smithi105.stdout: rgw enable usage log = true 2023-10-06T03:01:55.581 INFO:teuthology.orchestra.run.smithi105.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-06T03:01:55.581 INFO:teuthology.orchestra.run.smithi105.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-06T03:01:55.581 INFO:teuthology.orchestra.run.smithi105.stdout: client mount timeout = 600 2023-10-06T03:01:55.581 INFO:teuthology.orchestra.run.smithi105.stdout: debug client = 20 2023-10-06T03:01:55.581 INFO:teuthology.orchestra.run.smithi105.stdout: debug ms = 1 2023-10-06T03:01:55.581 INFO:teuthology.orchestra.run.smithi105.stdout: pid file = "" 2023-10-06T03:01:55.581 INFO:teuthology.orchestra.run.smithi105.stdout: rados mon op timeout = 900 2023-10-06T03:01:55.581 INFO:teuthology.orchestra.run.smithi105.stdout: rados osd op timeout = 900 2023-10-06T03:01:55.581 INFO:teuthology.orchestra.run.smithi105.stdout:[mon.a] 2023-10-06T03:01:55.581 INFO:teuthology.orchestra.run.smithi105.stdout:[mon.b] 2023-10-06T03:01:55.581 INFO:teuthology.orchestra.run.smithi105.stdout:[mon.c] 2023-10-06T03:01:55.582 INFO:teuthology.orchestra.run.smithi105.stdout:[mds.a] 2023-10-06T03:01:55.582 INFO:teuthology.orchestra.run.smithi105.stdout:[mds.c] 2023-10-06T03:01:55.582 INFO:teuthology.orchestra.run.smithi105.stdout:[mds.b] 2023-10-06T03:01:55.582 INFO:teuthology.orchestra.run.smithi105.stdout:[mds.d] 2023-10-06T03:01:55.582 INFO:teuthology.orchestra.run.smithi105.stdout:[mds] 2023-10-06T03:01:55.582 INFO:teuthology.orchestra.run.smithi105.stdout: debug mds = 20 2023-10-06T03:01:55.582 INFO:teuthology.orchestra.run.smithi105.stdout: debug ms = 1 2023-10-06T03:01:55.582 INFO:teuthology.orchestra.run.smithi105.stdout: mds debug frag = True 2023-10-06T03:01:55.582 INFO:teuthology.orchestra.run.smithi105.stdout: mds debug scatterstat = True 2023-10-06T03:01:55.582 INFO:teuthology.orchestra.run.smithi105.stdout: mds op complaint time = 180 2023-10-06T03:01:55.582 INFO:teuthology.orchestra.run.smithi105.stdout: mds verify scatter = True 2023-10-06T03:01:55.582 INFO:teuthology.orchestra.run.smithi105.stdout: osd op complaint time = 180 2023-10-06T03:01:55.583 INFO:teuthology.orchestra.run.smithi105.stdout: rados mon op timeout = 900 2023-10-06T03:01:55.583 INFO:teuthology.orchestra.run.smithi105.stdout: rados osd op timeout = 900 2023-10-06T03:01:55.583 INFO:teuthology.orchestra.run.smithi105.stdout: osd_deep_scrub_large_omap_object_key_threshold = 5 2023-10-06T03:01:55.592 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-06T03:01:55.592 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-06T03:01:55.592 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-06T03:01:55.592 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:01:55.592 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-06T03:01:55.593 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-06T03:01:55.593 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-06T03:01:55.593 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:01:55.593 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-06T03:01:55.593 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-06T03:01:55.593 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-06T03:01:55.593 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:01:55.594 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-06T03:01:55.594 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-06T03:01:55.594 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-06T03:01:55.594 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:01:55.617 INFO:tasks.ceph.mds.b:Stopped 2023-10-06T03:01:55.617 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-06T03:01:55.618 INFO:tasks.ceph.mds.d:Stopped 2023-10-06T03:01:55.618 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-06T03:01:55.619 INFO:tasks.ceph.mds.a:Stopped 2023-10-06T03:01:55.619 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-06T03:01:55.620 INFO:tasks.ceph.mds.c:Stopped 2023-10-06T03:01:55.620 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-06T03:01:55.667 INFO:tasks.ceph.mds.b:Started 2023-10-06T03:01:55.667 DEBUG:teuthology.parallel:result is None 2023-10-06T03:01:55.669 INFO:tasks.ceph.mds.a:Started 2023-10-06T03:01:55.669 DEBUG:teuthology.parallel:result is None 2023-10-06T03:01:55.670 INFO:tasks.ceph.mds.d:Started 2023-10-06T03:01:55.670 DEBUG:teuthology.parallel:result is None 2023-10-06T03:01:55.675 INFO:tasks.ceph.mds.c:Started 2023-10-06T03:01:55.675 DEBUG:teuthology.parallel:result is None 2023-10-06T03:01:55.675 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:01:55.772 INFO:tasks.ceph.mds.b.smithi105.stdout:starting mds.b at 2023-10-06T03:01:55.772 INFO:tasks.ceph.mds.d.smithi105.stdout:starting mds.d at 2023-10-06T03:01:55.773 INFO:tasks.ceph.mds.c.smithi057.stdout:starting mds.c at 2023-10-06T03:01:55.781 INFO:tasks.ceph.mon.a.smithi057.stderr:2023-10-06T03:01:55.774+0000 7f3ec61a3700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T03:01:55.781 INFO:tasks.ceph.mds.a.smithi057.stdout:starting mds.a at 2023-10-06T03:01:55.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:55.826+0000 7f9fa046e700 1 Processor -- start 2023-10-06T03:01:55.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:55.826+0000 7f9fa046e700 1 -- start start 2023-10-06T03:01:55.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:55.830+0000 7f9fa046e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9f98158fa0 0x7f9f9815ce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:55.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:55.830+0000 7f9fa046e700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f9f9815a490 0x7f9f980cc970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:55.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:55.830+0000 7f9fa046e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f980ce440 con 0x7f9f98159370 2023-10-06T03:01:55.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:55.830+0000 7f9fa046e700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f980ce720 con 0x7f9f9815a490 2023-10-06T03:01:55.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:55.830+0000 7f9fa046e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f9815d660 con 0x7f9f98158fa0 2023-10-06T03:01:55.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:55.830+0000 7f9f9ea0b700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f9f98159370 0x7f9f98069170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:35936/0 (socket says 172.21.15.57:35936) 2023-10-06T03:01:55.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:55.830+0000 7f9f9ea0b700 1 -- 172.21.15.57:0/3598528472 learned_addr learned my addr 172.21.15.57:0/3598528472 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:01:55.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:55.830+0000 7f9f9e20a700 1 --2- 172.21.15.57:0/3598528472 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9f98158fa0 0x7f9f9815ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:55.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:55.830+0000 7f9f9da09700 1 --2- 172.21.15.57:0/3598528472 >> v2:172.21.15.105:3300/0 conn(0x7f9f9815a490 0x7f9f980cc970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:55.838 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:55.830+0000 7f9f9d208700 1 -- 172.21.15.57:0/3598528472 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2781617558 0 0) 0x7f9f980ce440 con 0x7f9f98159370 2023-10-06T03:01:55.838 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:55.830+0000 7f9f9d208700 1 -- 172.21.15.57:0/3598528472 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f84003570 con 0x7f9f98159370 2023-10-06T03:01:55.838 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:55.830+0000 7f9f9e20a700 1 -- 172.21.15.57:0/3598528472 >> v2:172.21.15.105:3300/0 conn(0x7f9f9815a490 msgr2=0x7f9f980cc970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:55.838 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:55.830+0000 7f9f9e20a700 1 --2- 172.21.15.57:0/3598528472 >> v2:172.21.15.105:3300/0 conn(0x7f9f9815a490 0x7f9f980cc970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:55.838 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:55.830+0000 7f9f9e20a700 1 -- 172.21.15.57:0/3598528472 >> v1:172.21.15.57:6789/0 conn(0x7f9f98159370 legacy=0x7f9f98069170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:55.838 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:55.830+0000 7f9f9e20a700 1 -- 172.21.15.57:0/3598528472 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f9815d940 con 0x7f9f98158fa0 2023-10-06T03:01:55.838 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:55.830+0000 7f9f9da09700 1 --2- 172.21.15.57:0/3598528472 >> v2:172.21.15.105:3300/0 conn(0x7f9f9815a490 0x7f9f980cc970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:01:55.838 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:55.830+0000 7f9f9e20a700 1 --2- 172.21.15.57:0/3598528472 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9f98158fa0 0x7f9f9815ce10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9f940098e0 tx=0x7f9f940091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=88c5e60ecdf04387 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:55.838 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:55.830+0000 7f9f9d208700 1 -- 172.21.15.57:0/3598528472 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f94011630 con 0x7f9f98158fa0 2023-10-06T03:01:55.838 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:55.830+0000 7f9f9d208700 1 -- 172.21.15.57:0/3598528472 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f94011790 con 0x7f9f98158fa0 2023-10-06T03:01:55.838 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:55.830+0000 7f9f9d208700 1 -- 172.21.15.57:0/3598528472 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f94011b30 con 0x7f9f98158fa0 2023-10-06T03:01:55.839 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:55.830+0000 7f9fa046e700 1 -- 172.21.15.57:0/3598528472 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9f98158fa0 msgr2=0x7f9f9815ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:55.839 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:55.830+0000 7f9fa046e700 1 --2- 172.21.15.57:0/3598528472 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9f98158fa0 0x7f9f9815ce10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9f940098e0 tx=0x7f9f940091a0 comp rx=0 tx=0).stop 2023-10-06T03:01:55.839 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:55.834+0000 7f9fa046e700 1 -- 172.21.15.57:0/3598528472 shutdown_connections 2023-10-06T03:01:55.839 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:55.834+0000 7f9fa046e700 1 --2- 172.21.15.57:0/3598528472 >> v2:172.21.15.105:3300/0 conn(0x7f9f9815a490 0x7f9f980cc970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:55.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:55.834+0000 7f9fa046e700 1 --2- 172.21.15.57:0/3598528472 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9f98158fa0 0x7f9f9815ce10 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:55.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:55.834+0000 7f9fa046e700 1 -- 172.21.15.57:0/3598528472 >> 172.21.15.57:0/3598528472 conn(0x7f9f98067a20 msgr2=0x7f9f98067e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:55.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:55.834+0000 7f9fa046e700 1 -- 172.21.15.57:0/3598528472 shutdown_connections 2023-10-06T03:01:55.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:55.834+0000 7f9fa046e700 1 -- 172.21.15.57:0/3598528472 wait complete. 2023-10-06T03:01:55.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:55.834+0000 7f9fa046e700 1 Processor -- start 2023-10-06T03:01:55.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:55.834+0000 7f9fa046e700 1 -- start start 2023-10-06T03:01:55.843 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:55.838+0000 7f9fa046e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9f98158fa0 0x7f9f9814c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:55.843 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:55.838+0000 7f9fa046e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9f98159370 0x7f9f98152270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:55.844 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:55.838+0000 7f9fa046e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9f9815a490 0x7f9f981527b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:55.844 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:55.838+0000 7f9fa046e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f981530c0 con 0x7f9f98159370 2023-10-06T03:01:55.844 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:55.838+0000 7f9fa046e700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f9814c740 con 0x7f9f98158fa0 2023-10-06T03:01:55.844 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:55.838+0000 7f9fa046e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f98169730 con 0x7f9f9815a490 2023-10-06T03:01:55.844 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:55.838+0000 7f9f9da09700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9f98159370 0x7f9f98152270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:55.844 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:55.838+0000 7f9f9da09700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9f98159370 0x7f9f98152270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40406/0 (socket says 172.21.15.57:40406) 2023-10-06T03:01:55.844 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:55.838+0000 7f9f9da09700 1 -- 172.21.15.57:0/4251864452 learned_addr learned my addr 172.21.15.57:0/4251864452 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:55.844 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:55.838+0000 7f9f9e20a700 1 --2- 172.21.15.57:0/4251864452 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9f98158fa0 0x7f9f9814c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:55.844 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:55.838+0000 7f9f9ea0b700 1 --2- 172.21.15.57:0/4251864452 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9f9815a490 0x7f9f981527b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:55.845 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:55.838+0000 7f9f9da09700 1 -- 172.21.15.57:0/4251864452 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9f9815a490 msgr2=0x7f9f981527b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:55.846 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:55.838+0000 7f9f9da09700 1 --2- 172.21.15.57:0/4251864452 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9f9815a490 0x7f9f981527b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:55.846 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:55.838+0000 7f9f9da09700 1 -- 172.21.15.57:0/4251864452 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9f98158fa0 msgr2=0x7f9f9814c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:55.846 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:55.838+0000 7f9f9da09700 1 --2- 172.21.15.57:0/4251864452 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9f98158fa0 0x7f9f9814c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:55.846 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:55.838+0000 7f9f9da09700 1 -- 172.21.15.57:0/4251864452 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f88009420 con 0x7f9f98159370 2023-10-06T03:01:55.846 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:55.838+0000 7f9f9ea0b700 1 --2- 172.21.15.57:0/4251864452 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9f9815a490 0x7f9f981527b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:01:55.846 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:55.838+0000 7f9f9da09700 1 --2- 172.21.15.57:0/4251864452 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9f98159370 0x7f9f98152270 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f9f8800ec80 tx=0x7f9f880091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:55.846 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:55.838+0000 7f9f8e7fc700 1 -- 172.21.15.57:0/4251864452 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f8800c850 con 0x7f9f98159370 2023-10-06T03:01:55.846 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:55.838+0000 7f9f8e7fc700 1 -- 172.21.15.57:0/4251864452 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f8800c9b0 con 0x7f9f98159370 2023-10-06T03:01:55.846 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:55.838+0000 7f9fa046e700 1 -- 172.21.15.57:0/4251864452 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f94009420 con 0x7f9f98159370 2023-10-06T03:01:55.846 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:55.838+0000 7f9f8e7fc700 1 -- 172.21.15.57:0/4251864452 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f8800cd30 con 0x7f9f98159370 2023-10-06T03:01:55.846 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:55.838+0000 7f9fa046e700 1 -- 172.21.15.57:0/4251864452 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f981699f0 con 0x7f9f98159370 2023-10-06T03:01:55.847 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:55.842+0000 7f9fa046e700 1 -- 172.21.15.57:0/4251864452 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f98088b00 con 0x7f9f98159370 2023-10-06T03:01:55.848 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:55.842+0000 7f9f8e7fc700 1 -- 172.21.15.57:0/4251864452 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f9f88013680 con 0x7f9f98159370 2023-10-06T03:01:55.850 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:55.842+0000 7f9f8e7fc700 1 --2- 172.21.15.57:0/4251864452 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f9f7c060550 0x7f9f7c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:55.850 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:55.842+0000 7f9f8e7fc700 1 -- 172.21.15.57:0/4251864452 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6144+0+0 (secure 0 0 0) 0x7f9f8807ccc0 con 0x7f9f98159370 2023-10-06T03:01:55.850 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:55.842+0000 7f9f9e20a700 1 --2- 172.21.15.57:0/4251864452 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f9f7c060550 0x7f9f7c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:55.851 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:55.846+0000 7f9f9e20a700 1 --2- 172.21.15.57:0/4251864452 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f9f7c060550 0x7f9f7c062a00 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f9f940091e0 tx=0x7f9f94017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:55.859 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:55.854+0000 7f9f8e7fc700 1 -- 172.21.15.57:0/4251864452 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f9f88083080 con 0x7f9f98159370 2023-10-06T03:01:56.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:56.066+0000 7f9fa046e700 1 -- 172.21.15.57:0/4251864452 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9f9815dc20 con 0x7f9f98159370 2023-10-06T03:01:56.074 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:56.066+0000 7f9f8e7fc700 1 -- 172.21.15.57:0/4251864452 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4601 (secure 0 0 0) 0x7f9f88050b10 con 0x7f9f98159370 2023-10-06T03:01:56.075 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:01:56.075 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":19,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4980,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/3842897946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":3842897946},{"type":"v1","addr":"172.21.15.57:6835","nonce":3842897946}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4986,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6837/1629829999","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6836","nonce":1629829999},{"type":"v1","addr":"172.21.15.57:6837","nonce":1629829999}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5158,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6834/3877951826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":3877951826},{"type":"v1","addr":"172.21.15.105:6834","nonce":3877951826}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:01:47.353461+0000","modified":"2023-10-06T03:01:55.787676+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":36,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5211},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5211":{"gid":5211,"name":"d","rank":0,"incarnation":19,"state":"up:replay","state_seq":1,"addr":"172.21.15.105:6835/938221046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":938221046},{"type":"v1","addr":"172.21.15.105:6835","nonce":938221046}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T03:01:56.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:56.070+0000 7f9fa046e700 1 -- 172.21.15.57:0/4251864452 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f9f7c060550 msgr2=0x7f9f7c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:56.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:56.070+0000 7f9fa046e700 1 --2- 172.21.15.57:0/4251864452 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f9f7c060550 0x7f9f7c062a00 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f9f940091e0 tx=0x7f9f94017000 comp rx=0 tx=0).stop 2023-10-06T03:01:56.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:56.070+0000 7f9fa046e700 1 -- 172.21.15.57:0/4251864452 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9f98159370 msgr2=0x7f9f98152270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:56.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:56.070+0000 7f9fa046e700 1 --2- 172.21.15.57:0/4251864452 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9f98159370 0x7f9f98152270 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f9f8800ec80 tx=0x7f9f880091a0 comp rx=0 tx=0).stop 2023-10-06T03:01:56.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:56.070+0000 7f9fa046e700 1 -- 172.21.15.57:0/4251864452 shutdown_connections 2023-10-06T03:01:56.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:56.070+0000 7f9fa046e700 1 --2- 172.21.15.57:0/4251864452 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f9f7c060550 0x7f9f7c062a00 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:56.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:56.070+0000 7f9fa046e700 1 --2- 172.21.15.57:0/4251864452 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9f9815a490 0x7f9f981527b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:56.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:56.070+0000 7f9fa046e700 1 --2- 172.21.15.57:0/4251864452 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9f98159370 0x7f9f98152270 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:56.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:56.070+0000 7f9fa046e700 1 --2- 172.21.15.57:0/4251864452 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9f98158fa0 0x7f9f9814c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:56.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:56.070+0000 7f9fa046e700 1 -- 172.21.15.57:0/4251864452 >> 172.21.15.57:0/4251864452 conn(0x7f9f98067a20 msgr2=0x7f9f980c60a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:56.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:56.070+0000 7f9fa046e700 1 -- 172.21.15.57:0/4251864452 shutdown_connections 2023-10-06T03:01:56.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:56.070+0000 7f9fa046e700 1 -- 172.21.15.57:0/4251864452 wait complete. 2023-10-06T03:01:56.080 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 19 2023-10-06T03:01:56.501 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 19, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T03:01:47.353461+0000', 'modified': '2023-10-06T03:01:55.787676+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 36, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5211}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5211': {'gid': 5211, 'name': 'd', 'rank': 0, 'incarnation': 19, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.105:6835/938221046', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.105:6833', 'nonce': 938221046}, {'type': 'v1', 'addr': '172.21.15.105:6835', 'nonce': 938221046}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T03:01:56.501 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5211:up:replay 2023-10-06T03:01:57.502 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:01:57.664 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:57.658+0000 7f29d220c700 1 Processor -- start 2023-10-06T03:01:57.665 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:57.658+0000 7f29d220c700 1 -- start start 2023-10-06T03:01:57.667 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:57.662+0000 7f29d220c700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f29cc0c9b00 0x7f29cc0c8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:57.668 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:57.662+0000 7f29d220c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f29cc0c9ed0 0x7f29cc0c6340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:57.668 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:57.662+0000 7f29d220c700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29cc0cadb0 con 0x7f29cc161180 2023-10-06T03:01:57.668 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:57.662+0000 7f29d220c700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29cc0c6b00 con 0x7f29cc0c9ed0 2023-10-06T03:01:57.668 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:57.662+0000 7f29d220c700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29cc0c6880 con 0x7f29cc0c9b00 2023-10-06T03:01:57.668 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:57.662+0000 7f29d0a09700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f29cc0c9ed0 0x7f29cc0c6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:57.669 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:57.662+0000 7f29d0a09700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f29cc0c9ed0 0x7f29cc0c6340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40416/0 (socket says 172.21.15.57:40416) 2023-10-06T03:01:57.669 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:57.662+0000 7f29d0a09700 1 -- 172.21.15.57:0/663119103 learned_addr learned my addr 172.21.15.57:0/663119103 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:57.669 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:57.662+0000 7f29d120a700 1 --2- 172.21.15.57:0/663119103 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f29cc0c9b00 0x7f29cc0c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:57.669 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:57.662+0000 7f29d0a09700 1 -- 172.21.15.57:0/663119103 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f29cc0c9b00 msgr2=0x7f29cc0c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:57.669 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:57.662+0000 7f29d0a09700 1 --2- 172.21.15.57:0/663119103 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f29cc0c9b00 0x7f29cc0c8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:57.670 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:57.662+0000 7f29d0a09700 1 -- 172.21.15.57:0/663119103 >> v1:172.21.15.57:6789/0 conn(0x7f29cc161180 legacy=0x7f29cc15db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:57.670 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:57.662+0000 7f29d0a09700 1 -- 172.21.15.57:0/663119103 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29cc0ca480 con 0x7f29cc0c9ed0 2023-10-06T03:01:57.670 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:57.662+0000 7f29c3fff700 1 -- 172.21.15.57:0/663119103 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 993418730 0 0) 0x7f29cc0cadb0 con 0x7f29cc161180 2023-10-06T03:01:57.670 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:57.662+0000 7f29d0a09700 1 --2- 172.21.15.57:0/663119103 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29cc0c9ed0 0x7f29cc0c6340 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f29bc0099b0 tx=0x7f29bc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=601dd7630ddadec server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:57.671 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:57.666+0000 7f29c3fff700 1 -- 172.21.15.57:0/663119103 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29bc009ea0 con 0x7f29cc0c9ed0 2023-10-06T03:01:57.671 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:57.666+0000 7f29c3fff700 1 -- 172.21.15.57:0/663119103 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29bc00b860 con 0x7f29cc0c9ed0 2023-10-06T03:01:57.671 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:57.666+0000 7f29c3fff700 1 -- 172.21.15.57:0/663119103 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29bc00bc00 con 0x7f29cc0c9ed0 2023-10-06T03:01:57.672 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:57.666+0000 7f29d220c700 1 -- 172.21.15.57:0/663119103 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29cc0c9ed0 msgr2=0x7f29cc0c6340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:57.672 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:57.666+0000 7f29d220c700 1 --2- 172.21.15.57:0/663119103 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29cc0c9ed0 0x7f29cc0c6340 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f29bc0099b0 tx=0x7f29bc009250 comp rx=0 tx=0).stop 2023-10-06T03:01:57.673 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:57.666+0000 7f29d220c700 1 -- 172.21.15.57:0/663119103 shutdown_connections 2023-10-06T03:01:57.673 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:57.666+0000 7f29d220c700 1 --2- 172.21.15.57:0/663119103 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29cc0c9ed0 0x7f29cc0c6340 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:57.673 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:57.666+0000 7f29d220c700 1 --2- 172.21.15.57:0/663119103 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f29cc0c9b00 0x7f29cc0c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:57.673 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:57.666+0000 7f29d220c700 1 -- 172.21.15.57:0/663119103 >> 172.21.15.57:0/663119103 conn(0x7f29cc067b00 msgr2=0x7f29cc0cbd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:57.673 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:57.666+0000 7f29d220c700 1 -- 172.21.15.57:0/663119103 shutdown_connections 2023-10-06T03:01:57.673 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:57.666+0000 7f29d220c700 1 -- 172.21.15.57:0/663119103 wait complete. 2023-10-06T03:01:57.676 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:57.670+0000 7f29d220c700 1 Processor -- start 2023-10-06T03:01:57.676 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:57.670+0000 7f29d220c700 1 -- start start 2023-10-06T03:01:57.678 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:57.670+0000 7f29d220c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29cc0c9b00 0x7f29cc157140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:57.678 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:57.670+0000 7f29d220c700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f29cc0c9ed0 0x7f29cc0c5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:57.678 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:57.670+0000 7f29d220c700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f29cc161180 0x7f29cc0c3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:57.678 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:57.670+0000 7f29d220c700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29cc0c5830 con 0x7f29cc0c9b00 2023-10-06T03:01:57.678 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:57.670+0000 7f29d220c700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29cc1590d0 con 0x7f29cc161180 2023-10-06T03:01:57.678 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:57.670+0000 7f29d220c700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29cc0c4c20 con 0x7f29cc0c9ed0 2023-10-06T03:01:57.679 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:57.670+0000 7f29d120a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29cc0c9b00 0x7f29cc157140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:57.679 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:57.670+0000 7f29d120a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29cc0c9b00 0x7f29cc157140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40432/0 (socket says 172.21.15.57:40432) 2023-10-06T03:01:57.679 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:57.670+0000 7f29d120a700 1 -- 172.21.15.57:0/2071861700 learned_addr learned my addr 172.21.15.57:0/2071861700 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:57.679 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:57.670+0000 7f29d0a09700 1 --2- 172.21.15.57:0/2071861700 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f29cc0c9ed0 0x7f29cc0c5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:57.679 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:57.670+0000 7f29d1a0b700 1 --2- 172.21.15.57:0/2071861700 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f29cc161180 0x7f29cc0c3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:57.679 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:57.674+0000 7f29d120a700 1 -- 172.21.15.57:0/2071861700 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f29cc0c9ed0 msgr2=0x7f29cc0c5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:57.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:57.674+0000 7f29d120a700 1 --2- 172.21.15.57:0/2071861700 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f29cc0c9ed0 0x7f29cc0c5cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:57.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:57.674+0000 7f29d120a700 1 -- 172.21.15.57:0/2071861700 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f29cc161180 msgr2=0x7f29cc0c3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:57.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:57.674+0000 7f29d120a700 1 --2- 172.21.15.57:0/2071861700 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f29cc161180 0x7f29cc0c3770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:57.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:57.674+0000 7f29d120a700 1 -- 172.21.15.57:0/2071861700 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29bc0094f0 con 0x7f29cc0c9b00 2023-10-06T03:01:57.681 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:57.674+0000 7f29d120a700 1 --2- 172.21.15.57:0/2071861700 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29cc0c9b00 0x7f29cc157140 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f29c800e930 tx=0x7f29c80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:57.681 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:57.674+0000 7f29c17fa700 1 -- 172.21.15.57:0/2071861700 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29c8013680 con 0x7f29cc0c9b00 2023-10-06T03:01:57.681 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:57.674+0000 7f29c17fa700 1 -- 172.21.15.57:0/2071861700 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29c80137e0 con 0x7f29cc0c9b00 2023-10-06T03:01:57.681 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:57.674+0000 7f29c17fa700 1 -- 172.21.15.57:0/2071861700 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29c8013b80 con 0x7f29cc0c9b00 2023-10-06T03:01:57.681 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:57.674+0000 7f29d220c700 1 -- 172.21.15.57:0/2071861700 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29cc0c4f00 con 0x7f29cc0c9b00 2023-10-06T03:01:57.681 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:57.674+0000 7f29d220c700 1 -- 172.21.15.57:0/2071861700 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29cc0c54c0 con 0x7f29cc0c9b00 2023-10-06T03:01:57.682 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:57.674+0000 7f29d220c700 1 -- 172.21.15.57:0/2071861700 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29cc0645e0 con 0x7f29cc0c9b00 2023-10-06T03:01:57.684 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:57.678+0000 7f29c17fa700 1 -- 172.21.15.57:0/2071861700 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f29c800c3e0 con 0x7f29cc0c9b00 2023-10-06T03:01:57.685 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:57.678+0000 7f29c17fa700 1 --2- 172.21.15.57:0/2071861700 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f29b0060550 0x7f29b0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:57.685 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:57.678+0000 7f29c17fa700 1 -- 172.21.15.57:0/2071861700 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6144+0+0 (secure 0 0 0) 0x7f29c807ca90 con 0x7f29cc0c9b00 2023-10-06T03:01:57.685 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:57.678+0000 7f29d0a09700 1 --2- 172.21.15.57:0/2071861700 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f29b0060550 0x7f29b0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:57.686 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:57.682+0000 7f29d0a09700 1 --2- 172.21.15.57:0/2071861700 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f29b0060550 0x7f29b0062a00 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f29bc0099b0 tx=0x7f29bc017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:57.693 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:57.686+0000 7f29c17fa700 1 -- 172.21.15.57:0/2071861700 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f29c804ce50 con 0x7f29cc0c9b00 2023-10-06T03:01:57.910 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:57.902+0000 7f29d220c700 1 -- 172.21.15.57:0/2071861700 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f29cc0ca760 con 0x7f29cc0c9b00 2023-10-06T03:01:57.911 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:57.906+0000 7f29c17fa700 1 -- 172.21.15.57:0/2071861700 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+4595 (secure 0 0 0) 0x7f29c8017090 con 0x7f29cc0c9b00 2023-10-06T03:01:57.911 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:01:57.911 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":21,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5158,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6834/3877951826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":3877951826},{"type":"v1","addr":"172.21.15.105:6834","nonce":3877951826}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5214,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/311797094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":311797094},{"type":"v1","addr":"172.21.15.57:6835","nonce":311797094}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5217,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6837/670891004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6836","nonce":670891004},{"type":"v1","addr":"172.21.15.57:6837","nonce":670891004}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:01:47.353461+0000","modified":"2023-10-06T03:01:57.798613+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":36,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5211},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5211":{"gid":5211,"name":"d","rank":0,"incarnation":19,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.105:6835/938221046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":938221046},{"type":"v1","addr":"172.21.15.105:6835","nonce":938221046}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T03:01:57.914 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:57.906+0000 7f29d220c700 1 -- 172.21.15.57:0/2071861700 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f29b0060550 msgr2=0x7f29b0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:57.914 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:57.906+0000 7f29d220c700 1 --2- 172.21.15.57:0/2071861700 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f29b0060550 0x7f29b0062a00 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f29bc0099b0 tx=0x7f29bc017000 comp rx=0 tx=0).stop 2023-10-06T03:01:57.914 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:57.906+0000 7f29d220c700 1 -- 172.21.15.57:0/2071861700 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29cc0c9b00 msgr2=0x7f29cc157140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:57.914 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:57.906+0000 7f29d220c700 1 --2- 172.21.15.57:0/2071861700 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29cc0c9b00 0x7f29cc157140 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f29c800e930 tx=0x7f29c80091a0 comp rx=0 tx=0).stop 2023-10-06T03:01:57.915 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:57.906+0000 7f29d220c700 1 -- 172.21.15.57:0/2071861700 shutdown_connections 2023-10-06T03:01:57.915 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:57.906+0000 7f29d220c700 1 --2- 172.21.15.57:0/2071861700 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f29cc161180 0x7f29cc0c3770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:57.915 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:57.906+0000 7f29d220c700 1 --2- 172.21.15.57:0/2071861700 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f29b0060550 0x7f29b0062a00 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:57.915 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:57.906+0000 7f29d220c700 1 --2- 172.21.15.57:0/2071861700 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f29cc0c9ed0 0x7f29cc0c5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:57.915 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:57.906+0000 7f29d220c700 1 --2- 172.21.15.57:0/2071861700 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29cc0c9b00 0x7f29cc157140 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:57.915 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:57.906+0000 7f29d220c700 1 -- 172.21.15.57:0/2071861700 >> 172.21.15.57:0/2071861700 conn(0x7f29cc067b00 msgr2=0x7f29cc0c0aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:57.915 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:57.906+0000 7f29d220c700 1 -- 172.21.15.57:0/2071861700 shutdown_connections 2023-10-06T03:01:57.915 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:57.910+0000 7f29d220c700 1 -- 172.21.15.57:0/2071861700 wait complete. 2023-10-06T03:01:57.917 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 21 2023-10-06T03:01:58.338 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 21, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T03:01:47.353461+0000', 'modified': '2023-10-06T03:01:57.798613+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 36, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5211}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5211': {'gid': 5211, 'name': 'd', 'rank': 0, 'incarnation': 19, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.105:6835/938221046', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.105:6833', 'nonce': 938221046}, {'type': 'v1', 'addr': '172.21.15.105:6835', 'nonce': 938221046}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T03:01:58.338 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5211:up:rejoin 2023-10-06T03:01:59.340 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:01:59.501 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:59.494+0000 7fe12f385700 1 Processor -- start 2023-10-06T03:01:59.501 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:59.494+0000 7fe12f385700 1 -- start start 2023-10-06T03:01:59.503 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:59.498+0000 7fe12f385700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe1280c6c20 0x7fe1280c0e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:59.503 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:59.498+0000 7fe12f385700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1280cb0a0 con 0x7fe1280c9fb0 2023-10-06T03:01:59.503 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:59.498+0000 7fe12f385700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1280ca490 con 0x7fe12815d6a0 2023-10-06T03:01:59.503 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:59.498+0000 7fe12f385700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1280ca770 con 0x7fe1280c6c20 2023-10-06T03:01:59.504 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:59.498+0000 7fe12d922700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fe1280c9fb0 0x7fe1280c1360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:35954/0 (socket says 172.21.15.57:35954) 2023-10-06T03:01:59.504 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:59.498+0000 7fe12d922700 1 -- 172.21.15.57:0/464442154 learned_addr learned my addr 172.21.15.57:0/464442154 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:01:59.504 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:59.498+0000 7fe12c920700 1 --2- 172.21.15.57:0/464442154 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe1280c6c20 0x7fe1280c0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:59.505 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:59.498+0000 7fe11ffff700 1 -- 172.21.15.57:0/464442154 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 326419108 0 0) 0x7fe1280cb0a0 con 0x7fe1280c9fb0 2023-10-06T03:01:59.505 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:59.498+0000 7fe11ffff700 1 -- 172.21.15.57:0/464442154 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe114003570 con 0x7fe1280c9fb0 2023-10-06T03:01:59.506 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:59.498+0000 7fe11ffff700 1 -- 172.21.15.57:0/464442154 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 310438284 0 0) 0x7fe1280ca490 con 0x7fe12815d6a0 2023-10-06T03:01:59.506 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:59.498+0000 7fe11ffff700 1 -- 172.21.15.57:0/464442154 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1280cb0a0 con 0x7fe12815d6a0 2023-10-06T03:01:59.506 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:59.498+0000 7fe11ffff700 1 -- 172.21.15.57:0/464442154 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2239727247 0 0) 0x7fe114003570 con 0x7fe1280c9fb0 2023-10-06T03:01:59.506 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:59.498+0000 7fe11ffff700 1 -- 172.21.15.57:0/464442154 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe1280c6c20 msgr2=0x7fe1280c0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:59.506 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:59.498+0000 7fe11ffff700 1 --2- 172.21.15.57:0/464442154 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe1280c6c20 0x7fe1280c0e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:59.506 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:59.498+0000 7fe11ffff700 1 -- 172.21.15.57:0/464442154 >> v1:172.21.15.105:6789/0 conn(0x7fe12815d6a0 legacy=0x7fe1280c6510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:59.506 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:59.498+0000 7fe11ffff700 1 -- 172.21.15.57:0/464442154 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1280caa50 con 0x7fe1280c9fb0 2023-10-06T03:01:59.506 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:59.498+0000 7fe11ffff700 1 -- 172.21.15.57:0/464442154 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2482400018 0 0) 0x7fe1200017f0 con 0x7fe1280c9fb0 2023-10-06T03:01:59.506 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:59.498+0000 7fe11ffff700 1 -- 172.21.15.57:0/464442154 >> v1:172.21.15.57:6789/0 conn(0x7fe1280c9fb0 legacy=0x7fe1280c1360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:59.506 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:59.498+0000 7fe11ffff700 1 --2- 172.21.15.57:0/464442154 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe114003c20 0x7fe114003ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:59.507 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:59.498+0000 7fe11ffff700 1 --2- 172.21.15.57:0/464442154 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe114004810 0x7fe114004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:59.507 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:59.498+0000 7fe11ffff700 1 --2- 172.21.15.57:0/464442154 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe1280c6c20 0x7fe1140051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:59.507 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:59.498+0000 7fe11ffff700 1 -- 172.21.15.57:0/464442154 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1280ca770 con 0x7fe114004810 2023-10-06T03:01:59.507 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:59.498+0000 7fe11ffff700 1 -- 172.21.15.57:0/464442154 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe11400bb10 con 0x7fe114003c20 2023-10-06T03:01:59.507 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:59.498+0000 7fe11ffff700 1 -- 172.21.15.57:0/464442154 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe11400bcd0 con 0x7fe1280c6c20 2023-10-06T03:01:59.508 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:59.498+0000 7fe12c920700 1 --2- 172.21.15.57:0/464442154 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe114004810 0x7fe114004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:59.508 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:59.498+0000 7fe12d922700 1 --2- 172.21.15.57:0/464442154 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe1280c6c20 0x7fe1140051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:59.508 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:59.498+0000 7fe12d121700 1 --2- 172.21.15.57:0/464442154 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe114003c20 0x7fe114003ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:59.508 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:59.502+0000 7fe12d922700 1 -- 172.21.15.57:0/464442154 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe114003c20 msgr2=0x7fe114003ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:59.508 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:59.502+0000 7fe12d922700 1 --2- 172.21.15.57:0/464442154 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe114003c20 0x7fe114003ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:59.508 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:59.502+0000 7fe12d922700 1 -- 172.21.15.57:0/464442154 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe114004810 msgr2=0x7fe114004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:01:59.508 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:59.502+0000 7fe12d922700 1 --2- 172.21.15.57:0/464442154 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe114004810 0x7fe114004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:59.508 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:59.502+0000 7fe12d922700 1 -- 172.21.15.57:0/464442154 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe114003570 con 0x7fe1280c6c20 2023-10-06T03:01:59.508 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:59.502+0000 7fe12d922700 1 --2- 172.21.15.57:0/464442154 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe1280c6c20 0x7fe1140051c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe12000a8d0 tx=0x7fe120002170 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c99b823cda9c3bec server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:59.509 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:59.502+0000 7fe11ffff700 1 -- 172.21.15.57:0/464442154 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1200070d0 con 0x7fe1280c6c20 2023-10-06T03:01:59.509 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:59.502+0000 7fe11ffff700 1 -- 172.21.15.57:0/464442154 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe120007230 con 0x7fe1280c6c20 2023-10-06T03:01:59.509 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:59.502+0000 7fe11ffff700 1 -- 172.21.15.57:0/464442154 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1200075d0 con 0x7fe1280c6c20 2023-10-06T03:01:59.509 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:59.502+0000 7fe12f385700 1 -- 172.21.15.57:0/464442154 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe1280c6c20 msgr2=0x7fe1140051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:59.510 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:59.502+0000 7fe12f385700 1 --2- 172.21.15.57:0/464442154 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe1280c6c20 0x7fe1140051c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe12000a8d0 tx=0x7fe120002170 comp rx=0 tx=0).stop 2023-10-06T03:01:59.510 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:59.502+0000 7fe12d922700 1 -- 172.21.15.57:0/464442154 reap_dead start 2023-10-06T03:01:59.510 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:59.502+0000 7fe12f385700 1 -- 172.21.15.57:0/464442154 shutdown_connections 2023-10-06T03:01:59.510 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:59.502+0000 7fe12f385700 1 -- 172.21.15.57:0/464442154 >> 172.21.15.57:0/464442154 conn(0x7fe1280cbed0 msgr2=0x7fe1280cc2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:59.510 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:59.502+0000 7fe12f385700 1 -- 172.21.15.57:0/464442154 shutdown_connections 2023-10-06T03:01:59.510 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:59.502+0000 7fe12f385700 1 -- 172.21.15.57:0/464442154 wait complete. 2023-10-06T03:01:59.512 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:59.506+0000 7fe12f385700 1 Processor -- start 2023-10-06T03:01:59.512 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:59.506+0000 7fe12f385700 1 -- start start 2023-10-06T03:01:59.515 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:59.506+0000 7fe12f385700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe1280c6c20 0x7fe1280b1570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:59.515 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:59.506+0000 7fe12f385700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe1280af8d0 0x7fe1280adbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:59.515 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:59.510+0000 7fe12f385700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe1280afd40 0x7fe1280ae100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:59.515 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:59.510+0000 7fe12f385700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1280ad730 con 0x7fe1280c6c20 2023-10-06T03:01:59.515 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:59.510+0000 7fe12f385700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe128162f90 con 0x7fe1280af8d0 2023-10-06T03:01:59.515 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:59.510+0000 7fe12f385700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1280acb20 con 0x7fe1280afd40 2023-10-06T03:01:59.515 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:59.510+0000 7fe12d121700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe1280c6c20 0x7fe1280b1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:59.515 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:59.510+0000 7fe12d121700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe1280c6c20 0x7fe1280b1570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40454/0 (socket says 172.21.15.57:40454) 2023-10-06T03:01:59.515 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:59.510+0000 7fe12d121700 1 -- 172.21.15.57:0/1148328879 learned_addr learned my addr 172.21.15.57:0/1148328879 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:01:59.517 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:59.510+0000 7fe12c920700 1 --2- 172.21.15.57:0/1148328879 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe1280af8d0 0x7fe1280adbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:59.517 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:59.510+0000 7fe12d922700 1 --2- 172.21.15.57:0/1148328879 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe1280afd40 0x7fe1280ae100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:59.517 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:59.510+0000 7fe12d121700 1 -- 172.21.15.57:0/1148328879 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe1280afd40 msgr2=0x7fe1280ae100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:59.517 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:59.510+0000 7fe12d121700 1 --2- 172.21.15.57:0/1148328879 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe1280afd40 0x7fe1280ae100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:59.517 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:59.510+0000 7fe12d121700 1 -- 172.21.15.57:0/1148328879 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe1280af8d0 msgr2=0x7fe1280adbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:59.517 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:59.510+0000 7fe12d121700 1 --2- 172.21.15.57:0/1148328879 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe1280af8d0 0x7fe1280adbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:59.517 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:59.510+0000 7fe12d121700 1 -- 172.21.15.57:0/1148328879 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1280ace00 con 0x7fe1280c6c20 2023-10-06T03:01:59.517 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:59.510+0000 7fe12d922700 1 --2- 172.21.15.57:0/1148328879 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe1280afd40 0x7fe1280ae100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:01:59.517 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:59.510+0000 7fe12d121700 1 --2- 172.21.15.57:0/1148328879 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe1280c6c20 0x7fe1280b1570 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fe12400f820 tx=0x7fe124007d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:59.517 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:59.510+0000 7fe11d7fa700 1 -- 172.21.15.57:0/1148328879 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe12400d610 con 0x7fe1280c6c20 2023-10-06T03:01:59.517 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:59.510+0000 7fe11d7fa700 1 -- 172.21.15.57:0/1148328879 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe12400d790 con 0x7fe1280c6c20 2023-10-06T03:01:59.517 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:59.510+0000 7fe12f385700 1 -- 172.21.15.57:0/1148328879 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1280ad0e0 con 0x7fe1280c6c20 2023-10-06T03:01:59.518 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:59.510+0000 7fe11d7fa700 1 -- 172.21.15.57:0/1148328879 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe12400db50 con 0x7fe1280c6c20 2023-10-06T03:01:59.518 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:59.510+0000 7fe12f385700 1 -- 172.21.15.57:0/1148328879 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1280b1ab0 con 0x7fe1280c6c20 2023-10-06T03:01:59.518 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:59.510+0000 7fe12f385700 1 -- 172.21.15.57:0/1148328879 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe12806b970 con 0x7fe1280c6c20 2023-10-06T03:01:59.519 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:59.514+0000 7fe11d7fa700 1 -- 172.21.15.57:0/1148328879 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fe12401c400 con 0x7fe1280c6c20 2023-10-06T03:01:59.521 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:59.514+0000 7fe11d7fa700 1 --2- 172.21.15.57:0/1148328879 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fe10c060600 0x7fe10c062ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:01:59.521 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:59.514+0000 7fe11d7fa700 1 -- 172.21.15.57:0/1148328879 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6144+0+0 (secure 0 0 0) 0x7fe12407ccc0 con 0x7fe1280c6c20 2023-10-06T03:01:59.521 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:59.514+0000 7fe12c920700 1 --2- 172.21.15.57:0/1148328879 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fe10c060600 0x7fe10c062ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:01:59.523 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:59.518+0000 7fe12c920700 1 --2- 172.21.15.57:0/1148328879 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fe10c060600 0x7fe10c062ab0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe1280c68b0 tx=0x7fe118008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:01:59.528 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:59.522+0000 7fe11d7fa700 1 -- 172.21.15.57:0/1148328879 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fe12404d080 con 0x7fe1280c6c20 2023-10-06T03:01:59.735 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:59.730+0000 7fe12f385700 1 -- 172.21.15.57:0/1148328879 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe12804b600 con 0x7fe1280c6c20 2023-10-06T03:01:59.736 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:59.730+0000 7fe11d7fa700 1 -- 172.21.15.57:0/1148328879 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4601 (secure 0 0 0) 0x7fe124017090 con 0x7fe1280c6c20 2023-10-06T03:01:59.737 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:01:59.737 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":22,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5158,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6834/3877951826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":3877951826},{"type":"v1","addr":"172.21.15.105:6834","nonce":3877951826}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5214,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/311797094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":311797094},{"type":"v1","addr":"172.21.15.57:6835","nonce":311797094}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5217,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6837/670891004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6836","nonce":670891004},{"type":"v1","addr":"172.21.15.57:6837","nonce":670891004}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:01:47.353461+0000","modified":"2023-10-06T03:01:58.801985+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":36,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5211},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5211":{"gid":5211,"name":"d","rank":0,"incarnation":19,"state":"up:clientreplay","state_seq":4,"addr":"172.21.15.105:6835/938221046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":938221046},{"type":"v1","addr":"172.21.15.105:6835","nonce":938221046}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T03:01:59.739 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:59.734+0000 7fe12f385700 1 -- 172.21.15.57:0/1148328879 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fe10c060600 msgr2=0x7fe10c062ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:59.739 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:59.734+0000 7fe12f385700 1 --2- 172.21.15.57:0/1148328879 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fe10c060600 0x7fe10c062ab0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe1280c68b0 tx=0x7fe118008040 comp rx=0 tx=0).stop 2023-10-06T03:01:59.739 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:59.734+0000 7fe12f385700 1 -- 172.21.15.57:0/1148328879 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe1280c6c20 msgr2=0x7fe1280b1570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:01:59.740 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:59.734+0000 7fe12f385700 1 --2- 172.21.15.57:0/1148328879 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe1280c6c20 0x7fe1280b1570 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fe12400f820 tx=0x7fe124007d80 comp rx=0 tx=0).stop 2023-10-06T03:01:59.740 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:59.734+0000 7fe12f385700 1 -- 172.21.15.57:0/1148328879 shutdown_connections 2023-10-06T03:01:59.740 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:59.734+0000 7fe12f385700 1 --2- 172.21.15.57:0/1148328879 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fe10c060600 0x7fe10c062ab0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:59.740 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:59.734+0000 7fe12f385700 1 --2- 172.21.15.57:0/1148328879 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe1280afd40 0x7fe1280ae100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:59.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:59.734+0000 7fe12f385700 1 --2- 172.21.15.57:0/1148328879 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe1280af8d0 0x7fe1280adbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:59.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:59.734+0000 7fe12f385700 1 --2- 172.21.15.57:0/1148328879 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe1280c6c20 0x7fe1280b1570 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:01:59.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:59.734+0000 7fe12f385700 1 -- 172.21.15.57:0/1148328879 >> 172.21.15.57:0/1148328879 conn(0x7fe1280cbed0 msgr2=0x7fe12806ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:01:59.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:59.734+0000 7fe12f385700 1 -- 172.21.15.57:0/1148328879 shutdown_connections 2023-10-06T03:01:59.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:01:59.734+0000 7fe12f385700 1 -- 172.21.15.57:0/1148328879 wait complete. 2023-10-06T03:01:59.742 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 22 2023-10-06T03:02:00.165 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 22, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T03:01:47.353461+0000', 'modified': '2023-10-06T03:01:58.801985+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 36, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5211}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5211': {'gid': 5211, 'name': 'd', 'rank': 0, 'incarnation': 19, 'state': 'up:clientreplay', 'state_seq': 4, 'addr': '172.21.15.105:6835/938221046', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.105:6833', 'nonce': 938221046}, {'type': 'v1', 'addr': '172.21.15.105:6835', 'nonce': 938221046}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T03:02:00.186 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5211:up:clientreplay 2023-10-06T03:02:00.809 INFO:tasks.ceph.mds.d.smithi105.stderr:2023-10-06T03:02:00.808+0000 7f519e48b700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T03:02:01.245 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:02:01.408 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:01.402+0000 7fc751ae3700 1 Processor -- start 2023-10-06T03:02:01.554 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:01.402+0000 7fc751ae3700 1 -- start start 2023-10-06T03:02:01.562 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:01.402+0000 7fc751ae3700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc74c067740 0x7fc74c0cb820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:01.562 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:01.402+0000 7fc751ae3700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc74c0a9840 con 0x7fc74c0af1c0 2023-10-06T03:02:01.563 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:01.402+0000 7fc751ae3700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc74c0a9e00 con 0x7fc74c0af590 2023-10-06T03:02:01.563 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:01.402+0000 7fc751ae3700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc74c0cbf00 con 0x7fc74c067740 2023-10-06T03:02:01.563 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:01.406+0000 7fc750ae1700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fc74c0af1c0 0x7fc74c0c7dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:35956/0 (socket says 172.21.15.57:35956) 2023-10-06T03:02:01.563 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:01.406+0000 7fc750ae1700 1 -- 172.21.15.57:0/3143085131 learned_addr learned my addr 172.21.15.57:0/3143085131 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:02:01.563 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:01.406+0000 7fc7512e2700 1 --2- 172.21.15.57:0/3143085131 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc74c067740 0x7fc74c0cb820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:01.563 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:01.406+0000 7fc74b7fe700 1 -- 172.21.15.57:0/3143085131 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1996271467 0 0) 0x7fc74c0a9840 con 0x7fc74c0af1c0 2023-10-06T03:02:01.563 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:01.406+0000 7fc74b7fe700 1 -- 172.21.15.57:0/3143085131 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc73c003570 con 0x7fc74c0af1c0 2023-10-06T03:02:01.563 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:01.406+0000 7fc74b7fe700 1 -- 172.21.15.57:0/3143085131 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4211913985 0 0) 0x7fc74c0a9e00 con 0x7fc74c0af590 2023-10-06T03:02:01.563 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:01.406+0000 7fc74b7fe700 1 -- 172.21.15.57:0/3143085131 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc74c0a9840 con 0x7fc74c0af590 2023-10-06T03:02:01.563 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:01.406+0000 7fc7512e2700 1 -- 172.21.15.57:0/3143085131 >> v1:172.21.15.105:6789/0 conn(0x7fc74c0af590 legacy=0x7fc74c067030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:01.563 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:01.406+0000 7fc7512e2700 1 -- 172.21.15.57:0/3143085131 >> v1:172.21.15.57:6789/0 conn(0x7fc74c0af1c0 legacy=0x7fc74c0c7dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:01.563 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:01.406+0000 7fc7512e2700 1 -- 172.21.15.57:0/3143085131 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc74c0cc1e0 con 0x7fc74c067740 2023-10-06T03:02:01.564 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:01.406+0000 7fc7512e2700 1 --2- 172.21.15.57:0/3143085131 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc74c067740 0x7fc74c0cb820 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc744009e90 tx=0x7fc744009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=be2ce9c1f49ca857 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:01.564 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:01.406+0000 7fc74b7fe700 1 -- 172.21.15.57:0/3143085131 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc74400e070 con 0x7fc74c067740 2023-10-06T03:02:01.564 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:01.406+0000 7fc74b7fe700 1 -- 172.21.15.57:0/3143085131 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc74400bb80 con 0x7fc74c067740 2023-10-06T03:02:01.564 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:01.406+0000 7fc74b7fe700 1 -- 172.21.15.57:0/3143085131 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc744012430 con 0x7fc74c067740 2023-10-06T03:02:01.564 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:01.406+0000 7fc751ae3700 1 -- 172.21.15.57:0/3143085131 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc74c067740 msgr2=0x7fc74c0cb820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:01.564 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:01.406+0000 7fc751ae3700 1 --2- 172.21.15.57:0/3143085131 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc74c067740 0x7fc74c0cb820 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc744009e90 tx=0x7fc744009780 comp rx=0 tx=0).stop 2023-10-06T03:02:01.564 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:01.406+0000 7fc751ae3700 1 -- 172.21.15.57:0/3143085131 shutdown_connections 2023-10-06T03:02:01.564 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:01.406+0000 7fc751ae3700 1 --2- 172.21.15.57:0/3143085131 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc74c067740 0x7fc74c0cb820 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:01.564 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:01.406+0000 7fc751ae3700 1 -- 172.21.15.57:0/3143085131 >> 172.21.15.57:0/3143085131 conn(0x7fc74c0cce10 msgr2=0x7fc74c0cd210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:01.564 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:01.406+0000 7fc751ae3700 1 -- 172.21.15.57:0/3143085131 shutdown_connections 2023-10-06T03:02:01.564 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:01.406+0000 7fc751ae3700 1 -- 172.21.15.57:0/3143085131 wait complete. 2023-10-06T03:02:01.564 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:01.410+0000 7fc751ae3700 1 Processor -- start 2023-10-06T03:02:01.565 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:01.410+0000 7fc751ae3700 1 -- start start 2023-10-06T03:02:01.565 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:01.410+0000 7fc751ae3700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc74c067740 0x7fc74c14ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:01.565 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:01.410+0000 7fc751ae3700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc74c0af1c0 0x7fc74c0afbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:01.565 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:01.410+0000 7fc751ae3700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc74c0af590 0x7fc74c159840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:01.565 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:01.410+0000 7fc751ae3700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc74c1542c0 con 0x7fc74c067740 2023-10-06T03:02:01.565 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:01.410+0000 7fc751ae3700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc74c15a300 con 0x7fc74c0af1c0 2023-10-06T03:02:01.565 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:01.410+0000 7fc751ae3700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc74c15a5e0 con 0x7fc74c0af590 2023-10-06T03:02:01.565 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:01.410+0000 7fc750ae1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc74c067740 0x7fc74c14ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:01.565 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:01.414+0000 7fc7512e2700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc74c0af590 0x7fc74c159840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:01.565 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:01.414+0000 7fc7512e2700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc74c0af590 0x7fc74c159840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.57:34280/0 (socket says 172.21.15.57:34280) 2023-10-06T03:02:01.565 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:01.414+0000 7fc7512e2700 1 -- 172.21.15.57:0/61008633 learned_addr learned my addr 172.21.15.57:0/61008633 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:02:01.565 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:01.414+0000 7fc74bfff700 1 --2- 172.21.15.57:0/61008633 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc74c0af1c0 0x7fc74c0afbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:01.566 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:01.414+0000 7fc7512e2700 1 -- 172.21.15.57:0/61008633 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc74c0af1c0 msgr2=0x7fc74c0afbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:01.707 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:01.414+0000 7fc7512e2700 1 --2- 172.21.15.57:0/61008633 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc74c0af1c0 0x7fc74c0afbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:01.707 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:01.414+0000 7fc7512e2700 1 -- 172.21.15.57:0/61008633 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc74c067740 msgr2=0x7fc74c14ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:01.708 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:01.414+0000 7fc7512e2700 1 --2- 172.21.15.57:0/61008633 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc74c067740 0x7fc74c14ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:01.708 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:01.414+0000 7fc7512e2700 1 -- 172.21.15.57:0/61008633 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc744009a20 con 0x7fc74c0af590 2023-10-06T03:02:01.708 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:01.414+0000 7fc7512e2700 1 --2- 172.21.15.57:0/61008633 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc74c0af590 0x7fc74c159840 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc744013000 tx=0x7fc744019000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:01.708 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:01.414+0000 7fc748ff9700 1 -- 172.21.15.57:0/61008633 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc74401b420 con 0x7fc74c0af590 2023-10-06T03:02:01.708 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:01.414+0000 7fc748ff9700 1 -- 172.21.15.57:0/61008633 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc74401b5a0 con 0x7fc74c0af590 2023-10-06T03:02:01.708 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:01.414+0000 7fc751ae3700 1 -- 172.21.15.57:0/61008633 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc74c154510 con 0x7fc74c0af590 2023-10-06T03:02:01.708 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:01.414+0000 7fc748ff9700 1 -- 172.21.15.57:0/61008633 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc74401b960 con 0x7fc74c0af590 2023-10-06T03:02:01.708 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:01.414+0000 7fc751ae3700 1 -- 172.21.15.57:0/61008633 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc74c155d40 con 0x7fc74c0af590 2023-10-06T03:02:01.708 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:01.418+0000 7fc751ae3700 1 -- 172.21.15.57:0/61008633 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc74c0645e0 con 0x7fc74c0af590 2023-10-06T03:02:01.709 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:01.418+0000 7fc748ff9700 1 -- 172.21.15.57:0/61008633 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fc74401c400 con 0x7fc74c0af590 2023-10-06T03:02:01.709 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:01.418+0000 7fc748ff9700 1 --2- 172.21.15.57:0/61008633 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fc730060550 0x7fc730062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:01.709 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:01.418+0000 7fc748ff9700 1 -- 172.21.15.57:0/61008633 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6144+0+0 (secure 0 0 0) 0x7fc74407e590 con 0x7fc74c0af590 2023-10-06T03:02:01.709 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:01.418+0000 7fc750ae1700 1 --2- 172.21.15.57:0/61008633 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fc730060550 0x7fc730062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:01.709 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:01.422+0000 7fc750ae1700 1 --2- 172.21.15.57:0/61008633 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fc730060550 0x7fc730062a00 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc740007fd0 tx=0x7fc740009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:01.709 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:01.426+0000 7fc748ff9700 1 -- 172.21.15.57:0/61008633 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fc74404e950 con 0x7fc74c0af590 2023-10-06T03:02:01.710 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:01.638+0000 7fc751ae3700 1 -- 172.21.15.57:0/61008633 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc74c0a9a90 con 0x7fc74c0af590 2023-10-06T03:02:01.710 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:01.638+0000 7fc748ff9700 1 -- 172.21.15.57:0/61008633 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4595 (secure 0 0 0) 0x7fc744051f70 con 0x7fc74c0af590 2023-10-06T03:02:01.710 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:02:01.710 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":23,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5158,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6834/3877951826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":3877951826},{"type":"v1","addr":"172.21.15.105:6834","nonce":3877951826}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5214,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/311797094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":311797094},{"type":"v1","addr":"172.21.15.57:6835","nonce":311797094}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5217,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6837/670891004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6836","nonce":670891004},{"type":"v1","addr":"172.21.15.57:6837","nonce":670891004}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:01:47.353461+0000","modified":"2023-10-06T03:01:59.821893+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":36,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5211},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5211":{"gid":5211,"name":"d","rank":0,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.105:6835/938221046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":938221046},{"type":"v1","addr":"172.21.15.105:6835","nonce":938221046}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T03:02:01.712 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:01.642+0000 7fc751ae3700 1 -- 172.21.15.57:0/61008633 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fc730060550 msgr2=0x7fc730062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:01.712 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:01.642+0000 7fc751ae3700 1 --2- 172.21.15.57:0/61008633 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fc730060550 0x7fc730062a00 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc740007fd0 tx=0x7fc740009040 comp rx=0 tx=0).stop 2023-10-06T03:02:01.712 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:01.642+0000 7fc751ae3700 1 -- 172.21.15.57:0/61008633 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc74c0af590 msgr2=0x7fc74c159840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:01.712 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:01.642+0000 7fc751ae3700 1 --2- 172.21.15.57:0/61008633 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc74c0af590 0x7fc74c159840 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc744013000 tx=0x7fc744019000 comp rx=0 tx=0).stop 2023-10-06T03:02:01.712 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:01.642+0000 7fc751ae3700 1 -- 172.21.15.57:0/61008633 shutdown_connections 2023-10-06T03:02:01.712 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:01.642+0000 7fc751ae3700 1 --2- 172.21.15.57:0/61008633 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fc730060550 0x7fc730062a00 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:01.712 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:01.642+0000 7fc751ae3700 1 --2- 172.21.15.57:0/61008633 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc74c0af590 0x7fc74c159840 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:01.712 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:01.642+0000 7fc751ae3700 1 --2- 172.21.15.57:0/61008633 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc74c0af1c0 0x7fc74c0afbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:01.712 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:01.642+0000 7fc751ae3700 1 --2- 172.21.15.57:0/61008633 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc74c067740 0x7fc74c14ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:01.712 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:01.642+0000 7fc751ae3700 1 -- 172.21.15.57:0/61008633 >> 172.21.15.57:0/61008633 conn(0x7fc74c0cce10 msgr2=0x7fc74c1588b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:01.712 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:01.642+0000 7fc751ae3700 1 -- 172.21.15.57:0/61008633 shutdown_connections 2023-10-06T03:02:01.713 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:01.642+0000 7fc751ae3700 1 -- 172.21.15.57:0/61008633 wait complete. 2023-10-06T03:02:01.713 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 23 2023-10-06T03:02:02.116 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 23, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T03:01:47.353461+0000', 'modified': '2023-10-06T03:01:59.821893+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 36, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5211}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5211': {'gid': 5211, 'name': 'd', 'rank': 0, 'incarnation': 19, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.105:6835/938221046', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.105:6833', 'nonce': 938221046}, {'type': 'v1', 'addr': '172.21.15.105:6835', 'nonce': 938221046}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T03:02:02.183 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T03:02:02.184 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-10-06T03:02:02.352 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.346+0000 7fd486f45700 1 Processor -- start 2023-10-06T03:02:02.352 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.346+0000 7fd486f45700 1 -- start start 2023-10-06T03:02:02.355 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.350+0000 7fd486f45700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd4800c6510 0x7fd48006d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:02.356 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.350+0000 7fd486f45700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd4800c0c70 0x7fd4800c2540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:02.356 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.350+0000 7fd486f45700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4800c14a0 con 0x7fd4800c2a80 2023-10-06T03:02:02.356 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.350+0000 7fd486f45700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4800c1780 con 0x7fd4800c6510 2023-10-06T03:02:02.356 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.350+0000 7fd486f45700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4800c1a60 con 0x7fd4800c0c70 2023-10-06T03:02:02.356 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.350+0000 7fd484ce1700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd4800c6510 0x7fd48006d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:02.357 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.350+0000 7fd484ce1700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd4800c6510 0x7fd48006d0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40468/0 (socket says 172.21.15.57:40468) 2023-10-06T03:02:02.357 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.350+0000 7fd484ce1700 1 -- 172.21.15.57:0/3819306066 learned_addr learned my addr 172.21.15.57:0/3819306066 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:02:02.357 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.350+0000 7fd47ffff700 1 --2- 172.21.15.57:0/3819306066 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd4800c0c70 0x7fd4800c2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:02.357 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.350+0000 7fd484ce1700 1 -- 172.21.15.57:0/3819306066 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd4800c0c70 msgr2=0x7fd4800c2540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:02.357 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.350+0000 7fd484ce1700 1 --2- 172.21.15.57:0/3819306066 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd4800c0c70 0x7fd4800c2540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:02.357 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.350+0000 7fd484ce1700 1 -- 172.21.15.57:0/3819306066 >> v1:172.21.15.57:6789/0 conn(0x7fd4800c2a80 legacy=0x7fd4800aec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:02.357 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.350+0000 7fd484ce1700 1 -- 172.21.15.57:0/3819306066 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4800c1d40 con 0x7fd4800c6510 2023-10-06T03:02:02.358 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.350+0000 7fd484ce1700 1 --2- 172.21.15.57:0/3819306066 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd4800c6510 0x7fd48006d0d0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fd474009990 tx=0x7fd474009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=201dfe8121e83888 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:02.358 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.350+0000 7fd47f7fe700 1 -- 172.21.15.57:0/3819306066 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd474005c10 con 0x7fd4800c6510 2023-10-06T03:02:02.359 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.350+0000 7fd47f7fe700 1 -- 172.21.15.57:0/3819306066 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd474005d70 con 0x7fd4800c6510 2023-10-06T03:02:02.359 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.350+0000 7fd47f7fe700 1 -- 172.21.15.57:0/3819306066 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd47400b880 con 0x7fd4800c6510 2023-10-06T03:02:02.359 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.354+0000 7fd486f45700 1 -- 172.21.15.57:0/3819306066 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd4800c6510 msgr2=0x7fd48006d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:02.359 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.354+0000 7fd486f45700 1 --2- 172.21.15.57:0/3819306066 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd4800c6510 0x7fd48006d0d0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fd474009990 tx=0x7fd474009220 comp rx=0 tx=0).stop 2023-10-06T03:02:02.359 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.354+0000 7fd486f45700 1 -- 172.21.15.57:0/3819306066 shutdown_connections 2023-10-06T03:02:02.360 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.354+0000 7fd486f45700 1 --2- 172.21.15.57:0/3819306066 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd4800c0c70 0x7fd4800c2540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:02.360 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.354+0000 7fd486f45700 1 --2- 172.21.15.57:0/3819306066 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd4800c6510 0x7fd48006d0d0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:02.360 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.354+0000 7fd486f45700 1 -- 172.21.15.57:0/3819306066 >> 172.21.15.57:0/3819306066 conn(0x7fd4800cbed0 msgr2=0x7fd4800cc2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:02.360 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.354+0000 7fd486f45700 1 -- 172.21.15.57:0/3819306066 shutdown_connections 2023-10-06T03:02:02.360 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.354+0000 7fd486f45700 1 -- 172.21.15.57:0/3819306066 wait complete. 2023-10-06T03:02:02.363 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.358+0000 7fd486f45700 1 Processor -- start 2023-10-06T03:02:02.363 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.358+0000 7fd486f45700 1 -- start start 2023-10-06T03:02:02.366 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.358+0000 7fd486f45700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd4800c0c70 0x7fd4800c3f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:02.366 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.358+0000 7fd486f45700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd4800c2a80 0x7fd48013b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:02.366 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.358+0000 7fd486f45700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd4800c6510 0x7fd480159d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:02.366 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.358+0000 7fd486f45700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4800af620 con 0x7fd4800c2a80 2023-10-06T03:02:02.366 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.358+0000 7fd486f45700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd48015a6e0 con 0x7fd4800c6510 2023-10-06T03:02:02.366 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.358+0000 7fd486f45700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd48015a9c0 con 0x7fd4800c0c70 2023-10-06T03:02:02.366 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.358+0000 7fd47ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd4800c2a80 0x7fd48013b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:02.367 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.358+0000 7fd47ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd4800c2a80 0x7fd48013b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40472/0 (socket says 172.21.15.57:40472) 2023-10-06T03:02:02.367 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.358+0000 7fd47ffff700 1 -- 172.21.15.57:0/4047983893 learned_addr learned my addr 172.21.15.57:0/4047983893 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:02:02.367 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.358+0000 7fd484ce1700 1 --2- 172.21.15.57:0/4047983893 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd4800c0c70 0x7fd4800c3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:02.368 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.358+0000 7fd4854e2700 1 --2- 172.21.15.57:0/4047983893 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd4800c6510 0x7fd480159d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:02.368 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.362+0000 7fd47ffff700 1 -- 172.21.15.57:0/4047983893 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd4800c0c70 msgr2=0x7fd4800c3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:02.368 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.362+0000 7fd47ffff700 1 --2- 172.21.15.57:0/4047983893 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd4800c0c70 0x7fd4800c3f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:02.368 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.362+0000 7fd47ffff700 1 -- 172.21.15.57:0/4047983893 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd4800c6510 msgr2=0x7fd480159d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:02.368 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.362+0000 7fd47ffff700 1 --2- 172.21.15.57:0/4047983893 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd4800c6510 0x7fd480159d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:02.368 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.362+0000 7fd47ffff700 1 -- 172.21.15.57:0/4047983893 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd474009480 con 0x7fd4800c2a80 2023-10-06T03:02:02.368 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.362+0000 7fd4854e2700 1 --2- 172.21.15.57:0/4047983893 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd4800c6510 0x7fd480159d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:02:02.368 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.362+0000 7fd47ffff700 1 --2- 172.21.15.57:0/4047983893 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd4800c2a80 0x7fd48013b9d0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fd47000d860 tx=0x7fd470008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:02.368 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.362+0000 7fd47cff9700 1 -- 172.21.15.57:0/4047983893 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd470018070 con 0x7fd4800c2a80 2023-10-06T03:02:02.369 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.362+0000 7fd47cff9700 1 -- 172.21.15.57:0/4047983893 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4700125f0 con 0x7fd4800c2a80 2023-10-06T03:02:02.369 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.362+0000 7fd47cff9700 1 -- 172.21.15.57:0/4047983893 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd470012990 con 0x7fd4800c2a80 2023-10-06T03:02:02.369 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.362+0000 7fd486f45700 1 -- 172.21.15.57:0/4047983893 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4800aefd0 con 0x7fd4800c2a80 2023-10-06T03:02:02.369 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.362+0000 7fd486f45700 1 -- 172.21.15.57:0/4047983893 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd48013bf10 con 0x7fd4800c2a80 2023-10-06T03:02:02.371 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.366+0000 7fd47cff9700 1 -- 172.21.15.57:0/4047983893 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fd470012d40 con 0x7fd4800c2a80 2023-10-06T03:02:02.374 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.370+0000 7fd47cff9700 1 --2- 172.21.15.57:0/4047983893 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fd46c060550 0x7fd46c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:02.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.370+0000 7fd47cff9700 1 -- 172.21.15.57:0/4047983893 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6144+0+0 (secure 0 0 0) 0x7fd47007cc70 con 0x7fd4800c2a80 2023-10-06T03:02:02.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.370+0000 7fd484ce1700 1 --2- 172.21.15.57:0/4047983893 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fd46c060550 0x7fd46c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:02.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.370+0000 7fd48920a740 1 Processor -- start 2023-10-06T03:02:02.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.370+0000 7fd48920a740 1 -- start start 2023-10-06T03:02:02.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.370+0000 7fd484ce1700 1 --2- 172.21.15.57:0/4047983893 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fd46c060550 0x7fd46c062a00 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd474009260 tx=0x7fd474016000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:02.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.370+0000 7fd48920a740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x1090ae0 0x130de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:02.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.370+0000 7fd48920a740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1090710 0x130e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:02.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.370+0000 7fd48920a740 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x10db790 0x130e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:02.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.370+0000 7fd48920a740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x123bf30 con 0x1090710 2023-10-06T03:02:02.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.370+0000 7fd48920a740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x1237ed0 con 0x1090ae0 2023-10-06T03:02:02.378 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.370+0000 7fd48920a740 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x11fe0b0 con 0x10db790 2023-10-06T03:02:02.378 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.370+0000 7fd47ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1090710 0x130e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:02.378 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.370+0000 7fd47ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1090710 0x130e390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40474/0 (socket says 172.21.15.57:40474) 2023-10-06T03:02:02.378 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.370+0000 7fd484ce1700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x1090ae0 0x130de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:02.378 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.370+0000 7fd47ffff700 1 -- 172.21.15.57:0/1524732785 learned_addr learned my addr 172.21.15.57:0/1524732785 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:02:02.378 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.370+0000 7fd4854e2700 1 --2- 172.21.15.57:0/1524732785 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x10db790 0x130e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:02.379 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.374+0000 7fd47ffff700 1 -- 172.21.15.57:0/1524732785 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x10db790 msgr2=0x130e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:02.379 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.374+0000 7fd47ffff700 1 --2- 172.21.15.57:0/1524732785 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x10db790 0x130e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:02.380 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.374+0000 7fd47ffff700 1 -- 172.21.15.57:0/1524732785 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x1090ae0 msgr2=0x130de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:02.380 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.374+0000 7fd47ffff700 1 --2- 172.21.15.57:0/1524732785 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x1090ae0 0x130de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:02.380 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.374+0000 7fd47ffff700 1 -- 172.21.15.57:0/1524732785 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x10dc9e0 con 0x1090710 2023-10-06T03:02:02.380 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.374+0000 7fd47ffff700 1 --2- 172.21.15.57:0/1524732785 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1090710 0x130e390 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fd47004d1f0 tx=0x7fd47007aec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fcba26d44fc549a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:02.380 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.374+0000 7fd4667fc700 1 -- 172.21.15.57:0/1524732785 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd470066070 con 0x1090710 2023-10-06T03:02:02.380 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.374+0000 7fd4667fc700 1 -- 172.21.15.57:0/1524732785 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd470057cd0 con 0x1090710 2023-10-06T03:02:02.380 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.374+0000 7fd4667fc700 1 -- 172.21.15.57:0/1524732785 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd47004ee30 con 0x1090710 2023-10-06T03:02:02.381 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.374+0000 7fd48920a740 1 -- 172.21.15.57:0/1524732785 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1090710 msgr2=0x130e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:02.381 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.374+0000 7fd48920a740 1 --2- 172.21.15.57:0/1524732785 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1090710 0x130e390 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fd47004d1f0 tx=0x7fd47007aec0 comp rx=0 tx=0).stop 2023-10-06T03:02:02.381 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.374+0000 7fd48920a740 1 -- 172.21.15.57:0/1524732785 shutdown_connections 2023-10-06T03:02:02.381 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.374+0000 7fd48920a740 1 --2- 172.21.15.57:0/1524732785 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x10db790 0x130e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:02.381 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.374+0000 7fd48920a740 1 --2- 172.21.15.57:0/1524732785 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1090710 0x130e390 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:02.381 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.374+0000 7fd48920a740 1 --2- 172.21.15.57:0/1524732785 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x1090ae0 0x130de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:02.381 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.374+0000 7fd48920a740 1 -- 172.21.15.57:0/1524732785 >> 172.21.15.57:0/1524732785 conn(0x1090eb0 msgr2=0x12ca880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:02.381 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.374+0000 7fd48920a740 1 -- 172.21.15.57:0/1524732785 shutdown_connections 2023-10-06T03:02:02.381 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.374+0000 7fd48920a740 1 -- 172.21.15.57:0/1524732785 wait complete. 2023-10-06T03:02:02.382 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.374+0000 7fd48920a740 1 -- start start 2023-10-06T03:02:02.382 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.374+0000 7fd48920a740 1 Processor -- start 2023-10-06T03:02:02.383 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.378+0000 7fd48920a740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1090710 0x12ca740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:02.383 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.378+0000 7fd48920a740 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x1090ae0 0x12f3c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:02.384 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.378+0000 7fd48920a740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x10db790 0x12f4140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:02.384 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.378+0000 7fd48920a740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x11fdd50 con 0x1090710 2023-10-06T03:02:02.384 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.378+0000 7fd48920a740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x11d6970 con 0x10db790 2023-10-06T03:02:02.384 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.378+0000 7fd48920a740 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x11e1510 con 0x1090ae0 2023-10-06T03:02:02.384 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.378+0000 7fd48920a740 10 client.0 _ll_register_callbacks cb 0x1281b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:02:02.384 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.378+0000 7fd484ce1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1090710 0x12ca740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:02.384 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.378+0000 7fd484ce1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1090710 0x12ca740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40490/0 (socket says 172.21.15.57:40490) 2023-10-06T03:02:02.384 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.378+0000 7fd484ce1700 1 -- 172.21.15.57:0/1011051249 learned_addr learned my addr 172.21.15.57:0/1011051249 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:02:02.385 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.378+0000 7fd47ffff700 1 --2- 172.21.15.57:0/1011051249 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x1090ae0 0x12f3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:02.385 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.378+0000 7fd4854e2700 1 --2- 172.21.15.57:0/1011051249 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x10db790 0x12f4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:02.385 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.378+0000 7fd484ce1700 1 -- 172.21.15.57:0/1011051249 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x1090ae0 msgr2=0x12f3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:02.386 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.378+0000 7fd484ce1700 1 --2- 172.21.15.57:0/1011051249 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x1090ae0 0x12f3c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:02.386 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.378+0000 7fd484ce1700 1 -- 172.21.15.57:0/1011051249 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x10db790 msgr2=0x12f4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:02.386 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.378+0000 7fd484ce1700 1 --2- 172.21.15.57:0/1011051249 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x10db790 0x12f4140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:02.386 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.378+0000 7fd484ce1700 1 -- 172.21.15.57:0/1011051249 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd48013bf10 con 0x1090710 2023-10-06T03:02:02.386 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.378+0000 7fd484ce1700 1 --2- 172.21.15.57:0/1011051249 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1090710 0x12ca740 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fd48006c350 tx=0x7fd474021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd429c906b62964e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:02.386 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.378+0000 7fd45effd700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-10-06T03:02:02.386 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.378+0000 7fd45effd700 1 -- 172.21.15.57:0/1011051249 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd474030070 con 0x1090710 2023-10-06T03:02:02.386 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.378+0000 7fd45effd700 1 -- 172.21.15.57:0/1011051249 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(39..39 src has 1..39) v4 ==== 6144+0+0 (secure 0 0 0) 0x7fd47400b7c0 con 0x1090710 2023-10-06T03:02:02.386 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.378+0000 7fd48920a740 1 -- 172.21.15.57:0/1011051249 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x11d6cc0 con 0x1090710 2023-10-06T03:02:02.387 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.378+0000 7fd45effd700 1 -- 172.21.15.57:0/1011051249 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd474021070 con 0x1090710 2023-10-06T03:02:02.387 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.378+0000 7fd48920a740 10 client.5259 fetch_fsmap learned FSMap version 23 2023-10-06T03:02:02.387 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.378+0000 7fd48920a740 1 -- 172.21.15.57:0/1011051249 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) v3 -- 0x1206370 con 0x1090710 2023-10-06T03:02:02.387 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.378+0000 7fd45effd700 1 -- 172.21.15.57:0/1011051249 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x11d6cc0 con 0x1090710 2023-10-06T03:02:02.387 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.378+0000 7fd45effd700 1 -- 172.21.15.57:0/1011051249 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 23) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fd474027430 con 0x1090710 2023-10-06T03:02:02.388 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.382+0000 7fd48920a740 10 client.5259 fetch_fsmap finished waiting for FSMap version 23 2023-10-06T03:02:02.388 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.382+0000 7fd48920a740 10 client.5259 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-06T03:02:02.388 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.382+0000 7fd48920a740 20 client.5259 populate_metadata read hostname 'smithi057' 2023-10-06T03:02:02.388 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.382+0000 7fd48920a740 1 --2- 172.21.15.57:0/1011051249 >> [v2:172.21.15.105:6833/938221046,v1:172.21.15.105:6835/938221046] conn(0x131a6b0 0x131ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:02.388 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.382+0000 7fd48920a740 4 client.5259 mds_command: new command op to 5211 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T03:02:02.388 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.382+0000 7fd48920a740 1 -- 172.21.15.57:0/1011051249 --> [v2:172.21.15.105:6833/938221046,v1:172.21.15.105:6835/938221046] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x11da3e0 con 0x131a6b0 2023-10-06T03:02:02.388 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.382+0000 7fd47ffff700 1 --2- 172.21.15.57:0/1011051249 >> [v2:172.21.15.105:6833/938221046,v1:172.21.15.105:6835/938221046] conn(0x131a6b0 0x131ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:02.481 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.382+0000 7fd47ffff700 1 --2- 172.21.15.57:0/1011051249 >> [v2:172.21.15.105:6833/938221046,v1:172.21.15.105:6835/938221046] conn(0x131a6b0 0x131ca90 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4daa2fcd09a90e85 server_cookie=b2fbc4cb127d8876 in_seq=0 out_seq=0 2023-10-06T03:02:02.482 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.382+0000 7fd45effd700 10 client.5259 ms_handle_connect on v2:172.21.15.105:6833/938221046 2023-10-06T03:02:02.482 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.382+0000 7fd45effd700 1 -- 172.21.15.57:0/1011051249 <== mds.0 v2:172.21.15.105:6833/938221046 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x11da3e0 con 0x131a6b0 2023-10-06T03:02:02.482 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.382+0000 7fd45effd700 10 client.5259 handle_command_reply: tid=0 2023-10-06T03:02:02.482 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.382+0000 7fd48920a740 1 client.5259 shutdown 2023-10-06T03:02:02.482 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.382+0000 7fd48920a740 1 -- 172.21.15.57:0/1011051249 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1090710 msgr2=0x12ca740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:02.482 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.382+0000 7fd48920a740 1 --2- 172.21.15.57:0/1011051249 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1090710 0x12ca740 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fd48006c350 tx=0x7fd474021000 comp rx=0 tx=0).stop 2023-10-06T03:02:02.482 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.386+0000 7fd48920a740 1 -- 172.21.15.57:0/1011051249 shutdown_connections 2023-10-06T03:02:02.482 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.386+0000 7fd48920a740 1 --2- 172.21.15.57:0/1011051249 >> [v2:172.21.15.105:6833/938221046,v1:172.21.15.105:6835/938221046] conn(0x131a6b0 0x131ca90 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:02.482 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.386+0000 7fd48920a740 1 --2- 172.21.15.57:0/1011051249 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x10db790 0x12f4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:02.482 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.386+0000 7fd48920a740 1 --2- 172.21.15.57:0/1011051249 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x1090ae0 0x12f3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:02.482 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.386+0000 7fd45effd700 0 client.5259 ms_handle_reset on v2:172.21.15.105:6833/938221046 2023-10-06T03:02:02.482 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.386+0000 7fd48920a740 1 --2- 172.21.15.57:0/1011051249 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1090710 0x12ca740 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:02.483 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.386+0000 7fd48920a740 1 -- 172.21.15.57:0/1011051249 >> 172.21.15.57:0/1011051249 conn(0x1090eb0 msgr2=0x12c2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:02.483 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.386+0000 7fd48920a740 1 -- 172.21.15.57:0/1011051249 shutdown_connections 2023-10-06T03:02:02.483 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.386+0000 7fd48920a740 1 -- 172.21.15.57:0/1011051249 wait complete. 2023-10-06T03:02:02.483 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.386+0000 7fd48920a740 20 client.5259 trim_cache size 0 max 16384 2023-10-06T03:02:02.483 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.406+0000 7fd48920a740 1 Processor -- start 2023-10-06T03:02:02.483 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.406+0000 7fd48920a740 1 -- start start 2023-10-06T03:02:02.483 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.406+0000 7fd48920a740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1090710 0x13636d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:02.483 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.406+0000 7fd48920a740 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x1090ae0 0x1363c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:02.483 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.406+0000 7fd48920a740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x10db790 0x1364150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:02.483 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.406+0000 7fd48920a740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x123cef0 con 0x1090710 2023-10-06T03:02:02.483 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.406+0000 7fd48920a740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x120d550 con 0x10db790 2023-10-06T03:02:02.483 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.406+0000 7fd48920a740 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x1295f50 con 0x1090ae0 2023-10-06T03:02:02.484 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.406+0000 7fd484ce1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1090710 0x13636d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:02.484 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.406+0000 7fd484ce1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1090710 0x13636d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40500/0 (socket says 172.21.15.57:40500) 2023-10-06T03:02:02.484 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.406+0000 7fd484ce1700 1 -- 172.21.15.57:0/1568617 learned_addr learned my addr 172.21.15.57:0/1568617 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:02:02.484 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.406+0000 7fd4854e2700 1 --2- 172.21.15.57:0/1568617 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x10db790 0x1364150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:02.484 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.410+0000 7fd47ffff700 1 --2- 172.21.15.57:0/1568617 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x1090ae0 0x1363c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:02.484 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.410+0000 7fd484ce1700 1 -- 172.21.15.57:0/1568617 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x1090ae0 msgr2=0x1363c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:02.484 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.410+0000 7fd484ce1700 1 --2- 172.21.15.57:0/1568617 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x1090ae0 0x1363c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:02.484 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.410+0000 7fd484ce1700 1 -- 172.21.15.57:0/1568617 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x10db790 msgr2=0x1364150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:02.484 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.410+0000 7fd484ce1700 1 --2- 172.21.15.57:0/1568617 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x10db790 0x1364150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:02.484 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.410+0000 7fd484ce1700 1 -- 172.21.15.57:0/1568617 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd48013eaa0 con 0x1090710 2023-10-06T03:02:02.484 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.410+0000 7fd484ce1700 1 --2- 172.21.15.57:0/1568617 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1090710 0x13636d0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fd474000c90 tx=0x7fd47402c070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=559c60c744bb6e95 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:02.484 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.410+0000 7fd466ffd700 1 -- 172.21.15.57:0/1568617 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd474021040 con 0x1090710 2023-10-06T03:02:02.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.410+0000 7fd466ffd700 1 -- 172.21.15.57:0/1568617 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd47400bed0 con 0x1090710 2023-10-06T03:02:02.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.410+0000 7fd466ffd700 1 -- 172.21.15.57:0/1568617 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd474030040 con 0x1090710 2023-10-06T03:02:02.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.410+0000 7fd48920a740 1 -- 172.21.15.57:0/1568617 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1090710 msgr2=0x13636d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:02.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.410+0000 7fd48920a740 1 --2- 172.21.15.57:0/1568617 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1090710 0x13636d0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fd474000c90 tx=0x7fd47402c070 comp rx=0 tx=0).stop 2023-10-06T03:02:02.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.410+0000 7fd48920a740 1 -- 172.21.15.57:0/1568617 shutdown_connections 2023-10-06T03:02:02.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.410+0000 7fd48920a740 1 --2- 172.21.15.57:0/1568617 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x10db790 0x1364150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:02.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.410+0000 7fd48920a740 1 --2- 172.21.15.57:0/1568617 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x1090ae0 0x1363c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:02.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.410+0000 7fd48920a740 1 --2- 172.21.15.57:0/1568617 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1090710 0x13636d0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:02.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.410+0000 7fd48920a740 1 -- 172.21.15.57:0/1568617 >> 172.21.15.57:0/1568617 conn(0x1090eb0 msgr2=0x12f2c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:02.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.410+0000 7fd48920a740 1 -- 172.21.15.57:0/1568617 shutdown_connections 2023-10-06T03:02:02.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.410+0000 7fd48920a740 1 -- 172.21.15.57:0/1568617 wait complete. 2023-10-06T03:02:02.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.414+0000 7fd48920a740 1 -- start start 2023-10-06T03:02:02.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.414+0000 7fd48920a740 1 Processor -- start 2023-10-06T03:02:02.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.414+0000 7fd48920a740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1090710 0x12ef900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:02.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.414+0000 7fd48920a740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x1090ae0 0x12efe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:02.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.414+0000 7fd48920a740 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x10db790 0x12f0380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:02.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.414+0000 7fd48920a740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x11d8b80 con 0x1090710 2023-10-06T03:02:02.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.414+0000 7fd48920a740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x1067060 con 0x1090ae0 2023-10-06T03:02:02.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.414+0000 7fd48920a740 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x123e290 con 0x10db790 2023-10-06T03:02:02.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.414+0000 7fd48920a740 10 client.0 _ll_register_callbacks cb 0x11540e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:02:02.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.414+0000 7fd484ce1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1090710 0x12ef900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:02.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.414+0000 7fd484ce1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1090710 0x12ef900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40512/0 (socket says 172.21.15.57:40512) 2023-10-06T03:02:02.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.414+0000 7fd484ce1700 1 -- 172.21.15.57:0/3431851292 learned_addr learned my addr 172.21.15.57:0/3431851292 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:02:02.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.418+0000 7fd47ffff700 1 --2- 172.21.15.57:0/3431851292 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x1090ae0 0x12efe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:02.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.418+0000 7fd4854e2700 1 --2- 172.21.15.57:0/3431851292 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x10db790 0x12f0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:02.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.418+0000 7fd484ce1700 1 -- 172.21.15.57:0/3431851292 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x10db790 msgr2=0x12f0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:02.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.418+0000 7fd484ce1700 1 --2- 172.21.15.57:0/3431851292 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x10db790 0x12f0380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:02.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.418+0000 7fd484ce1700 1 -- 172.21.15.57:0/3431851292 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x1090ae0 msgr2=0x12efe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:02.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.418+0000 7fd484ce1700 1 --2- 172.21.15.57:0/3431851292 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x1090ae0 0x12efe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:02.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.418+0000 7fd484ce1700 1 -- 172.21.15.57:0/3431851292 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x1206370 con 0x1090710 2023-10-06T03:02:02.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.418+0000 7fd4854e2700 1 --2- 172.21.15.57:0/3431851292 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x10db790 0x12f0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:02:02.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.418+0000 7fd484ce1700 1 --2- 172.21.15.57:0/3431851292 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1090710 0x12ef900 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fd474000e50 tx=0x7fd474037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afecdee3908999e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:02.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.418+0000 7fd45effd700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-10-06T03:02:02.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.418+0000 7fd45effd700 1 -- 172.21.15.57:0/3431851292 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd474030070 con 0x1090710 2023-10-06T03:02:02.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.418+0000 7fd48920a740 1 -- 172.21.15.57:0/3431851292 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd470057cd0 con 0x1090710 2023-10-06T03:02:02.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.418+0000 7fd45effd700 1 -- 172.21.15.57:0/3431851292 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(39..39 src has 1..39) v4 ==== 6144+0+0 (secure 0 0 0) 0x7fd474048450 con 0x1090710 2023-10-06T03:02:02.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.418+0000 7fd45effd700 1 -- 172.21.15.57:0/3431851292 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd474021040 con 0x1090710 2023-10-06T03:02:02.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.418+0000 7fd48920a740 10 client.5265 fetch_fsmap learned FSMap version 23 2023-10-06T03:02:02.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.418+0000 7fd48920a740 1 -- 172.21.15.57:0/3431851292 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) v3 -- 0x11ecd80 con 0x1090710 2023-10-06T03:02:02.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.418+0000 7fd45effd700 1 -- 172.21.15.57:0/3431851292 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd470057cd0 con 0x1090710 2023-10-06T03:02:02.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.418+0000 7fd45effd700 1 -- 172.21.15.57:0/3431851292 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 23) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fd474048880 con 0x1090710 2023-10-06T03:02:02.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.418+0000 7fd48920a740 10 client.5265 fetch_fsmap finished waiting for FSMap version 23 2023-10-06T03:02:02.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.418+0000 7fd48920a740 10 client.5265 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-06T03:02:02.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.418+0000 7fd48920a740 20 client.5265 populate_metadata read hostname 'smithi057' 2023-10-06T03:02:02.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.418+0000 7fd48920a740 1 --2- 172.21.15.57:0/3431851292 >> [v2:172.21.15.105:6833/938221046,v1:172.21.15.105:6835/938221046] conn(0x12f0d40 0x136f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:02.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.418+0000 7fd48920a740 4 client.5265 mds_command: new command op to 5211 tid=0[{"prefix": "status"}] 2023-10-06T03:02:02.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.418+0000 7fd48920a740 1 -- 172.21.15.57:0/3431851292 --> [v2:172.21.15.105:6833/938221046,v1:172.21.15.105:6835/938221046] -- command(tid 0: {"prefix": "status"}) v1 -- 0x120c410 con 0x12f0d40 2023-10-06T03:02:02.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.418+0000 7fd47ffff700 1 --2- 172.21.15.57:0/3431851292 >> [v2:172.21.15.105:6833/938221046,v1:172.21.15.105:6835/938221046] conn(0x12f0d40 0x136f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:02.489 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.422+0000 7fd47ffff700 1 --2- 172.21.15.57:0/3431851292 >> [v2:172.21.15.105:6833/938221046,v1:172.21.15.105:6835/938221046] conn(0x12f0d40 0x136f960 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=72906a0d04050c84 server_cookie=76db90b4b686357c in_seq=0 out_seq=0 2023-10-06T03:02:02.489 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.422+0000 7fd45effd700 10 client.5265 ms_handle_connect on v2:172.21.15.105:6833/938221046 2023-10-06T03:02:02.489 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.422+0000 7fd45effd700 1 -- 172.21.15.57:0/3431851292 <== mds.0 v2:172.21.15.105:6833/938221046 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x120c410 con 0x12f0d40 2023-10-06T03:02:02.489 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.422+0000 7fd45effd700 10 client.5265 handle_command_reply: tid=0 2023-10-06T03:02:02.489 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.422+0000 7fd48920a740 1 client.5265 shutdown 2023-10-06T03:02:02.489 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.422+0000 7fd48920a740 1 -- 172.21.15.57:0/3431851292 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1090710 msgr2=0x12ef900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:02.489 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.422+0000 7fd48920a740 1 --2- 172.21.15.57:0/3431851292 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1090710 0x12ef900 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fd474000e50 tx=0x7fd474037000 comp rx=0 tx=0).stop 2023-10-06T03:02:02.489 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.422+0000 7fd48920a740 1 -- 172.21.15.57:0/3431851292 shutdown_connections 2023-10-06T03:02:02.489 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.422+0000 7fd48920a740 1 --2- 172.21.15.57:0/3431851292 >> [v2:172.21.15.105:6833/938221046,v1:172.21.15.105:6835/938221046] conn(0x12f0d40 0x136f960 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:02.489 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.422+0000 7fd48920a740 1 --2- 172.21.15.57:0/3431851292 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x10db790 0x12f0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:02.489 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.422+0000 7fd48920a740 1 --2- 172.21.15.57:0/3431851292 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x1090ae0 0x12efe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:02.489 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.422+0000 7fd48920a740 1 --2- 172.21.15.57:0/3431851292 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1090710 0x12ef900 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:02.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.422+0000 7fd45effd700 0 client.5265 ms_handle_reset on v2:172.21.15.105:6833/938221046 2023-10-06T03:02:02.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.422+0000 7fd48920a740 1 -- 172.21.15.57:0/3431851292 >> 172.21.15.57:0/3431851292 conn(0x1090eb0 msgr2=0x12f3b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:02.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.422+0000 7fd48920a740 1 -- 172.21.15.57:0/3431851292 shutdown_connections 2023-10-06T03:02:02.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.422+0000 7fd48920a740 1 -- 172.21.15.57:0/3431851292 wait complete. 2023-10-06T03:02:02.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.422+0000 7fd48920a740 20 client.5265 trim_cache size 0 max 16384 2023-10-06T03:02:02.490 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-10-06T03:02:02.490 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_fsid": "eb56dc0f-9213-41cb-9aad-8ade6c802e98", 2023-10-06T03:02:02.490 INFO:teuthology.orchestra.run.smithi057.stdout: "whoami": 0, 2023-10-06T03:02:02.490 INFO:teuthology.orchestra.run.smithi057.stdout: "id": 5211, 2023-10-06T03:02:02.491 INFO:teuthology.orchestra.run.smithi057.stdout: "want_state": "up:active", 2023-10-06T03:02:02.491 INFO:teuthology.orchestra.run.smithi057.stdout: "state": "up:active", 2023-10-06T03:02:02.491 INFO:teuthology.orchestra.run.smithi057.stdout: "fs_name": "cephfs", 2023-10-06T03:02:02.491 INFO:teuthology.orchestra.run.smithi057.stdout: "rank_uptime": 6.631341698, 2023-10-06T03:02:02.491 INFO:teuthology.orchestra.run.smithi057.stdout: "mdsmap_epoch": 23, 2023-10-06T03:02:02.493 INFO:teuthology.orchestra.run.smithi057.stdout: "osdmap_epoch": 39, 2023-10-06T03:02:02.494 INFO:teuthology.orchestra.run.smithi057.stdout: "osdmap_epoch_barrier": 39, 2023-10-06T03:02:02.494 INFO:teuthology.orchestra.run.smithi057.stdout: "uptime": 6.6514747219999997 2023-10-06T03:02:02.494 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-10-06T03:02:02.495 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.422+0000 7fd486f45700 1 -- 172.21.15.57:0/4047983893 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fd46c060550 msgr2=0x7fd46c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:02.495 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.422+0000 7fd486f45700 1 --2- 172.21.15.57:0/4047983893 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fd46c060550 0x7fd46c062a00 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd474009260 tx=0x7fd474016000 comp rx=0 tx=0).stop 2023-10-06T03:02:02.495 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.422+0000 7fd486f45700 1 -- 172.21.15.57:0/4047983893 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd4800c2a80 msgr2=0x7fd48013b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:02.495 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.422+0000 7fd486f45700 1 --2- 172.21.15.57:0/4047983893 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd4800c2a80 0x7fd48013b9d0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fd47000d860 tx=0x7fd470008040 comp rx=0 tx=0).stop 2023-10-06T03:02:02.495 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.422+0000 7fd486f45700 1 -- 172.21.15.57:0/4047983893 shutdown_connections 2023-10-06T03:02:02.496 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.422+0000 7fd486f45700 1 --2- 172.21.15.57:0/4047983893 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd4800c6510 0x7fd480159d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:02.496 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.422+0000 7fd486f45700 1 --2- 172.21.15.57:0/4047983893 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd4800c2a80 0x7fd48013b9d0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:02.496 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.422+0000 7fd486f45700 1 --2- 172.21.15.57:0/4047983893 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fd46c060550 0x7fd46c062a00 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:02.496 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.422+0000 7fd486f45700 1 --2- 172.21.15.57:0/4047983893 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd4800c0c70 0x7fd4800c3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:02.496 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.422+0000 7fd486f45700 1 -- 172.21.15.57:0/4047983893 >> 172.21.15.57:0/4047983893 conn(0x7fd4800cbed0 msgr2=0x7fd48013faf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:02.496 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.426+0000 7fd486f45700 1 -- 172.21.15.57:0/4047983893 shutdown_connections 2023-10-06T03:02:02.496 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:02.426+0000 7fd486f45700 1 -- 172.21.15.57:0/4047983893 wait complete. 2023-10-06T03:02:02.498 DEBUG:teuthology.orchestra.run.smithi057:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T03:02:02.498 DEBUG:teuthology.orchestra.run.smithi057:> import time 2023-10-06T03:02:02.498 DEBUG:teuthology.orchestra.run.smithi057:> 2023-10-06T03:02:02.498 DEBUG:teuthology.orchestra.run.smithi057:> with open("/home/ubuntu/cephtest/mnt.0/open_file0", '"'"'w'"'"') as f: 2023-10-06T03:02:02.498 DEBUG:teuthology.orchestra.run.smithi057:> f.write("content") 2023-10-06T03:02:02.498 DEBUG:teuthology.orchestra.run.smithi057:> f.flush() 2023-10-06T03:02:02.498 DEBUG:teuthology.orchestra.run.smithi057:> while True: 2023-10-06T03:02:02.498 DEBUG:teuthology.orchestra.run.smithi057:> time.sleep(1) 2023-10-06T03:02:02.498 DEBUG:teuthology.orchestra.run.smithi057:> ' 2023-10-06T03:02:02.505 DEBUG:teuthology.orchestra.run.smithi057:> stat --printf=%s /home/ubuntu/cephtest/mnt.0/open_file0 2023-10-06T03:02:02.523 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T03:02:02.791 INFO:teuthology.orchestra.run.smithi057.stderr:stat: cannot stat '/home/ubuntu/cephtest/mnt.0/open_file0': No such file or directory 2023-10-06T03:02:03.791 DEBUG:teuthology.orchestra.run.smithi057:> stat --printf=%s /home/ubuntu/cephtest/mnt.0/open_file0 2023-10-06T03:02:03.810 INFO:teuthology.orchestra.run.smithi057.stdout:7 2023-10-06T03:02:03.810 INFO:tasks.cephfs.mount:File open_file0 became visible with size 7 from 0 after 1s 2023-10-06T03:02:03.810 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:02:03.810 DEBUG:teuthology.orchestra.run.smithi057:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=open_file0 bs=1M conv=fdatasync count=1 seek=0) 2023-10-06T03:02:03.924 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records in 2023-10-06T03:02:03.924 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records out 2023-10-06T03:02:03.924 INFO:teuthology.orchestra.run.smithi057.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0395308 s, 26.5 MB/s 2023-10-06T03:02:03.925 DEBUG:teuthology.orchestra.run.smithi057:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T03:02:03.925 DEBUG:teuthology.orchestra.run.smithi057:> import time 2023-10-06T03:02:03.925 DEBUG:teuthology.orchestra.run.smithi057:> 2023-10-06T03:02:03.926 DEBUG:teuthology.orchestra.run.smithi057:> with open("/home/ubuntu/cephtest/mnt.0/open_file1", '"'"'w'"'"') as f: 2023-10-06T03:02:03.926 DEBUG:teuthology.orchestra.run.smithi057:> f.write("content") 2023-10-06T03:02:03.926 DEBUG:teuthology.orchestra.run.smithi057:> f.flush() 2023-10-06T03:02:03.926 DEBUG:teuthology.orchestra.run.smithi057:> while True: 2023-10-06T03:02:03.926 DEBUG:teuthology.orchestra.run.smithi057:> time.sleep(1) 2023-10-06T03:02:03.926 DEBUG:teuthology.orchestra.run.smithi057:> ' 2023-10-06T03:02:03.932 DEBUG:teuthology.orchestra.run.smithi057:> stat --printf=%s /home/ubuntu/cephtest/mnt.0/open_file1 2023-10-06T03:02:03.951 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T03:02:03.951 INFO:teuthology.orchestra.run.smithi057.stderr:stat: cannot stat '/home/ubuntu/cephtest/mnt.0/open_file1': No such file or directory 2023-10-06T03:02:04.953 DEBUG:teuthology.orchestra.run.smithi057:> stat --printf=%s /home/ubuntu/cephtest/mnt.0/open_file1 2023-10-06T03:02:04.973 INFO:teuthology.orchestra.run.smithi057.stdout:7 2023-10-06T03:02:04.973 INFO:tasks.cephfs.mount:File open_file1 became visible with size 7 from 0 after 1s 2023-10-06T03:02:04.974 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:02:04.974 DEBUG:teuthology.orchestra.run.smithi057:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=open_file1 bs=1M conv=fdatasync count=1 seek=0) 2023-10-06T03:02:05.091 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records in 2023-10-06T03:02:05.092 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records out 2023-10-06T03:02:05.092 INFO:teuthology.orchestra.run.smithi057.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0430531 s, 24.4 MB/s 2023-10-06T03:02:05.093 DEBUG:teuthology.orchestra.run.smithi057:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T03:02:05.093 DEBUG:teuthology.orchestra.run.smithi057:> import time 2023-10-06T03:02:05.093 DEBUG:teuthology.orchestra.run.smithi057:> 2023-10-06T03:02:05.093 DEBUG:teuthology.orchestra.run.smithi057:> with open("/home/ubuntu/cephtest/mnt.0/open_file2", '"'"'w'"'"') as f: 2023-10-06T03:02:05.093 DEBUG:teuthology.orchestra.run.smithi057:> f.write("content") 2023-10-06T03:02:05.094 DEBUG:teuthology.orchestra.run.smithi057:> f.flush() 2023-10-06T03:02:05.094 DEBUG:teuthology.orchestra.run.smithi057:> while True: 2023-10-06T03:02:05.094 DEBUG:teuthology.orchestra.run.smithi057:> time.sleep(1) 2023-10-06T03:02:05.094 DEBUG:teuthology.orchestra.run.smithi057:> ' 2023-10-06T03:02:05.100 DEBUG:teuthology.orchestra.run.smithi057:> stat --printf=%s /home/ubuntu/cephtest/mnt.0/open_file2 2023-10-06T03:02:05.119 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T03:02:05.120 INFO:teuthology.orchestra.run.smithi057.stderr:stat: cannot stat '/home/ubuntu/cephtest/mnt.0/open_file2': No such file or directory 2023-10-06T03:02:06.121 DEBUG:teuthology.orchestra.run.smithi057:> stat --printf=%s /home/ubuntu/cephtest/mnt.0/open_file2 2023-10-06T03:02:06.142 INFO:teuthology.orchestra.run.smithi057.stdout:7 2023-10-06T03:02:06.142 INFO:tasks.cephfs.mount:File open_file2 became visible with size 7 from 0 after 1s 2023-10-06T03:02:06.142 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:02:06.142 DEBUG:teuthology.orchestra.run.smithi057:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=open_file2 bs=1M conv=fdatasync count=1 seek=0) 2023-10-06T03:02:06.240 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records in 2023-10-06T03:02:06.240 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records out 2023-10-06T03:02:06.240 INFO:teuthology.orchestra.run.smithi057.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0283948 s, 36.9 MB/s 2023-10-06T03:02:06.242 DEBUG:teuthology.orchestra.run.smithi057:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T03:02:06.242 DEBUG:teuthology.orchestra.run.smithi057:> import time 2023-10-06T03:02:06.242 DEBUG:teuthology.orchestra.run.smithi057:> 2023-10-06T03:02:06.242 DEBUG:teuthology.orchestra.run.smithi057:> with open("/home/ubuntu/cephtest/mnt.0/open_file3", '"'"'w'"'"') as f: 2023-10-06T03:02:06.242 DEBUG:teuthology.orchestra.run.smithi057:> f.write("content") 2023-10-06T03:02:06.242 DEBUG:teuthology.orchestra.run.smithi057:> f.flush() 2023-10-06T03:02:06.242 DEBUG:teuthology.orchestra.run.smithi057:> while True: 2023-10-06T03:02:06.242 DEBUG:teuthology.orchestra.run.smithi057:> time.sleep(1) 2023-10-06T03:02:06.243 DEBUG:teuthology.orchestra.run.smithi057:> ' 2023-10-06T03:02:06.250 DEBUG:teuthology.orchestra.run.smithi057:> stat --printf=%s /home/ubuntu/cephtest/mnt.0/open_file3 2023-10-06T03:02:06.266 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T03:02:06.266 INFO:teuthology.orchestra.run.smithi057.stderr:stat: cannot stat '/home/ubuntu/cephtest/mnt.0/open_file3': No such file or directory 2023-10-06T03:02:07.267 DEBUG:teuthology.orchestra.run.smithi057:> stat --printf=%s /home/ubuntu/cephtest/mnt.0/open_file3 2023-10-06T03:02:07.285 INFO:teuthology.orchestra.run.smithi057.stdout:7 2023-10-06T03:02:07.285 INFO:tasks.cephfs.mount:File open_file3 became visible with size 7 from 0 after 1s 2023-10-06T03:02:07.286 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:02:07.286 DEBUG:teuthology.orchestra.run.smithi057:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=open_file3 bs=1M conv=fdatasync count=1 seek=0) 2023-10-06T03:02:07.402 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records in 2023-10-06T03:02:07.402 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records out 2023-10-06T03:02:07.403 INFO:teuthology.orchestra.run.smithi057.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0388247 s, 27.0 MB/s 2023-10-06T03:02:07.404 DEBUG:teuthology.orchestra.run.smithi057:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T03:02:07.404 DEBUG:teuthology.orchestra.run.smithi057:> import time 2023-10-06T03:02:07.404 DEBUG:teuthology.orchestra.run.smithi057:> 2023-10-06T03:02:07.404 DEBUG:teuthology.orchestra.run.smithi057:> with open("/home/ubuntu/cephtest/mnt.0/open_file4", '"'"'w'"'"') as f: 2023-10-06T03:02:07.404 DEBUG:teuthology.orchestra.run.smithi057:> f.write("content") 2023-10-06T03:02:07.404 DEBUG:teuthology.orchestra.run.smithi057:> f.flush() 2023-10-06T03:02:07.404 DEBUG:teuthology.orchestra.run.smithi057:> while True: 2023-10-06T03:02:07.404 DEBUG:teuthology.orchestra.run.smithi057:> time.sleep(1) 2023-10-06T03:02:07.405 DEBUG:teuthology.orchestra.run.smithi057:> ' 2023-10-06T03:02:07.410 DEBUG:teuthology.orchestra.run.smithi057:> stat --printf=%s /home/ubuntu/cephtest/mnt.0/open_file4 2023-10-06T03:02:07.427 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T03:02:07.427 INFO:teuthology.orchestra.run.smithi057.stderr:stat: cannot stat '/home/ubuntu/cephtest/mnt.0/open_file4': No such file or directory 2023-10-06T03:02:08.428 DEBUG:teuthology.orchestra.run.smithi057:> stat --printf=%s /home/ubuntu/cephtest/mnt.0/open_file4 2023-10-06T03:02:08.446 INFO:teuthology.orchestra.run.smithi057.stdout:7 2023-10-06T03:02:08.446 INFO:tasks.cephfs.mount:File open_file4 became visible with size 7 from 0 after 1s 2023-10-06T03:02:08.446 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:02:08.446 DEBUG:teuthology.orchestra.run.smithi057:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=open_file4 bs=1M conv=fdatasync count=1 seek=0) 2023-10-06T03:02:08.559 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records in 2023-10-06T03:02:08.559 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records out 2023-10-06T03:02:08.559 INFO:teuthology.orchestra.run.smithi057.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0348461 s, 30.1 MB/s 2023-10-06T03:02:08.560 DEBUG:teuthology.orchestra.run.smithi057:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T03:02:08.560 DEBUG:teuthology.orchestra.run.smithi057:> import time 2023-10-06T03:02:08.560 DEBUG:teuthology.orchestra.run.smithi057:> 2023-10-06T03:02:08.560 DEBUG:teuthology.orchestra.run.smithi057:> with open("/home/ubuntu/cephtest/mnt.0/open_file5", '"'"'w'"'"') as f: 2023-10-06T03:02:08.561 DEBUG:teuthology.orchestra.run.smithi057:> f.write("content") 2023-10-06T03:02:08.561 DEBUG:teuthology.orchestra.run.smithi057:> f.flush() 2023-10-06T03:02:08.561 DEBUG:teuthology.orchestra.run.smithi057:> while True: 2023-10-06T03:02:08.561 DEBUG:teuthology.orchestra.run.smithi057:> time.sleep(1) 2023-10-06T03:02:08.561 DEBUG:teuthology.orchestra.run.smithi057:> ' 2023-10-06T03:02:08.566 DEBUG:teuthology.orchestra.run.smithi057:> stat --printf=%s /home/ubuntu/cephtest/mnt.0/open_file5 2023-10-06T03:02:08.582 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T03:02:08.582 INFO:teuthology.orchestra.run.smithi057.stderr:stat: cannot stat '/home/ubuntu/cephtest/mnt.0/open_file5': No such file or directory 2023-10-06T03:02:09.583 DEBUG:teuthology.orchestra.run.smithi057:> stat --printf=%s /home/ubuntu/cephtest/mnt.0/open_file5 2023-10-06T03:02:09.604 INFO:teuthology.orchestra.run.smithi057.stdout:7 2023-10-06T03:02:09.605 INFO:tasks.cephfs.mount:File open_file5 became visible with size 7 from 0 after 1s 2023-10-06T03:02:09.605 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:02:09.605 DEBUG:teuthology.orchestra.run.smithi057:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=open_file5 bs=1M conv=fdatasync count=1 seek=0) 2023-10-06T03:02:09.718 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records in 2023-10-06T03:02:09.719 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records out 2023-10-06T03:02:09.719 INFO:teuthology.orchestra.run.smithi057.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0370951 s, 28.3 MB/s 2023-10-06T03:02:09.720 DEBUG:teuthology.orchestra.run.smithi057:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T03:02:09.720 DEBUG:teuthology.orchestra.run.smithi057:> import time 2023-10-06T03:02:09.720 DEBUG:teuthology.orchestra.run.smithi057:> 2023-10-06T03:02:09.721 DEBUG:teuthology.orchestra.run.smithi057:> with open("/home/ubuntu/cephtest/mnt.0/open_file6", '"'"'w'"'"') as f: 2023-10-06T03:02:09.721 DEBUG:teuthology.orchestra.run.smithi057:> f.write("content") 2023-10-06T03:02:09.721 DEBUG:teuthology.orchestra.run.smithi057:> f.flush() 2023-10-06T03:02:09.721 DEBUG:teuthology.orchestra.run.smithi057:> while True: 2023-10-06T03:02:09.721 DEBUG:teuthology.orchestra.run.smithi057:> time.sleep(1) 2023-10-06T03:02:09.721 DEBUG:teuthology.orchestra.run.smithi057:> ' 2023-10-06T03:02:09.726 DEBUG:teuthology.orchestra.run.smithi057:> stat --printf=%s /home/ubuntu/cephtest/mnt.0/open_file6 2023-10-06T03:02:09.743 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T03:02:09.743 INFO:teuthology.orchestra.run.smithi057.stderr:stat: cannot stat '/home/ubuntu/cephtest/mnt.0/open_file6': No such file or directory 2023-10-06T03:02:10.744 DEBUG:teuthology.orchestra.run.smithi057:> stat --printf=%s /home/ubuntu/cephtest/mnt.0/open_file6 2023-10-06T03:02:10.763 INFO:teuthology.orchestra.run.smithi057.stdout:7 2023-10-06T03:02:10.764 INFO:tasks.cephfs.mount:File open_file6 became visible with size 7 from 0 after 1s 2023-10-06T03:02:10.764 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:02:10.764 DEBUG:teuthology.orchestra.run.smithi057:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=open_file6 bs=1M conv=fdatasync count=1 seek=0) 2023-10-06T03:02:10.860 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records in 2023-10-06T03:02:10.860 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records out 2023-10-06T03:02:10.860 INFO:teuthology.orchestra.run.smithi057.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0258263 s, 40.6 MB/s 2023-10-06T03:02:10.861 DEBUG:teuthology.orchestra.run.smithi057:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T03:02:10.862 DEBUG:teuthology.orchestra.run.smithi057:> import time 2023-10-06T03:02:10.862 DEBUG:teuthology.orchestra.run.smithi057:> 2023-10-06T03:02:10.862 DEBUG:teuthology.orchestra.run.smithi057:> with open("/home/ubuntu/cephtest/mnt.0/open_file7", '"'"'w'"'"') as f: 2023-10-06T03:02:10.862 DEBUG:teuthology.orchestra.run.smithi057:> f.write("content") 2023-10-06T03:02:10.862 DEBUG:teuthology.orchestra.run.smithi057:> f.flush() 2023-10-06T03:02:10.862 DEBUG:teuthology.orchestra.run.smithi057:> while True: 2023-10-06T03:02:10.862 DEBUG:teuthology.orchestra.run.smithi057:> time.sleep(1) 2023-10-06T03:02:10.862 DEBUG:teuthology.orchestra.run.smithi057:> ' 2023-10-06T03:02:10.868 DEBUG:teuthology.orchestra.run.smithi057:> stat --printf=%s /home/ubuntu/cephtest/mnt.0/open_file7 2023-10-06T03:02:10.881 INFO:teuthology.orchestra.run.smithi057.stderr:stat: cannot stat '/home/ubuntu/cephtest/mnt.0/open_file7': No such file or directory 2023-10-06T03:02:10.882 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T03:02:11.883 DEBUG:teuthology.orchestra.run.smithi057:> stat --printf=%s /home/ubuntu/cephtest/mnt.0/open_file7 2023-10-06T03:02:11.904 INFO:teuthology.orchestra.run.smithi057.stdout:7 2023-10-06T03:02:11.904 INFO:tasks.cephfs.mount:File open_file7 became visible with size 7 from 0 after 1s 2023-10-06T03:02:11.904 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:02:11.904 DEBUG:teuthology.orchestra.run.smithi057:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=open_file7 bs=1M conv=fdatasync count=1 seek=0) 2023-10-06T03:02:12.005 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records in 2023-10-06T03:02:12.005 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records out 2023-10-06T03:02:12.005 INFO:teuthology.orchestra.run.smithi057.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0267697 s, 39.2 MB/s 2023-10-06T03:02:18.140 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:02:18.147 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:02:22.008 DEBUG:teuthology.orchestra.run.smithi057:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata stat mds0_openfiles.1 2023-10-06T03:02:22.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:22.062+0000 7fe9b55cae80 1 Processor -- start 2023-10-06T03:02:22.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:22.062+0000 7fe9b55cae80 1 -- start start 2023-10-06T03:02:22.070 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:22.062+0000 7fe9b55cae80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5560ce063be0 0x5560cdf8a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:22.070 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:22.062+0000 7fe9b55cae80 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5560ce063fb0 0x5560ce062df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:22.071 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:22.062+0000 7fe9b55cae80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5560ce064c80 0x5560ce05b840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:22.071 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:22.062+0000 7fe9b55cae80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560cdf32220 con 0x5560ce064c80 2023-10-06T03:02:22.071 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:22.062+0000 7fe9b55cae80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560cded6840 con 0x5560ce063be0 2023-10-06T03:02:22.071 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:22.062+0000 7fe9b55cae80 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x5560cded64e0 con 0x5560ce063fb0 2023-10-06T03:02:22.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:22.066+0000 7fe9b234d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5560ce064c80 0x5560ce05b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:22.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:22.066+0000 7fe9b1b4c700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5560ce063be0 0x5560cdf8a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:22.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:22.066+0000 7fe9b1b4c700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5560ce063be0 0x5560cdf8a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.57:37790/0 (socket says 172.21.15.57:37790) 2023-10-06T03:02:22.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:22.066+0000 7fe9b1b4c700 1 -- 172.21.15.57:0/895466214 learned_addr learned my addr 172.21.15.57:0/895466214 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:02:22.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:22.066+0000 7fe9b134b700 1 --2- 172.21.15.57:0/895466214 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5560ce063fb0 0x5560ce062df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:22.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:22.066+0000 7fe9b234d700 1 -- 172.21.15.57:0/895466214 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5560ce063fb0 msgr2=0x5560ce062df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:22.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:22.066+0000 7fe9b234d700 1 --2- 172.21.15.57:0/895466214 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5560ce063fb0 0x5560ce062df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:22.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:22.066+0000 7fe9b234d700 1 -- 172.21.15.57:0/895466214 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5560ce063be0 msgr2=0x5560cdf8a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:22.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:22.066+0000 7fe9b234d700 1 --2- 172.21.15.57:0/895466214 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5560ce063be0 0x5560cdf8a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:22.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:22.066+0000 7fe9b234d700 1 -- 172.21.15.57:0/895466214 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9a400a0e0 con 0x5560ce064c80 2023-10-06T03:02:22.074 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:22.066+0000 7fe9b234d700 1 --2- 172.21.15.57:0/895466214 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5560ce064c80 0x5560ce05b840 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac001d00 tx=0x7fe9ac0017a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52b3f522fe77208c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:22.074 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:22.066+0000 7fe9a3fff700 1 -- 172.21.15.57:0/895466214 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9ac014070 con 0x5560ce064c80 2023-10-06T03:02:22.074 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:22.066+0000 7fe9a3fff700 1 -- 172.21.15.57:0/895466214 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9ac008030 con 0x5560ce064c80 2023-10-06T03:02:22.074 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:22.066+0000 7fe9a3fff700 1 -- 172.21.15.57:0/895466214 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9ac00bc00 con 0x5560ce064c80 2023-10-06T03:02:22.074 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:22.066+0000 7fe9b55cae80 1 -- 172.21.15.57:0/895466214 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5560ce064c80 msgr2=0x5560ce05b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:22.074 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:22.066+0000 7fe9b55cae80 1 --2- 172.21.15.57:0/895466214 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5560ce064c80 0x5560ce05b840 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac001d00 tx=0x7fe9ac0017a0 comp rx=0 tx=0).stop 2023-10-06T03:02:22.074 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:22.066+0000 7fe9b55cae80 1 -- 172.21.15.57:0/895466214 shutdown_connections 2023-10-06T03:02:22.074 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:22.066+0000 7fe9b55cae80 1 --2- 172.21.15.57:0/895466214 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5560ce064c80 0x5560ce05b840 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:22.075 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:22.066+0000 7fe9b55cae80 1 --2- 172.21.15.57:0/895466214 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5560ce063fb0 0x5560ce062df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:22.075 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:22.066+0000 7fe9b55cae80 1 --2- 172.21.15.57:0/895466214 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5560ce063be0 0x5560cdf8a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:22.075 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:22.066+0000 7fe9b55cae80 1 -- 172.21.15.57:0/895466214 >> 172.21.15.57:0/895466214 conn(0x5560cdf90f00 msgr2=0x5560cdf89a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:22.075 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:22.066+0000 7fe9b55cae80 1 -- 172.21.15.57:0/895466214 shutdown_connections 2023-10-06T03:02:22.075 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:22.066+0000 7fe9b55cae80 1 -- 172.21.15.57:0/895466214 wait complete. 2023-10-06T03:02:22.075 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:22.070+0000 7fe9b55cae80 1 Processor -- start 2023-10-06T03:02:22.075 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:22.070+0000 7fe9b55cae80 1 -- start start 2023-10-06T03:02:22.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:22.070+0000 7fe9b55cae80 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5560ce063be0 0x5560ce059060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:22.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:22.070+0000 7fe9b55cae80 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5560ce063fb0 0x5560cdf884e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:22.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:22.070+0000 7fe9b55cae80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5560ce064c80 0x5560cdf88a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:22.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:22.070+0000 7fe9b55cae80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560cdecd270 con 0x5560ce064c80 2023-10-06T03:02:22.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:22.070+0000 7fe9b55cae80 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560ce0611d0 con 0x5560ce063be0 2023-10-06T03:02:22.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:22.070+0000 7fe9b55cae80 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x5560ce060320 con 0x5560ce063fb0 2023-10-06T03:02:22.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:22.070+0000 7fe9b234d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5560ce064c80 0x5560cdf88a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:22.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:22.070+0000 7fe9b234d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5560ce064c80 0x5560cdf88a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43200/0 (socket says 172.21.15.57:43200) 2023-10-06T03:02:22.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:22.070+0000 7fe9b234d700 1 -- 172.21.15.57:0/3410597788 learned_addr learned my addr 172.21.15.57:0/3410597788 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:02:22.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:22.070+0000 7fe9b134b700 1 --2- 172.21.15.57:0/3410597788 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5560ce063fb0 0x5560cdf884e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:22.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:22.070+0000 7fe9b1b4c700 1 --2- 172.21.15.57:0/3410597788 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5560ce063be0 0x5560ce059060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:22.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:22.070+0000 7fe9b134b700 1 -- 172.21.15.57:0/3410597788 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5560ce063be0 msgr2=0x5560ce059060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:22.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:22.070+0000 7fe9b134b700 1 --2- 172.21.15.57:0/3410597788 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5560ce063be0 0x5560ce059060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:22.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:22.070+0000 7fe9b134b700 1 -- 172.21.15.57:0/3410597788 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5560ce064c80 msgr2=0x5560cdf88a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:22.079 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:22.070+0000 7fe9b134b700 1 --2- 172.21.15.57:0/3410597788 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5560ce064c80 0x5560cdf88a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:22.079 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:22.070+0000 7fe9b134b700 1 -- 172.21.15.57:0/3410597788 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9ac00a040 con 0x5560ce063fb0 2023-10-06T03:02:22.079 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:22.070+0000 7fe9b234d700 1 --2- 172.21.15.57:0/3410597788 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5560ce064c80 0x5560cdf88a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:02:22.079 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:22.070+0000 7fe9b134b700 1 --2- 172.21.15.57:0/3410597788 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5560ce063fb0 0x5560cdf884e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe9a800efb0 tx=0x7fe9a8001770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:22.080 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:22.070+0000 7fe9a27fc700 1 -- 172.21.15.57:0/3410597788 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9a800ce70 con 0x5560ce063fb0 2023-10-06T03:02:22.080 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:22.074+0000 7fe9a27fc700 1 -- 172.21.15.57:0/3410597788 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9a800f450 con 0x5560ce063fb0 2023-10-06T03:02:22.080 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:22.074+0000 7fe9a27fc700 1 -- 172.21.15.57:0/3410597788 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9a800f600 con 0x5560ce063fb0 2023-10-06T03:02:22.080 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:22.074+0000 7fe9b55cae80 1 -- 172.21.15.57:0/3410597788 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5560cded8770 con 0x5560ce063fb0 2023-10-06T03:02:22.080 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:22.074+0000 7fe9b55cae80 1 -- 172.21.15.57:0/3410597788 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5560cded81d0 con 0x5560ce063fb0 2023-10-06T03:02:22.082 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:22.078+0000 7fe9a27fc700 1 -- 172.21.15.57:0/3410597788 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fe9a8015020 con 0x5560ce063fb0 2023-10-06T03:02:22.084 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:22.078+0000 7fe9a27fc700 1 --2- 172.21.15.57:0/3410597788 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fe99405eeb0 0x7fe994061360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:22.084 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:22.078+0000 7fe9a27fc700 1 -- 172.21.15.57:0/3410597788 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6144+0+0 (secure 0 0 0) 0x7fe9a807b8e0 con 0x5560ce063fb0 2023-10-06T03:02:22.085 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:22.078+0000 7fe9b1b4c700 1 --2- 172.21.15.57:0/3410597788 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fe99405eeb0 0x7fe994061360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:22.085 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:22.078+0000 7fe9b55cae80 1 --2- 172.21.15.57:0/3410597788 >> [v2:172.21.15.57:6808/33057,v1:172.21.15.57:6811/33057] conn(0x5560ce05d6d0 0x5560ce05c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:22.085 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:22.078+0000 7fe9b55cae80 1 -- 172.21.15.57:0/3410597788 --> [v2:172.21.15.57:6808/33057,v1:172.21.15.57:6811/33057] -- osd_op(unknown.0.0:1 5.13 5:c9647462:::mds0_openfiles.1:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39) v8 -- 0x5560ce05cdb0 con 0x5560ce05d6d0 2023-10-06T03:02:22.085 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:22.078+0000 7fe9b234d700 1 --2- 172.21.15.57:0/3410597788 >> [v2:172.21.15.57:6808/33057,v1:172.21.15.57:6811/33057] conn(0x5560ce05d6d0 0x5560ce05c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:22.086 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:22.078+0000 7fe9b1b4c700 1 --2- 172.21.15.57:0/3410597788 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fe99405eeb0 0x7fe994061360 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe9a40059e0 tx=0x7fe9a4015000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:22.086 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:22.078+0000 7fe9b234d700 1 --2- 172.21.15.57:0/3410597788 >> [v2:172.21.15.57:6808/33057,v1:172.21.15.57:6811/33057] conn(0x5560ce05d6d0 0x5560ce05c870 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:22.087 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:22.082+0000 7fe9b234d700 1 -- 172.21.15.57:0/3410597788 <== osd.3 v2:172.21.15.57:6808/33057 1 ==== osd_op_reply(1 mds0_openfiles.1 [stat out=16b] v0'0 uv5 ondisk = 0) v8 ==== 160+0+16 (crc 0 0 0) 0x7fe9ac016070 con 0x5560ce05d6d0 2023-10-06T03:02:22.087 INFO:teuthology.orchestra.run.smithi057.stdout:cephfs_metadata/mds0_openfiles.1 mtime 2023-10-06T03:02:15.000000+0000, size 0 2023-10-06T03:02:22.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:22.082+0000 7fe9b55cae80 1 -- 172.21.15.57:0/3410597788 >> [v2:172.21.15.57:6808/33057,v1:172.21.15.57:6811/33057] conn(0x5560ce05d6d0 msgr2=0x5560ce05c870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:22.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:22.082+0000 7fe9b55cae80 1 --2- 172.21.15.57:0/3410597788 >> [v2:172.21.15.57:6808/33057,v1:172.21.15.57:6811/33057] conn(0x5560ce05d6d0 0x5560ce05c870 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:22.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:22.082+0000 7fe9b55cae80 1 -- 172.21.15.57:0/3410597788 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fe99405eeb0 msgr2=0x7fe994061360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:22.089 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:22.082+0000 7fe9b55cae80 1 --2- 172.21.15.57:0/3410597788 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fe99405eeb0 0x7fe994061360 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe9a40059e0 tx=0x7fe9a4015000 comp rx=0 tx=0).stop 2023-10-06T03:02:22.089 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:22.082+0000 7fe9b55cae80 1 -- 172.21.15.57:0/3410597788 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5560ce063fb0 msgr2=0x5560cdf884e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:22.089 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:22.082+0000 7fe9b55cae80 1 --2- 172.21.15.57:0/3410597788 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5560ce063fb0 0x5560cdf884e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe9a800efb0 tx=0x7fe9a8001770 comp rx=0 tx=0).stop 2023-10-06T03:02:22.089 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:22.082+0000 7fe9b234d700 1 -- 172.21.15.57:0/3410597788 reap_dead start 2023-10-06T03:02:22.089 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:22.082+0000 7fe9b55cae80 1 -- 172.21.15.57:0/3410597788 shutdown_connections 2023-10-06T03:02:22.089 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:22.082+0000 7fe9b55cae80 1 -- 172.21.15.57:0/3410597788 >> 172.21.15.57:0/3410597788 conn(0x5560cdf90f00 msgr2=0x5560cdfbb700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:22.089 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:22.082+0000 7fe9b55cae80 1 -- 172.21.15.57:0/3410597788 shutdown_connections 2023-10-06T03:02:22.089 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:22.082+0000 7fe9b55cae80 1 -- 172.21.15.57:0/3410597788 wait complete. 2023-10-06T03:02:22.107 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T03:02:22.107 DEBUG:teuthology.orchestra.run.smithi057:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T03:02:22.196 DEBUG:teuthology.orchestra.run.smithi105:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T03:02:22.238 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T03:02:22.239 INFO:tasks.cephfs.mount:Terminating background process 2023-10-06T03:02:22.258 INFO:tasks.cephfs.mount:Terminating background process 2023-10-06T03:02:22.318 INFO:tasks.cephfs.mount:Terminating background process 2023-10-06T03:02:22.379 INFO:tasks.cephfs.mount:Terminating background process 2023-10-06T03:02:22.438 INFO:tasks.cephfs.mount:Terminating background process 2023-10-06T03:02:22.498 INFO:tasks.cephfs.mount:Terminating background process 2023-10-06T03:02:22.558 INFO:tasks.cephfs.mount:Terminating background process 2023-10-06T03:02:22.619 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-06T03:02:22.619 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:02:22.619 DEBUG:teuthology.orchestra.run.smithi057:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-06T03:02:22.805 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi057.front.sepia.ceph.com 2023-10-06T03:02:22.805 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:02:22.805 DEBUG:teuthology.orchestra.run.smithi057:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T03:02:22.822 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:02:23.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.026+0000 7fdec0ae3700 1 Processor -- start 2023-10-06T03:02:23.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.026+0000 7fdec0ae3700 1 -- start start 2023-10-06T03:02:23.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.030+0000 7fdec0ae3700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdebc0b10f0 0x7fdebc0d0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:23.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.030+0000 7fdec0ae3700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdebc0afc50 con 0x7fdebc159910 2023-10-06T03:02:23.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.030+0000 7fdec0ae3700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdebc0af920 con 0x7fdebc15a3f0 2023-10-06T03:02:23.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.030+0000 7fdec0ae3700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdebc0b25e0 con 0x7fdebc0b10f0 2023-10-06T03:02:23.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.030+0000 7fdebb7fe700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fdebc159910 0x7fdebc159ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:59716/0 (socket says 172.21.15.57:59716) 2023-10-06T03:02:23.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.030+0000 7fdebb7fe700 1 -- 172.21.15.57:0/309747774 learned_addr learned my addr 172.21.15.57:0/309747774 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:02:23.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.030+0000 7fdebbfff700 1 --2- 172.21.15.57:0/309747774 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdebc0b10f0 0x7fdebc0d0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:23.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.030+0000 7fdeba7fc700 1 -- 172.21.15.57:0/309747774 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2232135760 0 0) 0x7fdebc0afc50 con 0x7fdebc159910 2023-10-06T03:02:23.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.030+0000 7fdeba7fc700 1 -- 172.21.15.57:0/309747774 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdea4003570 con 0x7fdebc159910 2023-10-06T03:02:23.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.030+0000 7fdeba7fc700 1 -- 172.21.15.57:0/309747774 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 346782864 0 0) 0x7fdebc0af920 con 0x7fdebc15a3f0 2023-10-06T03:02:23.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.030+0000 7fdeba7fc700 1 -- 172.21.15.57:0/309747774 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdebc0afc50 con 0x7fdebc15a3f0 2023-10-06T03:02:23.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.030+0000 7fdebbfff700 1 -- 172.21.15.57:0/309747774 >> v1:172.21.15.105:6789/0 conn(0x7fdebc15a3f0 legacy=0x7fdebc160d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:23.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.030+0000 7fdebbfff700 1 -- 172.21.15.57:0/309747774 >> v1:172.21.15.57:6789/0 conn(0x7fdebc159910 legacy=0x7fdebc159ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:23.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.030+0000 7fdebbfff700 1 -- 172.21.15.57:0/309747774 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdebc0aee30 con 0x7fdebc0b10f0 2023-10-06T03:02:23.038 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.030+0000 7fdebbfff700 1 --2- 172.21.15.57:0/309747774 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdebc0b10f0 0x7fdebc0d0bf0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fdeb4009e90 tx=0x7fdeb4009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e69d7fdf420d0dd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:23.038 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.030+0000 7fdeba7fc700 1 -- 172.21.15.57:0/309747774 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeb400e070 con 0x7fdebc0b10f0 2023-10-06T03:02:23.038 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.030+0000 7fdeba7fc700 1 -- 172.21.15.57:0/309747774 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdeb400bb80 con 0x7fdebc0b10f0 2023-10-06T03:02:23.038 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.030+0000 7fdeba7fc700 1 -- 172.21.15.57:0/309747774 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeb4012430 con 0x7fdebc0b10f0 2023-10-06T03:02:23.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.034+0000 7fdec0ae3700 1 -- 172.21.15.57:0/309747774 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdebc0b10f0 msgr2=0x7fdebc0d0bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:23.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.034+0000 7fdec0ae3700 1 --2- 172.21.15.57:0/309747774 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdebc0b10f0 0x7fdebc0d0bf0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fdeb4009e90 tx=0x7fdeb4009780 comp rx=0 tx=0).stop 2023-10-06T03:02:23.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.034+0000 7fdec0ae3700 1 -- 172.21.15.57:0/309747774 shutdown_connections 2023-10-06T03:02:23.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.034+0000 7fdec0ae3700 1 --2- 172.21.15.57:0/309747774 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdebc0b10f0 0x7fdebc0d0bf0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:23.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.034+0000 7fdec0ae3700 1 -- 172.21.15.57:0/309747774 >> 172.21.15.57:0/309747774 conn(0x7fdebc06ef40 msgr2=0x7fdebc0d0080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:23.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.034+0000 7fdec0ae3700 1 -- 172.21.15.57:0/309747774 shutdown_connections 2023-10-06T03:02:23.040 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.034+0000 7fdec0ae3700 1 -- 172.21.15.57:0/309747774 wait complete. 2023-10-06T03:02:23.041 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.034+0000 7fdec0ae3700 1 Processor -- start 2023-10-06T03:02:23.041 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.034+0000 7fdec0ae3700 1 -- start start 2023-10-06T03:02:23.042 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.034+0000 7fdec0ae3700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdebc0b10f0 0x7fdebc14a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:23.043 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.034+0000 7fdec0ae3700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdebc159910 0x7fdebc0b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:23.043 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.034+0000 7fdec0ae3700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdebc15a3f0 0x7fdebc0b5390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:23.043 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.034+0000 7fdec0ae3700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdebc099fe0 con 0x7fdebc15a3f0 2023-10-06T03:02:23.043 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.034+0000 7fdec0ae3700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdebc14a750 con 0x7fdebc0b10f0 2023-10-06T03:02:23.043 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.034+0000 7fdec0ae3700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdebc16a3b0 con 0x7fdebc159910 2023-10-06T03:02:23.043 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.038+0000 7fdebbfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdebc15a3f0 0x7fdebc0b5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:23.043 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.038+0000 7fdebb7fe700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdebc0b10f0 0x7fdebc14a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:23.043 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.038+0000 7fdebbfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdebc15a3f0 0x7fdebc0b5390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43202/0 (socket says 172.21.15.57:43202) 2023-10-06T03:02:23.043 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.038+0000 7fdebbfff700 1 -- 172.21.15.57:0/2755709181 learned_addr learned my addr 172.21.15.57:0/2755709181 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:02:23.043 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.038+0000 7fdebaffd700 1 --2- 172.21.15.57:0/2755709181 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdebc159910 0x7fdebc0b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:23.044 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.038+0000 7fdebbfff700 1 -- 172.21.15.57:0/2755709181 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdebc159910 msgr2=0x7fdebc0b4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:23.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.038+0000 7fdebbfff700 1 --2- 172.21.15.57:0/2755709181 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdebc159910 0x7fdebc0b4e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:23.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.038+0000 7fdebbfff700 1 -- 172.21.15.57:0/2755709181 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdebc0b10f0 msgr2=0x7fdebc14a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:23.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.038+0000 7fdebbfff700 1 --2- 172.21.15.57:0/2755709181 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdebc0b10f0 0x7fdebc14a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:23.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.038+0000 7fdebbfff700 1 -- 172.21.15.57:0/2755709181 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeb4009a20 con 0x7fdebc15a3f0 2023-10-06T03:02:23.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.038+0000 7fdebbfff700 1 --2- 172.21.15.57:0/2755709181 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdebc15a3f0 0x7fdebc0b5390 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fdeb400b610 tx=0x7fdeb4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:23.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.038+0000 7fdea37fe700 1 -- 172.21.15.57:0/2755709181 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeb4026480 con 0x7fdebc15a3f0 2023-10-06T03:02:23.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.038+0000 7fdea37fe700 1 -- 172.21.15.57:0/2755709181 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdeb4026600 con 0x7fdebc15a3f0 2023-10-06T03:02:23.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.038+0000 7fdea37fe700 1 -- 172.21.15.57:0/2755709181 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeb40269c0 con 0x7fdebc15a3f0 2023-10-06T03:02:23.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.038+0000 7fdec0ae3700 1 -- 172.21.15.57:0/2755709181 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdebc16a0d0 con 0x7fdebc15a3f0 2023-10-06T03:02:23.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.038+0000 7fdec0ae3700 1 -- 172.21.15.57:0/2755709181 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdebc16ce90 con 0x7fdebc15a3f0 2023-10-06T03:02:23.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.038+0000 7fdec0ae3700 1 -- 172.21.15.57:0/2755709181 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdebc0645e0 con 0x7fdebc15a3f0 2023-10-06T03:02:23.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.042+0000 7fdea37fe700 1 -- 172.21.15.57:0/2755709181 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fdeb401c400 con 0x7fdebc15a3f0 2023-10-06T03:02:23.049 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.042+0000 7fdea37fe700 1 --2- 172.21.15.57:0/2755709181 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fdea8060550 0x7fdea8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:23.049 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.042+0000 7fdea37fe700 1 -- 172.21.15.57:0/2755709181 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6144+0+0 (secure 0 0 0) 0x7fdeb407e8d0 con 0x7fdebc15a3f0 2023-10-06T03:02:23.049 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.042+0000 7fdebb7fe700 1 --2- 172.21.15.57:0/2755709181 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fdea8060550 0x7fdea8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:23.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.046+0000 7fdebb7fe700 1 --2- 172.21.15.57:0/2755709181 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fdea8060550 0x7fdea8062a00 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fdeac001360 tx=0x7fdeac009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:23.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.050+0000 7fdea37fe700 1 -- 172.21.15.57:0/2755709181 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fdeb404ec90 con 0x7fdebc15a3f0 2023-10-06T03:02:23.261 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.254+0000 7fdec0ae3700 1 -- 172.21.15.57:0/2755709181 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdebc0675b0 con 0x7fdebc15a3f0 2023-10-06T03:02:23.262 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.254+0000 7fdea37fe700 1 -- 172.21.15.57:0/2755709181 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4595 (secure 0 0 0) 0x7fdeb40522b0 con 0x7fdebc15a3f0 2023-10-06T03:02:23.263 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:02:23.263 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":23,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5158,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6834/3877951826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":3877951826},{"type":"v1","addr":"172.21.15.105:6834","nonce":3877951826}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5214,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/311797094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":311797094},{"type":"v1","addr":"172.21.15.57:6835","nonce":311797094}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5217,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6837/670891004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6836","nonce":670891004},{"type":"v1","addr":"172.21.15.57:6837","nonce":670891004}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:01:47.353461+0000","modified":"2023-10-06T03:01:59.821893+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":36,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5211},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5211":{"gid":5211,"name":"d","rank":0,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.105:6835/938221046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":938221046},{"type":"v1","addr":"172.21.15.105:6835","nonce":938221046}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T03:02:23.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.258+0000 7fdec0ae3700 1 -- 172.21.15.57:0/2755709181 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fdea8060550 msgr2=0x7fdea8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:23.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.258+0000 7fdec0ae3700 1 --2- 172.21.15.57:0/2755709181 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fdea8060550 0x7fdea8062a00 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fdeac001360 tx=0x7fdeac009040 comp rx=0 tx=0).stop 2023-10-06T03:02:23.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.258+0000 7fdec0ae3700 1 -- 172.21.15.57:0/2755709181 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdebc15a3f0 msgr2=0x7fdebc0b5390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:23.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.258+0000 7fdec0ae3700 1 --2- 172.21.15.57:0/2755709181 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdebc15a3f0 0x7fdebc0b5390 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fdeb400b610 tx=0x7fdeb4019000 comp rx=0 tx=0).stop 2023-10-06T03:02:23.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.258+0000 7fdec0ae3700 1 -- 172.21.15.57:0/2755709181 shutdown_connections 2023-10-06T03:02:23.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.258+0000 7fdec0ae3700 1 --2- 172.21.15.57:0/2755709181 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdebc15a3f0 0x7fdebc0b5390 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:23.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.258+0000 7fdec0ae3700 1 --2- 172.21.15.57:0/2755709181 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fdea8060550 0x7fdea8062a00 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:23.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.258+0000 7fdec0ae3700 1 --2- 172.21.15.57:0/2755709181 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdebc159910 0x7fdebc0b4e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:23.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.258+0000 7fdec0ae3700 1 --2- 172.21.15.57:0/2755709181 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdebc0b10f0 0x7fdebc14a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:23.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.258+0000 7fdec0ae3700 1 -- 172.21.15.57:0/2755709181 >> 172.21.15.57:0/2755709181 conn(0x7fdebc06ef40 msgr2=0x7fdebc157bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:23.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.258+0000 7fdec0ae3700 1 -- 172.21.15.57:0/2755709181 shutdown_connections 2023-10-06T03:02:23.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.258+0000 7fdec0ae3700 1 -- 172.21.15.57:0/2755709181 wait complete. 2023-10-06T03:02:23.268 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 23 2023-10-06T03:02:23.286 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:02:23.439 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.434+0000 7f59702ae700 1 Processor -- start 2023-10-06T03:02:23.440 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.434+0000 7f59702ae700 1 -- start start 2023-10-06T03:02:23.442 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.434+0000 7f59702ae700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f59680c7540 0x7f59680c9d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:23.442 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.434+0000 7f59702ae700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59680ca920 con 0x7f5968159470 2023-10-06T03:02:23.442 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.434+0000 7f59702ae700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59680c0e20 con 0x7f59681590a0 2023-10-06T03:02:23.442 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.434+0000 7f59702ae700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59680a9f50 con 0x7f59680c7540 2023-10-06T03:02:23.443 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.438+0000 7f596e84b700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f5968159470 0x7f59680c7c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:59724/0 (socket says 172.21.15.57:59724) 2023-10-06T03:02:23.443 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.438+0000 7f596e84b700 1 -- 172.21.15.57:0/546371876 learned_addr learned my addr 172.21.15.57:0/546371876 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:02:23.443 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.438+0000 7f596d849700 1 --2- 172.21.15.57:0/546371876 >> v2:172.21.15.105:3300/0 conn(0x7f59680c7540 0x7f59680c9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:23.443 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.438+0000 7f596d849700 1 -- 172.21.15.57:0/546371876 >> v1:172.21.15.105:6789/0 conn(0x7f59681590a0 legacy=0x7f59680a9840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:23.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.438+0000 7f596d849700 1 -- 172.21.15.57:0/546371876 >> v1:172.21.15.57:6789/0 conn(0x7f5968159470 legacy=0x7f59680c7c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:23.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.438+0000 7f596d849700 1 -- 172.21.15.57:0/546371876 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59680ca640 con 0x7f59680c7540 2023-10-06T03:02:23.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.438+0000 7f596d849700 1 --2- 172.21.15.57:0/546371876 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f59680c7540 0x7f59680c9d40 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f59580098e0 tx=0x7f59580091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b4c90a1aa24b41ca server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:23.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.438+0000 7f596d048700 1 -- 172.21.15.57:0/546371876 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5958009e80 con 0x7f59680c7540 2023-10-06T03:02:23.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.438+0000 7f596d048700 1 -- 172.21.15.57:0/546371876 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f595800b860 con 0x7f59680c7540 2023-10-06T03:02:23.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.438+0000 7f596d048700 1 -- 172.21.15.57:0/546371876 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f595800bbe0 con 0x7f59680c7540 2023-10-06T03:02:23.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.438+0000 7f59702ae700 1 -- 172.21.15.57:0/546371876 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f59680c7540 msgr2=0x7f59680c9d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:23.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.438+0000 7f59702ae700 1 --2- 172.21.15.57:0/546371876 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f59680c7540 0x7f59680c9d40 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f59580098e0 tx=0x7f59580091a0 comp rx=0 tx=0).stop 2023-10-06T03:02:23.446 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.438+0000 7f59702ae700 1 -- 172.21.15.57:0/546371876 shutdown_connections 2023-10-06T03:02:23.446 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.438+0000 7f59702ae700 1 --2- 172.21.15.57:0/546371876 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f59680c7540 0x7f59680c9d40 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:23.446 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.438+0000 7f59702ae700 1 -- 172.21.15.57:0/546371876 >> 172.21.15.57:0/546371876 conn(0x7f59680cbed0 msgr2=0x7f59680cc2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:23.446 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.438+0000 7f59702ae700 1 -- 172.21.15.57:0/546371876 shutdown_connections 2023-10-06T03:02:23.447 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.442+0000 7f59702ae700 1 -- 172.21.15.57:0/546371876 wait complete. 2023-10-06T03:02:23.449 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.442+0000 7f59702ae700 1 Processor -- start 2023-10-06T03:02:23.450 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.442+0000 7f59702ae700 1 -- start start 2023-10-06T03:02:23.451 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.446+0000 7f59702ae700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f59680c7540 0x7f596814ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:23.452 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.446+0000 7f59702ae700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f59681590a0 0x7f59680aec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:23.452 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.446+0000 7f59702ae700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5968159470 0x7f59680af1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:23.452 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.446+0000 7f59702ae700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59681720a0 con 0x7f5968159470 2023-10-06T03:02:23.452 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.446+0000 7f59702ae700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f596806e4b0 con 0x7f59680c7540 2023-10-06T03:02:23.452 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.446+0000 7f59702ae700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f596806d8a0 con 0x7f59681590a0 2023-10-06T03:02:23.453 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.446+0000 7f596e84b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5968159470 0x7f59680af1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:23.453 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.446+0000 7f596e84b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5968159470 0x7f59680af1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43208/0 (socket says 172.21.15.57:43208) 2023-10-06T03:02:23.453 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.446+0000 7f596e84b700 1 -- 172.21.15.57:0/2296100068 learned_addr learned my addr 172.21.15.57:0/2296100068 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:02:23.453 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.446+0000 7f596d849700 1 --2- 172.21.15.57:0/2296100068 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f59681590a0 0x7f59680aec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:23.453 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.446+0000 7f596e04a700 1 --2- 172.21.15.57:0/2296100068 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f59680c7540 0x7f596814ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:23.454 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.446+0000 7f596e84b700 1 -- 172.21.15.57:0/2296100068 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f59681590a0 msgr2=0x7f59680aec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:23.454 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.446+0000 7f596e84b700 1 --2- 172.21.15.57:0/2296100068 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f59681590a0 0x7f59680aec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:23.454 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.446+0000 7f596e84b700 1 -- 172.21.15.57:0/2296100068 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f59680c7540 msgr2=0x7f596814ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:23.454 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.446+0000 7f596e84b700 1 --2- 172.21.15.57:0/2296100068 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f59680c7540 0x7f596814ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:23.454 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.446+0000 7f596e84b700 1 -- 172.21.15.57:0/2296100068 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5958009420 con 0x7f5968159470 2023-10-06T03:02:23.454 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.446+0000 7f596e84b700 1 --2- 172.21.15.57:0/2296100068 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5968159470 0x7f59680af1d0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f596000cbc0 tx=0x7f59600019c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:23.455 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.446+0000 7f595e7fc700 1 -- 172.21.15.57:0/2296100068 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f596000a7e0 con 0x7f5968159470 2023-10-06T03:02:23.455 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.446+0000 7f595e7fc700 1 -- 172.21.15.57:0/2296100068 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f596000a940 con 0x7f5968159470 2023-10-06T03:02:23.455 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.446+0000 7f595e7fc700 1 -- 172.21.15.57:0/2296100068 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f596000acc0 con 0x7f5968159470 2023-10-06T03:02:23.455 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.446+0000 7f59702ae700 1 -- 172.21.15.57:0/2296100068 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f596806db80 con 0x7f5968159470 2023-10-06T03:02:23.455 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.450+0000 7f59702ae700 1 -- 172.21.15.57:0/2296100068 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f596806e140 con 0x7f5968159470 2023-10-06T03:02:23.456 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.450+0000 7f59702ae700 1 -- 172.21.15.57:0/2296100068 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f596806e620 con 0x7f5968159470 2023-10-06T03:02:23.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.450+0000 7f595e7fc700 1 -- 172.21.15.57:0/2296100068 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f5960007300 con 0x7f5968159470 2023-10-06T03:02:23.459 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.454+0000 7f595e7fc700 1 --2- 172.21.15.57:0/2296100068 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f594c060550 0x7f594c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:23.460 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.454+0000 7f595e7fc700 1 -- 172.21.15.57:0/2296100068 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6144+0+0 (secure 0 0 0) 0x7f596007cc40 con 0x7f5968159470 2023-10-06T03:02:23.460 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.454+0000 7f596e04a700 1 --2- 172.21.15.57:0/2296100068 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f594c060550 0x7f594c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:23.461 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.454+0000 7f596e04a700 1 --2- 172.21.15.57:0/2296100068 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f594c060550 0x7f594c062a00 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5964007fd0 tx=0x7f5964007eb0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:23.466 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.458+0000 7f595e7fc700 1 -- 172.21.15.57:0/2296100068 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f596004d080 con 0x7f5968159470 2023-10-06T03:02:23.641 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.634+0000 7f59702ae700 1 -- 172.21.15.57:0/2296100068 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f59680c1070 con 0x7f5968159470 2023-10-06T03:02:23.643 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.638+0000 7f595e7fc700 1 -- 172.21.15.57:0/2296100068 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+16997 (secure 0 0 0) 0x7f59600506a0 con 0x7f5968159470 2023-10-06T03:02:23.644 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:02:23.644 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":39,"fsid":"eb56dc0f-9213-41cb-9aad-8ade6c802e98","created":"2023-10-06T03:00:30.806197+0000","modified":"2023-10-06T03:01:55.806234+0000","last_up_change":"2023-10-06T03:00:43.607454+0000","last_in_change":"2023-10-06T03:00:33.943513+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T03:00:44.360651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T03:00:50.466601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:01:45.068952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-10-06T03:01:46.357714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"58cf6c90-d704-43e0-b2db-dffe526d5e8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":33053},{"type":"v1","addr":"172.21.15.57:6801","nonce":33053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":33053},{"type":"v1","addr":"172.21.15.57:6803","nonce":33053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":33053},{"type":"v1","addr":"172.21.15.57:6807","nonce":33053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":33053},{"type":"v1","addr":"172.21.15.57:6805","nonce":33053}]},"public_addr":"172.21.15.57:6801/33053","cluster_addr":"172.21.15.57:6803/33053","heartbeat_back_addr":"172.21.15.57:6807/33053","heartbeat_front_addr":"172.21.15.57:6805/33053","state":["exists","up"]},{"osd":1,"uuid":"16afbe70-7f9e-4568-9c92-763e6e348119","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6809","nonce":33052},{"type":"v1","addr":"172.21.15.57:6810","nonce":33052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":33052},{"type":"v1","addr":"172.21.15.57:6813","nonce":33052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":33052},{"type":"v1","addr":"172.21.15.57:6822","nonce":33052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6815","nonce":33052},{"type":"v1","addr":"172.21.15.57:6818","nonce":33052}]},"public_addr":"172.21.15.57:6810/33052","cluster_addr":"172.21.15.57:6813/33052","heartbeat_back_addr":"172.21.15.57:6822/33052","heartbeat_front_addr":"172.21.15.57:6818/33052","state":["exists","up"]},{"osd":2,"uuid":"7255c62e-f92f-470f-a5ce-30228920d9f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":33058},{"type":"v1","addr":"172.21.15.57:6825","nonce":33058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":33058},{"type":"v1","addr":"172.21.15.57:6827","nonce":33058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":33058},{"type":"v1","addr":"172.21.15.57:6831","nonce":33058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":33058},{"type":"v1","addr":"172.21.15.57:6829","nonce":33058}]},"public_addr":"172.21.15.57:6825/33058","cluster_addr":"172.21.15.57:6827/33058","heartbeat_back_addr":"172.21.15.57:6831/33058","heartbeat_front_addr":"172.21.15.57:6829/33058","state":["exists","up"]},{"osd":3,"uuid":"152a236d-f799-4888-8544-74865508d5a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":33057},{"type":"v1","addr":"172.21.15.57:6811","nonce":33057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":33057},{"type":"v1","addr":"172.21.15.57:6816","nonce":33057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6821","nonce":33057},{"type":"v1","addr":"172.21.15.57:6823","nonce":33057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6817","nonce":33057},{"type":"v1","addr":"172.21.15.57:6819","nonce":33057}]},"public_addr":"172.21.15.57:6811/33057","cluster_addr":"172.21.15.57:6816/33057","heartbeat_back_addr":"172.21.15.57:6823/33057","heartbeat_front_addr":"172.21.15.57:6819/33057","state":["exists","up"]},{"osd":4,"uuid":"37db2a65-3566-41d0-9d60-e66c49e1e68e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":33368},{"type":"v1","addr":"172.21.15.105:6801","nonce":33368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":33368},{"type":"v1","addr":"172.21.15.105:6803","nonce":33368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":33368},{"type":"v1","addr":"172.21.15.105:6807","nonce":33368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":33368},{"type":"v1","addr":"172.21.15.105:6805","nonce":33368}]},"public_addr":"172.21.15.105:6801/33368","cluster_addr":"172.21.15.105:6803/33368","heartbeat_back_addr":"172.21.15.105:6807/33368","heartbeat_front_addr":"172.21.15.105:6805/33368","state":["exists","up"]},{"osd":5,"uuid":"35e77918-1bb4-42ca-9b20-f3c14eaa0c04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":33379},{"type":"v1","addr":"172.21.15.105:6818","nonce":33379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":33379},{"type":"v1","addr":"172.21.15.105:6823","nonce":33379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":33379},{"type":"v1","addr":"172.21.15.105:6831","nonce":33379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":33379},{"type":"v1","addr":"172.21.15.105:6827","nonce":33379}]},"public_addr":"172.21.15.105:6818/33379","cluster_addr":"172.21.15.105:6823/33379","heartbeat_back_addr":"172.21.15.105:6831/33379","heartbeat_front_addr":"172.21.15.105:6827/33379","state":["exists","up"]},{"osd":6,"uuid":"b4d9d510-7a45-4173-8287-c6c8d6547f2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":33369},{"type":"v1","addr":"172.21.15.105:6819","nonce":33369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":33369},{"type":"v1","addr":"172.21.15.105:6822","nonce":33369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":33369},{"type":"v1","addr":"172.21.15.105:6830","nonce":33369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":33369},{"type":"v1","addr":"172.21.15.105:6826","nonce":33369}]},"public_addr":"172.21.15.105:6819/33369","cluster_addr":"172.21.15.105:6822/33369","heartbeat_back_addr":"172.21.15.105:6830/33369","heartbeat_front_addr":"172.21.15.105:6826/33369","state":["exists","up"]},{"osd":7,"uuid":"74266fb0-cd84-463f-8bf0-092652a71dc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":33370},{"type":"v1","addr":"172.21.15.105:6809","nonce":33370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":33370},{"type":"v1","addr":"172.21.15.105:6811","nonce":33370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":33370},{"type":"v1","addr":"172.21.15.105:6815","nonce":33370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":33370},{"type":"v1","addr":"172.21.15.105:6813","nonce":33370}]},"public_addr":"172.21.15.105:6809/33370","cluster_addr":"172.21.15.105:6811/33370","heartbeat_back_addr":"172.21.15.105:6815/33370","heartbeat_front_addr":"172.21.15.105:6813/33370","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.596864+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.633851+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.636993+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.529681+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.608601+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.659752+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.661717+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.642221+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.105:6834/1325054263":"2023-10-07T03:01:55.780023+0000","172.21.15.105:6832/1325054263":"2023-10-07T03:01:55.780023+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:02:23.647 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.638+0000 7f59702ae700 1 -- 172.21.15.57:0/2296100068 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f594c060550 msgr2=0x7f594c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:23.647 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.638+0000 7f59702ae700 1 --2- 172.21.15.57:0/2296100068 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f594c060550 0x7f594c062a00 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5964007fd0 tx=0x7f5964007eb0 comp rx=0 tx=0).stop 2023-10-06T03:02:23.647 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.638+0000 7f59702ae700 1 -- 172.21.15.57:0/2296100068 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5968159470 msgr2=0x7f59680af1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:23.647 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.638+0000 7f59702ae700 1 --2- 172.21.15.57:0/2296100068 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5968159470 0x7f59680af1d0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f596000cbc0 tx=0x7f59600019c0 comp rx=0 tx=0).stop 2023-10-06T03:02:23.647 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.642+0000 7f59702ae700 1 -- 172.21.15.57:0/2296100068 shutdown_connections 2023-10-06T03:02:23.647 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.642+0000 7f59702ae700 1 --2- 172.21.15.57:0/2296100068 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5968159470 0x7f59680af1d0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:23.647 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.642+0000 7f59702ae700 1 --2- 172.21.15.57:0/2296100068 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f594c060550 0x7f594c062a00 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:23.647 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.642+0000 7f59702ae700 1 --2- 172.21.15.57:0/2296100068 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f59681590a0 0x7f59680aec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:23.647 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.642+0000 7f59702ae700 1 --2- 172.21.15.57:0/2296100068 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f59680c7540 0x7f596814ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:23.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.642+0000 7f59702ae700 1 -- 172.21.15.57:0/2296100068 >> 172.21.15.57:0/2296100068 conn(0x7f59680cbed0 msgr2=0x7f59680c8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:23.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.642+0000 7f59702ae700 1 -- 172.21.15.57:0/2296100068 shutdown_connections 2023-10-06T03:02:23.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.642+0000 7f59702ae700 1 -- 172.21.15.57:0/2296100068 wait complete. 2023-10-06T03:02:23.667 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T03:00:44.360651+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T03:00:50.466601+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T03:01:45.068952+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T03:01:46.357714+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T03:02:23.667 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T03:02:23.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.830+0000 7fc476ea5700 1 Processor -- start 2023-10-06T03:02:23.837 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.830+0000 7fc476ea5700 1 -- start start 2023-10-06T03:02:23.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.834+0000 7fc476ea5700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc470159220 0x7fc4700b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:23.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.834+0000 7fc476ea5700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fc4700b3510 0x7fc4700ccce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:23.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.834+0000 7fc476ea5700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4700cab00 con 0x7fc4701595f0 2023-10-06T03:02:23.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.834+0000 7fc476ea5700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4700cba50 con 0x7fc4700b3510 2023-10-06T03:02:23.841 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.834+0000 7fc476ea5700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4700cc850 con 0x7fc470159220 2023-10-06T03:02:23.841 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.834+0000 7fc474c41700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc470159220 0x7fc4700b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:23.841 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.834+0000 7fc46ffff700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fc4700b3510 0x7fc4700ccce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:23.841 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.834+0000 7fc475442700 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7fc4701595f0 0x7fc4700afde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.57:41116/0 (socket says 172.21.15.57:41116) 2023-10-06T03:02:23.842 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.834+0000 7fc475442700 1 -- 172.21.15.57:0/1650174207 learned_addr learned my addr 172.21.15.57:0/1650174207 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:02:23.842 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.834+0000 7fc46f7fe700 1 -- 172.21.15.57:0/1650174207 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2622822484 0 0) 0x7fc4700cab00 con 0x7fc4701595f0 2023-10-06T03:02:23.842 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.834+0000 7fc46f7fe700 1 -- 172.21.15.57:0/1650174207 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc458003570 con 0x7fc4701595f0 2023-10-06T03:02:23.843 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.834+0000 7fc46ffff700 1 -- 172.21.15.57:0/1650174207 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc470159220 msgr2=0x7fc4700b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:23.843 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.834+0000 7fc46ffff700 1 --2- 172.21.15.57:0/1650174207 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc470159220 0x7fc4700b2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:23.843 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.834+0000 7fc46ffff700 1 -- 172.21.15.57:0/1650174207 >> v1:172.21.15.105:6789/0 conn(0x7fc4701595f0 legacy=0x7fc4700afde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:23.843 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.834+0000 7fc46ffff700 1 -- 172.21.15.57:0/1650174207 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4700cbc40 con 0x7fc4700b3510 2023-10-06T03:02:23.843 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.838+0000 7fc46ffff700 1 --2- 172.21.15.57:0/1650174207 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc4700b3510 0x7fc4700ccce0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc4600098e0 tx=0x7fc4600091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5c91ff7df7f2b9f9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:23.844 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.838+0000 7fc46f7fe700 1 -- 172.21.15.57:0/1650174207 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc460011630 con 0x7fc4700b3510 2023-10-06T03:02:23.844 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.838+0000 7fc46f7fe700 1 -- 172.21.15.57:0/1650174207 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc460011790 con 0x7fc4700b3510 2023-10-06T03:02:23.844 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.838+0000 7fc46f7fe700 1 -- 172.21.15.57:0/1650174207 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc460011b30 con 0x7fc4700b3510 2023-10-06T03:02:23.845 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.838+0000 7fc476ea5700 1 -- 172.21.15.57:0/1650174207 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc4700b3510 msgr2=0x7fc4700ccce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:23.845 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.838+0000 7fc476ea5700 1 --2- 172.21.15.57:0/1650174207 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc4700b3510 0x7fc4700ccce0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc4600098e0 tx=0x7fc4600091a0 comp rx=0 tx=0).stop 2023-10-06T03:02:23.845 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.838+0000 7fc476ea5700 1 -- 172.21.15.57:0/1650174207 shutdown_connections 2023-10-06T03:02:23.845 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.838+0000 7fc476ea5700 1 --2- 172.21.15.57:0/1650174207 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc4700b3510 0x7fc4700ccce0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:23.846 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.838+0000 7fc476ea5700 1 --2- 172.21.15.57:0/1650174207 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc470159220 0x7fc4700b2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:23.846 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.838+0000 7fc476ea5700 1 -- 172.21.15.57:0/1650174207 >> 172.21.15.57:0/1650174207 conn(0x7fc47006e760 msgr2=0x7fc47006eb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:23.846 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.838+0000 7fc476ea5700 1 -- 172.21.15.57:0/1650174207 shutdown_connections 2023-10-06T03:02:23.846 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.838+0000 7fc476ea5700 1 -- 172.21.15.57:0/1650174207 wait complete. 2023-10-06T03:02:23.847 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.842+0000 7fc476ea5700 1 Processor -- start 2023-10-06T03:02:23.848 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.842+0000 7fc476ea5700 1 -- start start 2023-10-06T03:02:23.850 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.842+0000 7fc476ea5700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc4700b3510 0x7fc47016a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:23.850 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.842+0000 7fc476ea5700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc470159220 0x7fc47015e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:23.850 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.842+0000 7fc476ea5700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc4701595f0 0x7fc4700cdd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:23.850 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.842+0000 7fc476ea5700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4700ce270 con 0x7fc4701595f0 2023-10-06T03:02:23.850 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.842+0000 7fc476ea5700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc47015d0d0 con 0x7fc470159220 2023-10-06T03:02:23.851 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.842+0000 7fc476ea5700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc47015d3b0 con 0x7fc4700b3510 2023-10-06T03:02:23.851 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.842+0000 7fc475442700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc4701595f0 0x7fc4700cdd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:23.851 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.842+0000 7fc475442700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc4701595f0 0x7fc4700cdd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43212/0 (socket says 172.21.15.57:43212) 2023-10-06T03:02:23.851 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.842+0000 7fc475442700 1 -- 172.21.15.57:0/148028630 learned_addr learned my addr 172.21.15.57:0/148028630 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:02:23.851 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.842+0000 7fc474c41700 1 --2- 172.21.15.57:0/148028630 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc4700b3510 0x7fc47016a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:23.851 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.846+0000 7fc46ffff700 1 --2- 172.21.15.57:0/148028630 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc470159220 0x7fc47015e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:23.852 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.846+0000 7fc475442700 1 -- 172.21.15.57:0/148028630 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc4700b3510 msgr2=0x7fc47016a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:23.852 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.846+0000 7fc475442700 1 --2- 172.21.15.57:0/148028630 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc4700b3510 0x7fc47016a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:23.852 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.846+0000 7fc475442700 1 -- 172.21.15.57:0/148028630 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc470159220 msgr2=0x7fc47015e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:23.852 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.846+0000 7fc475442700 1 --2- 172.21.15.57:0/148028630 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc470159220 0x7fc47015e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:23.852 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.846+0000 7fc475442700 1 -- 172.21.15.57:0/148028630 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc460009420 con 0x7fc4701595f0 2023-10-06T03:02:23.852 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.846+0000 7fc475442700 1 --2- 172.21.15.57:0/148028630 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc4701595f0 0x7fc4700cdd30 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fc46800cc40 tx=0x7fc468001aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:23.853 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.846+0000 7fc46cff9700 1 -- 172.21.15.57:0/148028630 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc46800a8b0 con 0x7fc4701595f0 2023-10-06T03:02:23.853 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.846+0000 7fc46cff9700 1 -- 172.21.15.57:0/148028630 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc46800aa10 con 0x7fc4701595f0 2023-10-06T03:02:23.853 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.846+0000 7fc476ea5700 1 -- 172.21.15.57:0/148028630 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc47015d690 con 0x7fc4701595f0 2023-10-06T03:02:23.853 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.846+0000 7fc46cff9700 1 -- 172.21.15.57:0/148028630 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc46800ad90 con 0x7fc4701595f0 2023-10-06T03:02:23.853 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.846+0000 7fc476ea5700 1 -- 172.21.15.57:0/148028630 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc47015dc50 con 0x7fc4701595f0 2023-10-06T03:02:23.854 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.850+0000 7fc476ea5700 1 -- 172.21.15.57:0/148028630 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc470088b30 con 0x7fc4701595f0 2023-10-06T03:02:23.856 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.850+0000 7fc46cff9700 1 -- 172.21.15.57:0/148028630 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fc468007300 con 0x7fc4701595f0 2023-10-06T03:02:23.857 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.850+0000 7fc46cff9700 1 --2- 172.21.15.57:0/148028630 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fc45c060550 0x7fc45c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:23.858 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.850+0000 7fc46cff9700 1 -- 172.21.15.57:0/148028630 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6144+0+0 (secure 0 0 0) 0x7fc46807cd50 con 0x7fc4701595f0 2023-10-06T03:02:23.858 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.850+0000 7fc474c41700 1 --2- 172.21.15.57:0/148028630 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fc45c060550 0x7fc45c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:23.859 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.854+0000 7fc474c41700 1 --2- 172.21.15.57:0/148028630 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fc45c060550 0x7fc45c062a00 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc4700c6350 tx=0x7fc4640091a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:23.862 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:23.858+0000 7fc46cff9700 1 -- 172.21.15.57:0/148028630 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fc46804d190 con 0x7fc4701595f0 2023-10-06T03:02:24.033 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.026+0000 7fc476ea5700 1 -- 172.21.15.57:0/148028630 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc47015de40 con 0x7fc4701595f0 2023-10-06T03:02:24.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.026+0000 7fc46cff9700 1 -- 172.21.15.57:0/148028630 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v39) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc4680507b0 con 0x7fc4701595f0 2023-10-06T03:02:24.034 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2023-10-06T03:02:24.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.034+0000 7fc476ea5700 1 -- 172.21.15.57:0/148028630 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fc45c060550 msgr2=0x7fc45c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:24.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.034+0000 7fc476ea5700 1 --2- 172.21.15.57:0/148028630 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fc45c060550 0x7fc45c062a00 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc4700c6350 tx=0x7fc4640091a0 comp rx=0 tx=0).stop 2023-10-06T03:02:24.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.034+0000 7fc476ea5700 1 -- 172.21.15.57:0/148028630 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc4701595f0 msgr2=0x7fc4700cdd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:24.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.034+0000 7fc476ea5700 1 --2- 172.21.15.57:0/148028630 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc4701595f0 0x7fc4700cdd30 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fc46800cc40 tx=0x7fc468001aa0 comp rx=0 tx=0).stop 2023-10-06T03:02:24.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.034+0000 7fc476ea5700 1 -- 172.21.15.57:0/148028630 shutdown_connections 2023-10-06T03:02:24.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.034+0000 7fc476ea5700 1 --2- 172.21.15.57:0/148028630 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc4701595f0 0x7fc4700cdd30 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:24.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.034+0000 7fc476ea5700 1 --2- 172.21.15.57:0/148028630 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc470159220 0x7fc47015e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:24.040 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.034+0000 7fc476ea5700 1 --2- 172.21.15.57:0/148028630 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fc45c060550 0x7fc45c062a00 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:24.040 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.034+0000 7fc476ea5700 1 --2- 172.21.15.57:0/148028630 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc4700b3510 0x7fc47016a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:24.040 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.034+0000 7fc476ea5700 1 -- 172.21.15.57:0/148028630 >> 172.21.15.57:0/148028630 conn(0x7fc47006e760 msgr2=0x7fc4700c72a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:24.040 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.034+0000 7fc476ea5700 1 -- 172.21.15.57:0/148028630 shutdown_connections 2023-10-06T03:02:24.040 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.034+0000 7fc476ea5700 1 -- 172.21.15.57:0/148028630 wait complete. 2023-10-06T03:02:24.061 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T03:02:24.223 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.218+0000 7f5e11585700 1 Processor -- start 2023-10-06T03:02:24.223 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.218+0000 7f5e11585700 1 -- start start 2023-10-06T03:02:24.227 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.222+0000 7f5e11585700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f5e0c1594b0 0x7f5e0c0c66f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:24.227 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.222+0000 7f5e11585700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5e0c0c6c30 0x7f5e0c0cde50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:24.227 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.222+0000 7f5e11585700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e0c0c5b50 con 0x7f5e0c1590e0 2023-10-06T03:02:24.227 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.222+0000 7f5e11585700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e0c0c4f40 con 0x7f5e0c1594b0 2023-10-06T03:02:24.227 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.222+0000 7f5e11585700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e0c0c5220 con 0x7f5e0c0c6c30 2023-10-06T03:02:24.228 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.222+0000 7f5e0affd700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f5e0c1590e0 0x7f5e0c0c5fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:59730/0 (socket says 172.21.15.57:59730) 2023-10-06T03:02:24.228 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.222+0000 7f5e0affd700 1 -- 172.21.15.57:0/3332702419 learned_addr learned my addr 172.21.15.57:0/3332702419 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:02:24.228 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.222+0000 7f5e0a7fc700 1 --2- 172.21.15.57:0/3332702419 >> v2:172.21.15.105:3300/0 conn(0x7f5e0c1594b0 0x7f5e0c0c66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:24.228 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.222+0000 7f5e0b7fe700 1 --2- 172.21.15.57:0/3332702419 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5e0c0c6c30 0x7f5e0c0cde50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:24.228 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.222+0000 7f5e09ffb700 1 -- 172.21.15.57:0/3332702419 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1468011703 0 0) 0x7f5e0c0c5b50 con 0x7f5e0c1590e0 2023-10-06T03:02:24.229 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.222+0000 7f5e09ffb700 1 -- 172.21.15.57:0/3332702419 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5df4003570 con 0x7f5e0c1590e0 2023-10-06T03:02:24.229 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.222+0000 7f5e0a7fc700 1 -- 172.21.15.57:0/3332702419 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5e0c0c6c30 msgr2=0x7f5e0c0cde50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:24.229 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.222+0000 7f5e0a7fc700 1 --2- 172.21.15.57:0/3332702419 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5e0c0c6c30 0x7f5e0c0cde50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:24.229 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.222+0000 7f5e0a7fc700 1 -- 172.21.15.57:0/3332702419 >> v1:172.21.15.57:6789/0 conn(0x7f5e0c1590e0 legacy=0x7f5e0c0c5fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:24.229 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.222+0000 7f5e0a7fc700 1 -- 172.21.15.57:0/3332702419 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e0c0c5500 con 0x7f5e0c1594b0 2023-10-06T03:02:24.229 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.222+0000 7f5e0a7fc700 1 --2- 172.21.15.57:0/3332702419 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5e0c1594b0 0x7f5e0c0c66f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5e000098e0 tx=0x7f5e000091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=12acf512e767e54d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:24.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.222+0000 7f5e09ffb700 1 -- 172.21.15.57:0/3332702419 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e00011630 con 0x7f5e0c1594b0 2023-10-06T03:02:24.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.222+0000 7f5e09ffb700 1 -- 172.21.15.57:0/3332702419 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e00011790 con 0x7f5e0c1594b0 2023-10-06T03:02:24.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.222+0000 7f5e09ffb700 1 -- 172.21.15.57:0/3332702419 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e00011b30 con 0x7f5e0c1594b0 2023-10-06T03:02:24.231 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.226+0000 7f5e11585700 1 -- 172.21.15.57:0/3332702419 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5e0c1594b0 msgr2=0x7f5e0c0c66f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:24.231 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.226+0000 7f5e11585700 1 --2- 172.21.15.57:0/3332702419 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5e0c1594b0 0x7f5e0c0c66f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5e000098e0 tx=0x7f5e000091a0 comp rx=0 tx=0).stop 2023-10-06T03:02:24.231 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.226+0000 7f5e11585700 1 -- 172.21.15.57:0/3332702419 shutdown_connections 2023-10-06T03:02:24.231 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.226+0000 7f5e11585700 1 --2- 172.21.15.57:0/3332702419 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5e0c0c6c30 0x7f5e0c0cde50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:24.231 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.226+0000 7f5e11585700 1 --2- 172.21.15.57:0/3332702419 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5e0c1594b0 0x7f5e0c0c66f0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:24.231 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.226+0000 7f5e11585700 1 -- 172.21.15.57:0/3332702419 >> 172.21.15.57:0/3332702419 conn(0x7f5e0c06ef40 msgr2=0x7f5e0c0d0070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:24.232 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.226+0000 7f5e11585700 1 -- 172.21.15.57:0/3332702419 shutdown_connections 2023-10-06T03:02:24.232 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.226+0000 7f5e11585700 1 -- 172.21.15.57:0/3332702419 wait complete. 2023-10-06T03:02:24.235 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.230+0000 7f5e11585700 1 Processor -- start 2023-10-06T03:02:24.235 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.230+0000 7f5e11585700 1 -- start start 2023-10-06T03:02:24.236 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.230+0000 7f5e11585700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5e0c0c6c30 0x7f5e0c0c7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:24.237 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.230+0000 7f5e11585700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5e0c1590e0 0x7f5e0c0c8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:24.237 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.230+0000 7f5e11585700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5e0c1594b0 0x7f5e0c154180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:24.237 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.230+0000 7f5e11585700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e0c15e980 con 0x7f5e0c1590e0 2023-10-06T03:02:24.237 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.230+0000 7f5e11585700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e0c0c90c0 con 0x7f5e0c1594b0 2023-10-06T03:02:24.237 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.230+0000 7f5e11585700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e0c1549d0 con 0x7f5e0c0c6c30 2023-10-06T03:02:24.238 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.230+0000 7f5e0a7fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5e0c1590e0 0x7f5e0c0c8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:24.238 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.230+0000 7f5e0a7fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5e0c1590e0 0x7f5e0c0c8b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43228/0 (socket says 172.21.15.57:43228) 2023-10-06T03:02:24.238 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.230+0000 7f5e0a7fc700 1 -- 172.21.15.57:0/1668601426 learned_addr learned my addr 172.21.15.57:0/1668601426 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:02:24.238 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.230+0000 7f5e0b7fe700 1 --2- 172.21.15.57:0/1668601426 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5e0c1594b0 0x7f5e0c154180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:24.238 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.230+0000 7f5e0affd700 1 --2- 172.21.15.57:0/1668601426 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5e0c0c6c30 0x7f5e0c0c7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:24.239 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.230+0000 7f5e0b7fe700 1 -- 172.21.15.57:0/1668601426 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5e0c0c6c30 msgr2=0x7f5e0c0c7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:24.239 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.230+0000 7f5e0b7fe700 1 --2- 172.21.15.57:0/1668601426 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5e0c0c6c30 0x7f5e0c0c7120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:24.239 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.230+0000 7f5e0b7fe700 1 -- 172.21.15.57:0/1668601426 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5e0c1590e0 msgr2=0x7f5e0c0c8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:24.239 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.230+0000 7f5e0b7fe700 1 --2- 172.21.15.57:0/1668601426 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5e0c1590e0 0x7f5e0c0c8b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:24.239 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.230+0000 7f5e0b7fe700 1 -- 172.21.15.57:0/1668601426 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e00009420 con 0x7f5e0c1594b0 2023-10-06T03:02:24.239 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.230+0000 7f5e0a7fc700 1 --2- 172.21.15.57:0/1668601426 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5e0c1590e0 0x7f5e0c0c8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:02:24.239 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.234+0000 7f5e0b7fe700 1 --2- 172.21.15.57:0/1668601426 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5e0c1594b0 0x7f5e0c154180 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f5e04009e50 tx=0x7f5e0400b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:24.240 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.234+0000 7f5df2ffd700 1 -- 172.21.15.57:0/1668601426 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e0400caa0 con 0x7f5e0c1594b0 2023-10-06T03:02:24.240 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.234+0000 7f5df2ffd700 1 -- 172.21.15.57:0/1668601426 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e0400f040 con 0x7f5e0c1594b0 2023-10-06T03:02:24.240 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.234+0000 7f5e11585700 1 -- 172.21.15.57:0/1668601426 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e0c15e330 con 0x7f5e0c1594b0 2023-10-06T03:02:24.240 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.234+0000 7f5df2ffd700 1 -- 172.21.15.57:0/1668601426 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e0400ce50 con 0x7f5e0c1594b0 2023-10-06T03:02:24.240 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.234+0000 7f5e11585700 1 -- 172.21.15.57:0/1668601426 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e0c1546c0 con 0x7f5e0c1594b0 2023-10-06T03:02:24.242 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.234+0000 7f5e11585700 1 -- 172.21.15.57:0/1668601426 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e0c15eb30 con 0x7f5e0c1594b0 2023-10-06T03:02:24.244 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.238+0000 7f5df2ffd700 1 -- 172.21.15.57:0/1668601426 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f5e04014690 con 0x7f5e0c1594b0 2023-10-06T03:02:24.246 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.238+0000 7f5df2ffd700 1 --2- 172.21.15.57:0/1668601426 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f5df8060550 0x7f5df8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:24.246 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.238+0000 7f5df2ffd700 1 -- 172.21.15.57:0/1668601426 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6144+0+0 (secure 0 0 0) 0x7f5e0407d530 con 0x7f5e0c1594b0 2023-10-06T03:02:24.246 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.238+0000 7f5e0affd700 1 --2- 172.21.15.57:0/1668601426 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f5df8060550 0x7f5df8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:24.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.242+0000 7f5e0affd700 1 --2- 172.21.15.57:0/1668601426 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f5df8060550 0x7f5df8062a00 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc001360 tx=0x7f5dfc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:24.253 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.246+0000 7f5df2ffd700 1 -- 172.21.15.57:0/1668601426 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f5e04051380 con 0x7f5e0c1594b0 2023-10-06T03:02:24.427 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.422+0000 7f5e11585700 1 -- 172.21.15.57:0/1668601426 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f5e0c0645e0 con 0x7f5e0c1594b0 2023-10-06T03:02:24.428 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.422+0000 7f5df2ffd700 1 -- 172.21.15.57:0/1668601426 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v39) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5e04050f10 con 0x7f5e0c1594b0 2023-10-06T03:02:24.428 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2023-10-06T03:02:24.431 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.422+0000 7f5e11585700 1 -- 172.21.15.57:0/1668601426 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f5df8060550 msgr2=0x7f5df8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:24.431 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.422+0000 7f5e11585700 1 --2- 172.21.15.57:0/1668601426 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f5df8060550 0x7f5df8062a00 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc001360 tx=0x7f5dfc009040 comp rx=0 tx=0).stop 2023-10-06T03:02:24.431 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.422+0000 7f5e11585700 1 -- 172.21.15.57:0/1668601426 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5e0c1594b0 msgr2=0x7f5e0c154180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:24.431 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.422+0000 7f5e11585700 1 --2- 172.21.15.57:0/1668601426 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5e0c1594b0 0x7f5e0c154180 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f5e04009e50 tx=0x7f5e0400b040 comp rx=0 tx=0).stop 2023-10-06T03:02:24.431 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.426+0000 7f5e11585700 1 -- 172.21.15.57:0/1668601426 shutdown_connections 2023-10-06T03:02:24.431 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.426+0000 7f5e11585700 1 --2- 172.21.15.57:0/1668601426 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5e0c1594b0 0x7f5e0c154180 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:24.431 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.426+0000 7f5e11585700 1 --2- 172.21.15.57:0/1668601426 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5e0c1590e0 0x7f5e0c0c8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:24.431 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.426+0000 7f5e11585700 1 --2- 172.21.15.57:0/1668601426 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f5df8060550 0x7f5df8062a00 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:24.432 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.426+0000 7f5e11585700 1 --2- 172.21.15.57:0/1668601426 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5e0c0c6c30 0x7f5e0c0c7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:24.432 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.426+0000 7f5e11585700 1 -- 172.21.15.57:0/1668601426 >> 172.21.15.57:0/1668601426 conn(0x7f5e0c06ef40 msgr2=0x7f5e0c156540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:24.432 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.426+0000 7f5e11585700 1 -- 172.21.15.57:0/1668601426 shutdown_connections 2023-10-06T03:02:24.432 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.426+0000 7f5e11585700 1 -- 172.21.15.57:0/1668601426 wait complete. 2023-10-06T03:02:24.450 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T03:02:24.616 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.610+0000 7fafb7af0700 1 Processor -- start 2023-10-06T03:02:24.617 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.610+0000 7fafb7af0700 1 -- start start 2023-10-06T03:02:24.620 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.614+0000 7fafb7af0700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fafb015cfe0 0x7fafb00ce020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:24.621 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.614+0000 7fafb7af0700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fafb0159510 0x7fafb0159990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:24.621 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.614+0000 7fafb7af0700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafb00cc3d0 con 0x7fafb015d3b0 2023-10-06T03:02:24.621 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.614+0000 7fafb7af0700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafb00cf900 con 0x7fafb015cfe0 2023-10-06T03:02:24.621 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.614+0000 7fafb7af0700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafb00caf70 con 0x7fafb0159510 2023-10-06T03:02:24.621 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.614+0000 7fafb588c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fafb015cfe0 0x7fafb00ce020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:24.621 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.614+0000 7fafb588c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fafb015cfe0 0x7fafb00ce020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:49776/0 (socket says 172.21.15.57:49776) 2023-10-06T03:02:24.621 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.614+0000 7fafb588c700 1 -- 172.21.15.57:0/1870524857 learned_addr learned my addr 172.21.15.57:0/1870524857 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:02:24.622 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.614+0000 7fafb608d700 1 --2- 172.21.15.57:0/1870524857 >> v2:172.21.15.105:3300/0 conn(0x7fafb0159510 0x7fafb0159990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:24.622 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.614+0000 7fafb588c700 1 -- 172.21.15.57:0/1870524857 >> v2:172.21.15.105:3300/0 conn(0x7fafb0159510 msgr2=0x7fafb0159990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:24.623 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.614+0000 7fafb588c700 1 --2- 172.21.15.57:0/1870524857 >> v2:172.21.15.105:3300/0 conn(0x7fafb0159510 0x7fafb0159990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:24.623 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.614+0000 7fafb588c700 1 -- 172.21.15.57:0/1870524857 >> v1:172.21.15.57:6789/0 conn(0x7fafb015d3b0 legacy=0x7fafb015d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:24.623 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.614+0000 7fafb588c700 1 -- 172.21.15.57:0/1870524857 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafb00ce870 con 0x7fafb015cfe0 2023-10-06T03:02:24.623 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.614+0000 7fafb588c700 1 --2- 172.21.15.57:0/1870524857 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fafb015cfe0 0x7fafb00ce020 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fafb0067940 tx=0x7fafac009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59c815ca56fe4eba server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:24.623 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.618+0000 7fafb488a700 1 -- 172.21.15.57:0/1870524857 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafac005c10 con 0x7fafb015cfe0 2023-10-06T03:02:24.623 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.618+0000 7fafb488a700 1 -- 172.21.15.57:0/1870524857 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafac005d70 con 0x7fafb015cfe0 2023-10-06T03:02:24.623 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.618+0000 7fafb488a700 1 -- 172.21.15.57:0/1870524857 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafac00b880 con 0x7fafb015cfe0 2023-10-06T03:02:24.624 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.618+0000 7fafb7af0700 1 -- 172.21.15.57:0/1870524857 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fafb015cfe0 msgr2=0x7fafb00ce020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:24.624 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.618+0000 7fafb7af0700 1 --2- 172.21.15.57:0/1870524857 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fafb015cfe0 0x7fafb00ce020 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fafb0067940 tx=0x7fafac009220 comp rx=0 tx=0).stop 2023-10-06T03:02:24.624 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.618+0000 7fafb7af0700 1 -- 172.21.15.57:0/1870524857 shutdown_connections 2023-10-06T03:02:24.624 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.618+0000 7fafb7af0700 1 --2- 172.21.15.57:0/1870524857 >> v2:172.21.15.105:3300/0 conn(0x7fafb0159510 0x7fafb0159990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:24.624 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.618+0000 7fafb7af0700 1 --2- 172.21.15.57:0/1870524857 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fafb015cfe0 0x7fafb00ce020 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:24.624 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.618+0000 7fafb7af0700 1 -- 172.21.15.57:0/1870524857 >> 172.21.15.57:0/1870524857 conn(0x7fafb006ef40 msgr2=0x7fafb00d0240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:24.625 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.618+0000 7fafb7af0700 1 -- 172.21.15.57:0/1870524857 shutdown_connections 2023-10-06T03:02:24.625 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.618+0000 7fafb7af0700 1 -- 172.21.15.57:0/1870524857 wait complete. 2023-10-06T03:02:24.627 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.622+0000 7fafb7af0700 1 Processor -- start 2023-10-06T03:02:24.627 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.622+0000 7fafb7af0700 1 -- start start 2023-10-06T03:02:24.629 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.622+0000 7fafb7af0700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fafb0159510 0x7fafb009d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:24.629 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.622+0000 7fafb7af0700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fafb015cfe0 0x7fafb0159990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:24.629 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.622+0000 7fafb7af0700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fafb015d3b0 0x7fafb00c85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:24.630 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.622+0000 7fafb7af0700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafb009dba0 con 0x7fafb015cfe0 2023-10-06T03:02:24.630 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.622+0000 7fafb7af0700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafb0169b90 con 0x7fafb0159510 2023-10-06T03:02:24.630 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.622+0000 7fafb7af0700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafb01566a0 con 0x7fafb015d3b0 2023-10-06T03:02:24.630 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.622+0000 7fafb508b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fafb015cfe0 0x7fafb0159990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:24.630 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.622+0000 7fafb508b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fafb015cfe0 0x7fafb0159990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:49782/0 (socket says 172.21.15.57:49782) 2023-10-06T03:02:24.630 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.622+0000 7fafb508b700 1 -- 172.21.15.57:0/3680081573 learned_addr learned my addr 172.21.15.57:0/3680081573 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:02:24.630 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.622+0000 7fafb588c700 1 --2- 172.21.15.57:0/3680081573 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fafb0159510 0x7fafb009d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:24.630 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.622+0000 7fafb608d700 1 --2- 172.21.15.57:0/3680081573 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fafb015d3b0 0x7fafb00c85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:24.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.622+0000 7fafb508b700 1 -- 172.21.15.57:0/3680081573 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fafb015d3b0 msgr2=0x7fafb00c85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:24.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.622+0000 7fafb508b700 1 --2- 172.21.15.57:0/3680081573 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fafb015d3b0 0x7fafb00c85d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:24.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.622+0000 7fafb508b700 1 -- 172.21.15.57:0/3680081573 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fafb0159510 msgr2=0x7fafb009d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:24.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.622+0000 7fafb508b700 1 --2- 172.21.15.57:0/3680081573 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fafb0159510 0x7fafb009d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:24.632 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.622+0000 7fafb508b700 1 -- 172.21.15.57:0/3680081573 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafac009480 con 0x7fafb015cfe0 2023-10-06T03:02:24.632 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.626+0000 7fafb508b700 1 --2- 172.21.15.57:0/3680081573 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fafb015cfe0 0x7fafb0159990 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fafa000c590 tx=0x7fafa000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:24.632 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.626+0000 7fafa5ffb700 1 -- 172.21.15.57:0/3680081573 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa0011590 con 0x7fafb015cfe0 2023-10-06T03:02:24.632 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.626+0000 7fafa5ffb700 1 -- 172.21.15.57:0/3680081573 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafa0011710 con 0x7fafb015cfe0 2023-10-06T03:02:24.632 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.626+0000 7fafb7af0700 1 -- 172.21.15.57:0/3680081573 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafb0159ed0 con 0x7fafb015cfe0 2023-10-06T03:02:24.632 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.626+0000 7fafa5ffb700 1 -- 172.21.15.57:0/3680081573 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa0011ad0 con 0x7fafb015cfe0 2023-10-06T03:02:24.632 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.626+0000 7fafb7af0700 1 -- 172.21.15.57:0/3680081573 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafb016d8a0 con 0x7fafb015cfe0 2023-10-06T03:02:24.633 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.626+0000 7fafb7af0700 1 -- 172.21.15.57:0/3680081573 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafb0169ce0 con 0x7fafb015cfe0 2023-10-06T03:02:24.635 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.630+0000 7fafa5ffb700 1 -- 172.21.15.57:0/3680081573 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fafa001b3b0 con 0x7fafb015cfe0 2023-10-06T03:02:24.635 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.630+0000 7fafa5ffb700 1 --2- 172.21.15.57:0/3680081573 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7faf94060550 0x7faf94062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:24.636 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.630+0000 7fafa5ffb700 1 -- 172.21.15.57:0/3680081573 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6144+0+0 (secure 0 0 0) 0x7fafa007bd80 con 0x7fafb015cfe0 2023-10-06T03:02:24.636 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.630+0000 7fafb588c700 1 --2- 172.21.15.57:0/3680081573 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7faf94060550 0x7faf94062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:24.637 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.630+0000 7fafb588c700 1 --2- 172.21.15.57:0/3680081573 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7faf94060550 0x7faf94062a00 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fafb015bb10 tx=0x7fafac016000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:24.643 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.638+0000 7fafa5ffb700 1 -- 172.21.15.57:0/3680081573 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fafb0169ce0 con 0x7fafb015cfe0 2023-10-06T03:02:24.811 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.806+0000 7fafb7af0700 1 -- 172.21.15.57:0/3680081573 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fafb0169ce0 con 0x7fafb015cfe0 2023-10-06T03:02:24.812 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.806+0000 7fafa5ffb700 1 -- 172.21.15.57:0/3680081573 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v39) v1 ==== 104+0+11 (secure 0 0 0) 0x7fafb0169ce0 con 0x7fafb015cfe0 2023-10-06T03:02:24.812 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2023-10-06T03:02:24.815 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.810+0000 7fafb7af0700 1 -- 172.21.15.57:0/3680081573 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7faf94060550 msgr2=0x7faf94062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:24.815 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.810+0000 7fafb7af0700 1 --2- 172.21.15.57:0/3680081573 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7faf94060550 0x7faf94062a00 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fafb015bb10 tx=0x7fafac016000 comp rx=0 tx=0).stop 2023-10-06T03:02:24.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.810+0000 7fafb7af0700 1 -- 172.21.15.57:0/3680081573 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fafb015cfe0 msgr2=0x7fafb0159990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:24.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.810+0000 7fafb7af0700 1 --2- 172.21.15.57:0/3680081573 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fafb015cfe0 0x7fafb0159990 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fafa000c590 tx=0x7fafa000c8a0 comp rx=0 tx=0).stop 2023-10-06T03:02:24.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.810+0000 7fafb7af0700 1 -- 172.21.15.57:0/3680081573 shutdown_connections 2023-10-06T03:02:24.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.810+0000 7fafb7af0700 1 --2- 172.21.15.57:0/3680081573 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7faf94060550 0x7faf94062a00 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:24.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.810+0000 7fafb7af0700 1 --2- 172.21.15.57:0/3680081573 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fafb015d3b0 0x7fafb00c85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:24.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.810+0000 7fafb7af0700 1 --2- 172.21.15.57:0/3680081573 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fafb015cfe0 0x7fafb0159990 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:24.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.810+0000 7fafb7af0700 1 --2- 172.21.15.57:0/3680081573 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fafb0159510 0x7fafb009d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:24.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.810+0000 7fafb7af0700 1 -- 172.21.15.57:0/3680081573 >> 172.21.15.57:0/3680081573 conn(0x7fafb006ef40 msgr2=0x7fafb01589a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:24.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.810+0000 7fafb7af0700 1 -- 172.21.15.57:0/3680081573 shutdown_connections 2023-10-06T03:02:24.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.810+0000 7fafb7af0700 1 -- 172.21.15.57:0/3680081573 wait complete. 2023-10-06T03:02:24.835 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T03:02:25.000 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.994+0000 7f9a33af0700 1 Processor -- start 2023-10-06T03:02:25.001 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.994+0000 7f9a33af0700 1 -- start start 2023-10-06T03:02:25.003 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.998+0000 7f9a33af0700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f9a2c155780 0x7f9a2c068040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:25.003 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.998+0000 7f9a33af0700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9a2c155b50 0x7f9a2c068580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:25.003 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.998+0000 7f9a33af0700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f9a2c069f10 0x7f9a2c06a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:25.003 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.998+0000 7f9a33af0700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a2c06af70 con 0x7f9a2c155780 2023-10-06T03:02:25.003 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.998+0000 7f9a33af0700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a2c0c7520 con 0x7f9a2c069f10 2023-10-06T03:02:25.004 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.998+0000 7f9a33af0700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a2c06ac90 con 0x7f9a2c155b50 2023-10-06T03:02:25.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.998+0000 7f9a3188c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f9a2c155780 0x7f9a2c068040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:25.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.998+0000 7f9a3188c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f9a2c155780 0x7f9a2c068040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:49788/0 (socket says 172.21.15.57:49788) 2023-10-06T03:02:25.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.998+0000 7f9a3188c700 1 -- 172.21.15.57:0/1593769671 learned_addr learned my addr 172.21.15.57:0/1593769671 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:02:25.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.998+0000 7f9a3208d700 1 --2- 172.21.15.57:0/1593769671 >> v2:172.21.15.105:3300/0 conn(0x7f9a2c069f10 0x7f9a2c06a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:25.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.998+0000 7f9a3108b700 1 --2- 172.21.15.57:0/1593769671 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9a2c155b50 0x7f9a2c068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:25.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.998+0000 7f9a3188c700 1 -- 172.21.15.57:0/1593769671 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9a2c155b50 msgr2=0x7f9a2c068580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:25.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.998+0000 7f9a3188c700 1 --2- 172.21.15.57:0/1593769671 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9a2c155b50 0x7f9a2c068580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:25.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.998+0000 7f9a3188c700 1 -- 172.21.15.57:0/1593769671 >> v2:172.21.15.105:3300/0 conn(0x7f9a2c069f10 msgr2=0x7f9a2c06a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:25.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.998+0000 7f9a3188c700 1 --2- 172.21.15.57:0/1593769671 >> v2:172.21.15.105:3300/0 conn(0x7f9a2c069f10 0x7f9a2c06a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:25.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.998+0000 7f9a3188c700 1 -- 172.21.15.57:0/1593769671 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a2c0c6ed0 con 0x7f9a2c155780 2023-10-06T03:02:25.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.998+0000 7f9a3108b700 1 --2- 172.21.15.57:0/1593769671 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9a2c155b50 0x7f9a2c068580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:02:25.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.998+0000 7f9a3188c700 1 --2- 172.21.15.57:0/1593769671 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a2c155780 0x7f9a2c068040 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c069180 tx=0x7f9a28009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2f433fd5134d698 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:25.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.998+0000 7f9a3088a700 1 -- 172.21.15.57:0/1593769671 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a28009e70 con 0x7f9a2c155780 2023-10-06T03:02:25.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.998+0000 7f9a3088a700 1 -- 172.21.15.57:0/1593769671 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a2800b860 con 0x7f9a2c155780 2023-10-06T03:02:25.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:24.998+0000 7f9a3088a700 1 -- 172.21.15.57:0/1593769671 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a2800bc00 con 0x7f9a2c155780 2023-10-06T03:02:25.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.002+0000 7f9a33af0700 1 -- 172.21.15.57:0/1593769671 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a2c155780 msgr2=0x7f9a2c068040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:25.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.002+0000 7f9a33af0700 1 --2- 172.21.15.57:0/1593769671 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a2c155780 0x7f9a2c068040 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c069180 tx=0x7f9a28009250 comp rx=0 tx=0).stop 2023-10-06T03:02:25.008 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.002+0000 7f9a33af0700 1 -- 172.21.15.57:0/1593769671 shutdown_connections 2023-10-06T03:02:25.008 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.002+0000 7f9a33af0700 1 --2- 172.21.15.57:0/1593769671 >> v2:172.21.15.105:3300/0 conn(0x7f9a2c069f10 0x7f9a2c06a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:25.008 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.002+0000 7f9a33af0700 1 --2- 172.21.15.57:0/1593769671 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9a2c155b50 0x7f9a2c068580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:25.008 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.002+0000 7f9a33af0700 1 --2- 172.21.15.57:0/1593769671 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a2c155780 0x7f9a2c068040 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:25.008 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.002+0000 7f9a33af0700 1 -- 172.21.15.57:0/1593769671 >> 172.21.15.57:0/1593769671 conn(0x7f9a2c0c9c70 msgr2=0x7f9a2c06d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:25.008 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.002+0000 7f9a33af0700 1 -- 172.21.15.57:0/1593769671 shutdown_connections 2023-10-06T03:02:25.008 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.002+0000 7f9a33af0700 1 -- 172.21.15.57:0/1593769671 wait complete. 2023-10-06T03:02:25.010 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.002+0000 7f9a33af0700 1 Processor -- start 2023-10-06T03:02:25.010 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.002+0000 7f9a33af0700 1 -- start start 2023-10-06T03:02:25.011 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.006+0000 7f9a33af0700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a2c069f10 0x7f9a2c14d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:25.012 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.006+0000 7f9a33af0700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9a2c155780 0x7f9a2c158800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:25.012 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.006+0000 7f9a33af0700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9a2c155b50 0x7f9a2c14c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:25.012 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.006+0000 7f9a33af0700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a2c0c5730 con 0x7f9a2c069f10 2023-10-06T03:02:25.012 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.006+0000 7f9a33af0700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a2c157010 con 0x7f9a2c155780 2023-10-06T03:02:25.012 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.006+0000 7f9a33af0700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a2c0c59d0 con 0x7f9a2c155b50 2023-10-06T03:02:25.012 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.006+0000 7f9a3188c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a2c069f10 0x7f9a2c14d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:25.012 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.006+0000 7f9a3188c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a2c069f10 0x7f9a2c14d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:49794/0 (socket says 172.21.15.57:49794) 2023-10-06T03:02:25.012 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.006+0000 7f9a3188c700 1 -- 172.21.15.57:0/2203609519 learned_addr learned my addr 172.21.15.57:0/2203609519 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:02:25.013 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.006+0000 7f9a3208d700 1 --2- 172.21.15.57:0/2203609519 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9a2c155b50 0x7f9a2c14c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:25.013 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.006+0000 7f9a3108b700 1 --2- 172.21.15.57:0/2203609519 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9a2c155780 0x7f9a2c158800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:25.014 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.006+0000 7f9a3188c700 1 -- 172.21.15.57:0/2203609519 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9a2c155b50 msgr2=0x7f9a2c14c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:25.014 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.006+0000 7f9a3188c700 1 --2- 172.21.15.57:0/2203609519 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9a2c155b50 0x7f9a2c14c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:25.014 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.006+0000 7f9a3188c700 1 -- 172.21.15.57:0/2203609519 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9a2c155780 msgr2=0x7f9a2c158800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:25.014 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.006+0000 7f9a3188c700 1 --2- 172.21.15.57:0/2203609519 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9a2c155780 0x7f9a2c158800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:25.014 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.006+0000 7f9a3188c700 1 -- 172.21.15.57:0/2203609519 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a280094f0 con 0x7f9a2c069f10 2023-10-06T03:02:25.014 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.006+0000 7f9a3108b700 1 --2- 172.21.15.57:0/2203609519 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9a2c155780 0x7f9a2c158800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:02:25.014 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.006+0000 7f9a3208d700 1 --2- 172.21.15.57:0/2203609519 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9a2c155b50 0x7f9a2c14c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:02:25.014 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.006+0000 7f9a3188c700 1 --2- 172.21.15.57:0/2203609519 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a2c069f10 0x7f9a2c14d6e0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f9a28009290 tx=0x7f9a28017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:25.014 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.006+0000 7f9a21ffb700 1 -- 172.21.15.57:0/2203609519 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a2800bbe0 con 0x7f9a2c069f10 2023-10-06T03:02:25.014 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.006+0000 7f9a21ffb700 1 -- 172.21.15.57:0/2203609519 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a2801f070 con 0x7f9a2c069f10 2023-10-06T03:02:25.014 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.006+0000 7f9a33af0700 1 -- 172.21.15.57:0/2203609519 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a2c0c5d40 con 0x7f9a2c069f10 2023-10-06T03:02:25.014 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.006+0000 7f9a21ffb700 1 -- 172.21.15.57:0/2203609519 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a28026690 con 0x7f9a2c069f10 2023-10-06T03:02:25.015 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.006+0000 7f9a33af0700 1 -- 172.21.15.57:0/2203609519 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a2c14cd60 con 0x7f9a2c069f10 2023-10-06T03:02:25.015 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.010+0000 7f9a33af0700 1 -- 172.21.15.57:0/2203609519 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a2c06c810 con 0x7f9a2c069f10 2023-10-06T03:02:25.016 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.010+0000 7f9a21ffb700 1 -- 172.21.15.57:0/2203609519 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f9a2801a430 con 0x7f9a2c069f10 2023-10-06T03:02:25.018 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.010+0000 7f9a21ffb700 1 --2- 172.21.15.57:0/2203609519 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f9a10060550 0x7f9a10062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:25.018 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.010+0000 7f9a21ffb700 1 -- 172.21.15.57:0/2203609519 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6144+0+0 (secure 0 0 0) 0x7f9a28021070 con 0x7f9a2c069f10 2023-10-06T03:02:25.018 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.014+0000 7f9a3108b700 1 --2- 172.21.15.57:0/2203609519 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f9a10060550 0x7f9a10062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:25.019 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.014+0000 7f9a3108b700 1 --2- 172.21.15.57:0/2203609519 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f9a10060550 0x7f9a10062a00 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f9a1c006f00 tx=0x7f9a1c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:25.025 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.018+0000 7f9a21ffb700 1 -- 172.21.15.57:0/2203609519 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f9a2804ebb0 con 0x7f9a2c069f10 2023-10-06T03:02:25.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.186+0000 7f9a33af0700 1 -- 172.21.15.57:0/2203609519 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9a2c0c71b0 con 0x7f9a2c069f10 2023-10-06T03:02:25.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.190+0000 7f9a21ffb700 1 -- 172.21.15.57:0/2203609519 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v39) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9a2802e350 con 0x7f9a2c069f10 2023-10-06T03:02:25.195 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 64 2023-10-06T03:02:25.200 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.194+0000 7f9a33af0700 1 -- 172.21.15.57:0/2203609519 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f9a10060550 msgr2=0x7f9a10062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:25.200 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.194+0000 7f9a33af0700 1 --2- 172.21.15.57:0/2203609519 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f9a10060550 0x7f9a10062a00 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f9a1c006f00 tx=0x7f9a1c008040 comp rx=0 tx=0).stop 2023-10-06T03:02:25.200 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.194+0000 7f9a33af0700 1 -- 172.21.15.57:0/2203609519 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a2c069f10 msgr2=0x7f9a2c14d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:25.200 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.194+0000 7f9a33af0700 1 --2- 172.21.15.57:0/2203609519 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a2c069f10 0x7f9a2c14d6e0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f9a28009290 tx=0x7f9a28017000 comp rx=0 tx=0).stop 2023-10-06T03:02:25.201 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.194+0000 7f9a33af0700 1 -- 172.21.15.57:0/2203609519 shutdown_connections 2023-10-06T03:02:25.201 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.194+0000 7f9a33af0700 1 --2- 172.21.15.57:0/2203609519 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f9a10060550 0x7f9a10062a00 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:25.201 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.194+0000 7f9a33af0700 1 --2- 172.21.15.57:0/2203609519 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9a2c155b50 0x7f9a2c14c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:25.201 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.194+0000 7f9a33af0700 1 --2- 172.21.15.57:0/2203609519 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9a2c155780 0x7f9a2c158800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:25.201 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.194+0000 7f9a33af0700 1 --2- 172.21.15.57:0/2203609519 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a2c069f10 0x7f9a2c14d6e0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:25.201 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.194+0000 7f9a33af0700 1 -- 172.21.15.57:0/2203609519 >> 172.21.15.57:0/2203609519 conn(0x7f9a2c0c9c70 msgr2=0x7f9a2c0c85f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:25.201 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.194+0000 7f9a33af0700 1 -- 172.21.15.57:0/2203609519 shutdown_connections 2023-10-06T03:02:25.201 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.194+0000 7f9a33af0700 1 -- 172.21.15.57:0/2203609519 wait complete. 2023-10-06T03:02:25.221 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:02:25.385 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.378+0000 7f2c93fff700 1 Processor -- start 2023-10-06T03:02:25.385 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.378+0000 7f2c93fff700 1 -- start start 2023-10-06T03:02:25.389 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.382+0000 7f2c93fff700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2c940c9b00 0x7f2c940c8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:25.389 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.382+0000 7f2c93fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2c94161180 0x7f2c94161600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:25.389 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.382+0000 7f2c93fff700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c940cadb0 con 0x7f2c940c9ed0 2023-10-06T03:02:25.390 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.382+0000 7f2c93fff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c940c6b00 con 0x7f2c94161180 2023-10-06T03:02:25.390 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.382+0000 7f2c93fff700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c94161b40 con 0x7f2c940c9b00 2023-10-06T03:02:25.390 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.382+0000 7f2c937fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2c94161180 0x7f2c94161600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:25.391 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.382+0000 7f2c937fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2c94161180 0x7f2c94161600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:49802/0 (socket says 172.21.15.57:49802) 2023-10-06T03:02:25.391 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.382+0000 7f2c937fe700 1 -- 172.21.15.57:0/363472909 learned_addr learned my addr 172.21.15.57:0/363472909 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:02:25.391 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.382+0000 7f2c92ffd700 1 --2- 172.21.15.57:0/363472909 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2c940c9b00 0x7f2c940c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:25.391 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.386+0000 7f2c937fe700 1 -- 172.21.15.57:0/363472909 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2c940c9b00 msgr2=0x7f2c940c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:25.391 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.386+0000 7f2c937fe700 1 --2- 172.21.15.57:0/363472909 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2c940c9b00 0x7f2c940c8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:25.391 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.386+0000 7f2c937fe700 1 -- 172.21.15.57:0/363472909 >> v1:172.21.15.105:6789/0 conn(0x7f2c940c9ed0 legacy=0x7f2c940c6340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:25.391 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.386+0000 7f2c937fe700 1 -- 172.21.15.57:0/363472909 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c940ca480 con 0x7f2c94161180 2023-10-06T03:02:25.392 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.386+0000 7f2c937fe700 1 --2- 172.21.15.57:0/363472909 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c94161180 0x7f2c94161600 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f2c8c009f20 tx=0x7f2c8c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8021786a2a8607f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:25.392 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.386+0000 7f2c91ffb700 1 -- 172.21.15.57:0/363472909 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c8c00e070 con 0x7f2c94161180 2023-10-06T03:02:25.392 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.386+0000 7f2c91ffb700 1 -- 172.21.15.57:0/363472909 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c8c00b9d0 con 0x7f2c94161180 2023-10-06T03:02:25.392 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.386+0000 7f2c91ffb700 1 -- 172.21.15.57:0/363472909 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c8c0092e0 con 0x7f2c94161180 2023-10-06T03:02:25.392 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.386+0000 7f2c93fff700 1 -- 172.21.15.57:0/363472909 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c94161180 msgr2=0x7f2c94161600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:25.392 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.386+0000 7f2c93fff700 1 --2- 172.21.15.57:0/363472909 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c94161180 0x7f2c94161600 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f2c8c009f20 tx=0x7f2c8c009840 comp rx=0 tx=0).stop 2023-10-06T03:02:25.393 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.386+0000 7f2c93fff700 1 -- 172.21.15.57:0/363472909 shutdown_connections 2023-10-06T03:02:25.393 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.386+0000 7f2c93fff700 1 --2- 172.21.15.57:0/363472909 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c94161180 0x7f2c94161600 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:25.393 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.386+0000 7f2c93fff700 1 --2- 172.21.15.57:0/363472909 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2c940c9b00 0x7f2c940c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:25.393 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.386+0000 7f2c93fff700 1 -- 172.21.15.57:0/363472909 >> 172.21.15.57:0/363472909 conn(0x7f2c94067b00 msgr2=0x7f2c940cbd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:25.393 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.386+0000 7f2c93fff700 1 -- 172.21.15.57:0/363472909 shutdown_connections 2023-10-06T03:02:25.393 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.386+0000 7f2c93fff700 1 -- 172.21.15.57:0/363472909 wait complete. 2023-10-06T03:02:25.396 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.390+0000 7f2c93fff700 1 Processor -- start 2023-10-06T03:02:25.396 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.390+0000 7f2c93fff700 1 -- start start 2023-10-06T03:02:25.398 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.390+0000 7f2c93fff700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2c940c9b00 0x7f2c9416e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:25.398 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.390+0000 7f2c93fff700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c940c9ed0 0x7f2c940aeaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:25.398 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.390+0000 7f2c93fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c94161180 0x7f2c9415db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:25.398 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.390+0000 7f2c93fff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c940aefe0 con 0x7f2c94161180 2023-10-06T03:02:25.398 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.390+0000 7f2c93fff700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c940afd90 con 0x7f2c940c9ed0 2023-10-06T03:02:25.398 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.390+0000 7f2c93fff700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c940af210 con 0x7f2c940c9b00 2023-10-06T03:02:25.399 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.390+0000 7f2c937fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c94161180 0x7f2c9415db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:25.399 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.390+0000 7f2c937fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c94161180 0x7f2c9415db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:49818/0 (socket says 172.21.15.57:49818) 2023-10-06T03:02:25.399 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.390+0000 7f2c937fe700 1 -- 172.21.15.57:0/4204897053 learned_addr learned my addr 172.21.15.57:0/4204897053 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:02:25.399 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.394+0000 7f2c927fc700 1 --2- 172.21.15.57:0/4204897053 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c940c9ed0 0x7f2c940aeaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:25.399 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.394+0000 7f2c92ffd700 1 --2- 172.21.15.57:0/4204897053 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2c940c9b00 0x7f2c9416e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:25.399 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.394+0000 7f2c937fe700 1 -- 172.21.15.57:0/4204897053 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2c940c9b00 msgr2=0x7f2c9416e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:25.400 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.394+0000 7f2c937fe700 1 --2- 172.21.15.57:0/4204897053 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2c940c9b00 0x7f2c9416e640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:25.400 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.394+0000 7f2c937fe700 1 -- 172.21.15.57:0/4204897053 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c940c9ed0 msgr2=0x7f2c940aeaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:25.400 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.394+0000 7f2c937fe700 1 --2- 172.21.15.57:0/4204897053 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c940c9ed0 0x7f2c940aeaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:25.400 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.394+0000 7f2c937fe700 1 -- 172.21.15.57:0/4204897053 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c8c009ae0 con 0x7f2c94161180 2023-10-06T03:02:25.401 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.394+0000 7f2c937fe700 1 --2- 172.21.15.57:0/4204897053 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c94161180 0x7f2c9415db40 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f2c9406c120 tx=0x7f2c8c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:25.401 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.394+0000 7f2c7affd700 1 -- 172.21.15.57:0/4204897053 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c8c008ab0 con 0x7f2c94161180 2023-10-06T03:02:25.401 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.394+0000 7f2c7affd700 1 -- 172.21.15.57:0/4204897053 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c8c008c30 con 0x7f2c94161180 2023-10-06T03:02:25.401 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.394+0000 7f2c93fff700 1 -- 172.21.15.57:0/4204897053 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c940af4f0 con 0x7f2c94161180 2023-10-06T03:02:25.401 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.394+0000 7f2c7affd700 1 -- 172.21.15.57:0/4204897053 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c8c026460 con 0x7f2c94161180 2023-10-06T03:02:25.401 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.394+0000 7f2c93fff700 1 -- 172.21.15.57:0/4204897053 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c940afab0 con 0x7f2c94161180 2023-10-06T03:02:25.402 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.394+0000 7f2c93fff700 1 -- 172.21.15.57:0/4204897053 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c940645e0 con 0x7f2c94161180 2023-10-06T03:02:25.403 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.398+0000 7f2c7affd700 1 -- 172.21.15.57:0/4204897053 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f2c8c003040 con 0x7f2c94161180 2023-10-06T03:02:25.405 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.398+0000 7f2c7affd700 1 --2- 172.21.15.57:0/4204897053 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f2c800605d0 0x7f2c80062a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:25.405 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.398+0000 7f2c7affd700 1 -- 172.21.15.57:0/4204897053 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6144+0+0 (secure 0 0 0) 0x7f2c8c07e230 con 0x7f2c94161180 2023-10-06T03:02:25.405 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.398+0000 7f2c92ffd700 1 --2- 172.21.15.57:0/4204897053 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f2c800605d0 0x7f2c80062a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:25.406 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.402+0000 7f2c92ffd700 1 --2- 172.21.15.57:0/4204897053 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f2c800605d0 0x7f2c80062a80 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f2c940b1b10 tx=0x7f2c840091a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:25.413 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.406+0000 7f2c7affd700 1 -- 172.21.15.57:0/4204897053 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f2c8c04e5f0 con 0x7f2c94161180 2023-10-06T03:02:25.621 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.614+0000 7f2c93fff700 1 -- 172.21.15.57:0/4204897053 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2c940ca760 con 0x7f2c94161180 2023-10-06T03:02:25.622 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.614+0000 7f2c7affd700 1 -- 172.21.15.57:0/4204897053 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4595 (secure 0 0 0) 0x7f2c8c051c10 con 0x7f2c94161180 2023-10-06T03:02:25.622 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:02:25.622 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":23,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5158,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6834/3877951826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":3877951826},{"type":"v1","addr":"172.21.15.105:6834","nonce":3877951826}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5214,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/311797094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":311797094},{"type":"v1","addr":"172.21.15.57:6835","nonce":311797094}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5217,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6837/670891004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6836","nonce":670891004},{"type":"v1","addr":"172.21.15.57:6837","nonce":670891004}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:01:47.353461+0000","modified":"2023-10-06T03:01:59.821893+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":36,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5211},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5211":{"gid":5211,"name":"d","rank":0,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.105:6835/938221046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":938221046},{"type":"v1","addr":"172.21.15.105:6835","nonce":938221046}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T03:02:25.626 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.618+0000 7f2c93fff700 1 -- 172.21.15.57:0/4204897053 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f2c800605d0 msgr2=0x7f2c80062a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:25.626 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.618+0000 7f2c93fff700 1 --2- 172.21.15.57:0/4204897053 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f2c800605d0 0x7f2c80062a80 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f2c940b1b10 tx=0x7f2c840091a0 comp rx=0 tx=0).stop 2023-10-06T03:02:25.626 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.618+0000 7f2c93fff700 1 -- 172.21.15.57:0/4204897053 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c94161180 msgr2=0x7f2c9415db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:25.626 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.618+0000 7f2c93fff700 1 --2- 172.21.15.57:0/4204897053 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c94161180 0x7f2c9415db40 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f2c9406c120 tx=0x7f2c8c018000 comp rx=0 tx=0).stop 2023-10-06T03:02:25.627 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.622+0000 7f2c93fff700 1 -- 172.21.15.57:0/4204897053 shutdown_connections 2023-10-06T03:02:25.627 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.622+0000 7f2c93fff700 1 --2- 172.21.15.57:0/4204897053 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c94161180 0x7f2c9415db40 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:25.627 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.622+0000 7f2c93fff700 1 --2- 172.21.15.57:0/4204897053 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c940c9ed0 0x7f2c940aeaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:25.627 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.622+0000 7f2c93fff700 1 --2- 172.21.15.57:0/4204897053 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f2c800605d0 0x7f2c80062a80 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:25.627 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.622+0000 7f2c93fff700 1 --2- 172.21.15.57:0/4204897053 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2c940c9b00 0x7f2c9416e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:25.627 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.622+0000 7f2c93fff700 1 -- 172.21.15.57:0/4204897053 >> 172.21.15.57:0/4204897053 conn(0x7f2c94067b00 msgr2=0x7f2c94069f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:25.628 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.622+0000 7f2c93fff700 1 -- 172.21.15.57:0/4204897053 shutdown_connections 2023-10-06T03:02:25.628 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.622+0000 7f2c93fff700 1 -- 172.21.15.57:0/4204897053 wait complete. 2023-10-06T03:02:25.629 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 23 2023-10-06T03:02:25.648 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:02:25.808 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.802+0000 7fca6a1c3700 1 Processor -- start 2023-10-06T03:02:25.808 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.802+0000 7fca6a1c3700 1 -- start start 2023-10-06T03:02:25.809 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.802+0000 7fca6a1c3700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fca640c9ed0 0x7fca640c8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:25.809 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.802+0000 7fca6a1c3700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca64161180 0x7fca64161600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:25.809 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.802+0000 7fca6a1c3700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca640cadb0 con 0x7fca640c9b00 2023-10-06T03:02:25.810 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.802+0000 7fca6a1c3700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca640c6b00 con 0x7fca640c9ed0 2023-10-06T03:02:25.810 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.802+0000 7fca6a1c3700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca64161b40 con 0x7fca64161180 2023-10-06T03:02:25.810 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.802+0000 7fca699c2700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca64161180 0x7fca64161600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:25.810 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.802+0000 7fca689c0700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fca640c9ed0 0x7fca640c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:25.810 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.802+0000 7fca699c2700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca64161180 0x7fca64161600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.57:47440/0 (socket says 172.21.15.57:47440) 2023-10-06T03:02:25.811 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.802+0000 7fca699c2700 1 -- 172.21.15.57:0/2029941680 learned_addr learned my addr 172.21.15.57:0/2029941680 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:02:25.811 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.806+0000 7fca699c2700 1 -- 172.21.15.57:0/2029941680 >> v2:172.21.15.105:3300/0 conn(0x7fca640c9ed0 msgr2=0x7fca640c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:25.811 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.806+0000 7fca699c2700 1 --2- 172.21.15.57:0/2029941680 >> v2:172.21.15.105:3300/0 conn(0x7fca640c9ed0 0x7fca640c8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:25.811 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.806+0000 7fca699c2700 1 -- 172.21.15.57:0/2029941680 >> v1:172.21.15.105:6789/0 conn(0x7fca640c9b00 legacy=0x7fca640c6340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:25.811 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.806+0000 7fca699c2700 1 -- 172.21.15.57:0/2029941680 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca640ca480 con 0x7fca64161180 2023-10-06T03:02:25.812 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.806+0000 7fca699c2700 1 --2- 172.21.15.57:0/2029941680 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca64161180 0x7fca64161600 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fca5c0099b0 tx=0x7fca5c009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3abde225259d4ee5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:25.812 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.806+0000 7fca5bfff700 1 -- 172.21.15.57:0/2029941680 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca5c009ea0 con 0x7fca64161180 2023-10-06T03:02:25.812 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.806+0000 7fca5bfff700 1 -- 172.21.15.57:0/2029941680 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca5c00b860 con 0x7fca64161180 2023-10-06T03:02:25.812 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.806+0000 7fca5bfff700 1 -- 172.21.15.57:0/2029941680 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca5c00bc00 con 0x7fca64161180 2023-10-06T03:02:25.813 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.806+0000 7fca6a1c3700 1 -- 172.21.15.57:0/2029941680 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca64161180 msgr2=0x7fca64161600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:25.813 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.806+0000 7fca6a1c3700 1 --2- 172.21.15.57:0/2029941680 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca64161180 0x7fca64161600 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fca5c0099b0 tx=0x7fca5c009250 comp rx=0 tx=0).stop 2023-10-06T03:02:25.813 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.806+0000 7fca6a1c3700 1 -- 172.21.15.57:0/2029941680 shutdown_connections 2023-10-06T03:02:25.813 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.806+0000 7fca6a1c3700 1 --2- 172.21.15.57:0/2029941680 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca64161180 0x7fca64161600 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:25.813 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.806+0000 7fca6a1c3700 1 --2- 172.21.15.57:0/2029941680 >> v2:172.21.15.105:3300/0 conn(0x7fca640c9ed0 0x7fca640c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:25.813 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.806+0000 7fca6a1c3700 1 -- 172.21.15.57:0/2029941680 >> 172.21.15.57:0/2029941680 conn(0x7fca64067b00 msgr2=0x7fca640cbd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:25.814 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.806+0000 7fca6a1c3700 1 -- 172.21.15.57:0/2029941680 shutdown_connections 2023-10-06T03:02:25.814 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.806+0000 7fca6a1c3700 1 -- 172.21.15.57:0/2029941680 wait complete. 2023-10-06T03:02:25.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.810+0000 7fca6a1c3700 1 Processor -- start 2023-10-06T03:02:25.817 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.810+0000 7fca6a1c3700 1 -- start start 2023-10-06T03:02:25.819 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.814+0000 7fca6a1c3700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca640c9b00 0x7fca6415d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:25.819 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.814+0000 7fca6a1c3700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca640c9ed0 0x7fca640b0c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:25.819 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.814+0000 7fca6a1c3700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca64161180 0x7fca640b1160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:25.819 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.814+0000 7fca6a1c3700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca6416db70 con 0x7fca640c9b00 2023-10-06T03:02:25.819 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.814+0000 7fca6a1c3700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca64155740 con 0x7fca640c9ed0 2023-10-06T03:02:25.820 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.814+0000 7fca6a1c3700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca640b17e0 con 0x7fca64161180 2023-10-06T03:02:25.820 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.814+0000 7fca689c0700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca640c9ed0 0x7fca640b0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:25.820 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.814+0000 7fca691c1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca640c9b00 0x7fca6415d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:25.820 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.814+0000 7fca689c0700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca640c9ed0 0x7fca640b0c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.57:39886/0 (socket says 172.21.15.57:39886) 2023-10-06T03:02:25.820 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.814+0000 7fca689c0700 1 -- 172.21.15.57:0/2082863888 learned_addr learned my addr 172.21.15.57:0/2082863888 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:02:25.820 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.814+0000 7fca699c2700 1 --2- 172.21.15.57:0/2082863888 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca64161180 0x7fca640b1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:25.821 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.814+0000 7fca689c0700 1 -- 172.21.15.57:0/2082863888 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca64161180 msgr2=0x7fca640b1160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:25.821 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.814+0000 7fca689c0700 1 --2- 172.21.15.57:0/2082863888 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca64161180 0x7fca640b1160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:25.821 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.814+0000 7fca689c0700 1 -- 172.21.15.57:0/2082863888 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca640c9b00 msgr2=0x7fca6415d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:25.821 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.814+0000 7fca689c0700 1 --2- 172.21.15.57:0/2082863888 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca640c9b00 0x7fca6415d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:25.821 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.814+0000 7fca689c0700 1 -- 172.21.15.57:0/2082863888 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca5c0094f0 con 0x7fca640c9ed0 2023-10-06T03:02:25.822 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.814+0000 7fca691c1700 1 --2- 172.21.15.57:0/2082863888 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca640c9b00 0x7fca6415d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:02:25.822 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.814+0000 7fca689c0700 1 --2- 172.21.15.57:0/2082863888 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca640c9ed0 0x7fca640b0c20 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fca5400e930 tx=0x7fca540091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:25.822 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.814+0000 7fca597fa700 1 -- 172.21.15.57:0/2082863888 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca54013680 con 0x7fca640c9ed0 2023-10-06T03:02:25.822 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.814+0000 7fca597fa700 1 -- 172.21.15.57:0/2082863888 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca540137e0 con 0x7fca640c9ed0 2023-10-06T03:02:25.822 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.814+0000 7fca597fa700 1 -- 172.21.15.57:0/2082863888 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca54013b80 con 0x7fca640c9ed0 2023-10-06T03:02:25.823 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.814+0000 7fca6a1c3700 1 -- 172.21.15.57:0/2082863888 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca6416ddc0 con 0x7fca640c9ed0 2023-10-06T03:02:25.823 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.814+0000 7fca6a1c3700 1 -- 172.21.15.57:0/2082863888 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca6416e380 con 0x7fca640c9ed0 2023-10-06T03:02:25.824 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.818+0000 7fca6a1c3700 1 -- 172.21.15.57:0/2082863888 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca6416e5a0 con 0x7fca640c9ed0 2023-10-06T03:02:25.826 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.818+0000 7fca597fa700 1 -- 172.21.15.57:0/2082863888 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fca5400c3e0 con 0x7fca640c9ed0 2023-10-06T03:02:25.827 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.822+0000 7fca597fa700 1 --2- 172.21.15.57:0/2082863888 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fca48060520 0x7fca480629d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:25.827 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.822+0000 7fca597fa700 1 -- 172.21.15.57:0/2082863888 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6144+0+0 (secure 0 0 0) 0x7fca5407c9a0 con 0x7fca640c9ed0 2023-10-06T03:02:25.827 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.822+0000 7fca691c1700 1 --2- 172.21.15.57:0/2082863888 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fca48060520 0x7fca480629d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:25.828 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.822+0000 7fca691c1700 1 --2- 172.21.15.57:0/2082863888 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fca48060520 0x7fca480629d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fca60007fd0 tx=0x7fca60009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:25.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:25.830+0000 7fca597fa700 1 -- 172.21.15.57:0/2082863888 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fca5404cde0 con 0x7fca640c9ed0 2023-10-06T03:02:26.022 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.014+0000 7fca6a1c3700 1 -- 172.21.15.57:0/2082863888 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fca640645e0 con 0x7fca640c9ed0 2023-10-06T03:02:26.025 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.018+0000 7fca597fa700 1 -- 172.21.15.57:0/2082863888 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+16997 (secure 0 0 0) 0x7fca54017090 con 0x7fca640c9ed0 2023-10-06T03:02:26.026 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:02:26.026 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":39,"fsid":"eb56dc0f-9213-41cb-9aad-8ade6c802e98","created":"2023-10-06T03:00:30.806197+0000","modified":"2023-10-06T03:01:55.806234+0000","last_up_change":"2023-10-06T03:00:43.607454+0000","last_in_change":"2023-10-06T03:00:33.943513+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T03:00:44.360651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T03:00:50.466601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:01:45.068952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-10-06T03:01:46.357714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"58cf6c90-d704-43e0-b2db-dffe526d5e8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":33053},{"type":"v1","addr":"172.21.15.57:6801","nonce":33053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":33053},{"type":"v1","addr":"172.21.15.57:6803","nonce":33053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":33053},{"type":"v1","addr":"172.21.15.57:6807","nonce":33053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":33053},{"type":"v1","addr":"172.21.15.57:6805","nonce":33053}]},"public_addr":"172.21.15.57:6801/33053","cluster_addr":"172.21.15.57:6803/33053","heartbeat_back_addr":"172.21.15.57:6807/33053","heartbeat_front_addr":"172.21.15.57:6805/33053","state":["exists","up"]},{"osd":1,"uuid":"16afbe70-7f9e-4568-9c92-763e6e348119","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6809","nonce":33052},{"type":"v1","addr":"172.21.15.57:6810","nonce":33052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":33052},{"type":"v1","addr":"172.21.15.57:6813","nonce":33052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":33052},{"type":"v1","addr":"172.21.15.57:6822","nonce":33052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6815","nonce":33052},{"type":"v1","addr":"172.21.15.57:6818","nonce":33052}]},"public_addr":"172.21.15.57:6810/33052","cluster_addr":"172.21.15.57:6813/33052","heartbeat_back_addr":"172.21.15.57:6822/33052","heartbeat_front_addr":"172.21.15.57:6818/33052","state":["exists","up"]},{"osd":2,"uuid":"7255c62e-f92f-470f-a5ce-30228920d9f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":33058},{"type":"v1","addr":"172.21.15.57:6825","nonce":33058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":33058},{"type":"v1","addr":"172.21.15.57:6827","nonce":33058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":33058},{"type":"v1","addr":"172.21.15.57:6831","nonce":33058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":33058},{"type":"v1","addr":"172.21.15.57:6829","nonce":33058}]},"public_addr":"172.21.15.57:6825/33058","cluster_addr":"172.21.15.57:6827/33058","heartbeat_back_addr":"172.21.15.57:6831/33058","heartbeat_front_addr":"172.21.15.57:6829/33058","state":["exists","up"]},{"osd":3,"uuid":"152a236d-f799-4888-8544-74865508d5a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":33057},{"type":"v1","addr":"172.21.15.57:6811","nonce":33057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":33057},{"type":"v1","addr":"172.21.15.57:6816","nonce":33057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6821","nonce":33057},{"type":"v1","addr":"172.21.15.57:6823","nonce":33057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6817","nonce":33057},{"type":"v1","addr":"172.21.15.57:6819","nonce":33057}]},"public_addr":"172.21.15.57:6811/33057","cluster_addr":"172.21.15.57:6816/33057","heartbeat_back_addr":"172.21.15.57:6823/33057","heartbeat_front_addr":"172.21.15.57:6819/33057","state":["exists","up"]},{"osd":4,"uuid":"37db2a65-3566-41d0-9d60-e66c49e1e68e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":33368},{"type":"v1","addr":"172.21.15.105:6801","nonce":33368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":33368},{"type":"v1","addr":"172.21.15.105:6803","nonce":33368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":33368},{"type":"v1","addr":"172.21.15.105:6807","nonce":33368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":33368},{"type":"v1","addr":"172.21.15.105:6805","nonce":33368}]},"public_addr":"172.21.15.105:6801/33368","cluster_addr":"172.21.15.105:6803/33368","heartbeat_back_addr":"172.21.15.105:6807/33368","heartbeat_front_addr":"172.21.15.105:6805/33368","state":["exists","up"]},{"osd":5,"uuid":"35e77918-1bb4-42ca-9b20-f3c14eaa0c04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":33379},{"type":"v1","addr":"172.21.15.105:6818","nonce":33379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":33379},{"type":"v1","addr":"172.21.15.105:6823","nonce":33379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":33379},{"type":"v1","addr":"172.21.15.105:6831","nonce":33379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":33379},{"type":"v1","addr":"172.21.15.105:6827","nonce":33379}]},"public_addr":"172.21.15.105:6818/33379","cluster_addr":"172.21.15.105:6823/33379","heartbeat_back_addr":"172.21.15.105:6831/33379","heartbeat_front_addr":"172.21.15.105:6827/33379","state":["exists","up"]},{"osd":6,"uuid":"b4d9d510-7a45-4173-8287-c6c8d6547f2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":33369},{"type":"v1","addr":"172.21.15.105:6819","nonce":33369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":33369},{"type":"v1","addr":"172.21.15.105:6822","nonce":33369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":33369},{"type":"v1","addr":"172.21.15.105:6830","nonce":33369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":33369},{"type":"v1","addr":"172.21.15.105:6826","nonce":33369}]},"public_addr":"172.21.15.105:6819/33369","cluster_addr":"172.21.15.105:6822/33369","heartbeat_back_addr":"172.21.15.105:6830/33369","heartbeat_front_addr":"172.21.15.105:6826/33369","state":["exists","up"]},{"osd":7,"uuid":"74266fb0-cd84-463f-8bf0-092652a71dc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":33370},{"type":"v1","addr":"172.21.15.105:6809","nonce":33370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":33370},{"type":"v1","addr":"172.21.15.105:6811","nonce":33370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":33370},{"type":"v1","addr":"172.21.15.105:6815","nonce":33370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":33370},{"type":"v1","addr":"172.21.15.105:6813","nonce":33370}]},"public_addr":"172.21.15.105:6809/33370","cluster_addr":"172.21.15.105:6811/33370","heartbeat_back_addr":"172.21.15.105:6815/33370","heartbeat_front_addr":"172.21.15.105:6813/33370","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.596864+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.633851+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.636993+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.529681+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.608601+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.659752+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.661717+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.642221+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.105:6834/1325054263":"2023-10-07T03:01:55.780023+0000","172.21.15.105:6832/1325054263":"2023-10-07T03:01:55.780023+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:02:26.030 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.022+0000 7fca6a1c3700 1 -- 172.21.15.57:0/2082863888 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fca48060520 msgr2=0x7fca480629d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:26.030 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.022+0000 7fca6a1c3700 1 --2- 172.21.15.57:0/2082863888 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fca48060520 0x7fca480629d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fca60007fd0 tx=0x7fca60009040 comp rx=0 tx=0).stop 2023-10-06T03:02:26.030 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.022+0000 7fca6a1c3700 1 -- 172.21.15.57:0/2082863888 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca640c9ed0 msgr2=0x7fca640b0c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:26.030 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.022+0000 7fca6a1c3700 1 --2- 172.21.15.57:0/2082863888 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca640c9ed0 0x7fca640b0c20 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fca5400e930 tx=0x7fca540091a0 comp rx=0 tx=0).stop 2023-10-06T03:02:26.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.022+0000 7fca6a1c3700 1 -- 172.21.15.57:0/2082863888 shutdown_connections 2023-10-06T03:02:26.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.022+0000 7fca6a1c3700 1 --2- 172.21.15.57:0/2082863888 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fca48060520 0x7fca480629d0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:26.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.026+0000 7fca6a1c3700 1 --2- 172.21.15.57:0/2082863888 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca64161180 0x7fca640b1160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:26.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.026+0000 7fca6a1c3700 1 --2- 172.21.15.57:0/2082863888 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca640c9ed0 0x7fca640b0c20 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:26.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.026+0000 7fca6a1c3700 1 --2- 172.21.15.57:0/2082863888 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca640c9b00 0x7fca6415d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:26.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.026+0000 7fca6a1c3700 1 -- 172.21.15.57:0/2082863888 >> 172.21.15.57:0/2082863888 conn(0x7fca64067b00 msgr2=0x7fca640c5ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:26.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.026+0000 7fca6a1c3700 1 -- 172.21.15.57:0/2082863888 shutdown_connections 2023-10-06T03:02:26.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.026+0000 7fca6a1c3700 1 -- 172.21.15.57:0/2082863888 wait complete. 2023-10-06T03:02:26.052 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T03:02:26.052 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:02:26.213 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.206+0000 7f306d0f0700 1 Processor -- start 2023-10-06T03:02:26.214 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.206+0000 7f306d0f0700 1 -- start start 2023-10-06T03:02:26.216 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.210+0000 7f306d0f0700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f306815d6a0 0x7f30680c6510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:26.216 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.210+0000 7f306d0f0700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30680cb0a0 con 0x7f30680c1e30 2023-10-06T03:02:26.216 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.210+0000 7f306d0f0700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30680ca490 con 0x7f30680c9fb0 2023-10-06T03:02:26.216 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.210+0000 7f306d0f0700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30680ca770 con 0x7f306815d6a0 2023-10-06T03:02:26.216 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.210+0000 7f306759e700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f30680c1e30 0x7f306815e180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:45442/0 (socket says 172.21.15.57:45442) 2023-10-06T03:02:26.217 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.210+0000 7f306759e700 1 -- 172.21.15.57:0/2483128734 learned_addr learned my addr 172.21.15.57:0/2483128734 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:02:26.217 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.210+0000 7f3066d9d700 1 --2- 172.21.15.57:0/2483128734 >> v2:172.21.15.105:3300/0 conn(0x7f306815d6a0 0x7f30680c6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:26.218 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.210+0000 7f3065d9b700 1 -- 172.21.15.57:0/2483128734 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2096480441 0 0) 0x7f30680cb0a0 con 0x7f30680c1e30 2023-10-06T03:02:26.218 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.210+0000 7f3065d9b700 1 -- 172.21.15.57:0/2483128734 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3050003570 con 0x7f30680c1e30 2023-10-06T03:02:26.218 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.210+0000 7f3065d9b700 1 -- 172.21.15.57:0/2483128734 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2813196949 0 0) 0x7f30680ca490 con 0x7f30680c9fb0 2023-10-06T03:02:26.218 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.210+0000 7f3065d9b700 1 -- 172.21.15.57:0/2483128734 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30680cb0a0 con 0x7f30680c9fb0 2023-10-06T03:02:26.218 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.210+0000 7f3066d9d700 1 -- 172.21.15.57:0/2483128734 >> v1:172.21.15.105:6789/0 conn(0x7f30680c9fb0 legacy=0x7f306815da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:26.218 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.210+0000 7f3066d9d700 1 -- 172.21.15.57:0/2483128734 >> v1:172.21.15.57:6789/0 conn(0x7f30680c1e30 legacy=0x7f306815e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:26.218 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.210+0000 7f3066d9d700 1 -- 172.21.15.57:0/2483128734 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30680caa50 con 0x7f306815d6a0 2023-10-06T03:02:26.218 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.214+0000 7f3066d9d700 1 --2- 172.21.15.57:0/2483128734 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f306815d6a0 0x7f30680c6510 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f30580098d0 tx=0x7f3058009120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5cf42ba550ebb449 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:26.219 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.214+0000 7f3065d9b700 1 -- 172.21.15.57:0/2483128734 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3058005c10 con 0x7f306815d6a0 2023-10-06T03:02:26.219 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.214+0000 7f3065d9b700 1 -- 172.21.15.57:0/2483128734 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3058005d70 con 0x7f306815d6a0 2023-10-06T03:02:26.219 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.214+0000 7f3065d9b700 1 -- 172.21.15.57:0/2483128734 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3058006260 con 0x7f306815d6a0 2023-10-06T03:02:26.220 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.214+0000 7f306d0f0700 1 -- 172.21.15.57:0/2483128734 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f306815d6a0 msgr2=0x7f30680c6510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:26.220 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.214+0000 7f306d0f0700 1 --2- 172.21.15.57:0/2483128734 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f306815d6a0 0x7f30680c6510 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f30580098d0 tx=0x7f3058009120 comp rx=0 tx=0).stop 2023-10-06T03:02:26.221 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.214+0000 7f306d0f0700 1 -- 172.21.15.57:0/2483128734 shutdown_connections 2023-10-06T03:02:26.221 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.214+0000 7f306d0f0700 1 --2- 172.21.15.57:0/2483128734 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f306815d6a0 0x7f30680c6510 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:26.221 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.214+0000 7f306d0f0700 1 -- 172.21.15.57:0/2483128734 >> 172.21.15.57:0/2483128734 conn(0x7f30680cbed0 msgr2=0x7f30680cc2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:26.221 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.214+0000 7f306d0f0700 1 -- 172.21.15.57:0/2483128734 shutdown_connections 2023-10-06T03:02:26.221 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.214+0000 7f306d0f0700 1 -- 172.21.15.57:0/2483128734 wait complete. 2023-10-06T03:02:26.224 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.218+0000 7f306d0f0700 1 Processor -- start 2023-10-06T03:02:26.224 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.218+0000 7f306d0f0700 1 -- start start 2023-10-06T03:02:26.226 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.218+0000 7f306d0f0700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f30680c1e30 0x7f3068159700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:26.226 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.218+0000 7f306d0f0700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f30680c9fb0 0x7f306814b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:26.226 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.218+0000 7f306d0f0700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f306815d6a0 0x7f306816e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:26.226 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.218+0000 7f306d0f0700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f306816e700 con 0x7f306815d6a0 2023-10-06T03:02:26.226 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.218+0000 7f306d0f0700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f306815a520 con 0x7f30680c1e30 2023-10-06T03:02:26.226 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.218+0000 7f306d0f0700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f306815a770 con 0x7f30680c9fb0 2023-10-06T03:02:26.228 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.218+0000 7f306759e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f306815d6a0 0x7f306816e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:26.228 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.222+0000 7f3066d9d700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f30680c1e30 0x7f3068159700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:26.228 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.222+0000 7f306759e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f306815d6a0 0x7f306816e1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:49836/0 (socket says 172.21.15.57:49836) 2023-10-06T03:02:26.228 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.222+0000 7f306759e700 1 -- 172.21.15.57:0/1132454998 learned_addr learned my addr 172.21.15.57:0/1132454998 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:02:26.228 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.222+0000 7f306659c700 1 --2- 172.21.15.57:0/1132454998 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f30680c9fb0 0x7f306814b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:26.228 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.222+0000 7f306759e700 1 -- 172.21.15.57:0/1132454998 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f30680c9fb0 msgr2=0x7f306814b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:26.228 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.222+0000 7f306759e700 1 --2- 172.21.15.57:0/1132454998 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f30680c9fb0 0x7f306814b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:26.228 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.222+0000 7f306759e700 1 -- 172.21.15.57:0/1132454998 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f30680c1e30 msgr2=0x7f3068159700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:26.228 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.222+0000 7f306759e700 1 --2- 172.21.15.57:0/1132454998 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f30680c1e30 0x7f3068159700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:26.228 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.222+0000 7f306759e700 1 -- 172.21.15.57:0/1132454998 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30580093c0 con 0x7f306815d6a0 2023-10-06T03:02:26.229 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.222+0000 7f306759e700 1 --2- 172.21.15.57:0/1132454998 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f306815d6a0 0x7f306816e1c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f306000cc20 tx=0x7f3060001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:26.229 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.222+0000 7f304effd700 1 -- 172.21.15.57:0/1132454998 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f306000a850 con 0x7f306815d6a0 2023-10-06T03:02:26.229 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.222+0000 7f304effd700 1 -- 172.21.15.57:0/1132454998 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f306000a9b0 con 0x7f306815d6a0 2023-10-06T03:02:26.229 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.222+0000 7f306d0f0700 1 -- 172.21.15.57:0/1132454998 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f306815aa50 con 0x7f306815d6a0 2023-10-06T03:02:26.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.222+0000 7f304effd700 1 -- 172.21.15.57:0/1132454998 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f306000ad30 con 0x7f306815d6a0 2023-10-06T03:02:26.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.222+0000 7f306d0f0700 1 -- 172.21.15.57:0/1132454998 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30680c48b0 con 0x7f306815d6a0 2023-10-06T03:02:26.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.222+0000 7f306d0f0700 1 -- 172.21.15.57:0/1132454998 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30680c52d0 con 0x7f306815d6a0 2023-10-06T03:02:26.232 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.226+0000 7f304effd700 1 -- 172.21.15.57:0/1132454998 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f3060007300 con 0x7f306815d6a0 2023-10-06T03:02:26.234 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.226+0000 7f304effd700 1 --2- 172.21.15.57:0/1132454998 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f3054060550 0x7f3054062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:26.234 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.226+0000 7f304effd700 1 -- 172.21.15.57:0/1132454998 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6144+0+0 (secure 0 0 0) 0x7f306007cc40 con 0x7f306815d6a0 2023-10-06T03:02:26.234 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.226+0000 7f3066d9d700 1 --2- 172.21.15.57:0/1132454998 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f3054060550 0x7f3054062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:26.235 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.230+0000 7f3066d9d700 1 --2- 172.21.15.57:0/1132454998 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f3054060550 0x7f3054062a00 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3058009160 tx=0x7f3058016000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:26.240 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.234+0000 7f304effd700 1 -- 172.21.15.57:0/1132454998 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f30680c52d0 con 0x7f306815d6a0 2023-10-06T03:02:26.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.442+0000 7f306d0f0700 1 -- 172.21.15.57:0/1132454998 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f306806b970 con 0x7f306815d6a0 2023-10-06T03:02:26.449 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.442+0000 7f304effd700 1 -- 172.21.15.57:0/1132454998 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4595 (secure 0 0 0) 0x7f306004d080 con 0x7f306815d6a0 2023-10-06T03:02:26.449 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:02:26.450 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":23,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5158,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6834/3877951826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":3877951826},{"type":"v1","addr":"172.21.15.105:6834","nonce":3877951826}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5214,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/311797094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":311797094},{"type":"v1","addr":"172.21.15.57:6835","nonce":311797094}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5217,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6837/670891004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6836","nonce":670891004},{"type":"v1","addr":"172.21.15.57:6837","nonce":670891004}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:01:47.353461+0000","modified":"2023-10-06T03:01:59.821893+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":36,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5211},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5211":{"gid":5211,"name":"d","rank":0,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.105:6835/938221046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":938221046},{"type":"v1","addr":"172.21.15.105:6835","nonce":938221046}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T03:02:26.453 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.446+0000 7f306d0f0700 1 -- 172.21.15.57:0/1132454998 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f3054060550 msgr2=0x7f3054062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:26.453 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.446+0000 7f306d0f0700 1 --2- 172.21.15.57:0/1132454998 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f3054060550 0x7f3054062a00 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3058009160 tx=0x7f3058016000 comp rx=0 tx=0).stop 2023-10-06T03:02:26.453 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.446+0000 7f306d0f0700 1 -- 172.21.15.57:0/1132454998 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f306815d6a0 msgr2=0x7f306816e1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:26.453 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.446+0000 7f306d0f0700 1 --2- 172.21.15.57:0/1132454998 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f306815d6a0 0x7f306816e1c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f306000cc20 tx=0x7f3060001a40 comp rx=0 tx=0).stop 2023-10-06T03:02:26.453 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.446+0000 7f306d0f0700 1 -- 172.21.15.57:0/1132454998 shutdown_connections 2023-10-06T03:02:26.453 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.446+0000 7f306d0f0700 1 --2- 172.21.15.57:0/1132454998 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f306815d6a0 0x7f306816e1c0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:26.453 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.446+0000 7f306d0f0700 1 --2- 172.21.15.57:0/1132454998 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f3054060550 0x7f3054062a00 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:26.453 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.446+0000 7f306d0f0700 1 --2- 172.21.15.57:0/1132454998 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f30680c9fb0 0x7f306814b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:26.453 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.446+0000 7f306d0f0700 1 --2- 172.21.15.57:0/1132454998 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f30680c1e30 0x7f3068159700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:26.453 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.446+0000 7f306d0f0700 1 -- 172.21.15.57:0/1132454998 >> 172.21.15.57:0/1132454998 conn(0x7f30680cbed0 msgr2=0x7f306806cbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:26.453 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.446+0000 7f306d0f0700 1 -- 172.21.15.57:0/1132454998 shutdown_connections 2023-10-06T03:02:26.453 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.446+0000 7f306d0f0700 1 -- 172.21.15.57:0/1132454998 wait complete. 2023-10-06T03:02:26.455 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 23 2023-10-06T03:02:26.476 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:02:26.638 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.630+0000 7fd7b4dc5700 1 Processor -- start 2023-10-06T03:02:26.639 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.634+0000 7fd7b4dc5700 1 -- start start 2023-10-06T03:02:26.641 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.634+0000 7fd7b4dc5700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fd7b015d6a0 0x7fd7b00c6510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:26.642 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.634+0000 7fd7b4dc5700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd7b00c9fb0 0x7fd7b00c6a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:26.642 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.634+0000 7fd7b4dc5700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7b00cb0a0 con 0x7fd7b0161320 2023-10-06T03:02:26.642 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.634+0000 7fd7b4dc5700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7b00ca490 con 0x7fd7b00c9fb0 2023-10-06T03:02:26.642 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.634+0000 7fd7b4dc5700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7b00ca770 con 0x7fd7b015d6a0 2023-10-06T03:02:26.643 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.634+0000 7fd7aed9d700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fd7b0161320 0x7fd7b015da70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:45458/0 (socket says 172.21.15.57:45458) 2023-10-06T03:02:26.643 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.634+0000 7fd7aed9d700 1 -- 172.21.15.57:0/3244546694 learned_addr learned my addr 172.21.15.57:0/3244546694 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:02:26.643 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.634+0000 7fd7a7fff700 1 --2- 172.21.15.57:0/3244546694 >> v2:172.21.15.57:3300/0 conn(0x7fd7b00c9fb0 0x7fd7b00c6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:26.643 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.634+0000 7fd7ae59c700 1 --2- 172.21.15.57:0/3244546694 >> v2:172.21.15.105:3300/0 conn(0x7fd7b015d6a0 0x7fd7b00c6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:26.643 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.638+0000 7fd7add9b700 1 -- 172.21.15.57:0/3244546694 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3087333156 0 0) 0x7fd7b00cb0a0 con 0x7fd7b0161320 2023-10-06T03:02:26.643 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.638+0000 7fd7add9b700 1 -- 172.21.15.57:0/3244546694 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd79c003570 con 0x7fd7b0161320 2023-10-06T03:02:26.644 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.638+0000 7fd7a7fff700 1 -- 172.21.15.57:0/3244546694 >> v2:172.21.15.105:3300/0 conn(0x7fd7b015d6a0 msgr2=0x7fd7b00c6510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:26.644 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.638+0000 7fd7add9b700 1 -- 172.21.15.57:0/3244546694 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4224806858 0 0) 0x7fd79c003570 con 0x7fd7b0161320 2023-10-06T03:02:26.644 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.638+0000 7fd7a7fff700 1 --2- 172.21.15.57:0/3244546694 >> v2:172.21.15.105:3300/0 conn(0x7fd7b015d6a0 0x7fd7b00c6510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:26.644 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.638+0000 7fd7a7fff700 1 -- 172.21.15.57:0/3244546694 >> v1:172.21.15.57:6789/0 conn(0x7fd7b0161320 legacy=0x7fd7b015da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:26.644 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.638+0000 7fd7a7fff700 1 -- 172.21.15.57:0/3244546694 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7b00caa50 con 0x7fd7b00c9fb0 2023-10-06T03:02:26.645 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.638+0000 7fd7a7fff700 1 --2- 172.21.15.57:0/3244546694 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd7b00c9fb0 0x7fd7b00c6a50 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fd7b006b0a0 tx=0x7fd7980091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=976f6eda4bf2418a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:26.645 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.638+0000 7fd7add9b700 1 -- 172.21.15.57:0/3244546694 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7a80017f0 con 0x7fd7b00c9fb0 2023-10-06T03:02:26.645 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.638+0000 7fd7add9b700 1 -- 172.21.15.57:0/3244546694 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd798011420 con 0x7fd7b00c9fb0 2023-10-06T03:02:26.645 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.638+0000 7fd7add9b700 1 -- 172.21.15.57:0/3244546694 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7980117c0 con 0x7fd7b00c9fb0 2023-10-06T03:02:26.646 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.638+0000 7fd7b4dc5700 1 -- 172.21.15.57:0/3244546694 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd7b00c9fb0 msgr2=0x7fd7b00c6a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:26.646 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.638+0000 7fd7b4dc5700 1 --2- 172.21.15.57:0/3244546694 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd7b00c9fb0 0x7fd7b00c6a50 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fd7b006b0a0 tx=0x7fd7980091a0 comp rx=0 tx=0).stop 2023-10-06T03:02:26.646 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.638+0000 7fd7b4dc5700 1 -- 172.21.15.57:0/3244546694 shutdown_connections 2023-10-06T03:02:26.647 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.638+0000 7fd7b4dc5700 1 --2- 172.21.15.57:0/3244546694 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd7b00c9fb0 0x7fd7b00c6a50 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:26.647 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.638+0000 7fd7b4dc5700 1 --2- 172.21.15.57:0/3244546694 >> v2:172.21.15.105:3300/0 conn(0x7fd7b015d6a0 0x7fd7b00c6510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:26.647 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.638+0000 7fd7b4dc5700 1 -- 172.21.15.57:0/3244546694 >> 172.21.15.57:0/3244546694 conn(0x7fd7b00cbed0 msgr2=0x7fd7b00cc2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:26.647 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.638+0000 7fd7b4dc5700 1 -- 172.21.15.57:0/3244546694 shutdown_connections 2023-10-06T03:02:26.647 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.638+0000 7fd7b4dc5700 1 -- 172.21.15.57:0/3244546694 wait complete. 2023-10-06T03:02:26.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.642+0000 7fd7b4dc5700 1 Processor -- start 2023-10-06T03:02:26.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.642+0000 7fd7b4dc5700 1 -- start start 2023-10-06T03:02:26.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.642+0000 7fd7b4dc5700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd7b00c9fb0 0x7fd7b00aec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:26.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.642+0000 7fd7b4dc5700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd7b015d6a0 0x7fd7b00af1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:26.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.642+0000 7fd7b4dc5700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd7b0161320 0x7fd7b00aba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:26.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.642+0000 7fd7b4dc5700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b0155ae0 con 0x7fd7b0161320 2023-10-06T03:02:26.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.642+0000 7fd7b4dc5700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b01618d0 con 0x7fd7b00c9fb0 2023-10-06T03:02:26.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.642+0000 7fd7b4dc5700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b00ac790 con 0x7fd7b015d6a0 2023-10-06T03:02:26.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.642+0000 7fd7aed9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd7b0161320 0x7fd7b00aba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:26.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.642+0000 7fd7aed9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd7b0161320 0x7fd7b00aba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:49860/0 (socket says 172.21.15.57:49860) 2023-10-06T03:02:26.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.642+0000 7fd7aed9d700 1 -- 172.21.15.57:0/1637714092 learned_addr learned my addr 172.21.15.57:0/1637714092 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:02:26.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.642+0000 7fd7ae59c700 1 --2- 172.21.15.57:0/1637714092 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd7b00c9fb0 0x7fd7b00aec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:26.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.642+0000 7fd7a7fff700 1 --2- 172.21.15.57:0/1637714092 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd7b015d6a0 0x7fd7b00af1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:26.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.646+0000 7fd7aed9d700 1 -- 172.21.15.57:0/1637714092 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd7b015d6a0 msgr2=0x7fd7b00af1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:26.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.646+0000 7fd7aed9d700 1 --2- 172.21.15.57:0/1637714092 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd7b015d6a0 0x7fd7b00af1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:26.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.646+0000 7fd7aed9d700 1 -- 172.21.15.57:0/1637714092 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd7b00c9fb0 msgr2=0x7fd7b00aec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:26.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.646+0000 7fd7aed9d700 1 --2- 172.21.15.57:0/1637714092 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd7b00c9fb0 0x7fd7b00aec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:26.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.646+0000 7fd7aed9d700 1 -- 172.21.15.57:0/1637714092 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd798009420 con 0x7fd7b0161320 2023-10-06T03:02:26.652 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.646+0000 7fd7aed9d700 1 --2- 172.21.15.57:0/1637714092 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd7b0161320 0x7fd7b00aba60 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fd7a8001560 tx=0x7fd7a8001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:26.652 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.646+0000 7fd7a67fc700 1 -- 172.21.15.57:0/1637714092 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7a8004dc0 con 0x7fd7b0161320 2023-10-06T03:02:26.652 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.646+0000 7fd7a67fc700 1 -- 172.21.15.57:0/1637714092 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7a800a6a0 con 0x7fd7b0161320 2023-10-06T03:02:26.652 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.646+0000 7fd7b4dc5700 1 -- 172.21.15.57:0/1637714092 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7b00aca70 con 0x7fd7b0161320 2023-10-06T03:02:26.652 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.646+0000 7fd7a67fc700 1 -- 172.21.15.57:0/1637714092 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7a800aa60 con 0x7fd7b0161320 2023-10-06T03:02:26.652 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.646+0000 7fd7b4dc5700 1 -- 172.21.15.57:0/1637714092 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7b00ad030 con 0x7fd7b0161320 2023-10-06T03:02:26.654 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.646+0000 7fd7b4dc5700 1 -- 172.21.15.57:0/1637714092 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7b0161a40 con 0x7fd7b0161320 2023-10-06T03:02:26.655 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.650+0000 7fd7a67fc700 1 -- 172.21.15.57:0/1637714092 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fd7a8007150 con 0x7fd7b0161320 2023-10-06T03:02:26.656 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.650+0000 7fd7a67fc700 1 --2- 172.21.15.57:0/1637714092 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fd790060580 0x7fd790062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:26.657 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.650+0000 7fd7a67fc700 1 -- 172.21.15.57:0/1637714092 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6144+0+0 (secure 0 0 0) 0x7fd7a807bff0 con 0x7fd7b0161320 2023-10-06T03:02:26.657 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.650+0000 7fd7ae59c700 1 --2- 172.21.15.57:0/1637714092 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fd790060580 0x7fd790062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:26.658 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.650+0000 7fd7ae59c700 1 --2- 172.21.15.57:0/1637714092 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fd790060580 0x7fd790062a30 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd7b006ca70 tx=0x7fd7a0009120 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:26.663 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.658+0000 7fd7a67fc700 1 -- 172.21.15.57:0/1637714092 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fd7a804c430 con 0x7fd7b0161320 2023-10-06T03:02:26.877 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.870+0000 7fd7b4dc5700 1 -- 172.21.15.57:0/1637714092 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd7b00cad30 con 0x7fd7b0161320 2023-10-06T03:02:26.877 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.870+0000 7fd7a67fc700 1 -- 172.21.15.57:0/1637714092 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4595 (secure 0 0 0) 0x7fd7a8018020 con 0x7fd7b0161320 2023-10-06T03:02:26.877 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:02:26.878 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":23,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5158,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6834/3877951826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":3877951826},{"type":"v1","addr":"172.21.15.105:6834","nonce":3877951826}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5214,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/311797094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":311797094},{"type":"v1","addr":"172.21.15.57:6835","nonce":311797094}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5217,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6837/670891004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6836","nonce":670891004},{"type":"v1","addr":"172.21.15.57:6837","nonce":670891004}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:01:47.353461+0000","modified":"2023-10-06T03:01:59.821893+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":36,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5211},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5211":{"gid":5211,"name":"d","rank":0,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.105:6835/938221046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":938221046},{"type":"v1","addr":"172.21.15.105:6835","nonce":938221046}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T03:02:26.883 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.874+0000 7fd7b4dc5700 1 -- 172.21.15.57:0/1637714092 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fd790060580 msgr2=0x7fd790062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:26.883 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.874+0000 7fd7b4dc5700 1 --2- 172.21.15.57:0/1637714092 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fd790060580 0x7fd790062a30 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd7b006ca70 tx=0x7fd7a0009120 comp rx=0 tx=0).stop 2023-10-06T03:02:26.883 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.878+0000 7fd7b4dc5700 1 -- 172.21.15.57:0/1637714092 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd7b0161320 msgr2=0x7fd7b00aba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:26.883 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.878+0000 7fd7b4dc5700 1 --2- 172.21.15.57:0/1637714092 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd7b0161320 0x7fd7b00aba60 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fd7a8001560 tx=0x7fd7a8001640 comp rx=0 tx=0).stop 2023-10-06T03:02:26.884 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.878+0000 7fd7b4dc5700 1 -- 172.21.15.57:0/1637714092 shutdown_connections 2023-10-06T03:02:26.884 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.878+0000 7fd7b4dc5700 1 --2- 172.21.15.57:0/1637714092 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd7b0161320 0x7fd7b00aba60 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:26.884 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.878+0000 7fd7b4dc5700 1 --2- 172.21.15.57:0/1637714092 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fd790060580 0x7fd790062a30 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:26.884 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.878+0000 7fd7b4dc5700 1 --2- 172.21.15.57:0/1637714092 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd7b015d6a0 0x7fd7b00af1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:26.884 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.878+0000 7fd7b4dc5700 1 --2- 172.21.15.57:0/1637714092 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd7b00c9fb0 0x7fd7b00aec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:26.884 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.878+0000 7fd7b4dc5700 1 -- 172.21.15.57:0/1637714092 >> 172.21.15.57:0/1637714092 conn(0x7fd7b00cbed0 msgr2=0x7fd7b0158a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:26.884 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.878+0000 7fd7b4dc5700 1 -- 172.21.15.57:0/1637714092 shutdown_connections 2023-10-06T03:02:26.886 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:26.878+0000 7fd7b4dc5700 1 -- 172.21.15.57:0/1637714092 wait complete. 2023-10-06T03:02:26.886 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 23 2023-10-06T03:02:26.903 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:02:27.065 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.058+0000 7ff5c7cf0700 1 Processor -- start 2023-10-06T03:02:27.066 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.058+0000 7ff5c7cf0700 1 -- start start 2023-10-06T03:02:27.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.062+0000 7ff5c7cf0700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff5c006f020 0x7ff5c00ce810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:27.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.062+0000 7ff5c7cf0700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7ff5c00ced50 0x7ff5c01596a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:27.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.062+0000 7ff5c7cf0700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5c015dcd0 con 0x7ff5c00b28b0 2023-10-06T03:02:27.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.062+0000 7ff5c7cf0700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5c00cb240 con 0x7ff5c006f020 2023-10-06T03:02:27.070 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.062+0000 7ff5c7cf0700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5c015d4b0 con 0x7ff5c00ced50 2023-10-06T03:02:27.071 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.062+0000 7ff5c5a8c700 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7ff5c00b28b0 0x7ff5c015cda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.57:52862/0 (socket says 172.21.15.57:52862) 2023-10-06T03:02:27.071 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.062+0000 7ff5c5a8c700 1 -- 172.21.15.57:0/2927951777 learned_addr learned my addr 172.21.15.57:0/2927951777 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:02:27.071 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.062+0000 7ff5c528b700 1 --2- 172.21.15.57:0/2927951777 >> v2:172.21.15.57:3300/0 conn(0x7ff5c006f020 0x7ff5c00ce810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:27.071 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.062+0000 7ff5c628d700 1 --2- 172.21.15.57:0/2927951777 >> v2:172.21.15.105:3300/0 conn(0x7ff5c00ced50 0x7ff5c01596a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:27.071 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.066+0000 7ff5c4a8a700 1 -- 172.21.15.57:0/2927951777 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3414866548 0 0) 0x7ff5c015dcd0 con 0x7ff5c00b28b0 2023-10-06T03:02:27.071 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.066+0000 7ff5c4a8a700 1 -- 172.21.15.57:0/2927951777 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5ac003570 con 0x7ff5c00b28b0 2023-10-06T03:02:27.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.066+0000 7ff5c628d700 1 -- 172.21.15.57:0/2927951777 >> v2:172.21.15.57:3300/0 conn(0x7ff5c006f020 msgr2=0x7ff5c00ce810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:27.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.066+0000 7ff5c628d700 1 --2- 172.21.15.57:0/2927951777 >> v2:172.21.15.57:3300/0 conn(0x7ff5c006f020 0x7ff5c00ce810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:27.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.066+0000 7ff5c628d700 1 -- 172.21.15.57:0/2927951777 >> v1:172.21.15.105:6789/0 conn(0x7ff5c00b28b0 legacy=0x7ff5c015cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:27.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.066+0000 7ff5c628d700 1 -- 172.21.15.57:0/2927951777 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5c015d710 con 0x7ff5c00ced50 2023-10-06T03:02:27.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.066+0000 7ff5c528b700 1 --2- 172.21.15.57:0/2927951777 >> v2:172.21.15.57:3300/0 conn(0x7ff5c006f020 0x7ff5c00ce810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:02:27.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.066+0000 7ff5c628d700 1 --2- 172.21.15.57:0/2927951777 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff5c00ced50 0x7ff5c01596a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff5c015a940 tx=0x7ff5b8009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3dc43abd44c97af server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:27.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.066+0000 7ff5c4a8a700 1 -- 172.21.15.57:0/2927951777 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b800e070 con 0x7ff5c00ced50 2023-10-06T03:02:27.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.066+0000 7ff5c4a8a700 1 -- 172.21.15.57:0/2927951777 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5b800bab0 con 0x7ff5c00ced50 2023-10-06T03:02:27.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.066+0000 7ff5c4a8a700 1 -- 172.21.15.57:0/2927951777 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b800be70 con 0x7ff5c00ced50 2023-10-06T03:02:27.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.066+0000 7ff5c7cf0700 1 -- 172.21.15.57:0/2927951777 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff5c00ced50 msgr2=0x7ff5c01596a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:27.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.066+0000 7ff5c7cf0700 1 --2- 172.21.15.57:0/2927951777 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff5c00ced50 0x7ff5c01596a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff5c015a940 tx=0x7ff5b8009780 comp rx=0 tx=0).stop 2023-10-06T03:02:27.074 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.066+0000 7ff5c7cf0700 1 -- 172.21.15.57:0/2927951777 shutdown_connections 2023-10-06T03:02:27.074 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.066+0000 7ff5c7cf0700 1 --2- 172.21.15.57:0/2927951777 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff5c00ced50 0x7ff5c01596a0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:27.074 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.066+0000 7ff5c7cf0700 1 --2- 172.21.15.57:0/2927951777 >> v2:172.21.15.57:3300/0 conn(0x7ff5c006f020 0x7ff5c00ce810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:27.074 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.066+0000 7ff5c7cf0700 1 -- 172.21.15.57:0/2927951777 >> 172.21.15.57:0/2927951777 conn(0x7ff5c0089b80 msgr2=0x7ff5c00994a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:27.074 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.066+0000 7ff5c7cf0700 1 -- 172.21.15.57:0/2927951777 shutdown_connections 2023-10-06T03:02:27.075 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.066+0000 7ff5c7cf0700 1 -- 172.21.15.57:0/2927951777 wait complete. 2023-10-06T03:02:27.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.070+0000 7ff5c7cf0700 1 Processor -- start 2023-10-06T03:02:27.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.070+0000 7ff5c7cf0700 1 -- start start 2023-10-06T03:02:27.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.070+0000 7ff5c7cf0700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff5c006f020 0x7ff5c00b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:27.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.070+0000 7ff5c7cf0700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff5c00b28b0 0x7ff5c00ca180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:27.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.070+0000 7ff5c7cf0700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff5c00ced50 0x7ff5c00c5200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:27.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.070+0000 7ff5c7cf0700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c00ca6c0 con 0x7ff5c00ced50 2023-10-06T03:02:27.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.070+0000 7ff5c7cf0700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c00b3f10 con 0x7ff5c00b28b0 2023-10-06T03:02:27.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.070+0000 7ff5c7cf0700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c00b3670 con 0x7ff5c006f020 2023-10-06T03:02:27.079 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.070+0000 7ff5c628d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff5c00ced50 0x7ff5c00c5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:27.079 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.070+0000 7ff5c628d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff5c00ced50 0x7ff5c00c5200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:49886/0 (socket says 172.21.15.57:49886) 2023-10-06T03:02:27.079 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.070+0000 7ff5c628d700 1 -- 172.21.15.57:0/2835525457 learned_addr learned my addr 172.21.15.57:0/2835525457 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:02:27.079 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.070+0000 7ff5c528b700 1 --2- 172.21.15.57:0/2835525457 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff5c00b28b0 0x7ff5c00ca180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:27.079 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.070+0000 7ff5c5a8c700 1 --2- 172.21.15.57:0/2835525457 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff5c006f020 0x7ff5c00b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:27.079 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.074+0000 7ff5c628d700 1 -- 172.21.15.57:0/2835525457 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff5c006f020 msgr2=0x7ff5c00b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:27.079 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.074+0000 7ff5c628d700 1 --2- 172.21.15.57:0/2835525457 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff5c006f020 0x7ff5c00b2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:27.079 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.074+0000 7ff5c628d700 1 -- 172.21.15.57:0/2835525457 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff5c00b28b0 msgr2=0x7ff5c00ca180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:27.080 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.074+0000 7ff5c628d700 1 --2- 172.21.15.57:0/2835525457 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff5c00b28b0 0x7ff5c00ca180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:27.080 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.074+0000 7ff5c628d700 1 -- 172.21.15.57:0/2835525457 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5b0009420 con 0x7ff5c00ced50 2023-10-06T03:02:27.080 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.074+0000 7ff5c628d700 1 --2- 172.21.15.57:0/2835525457 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff5c00ced50 0x7ff5c00c5200 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7ff5b80099f0 tx=0x7ff5b8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:27.081 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.074+0000 7ff5b5ffb700 1 -- 172.21.15.57:0/2835525457 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b8012d00 con 0x7ff5c00ced50 2023-10-06T03:02:27.081 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.074+0000 7ff5b5ffb700 1 -- 172.21.15.57:0/2835525457 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5b8012e60 con 0x7ff5c00ced50 2023-10-06T03:02:27.081 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.074+0000 7ff5b5ffb700 1 -- 172.21.15.57:0/2835525457 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b80276c0 con 0x7ff5c00ced50 2023-10-06T03:02:27.081 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.074+0000 7ff5c7cf0700 1 -- 172.21.15.57:0/2835525457 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5b8009a20 con 0x7ff5c00ced50 2023-10-06T03:02:27.081 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.074+0000 7ff5c7cf0700 1 -- 172.21.15.57:0/2835525457 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5c00b3c30 con 0x7ff5c00ced50 2023-10-06T03:02:27.082 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.074+0000 7ff5c7cf0700 1 -- 172.21.15.57:0/2835525457 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5c0089f50 con 0x7ff5c00ced50 2023-10-06T03:02:27.083 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.078+0000 7ff5b5ffb700 1 -- 172.21.15.57:0/2835525457 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7ff5b8024070 con 0x7ff5c00ced50 2023-10-06T03:02:27.085 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.078+0000 7ff5b5ffb700 1 --2- 172.21.15.57:0/2835525457 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7ff5a4060550 0x7ff5a4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:27.085 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.078+0000 7ff5b5ffb700 1 -- 172.21.15.57:0/2835525457 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6144+0+0 (secure 0 0 0) 0x7ff5b807ef10 con 0x7ff5c00ced50 2023-10-06T03:02:27.085 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.078+0000 7ff5c5a8c700 1 --2- 172.21.15.57:0/2835525457 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7ff5a4060550 0x7ff5a4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:27.086 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.082+0000 7ff5c5a8c700 1 --2- 172.21.15.57:0/2835525457 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7ff5a4060550 0x7ff5a4062a00 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff5bc007fd0 tx=0x7ff5bc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:27.090 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.086+0000 7ff5b5ffb700 1 -- 172.21.15.57:0/2835525457 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7ff5b804f2d0 con 0x7ff5c00ced50 2023-10-06T03:02:27.264 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.258+0000 7ff5c7cf0700 1 -- 172.21.15.57:0/2835525457 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff5c004b600 con 0x7ff5c00ced50 2023-10-06T03:02:27.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.262+0000 7ff5b5ffb700 1 -- 172.21.15.57:0/2835525457 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+16997 (secure 0 0 0) 0x7ff5b80528f0 con 0x7ff5c00ced50 2023-10-06T03:02:27.267 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:02:27.267 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":39,"fsid":"eb56dc0f-9213-41cb-9aad-8ade6c802e98","created":"2023-10-06T03:00:30.806197+0000","modified":"2023-10-06T03:01:55.806234+0000","last_up_change":"2023-10-06T03:00:43.607454+0000","last_in_change":"2023-10-06T03:00:33.943513+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T03:00:44.360651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T03:00:50.466601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:01:45.068952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-10-06T03:01:46.357714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"58cf6c90-d704-43e0-b2db-dffe526d5e8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":33053},{"type":"v1","addr":"172.21.15.57:6801","nonce":33053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":33053},{"type":"v1","addr":"172.21.15.57:6803","nonce":33053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":33053},{"type":"v1","addr":"172.21.15.57:6807","nonce":33053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":33053},{"type":"v1","addr":"172.21.15.57:6805","nonce":33053}]},"public_addr":"172.21.15.57:6801/33053","cluster_addr":"172.21.15.57:6803/33053","heartbeat_back_addr":"172.21.15.57:6807/33053","heartbeat_front_addr":"172.21.15.57:6805/33053","state":["exists","up"]},{"osd":1,"uuid":"16afbe70-7f9e-4568-9c92-763e6e348119","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6809","nonce":33052},{"type":"v1","addr":"172.21.15.57:6810","nonce":33052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":33052},{"type":"v1","addr":"172.21.15.57:6813","nonce":33052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":33052},{"type":"v1","addr":"172.21.15.57:6822","nonce":33052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6815","nonce":33052},{"type":"v1","addr":"172.21.15.57:6818","nonce":33052}]},"public_addr":"172.21.15.57:6810/33052","cluster_addr":"172.21.15.57:6813/33052","heartbeat_back_addr":"172.21.15.57:6822/33052","heartbeat_front_addr":"172.21.15.57:6818/33052","state":["exists","up"]},{"osd":2,"uuid":"7255c62e-f92f-470f-a5ce-30228920d9f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":33058},{"type":"v1","addr":"172.21.15.57:6825","nonce":33058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":33058},{"type":"v1","addr":"172.21.15.57:6827","nonce":33058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":33058},{"type":"v1","addr":"172.21.15.57:6831","nonce":33058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":33058},{"type":"v1","addr":"172.21.15.57:6829","nonce":33058}]},"public_addr":"172.21.15.57:6825/33058","cluster_addr":"172.21.15.57:6827/33058","heartbeat_back_addr":"172.21.15.57:6831/33058","heartbeat_front_addr":"172.21.15.57:6829/33058","state":["exists","up"]},{"osd":3,"uuid":"152a236d-f799-4888-8544-74865508d5a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":33057},{"type":"v1","addr":"172.21.15.57:6811","nonce":33057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":33057},{"type":"v1","addr":"172.21.15.57:6816","nonce":33057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6821","nonce":33057},{"type":"v1","addr":"172.21.15.57:6823","nonce":33057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6817","nonce":33057},{"type":"v1","addr":"172.21.15.57:6819","nonce":33057}]},"public_addr":"172.21.15.57:6811/33057","cluster_addr":"172.21.15.57:6816/33057","heartbeat_back_addr":"172.21.15.57:6823/33057","heartbeat_front_addr":"172.21.15.57:6819/33057","state":["exists","up"]},{"osd":4,"uuid":"37db2a65-3566-41d0-9d60-e66c49e1e68e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":33368},{"type":"v1","addr":"172.21.15.105:6801","nonce":33368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":33368},{"type":"v1","addr":"172.21.15.105:6803","nonce":33368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":33368},{"type":"v1","addr":"172.21.15.105:6807","nonce":33368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":33368},{"type":"v1","addr":"172.21.15.105:6805","nonce":33368}]},"public_addr":"172.21.15.105:6801/33368","cluster_addr":"172.21.15.105:6803/33368","heartbeat_back_addr":"172.21.15.105:6807/33368","heartbeat_front_addr":"172.21.15.105:6805/33368","state":["exists","up"]},{"osd":5,"uuid":"35e77918-1bb4-42ca-9b20-f3c14eaa0c04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":33379},{"type":"v1","addr":"172.21.15.105:6818","nonce":33379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":33379},{"type":"v1","addr":"172.21.15.105:6823","nonce":33379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":33379},{"type":"v1","addr":"172.21.15.105:6831","nonce":33379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":33379},{"type":"v1","addr":"172.21.15.105:6827","nonce":33379}]},"public_addr":"172.21.15.105:6818/33379","cluster_addr":"172.21.15.105:6823/33379","heartbeat_back_addr":"172.21.15.105:6831/33379","heartbeat_front_addr":"172.21.15.105:6827/33379","state":["exists","up"]},{"osd":6,"uuid":"b4d9d510-7a45-4173-8287-c6c8d6547f2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":33369},{"type":"v1","addr":"172.21.15.105:6819","nonce":33369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":33369},{"type":"v1","addr":"172.21.15.105:6822","nonce":33369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":33369},{"type":"v1","addr":"172.21.15.105:6830","nonce":33369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":33369},{"type":"v1","addr":"172.21.15.105:6826","nonce":33369}]},"public_addr":"172.21.15.105:6819/33369","cluster_addr":"172.21.15.105:6822/33369","heartbeat_back_addr":"172.21.15.105:6830/33369","heartbeat_front_addr":"172.21.15.105:6826/33369","state":["exists","up"]},{"osd":7,"uuid":"74266fb0-cd84-463f-8bf0-092652a71dc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":33370},{"type":"v1","addr":"172.21.15.105:6809","nonce":33370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":33370},{"type":"v1","addr":"172.21.15.105:6811","nonce":33370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":33370},{"type":"v1","addr":"172.21.15.105:6815","nonce":33370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":33370},{"type":"v1","addr":"172.21.15.105:6813","nonce":33370}]},"public_addr":"172.21.15.105:6809/33370","cluster_addr":"172.21.15.105:6811/33370","heartbeat_back_addr":"172.21.15.105:6815/33370","heartbeat_front_addr":"172.21.15.105:6813/33370","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.596864+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.633851+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.636993+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.529681+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.608601+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.659752+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.661717+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.642221+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.105:6834/1325054263":"2023-10-07T03:01:55.780023+0000","172.21.15.105:6832/1325054263":"2023-10-07T03:01:55.780023+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:02:27.272 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.266+0000 7ff5c7cf0700 1 -- 172.21.15.57:0/2835525457 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7ff5a4060550 msgr2=0x7ff5a4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:27.272 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.266+0000 7ff5c7cf0700 1 --2- 172.21.15.57:0/2835525457 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7ff5a4060550 0x7ff5a4062a00 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff5bc007fd0 tx=0x7ff5bc009040 comp rx=0 tx=0).stop 2023-10-06T03:02:27.272 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.266+0000 7ff5c7cf0700 1 -- 172.21.15.57:0/2835525457 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff5c00ced50 msgr2=0x7ff5c00c5200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:27.272 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.266+0000 7ff5c7cf0700 1 --2- 172.21.15.57:0/2835525457 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff5c00ced50 0x7ff5c00c5200 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7ff5b80099f0 tx=0x7ff5b8019000 comp rx=0 tx=0).stop 2023-10-06T03:02:27.272 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.266+0000 7ff5c7cf0700 1 -- 172.21.15.57:0/2835525457 shutdown_connections 2023-10-06T03:02:27.272 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.266+0000 7ff5c7cf0700 1 --2- 172.21.15.57:0/2835525457 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff5c00ced50 0x7ff5c00c5200 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:27.272 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.266+0000 7ff5c7cf0700 1 --2- 172.21.15.57:0/2835525457 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff5c00b28b0 0x7ff5c00ca180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:27.272 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.266+0000 7ff5c7cf0700 1 --2- 172.21.15.57:0/2835525457 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7ff5a4060550 0x7ff5a4062a00 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:27.273 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.266+0000 7ff5c7cf0700 1 --2- 172.21.15.57:0/2835525457 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff5c006f020 0x7ff5c00b2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:27.273 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.266+0000 7ff5c7cf0700 1 -- 172.21.15.57:0/2835525457 >> 172.21.15.57:0/2835525457 conn(0x7ff5c0089b80 msgr2=0x7ff5c01596a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:27.273 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.266+0000 7ff5c7cf0700 1 -- 172.21.15.57:0/2835525457 shutdown_connections 2023-10-06T03:02:27.273 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.266+0000 7ff5c7cf0700 1 -- 172.21.15.57:0/2835525457 wait complete. 2023-10-06T03:02:27.292 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T03:02:27.454 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.446+0000 7f75a568e700 1 Processor -- start 2023-10-06T03:02:27.454 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.446+0000 7f75a568e700 1 -- start start 2023-10-06T03:02:27.456 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.450+0000 7f75a568e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f75a00c9ed0 0x7f75a00c8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:27.456 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.450+0000 7f75a568e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75a00cadb0 con 0x7f75a00c9b00 2023-10-06T03:02:27.456 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.450+0000 7f75a568e700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75a00ca480 con 0x7f75a0161180 2023-10-06T03:02:27.456 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.450+0000 7f75a568e700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75a00c6b00 con 0x7f75a00c9ed0 2023-10-06T03:02:27.457 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.450+0000 7f75977fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f75a00c9ed0 0x7f75a00c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:27.457 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.450+0000 7f75977fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f75a00c9ed0 0x7f75a00c8120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:49902/0 (socket says 172.21.15.57:49902) 2023-10-06T03:02:27.457 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.450+0000 7f75977fe700 1 -- 172.21.15.57:0/2848597017 learned_addr learned my addr 172.21.15.57:0/2848597017 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:02:27.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.450+0000 7f75977fe700 1 -- 172.21.15.57:0/2848597017 >> v1:172.21.15.105:6789/0 conn(0x7f75a0161180 legacy=0x7f75a0068bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:27.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.450+0000 7f75977fe700 1 -- 172.21.15.57:0/2848597017 >> v1:172.21.15.57:6789/0 conn(0x7f75a00c9b00 legacy=0x7f75a00c6340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:27.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.450+0000 7f75977fe700 1 -- 172.21.15.57:0/2848597017 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75a00ca760 con 0x7f75a00c9ed0 2023-10-06T03:02:27.459 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.450+0000 7f75977fe700 1 --2- 172.21.15.57:0/2848597017 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f75a00c9ed0 0x7f75a00c8120 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f75880099b0 tx=0x7f7588009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=298475b24884c956 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:27.459 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.450+0000 7f759f7fe700 1 -- 172.21.15.57:0/2848597017 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f758800b860 con 0x7f75a00c9ed0 2023-10-06T03:02:27.459 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.454+0000 7f759f7fe700 1 -- 172.21.15.57:0/2848597017 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f758800b9c0 con 0x7f75a00c9ed0 2023-10-06T03:02:27.459 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.454+0000 7f759f7fe700 1 -- 172.21.15.57:0/2848597017 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f758800bd60 con 0x7f75a00c9ed0 2023-10-06T03:02:27.460 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.454+0000 7f75a568e700 1 -- 172.21.15.57:0/2848597017 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f75a00c9ed0 msgr2=0x7f75a00c8120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:27.460 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.454+0000 7f75a568e700 1 --2- 172.21.15.57:0/2848597017 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f75a00c9ed0 0x7f75a00c8120 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f75880099b0 tx=0x7f7588009250 comp rx=0 tx=0).stop 2023-10-06T03:02:27.460 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.454+0000 7f75a568e700 1 -- 172.21.15.57:0/2848597017 shutdown_connections 2023-10-06T03:02:27.460 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.454+0000 7f75a568e700 1 --2- 172.21.15.57:0/2848597017 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f75a00c9ed0 0x7f75a00c8120 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:27.461 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.454+0000 7f75a568e700 1 -- 172.21.15.57:0/2848597017 >> 172.21.15.57:0/2848597017 conn(0x7f75a0067b00 msgr2=0x7f75a00cbd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:27.461 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.454+0000 7f75a568e700 1 -- 172.21.15.57:0/2848597017 shutdown_connections 2023-10-06T03:02:27.461 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.454+0000 7f75a568e700 1 -- 172.21.15.57:0/2848597017 wait complete. 2023-10-06T03:02:27.463 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.458+0000 7f75a568e700 1 Processor -- start 2023-10-06T03:02:27.463 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.458+0000 7f75a568e700 1 -- start start 2023-10-06T03:02:27.465 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.458+0000 7f75a568e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f75a00c9b00 0x7f75a00af370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:27.465 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.458+0000 7f75a568e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f75a00c9ed0 0x7f75a0147d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:27.465 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.458+0000 7f75a568e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f75a0161180 0x7f75a00c2db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:27.465 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.458+0000 7f75a568e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75a00c68d0 con 0x7f75a00c9ed0 2023-10-06T03:02:27.465 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.458+0000 7f75a568e700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75a0162090 con 0x7f75a00c9b00 2023-10-06T03:02:27.465 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.458+0000 7f75a568e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75a0161760 con 0x7f75a0161180 2023-10-06T03:02:27.465 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.458+0000 7f75977fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f75a00c9ed0 0x7f75a0147d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:27.465 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.458+0000 7f75977fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f75a00c9ed0 0x7f75a0147d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:49914/0 (socket says 172.21.15.57:49914) 2023-10-06T03:02:27.466 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.458+0000 7f75977fe700 1 -- 172.21.15.57:0/3317557925 learned_addr learned my addr 172.21.15.57:0/3317557925 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:02:27.467 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.458+0000 7f75a4e8d700 1 --2- 172.21.15.57:0/3317557925 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f75a0161180 0x7f75a00c2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:27.467 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.458+0000 7f759ffff700 1 --2- 172.21.15.57:0/3317557925 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f75a00c9b00 0x7f75a00af370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:27.467 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.458+0000 7f75977fe700 1 -- 172.21.15.57:0/3317557925 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f75a0161180 msgr2=0x7f75a00c2db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:27.467 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.458+0000 7f75977fe700 1 --2- 172.21.15.57:0/3317557925 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f75a0161180 0x7f75a00c2db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:27.467 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.458+0000 7f75977fe700 1 -- 172.21.15.57:0/3317557925 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f75a00c9b00 msgr2=0x7f75a00af370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:27.467 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.458+0000 7f75977fe700 1 --2- 172.21.15.57:0/3317557925 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f75a00c9b00 0x7f75a00af370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:27.467 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.458+0000 7f75977fe700 1 -- 172.21.15.57:0/3317557925 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75880094f0 con 0x7f75a00c9ed0 2023-10-06T03:02:27.467 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.458+0000 7f759ffff700 1 --2- 172.21.15.57:0/3317557925 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f75a00c9b00 0x7f75a00af370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:02:27.467 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.458+0000 7f75977fe700 1 --2- 172.21.15.57:0/3317557925 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f75a00c9ed0 0x7f75a0147d90 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f75a006b040 tx=0x7f7588017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:27.468 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.458+0000 7f759cff9700 1 -- 172.21.15.57:0/3317557925 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f758801a630 con 0x7f75a00c9ed0 2023-10-06T03:02:27.468 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.458+0000 7f759cff9700 1 -- 172.21.15.57:0/3317557925 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f758801a790 con 0x7f75a00c9ed0 2023-10-06T03:02:27.468 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.462+0000 7f75a568e700 1 -- 172.21.15.57:0/3317557925 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75a0161a40 con 0x7f75a00c9ed0 2023-10-06T03:02:27.468 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.462+0000 7f759cff9700 1 -- 172.21.15.57:0/3317557925 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f758801ab30 con 0x7f75a00c9ed0 2023-10-06T03:02:27.468 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.462+0000 7f75a568e700 1 -- 172.21.15.57:0/3317557925 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75a01482d0 con 0x7f75a00c9ed0 2023-10-06T03:02:27.468 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.462+0000 7f75a568e700 1 -- 172.21.15.57:0/3317557925 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75a00645e0 con 0x7f75a00c9ed0 2023-10-06T03:02:27.469 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.462+0000 7f759cff9700 1 -- 172.21.15.57:0/3317557925 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f7588026450 con 0x7f75a00c9ed0 2023-10-06T03:02:27.472 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.466+0000 7f759cff9700 1 --2- 172.21.15.57:0/3317557925 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f7580060550 0x7f7580062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:27.472 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.466+0000 7f759cff9700 1 -- 172.21.15.57:0/3317557925 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6144+0+0 (secure 0 0 0) 0x7f758807e640 con 0x7f75a00c9ed0 2023-10-06T03:02:27.472 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.466+0000 7f759ffff700 1 --2- 172.21.15.57:0/3317557925 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f7580060550 0x7f7580062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:27.473 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.466+0000 7f759ffff700 1 --2- 172.21.15.57:0/3317557925 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f7580060550 0x7f7580062a00 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f75900017a0 tx=0x7f7590009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:27.480 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.474+0000 7f759cff9700 1 -- 172.21.15.57:0/3317557925 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f758804ea80 con 0x7f75a00c9ed0 2023-10-06T03:02:27.684 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.678+0000 7f75a568e700 1 -- 172.21.15.57:0/3317557925 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f75a00caa40 con 0x7f75a00c9ed0 2023-10-06T03:02:27.685 INFO:tasks.ceph.mon.a.smithi057.stderr:2023-10-06T03:02:27.678+0000 7f3ec61a3700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T03:02:27.696 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.690+0000 7f759cff9700 1 -- 172.21.15.57:0/3317557925 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v24) v1 ==== 161+0+0 (secure 0 0 0) 0x7f75880520a0 con 0x7f75a00c9ed0 2023-10-06T03:02:27.700 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.694+0000 7f75a568e700 1 -- 172.21.15.57:0/3317557925 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f7580060550 msgr2=0x7f7580062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:27.700 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.694+0000 7f75a568e700 1 --2- 172.21.15.57:0/3317557925 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f7580060550 0x7f7580062a00 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f75900017a0 tx=0x7f7590009040 comp rx=0 tx=0).stop 2023-10-06T03:02:27.700 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.694+0000 7f75a568e700 1 -- 172.21.15.57:0/3317557925 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f75a00c9ed0 msgr2=0x7f75a0147d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:27.700 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.694+0000 7f75a568e700 1 --2- 172.21.15.57:0/3317557925 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f75a00c9ed0 0x7f75a0147d90 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f75a006b040 tx=0x7f7588017000 comp rx=0 tx=0).stop 2023-10-06T03:02:27.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.694+0000 7f75a568e700 1 -- 172.21.15.57:0/3317557925 shutdown_connections 2023-10-06T03:02:27.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.694+0000 7f75a568e700 1 --2- 172.21.15.57:0/3317557925 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f7580060550 0x7f7580062a00 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:27.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.694+0000 7f75a568e700 1 --2- 172.21.15.57:0/3317557925 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f75a0161180 0x7f75a00c2db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:27.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.694+0000 7f75a568e700 1 --2- 172.21.15.57:0/3317557925 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f75a00c9ed0 0x7f75a0147d90 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:27.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.694+0000 7f75a568e700 1 --2- 172.21.15.57:0/3317557925 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f75a00c9b00 0x7f75a00af370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:27.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.694+0000 7f75a568e700 1 -- 172.21.15.57:0/3317557925 >> 172.21.15.57:0/3317557925 conn(0x7f75a0067b00 msgr2=0x7f75a00697a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:27.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.694+0000 7f75a568e700 1 -- 172.21.15.57:0/3317557925 shutdown_connections 2023-10-06T03:02:27.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.694+0000 7f75a568e700 1 -- 172.21.15.57:0/3317557925 wait complete. 2023-10-06T03:02:27.702 INFO:teuthology.orchestra.run.smithi057.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T03:02:27.710 INFO:tasks.ceph.mds.d.smithi105.stderr: -8624> 2023-10-06T03:02:00.808+0000 7f519e48b700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T03:02:27.720 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-06T03:02:27.761 INFO:tasks.ceph.mds.d.smithi105.stdout:starting mds.d at 2023-10-06T03:02:27.882 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.874+0000 7fe9b6ce3700 1 Processor -- start 2023-10-06T03:02:27.883 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.878+0000 7fe9b6ce3700 1 -- start start 2023-10-06T03:02:27.886 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.878+0000 7fe9b6ce3700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fe9b0158d40 0x7fe9b0159110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:27.886 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.878+0000 7fe9b6ce3700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe9b00afcb0 0x7fe9b015d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:27.887 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.882+0000 7fe9b6ce3700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9b015db00 con 0x7fe9b00cc830 2023-10-06T03:02:27.887 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.882+0000 7fe9b6ce3700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9b00caa50 con 0x7fe9b0158d40 2023-10-06T03:02:27.887 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.882+0000 7fe9b6ce3700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9b00cad30 con 0x7fe9b00afcb0 2023-10-06T03:02:27.887 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.882+0000 7fe9b64e2700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fe9b00cc830 0x7fe9b00cccb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:45474/0 (socket says 172.21.15.57:45474) 2023-10-06T03:02:27.887 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.882+0000 7fe9b64e2700 1 -- 172.21.15.57:0/6190294 learned_addr learned my addr 172.21.15.57:0/6190294 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:02:27.888 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.882+0000 7fe9b54e0700 1 --2- 172.21.15.57:0/6190294 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe9b00afcb0 0x7fe9b015d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:27.888 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.882+0000 7fe9b5ce1700 1 --2- 172.21.15.57:0/6190294 >> v2:172.21.15.105:3300/0 conn(0x7fe9b0158d40 0x7fe9b0159110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:27.888 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.882+0000 7fe9b4cdf700 1 -- 172.21.15.57:0/6190294 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3893846957 0 0) 0x7fe9b015db00 con 0x7fe9b00cc830 2023-10-06T03:02:27.888 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.882+0000 7fe9b4cdf700 1 -- 172.21.15.57:0/6190294 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe99c003570 con 0x7fe9b00cc830 2023-10-06T03:02:27.889 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.882+0000 7fe9b5ce1700 1 -- 172.21.15.57:0/6190294 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe9b00afcb0 msgr2=0x7fe9b015d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:27.889 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.882+0000 7fe9b5ce1700 1 --2- 172.21.15.57:0/6190294 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe9b00afcb0 0x7fe9b015d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:27.889 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.882+0000 7fe9b5ce1700 1 -- 172.21.15.57:0/6190294 >> v1:172.21.15.57:6789/0 conn(0x7fe9b00cc830 legacy=0x7fe9b00cccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:27.889 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.882+0000 7fe9b5ce1700 1 -- 172.21.15.57:0/6190294 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9b00cb140 con 0x7fe9b0158d40 2023-10-06T03:02:27.889 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.882+0000 7fe9b54e0700 1 --2- 172.21.15.57:0/6190294 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe9b00afcb0 0x7fe9b015d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:02:27.890 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.882+0000 7fe9b5ce1700 1 --2- 172.21.15.57:0/6190294 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe9b0158d40 0x7fe9b0159110 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac0098e0 tx=0x7fe9ac0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e1ac53da6abc84a2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:27.890 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.882+0000 7fe9b4cdf700 1 -- 172.21.15.57:0/6190294 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9ac011630 con 0x7fe9b0158d40 2023-10-06T03:02:27.890 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.882+0000 7fe9b4cdf700 1 -- 172.21.15.57:0/6190294 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9ac011790 con 0x7fe9b0158d40 2023-10-06T03:02:27.890 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.882+0000 7fe9b4cdf700 1 -- 172.21.15.57:0/6190294 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9ac011b30 con 0x7fe9b0158d40 2023-10-06T03:02:27.890 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.882+0000 7fe9b6ce3700 1 -- 172.21.15.57:0/6190294 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe9b0158d40 msgr2=0x7fe9b0159110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:27.890 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.882+0000 7fe9b6ce3700 1 --2- 172.21.15.57:0/6190294 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe9b0158d40 0x7fe9b0159110 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac0098e0 tx=0x7fe9ac0091a0 comp rx=0 tx=0).stop 2023-10-06T03:02:27.891 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.882+0000 7fe9b6ce3700 1 -- 172.21.15.57:0/6190294 shutdown_connections 2023-10-06T03:02:27.891 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.882+0000 7fe9b6ce3700 1 --2- 172.21.15.57:0/6190294 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe9b00afcb0 0x7fe9b015d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:27.891 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.882+0000 7fe9b6ce3700 1 --2- 172.21.15.57:0/6190294 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe9b0158d40 0x7fe9b0159110 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:27.891 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.882+0000 7fe9b6ce3700 1 -- 172.21.15.57:0/6190294 >> 172.21.15.57:0/6190294 conn(0x7fe9b0067940 msgr2=0x7fe9b0067d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:27.891 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.886+0000 7fe9b6ce3700 1 -- 172.21.15.57:0/6190294 shutdown_connections 2023-10-06T03:02:27.891 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.886+0000 7fe9b6ce3700 1 -- 172.21.15.57:0/6190294 wait complete. 2023-10-06T03:02:27.892 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.886+0000 7fe9b6ce3700 1 Processor -- start 2023-10-06T03:02:27.892 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.886+0000 7fe9b6ce3700 1 -- start start 2023-10-06T03:02:27.893 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.886+0000 7fe9b6ce3700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe9b00afcb0 0x7fe9b0149f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:27.894 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.886+0000 7fe9b6ce3700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe9b00cc830 0x7fe9b01487d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:27.894 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.886+0000 7fe9b6ce3700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe9b0158d40 0x7fe9b0148d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:27.894 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.886+0000 7fe9b6ce3700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9b00c7150 con 0x7fe9b00afcb0 2023-10-06T03:02:27.894 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.886+0000 7fe9b6ce3700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9b014c060 con 0x7fe9b00cc830 2023-10-06T03:02:27.894 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.886+0000 7fe9b6ce3700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9b014c340 con 0x7fe9b0158d40 2023-10-06T03:02:27.895 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.886+0000 7fe9b5ce1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe9b00afcb0 0x7fe9b0149f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:27.895 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.886+0000 7fe9b5ce1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe9b00afcb0 0x7fe9b0149f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:49930/0 (socket says 172.21.15.57:49930) 2023-10-06T03:02:27.895 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.886+0000 7fe9b5ce1700 1 -- 172.21.15.57:0/3347325820 learned_addr learned my addr 172.21.15.57:0/3347325820 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:02:27.895 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.890+0000 7fe9b64e2700 1 --2- 172.21.15.57:0/3347325820 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe9b0158d40 0x7fe9b0148d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:27.895 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.890+0000 7fe9b54e0700 1 --2- 172.21.15.57:0/3347325820 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe9b00cc830 0x7fe9b01487d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:27.896 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.890+0000 7fe9b5ce1700 1 -- 172.21.15.57:0/3347325820 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe9b0158d40 msgr2=0x7fe9b0148d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:27.896 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.890+0000 7fe9b5ce1700 1 --2- 172.21.15.57:0/3347325820 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe9b0158d40 0x7fe9b0148d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:27.896 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.890+0000 7fe9b5ce1700 1 -- 172.21.15.57:0/3347325820 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe9b00cc830 msgr2=0x7fe9b01487d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:27.896 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.890+0000 7fe9b5ce1700 1 --2- 172.21.15.57:0/3347325820 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe9b00cc830 0x7fe9b01487d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:27.896 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.890+0000 7fe9b5ce1700 1 -- 172.21.15.57:0/3347325820 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9a0009420 con 0x7fe9b00afcb0 2023-10-06T03:02:27.896 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.890+0000 7fe9b5ce1700 1 --2- 172.21.15.57:0/3347325820 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe9b00afcb0 0x7fe9b0149f70 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fe9b0089140 tx=0x7fe9ac017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:27.897 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.890+0000 7fe9a5ffb700 1 -- 172.21.15.57:0/3347325820 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9ac011900 con 0x7fe9b00afcb0 2023-10-06T03:02:27.897 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.890+0000 7fe9a5ffb700 1 -- 172.21.15.57:0/3347325820 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9ac011a60 con 0x7fe9b00afcb0 2023-10-06T03:02:27.897 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.890+0000 7fe9a5ffb700 1 -- 172.21.15.57:0/3347325820 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9ac023620 con 0x7fe9b00afcb0 2023-10-06T03:02:27.897 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.890+0000 7fe9b6ce3700 1 -- 172.21.15.57:0/3347325820 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9ac009420 con 0x7fe9b00afcb0 2023-10-06T03:02:27.897 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.890+0000 7fe9b6ce3700 1 -- 172.21.15.57:0/3347325820 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9b00c7680 con 0x7fe9b00afcb0 2023-10-06T03:02:27.898 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.890+0000 7fe9b6ce3700 1 -- 172.21.15.57:0/3347325820 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9b014c500 con 0x7fe9b00afcb0 2023-10-06T03:02:27.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.894+0000 7fe9a5ffb700 1 -- 172.21.15.57:0/3347325820 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fe9ac02c3b0 con 0x7fe9b00afcb0 2023-10-06T03:02:27.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.894+0000 7fe9a5ffb700 1 --2- 172.21.15.57:0/3347325820 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fe994060550 0x7fe994062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:27.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.894+0000 7fe9a5ffb700 1 -- 172.21.15.57:0/3347325820 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6230+0+0 (secure 0 0 0) 0x7fe9ac07dcb0 con 0x7fe9b00afcb0 2023-10-06T03:02:27.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.894+0000 7fe9b54e0700 1 --2- 172.21.15.57:0/3347325820 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fe994060550 0x7fe994062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:27.902 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.898+0000 7fe9b54e0700 1 --2- 172.21.15.57:0/3347325820 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fe994060550 0x7fe994062a00 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe9b00ce630 tx=0x7fe9a00091a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:27.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:27.902+0000 7fe9a5ffb700 1 -- 172.21.15.57:0/3347325820 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fe9ac04e0f0 con 0x7fe9b00afcb0 2023-10-06T03:02:28.118 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:28.110+0000 7fe9b6ce3700 1 -- 172.21.15.57:0/3347325820 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fe9b00cb420 con 0x7fe9b00afcb0 2023-10-06T03:02:28.730 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:28.722+0000 7fe9a5ffb700 1 -- 172.21.15.57:0/3347325820 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v25) v1 ==== 104+0+0 (secure 0 0 0) 0x7fe9ac051690 con 0x7fe9b00afcb0 2023-10-06T03:02:28.735 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:28.730+0000 7fe9b6ce3700 1 -- 172.21.15.57:0/3347325820 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fe994060550 msgr2=0x7fe994062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:28.736 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:28.730+0000 7fe9b6ce3700 1 --2- 172.21.15.57:0/3347325820 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fe994060550 0x7fe994062a00 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe9b00ce630 tx=0x7fe9a00091a0 comp rx=0 tx=0).stop 2023-10-06T03:02:28.736 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:28.730+0000 7fe9b6ce3700 1 -- 172.21.15.57:0/3347325820 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe9b00afcb0 msgr2=0x7fe9b0149f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:28.736 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:28.730+0000 7fe9b6ce3700 1 --2- 172.21.15.57:0/3347325820 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe9b00afcb0 0x7fe9b0149f70 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fe9b0089140 tx=0x7fe9ac017000 comp rx=0 tx=0).stop 2023-10-06T03:02:28.736 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:28.730+0000 7fe9b6ce3700 1 -- 172.21.15.57:0/3347325820 shutdown_connections 2023-10-06T03:02:28.736 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:28.730+0000 7fe9b6ce3700 1 --2- 172.21.15.57:0/3347325820 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fe994060550 0x7fe994062a00 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:28.736 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:28.730+0000 7fe9b6ce3700 1 --2- 172.21.15.57:0/3347325820 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe9b0158d40 0x7fe9b0148d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:28.736 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:28.730+0000 7fe9b6ce3700 1 --2- 172.21.15.57:0/3347325820 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe9b00cc830 0x7fe9b01487d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:28.736 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:28.730+0000 7fe9b6ce3700 1 --2- 172.21.15.57:0/3347325820 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe9b00afcb0 0x7fe9b0149f70 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:28.736 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:28.730+0000 7fe9b6ce3700 1 -- 172.21.15.57:0/3347325820 >> 172.21.15.57:0/3347325820 conn(0x7fe9b0067940 msgr2=0x7fe9b00c69d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:28.736 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:28.730+0000 7fe9b6ce3700 1 -- 172.21.15.57:0/3347325820 shutdown_connections 2023-10-06T03:02:28.736 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:28.730+0000 7fe9b6ce3700 1 -- 172.21.15.57:0/3347325820 wait complete. 2023-10-06T03:02:28.757 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-06T03:02:28.924 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:28.918+0000 7fd46a523700 1 Processor -- start 2023-10-06T03:02:28.924 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:28.918+0000 7fd46a523700 1 -- start start 2023-10-06T03:02:28.928 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:28.922+0000 7fd46a523700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd464160860 0x7fd46415e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:28.929 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:28.922+0000 7fd46a523700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fd4640af120 0x7fd46415ef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:28.929 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:28.922+0000 7fd46a523700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4640b0f90 con 0x7fd464160c30 2023-10-06T03:02:28.929 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:28.922+0000 7fd46a523700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd46415e9f0 con 0x7fd4640af120 2023-10-06T03:02:28.929 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:28.922+0000 7fd46a523700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd464140900 con 0x7fd464160860 2023-10-06T03:02:28.929 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:28.922+0000 7fd468d20700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fd464160c30 0x7fd4640aea10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:45490/0 (socket says 172.21.15.57:45490) 2023-10-06T03:02:28.929 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:28.922+0000 7fd468d20700 1 -- 172.21.15.57:0/2393985964 learned_addr learned my addr 172.21.15.57:0/2393985964 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:02:28.930 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:28.922+0000 7fd469521700 1 --2- 172.21.15.57:0/2393985964 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd464160860 0x7fd46415e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:28.930 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:28.922+0000 7fd469d22700 1 --2- 172.21.15.57:0/2393985964 >> v2:172.21.15.105:3300/0 conn(0x7fd4640af120 0x7fd46415ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:28.930 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:28.922+0000 7fd45bfff700 1 -- 172.21.15.57:0/2393985964 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4182034737 0 0) 0x7fd4640b0f90 con 0x7fd464160c30 2023-10-06T03:02:28.931 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:28.922+0000 7fd45bfff700 1 -- 172.21.15.57:0/2393985964 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd450003570 con 0x7fd464160c30 2023-10-06T03:02:28.931 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:28.922+0000 7fd469d22700 1 -- 172.21.15.57:0/2393985964 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd464160860 msgr2=0x7fd46415e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:28.931 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:28.922+0000 7fd469d22700 1 --2- 172.21.15.57:0/2393985964 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd464160860 0x7fd46415e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:28.931 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:28.922+0000 7fd469d22700 1 -- 172.21.15.57:0/2393985964 >> v1:172.21.15.57:6789/0 conn(0x7fd464160c30 legacy=0x7fd4640aea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:28.931 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:28.922+0000 7fd469d22700 1 -- 172.21.15.57:0/2393985964 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4640b1270 con 0x7fd4640af120 2023-10-06T03:02:28.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:28.926+0000 7fd469d22700 1 --2- 172.21.15.57:0/2393985964 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd4640af120 0x7fd46415ef30 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd45c009e90 tx=0x7fd45c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cfe5366b631e2350 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:28.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:28.926+0000 7fd45bfff700 1 -- 172.21.15.57:0/2393985964 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd45c00e070 con 0x7fd4640af120 2023-10-06T03:02:28.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:28.926+0000 7fd45bfff700 1 -- 172.21.15.57:0/2393985964 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd45c00bb40 con 0x7fd4640af120 2023-10-06T03:02:28.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:28.926+0000 7fd45bfff700 1 -- 172.21.15.57:0/2393985964 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd45c012430 con 0x7fd4640af120 2023-10-06T03:02:28.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:28.926+0000 7fd46a523700 1 -- 172.21.15.57:0/2393985964 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd4640af120 msgr2=0x7fd46415ef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:28.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:28.926+0000 7fd46a523700 1 --2- 172.21.15.57:0/2393985964 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd4640af120 0x7fd46415ef30 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd45c009e90 tx=0x7fd45c009780 comp rx=0 tx=0).stop 2023-10-06T03:02:28.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:28.926+0000 7fd46a523700 1 -- 172.21.15.57:0/2393985964 shutdown_connections 2023-10-06T03:02:28.933 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:28.926+0000 7fd46a523700 1 --2- 172.21.15.57:0/2393985964 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd4640af120 0x7fd46415ef30 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:28.933 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:28.926+0000 7fd46a523700 1 --2- 172.21.15.57:0/2393985964 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd464160860 0x7fd46415e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:28.933 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:28.926+0000 7fd46a523700 1 -- 172.21.15.57:0/2393985964 >> 172.21.15.57:0/2393985964 conn(0x7fd464067030 msgr2=0x7fd464067430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:28.933 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:28.926+0000 7fd46a523700 1 -- 172.21.15.57:0/2393985964 shutdown_connections 2023-10-06T03:02:28.933 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:28.926+0000 7fd46a523700 1 -- 172.21.15.57:0/2393985964 wait complete. 2023-10-06T03:02:28.934 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:28.930+0000 7fd46a523700 1 Processor -- start 2023-10-06T03:02:28.935 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:28.930+0000 7fd46a523700 1 -- start start 2023-10-06T03:02:28.936 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:28.930+0000 7fd46a523700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd4640af120 0x7fd4640ac000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:28.936 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:28.930+0000 7fd46a523700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd464160860 0x7fd464159bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:28.936 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:28.930+0000 7fd46a523700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd464160c30 0x7fd46416dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:28.936 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:28.930+0000 7fd46a523700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4640a8e70 con 0x7fd464160860 2023-10-06T03:02:28.936 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:28.930+0000 7fd46a523700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4640ac6d0 con 0x7fd464160c30 2023-10-06T03:02:28.936 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:28.930+0000 7fd46a523700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd46415a110 con 0x7fd4640af120 2023-10-06T03:02:28.937 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:28.930+0000 7fd468d20700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd464160860 0x7fd464159bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:28.937 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:28.930+0000 7fd468d20700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd464160860 0x7fd464159bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:49936/0 (socket says 172.21.15.57:49936) 2023-10-06T03:02:28.938 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:28.930+0000 7fd468d20700 1 -- 172.21.15.57:0/2988848959 learned_addr learned my addr 172.21.15.57:0/2988848959 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:02:28.938 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:28.930+0000 7fd469521700 1 --2- 172.21.15.57:0/2988848959 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd4640af120 0x7fd4640ac000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:28.938 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:28.930+0000 7fd469d22700 1 --2- 172.21.15.57:0/2988848959 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd464160c30 0x7fd46416dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:28.938 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:28.930+0000 7fd468d20700 1 -- 172.21.15.57:0/2988848959 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd4640af120 msgr2=0x7fd4640ac000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:28.938 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:28.930+0000 7fd468d20700 1 --2- 172.21.15.57:0/2988848959 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd4640af120 0x7fd4640ac000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:28.938 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:28.930+0000 7fd468d20700 1 -- 172.21.15.57:0/2988848959 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd464160c30 msgr2=0x7fd46416dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:28.938 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:28.930+0000 7fd468d20700 1 --2- 172.21.15.57:0/2988848959 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd464160c30 0x7fd46416dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:28.938 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:28.930+0000 7fd468d20700 1 -- 172.21.15.57:0/2988848959 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd45c009a20 con 0x7fd464160860 2023-10-06T03:02:28.939 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:28.930+0000 7fd468d20700 1 --2- 172.21.15.57:0/2988848959 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd464160860 0x7fd464159bd0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fd45400c820 tx=0x7fd454007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:28.939 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:28.930+0000 7fd4597fa700 1 -- 172.21.15.57:0/2988848959 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd454005cd0 con 0x7fd464160860 2023-10-06T03:02:28.939 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:28.930+0000 7fd4597fa700 1 -- 172.21.15.57:0/2988848959 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd454005e50 con 0x7fd464160860 2023-10-06T03:02:28.939 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:28.934+0000 7fd46a523700 1 -- 172.21.15.57:0/2988848959 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4640a8540 con 0x7fd464160860 2023-10-06T03:02:28.939 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:28.934+0000 7fd4597fa700 1 -- 172.21.15.57:0/2988848959 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd454007320 con 0x7fd464160860 2023-10-06T03:02:28.939 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:28.934+0000 7fd46a523700 1 -- 172.21.15.57:0/2988848959 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4640a8b00 con 0x7fd464160860 2023-10-06T03:02:28.940 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:28.934+0000 7fd46a523700 1 -- 172.21.15.57:0/2988848959 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd46415a250 con 0x7fd464160860 2023-10-06T03:02:28.941 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:28.934+0000 7fd4597fa700 1 -- 172.21.15.57:0/2988848959 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fd454007690 con 0x7fd464160860 2023-10-06T03:02:28.943 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:28.938+0000 7fd4597fa700 1 --2- 172.21.15.57:0/2988848959 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fd448060580 0x7fd448062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:28.943 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:28.938+0000 7fd4597fa700 1 -- 172.21.15.57:0/2988848959 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6230+0+0 (secure 0 0 0) 0x7fd45407c090 con 0x7fd464160860 2023-10-06T03:02:28.943 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:28.938+0000 7fd469521700 1 --2- 172.21.15.57:0/2988848959 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fd448060580 0x7fd448062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:28.944 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:28.938+0000 7fd469521700 1 --2- 172.21.15.57:0/2988848959 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fd448060580 0x7fd448062a30 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fd460009db0 tx=0x7fd4600091a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:28.949 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:28.942+0000 7fd4597fa700 1 -- 172.21.15.57:0/2988848959 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fd46415a250 con 0x7fd464160860 2023-10-06T03:02:29.120 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:29.114+0000 7fd46a523700 1 -- 172.21.15.57:0/2988848959 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd46415a250 con 0x7fd464160860 2023-10-06T03:02:29.740 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:29.734+0000 7fd4597fa700 1 -- 172.21.15.57:0/2988848959 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v41) v1 ==== 181+0+0 (secure 0 0 0) 0x7fd46415a250 con 0x7fd464160860 2023-10-06T03:02:29.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:29.738+0000 7fd46a523700 1 -- 172.21.15.57:0/2988848959 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fd448060580 msgr2=0x7fd448062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:29.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:29.738+0000 7fd46a523700 1 --2- 172.21.15.57:0/2988848959 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fd448060580 0x7fd448062a30 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fd460009db0 tx=0x7fd4600091a0 comp rx=0 tx=0).stop 2023-10-06T03:02:29.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:29.738+0000 7fd46a523700 1 -- 172.21.15.57:0/2988848959 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd464160860 msgr2=0x7fd464159bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:29.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:29.738+0000 7fd46a523700 1 --2- 172.21.15.57:0/2988848959 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd464160860 0x7fd464159bd0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fd45400c820 tx=0x7fd454007e00 comp rx=0 tx=0).stop 2023-10-06T03:02:29.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:29.738+0000 7fd46a523700 1 -- 172.21.15.57:0/2988848959 shutdown_connections 2023-10-06T03:02:29.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:29.738+0000 7fd46a523700 1 --2- 172.21.15.57:0/2988848959 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd464160c30 0x7fd46416dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:29.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:29.738+0000 7fd46a523700 1 --2- 172.21.15.57:0/2988848959 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd464160860 0x7fd464159bd0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:29.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:29.738+0000 7fd46a523700 1 --2- 172.21.15.57:0/2988848959 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fd448060580 0x7fd448062a30 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:29.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:29.738+0000 7fd46a523700 1 --2- 172.21.15.57:0/2988848959 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd4640af120 0x7fd4640ac000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:29.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:29.738+0000 7fd46a523700 1 -- 172.21.15.57:0/2988848959 >> 172.21.15.57:0/2988848959 conn(0x7fd464067030 msgr2=0x7fd46415dac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:29.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:29.738+0000 7fd46a523700 1 -- 172.21.15.57:0/2988848959 shutdown_connections 2023-10-06T03:02:29.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:29.738+0000 7fd46a523700 1 -- 172.21.15.57:0/2988848959 wait complete. 2023-10-06T03:02:29.748 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_metadata' removed 2023-10-06T03:02:29.765 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-06T03:02:29.934 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:29.926+0000 7f949f59e700 1 Processor -- start 2023-10-06T03:02:29.934 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:29.926+0000 7f949f59e700 1 -- start start 2023-10-06T03:02:29.937 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:29.930+0000 7f949f59e700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f94a0156fe0 0x7f94a0068a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:29.937 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:29.930+0000 7f949f59e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94a0156b50 con 0x7f94a01538a0 2023-10-06T03:02:29.937 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:29.930+0000 7f949f59e700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94a0069400 con 0x7f94a0068fc0 2023-10-06T03:02:29.937 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:29.930+0000 7f949f59e700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94a0156300 con 0x7f94a0156fe0 2023-10-06T03:02:29.937 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:29.930+0000 7f949e59c700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f94a01538a0 0x7f94a00af890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:45506/0 (socket says 172.21.15.57:45506) 2023-10-06T03:02:29.937 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:29.930+0000 7f949e59c700 1 -- 172.21.15.57:0/2884547567 learned_addr learned my addr 172.21.15.57:0/2884547567 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:02:29.938 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:29.930+0000 7f949dd9b700 1 --2- 172.21.15.57:0/2884547567 >> v2:172.21.15.105:3300/0 conn(0x7f94a0156fe0 0x7f94a0068a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:29.939 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:29.930+0000 7f949d59a700 1 -- 172.21.15.57:0/2884547567 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2624044327 0 0) 0x7f94a0069400 con 0x7f94a0068fc0 2023-10-06T03:02:29.939 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:29.930+0000 7f949d59a700 1 -- 172.21.15.57:0/2884547567 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9488003570 con 0x7f94a0068fc0 2023-10-06T03:02:29.939 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:29.930+0000 7f949d59a700 1 -- 172.21.15.57:0/2884547567 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1535147242 0 0) 0x7f94a0156b50 con 0x7f94a01538a0 2023-10-06T03:02:29.939 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:29.934+0000 7f949d59a700 1 -- 172.21.15.57:0/2884547567 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94a0069400 con 0x7f94a01538a0 2023-10-06T03:02:29.939 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:29.934+0000 7f949dd9b700 1 -- 172.21.15.57:0/2884547567 >> v1:172.21.15.105:6789/0 conn(0x7f94a0068fc0 legacy=0x7f94a0159960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:29.939 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:29.934+0000 7f949dd9b700 1 -- 172.21.15.57:0/2884547567 >> v1:172.21.15.57:6789/0 conn(0x7f94a01538a0 legacy=0x7f94a00af890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:29.939 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:29.934+0000 7f949dd9b700 1 -- 172.21.15.57:0/2884547567 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94a00b02e0 con 0x7f94a0156fe0 2023-10-06T03:02:29.939 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:29.934+0000 7f949dd9b700 1 --2- 172.21.15.57:0/2884547567 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f94a0156fe0 0x7f94a0068a80 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f94940098e0 tx=0x7f94940091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a3abffb4d393fcc0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:29.940 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:29.934+0000 7f949d59a700 1 -- 172.21.15.57:0/2884547567 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9494011630 con 0x7f94a0156fe0 2023-10-06T03:02:29.940 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:29.934+0000 7f949d59a700 1 -- 172.21.15.57:0/2884547567 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9494011790 con 0x7f94a0156fe0 2023-10-06T03:02:29.940 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:29.934+0000 7f949d59a700 1 -- 172.21.15.57:0/2884547567 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9494011b30 con 0x7f94a0156fe0 2023-10-06T03:02:29.941 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:29.934+0000 7f949f59e700 1 -- 172.21.15.57:0/2884547567 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f94a0156fe0 msgr2=0x7f94a0068a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:29.941 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:29.934+0000 7f949f59e700 1 --2- 172.21.15.57:0/2884547567 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f94a0156fe0 0x7f94a0068a80 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f94940098e0 tx=0x7f94940091a0 comp rx=0 tx=0).stop 2023-10-06T03:02:29.941 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:29.934+0000 7f949f59e700 1 -- 172.21.15.57:0/2884547567 shutdown_connections 2023-10-06T03:02:29.942 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:29.934+0000 7f949f59e700 1 --2- 172.21.15.57:0/2884547567 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f94a0156fe0 0x7f94a0068a80 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:29.942 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:29.934+0000 7f949f59e700 1 -- 172.21.15.57:0/2884547567 >> 172.21.15.57:0/2884547567 conn(0x7f94a0067030 msgr2=0x7f94a0067430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:29.942 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:29.934+0000 7f949f59e700 1 -- 172.21.15.57:0/2884547567 shutdown_connections 2023-10-06T03:02:29.942 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:29.934+0000 7f949f59e700 1 -- 172.21.15.57:0/2884547567 wait complete. 2023-10-06T03:02:29.943 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:29.938+0000 7f949f59e700 1 Processor -- start 2023-10-06T03:02:29.944 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:29.938+0000 7f949f59e700 1 -- start start 2023-10-06T03:02:29.945 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:29.938+0000 7f949f59e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f94a0068fc0 0x7f94a0152bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:29.945 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:29.938+0000 7f949f59e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94a01538a0 0x7f94a00a5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:29.946 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:29.938+0000 7f949f59e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f94a0156fe0 0x7f94a00a6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:29.946 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:29.938+0000 7f949f59e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94a01509d0 con 0x7f94a0068fc0 2023-10-06T03:02:29.946 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:29.938+0000 7f949f59e700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94a0153100 con 0x7f94a0156fe0 2023-10-06T03:02:29.946 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:29.938+0000 7f949f59e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94a014fdc0 con 0x7f94a01538a0 2023-10-06T03:02:29.946 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:29.938+0000 7f949e59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f94a0068fc0 0x7f94a0152bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:29.946 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:29.938+0000 7f949e59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f94a0068fc0 0x7f94a0152bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:49940/0 (socket says 172.21.15.57:49940) 2023-10-06T03:02:29.946 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:29.938+0000 7f949e59c700 1 -- 172.21.15.57:0/3040524096 learned_addr learned my addr 172.21.15.57:0/3040524096 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:02:29.947 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:29.938+0000 7f949dd9b700 1 --2- 172.21.15.57:0/3040524096 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94a01538a0 0x7f94a00a5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:29.948 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:29.938+0000 7f949ed9d700 1 --2- 172.21.15.57:0/3040524096 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f94a0156fe0 0x7f94a00a6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:29.948 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:29.938+0000 7f949e59c700 1 -- 172.21.15.57:0/3040524096 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94a01538a0 msgr2=0x7f94a00a5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:29.948 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:29.938+0000 7f949e59c700 1 --2- 172.21.15.57:0/3040524096 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94a01538a0 0x7f94a00a5cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:29.948 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:29.938+0000 7f949e59c700 1 -- 172.21.15.57:0/3040524096 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f94a0156fe0 msgr2=0x7f94a00a6210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:29.948 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:29.938+0000 7f949e59c700 1 --2- 172.21.15.57:0/3040524096 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f94a0156fe0 0x7f94a00a6210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:29.948 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:29.938+0000 7f949e59c700 1 -- 172.21.15.57:0/3040524096 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9494009420 con 0x7f94a0068fc0 2023-10-06T03:02:29.948 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:29.938+0000 7f949ed9d700 1 --2- 172.21.15.57:0/3040524096 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f94a0156fe0 0x7f94a00a6210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:02:29.948 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:29.942+0000 7f949e59c700 1 --2- 172.21.15.57:0/3040524096 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f94a0068fc0 0x7f94a0152bc0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f949000c7c0 tx=0x7f9490007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:29.948 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:29.942+0000 7f948e7fc700 1 -- 172.21.15.57:0/3040524096 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9490005b30 con 0x7f94a0068fc0 2023-10-06T03:02:29.948 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:29.942+0000 7f948e7fc700 1 -- 172.21.15.57:0/3040524096 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9490005c90 con 0x7f94a0068fc0 2023-10-06T03:02:29.948 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:29.942+0000 7f949f59e700 1 -- 172.21.15.57:0/3040524096 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94a01500a0 con 0x7f94a0068fc0 2023-10-06T03:02:29.949 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:29.942+0000 7f948e7fc700 1 -- 172.21.15.57:0/3040524096 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9490007340 con 0x7f94a0068fc0 2023-10-06T03:02:29.949 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:29.942+0000 7f949f59e700 1 -- 172.21.15.57:0/3040524096 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94a0150660 con 0x7f94a0068fc0 2023-10-06T03:02:29.949 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:29.942+0000 7f949f59e700 1 -- 172.21.15.57:0/3040524096 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94a00645e0 con 0x7f94a0068fc0 2023-10-06T03:02:29.951 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:29.946+0000 7f948e7fc700 1 -- 172.21.15.57:0/3040524096 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f949001b400 con 0x7f94a0068fc0 2023-10-06T03:02:29.953 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:29.946+0000 7f948e7fc700 1 --2- 172.21.15.57:0/3040524096 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f9480060550 0x7f9480062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:29.953 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:29.946+0000 7f948e7fc700 1 -- 172.21.15.57:0/3040524096 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5792+0+0 (secure 0 0 0) 0x7f949007c380 con 0x7f94a0068fc0 2023-10-06T03:02:29.953 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:29.946+0000 7f949dd9b700 1 --2- 172.21.15.57:0/3040524096 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f9480060550 0x7f9480062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:29.954 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:29.950+0000 7f949dd9b700 1 --2- 172.21.15.57:0/3040524096 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f9480060550 0x7f9480062a00 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f94940093f0 tx=0x7f9494017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:29.959 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:29.954+0000 7f948e7fc700 1 -- 172.21.15.57:0/3040524096 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f949004c920 con 0x7f94a0068fc0 2023-10-06T03:02:30.127 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:30.122+0000 7f949f59e700 1 -- 172.21.15.57:0/3040524096 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f94a0156500 con 0x7f94a0068fc0 2023-10-06T03:02:30.771 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:30.766+0000 7f948e7fc700 1 -- 172.21.15.57:0/3040524096 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v42) v1 ==== 169+0+0 (secure 0 0 0) 0x7f949004ff40 con 0x7f94a0068fc0 2023-10-06T03:02:30.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:30.770+0000 7f949f59e700 1 -- 172.21.15.57:0/3040524096 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f9480060550 msgr2=0x7f9480062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:30.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:30.770+0000 7f949f59e700 1 --2- 172.21.15.57:0/3040524096 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f9480060550 0x7f9480062a00 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f94940093f0 tx=0x7f9494017000 comp rx=0 tx=0).stop 2023-10-06T03:02:30.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:30.770+0000 7f949f59e700 1 -- 172.21.15.57:0/3040524096 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f94a0068fc0 msgr2=0x7f94a0152bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:30.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:30.770+0000 7f949f59e700 1 --2- 172.21.15.57:0/3040524096 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f94a0068fc0 0x7f94a0152bc0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f949000c7c0 tx=0x7f9490007e00 comp rx=0 tx=0).stop 2023-10-06T03:02:30.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:30.770+0000 7f949f59e700 1 -- 172.21.15.57:0/3040524096 shutdown_connections 2023-10-06T03:02:30.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:30.770+0000 7f949f59e700 1 --2- 172.21.15.57:0/3040524096 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f94a0156fe0 0x7f94a00a6210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:30.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:30.770+0000 7f949f59e700 1 --2- 172.21.15.57:0/3040524096 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f9480060550 0x7f9480062a00 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:30.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:30.770+0000 7f949f59e700 1 --2- 172.21.15.57:0/3040524096 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94a01538a0 0x7f94a00a5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:30.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:30.770+0000 7f949f59e700 1 --2- 172.21.15.57:0/3040524096 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f94a0068fc0 0x7f94a0152bc0 secure :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f949000c7c0 tx=0x7f9490007e00 comp rx=0 tx=0).stop 2023-10-06T03:02:30.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:30.770+0000 7f949f59e700 1 -- 172.21.15.57:0/3040524096 >> 172.21.15.57:0/3040524096 conn(0x7f94a0067030 msgr2=0x7f94a014d270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:30.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:30.770+0000 7f949f59e700 1 -- 172.21.15.57:0/3040524096 shutdown_connections 2023-10-06T03:02:30.778 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:30.770+0000 7f949f59e700 1 -- 172.21.15.57:0/3040524096 wait complete. 2023-10-06T03:02:30.781 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_data' removed 2023-10-06T03:02:30.801 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-06T03:02:30.804 DEBUG:teuthology.orchestra.run.smithi105:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-06T03:02:30.873 INFO:teuthology.orchestra.run.smithi057.stdout:[global] 2023-10-06T03:02:30.873 INFO:teuthology.orchestra.run.smithi057.stdout: chdir = "" 2023-10-06T03:02:30.873 INFO:teuthology.orchestra.run.smithi057.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-06T03:02:30.873 INFO:teuthology.orchestra.run.smithi057.stdout: auth supported = cephx 2023-10-06T03:02:30.873 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:02:30.873 INFO:teuthology.orchestra.run.smithi057.stdout: filestore xattr use omap = true 2023-10-06T03:02:30.873 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:02:30.874 INFO:teuthology.orchestra.run.smithi057.stdout: mon clock drift allowed = 1.000 2023-10-06T03:02:30.874 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:02:30.874 INFO:teuthology.orchestra.run.smithi057.stdout: osd crush chooseleaf type = 0 2023-10-06T03:02:30.874 INFO:teuthology.orchestra.run.smithi057.stdout: auth debug = true 2023-10-06T03:02:30.874 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:02:30.874 INFO:teuthology.orchestra.run.smithi057.stdout: ms die on old message = true 2023-10-06T03:02:30.874 INFO:teuthology.orchestra.run.smithi057.stdout: ms die on bug = true 2023-10-06T03:02:30.874 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:02:30.874 INFO:teuthology.orchestra.run.smithi057.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-06T03:02:30.874 INFO:teuthology.orchestra.run.smithi057.stdout: mon pg warn max object skew = 0 2023-10-06T03:02:30.874 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:02:30.874 INFO:teuthology.orchestra.run.smithi057.stdout: # disable pg_autoscaler by default for new pools 2023-10-06T03:02:30.875 INFO:teuthology.orchestra.run.smithi057.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-06T03:02:30.875 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:02:30.875 INFO:teuthology.orchestra.run.smithi057.stdout: osd pool default size = 2 2023-10-06T03:02:30.875 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:02:30.875 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd allow primary affinity = true 2023-10-06T03:02:30.875 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd allow pg remap = true 2023-10-06T03:02:30.875 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on legacy crush tunables = false 2023-10-06T03:02:30.875 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on crush straw calc version zero = false 2023-10-06T03:02:30.875 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on no sortbitwise = false 2023-10-06T03:02:30.875 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on osd down out interval zero = false 2023-10-06T03:02:30.875 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on too few osds = false 2023-10-06T03:02:30.875 INFO:teuthology.orchestra.run.smithi057.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-06T03:02:30.876 INFO:teuthology.orchestra.run.smithi057.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-06T03:02:30.876 INFO:teuthology.orchestra.run.smithi057.stdout: mon_allow_pool_size_one = true 2023-10-06T03:02:30.876 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:02:30.876 INFO:teuthology.orchestra.run.smithi057.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-06T03:02:30.876 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:02:30.876 INFO:teuthology.orchestra.run.smithi057.stdout: osd default data pool replay window = 5 2023-10-06T03:02:30.876 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:02:30.876 INFO:teuthology.orchestra.run.smithi057.stdout: mon allow pool delete = true 2023-10-06T03:02:30.876 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:02:30.876 INFO:teuthology.orchestra.run.smithi057.stdout: mon cluster log file level = debug 2023-10-06T03:02:30.876 INFO:teuthology.orchestra.run.smithi057.stdout: debug asserts on shutdown = true 2023-10-06T03:02:30.876 INFO:teuthology.orchestra.run.smithi057.stdout: mon health detail to clog = false 2023-10-06T03:02:30.876 INFO:teuthology.orchestra.run.smithi057.stdout: mon host = "172.21.15.57,172.21.15.105,[v2:172.21.15.105:3301,v1:172.21.15.105:6790]" 2023-10-06T03:02:30.877 INFO:teuthology.orchestra.run.smithi057.stdout: ms die on skipped message = False 2023-10-06T03:02:30.877 INFO:teuthology.orchestra.run.smithi057.stdout: fsid = eb56dc0f-9213-41cb-9aad-8ade6c802e98 2023-10-06T03:02:30.877 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:02:30.877 INFO:teuthology.orchestra.run.smithi057.stdout:[osd] 2023-10-06T03:02:30.877 INFO:teuthology.orchestra.run.smithi057.stdout: osd journal size = 100 2023-10-06T03:02:30.877 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:02:30.877 INFO:teuthology.orchestra.run.smithi057.stdout: osd scrub load threshold = 5.0 2023-10-06T03:02:30.877 INFO:teuthology.orchestra.run.smithi057.stdout: osd scrub max interval = 600 2023-10-06T03:02:30.877 INFO:teuthology.orchestra.run.smithi057.stdout: osd mclock profile = high_recovery_ops 2023-10-06T03:02:30.877 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:02:30.877 INFO:teuthology.orchestra.run.smithi057.stdout: osd recover clone overlap = true 2023-10-06T03:02:30.877 INFO:teuthology.orchestra.run.smithi057.stdout: osd recovery max chunk = 1048576 2023-10-06T03:02:30.877 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:02:30.878 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug shutdown = true 2023-10-06T03:02:30.878 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug op order = true 2023-10-06T03:02:30.878 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug verify stray on activate = true 2023-10-06T03:02:30.878 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:02:30.878 INFO:teuthology.orchestra.run.smithi057.stdout: osd open classes on start = true 2023-10-06T03:02:30.878 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug pg log writeout = true 2023-10-06T03:02:30.878 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:02:30.878 INFO:teuthology.orchestra.run.smithi057.stdout: osd deep scrub update digest min age = 30 2023-10-06T03:02:30.878 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:02:30.878 INFO:teuthology.orchestra.run.smithi057.stdout: osd map max advance = 10 2023-10-06T03:02:30.878 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:02:30.878 INFO:teuthology.orchestra.run.smithi057.stdout: journal zero on create = true 2023-10-06T03:02:30.879 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:02:30.879 INFO:teuthology.orchestra.run.smithi057.stdout: filestore ondisk finisher threads = 3 2023-10-06T03:02:30.879 INFO:teuthology.orchestra.run.smithi057.stdout: filestore apply finisher threads = 3 2023-10-06T03:02:30.879 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:02:30.879 INFO:teuthology.orchestra.run.smithi057.stdout: bdev debug aio = true 2023-10-06T03:02:30.879 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug misdirected ops = true 2023-10-06T03:02:30.879 INFO:teuthology.orchestra.run.smithi057.stdout: bdev async discard = True 2023-10-06T03:02:30.879 INFO:teuthology.orchestra.run.smithi057.stdout: bdev enable discard = True 2023-10-06T03:02:30.879 INFO:teuthology.orchestra.run.smithi057.stdout: bluestore allocator = bitmap 2023-10-06T03:02:30.879 INFO:teuthology.orchestra.run.smithi057.stdout: bluestore block size = 96636764160 2023-10-06T03:02:30.879 INFO:teuthology.orchestra.run.smithi057.stdout: bluestore fsck on mount = True 2023-10-06T03:02:30.879 INFO:teuthology.orchestra.run.smithi057.stdout: debug bluefs = 1/20 2023-10-06T03:02:30.879 INFO:teuthology.orchestra.run.smithi057.stdout: debug bluestore = 1/20 2023-10-06T03:02:30.880 INFO:teuthology.orchestra.run.smithi057.stdout: debug ms = 1 2023-10-06T03:02:30.880 INFO:teuthology.orchestra.run.smithi057.stdout: debug osd = 20 2023-10-06T03:02:30.880 INFO:teuthology.orchestra.run.smithi057.stdout: debug rocksdb = 4/10 2023-10-06T03:02:30.880 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd backfillfull_ratio = 0.85 2023-10-06T03:02:30.880 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd full ratio = 0.9 2023-10-06T03:02:30.880 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd nearfull ratio = 0.8 2023-10-06T03:02:30.880 INFO:teuthology.orchestra.run.smithi057.stdout: osd failsafe full ratio = 0.95 2023-10-06T03:02:30.880 INFO:teuthology.orchestra.run.smithi057.stdout: osd objectstore = bluestore 2023-10-06T03:02:30.880 INFO:teuthology.orchestra.run.smithi057.stdout: osd op complaint time = 180 2023-10-06T03:02:30.880 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:02:30.880 INFO:teuthology.orchestra.run.smithi057.stdout:[mgr] 2023-10-06T03:02:30.880 INFO:teuthology.orchestra.run.smithi057.stdout: debug ms = 1 2023-10-06T03:02:30.881 INFO:teuthology.orchestra.run.smithi057.stdout: debug mgr = 20 2023-10-06T03:02:30.881 INFO:teuthology.orchestra.run.smithi057.stdout: debug mon = 20 2023-10-06T03:02:30.881 INFO:teuthology.orchestra.run.smithi057.stdout: debug auth = 20 2023-10-06T03:02:30.881 INFO:teuthology.orchestra.run.smithi057.stdout: mon reweight min pgs per osd = 4 2023-10-06T03:02:30.881 INFO:teuthology.orchestra.run.smithi057.stdout: mon reweight min bytes per osd = 10 2023-10-06T03:02:30.881 INFO:teuthology.orchestra.run.smithi057.stdout: mgr/telemetry/nag = false 2023-10-06T03:02:30.881 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:02:30.881 INFO:teuthology.orchestra.run.smithi057.stdout:[mon] 2023-10-06T03:02:30.881 INFO:teuthology.orchestra.run.smithi057.stdout: debug ms = 1 2023-10-06T03:02:30.881 INFO:teuthology.orchestra.run.smithi057.stdout: debug mon = 20 2023-10-06T03:02:30.881 INFO:teuthology.orchestra.run.smithi057.stdout: debug paxos = 20 2023-10-06T03:02:30.881 INFO:teuthology.orchestra.run.smithi057.stdout: debug auth = 20 2023-10-06T03:02:30.881 INFO:teuthology.orchestra.run.smithi057.stdout: mon data avail warn = 5 2023-10-06T03:02:30.882 INFO:teuthology.orchestra.run.smithi057.stdout: mon mgr mkfs grace = 240 2023-10-06T03:02:30.882 INFO:teuthology.orchestra.run.smithi057.stdout: mon reweight min pgs per osd = 4 2023-10-06T03:02:30.882 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd reporter subtree level = osd 2023-10-06T03:02:30.882 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd prime pg temp = true 2023-10-06T03:02:30.882 INFO:teuthology.orchestra.run.smithi057.stdout: mon reweight min bytes per osd = 10 2023-10-06T03:02:30.882 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:02:30.882 INFO:teuthology.orchestra.run.smithi057.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-06T03:02:30.882 INFO:teuthology.orchestra.run.smithi057.stdout: auth mon ticket ttl = 660 # 11m 2023-10-06T03:02:30.882 INFO:teuthology.orchestra.run.smithi057.stdout: auth service ticket ttl = 240 # 4m 2023-10-06T03:02:30.882 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:02:30.882 INFO:teuthology.orchestra.run.smithi057.stdout: # don't complain about insecure global_id in the test suite 2023-10-06T03:02:30.882 INFO:teuthology.orchestra.run.smithi057.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-06T03:02:30.883 INFO:teuthology.orchestra.run.smithi057.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-06T03:02:30.883 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:02:30.883 INFO:teuthology.orchestra.run.smithi057.stdout: # 1m isn't quite enough 2023-10-06T03:02:30.883 INFO:teuthology.orchestra.run.smithi057.stdout: mon_down_mkfs_grace = 2m 2023-10-06T03:02:30.883 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:02:30.883 INFO:teuthology.orchestra.run.smithi057.stdout: mon_warn_on_filestore_osds = false 2023-10-06T03:02:30.883 INFO:teuthology.orchestra.run.smithi057.stdout: mon op complaint time = 120 2023-10-06T03:02:30.883 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:02:30.883 INFO:teuthology.orchestra.run.smithi057.stdout:[client] 2023-10-06T03:02:30.883 INFO:teuthology.orchestra.run.smithi057.stdout: rgw cache enabled = true 2023-10-06T03:02:30.883 INFO:teuthology.orchestra.run.smithi057.stdout: rgw enable ops log = true 2023-10-06T03:02:30.883 INFO:teuthology.orchestra.run.smithi057.stdout: rgw enable usage log = true 2023-10-06T03:02:30.883 INFO:teuthology.orchestra.run.smithi057.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-06T03:02:30.884 INFO:teuthology.orchestra.run.smithi057.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-06T03:02:30.884 INFO:teuthology.orchestra.run.smithi057.stdout: client mount timeout = 600 2023-10-06T03:02:30.884 INFO:teuthology.orchestra.run.smithi057.stdout: debug client = 20 2023-10-06T03:02:30.884 INFO:teuthology.orchestra.run.smithi057.stdout: debug ms = 1 2023-10-06T03:02:30.884 INFO:teuthology.orchestra.run.smithi057.stdout: pid file = "" 2023-10-06T03:02:30.884 INFO:teuthology.orchestra.run.smithi057.stdout: rados mon op timeout = 900 2023-10-06T03:02:30.884 INFO:teuthology.orchestra.run.smithi057.stdout: rados osd op timeout = 900 2023-10-06T03:02:30.884 INFO:teuthology.orchestra.run.smithi057.stdout:[mon.a] 2023-10-06T03:02:30.884 INFO:teuthology.orchestra.run.smithi057.stdout:[mon.b] 2023-10-06T03:02:30.884 INFO:teuthology.orchestra.run.smithi057.stdout:[mon.c] 2023-10-06T03:02:30.884 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.a] 2023-10-06T03:02:30.884 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.c] 2023-10-06T03:02:30.884 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.b] 2023-10-06T03:02:30.885 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.d] 2023-10-06T03:02:30.885 INFO:teuthology.orchestra.run.smithi057.stdout:[mds] 2023-10-06T03:02:30.885 INFO:teuthology.orchestra.run.smithi057.stdout: debug mds = 20 2023-10-06T03:02:30.885 INFO:teuthology.orchestra.run.smithi057.stdout: debug ms = 1 2023-10-06T03:02:30.885 INFO:teuthology.orchestra.run.smithi057.stdout: mds debug frag = True 2023-10-06T03:02:30.885 INFO:teuthology.orchestra.run.smithi057.stdout: mds debug scatterstat = True 2023-10-06T03:02:30.885 INFO:teuthology.orchestra.run.smithi057.stdout: mds op complaint time = 180 2023-10-06T03:02:30.885 INFO:teuthology.orchestra.run.smithi057.stdout: mds verify scatter = True 2023-10-06T03:02:30.885 INFO:teuthology.orchestra.run.smithi057.stdout: osd op complaint time = 180 2023-10-06T03:02:30.885 INFO:teuthology.orchestra.run.smithi057.stdout: rados mon op timeout = 900 2023-10-06T03:02:30.885 INFO:teuthology.orchestra.run.smithi057.stdout: rados osd op timeout = 900 2023-10-06T03:02:30.886 INFO:teuthology.orchestra.run.smithi105.stdout:[global] 2023-10-06T03:02:30.886 INFO:teuthology.orchestra.run.smithi105.stdout: chdir = "" 2023-10-06T03:02:30.886 INFO:teuthology.orchestra.run.smithi105.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-06T03:02:30.886 INFO:teuthology.orchestra.run.smithi105.stdout: auth supported = cephx 2023-10-06T03:02:30.886 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:02:30.886 INFO:teuthology.orchestra.run.smithi105.stdout: filestore xattr use omap = true 2023-10-06T03:02:30.886 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:02:30.886 INFO:teuthology.orchestra.run.smithi105.stdout: mon clock drift allowed = 1.000 2023-10-06T03:02:30.887 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:02:30.887 INFO:teuthology.orchestra.run.smithi105.stdout: osd crush chooseleaf type = 0 2023-10-06T03:02:30.887 INFO:teuthology.orchestra.run.smithi105.stdout: auth debug = true 2023-10-06T03:02:30.887 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:02:30.887 INFO:teuthology.orchestra.run.smithi105.stdout: ms die on old message = true 2023-10-06T03:02:30.887 INFO:teuthology.orchestra.run.smithi105.stdout: ms die on bug = true 2023-10-06T03:02:30.887 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:02:30.887 INFO:teuthology.orchestra.run.smithi105.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-06T03:02:30.887 INFO:teuthology.orchestra.run.smithi105.stdout: mon pg warn max object skew = 0 2023-10-06T03:02:30.887 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:02:30.887 INFO:teuthology.orchestra.run.smithi105.stdout: # disable pg_autoscaler by default for new pools 2023-10-06T03:02:30.887 INFO:teuthology.orchestra.run.smithi105.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-06T03:02:30.887 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:02:30.888 INFO:teuthology.orchestra.run.smithi105.stdout: osd pool default size = 2 2023-10-06T03:02:30.888 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:02:30.888 INFO:teuthology.orchestra.run.smithi105.stdout: mon osd allow primary affinity = true 2023-10-06T03:02:30.888 INFO:teuthology.orchestra.run.smithi105.stdout: mon osd allow pg remap = true 2023-10-06T03:02:30.888 INFO:teuthology.orchestra.run.smithi105.stdout: mon warn on legacy crush tunables = false 2023-10-06T03:02:30.888 INFO:teuthology.orchestra.run.smithi105.stdout: mon warn on crush straw calc version zero = false 2023-10-06T03:02:30.888 INFO:teuthology.orchestra.run.smithi105.stdout: mon warn on no sortbitwise = false 2023-10-06T03:02:30.888 INFO:teuthology.orchestra.run.smithi105.stdout: mon warn on osd down out interval zero = false 2023-10-06T03:02:30.888 INFO:teuthology.orchestra.run.smithi105.stdout: mon warn on too few osds = false 2023-10-06T03:02:30.888 INFO:teuthology.orchestra.run.smithi105.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-06T03:02:30.888 INFO:teuthology.orchestra.run.smithi105.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-06T03:02:30.888 INFO:teuthology.orchestra.run.smithi105.stdout: mon_allow_pool_size_one = true 2023-10-06T03:02:30.888 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:02:30.888 INFO:teuthology.orchestra.run.smithi105.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-06T03:02:30.889 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:02:30.889 INFO:teuthology.orchestra.run.smithi105.stdout: osd default data pool replay window = 5 2023-10-06T03:02:30.889 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:02:30.889 INFO:teuthology.orchestra.run.smithi105.stdout: mon allow pool delete = true 2023-10-06T03:02:30.889 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:02:30.889 INFO:teuthology.orchestra.run.smithi105.stdout: mon cluster log file level = debug 2023-10-06T03:02:30.889 INFO:teuthology.orchestra.run.smithi105.stdout: debug asserts on shutdown = true 2023-10-06T03:02:30.889 INFO:teuthology.orchestra.run.smithi105.stdout: mon health detail to clog = false 2023-10-06T03:02:30.889 INFO:teuthology.orchestra.run.smithi105.stdout: mon host = "172.21.15.57,172.21.15.105,[v2:172.21.15.105:3301,v1:172.21.15.105:6790]" 2023-10-06T03:02:30.889 INFO:teuthology.orchestra.run.smithi105.stdout: ms die on skipped message = False 2023-10-06T03:02:30.889 INFO:teuthology.orchestra.run.smithi105.stdout: fsid = eb56dc0f-9213-41cb-9aad-8ade6c802e98 2023-10-06T03:02:30.889 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:02:30.889 INFO:teuthology.orchestra.run.smithi105.stdout:[osd] 2023-10-06T03:02:30.890 INFO:teuthology.orchestra.run.smithi105.stdout: osd journal size = 100 2023-10-06T03:02:30.890 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:02:30.890 INFO:teuthology.orchestra.run.smithi105.stdout: osd scrub load threshold = 5.0 2023-10-06T03:02:30.890 INFO:teuthology.orchestra.run.smithi105.stdout: osd scrub max interval = 600 2023-10-06T03:02:30.890 INFO:teuthology.orchestra.run.smithi105.stdout: osd mclock profile = high_recovery_ops 2023-10-06T03:02:30.890 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:02:30.890 INFO:teuthology.orchestra.run.smithi105.stdout: osd recover clone overlap = true 2023-10-06T03:02:30.890 INFO:teuthology.orchestra.run.smithi105.stdout: osd recovery max chunk = 1048576 2023-10-06T03:02:30.890 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:02:30.890 INFO:teuthology.orchestra.run.smithi105.stdout: osd debug shutdown = true 2023-10-06T03:02:30.890 INFO:teuthology.orchestra.run.smithi105.stdout: osd debug op order = true 2023-10-06T03:02:30.890 INFO:teuthology.orchestra.run.smithi105.stdout: osd debug verify stray on activate = true 2023-10-06T03:02:30.891 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:02:30.891 INFO:teuthology.orchestra.run.smithi105.stdout: osd open classes on start = true 2023-10-06T03:02:30.891 INFO:teuthology.orchestra.run.smithi105.stdout: osd debug pg log writeout = true 2023-10-06T03:02:30.891 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:02:30.891 INFO:teuthology.orchestra.run.smithi105.stdout: osd deep scrub update digest min age = 30 2023-10-06T03:02:30.891 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:02:30.891 INFO:teuthology.orchestra.run.smithi105.stdout: osd map max advance = 10 2023-10-06T03:02:30.891 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:02:30.891 INFO:teuthology.orchestra.run.smithi105.stdout: journal zero on create = true 2023-10-06T03:02:30.891 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:02:30.891 INFO:teuthology.orchestra.run.smithi105.stdout: filestore ondisk finisher threads = 3 2023-10-06T03:02:30.891 INFO:teuthology.orchestra.run.smithi105.stdout: filestore apply finisher threads = 3 2023-10-06T03:02:30.891 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:02:30.891 INFO:teuthology.orchestra.run.smithi105.stdout: bdev debug aio = true 2023-10-06T03:02:30.892 INFO:teuthology.orchestra.run.smithi105.stdout: osd debug misdirected ops = true 2023-10-06T03:02:30.892 INFO:teuthology.orchestra.run.smithi105.stdout: bdev async discard = True 2023-10-06T03:02:30.892 INFO:teuthology.orchestra.run.smithi105.stdout: bdev enable discard = True 2023-10-06T03:02:30.892 INFO:teuthology.orchestra.run.smithi105.stdout: bluestore allocator = bitmap 2023-10-06T03:02:30.892 INFO:teuthology.orchestra.run.smithi105.stdout: bluestore block size = 96636764160 2023-10-06T03:02:30.892 INFO:teuthology.orchestra.run.smithi105.stdout: bluestore fsck on mount = True 2023-10-06T03:02:30.892 INFO:teuthology.orchestra.run.smithi105.stdout: debug bluefs = 1/20 2023-10-06T03:02:30.892 INFO:teuthology.orchestra.run.smithi105.stdout: debug bluestore = 1/20 2023-10-06T03:02:30.892 INFO:teuthology.orchestra.run.smithi105.stdout: debug ms = 1 2023-10-06T03:02:30.892 INFO:teuthology.orchestra.run.smithi105.stdout: debug osd = 20 2023-10-06T03:02:30.892 INFO:teuthology.orchestra.run.smithi105.stdout: debug rocksdb = 4/10 2023-10-06T03:02:30.893 INFO:teuthology.orchestra.run.smithi105.stdout: mon osd backfillfull_ratio = 0.85 2023-10-06T03:02:30.893 INFO:teuthology.orchestra.run.smithi105.stdout: mon osd full ratio = 0.9 2023-10-06T03:02:30.893 INFO:teuthology.orchestra.run.smithi105.stdout: mon osd nearfull ratio = 0.8 2023-10-06T03:02:30.893 INFO:teuthology.orchestra.run.smithi105.stdout: osd failsafe full ratio = 0.95 2023-10-06T03:02:30.893 INFO:teuthology.orchestra.run.smithi105.stdout: osd objectstore = bluestore 2023-10-06T03:02:30.893 INFO:teuthology.orchestra.run.smithi105.stdout: osd op complaint time = 180 2023-10-06T03:02:30.893 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:02:30.893 INFO:teuthology.orchestra.run.smithi105.stdout:[mgr] 2023-10-06T03:02:30.893 INFO:teuthology.orchestra.run.smithi105.stdout: debug ms = 1 2023-10-06T03:02:30.893 INFO:teuthology.orchestra.run.smithi105.stdout: debug mgr = 20 2023-10-06T03:02:30.893 INFO:teuthology.orchestra.run.smithi105.stdout: debug mon = 20 2023-10-06T03:02:30.893 INFO:teuthology.orchestra.run.smithi105.stdout: debug auth = 20 2023-10-06T03:02:30.894 INFO:teuthology.orchestra.run.smithi105.stdout: mon reweight min pgs per osd = 4 2023-10-06T03:02:30.894 INFO:teuthology.orchestra.run.smithi105.stdout: mon reweight min bytes per osd = 10 2023-10-06T03:02:30.894 INFO:teuthology.orchestra.run.smithi105.stdout: mgr/telemetry/nag = false 2023-10-06T03:02:30.894 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:02:30.894 INFO:teuthology.orchestra.run.smithi105.stdout:[mon] 2023-10-06T03:02:30.894 INFO:teuthology.orchestra.run.smithi105.stdout: debug ms = 1 2023-10-06T03:02:30.894 INFO:teuthology.orchestra.run.smithi105.stdout: debug mon = 20 2023-10-06T03:02:30.894 INFO:teuthology.orchestra.run.smithi105.stdout: debug paxos = 20 2023-10-06T03:02:30.894 INFO:teuthology.orchestra.run.smithi105.stdout: debug auth = 20 2023-10-06T03:02:30.894 INFO:teuthology.orchestra.run.smithi105.stdout: mon data avail warn = 5 2023-10-06T03:02:30.894 INFO:teuthology.orchestra.run.smithi105.stdout: mon mgr mkfs grace = 240 2023-10-06T03:02:30.894 INFO:teuthology.orchestra.run.smithi105.stdout: mon reweight min pgs per osd = 4 2023-10-06T03:02:30.895 INFO:teuthology.orchestra.run.smithi105.stdout: mon osd reporter subtree level = osd 2023-10-06T03:02:30.895 INFO:teuthology.orchestra.run.smithi105.stdout: mon osd prime pg temp = true 2023-10-06T03:02:30.895 INFO:teuthology.orchestra.run.smithi105.stdout: mon reweight min bytes per osd = 10 2023-10-06T03:02:30.895 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:02:30.895 INFO:teuthology.orchestra.run.smithi105.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-06T03:02:30.895 INFO:teuthology.orchestra.run.smithi105.stdout: auth mon ticket ttl = 660 # 11m 2023-10-06T03:02:30.895 INFO:teuthology.orchestra.run.smithi105.stdout: auth service ticket ttl = 240 # 4m 2023-10-06T03:02:30.895 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:02:30.895 INFO:teuthology.orchestra.run.smithi105.stdout: # don't complain about insecure global_id in the test suite 2023-10-06T03:02:30.895 INFO:teuthology.orchestra.run.smithi105.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-06T03:02:30.895 INFO:teuthology.orchestra.run.smithi105.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-06T03:02:30.895 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:02:30.895 INFO:teuthology.orchestra.run.smithi105.stdout: # 1m isn't quite enough 2023-10-06T03:02:30.896 INFO:teuthology.orchestra.run.smithi105.stdout: mon_down_mkfs_grace = 2m 2023-10-06T03:02:30.896 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:02:30.896 INFO:teuthology.orchestra.run.smithi105.stdout: mon_warn_on_filestore_osds = false 2023-10-06T03:02:30.896 INFO:teuthology.orchestra.run.smithi105.stdout: mon op complaint time = 120 2023-10-06T03:02:30.896 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:02:30.896 INFO:teuthology.orchestra.run.smithi105.stdout:[client] 2023-10-06T03:02:30.896 INFO:teuthology.orchestra.run.smithi105.stdout: rgw cache enabled = true 2023-10-06T03:02:30.896 INFO:teuthology.orchestra.run.smithi105.stdout: rgw enable ops log = true 2023-10-06T03:02:30.896 INFO:teuthology.orchestra.run.smithi105.stdout: rgw enable usage log = true 2023-10-06T03:02:30.896 INFO:teuthology.orchestra.run.smithi105.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-06T03:02:30.896 INFO:teuthology.orchestra.run.smithi105.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-06T03:02:30.896 INFO:teuthology.orchestra.run.smithi105.stdout: client mount timeout = 600 2023-10-06T03:02:30.896 INFO:teuthology.orchestra.run.smithi105.stdout: debug client = 20 2023-10-06T03:02:30.897 INFO:teuthology.orchestra.run.smithi105.stdout: debug ms = 1 2023-10-06T03:02:30.897 INFO:teuthology.orchestra.run.smithi105.stdout: pid file = "" 2023-10-06T03:02:30.897 INFO:teuthology.orchestra.run.smithi105.stdout: rados mon op timeout = 900 2023-10-06T03:02:30.897 INFO:teuthology.orchestra.run.smithi105.stdout: rados osd op timeout = 900 2023-10-06T03:02:30.897 INFO:teuthology.orchestra.run.smithi105.stdout:[mon.a] 2023-10-06T03:02:30.897 INFO:teuthology.orchestra.run.smithi105.stdout:[mon.b] 2023-10-06T03:02:30.897 INFO:teuthology.orchestra.run.smithi105.stdout:[mon.c] 2023-10-06T03:02:30.897 INFO:teuthology.orchestra.run.smithi105.stdout:[mds.a] 2023-10-06T03:02:30.897 INFO:teuthology.orchestra.run.smithi105.stdout:[mds.c] 2023-10-06T03:02:30.897 INFO:teuthology.orchestra.run.smithi105.stdout:[mds.b] 2023-10-06T03:02:30.897 INFO:teuthology.orchestra.run.smithi105.stdout:[mds.d] 2023-10-06T03:02:30.897 INFO:teuthology.orchestra.run.smithi105.stdout:[mds] 2023-10-06T03:02:30.897 INFO:teuthology.orchestra.run.smithi105.stdout: debug mds = 20 2023-10-06T03:02:30.897 INFO:teuthology.orchestra.run.smithi105.stdout: debug ms = 1 2023-10-06T03:02:30.898 INFO:teuthology.orchestra.run.smithi105.stdout: mds debug frag = True 2023-10-06T03:02:30.898 INFO:teuthology.orchestra.run.smithi105.stdout: mds debug scatterstat = True 2023-10-06T03:02:30.898 INFO:teuthology.orchestra.run.smithi105.stdout: mds op complaint time = 180 2023-10-06T03:02:30.898 INFO:teuthology.orchestra.run.smithi105.stdout: mds verify scatter = True 2023-10-06T03:02:30.898 INFO:teuthology.orchestra.run.smithi105.stdout: osd op complaint time = 180 2023-10-06T03:02:30.898 INFO:teuthology.orchestra.run.smithi105.stdout: rados mon op timeout = 900 2023-10-06T03:02:30.898 INFO:teuthology.orchestra.run.smithi105.stdout: rados osd op timeout = 900 2023-10-06T03:02:30.908 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-06T03:02:31.084 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.078+0000 7fa5dd523700 1 Processor -- start 2023-10-06T03:02:31.085 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.078+0000 7fa5dd523700 1 -- start start 2023-10-06T03:02:31.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.082+0000 7fa5dd523700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa5d815a380 0x7fa5d806a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:31.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.082+0000 7fa5dd523700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5d806d030 con 0x7fa5d8156b60 2023-10-06T03:02:31.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.082+0000 7fa5dd523700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5d80b3250 con 0x7fa5d806adf0 2023-10-06T03:02:31.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.082+0000 7fa5dd523700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5d806b210 con 0x7fa5d815a380 2023-10-06T03:02:31.089 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.082+0000 7fa5cffff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa5d815a380 0x7fa5d806a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:31.089 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.082+0000 7fa5cffff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa5d815a380 0x7fa5d806a8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:49944/0 (socket says 172.21.15.57:49944) 2023-10-06T03:02:31.089 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.082+0000 7fa5cffff700 1 -- 172.21.15.57:0/1917601585 learned_addr learned my addr 172.21.15.57:0/1917601585 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:02:31.089 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.082+0000 7fa5d7fff700 1 --1- 172.21.15.57:0/1917601585 >> v1:172.21.15.57:6789/0 conn(0x7fa5d8156b60 0x7fa5d806c920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:45520/0 (socket says 172.21.15.57:45520) 2023-10-06T03:02:31.089 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.082+0000 7fa5cffff700 1 -- 172.21.15.57:0/1917601585 >> v1:172.21.15.105:6789/0 conn(0x7fa5d806adf0 legacy=0x7fa5d80b36e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:31.089 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.082+0000 7fa5cffff700 1 -- 172.21.15.57:0/1917601585 >> v1:172.21.15.57:6789/0 conn(0x7fa5d8156b60 legacy=0x7fa5d806c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:31.089 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.082+0000 7fa5cffff700 1 -- 172.21.15.57:0/1917601585 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5d806d270 con 0x7fa5d815a380 2023-10-06T03:02:31.090 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.082+0000 7fa5cffff700 1 --2- 172.21.15.57:0/1917601585 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa5d815a380 0x7fa5d806a8b0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fa5c00099b0 tx=0x7fa5c0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbaa3e8f9d3d3770 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:31.090 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.082+0000 7fa5d77fe700 1 -- 172.21.15.57:0/1917601585 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c000b860 con 0x7fa5d815a380 2023-10-06T03:02:31.090 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.082+0000 7fa5d77fe700 1 -- 172.21.15.57:0/1917601585 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5c000b9c0 con 0x7fa5d815a380 2023-10-06T03:02:31.091 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.082+0000 7fa5d77fe700 1 -- 172.21.15.57:0/1917601585 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c000bd60 con 0x7fa5d815a380 2023-10-06T03:02:31.091 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.086+0000 7fa5dd523700 1 -- 172.21.15.57:0/1917601585 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa5d815a380 msgr2=0x7fa5d806a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:31.091 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.086+0000 7fa5dd523700 1 --2- 172.21.15.57:0/1917601585 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa5d815a380 0x7fa5d806a8b0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fa5c00099b0 tx=0x7fa5c0009250 comp rx=0 tx=0).stop 2023-10-06T03:02:31.092 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.086+0000 7fa5dd523700 1 -- 172.21.15.57:0/1917601585 shutdown_connections 2023-10-06T03:02:31.092 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.086+0000 7fa5dd523700 1 --2- 172.21.15.57:0/1917601585 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa5d815a380 0x7fa5d806a8b0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:31.092 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.086+0000 7fa5dd523700 1 -- 172.21.15.57:0/1917601585 >> 172.21.15.57:0/1917601585 conn(0x7fa5d8067050 msgr2=0x7fa5d80b1ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:31.092 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.086+0000 7fa5dd523700 1 -- 172.21.15.57:0/1917601585 shutdown_connections 2023-10-06T03:02:31.092 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.086+0000 7fa5dd523700 1 -- 172.21.15.57:0/1917601585 wait complete. 2023-10-06T03:02:31.095 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.090+0000 7fa5dd523700 1 Processor -- start 2023-10-06T03:02:31.095 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.090+0000 7fa5dd523700 1 -- start start 2023-10-06T03:02:31.096 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.090+0000 7fa5dd523700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa5d806adf0 0x7fa5d80af5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:31.096 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.090+0000 7fa5dd523700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa5d8156b60 0x7fa5d81439e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:31.097 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.090+0000 7fa5dd523700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa5d815a380 0x7fa5d80a9c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:31.097 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.090+0000 7fa5dd523700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d80abca0 con 0x7fa5d806adf0 2023-10-06T03:02:31.097 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.090+0000 7fa5dd523700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d80afae0 con 0x7fa5d8156b60 2023-10-06T03:02:31.097 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.090+0000 7fa5dd523700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d80ab090 con 0x7fa5d815a380 2023-10-06T03:02:31.098 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.090+0000 7fa5d7fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa5d806adf0 0x7fa5d80af5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:31.098 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.090+0000 7fa5d7fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa5d806adf0 0x7fa5d80af5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:49948/0 (socket says 172.21.15.57:49948) 2023-10-06T03:02:31.099 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.090+0000 7fa5d7fff700 1 -- 172.21.15.57:0/2071077794 learned_addr learned my addr 172.21.15.57:0/2071077794 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:02:31.099 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.090+0000 7fa5cffff700 1 --2- 172.21.15.57:0/2071077794 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa5d8156b60 0x7fa5d81439e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:31.099 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.090+0000 7fa5dcd22700 1 --2- 172.21.15.57:0/2071077794 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa5d815a380 0x7fa5d80a9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:31.099 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.090+0000 7fa5d7fff700 1 -- 172.21.15.57:0/2071077794 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa5d815a380 msgr2=0x7fa5d80a9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:31.099 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.090+0000 7fa5d7fff700 1 --2- 172.21.15.57:0/2071077794 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa5d815a380 0x7fa5d80a9c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:31.099 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.090+0000 7fa5d7fff700 1 -- 172.21.15.57:0/2071077794 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa5d8156b60 msgr2=0x7fa5d81439e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:31.099 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.090+0000 7fa5d7fff700 1 --2- 172.21.15.57:0/2071077794 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa5d8156b60 0x7fa5d81439e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:31.099 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.090+0000 7fa5d7fff700 1 -- 172.21.15.57:0/2071077794 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5c00094f0 con 0x7fa5d806adf0 2023-10-06T03:02:31.099 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.090+0000 7fa5d7fff700 1 --2- 172.21.15.57:0/2071077794 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa5d806adf0 0x7fa5d80af5a0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fa5c800c560 tx=0x7fa5c8007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:31.099 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.094+0000 7fa5d4ff9700 1 -- 172.21.15.57:0/2071077794 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c8005a70 con 0x7fa5d806adf0 2023-10-06T03:02:31.099 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.094+0000 7fa5dd523700 1 -- 172.21.15.57:0/2071077794 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5d80ab370 con 0x7fa5d806adf0 2023-10-06T03:02:31.099 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.094+0000 7fa5d4ff9700 1 -- 172.21.15.57:0/2071077794 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5c8005bd0 con 0x7fa5d806adf0 2023-10-06T03:02:31.100 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.094+0000 7fa5d4ff9700 1 -- 172.21.15.57:0/2071077794 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c80070d0 con 0x7fa5d806adf0 2023-10-06T03:02:31.100 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.094+0000 7fa5dd523700 1 -- 172.21.15.57:0/2071077794 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5d80ab930 con 0x7fa5d806adf0 2023-10-06T03:02:31.100 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.094+0000 7fa5dd523700 1 -- 172.21.15.57:0/2071077794 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5d804be40 con 0x7fa5d806adf0 2023-10-06T03:02:31.101 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.094+0000 7fa5d4ff9700 1 -- 172.21.15.57:0/2071077794 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fa5c8007480 con 0x7fa5d806adf0 2023-10-06T03:02:31.102 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.094+0000 7fa5d4ff9700 1 --2- 172.21.15.57:0/2071077794 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fa5b8060580 0x7fa5b8062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:31.102 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.094+0000 7fa5d4ff9700 1 -- 172.21.15.57:0/2071077794 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5378+0+0 (secure 0 0 0) 0x7fa5c807b930 con 0x7fa5d806adf0 2023-10-06T03:02:31.103 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.098+0000 7fa5cffff700 1 --2- 172.21.15.57:0/2071077794 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fa5b8060580 0x7fa5b8062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:31.104 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.098+0000 7fa5cffff700 1 --2- 172.21.15.57:0/2071077794 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fa5b8060580 0x7fa5b8062a30 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fa5c00099b0 tx=0x7fa5c0017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:31.109 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.102+0000 7fa5d4ff9700 1 -- 172.21.15.57:0/2071077794 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fa5c804c060 con 0x7fa5d806adf0 2023-10-06T03:02:31.284 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.278+0000 7fa5dd523700 1 -- 172.21.15.57:0/2071077794 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fa5d806d030 con 0x7fa5d806adf0 2023-10-06T03:02:31.291 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.286+0000 7fa5d4ff9700 1 -- 172.21.15.57:0/2071077794 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7fa5d806d030 con 0x7fa5d806adf0 2023-10-06T03:02:31.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.290+0000 7fa5dd523700 1 -- 172.21.15.57:0/2071077794 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fa5b8060580 msgr2=0x7fa5b8062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:31.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.290+0000 7fa5dd523700 1 --2- 172.21.15.57:0/2071077794 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fa5b8060580 0x7fa5b8062a30 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fa5c00099b0 tx=0x7fa5c0017000 comp rx=0 tx=0).stop 2023-10-06T03:02:31.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.290+0000 7fa5dd523700 1 -- 172.21.15.57:0/2071077794 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa5d806adf0 msgr2=0x7fa5d80af5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:31.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.290+0000 7fa5dd523700 1 --2- 172.21.15.57:0/2071077794 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa5d806adf0 0x7fa5d80af5a0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fa5c800c560 tx=0x7fa5c8007f70 comp rx=0 tx=0).stop 2023-10-06T03:02:31.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.290+0000 7fa5dd523700 1 -- 172.21.15.57:0/2071077794 shutdown_connections 2023-10-06T03:02:31.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.290+0000 7fa5dd523700 1 --2- 172.21.15.57:0/2071077794 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fa5b8060580 0x7fa5b8062a30 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:31.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.290+0000 7fa5dd523700 1 --2- 172.21.15.57:0/2071077794 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa5d815a380 0x7fa5d80a9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:31.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.290+0000 7fa5dd523700 1 --2- 172.21.15.57:0/2071077794 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa5d8156b60 0x7fa5d81439e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:31.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.290+0000 7fa5dd523700 1 --2- 172.21.15.57:0/2071077794 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa5d806adf0 0x7fa5d80af5a0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:31.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.290+0000 7fa5dd523700 1 -- 172.21.15.57:0/2071077794 >> 172.21.15.57:0/2071077794 conn(0x7fa5d8067050 msgr2=0x7fa5d815a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:31.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.290+0000 7fa5dd523700 1 -- 172.21.15.57:0/2071077794 shutdown_connections 2023-10-06T03:02:31.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.290+0000 7fa5dd523700 1 -- 172.21.15.57:0/2071077794 wait complete. 2023-10-06T03:02:31.315 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_openfiletable.OpenFileTable.test_max_items_per_obj' 2023-10-06T03:02:31.479 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.474+0000 7fdacab85700 1 Processor -- start 2023-10-06T03:02:31.479 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.474+0000 7fdacab85700 1 -- start start 2023-10-06T03:02:31.483 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.478+0000 7fdacab85700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fdac40671f0 0x7fdac40675c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:31.484 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.478+0000 7fdacab85700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fdac406dc70 0x7fdac414fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:31.484 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.478+0000 7fdacab85700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdac4150180 0x7fdac415ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:31.484 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.478+0000 7fdacab85700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdac406d7e0 con 0x7fdac40671f0 2023-10-06T03:02:31.484 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.478+0000 7fdacab85700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdac4150600 con 0x7fdac406dc70 2023-10-06T03:02:31.484 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.478+0000 7fdacab85700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdac415dc00 con 0x7fdac4150180 2023-10-06T03:02:31.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.478+0000 7fdac8921700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fdac40671f0 0x7fdac40675c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:31.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.478+0000 7fdac8921700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fdac40671f0 0x7fdac40675c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:49956/0 (socket says 172.21.15.57:49956) 2023-10-06T03:02:31.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.478+0000 7fdac8921700 1 -- 172.21.15.57:0/889963379 learned_addr learned my addr 172.21.15.57:0/889963379 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:02:31.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.478+0000 7fdac3fff700 1 --2- 172.21.15.57:0/889963379 >> v2:172.21.15.105:3300/0 conn(0x7fdac406dc70 0x7fdac414fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:31.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.478+0000 7fdac9122700 1 --2- 172.21.15.57:0/889963379 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdac4150180 0x7fdac415ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:31.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.478+0000 7fdac8921700 1 -- 172.21.15.57:0/889963379 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdac4150180 msgr2=0x7fdac415ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:31.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.478+0000 7fdac8921700 1 --2- 172.21.15.57:0/889963379 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdac4150180 0x7fdac415ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:31.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.478+0000 7fdac8921700 1 -- 172.21.15.57:0/889963379 >> v2:172.21.15.105:3300/0 conn(0x7fdac406dc70 msgr2=0x7fdac414fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:31.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.478+0000 7fdac8921700 1 --2- 172.21.15.57:0/889963379 >> v2:172.21.15.105:3300/0 conn(0x7fdac406dc70 0x7fdac414fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:31.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.478+0000 7fdac8921700 1 -- 172.21.15.57:0/889963379 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdac406ceb0 con 0x7fdac40671f0 2023-10-06T03:02:31.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.478+0000 7fdac8921700 1 --2- 172.21.15.57:0/889963379 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdac40671f0 0x7fdac40675c0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fdac40aed10 tx=0x7fdab8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d70a6f28ffe989eb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:31.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.478+0000 7fdac37fe700 1 -- 172.21.15.57:0/889963379 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdab800b860 con 0x7fdac40671f0 2023-10-06T03:02:31.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.478+0000 7fdac37fe700 1 -- 172.21.15.57:0/889963379 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdab800b9c0 con 0x7fdac40671f0 2023-10-06T03:02:31.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.478+0000 7fdac37fe700 1 -- 172.21.15.57:0/889963379 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdab800bd60 con 0x7fdac40671f0 2023-10-06T03:02:31.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.482+0000 7fdacab85700 1 -- 172.21.15.57:0/889963379 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdac40671f0 msgr2=0x7fdac40675c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:31.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.482+0000 7fdacab85700 1 --2- 172.21.15.57:0/889963379 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdac40671f0 0x7fdac40675c0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fdac40aed10 tx=0x7fdab8009250 comp rx=0 tx=0).stop 2023-10-06T03:02:31.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.482+0000 7fdacab85700 1 -- 172.21.15.57:0/889963379 shutdown_connections 2023-10-06T03:02:31.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.482+0000 7fdacab85700 1 --2- 172.21.15.57:0/889963379 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdac4150180 0x7fdac415ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:31.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.482+0000 7fdacab85700 1 --2- 172.21.15.57:0/889963379 >> v2:172.21.15.105:3300/0 conn(0x7fdac406dc70 0x7fdac414fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:31.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.482+0000 7fdacab85700 1 --2- 172.21.15.57:0/889963379 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdac40671f0 0x7fdac40675c0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:31.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.482+0000 7fdacab85700 1 -- 172.21.15.57:0/889963379 >> 172.21.15.57:0/889963379 conn(0x7fdac40cbdd0 msgr2=0x7fdac40cc1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:31.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.482+0000 7fdacab85700 1 -- 172.21.15.57:0/889963379 shutdown_connections 2023-10-06T03:02:31.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.482+0000 7fdacab85700 1 -- 172.21.15.57:0/889963379 wait complete. 2023-10-06T03:02:31.489 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.482+0000 7fdacab85700 1 Processor -- start 2023-10-06T03:02:31.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.482+0000 7fdacab85700 1 -- start start 2023-10-06T03:02:31.492 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.486+0000 7fdacab85700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdac40671f0 0x7fdac41409c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:31.492 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.486+0000 7fdacab85700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdac406dc70 0x7fdac415b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:31.492 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.486+0000 7fdacab85700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdac4150180 0x7fdac40b0800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:31.492 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.486+0000 7fdacab85700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdac40ac7e0 con 0x7fdac4150180 2023-10-06T03:02:31.492 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.486+0000 7fdacab85700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdac415bcb0 con 0x7fdac40671f0 2023-10-06T03:02:31.492 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.486+0000 7fdacab85700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdac415bf90 con 0x7fdac406dc70 2023-10-06T03:02:31.493 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.486+0000 7fdac9122700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdac4150180 0x7fdac40b0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:31.493 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.486+0000 7fdac9122700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdac4150180 0x7fdac40b0800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:49958/0 (socket says 172.21.15.57:49958) 2023-10-06T03:02:31.493 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.486+0000 7fdac9122700 1 -- 172.21.15.57:0/424006764 learned_addr learned my addr 172.21.15.57:0/424006764 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:02:31.493 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.486+0000 7fdac3fff700 1 --2- 172.21.15.57:0/424006764 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdac406dc70 0x7fdac415b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:31.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.486+0000 7fdac8921700 1 --2- 172.21.15.57:0/424006764 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdac40671f0 0x7fdac41409c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:31.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.486+0000 7fdac9122700 1 -- 172.21.15.57:0/424006764 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdac406dc70 msgr2=0x7fdac415b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:31.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.486+0000 7fdac9122700 1 --2- 172.21.15.57:0/424006764 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdac406dc70 0x7fdac415b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:31.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.486+0000 7fdac9122700 1 -- 172.21.15.57:0/424006764 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdac40671f0 msgr2=0x7fdac41409c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:31.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.486+0000 7fdac9122700 1 --2- 172.21.15.57:0/424006764 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdac40671f0 0x7fdac41409c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:31.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.486+0000 7fdac9122700 1 -- 172.21.15.57:0/424006764 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdab80094f0 con 0x7fdac4150180 2023-10-06T03:02:31.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.486+0000 7fdac8921700 1 --2- 172.21.15.57:0/424006764 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdac40671f0 0x7fdac41409c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:02:31.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.486+0000 7fdac9122700 1 --2- 172.21.15.57:0/424006764 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdac4150180 0x7fdac40b0800 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fdabc007f20 tx=0x7fdabc009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:31.495 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.486+0000 7fdac0ff9700 1 -- 172.21.15.57:0/424006764 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdabc00eca0 con 0x7fdac4150180 2023-10-06T03:02:31.495 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.486+0000 7fdac0ff9700 1 -- 172.21.15.57:0/424006764 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdabc00ee20 con 0x7fdac4150180 2023-10-06T03:02:31.495 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.486+0000 7fdacab85700 1 -- 172.21.15.57:0/424006764 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdac415c270 con 0x7fdac4150180 2023-10-06T03:02:31.495 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.486+0000 7fdac0ff9700 1 -- 172.21.15.57:0/424006764 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdabc014670 con 0x7fdac4150180 2023-10-06T03:02:31.495 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.486+0000 7fdacab85700 1 -- 172.21.15.57:0/424006764 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdac415cd20 con 0x7fdac4150180 2023-10-06T03:02:31.496 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.490+0000 7fdacab85700 1 -- 172.21.15.57:0/424006764 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdac40ac2d0 con 0x7fdac4150180 2023-10-06T03:02:31.496 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.490+0000 7fdac0ff9700 1 -- 172.21.15.57:0/424006764 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fdabc0149e0 con 0x7fdac4150180 2023-10-06T03:02:31.498 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.490+0000 7fdac0ff9700 1 --2- 172.21.15.57:0/424006764 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fdab0060550 0x7fdab0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:31.498 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.490+0000 7fdac0ff9700 1 -- 172.21.15.57:0/424006764 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5378+0+0 (secure 0 0 0) 0x7fdabc07cdc0 con 0x7fdac4150180 2023-10-06T03:02:31.498 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.494+0000 7fdac8921700 1 --2- 172.21.15.57:0/424006764 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fdab0060550 0x7fdab0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:31.499 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.494+0000 7fdac8921700 1 --2- 172.21.15.57:0/424006764 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fdab0060550 0x7fdab0062a00 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fdac40aed10 tx=0x7fdab8017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:31.503 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.498+0000 7fdac0ff9700 1 -- 172.21.15.57:0/424006764 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fdac40ac2d0 con 0x7fdac4150180 2023-10-06T03:02:31.732 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.726+0000 7fdacab85700 1 -- 172.21.15.57:0/424006764 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_openfiletable.OpenFileTable.test_max_items_per_obj"]} v 0) v1 -- 0x7fdac40ac2d0 con 0x7fdac4150180 2023-10-06T03:02:31.769 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.762+0000 7fdac0ff9700 1 -- 172.21.15.57:0/424006764 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_openfiletable.OpenFileTable.test_max_items_per_obj"]}]=0 v107) v1 ==== 147+0+0 (secure 0 0 0) 0x7fdac40ac2d0 con 0x7fdac4150180 2023-10-06T03:02:31.772 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.766+0000 7fdacab85700 1 -- 172.21.15.57:0/424006764 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fdab0060550 msgr2=0x7fdab0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:31.772 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.766+0000 7fdacab85700 1 --2- 172.21.15.57:0/424006764 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fdab0060550 0x7fdab0062a00 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fdac40aed10 tx=0x7fdab8017000 comp rx=0 tx=0).stop 2023-10-06T03:02:31.772 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.766+0000 7fdacab85700 1 -- 172.21.15.57:0/424006764 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdac4150180 msgr2=0x7fdac40b0800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:31.772 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.766+0000 7fdacab85700 1 --2- 172.21.15.57:0/424006764 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdac4150180 0x7fdac40b0800 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fdabc007f20 tx=0x7fdabc009860 comp rx=0 tx=0).stop 2023-10-06T03:02:31.772 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.766+0000 7fdacab85700 1 -- 172.21.15.57:0/424006764 shutdown_connections 2023-10-06T03:02:31.772 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.766+0000 7fdacab85700 1 --2- 172.21.15.57:0/424006764 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdac4150180 0x7fdac40b0800 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:31.772 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.766+0000 7fdacab85700 1 --2- 172.21.15.57:0/424006764 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fdab0060550 0x7fdab0062a00 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:31.772 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.766+0000 7fdacab85700 1 --2- 172.21.15.57:0/424006764 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdac406dc70 0x7fdac415b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:31.772 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.766+0000 7fdacab85700 1 --2- 172.21.15.57:0/424006764 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdac40671f0 0x7fdac41409c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:31.772 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.766+0000 7fdacab85700 1 -- 172.21.15.57:0/424006764 >> 172.21.15.57:0/424006764 conn(0x7fdac40cbdd0 msgr2=0x7fdac414d7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:31.773 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.766+0000 7fdacab85700 1 -- 172.21.15.57:0/424006764 shutdown_connections 2023-10-06T03:02:31.773 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.766+0000 7fdacab85700 1 -- 172.21.15.57:0/424006764 wait complete. 2023-10-06T03:02:31.792 INFO:tasks.cephfs_test_runner:The maximum number of openfiles omap objects keys are now equal to ... ok 2023-10-06T03:02:31.792 INFO:tasks.cephfs_test_runner:Starting test: test_perf_counters (tasks.cephfs.test_openfiletable.OpenFileTable) Opening a file should increment omap_total_updates by 1. 2023-10-06T03:02:31.792 INFO:tasks.cephfs_test_runner:test_perf_counters (tasks.cephfs.test_openfiletable.OpenFileTable) 2023-10-06T03:02:31.792 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_openfiletable.OpenFileTable.test_perf_counters' 2023-10-06T03:02:31.959 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.954+0000 7ff42766e700 1 Processor -- start 2023-10-06T03:02:31.959 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.954+0000 7ff42766e700 1 -- start start 2023-10-06T03:02:31.961 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.954+0000 7ff42766e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff42015e600 0x7ff4200675c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:31.961 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.954+0000 7ff42766e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff42006da20 con 0x7ff4200671f0 2023-10-06T03:02:31.961 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.954+0000 7ff42766e700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4200b0650 con 0x7ff42006deb0 2023-10-06T03:02:31.961 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.954+0000 7ff42766e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff42015ea60 con 0x7ff42015e600 2023-10-06T03:02:31.962 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.954+0000 7ff42540a700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7ff4200671f0 0x7ff4200aff40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:45524/0 (socket says 172.21.15.57:45524) 2023-10-06T03:02:31.962 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.954+0000 7ff42540a700 1 -- 172.21.15.57:0/2550724251 learned_addr learned my addr 172.21.15.57:0/2550724251 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:02:31.965 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.954+0000 7ff425c0b700 1 --2- 172.21.15.57:0/2550724251 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff42015e600 0x7ff4200675c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:31.965 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.958+0000 7ff417fff700 1 -- 172.21.15.57:0/2550724251 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3102487780 0 0) 0x7ff42006da20 con 0x7ff4200671f0 2023-10-06T03:02:31.965 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.958+0000 7ff417fff700 1 -- 172.21.15.57:0/2550724251 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff40c003570 con 0x7ff4200671f0 2023-10-06T03:02:31.965 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.958+0000 7ff417fff700 1 -- 172.21.15.57:0/2550724251 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 639834285 0 0) 0x7ff4200b0650 con 0x7ff42006deb0 2023-10-06T03:02:31.966 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.958+0000 7ff417fff700 1 -- 172.21.15.57:0/2550724251 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff42006da20 con 0x7ff42006deb0 2023-10-06T03:02:31.966 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.958+0000 7ff417fff700 1 -- 172.21.15.57:0/2550724251 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 930628477 0 0) 0x7ff40c003570 con 0x7ff4200671f0 2023-10-06T03:02:31.966 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.958+0000 7ff417fff700 1 -- 172.21.15.57:0/2550724251 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff42015e600 msgr2=0x7ff4200675c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:31.966 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.958+0000 7ff417fff700 1 --2- 172.21.15.57:0/2550724251 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff42015e600 0x7ff4200675c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:31.966 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.958+0000 7ff417fff700 1 -- 172.21.15.57:0/2550724251 >> v1:172.21.15.105:6789/0 conn(0x7ff42006deb0 legacy=0x7ff42015cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:31.966 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.958+0000 7ff417fff700 1 -- 172.21.15.57:0/2550724251 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff42006ce10 con 0x7ff4200671f0 2023-10-06T03:02:31.967 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.958+0000 7ff417fff700 1 -- 172.21.15.57:0/2550724251 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2482400018 0 0) 0x7ff41c001470 con 0x7ff4200671f0 2023-10-06T03:02:31.967 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.958+0000 7ff417fff700 1 -- 172.21.15.57:0/2550724251 >> v1:172.21.15.57:6789/0 conn(0x7ff4200671f0 legacy=0x7ff4200aff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:31.967 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.958+0000 7ff417fff700 1 --2- 172.21.15.57:0/2550724251 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff40c003c20 0x7ff40c004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:31.967 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.958+0000 7ff417fff700 1 --2- 172.21.15.57:0/2550724251 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff40c004810 0x7ff40c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:31.967 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.958+0000 7ff417fff700 1 --2- 172.21.15.57:0/2550724251 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff40c0051c0 0x7ff40c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:31.967 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.958+0000 7ff417fff700 1 -- 172.21.15.57:0/2550724251 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff40c00bff0 con 0x7ff40c0051c0 2023-10-06T03:02:31.967 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.958+0000 7ff417fff700 1 -- 172.21.15.57:0/2550724251 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff40c00c160 con 0x7ff40c004810 2023-10-06T03:02:31.967 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.958+0000 7ff417fff700 1 -- 172.21.15.57:0/2550724251 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff40c00c320 con 0x7ff40c003c20 2023-10-06T03:02:31.968 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.958+0000 7ff425c0b700 1 --2- 172.21.15.57:0/2550724251 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff40c0051c0 0x7ff40c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:31.968 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.958+0000 7ff424c09700 1 --2- 172.21.15.57:0/2550724251 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff40c004810 0x7ff40c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:31.968 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.958+0000 7ff42540a700 1 --2- 172.21.15.57:0/2550724251 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff40c003c20 0x7ff40c004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:31.968 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.958+0000 7ff425c0b700 1 -- 172.21.15.57:0/2550724251 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff40c003c20 msgr2=0x7ff40c004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:31.968 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.958+0000 7ff425c0b700 1 --2- 172.21.15.57:0/2550724251 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff40c003c20 0x7ff40c004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:31.968 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.958+0000 7ff425c0b700 1 -- 172.21.15.57:0/2550724251 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff40c004810 msgr2=0x7ff40c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:31.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.958+0000 7ff425c0b700 1 --2- 172.21.15.57:0/2550724251 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff40c004810 0x7ff40c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:31.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.958+0000 7ff425c0b700 1 -- 172.21.15.57:0/2550724251 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff40c003570 con 0x7ff40c0051c0 2023-10-06T03:02:31.970 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.958+0000 7ff425c0b700 1 --2- 172.21.15.57:0/2550724251 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff40c0051c0 0x7ff40c00ba60 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7ff42015e9d0 tx=0x7ff41800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76221660174f592b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:31.970 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.958+0000 7ff417fff700 1 -- 172.21.15.57:0/2550724251 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff41800e960 con 0x7ff40c0051c0 2023-10-06T03:02:31.970 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.958+0000 7ff417fff700 1 -- 172.21.15.57:0/2550724251 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff41800f040 con 0x7ff40c0051c0 2023-10-06T03:02:31.970 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.958+0000 7ff417fff700 1 -- 172.21.15.57:0/2550724251 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff41800ecf0 con 0x7ff40c0051c0 2023-10-06T03:02:31.970 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.962+0000 7ff42766e700 1 -- 172.21.15.57:0/2550724251 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff40c0051c0 msgr2=0x7ff40c00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:31.970 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.962+0000 7ff42766e700 1 --2- 172.21.15.57:0/2550724251 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff40c0051c0 0x7ff40c00ba60 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7ff42015e9d0 tx=0x7ff41800b040 comp rx=0 tx=0).stop 2023-10-06T03:02:31.970 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.962+0000 7ff425c0b700 1 -- 172.21.15.57:0/2550724251 reap_dead start 2023-10-06T03:02:31.970 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.962+0000 7ff42766e700 1 -- 172.21.15.57:0/2550724251 shutdown_connections 2023-10-06T03:02:31.971 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.962+0000 7ff42766e700 1 -- 172.21.15.57:0/2550724251 >> 172.21.15.57:0/2550724251 conn(0x7ff4200cbdd0 msgr2=0x7ff4200cc1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:31.971 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.962+0000 7ff42766e700 1 -- 172.21.15.57:0/2550724251 shutdown_connections 2023-10-06T03:02:31.971 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.962+0000 7ff42766e700 1 -- 172.21.15.57:0/2550724251 wait complete. 2023-10-06T03:02:31.971 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.962+0000 7ff42766e700 1 Processor -- start 2023-10-06T03:02:31.971 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.962+0000 7ff42766e700 1 -- start start 2023-10-06T03:02:31.972 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.966+0000 7ff42766e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff4200aaf30 0x7ff420161b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:31.972 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.966+0000 7ff42766e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff4200a46e0 0x7ff4200a4b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:31.972 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.966+0000 7ff42766e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff42015fcd0 0x7ff420160140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:31.972 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.966+0000 7ff42766e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff420162080 con 0x7ff4200a46e0 2023-10-06T03:02:31.972 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.966+0000 7ff42766e700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4201616b0 con 0x7ff42015fcd0 2023-10-06T03:02:31.973 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.966+0000 7ff42766e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4200a5090 con 0x7ff4200aaf30 2023-10-06T03:02:31.973 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.966+0000 7ff424c09700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff4200a46e0 0x7ff4200a4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:31.973 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.966+0000 7ff424c09700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff4200a46e0 0x7ff4200a4b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:49974/0 (socket says 172.21.15.57:49974) 2023-10-06T03:02:31.973 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.966+0000 7ff424c09700 1 -- 172.21.15.57:0/4190785538 learned_addr learned my addr 172.21.15.57:0/4190785538 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:02:31.973 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.966+0000 7ff42540a700 1 --2- 172.21.15.57:0/4190785538 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff4200aaf30 0x7ff420161b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:31.973 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.966+0000 7ff424c09700 1 -- 172.21.15.57:0/4190785538 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff4200aaf30 msgr2=0x7ff420161b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:31.973 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.966+0000 7ff425c0b700 1 --2- 172.21.15.57:0/4190785538 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff42015fcd0 0x7ff420160140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:31.973 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.966+0000 7ff424c09700 1 --2- 172.21.15.57:0/4190785538 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff4200aaf30 0x7ff420161b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:31.974 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.966+0000 7ff424c09700 1 -- 172.21.15.57:0/4190785538 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff42015fcd0 msgr2=0x7ff420160140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:31.974 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.966+0000 7ff424c09700 1 --2- 172.21.15.57:0/4190785538 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff42015fcd0 0x7ff420160140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:31.974 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.966+0000 7ff424c09700 1 -- 172.21.15.57:0/4190785538 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4200ab300 con 0x7ff4200a46e0 2023-10-06T03:02:31.974 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.966+0000 7ff425c0b700 1 --2- 172.21.15.57:0/4190785538 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff42015fcd0 0x7ff420160140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:02:31.975 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.966+0000 7ff424c09700 1 --2- 172.21.15.57:0/4190785538 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff4200a46e0 0x7ff4200a4b50 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7ff410002b60 tx=0x7ff410007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:31.975 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.966+0000 7ff4157fa700 1 -- 172.21.15.57:0/4190785538 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff41000f970 con 0x7ff4200a46e0 2023-10-06T03:02:31.975 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.966+0000 7ff4157fa700 1 -- 172.21.15.57:0/4190785538 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff41000faf0 con 0x7ff4200a46e0 2023-10-06T03:02:31.975 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.966+0000 7ff42766e700 1 -- 172.21.15.57:0/4190785538 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff420160aa0 con 0x7ff4200a46e0 2023-10-06T03:02:31.975 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.966+0000 7ff4157fa700 1 -- 172.21.15.57:0/4190785538 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff41000feb0 con 0x7ff4200a46e0 2023-10-06T03:02:31.975 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.966+0000 7ff42766e700 1 -- 172.21.15.57:0/4190785538 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff420161060 con 0x7ff4200a46e0 2023-10-06T03:02:31.975 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.970+0000 7ff42766e700 1 -- 172.21.15.57:0/4190785538 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff420161840 con 0x7ff4200a46e0 2023-10-06T03:02:31.976 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.970+0000 7ff4157fa700 1 -- 172.21.15.57:0/4190785538 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7ff41001c460 con 0x7ff4200a46e0 2023-10-06T03:02:31.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.970+0000 7ff4157fa700 1 --2- 172.21.15.57:0/4190785538 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7ff404060580 0x7ff404062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:31.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.970+0000 7ff4157fa700 1 -- 172.21.15.57:0/4190785538 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5378+0+0 (secure 0 0 0) 0x7ff41007c810 con 0x7ff4200a46e0 2023-10-06T03:02:31.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.970+0000 7ff42540a700 1 --2- 172.21.15.57:0/4190785538 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7ff404060580 0x7ff404062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:31.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.974+0000 7ff42540a700 1 --2- 172.21.15.57:0/4190785538 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7ff404060580 0x7ff404062a30 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff41c000e10 tx=0x7ff41c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:31.985 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:31.978+0000 7ff4157fa700 1 -- 172.21.15.57:0/4190785538 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7ff41004cea0 con 0x7ff4200a46e0 2023-10-06T03:02:32.212 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:32.206+0000 7ff42766e700 1 -- 172.21.15.57:0/4190785538 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_openfiletable.OpenFileTable.test_perf_counters"]} v 0) v1 -- 0x7ff4200712e0 con 0x7ff4200a46e0 2023-10-06T03:02:32.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:32.770+0000 7ff4157fa700 1 -- 172.21.15.57:0/4190785538 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_openfiletable.OpenFileTable.test_perf_counters"]}]=0 v108) v1 ==== 146+0+0 (secure 0 0 0) 0x7ff4100170d0 con 0x7ff4200a46e0 2023-10-06T03:02:32.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:32.774+0000 7ff42766e700 1 -- 172.21.15.57:0/4190785538 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7ff404060580 msgr2=0x7ff404062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:32.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:32.774+0000 7ff42766e700 1 --2- 172.21.15.57:0/4190785538 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7ff404060580 0x7ff404062a30 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff41c000e10 tx=0x7ff41c009040 comp rx=0 tx=0).stop 2023-10-06T03:02:32.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:32.774+0000 7ff42766e700 1 -- 172.21.15.57:0/4190785538 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff4200a46e0 msgr2=0x7ff4200a4b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:32.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:32.774+0000 7ff42766e700 1 --2- 172.21.15.57:0/4190785538 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff4200a46e0 0x7ff4200a4b50 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7ff410002b60 tx=0x7ff410007d30 comp rx=0 tx=0).stop 2023-10-06T03:02:32.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:32.774+0000 7ff42766e700 1 -- 172.21.15.57:0/4190785538 shutdown_connections 2023-10-06T03:02:32.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:32.774+0000 7ff42766e700 1 --2- 172.21.15.57:0/4190785538 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff42015fcd0 0x7ff420160140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:32.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:32.774+0000 7ff42766e700 1 --2- 172.21.15.57:0/4190785538 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff4200a46e0 0x7ff4200a4b50 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:32.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:32.774+0000 7ff42766e700 1 --2- 172.21.15.57:0/4190785538 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7ff404060580 0x7ff404062a30 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:32.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:32.774+0000 7ff42766e700 1 --2- 172.21.15.57:0/4190785538 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff4200aaf30 0x7ff420161b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:32.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:32.774+0000 7ff42766e700 1 -- 172.21.15.57:0/4190785538 >> 172.21.15.57:0/4190785538 conn(0x7ff4200cbdd0 msgr2=0x7ff4200ad680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:32.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:32.774+0000 7ff42766e700 1 -- 172.21.15.57:0/4190785538 shutdown_connections 2023-10-06T03:02:32.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:32.778+0000 7ff42766e700 1 -- 172.21.15.57:0/4190785538 wait complete. 2023-10-06T03:02:32.808 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-06T03:02:32.982 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:32.974+0000 7f1a797cc700 1 Processor -- start 2023-10-06T03:02:32.983 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:32.978+0000 7f1a797cc700 1 -- start start 2023-10-06T03:02:32.986 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:32.978+0000 7f1a797cc700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1a741427e0 0x7f1a740cadc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:32.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:32.982+0000 7f1a797cc700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1a740cc470 0x7f1a74142bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:32.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:32.982+0000 7f1a797cc700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a740cbfe0 con 0x7f1a7406bf30 2023-10-06T03:02:32.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:32.982+0000 7f1a797cc700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a740cb3d0 con 0x7f1a740cc470 2023-10-06T03:02:32.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:32.982+0000 7f1a797cc700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a740cb6b0 con 0x7f1a741427e0 2023-10-06T03:02:32.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:32.982+0000 7f1a737fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1a740cc470 0x7f1a74142bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:32.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:32.982+0000 7f1a737fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1a740cc470 0x7f1a74142bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:49990/0 (socket says 172.21.15.57:49990) 2023-10-06T03:02:32.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:32.982+0000 7f1a737fe700 1 -- 172.21.15.57:0/3172229304 learned_addr learned my addr 172.21.15.57:0/3172229304 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:02:32.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:32.982+0000 7f1a73fff700 1 --2- 172.21.15.57:0/3172229304 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1a741427e0 0x7f1a740cadc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:32.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:32.982+0000 7f1a737fe700 1 -- 172.21.15.57:0/3172229304 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1a741427e0 msgr2=0x7f1a740cadc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:32.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:32.982+0000 7f1a737fe700 1 --2- 172.21.15.57:0/3172229304 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1a741427e0 0x7f1a740cadc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:32.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:32.982+0000 7f1a737fe700 1 -- 172.21.15.57:0/3172229304 >> v1:172.21.15.105:6789/0 conn(0x7f1a7406bf30 legacy=0x7f1a740ce710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:32.989 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:32.982+0000 7f1a737fe700 1 -- 172.21.15.57:0/3172229304 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a740cb990 con 0x7f1a740cc470 2023-10-06T03:02:32.989 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:32.982+0000 7f1a737fe700 1 --2- 172.21.15.57:0/3172229304 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1a740cc470 0x7f1a74142bb0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f1a680099b0 tx=0x7f1a68009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d9498c67723130e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:32.989 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:32.982+0000 7f1a72ffd700 1 -- 172.21.15.57:0/3172229304 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a68009ea0 con 0x7f1a740cc470 2023-10-06T03:02:32.990 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:32.982+0000 7f1a72ffd700 1 -- 172.21.15.57:0/3172229304 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a6800b860 con 0x7f1a740cc470 2023-10-06T03:02:32.990 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:32.982+0000 7f1a72ffd700 1 -- 172.21.15.57:0/3172229304 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a6800bc00 con 0x7f1a740cc470 2023-10-06T03:02:32.990 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:32.986+0000 7f1a797cc700 1 -- 172.21.15.57:0/3172229304 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1a740cc470 msgr2=0x7f1a74142bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:32.990 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:32.986+0000 7f1a797cc700 1 --2- 172.21.15.57:0/3172229304 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1a740cc470 0x7f1a74142bb0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f1a680099b0 tx=0x7f1a68009250 comp rx=0 tx=0).stop 2023-10-06T03:02:32.991 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:32.986+0000 7f1a797cc700 1 -- 172.21.15.57:0/3172229304 shutdown_connections 2023-10-06T03:02:32.991 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:32.986+0000 7f1a797cc700 1 --2- 172.21.15.57:0/3172229304 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1a740cc470 0x7f1a74142bb0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:32.991 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:32.986+0000 7f1a797cc700 1 --2- 172.21.15.57:0/3172229304 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1a741427e0 0x7f1a740cadc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:32.991 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:32.986+0000 7f1a797cc700 1 -- 172.21.15.57:0/3172229304 >> 172.21.15.57:0/3172229304 conn(0x7f1a740cffe0 msgr2=0x7f1a740d03e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:32.991 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:32.986+0000 7f1a797cc700 1 -- 172.21.15.57:0/3172229304 shutdown_connections 2023-10-06T03:02:32.991 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:32.986+0000 7f1a797cc700 1 -- 172.21.15.57:0/3172229304 wait complete. 2023-10-06T03:02:32.993 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:32.986+0000 7f1a797cc700 1 Processor -- start 2023-10-06T03:02:32.994 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:32.990+0000 7f1a797cc700 1 -- start start 2023-10-06T03:02:32.996 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:32.990+0000 7f1a797cc700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1a7406bf30 0x7f1a740c81c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:32.996 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:32.990+0000 7f1a797cc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1a740cc470 0x7f1a74158a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:32.996 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:32.990+0000 7f1a797cc700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a741427e0 0x7f1a741405a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:32.996 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:32.990+0000 7f1a797cc700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a740c9ae0 con 0x7f1a740cc470 2023-10-06T03:02:32.997 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:32.990+0000 7f1a797cc700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a740c9650 con 0x7f1a741427e0 2023-10-06T03:02:32.997 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:32.990+0000 7f1a797cc700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a740c8a40 con 0x7f1a7406bf30 2023-10-06T03:02:32.998 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:32.990+0000 7f1a737fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1a740cc470 0x7f1a74158a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:32.998 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:32.990+0000 7f1a737fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1a740cc470 0x7f1a74158a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:50000/0 (socket says 172.21.15.57:50000) 2023-10-06T03:02:32.998 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:32.990+0000 7f1a737fe700 1 -- 172.21.15.57:0/1700407784 learned_addr learned my addr 172.21.15.57:0/1700407784 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:02:32.998 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:32.990+0000 7f1a73fff700 1 --2- 172.21.15.57:0/1700407784 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1a7406bf30 0x7f1a740c81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:32.998 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:32.990+0000 7f1a78fcb700 1 --2- 172.21.15.57:0/1700407784 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a741427e0 0x7f1a741405a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:32.998 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:32.990+0000 7f1a737fe700 1 -- 172.21.15.57:0/1700407784 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1a7406bf30 msgr2=0x7f1a740c81c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:32.998 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:32.990+0000 7f1a737fe700 1 --2- 172.21.15.57:0/1700407784 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1a7406bf30 0x7f1a740c81c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:32.998 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:32.990+0000 7f1a737fe700 1 -- 172.21.15.57:0/1700407784 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a741427e0 msgr2=0x7f1a741405a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:32.998 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:32.990+0000 7f1a737fe700 1 --2- 172.21.15.57:0/1700407784 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a741427e0 0x7f1a741405a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:32.998 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:32.990+0000 7f1a737fe700 1 -- 172.21.15.57:0/1700407784 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a680094f0 con 0x7f1a740cc470 2023-10-06T03:02:32.998 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:32.990+0000 7f1a78fcb700 1 --2- 172.21.15.57:0/1700407784 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a741427e0 0x7f1a741405a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:02:32.999 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:32.990+0000 7f1a737fe700 1 --2- 172.21.15.57:0/1700407784 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1a740cc470 0x7f1a74158a00 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f1a68006fd0 tx=0x7f1a68017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:32.999 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:32.994+0000 7f1a5bfff700 1 -- 172.21.15.57:0/1700407784 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a68000d10 con 0x7f1a740cc470 2023-10-06T03:02:32.999 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:32.994+0000 7f1a5bfff700 1 -- 172.21.15.57:0/1700407784 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a6800bbe0 con 0x7f1a740cc470 2023-10-06T03:02:33.000 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:32.994+0000 7f1a5bfff700 1 -- 172.21.15.57:0/1700407784 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a68011650 con 0x7f1a740cc470 2023-10-06T03:02:33.000 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:32.994+0000 7f1a797cc700 1 -- 172.21.15.57:0/1700407784 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a740c8d20 con 0x7f1a740cc470 2023-10-06T03:02:33.000 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:32.994+0000 7f1a797cc700 1 -- 172.21.15.57:0/1700407784 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a740c92e0 con 0x7f1a740cc470 2023-10-06T03:02:33.001 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:32.994+0000 7f1a797cc700 1 -- 172.21.15.57:0/1700407784 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a7404be40 con 0x7f1a740cc470 2023-10-06T03:02:33.002 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:32.998+0000 7f1a5bfff700 1 -- 172.21.15.57:0/1700407784 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f1a68011a40 con 0x7f1a740cc470 2023-10-06T03:02:33.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:32.998+0000 7f1a5bfff700 1 --2- 172.21.15.57:0/1700407784 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f1a60060550 0x7f1a60062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:33.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:32.998+0000 7f1a5bfff700 1 -- 172.21.15.57:0/1700407784 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5378+0+0 (secure 0 0 0) 0x7f1a6807dc00 con 0x7f1a740cc470 2023-10-06T03:02:33.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:32.998+0000 7f1a73fff700 1 --2- 172.21.15.57:0/1700407784 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f1a60060550 0x7f1a60062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:33.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.002+0000 7f1a73fff700 1 --2- 172.21.15.57:0/1700407784 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f1a60060550 0x7f1a60062a00 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f1a64009d10 tx=0x7f1a640091a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:33.011 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.006+0000 7f1a5bfff700 1 -- 172.21.15.57:0/1700407784 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f1a6804e310 con 0x7f1a740cc470 2023-10-06T03:02:33.185 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.178+0000 7f1a797cc700 1 -- 172.21.15.57:0/1700407784 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f1a740c9790 con 0x7f1a740cc470 2023-10-06T03:02:33.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.186+0000 7f1a5bfff700 1 -- 172.21.15.57:0/1700407784 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7f1a68051930 con 0x7f1a740cc470 2023-10-06T03:02:33.199 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.194+0000 7f1a797cc700 1 -- 172.21.15.57:0/1700407784 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f1a60060550 msgr2=0x7f1a60062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:33.199 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.194+0000 7f1a797cc700 1 --2- 172.21.15.57:0/1700407784 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f1a60060550 0x7f1a60062a00 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f1a64009d10 tx=0x7f1a640091a0 comp rx=0 tx=0).stop 2023-10-06T03:02:33.200 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.194+0000 7f1a797cc700 1 -- 172.21.15.57:0/1700407784 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1a740cc470 msgr2=0x7f1a74158a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:33.200 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.194+0000 7f1a797cc700 1 --2- 172.21.15.57:0/1700407784 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1a740cc470 0x7f1a74158a00 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f1a68006fd0 tx=0x7f1a68017000 comp rx=0 tx=0).stop 2023-10-06T03:02:33.200 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.194+0000 7f1a797cc700 1 -- 172.21.15.57:0/1700407784 shutdown_connections 2023-10-06T03:02:33.200 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.194+0000 7f1a797cc700 1 --2- 172.21.15.57:0/1700407784 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a741427e0 0x7f1a741405a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:33.200 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.194+0000 7f1a797cc700 1 --2- 172.21.15.57:0/1700407784 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1a740cc470 0x7f1a74158a00 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:33.200 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.194+0000 7f1a797cc700 1 --2- 172.21.15.57:0/1700407784 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f1a60060550 0x7f1a60062a00 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:33.200 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.194+0000 7f1a797cc700 1 --2- 172.21.15.57:0/1700407784 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1a7406bf30 0x7f1a740c81c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:33.200 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.194+0000 7f1a797cc700 1 -- 172.21.15.57:0/1700407784 >> 172.21.15.57:0/1700407784 conn(0x7f1a740cffe0 msgr2=0x7f1a740c5c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:33.200 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.194+0000 7f1a797cc700 1 -- 172.21.15.57:0/1700407784 shutdown_connections 2023-10-06T03:02:33.200 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.194+0000 7f1a797cc700 1 -- 172.21.15.57:0/1700407784 wait complete. 2023-10-06T03:02:33.222 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T03:02:33.222 DEBUG:teuthology.orchestra.run.smithi057:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T03:02:33.264 DEBUG:teuthology.orchestra.run.smithi105:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T03:02:33.308 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T03:02:33.308 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-06T03:02:33.308 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:02:33.470 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.462+0000 7f0d834f0700 1 Processor -- start 2023-10-06T03:02:33.471 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.466+0000 7f0d834f0700 1 -- start start 2023-10-06T03:02:33.474 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.466+0000 7f0d834f0700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0d7c0675c0 0x7f0d7c14fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:33.474 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.466+0000 7f0d834f0700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f0d7c150180 0x7f0d7c15ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:33.474 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.466+0000 7f0d834f0700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d7c067a00 con 0x7f0d7c0671f0 2023-10-06T03:02:33.474 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.466+0000 7f0d834f0700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d7c06d7e0 con 0x7f0d7c0675c0 2023-10-06T03:02:33.474 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.466+0000 7f0d834f0700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d7c150600 con 0x7f0d7c150180 2023-10-06T03:02:33.474 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.466+0000 7f0d80a8b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0d7c0675c0 0x7f0d7c14fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:33.475 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.466+0000 7f0d8128c700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f0d7c0671f0 0x7f0d7c06dc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:45530/0 (socket says 172.21.15.57:45530) 2023-10-06T03:02:33.475 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.466+0000 7f0d8128c700 1 -- 172.21.15.57:0/384000792 learned_addr learned my addr 172.21.15.57:0/384000792 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:02:33.475 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.466+0000 7f0d81a8d700 1 --2- 172.21.15.57:0/384000792 >> v2:172.21.15.105:3300/0 conn(0x7f0d7c150180 0x7f0d7c15ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:33.475 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.470+0000 7f0d80a8b700 1 -- 172.21.15.57:0/384000792 >> v2:172.21.15.105:3300/0 conn(0x7f0d7c150180 msgr2=0x7f0d7c15ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:33.475 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.470+0000 7f0d80a8b700 1 --2- 172.21.15.57:0/384000792 >> v2:172.21.15.105:3300/0 conn(0x7f0d7c150180 0x7f0d7c15ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:33.476 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.470+0000 7f0d80a8b700 1 -- 172.21.15.57:0/384000792 >> v1:172.21.15.57:6789/0 conn(0x7f0d7c0671f0 legacy=0x7f0d7c06dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:33.476 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.470+0000 7f0d80a8b700 1 -- 172.21.15.57:0/384000792 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d7c15dc00 con 0x7f0d7c0675c0 2023-10-06T03:02:33.476 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.470+0000 7f0d73fff700 1 -- 172.21.15.57:0/384000792 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1779594206 0 0) 0x7f0d7c067a00 con 0x7f0d7c0671f0 2023-10-06T03:02:33.476 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.470+0000 7f0d80a8b700 1 --2- 172.21.15.57:0/384000792 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0d7c0675c0 0x7f0d7c14fc40 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c1597b0 tx=0x7f0d6c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6472a783b51cf9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:33.477 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.470+0000 7f0d73fff700 1 -- 172.21.15.57:0/384000792 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d6c011630 con 0x7f0d7c0675c0 2023-10-06T03:02:33.477 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.470+0000 7f0d73fff700 1 -- 172.21.15.57:0/384000792 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d6c011790 con 0x7f0d7c0675c0 2023-10-06T03:02:33.477 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.470+0000 7f0d73fff700 1 -- 172.21.15.57:0/384000792 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d6c011b30 con 0x7f0d7c0675c0 2023-10-06T03:02:33.477 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.470+0000 7f0d834f0700 1 -- 172.21.15.57:0/384000792 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0d7c0675c0 msgr2=0x7f0d7c14fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:33.477 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.470+0000 7f0d834f0700 1 --2- 172.21.15.57:0/384000792 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0d7c0675c0 0x7f0d7c14fc40 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c1597b0 tx=0x7f0d6c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:02:33.477 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.470+0000 7f0d834f0700 1 -- 172.21.15.57:0/384000792 shutdown_connections 2023-10-06T03:02:33.477 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.470+0000 7f0d834f0700 1 --2- 172.21.15.57:0/384000792 >> v2:172.21.15.105:3300/0 conn(0x7f0d7c150180 0x7f0d7c15ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:33.477 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.470+0000 7f0d834f0700 1 --2- 172.21.15.57:0/384000792 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0d7c0675c0 0x7f0d7c14fc40 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:33.477 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.470+0000 7f0d834f0700 1 -- 172.21.15.57:0/384000792 >> 172.21.15.57:0/384000792 conn(0x7f0d7c0cbdd0 msgr2=0x7f0d7c0cc1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:33.478 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.470+0000 7f0d834f0700 1 -- 172.21.15.57:0/384000792 shutdown_connections 2023-10-06T03:02:33.478 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.470+0000 7f0d834f0700 1 -- 172.21.15.57:0/384000792 wait complete. 2023-10-06T03:02:33.479 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.474+0000 7f0d834f0700 1 Processor -- start 2023-10-06T03:02:33.479 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.474+0000 7f0d834f0700 1 -- start start 2023-10-06T03:02:33.480 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.474+0000 7f0d834f0700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0d7c0671f0 0x7f0d7c143a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:33.481 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.474+0000 7f0d834f0700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0d7c0675c0 0x7f0d7c14c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:33.481 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.474+0000 7f0d834f0700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0d7c150180 0x7f0d7c14c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:33.481 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.474+0000 7f0d834f0700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d7c0c93a0 con 0x7f0d7c150180 2023-10-06T03:02:33.481 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.474+0000 7f0d834f0700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d7c0c9680 con 0x7f0d7c0675c0 2023-10-06T03:02:33.481 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.474+0000 7f0d834f0700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d7c0c9960 con 0x7f0d7c0671f0 2023-10-06T03:02:33.482 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.474+0000 7f0d81a8d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0d7c150180 0x7f0d7c14c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:33.482 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.474+0000 7f0d81a8d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0d7c150180 0x7f0d7c14c5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:50006/0 (socket says 172.21.15.57:50006) 2023-10-06T03:02:33.482 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.474+0000 7f0d81a8d700 1 -- 172.21.15.57:0/3545704448 learned_addr learned my addr 172.21.15.57:0/3545704448 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:02:33.482 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.474+0000 7f0d80a8b700 1 --2- 172.21.15.57:0/3545704448 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0d7c0675c0 0x7f0d7c14c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:33.482 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.474+0000 7f0d8128c700 1 --2- 172.21.15.57:0/3545704448 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0d7c0671f0 0x7f0d7c143a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:33.482 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.474+0000 7f0d81a8d700 1 -- 172.21.15.57:0/3545704448 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0d7c0671f0 msgr2=0x7f0d7c143a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:33.483 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.474+0000 7f0d81a8d700 1 --2- 172.21.15.57:0/3545704448 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0d7c0671f0 0x7f0d7c143a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:33.483 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.474+0000 7f0d81a8d700 1 -- 172.21.15.57:0/3545704448 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0d7c0675c0 msgr2=0x7f0d7c14c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:33.483 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.474+0000 7f0d81a8d700 1 --2- 172.21.15.57:0/3545704448 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0d7c0675c0 0x7f0d7c14c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:33.483 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.474+0000 7f0d81a8d700 1 -- 172.21.15.57:0/3545704448 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d6c009420 con 0x7f0d7c150180 2023-10-06T03:02:33.484 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.478+0000 7f0d81a8d700 1 --2- 172.21.15.57:0/3545704448 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0d7c150180 0x7f0d7c14c5e0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f0d74009df0 tx=0x7f0d7400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:33.484 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.478+0000 7f0d717fa700 1 -- 172.21.15.57:0/3545704448 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d7400caa0 con 0x7f0d7c150180 2023-10-06T03:02:33.484 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.478+0000 7f0d717fa700 1 -- 172.21.15.57:0/3545704448 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d7400f040 con 0x7f0d7c150180 2023-10-06T03:02:33.484 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.478+0000 7f0d834f0700 1 -- 172.21.15.57:0/3545704448 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d7c0c9c40 con 0x7f0d7c150180 2023-10-06T03:02:33.484 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.478+0000 7f0d717fa700 1 -- 172.21.15.57:0/3545704448 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d7400ce70 con 0x7f0d7c150180 2023-10-06T03:02:33.484 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.478+0000 7f0d834f0700 1 -- 172.21.15.57:0/3545704448 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d7c0c8670 con 0x7f0d7c150180 2023-10-06T03:02:33.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.478+0000 7f0d834f0700 1 -- 172.21.15.57:0/3545704448 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d7c0712e0 con 0x7f0d7c150180 2023-10-06T03:02:33.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.482+0000 7f0d717fa700 1 -- 172.21.15.57:0/3545704448 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f0d74014690 con 0x7f0d7c150180 2023-10-06T03:02:33.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.482+0000 7f0d717fa700 1 --2- 172.21.15.57:0/3545704448 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f0d60060550 0x7f0d60062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:33.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.482+0000 7f0d717fa700 1 -- 172.21.15.57:0/3545704448 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5378+0+0 (secure 0 0 0) 0x7f0d7407cff0 con 0x7f0d7c150180 2023-10-06T03:02:33.489 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.482+0000 7f0d8128c700 1 --2- 172.21.15.57:0/3545704448 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f0d60060550 0x7f0d60062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:33.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.482+0000 7f0d8128c700 1 --2- 172.21.15.57:0/3545704448 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f0d60060550 0x7f0d60062a00 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0d78007fd0 tx=0x7f0d78007d30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:33.495 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.490+0000 7f0d717fa700 1 -- 172.21.15.57:0/3545704448 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f0d740acbe0 con 0x7f0d7c150180 2023-10-06T03:02:33.702 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.694+0000 7f0d834f0700 1 -- 172.21.15.57:0/3545704448 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0d7c06ceb0 con 0x7f0d7c150180 2023-10-06T03:02:33.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.698+0000 7f0d717fa700 1 -- 172.21.15.57:0/3545704448 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+3529 (secure 0 0 0) 0x7f0d74018090 con 0x7f0d7c150180 2023-10-06T03:02:33.703 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:02:33.703 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":25,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5021,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/2302525130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":2302525130},{"type":"v1","addr":"172.21.15.105:6835","nonce":2302525130}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":5158,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6834/3877951826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":3877951826},{"type":"v1","addr":"172.21.15.105:6834","nonce":3877951826}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5214,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/311797094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":311797094},{"type":"v1","addr":"172.21.15.57:6835","nonce":311797094}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5217,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6837/670891004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6836","nonce":670891004},{"type":"v1","addr":"172.21.15.57:6837","nonce":670891004}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[]} 2023-10-06T03:02:33.705 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.698+0000 7f0d834f0700 1 -- 172.21.15.57:0/3545704448 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f0d60060550 msgr2=0x7f0d60062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:33.706 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.698+0000 7f0d834f0700 1 --2- 172.21.15.57:0/3545704448 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f0d60060550 0x7f0d60062a00 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0d78007fd0 tx=0x7f0d78007d30 comp rx=0 tx=0).stop 2023-10-06T03:02:33.706 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.698+0000 7f0d834f0700 1 -- 172.21.15.57:0/3545704448 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0d7c150180 msgr2=0x7f0d7c14c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:33.706 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.698+0000 7f0d834f0700 1 --2- 172.21.15.57:0/3545704448 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0d7c150180 0x7f0d7c14c5e0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f0d74009df0 tx=0x7f0d7400b040 comp rx=0 tx=0).stop 2023-10-06T03:02:33.706 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.698+0000 7f0d834f0700 1 -- 172.21.15.57:0/3545704448 shutdown_connections 2023-10-06T03:02:33.706 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.698+0000 7f0d834f0700 1 --2- 172.21.15.57:0/3545704448 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0d7c150180 0x7f0d7c14c5e0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:33.707 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.698+0000 7f0d834f0700 1 --2- 172.21.15.57:0/3545704448 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0d7c0675c0 0x7f0d7c14c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:33.707 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.698+0000 7f0d834f0700 1 --2- 172.21.15.57:0/3545704448 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f0d60060550 0x7f0d60062a00 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:33.707 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.698+0000 7f0d834f0700 1 --2- 172.21.15.57:0/3545704448 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0d7c0671f0 0x7f0d7c143a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:33.707 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.698+0000 7f0d834f0700 1 -- 172.21.15.57:0/3545704448 >> 172.21.15.57:0/3545704448 conn(0x7f0d7c0cbdd0 msgr2=0x7f0d7c0a93d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:33.707 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.702+0000 7f0d834f0700 1 -- 172.21.15.57:0/3545704448 shutdown_connections 2023-10-06T03:02:33.707 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.702+0000 7f0d834f0700 1 -- 172.21.15.57:0/3545704448 wait complete. 2023-10-06T03:02:33.709 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 25 2023-10-06T03:02:33.729 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-06T03:02:33.729 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-06T03:02:33.730 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-06T03:02:33.730 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:02:33.730 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-06T03:02:33.730 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-06T03:02:33.730 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-06T03:02:33.730 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:02:33.730 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-06T03:02:33.731 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-06T03:02:33.731 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-06T03:02:33.731 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:02:33.731 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-06T03:02:33.731 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-06T03:02:33.731 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-06T03:02:33.731 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:02:33.747 INFO:tasks.ceph.mds.a:Stopped 2023-10-06T03:02:33.747 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-06T03:02:33.750 INFO:tasks.ceph.mds.c:Stopped 2023-10-06T03:02:33.750 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-06T03:02:33.755 INFO:tasks.ceph.mds.b:Stopped 2023-10-06T03:02:33.755 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-06T03:02:33.756 INFO:tasks.ceph.mds.d:Stopped 2023-10-06T03:02:33.757 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-06T03:02:33.804 INFO:tasks.ceph.mds.a:Started 2023-10-06T03:02:33.804 DEBUG:teuthology.parallel:result is None 2023-10-06T03:02:33.806 INFO:tasks.ceph.mds.b:Started 2023-10-06T03:02:33.806 DEBUG:teuthology.parallel:result is None 2023-10-06T03:02:33.810 INFO:tasks.ceph.mds.c:Started 2023-10-06T03:02:33.810 DEBUG:teuthology.parallel:result is None 2023-10-06T03:02:33.811 INFO:tasks.ceph.mds.d:Started 2023-10-06T03:02:33.812 DEBUG:teuthology.parallel:result is None 2023-10-06T03:02:33.812 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-06T03:02:33.914 INFO:tasks.ceph.mds.b.smithi105.stdout:starting mds.b at 2023-10-06T03:02:33.915 INFO:tasks.ceph.mds.a.smithi057.stdout:starting mds.a at 2023-10-06T03:02:33.916 INFO:tasks.ceph.mds.c.smithi057.stdout:starting mds.c at 2023-10-06T03:02:33.920 INFO:tasks.ceph.mds.d.smithi105.stdout:starting mds.d at 2023-10-06T03:02:33.971 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.966+0000 7fdd4a416700 1 Processor -- start 2023-10-06T03:02:33.972 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.966+0000 7fdd4a416700 1 -- start start 2023-10-06T03:02:33.975 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.970+0000 7fdd4a416700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fdd4406c920 0x7fdd440aa7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:33.975 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.970+0000 7fdd4a416700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fdd440aae90 0x7fdd4406bba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:33.975 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.970+0000 7fdd4a416700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd4406de50 con 0x7fdd4406ccf0 2023-10-06T03:02:33.975 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.970+0000 7fdd4a416700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd4406e130 con 0x7fdd4406c920 2023-10-06T03:02:33.975 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.970+0000 7fdd4a416700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd4406b3a0 con 0x7fdd440aae90 2023-10-06T03:02:33.975 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.970+0000 7fdd49414700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fdd4406c920 0x7fdd440aa7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:33.976 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.970+0000 7fdd49c15700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fdd4406ccf0 0x7fdd440c64c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:45546/0 (socket says 172.21.15.57:45546) 2023-10-06T03:02:33.976 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.970+0000 7fdd49c15700 1 -- 172.21.15.57:0/1545489194 learned_addr learned my addr 172.21.15.57:0/1545489194 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:02:33.976 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.970+0000 7fdd48c13700 1 --2- 172.21.15.57:0/1545489194 >> v2:172.21.15.105:3300/0 conn(0x7fdd440aae90 0x7fdd4406bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:33.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.970+0000 7fdd3bfff700 1 -- 172.21.15.57:0/1545489194 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1023803468 0 0) 0x7fdd4406de50 con 0x7fdd4406ccf0 2023-10-06T03:02:33.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.970+0000 7fdd3bfff700 1 -- 172.21.15.57:0/1545489194 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd30003570 con 0x7fdd4406ccf0 2023-10-06T03:02:33.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.970+0000 7fdd3bfff700 1 -- 172.21.15.57:0/1545489194 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1723630748 0 0) 0x7fdd30003570 con 0x7fdd4406ccf0 2023-10-06T03:02:33.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.970+0000 7fdd49414700 1 -- 172.21.15.57:0/1545489194 >> v2:172.21.15.105:3300/0 conn(0x7fdd440aae90 msgr2=0x7fdd4406bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:33.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.970+0000 7fdd49414700 1 --2- 172.21.15.57:0/1545489194 >> v2:172.21.15.105:3300/0 conn(0x7fdd440aae90 0x7fdd4406bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:33.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.970+0000 7fdd49414700 1 -- 172.21.15.57:0/1545489194 >> v1:172.21.15.57:6789/0 conn(0x7fdd4406ccf0 legacy=0x7fdd440c64c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:33.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.970+0000 7fdd49414700 1 -- 172.21.15.57:0/1545489194 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd4406b680 con 0x7fdd4406c920 2023-10-06T03:02:33.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.970+0000 7fdd49414700 1 --2- 172.21.15.57:0/1545489194 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd4406c920 0x7fdd440aa7e0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fdd440ae750 tx=0x7fdd400091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6caebb14d43fcc8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:33.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.970+0000 7fdd3bfff700 1 -- 172.21.15.57:0/1545489194 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd3c0017f0 con 0x7fdd4406c920 2023-10-06T03:02:33.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.970+0000 7fdd3bfff700 1 -- 172.21.15.57:0/1545489194 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd40011420 con 0x7fdd4406c920 2023-10-06T03:02:33.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.970+0000 7fdd3bfff700 1 -- 172.21.15.57:0/1545489194 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd400117c0 con 0x7fdd4406c920 2023-10-06T03:02:33.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.974+0000 7fdd4a416700 1 -- 172.21.15.57:0/1545489194 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd4406c920 msgr2=0x7fdd440aa7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:33.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.974+0000 7fdd4a416700 1 --2- 172.21.15.57:0/1545489194 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd4406c920 0x7fdd440aa7e0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fdd440ae750 tx=0x7fdd400091a0 comp rx=0 tx=0).stop 2023-10-06T03:02:33.980 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.974+0000 7fdd4a416700 1 -- 172.21.15.57:0/1545489194 shutdown_connections 2023-10-06T03:02:33.980 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.974+0000 7fdd4a416700 1 --2- 172.21.15.57:0/1545489194 >> v2:172.21.15.105:3300/0 conn(0x7fdd440aae90 0x7fdd4406bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:33.980 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.974+0000 7fdd4a416700 1 --2- 172.21.15.57:0/1545489194 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd4406c920 0x7fdd440aa7e0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:33.980 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.974+0000 7fdd4a416700 1 -- 172.21.15.57:0/1545489194 >> 172.21.15.57:0/1545489194 conn(0x7fdd440c85e0 msgr2=0x7fdd440c89e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:33.980 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.974+0000 7fdd4a416700 1 -- 172.21.15.57:0/1545489194 shutdown_connections 2023-10-06T03:02:33.980 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.974+0000 7fdd4a416700 1 -- 172.21.15.57:0/1545489194 wait complete. 2023-10-06T03:02:33.982 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.978+0000 7fdd4a416700 1 Processor -- start 2023-10-06T03:02:33.983 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.978+0000 7fdd4a416700 1 -- start start 2023-10-06T03:02:33.986 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.978+0000 7fdd4a416700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdd4406c920 0x7fdd440c14b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:33.986 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.978+0000 7fdd4a416700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd4406ccf0 0x7fdd4415e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:33.986 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.978+0000 7fdd4a416700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdd440aae90 0x7fdd440ae9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:33.986 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.978+0000 7fdd4a416700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd44156980 con 0x7fdd4406ccf0 2023-10-06T03:02:33.986 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.978+0000 7fdd4a416700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd440c1020 con 0x7fdd4406c920 2023-10-06T03:02:33.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.978+0000 7fdd4a416700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd4415ed20 con 0x7fdd440aae90 2023-10-06T03:02:33.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.978+0000 7fdd48c13700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd4406ccf0 0x7fdd4415e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:33.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.978+0000 7fdd49414700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdd4406c920 0x7fdd440c14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:33.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.978+0000 7fdd48c13700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd4406ccf0 0x7fdd4415e7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:50074/0 (socket says 172.21.15.57:50074) 2023-10-06T03:02:33.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.978+0000 7fdd48c13700 1 -- 172.21.15.57:0/1724080839 learned_addr learned my addr 172.21.15.57:0/1724080839 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:02:33.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.978+0000 7fdd49c15700 1 --2- 172.21.15.57:0/1724080839 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdd440aae90 0x7fdd440ae9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:33.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.982+0000 7fdd49414700 1 -- 172.21.15.57:0/1724080839 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdd440aae90 msgr2=0x7fdd440ae9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:33.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.982+0000 7fdd49414700 1 --2- 172.21.15.57:0/1724080839 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdd440aae90 0x7fdd440ae9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:33.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.982+0000 7fdd49414700 1 -- 172.21.15.57:0/1724080839 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd4406ccf0 msgr2=0x7fdd4415e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:33.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.982+0000 7fdd49414700 1 --2- 172.21.15.57:0/1724080839 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd4406ccf0 0x7fdd4415e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:33.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.982+0000 7fdd49414700 1 -- 172.21.15.57:0/1724080839 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd40009420 con 0x7fdd4406c920 2023-10-06T03:02:33.989 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.982+0000 7fdd48c13700 1 --2- 172.21.15.57:0/1724080839 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd4406ccf0 0x7fdd4415e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:02:33.989 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.982+0000 7fdd49414700 1 --2- 172.21.15.57:0/1724080839 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdd4406c920 0x7fdd440c14b0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fdd40015000 tx=0x7fdd40016000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:33.989 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.982+0000 7fdd397fa700 1 -- 172.21.15.57:0/1724080839 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd4001cab0 con 0x7fdd4406c920 2023-10-06T03:02:33.989 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.982+0000 7fdd397fa700 1 -- 172.21.15.57:0/1724080839 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd4001cc30 con 0x7fdd4406c920 2023-10-06T03:02:33.989 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.982+0000 7fdd397fa700 1 -- 172.21.15.57:0/1724080839 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd4001a450 con 0x7fdd4406c920 2023-10-06T03:02:33.989 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.982+0000 7fdd4a416700 1 -- 172.21.15.57:0/1724080839 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd440c0a10 con 0x7fdd4406c920 2023-10-06T03:02:33.989 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.982+0000 7fdd4a416700 1 -- 172.21.15.57:0/1724080839 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd440af4d0 con 0x7fdd4406c920 2023-10-06T03:02:33.990 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.982+0000 7fdd4a416700 1 -- 172.21.15.57:0/1724080839 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd4404be40 con 0x7fdd4406c920 2023-10-06T03:02:33.991 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.986+0000 7fdd397fa700 1 -- 172.21.15.57:0/1724080839 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fdd4001a8a0 con 0x7fdd4406c920 2023-10-06T03:02:33.992 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.986+0000 7fdd397fa700 1 --2- 172.21.15.57:0/1724080839 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fdd28060580 0x7fdd28062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:33.992 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.986+0000 7fdd397fa700 1 -- 172.21.15.57:0/1724080839 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5378+0+0 (secure 0 0 0) 0x7fdd4007e2f0 con 0x7fdd4406c920 2023-10-06T03:02:33.993 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.986+0000 7fdd48c13700 1 --2- 172.21.15.57:0/1724080839 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fdd28060580 0x7fdd28062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:33.994 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.986+0000 7fdd48c13700 1 --2- 172.21.15.57:0/1724080839 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fdd28060580 0x7fdd28062a30 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fdd440c7510 tx=0x7fdd340091a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:34.000 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:33.994+0000 7fdd397fa700 1 -- 172.21.15.57:0/1724080839 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fdd4004e980 con 0x7fdd4406c920 2023-10-06T03:02:34.183 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:34.178+0000 7fdd4a416700 1 -- 172.21.15.57:0/1724080839 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fdd440cb4a0 con 0x7fdd4406c920 2023-10-06T03:02:34.805 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:34.798+0000 7fdd397fa700 1 -- 172.21.15.57:0/1724080839 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v44) v1 ==== 97+0+0 (secure 0 0 0) 0x7fdd40051fa0 con 0x7fdd4406c920 2023-10-06T03:02:34.810 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:34.802+0000 7fdd4a416700 1 -- 172.21.15.57:0/1724080839 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fdd28060580 msgr2=0x7fdd28062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:34.810 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:34.802+0000 7fdd4a416700 1 --2- 172.21.15.57:0/1724080839 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fdd28060580 0x7fdd28062a30 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fdd440c7510 tx=0x7fdd340091a0 comp rx=0 tx=0).stop 2023-10-06T03:02:34.810 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:34.802+0000 7fdd4a416700 1 -- 172.21.15.57:0/1724080839 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdd4406c920 msgr2=0x7fdd440c14b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:34.810 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:34.802+0000 7fdd4a416700 1 --2- 172.21.15.57:0/1724080839 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdd4406c920 0x7fdd440c14b0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fdd40015000 tx=0x7fdd40016000 comp rx=0 tx=0).stop 2023-10-06T03:02:34.811 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:34.806+0000 7fdd4a416700 1 -- 172.21.15.57:0/1724080839 shutdown_connections 2023-10-06T03:02:34.811 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:34.806+0000 7fdd4a416700 1 --2- 172.21.15.57:0/1724080839 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fdd28060580 0x7fdd28062a30 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:34.811 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:34.806+0000 7fdd4a416700 1 --2- 172.21.15.57:0/1724080839 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdd440aae90 0x7fdd440ae9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:34.811 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:34.806+0000 7fdd4a416700 1 --2- 172.21.15.57:0/1724080839 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd4406ccf0 0x7fdd4415e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:34.811 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:34.806+0000 7fdd4a416700 1 --2- 172.21.15.57:0/1724080839 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdd4406c920 0x7fdd440c14b0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:34.812 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:34.806+0000 7fdd4a416700 1 -- 172.21.15.57:0/1724080839 >> 172.21.15.57:0/1724080839 conn(0x7fdd440c85e0 msgr2=0x7fdd4415c8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:34.812 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:34.806+0000 7fdd4a416700 1 -- 172.21.15.57:0/1724080839 shutdown_connections 2023-10-06T03:02:34.812 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:34.806+0000 7fdd4a416700 1 -- 172.21.15.57:0/1724080839 wait complete. 2023-10-06T03:02:34.813 INFO:teuthology.orchestra.run.smithi057.stderr: removed all blocklist entries 2023-10-06T03:02:34.834 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-06T03:02:34.994 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:34.986+0000 7f7e89945700 1 Processor -- start 2023-10-06T03:02:34.994 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:34.986+0000 7f7e89945700 1 -- start start 2023-10-06T03:02:34.998 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:34.990+0000 7f7e89945700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f7e84154d90 0x7f7e8415b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:34.998 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:34.990+0000 7f7e89945700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f7e840b1490 0x7f7e841575d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:34.998 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:34.990+0000 7f7e89945700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e840b18d0 con 0x7f7e840b10c0 2023-10-06T03:02:34.998 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:34.990+0000 7f7e89945700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e8406bb10 con 0x7f7e84154d90 2023-10-06T03:02:34.998 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:34.990+0000 7f7e89945700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e84158530 con 0x7f7e840b1490 2023-10-06T03:02:34.998 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:34.990+0000 7f7e7a7fc700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f7e84154d90 0x7f7e8415b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:34.998 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:34.990+0000 7f7e7a7fc700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f7e84154d90 0x7f7e8415b750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:52468/0 (socket says 172.21.15.57:52468) 2023-10-06T03:02:34.998 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:34.990+0000 7f7e7a7fc700 1 -- 172.21.15.57:0/1651607368 learned_addr learned my addr 172.21.15.57:0/1651607368 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:02:34.999 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:34.994+0000 7f7e837fe700 1 --2- 172.21.15.57:0/1651607368 >> v2:172.21.15.105:3300/0 conn(0x7f7e840b1490 0x7f7e841575d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:34.999 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:34.994+0000 7f7e7a7fc700 1 -- 172.21.15.57:0/1651607368 >> v2:172.21.15.105:3300/0 conn(0x7f7e840b1490 msgr2=0x7f7e841575d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:34.999 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:34.994+0000 7f7e7a7fc700 1 --2- 172.21.15.57:0/1651607368 >> v2:172.21.15.105:3300/0 conn(0x7f7e840b1490 0x7f7e841575d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:34.999 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:34.994+0000 7f7e7a7fc700 1 -- 172.21.15.57:0/1651607368 >> v1:172.21.15.105:6789/0 conn(0x7f7e840b10c0 legacy=0x7f7e84154680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:35.000 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:34.994+0000 7f7e7a7fc700 1 -- 172.21.15.57:0/1651607368 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e84158250 con 0x7f7e84154d90 2023-10-06T03:02:35.000 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:34.994+0000 7f7e7a7fc700 1 --2- 172.21.15.57:0/1651607368 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7e84154d90 0x7f7e8415b750 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f7e840b1b70 tx=0x7f7e6c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5492afa002470199 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:35.000 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:34.994+0000 7f7e827fc700 1 -- 172.21.15.57:0/1651607368 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e6c00e070 con 0x7f7e84154d90 2023-10-06T03:02:35.000 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:34.994+0000 7f7e827fc700 1 -- 172.21.15.57:0/1651607368 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e6c00ba50 con 0x7f7e84154d90 2023-10-06T03:02:35.000 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:34.994+0000 7f7e827fc700 1 -- 172.21.15.57:0/1651607368 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e6c0092e0 con 0x7f7e84154d90 2023-10-06T03:02:35.001 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:34.994+0000 7f7e89945700 1 -- 172.21.15.57:0/1651607368 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7e84154d90 msgr2=0x7f7e8415b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:35.001 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:34.994+0000 7f7e89945700 1 --2- 172.21.15.57:0/1651607368 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7e84154d90 0x7f7e8415b750 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f7e840b1b70 tx=0x7f7e6c009840 comp rx=0 tx=0).stop 2023-10-06T03:02:35.002 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:34.994+0000 7f7e89945700 1 -- 172.21.15.57:0/1651607368 shutdown_connections 2023-10-06T03:02:35.002 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:34.994+0000 7f7e89945700 1 --2- 172.21.15.57:0/1651607368 >> v2:172.21.15.105:3300/0 conn(0x7f7e840b1490 0x7f7e841575d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:35.002 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:34.994+0000 7f7e89945700 1 --2- 172.21.15.57:0/1651607368 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7e84154d90 0x7f7e8415b750 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:35.002 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:34.994+0000 7f7e89945700 1 -- 172.21.15.57:0/1651607368 >> 172.21.15.57:0/1651607368 conn(0x7f7e840cbdd0 msgr2=0x7f7e840cc1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:35.002 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:34.994+0000 7f7e89945700 1 -- 172.21.15.57:0/1651607368 shutdown_connections 2023-10-06T03:02:35.002 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:34.994+0000 7f7e89945700 1 -- 172.21.15.57:0/1651607368 wait complete. 2023-10-06T03:02:35.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:34.998+0000 7f7e89945700 1 Processor -- start 2023-10-06T03:02:35.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:34.998+0000 7f7e89945700 1 -- start start 2023-10-06T03:02:35.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.002+0000 7f7e89945700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7e840b10c0 0x7f7e84152b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:35.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.002+0000 7f7e89945700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7e840b1490 0x7f7e840a5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:35.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.002+0000 7f7e89945700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7e84154d90 0x7f7e840a64f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:35.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.002+0000 7f7e89945700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e840a4e70 con 0x7f7e840b10c0 2023-10-06T03:02:35.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.002+0000 7f7e89945700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e840a5110 con 0x7f7e84154d90 2023-10-06T03:02:35.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.002+0000 7f7e89945700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e840a53f0 con 0x7f7e840b1490 2023-10-06T03:02:35.008 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.002+0000 7f7e82ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7e840b10c0 0x7f7e84152b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:35.008 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.002+0000 7f7e82ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7e840b10c0 0x7f7e84152b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:52474/0 (socket says 172.21.15.57:52474) 2023-10-06T03:02:35.009 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.002+0000 7f7e82ffd700 1 -- 172.21.15.57:0/366177845 learned_addr learned my addr 172.21.15.57:0/366177845 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:02:35.009 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.002+0000 7f7e7a7fc700 1 --2- 172.21.15.57:0/366177845 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7e840b1490 0x7f7e840a5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:35.009 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.002+0000 7f7e837fe700 1 --2- 172.21.15.57:0/366177845 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7e84154d90 0x7f7e840a64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:35.009 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.002+0000 7f7e82ffd700 1 -- 172.21.15.57:0/366177845 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7e840b1490 msgr2=0x7f7e840a5fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:35.009 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.002+0000 7f7e82ffd700 1 --2- 172.21.15.57:0/366177845 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7e840b1490 0x7f7e840a5fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:35.009 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.002+0000 7f7e82ffd700 1 -- 172.21.15.57:0/366177845 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7e84154d90 msgr2=0x7f7e840a64f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:35.009 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.002+0000 7f7e82ffd700 1 --2- 172.21.15.57:0/366177845 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7e84154d90 0x7f7e840a64f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:35.009 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.002+0000 7f7e82ffd700 1 -- 172.21.15.57:0/366177845 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e6c009ae0 con 0x7f7e840b10c0 2023-10-06T03:02:35.009 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.002+0000 7f7e82ffd700 1 --2- 172.21.15.57:0/366177845 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7e840b10c0 0x7f7e84152b70 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f7e7400c590 tx=0x7f7e7400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:35.010 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.002+0000 7f7e7b7fe700 1 -- 172.21.15.57:0/366177845 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e74011590 con 0x7f7e840b10c0 2023-10-06T03:02:35.010 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.002+0000 7f7e7b7fe700 1 -- 172.21.15.57:0/366177845 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e740116f0 con 0x7f7e840b10c0 2023-10-06T03:02:35.010 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.002+0000 7f7e7b7fe700 1 -- 172.21.15.57:0/366177845 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e74011ab0 con 0x7f7e840b10c0 2023-10-06T03:02:35.010 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.002+0000 7f7e89945700 1 -- 172.21.15.57:0/366177845 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e840a56d0 con 0x7f7e840b10c0 2023-10-06T03:02:35.010 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.002+0000 7f7e89945700 1 -- 172.21.15.57:0/366177845 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e84167260 con 0x7f7e840b10c0 2023-10-06T03:02:35.011 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.006+0000 7f7e89945700 1 -- 172.21.15.57:0/366177845 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e84154110 con 0x7f7e840b10c0 2023-10-06T03:02:35.012 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.006+0000 7f7e7b7fe700 1 -- 172.21.15.57:0/366177845 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f7e7401b3b0 con 0x7f7e840b10c0 2023-10-06T03:02:35.014 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.006+0000 7f7e7b7fe700 1 --2- 172.21.15.57:0/366177845 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f7e64060550 0x7f7e64062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:35.014 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.010+0000 7f7e7b7fe700 1 -- 172.21.15.57:0/366177845 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f7e7407bc60 con 0x7f7e840b10c0 2023-10-06T03:02:35.015 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.010+0000 7f7e7a7fc700 1 --2- 172.21.15.57:0/366177845 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f7e64060550 0x7f7e64062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:35.016 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.010+0000 7f7e7a7fc700 1 --2- 172.21.15.57:0/366177845 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f7e64060550 0x7f7e64062a00 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c009880 tx=0x7f7e6c018000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:35.020 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.014+0000 7f7e7b7fe700 1 -- 172.21.15.57:0/366177845 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f7e84154110 con 0x7f7e840b10c0 2023-10-06T03:02:35.248 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.242+0000 7f7e89945700 1 -- 172.21.15.57:0/366177845 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f7e84154110 con 0x7f7e840b10c0 2023-10-06T03:02:35.249 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.242+0000 7f7e7b7fe700 1 -- 172.21.15.57:0/366177845 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v11) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f7e84154110 con 0x7f7e840b10c0 2023-10-06T03:02:35.250 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:02:35.250 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-10-06T03:02:35.250 INFO:teuthology.orchestra.run.smithi057.stdout: "auth_dump": [ 2023-10-06T03:02:35.250 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-10-06T03:02:35.250 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "mds.a", 2023-10-06T03:02:35.250 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQAmeB9lDqECMRAAhzW3Orr26rDBr/eQWsWeUw==", 2023-10-06T03:02:35.250 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2023-10-06T03:02:35.250 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow", 2023-10-06T03:02:35.250 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2023-10-06T03:02:35.251 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2023-10-06T03:02:35.251 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2023-10-06T03:02:35.251 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-10-06T03:02:35.251 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-06T03:02:35.251 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-10-06T03:02:35.251 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "mds.b", 2023-10-06T03:02:35.251 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQAneB9lMQOrBxAA14XFhuZexpkxXWbava72Lg==", 2023-10-06T03:02:35.251 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2023-10-06T03:02:35.251 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow", 2023-10-06T03:02:35.251 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2023-10-06T03:02:35.251 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2023-10-06T03:02:35.251 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2023-10-06T03:02:35.251 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-10-06T03:02:35.252 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-06T03:02:35.252 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-10-06T03:02:35.252 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "mds.c", 2023-10-06T03:02:35.252 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQAmeB9lfIxXOxAAMEjLV/EclZMH8LJnne8HpQ==", 2023-10-06T03:02:35.252 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2023-10-06T03:02:35.252 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow", 2023-10-06T03:02:35.252 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2023-10-06T03:02:35.252 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2023-10-06T03:02:35.252 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2023-10-06T03:02:35.252 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-10-06T03:02:35.252 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-06T03:02:35.252 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-10-06T03:02:35.252 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "mds.d", 2023-10-06T03:02:35.253 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQAneB9lxuy7ERAAhOixOLVBW+kzwcR/I2stMA==", 2023-10-06T03:02:35.253 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2023-10-06T03:02:35.253 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow", 2023-10-06T03:02:35.253 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2023-10-06T03:02:35.253 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2023-10-06T03:02:35.253 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2023-10-06T03:02:35.253 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-10-06T03:02:35.253 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-06T03:02:35.253 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-10-06T03:02:35.253 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.0", 2023-10-06T03:02:35.253 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQAueB9l1QweDRAAQOi85Hl7CxwynZ/2juWCDQ==", 2023-10-06T03:02:35.253 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2023-10-06T03:02:35.254 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow profile osd", 2023-10-06T03:02:35.254 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile osd", 2023-10-06T03:02:35.254 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2023-10-06T03:02:35.254 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-10-06T03:02:35.254 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-06T03:02:35.254 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-10-06T03:02:35.254 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.1", 2023-10-06T03:02:35.254 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQAxeB9l8TFyGhAANcAhbFzZWvou0nJxAAqB4g==", 2023-10-06T03:02:35.254 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2023-10-06T03:02:35.254 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow profile osd", 2023-10-06T03:02:35.254 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile osd", 2023-10-06T03:02:35.254 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2023-10-06T03:02:35.255 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-10-06T03:02:35.255 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-06T03:02:35.255 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-10-06T03:02:35.255 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.2", 2023-10-06T03:02:35.255 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQA0eB9lmivnJhAA+YySNbp4IJmZM+sQE3d7QA==", 2023-10-06T03:02:35.255 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2023-10-06T03:02:35.255 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow profile osd", 2023-10-06T03:02:35.255 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile osd", 2023-10-06T03:02:35.255 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2023-10-06T03:02:35.255 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-10-06T03:02:35.255 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-06T03:02:35.255 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-10-06T03:02:35.256 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.3", 2023-10-06T03:02:35.256 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQA3eB9lk0RkNBAAbD3gSyHwErEXlJUs84h15w==", 2023-10-06T03:02:35.256 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2023-10-06T03:02:35.256 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow profile osd", 2023-10-06T03:02:35.256 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile osd", 2023-10-06T03:02:35.256 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2023-10-06T03:02:35.256 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-10-06T03:02:35.256 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-06T03:02:35.256 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-10-06T03:02:35.256 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.4", 2023-10-06T03:02:35.256 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQA+eB9lAPSdEBAAKd8VkbfnUNVRzObt7KuAWA==", 2023-10-06T03:02:35.256 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2023-10-06T03:02:35.256 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow profile osd", 2023-10-06T03:02:35.257 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile osd", 2023-10-06T03:02:35.257 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2023-10-06T03:02:35.257 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-10-06T03:02:35.257 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-06T03:02:35.257 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-10-06T03:02:35.257 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.5", 2023-10-06T03:02:35.257 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQBBeB9lyBkAHxAAxDWxeDfTrM3HByhyw5sVlQ==", 2023-10-06T03:02:35.257 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2023-10-06T03:02:35.257 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow profile osd", 2023-10-06T03:02:35.257 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile osd", 2023-10-06T03:02:35.257 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2023-10-06T03:02:35.257 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-10-06T03:02:35.258 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-06T03:02:35.258 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-10-06T03:02:35.258 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.6", 2023-10-06T03:02:35.258 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQBEeB9lMveJKxAA/obatGTtFXAPoaXP7O+qbw==", 2023-10-06T03:02:35.258 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2023-10-06T03:02:35.258 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow profile osd", 2023-10-06T03:02:35.258 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile osd", 2023-10-06T03:02:35.258 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2023-10-06T03:02:35.258 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-10-06T03:02:35.258 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-06T03:02:35.258 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-10-06T03:02:35.258 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.7", 2023-10-06T03:02:35.259 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQBHeB9lePjINxAAlsT5e6FfWebTYG66oT+naw==", 2023-10-06T03:02:35.259 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2023-10-06T03:02:35.259 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow profile osd", 2023-10-06T03:02:35.259 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile osd", 2023-10-06T03:02:35.259 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2023-10-06T03:02:35.259 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-10-06T03:02:35.259 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-06T03:02:35.259 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-10-06T03:02:35.259 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "client.0", 2023-10-06T03:02:35.259 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQAneB9lXov9FxAA0z65F9trriebBUZKVxOUUA==", 2023-10-06T03:02:35.259 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2023-10-06T03:02:35.259 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow", 2023-10-06T03:02:35.260 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow r", 2023-10-06T03:02:35.260 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-06T03:02:35.260 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-10-06T03:02:35.260 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-06T03:02:35.260 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-10-06T03:02:35.260 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "client.1", 2023-10-06T03:02:35.260 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQAneB9lRjCaIxAAI3gVmEJaBGQiBGfYbTOfvA==", 2023-10-06T03:02:35.260 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2023-10-06T03:02:35.260 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow", 2023-10-06T03:02:35.260 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow r", 2023-10-06T03:02:35.260 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow rw", 2023-10-06T03:02:35.261 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow rwx" 2023-10-06T03:02:35.261 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-10-06T03:02:35.261 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-06T03:02:35.261 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-10-06T03:02:35.261 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "client.2", 2023-10-06T03:02:35.261 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQAneB9lLCCVHRAA1mt8Mz7VVvX/2SyuqFq3NQ==", 2023-10-06T03:02:35.261 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2023-10-06T03:02:35.261 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow", 2023-10-06T03:02:35.261 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow r", 2023-10-06T03:02:35.261 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow rw", 2023-10-06T03:02:35.261 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow rwx" 2023-10-06T03:02:35.261 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-10-06T03:02:35.262 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-06T03:02:35.262 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-10-06T03:02:35.262 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "client.3", 2023-10-06T03:02:35.262 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQAneB9l5x/eKBAAQGb0VEfdnXA5BaUfbEJDOA==", 2023-10-06T03:02:35.262 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2023-10-06T03:02:35.262 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow", 2023-10-06T03:02:35.262 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow r", 2023-10-06T03:02:35.262 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow rw", 2023-10-06T03:02:35.262 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow rwx" 2023-10-06T03:02:35.262 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-10-06T03:02:35.262 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-06T03:02:35.263 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-10-06T03:02:35.263 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "client.admin", 2023-10-06T03:02:35.263 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQAmeB9laohwCRAA+ildmamovlX9F2Ea+EoNeA==", 2023-10-06T03:02:35.263 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2023-10-06T03:02:35.263 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow *", 2023-10-06T03:02:35.263 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2023-10-06T03:02:35.263 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2023-10-06T03:02:35.263 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2023-10-06T03:02:35.263 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-10-06T03:02:35.263 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-06T03:02:35.263 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-10-06T03:02:35.263 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "mgr.x", 2023-10-06T03:02:35.263 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQAmeB9l9rLvKhAA/gcq8fCI3ZFihu9r1HGTlQ==", 2023-10-06T03:02:35.264 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2023-10-06T03:02:35.264 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow *", 2023-10-06T03:02:35.264 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile mgr", 2023-10-06T03:02:35.264 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2023-10-06T03:02:35.264 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-10-06T03:02:35.264 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-06T03:02:35.264 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-10-06T03:02:35.264 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "mgr.y", 2023-10-06T03:02:35.264 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQAmeB9lwOhTJRAAeQ+9At86XOHzhFNQPNQa5g==", 2023-10-06T03:02:35.264 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2023-10-06T03:02:35.264 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow *", 2023-10-06T03:02:35.264 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile mgr", 2023-10-06T03:02:35.265 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2023-10-06T03:02:35.265 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-10-06T03:02:35.265 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-10-06T03:02:35.265 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-10-06T03:02:35.265 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-10-06T03:02:35.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.246+0000 7f7e89945700 1 -- 172.21.15.57:0/366177845 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f7e64060550 msgr2=0x7f7e64062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:35.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.246+0000 7f7e89945700 1 --2- 172.21.15.57:0/366177845 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f7e64060550 0x7f7e64062a00 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c009880 tx=0x7f7e6c018000 comp rx=0 tx=0).stop 2023-10-06T03:02:35.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.246+0000 7f7e89945700 1 -- 172.21.15.57:0/366177845 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7e840b10c0 msgr2=0x7f7e84152b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:35.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.246+0000 7f7e89945700 1 --2- 172.21.15.57:0/366177845 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7e840b10c0 0x7f7e84152b70 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f7e7400c590 tx=0x7f7e7400c950 comp rx=0 tx=0).stop 2023-10-06T03:02:35.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.246+0000 7f7e89945700 1 -- 172.21.15.57:0/366177845 shutdown_connections 2023-10-06T03:02:35.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.246+0000 7f7e89945700 1 --2- 172.21.15.57:0/366177845 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7e84154d90 0x7f7e840a64f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:35.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.246+0000 7f7e89945700 1 --2- 172.21.15.57:0/366177845 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f7e64060550 0x7f7e64062a00 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:35.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.246+0000 7f7e89945700 1 --2- 172.21.15.57:0/366177845 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7e840b1490 0x7f7e840a5fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:35.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.246+0000 7f7e89945700 1 --2- 172.21.15.57:0/366177845 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7e840b10c0 0x7f7e84152b70 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:35.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.246+0000 7f7e89945700 1 -- 172.21.15.57:0/366177845 >> 172.21.15.57:0/366177845 conn(0x7f7e840cbdd0 msgr2=0x7f7e840ca7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:35.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.246+0000 7f7e89945700 1 -- 172.21.15.57:0/366177845 shutdown_connections 2023-10-06T03:02:35.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.246+0000 7f7e89945700 1 -- 172.21.15.57:0/366177845 wait complete. 2023-10-06T03:02:35.274 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:02:35.438 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.430+0000 7ff955b45700 1 Processor -- start 2023-10-06T03:02:35.438 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.430+0000 7ff955b45700 1 -- start start 2023-10-06T03:02:35.440 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.434+0000 7ff955b45700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7ff9500cb410 0x7ff9500ca420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:35.440 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.434+0000 7ff955b45700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff950159650 0x7ff950159af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:35.440 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.434+0000 7ff955b45700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9500c7420 con 0x7ff950159280 2023-10-06T03:02:35.441 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.434+0000 7ff955b45700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9500ca960 con 0x7ff9500cb410 2023-10-06T03:02:35.441 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.434+0000 7ff955b45700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff95015dd10 con 0x7ff950159650 2023-10-06T03:02:35.441 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.434+0000 7ff94effd700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7ff9500cb410 0x7ff9500ca420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:35.441 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.434+0000 7ff94f7fe700 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7ff950159280 0x7ff9500cad00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.57:59790/0 (socket says 172.21.15.57:59790) 2023-10-06T03:02:35.441 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.434+0000 7ff94f7fe700 1 -- 172.21.15.57:0/219830531 learned_addr learned my addr 172.21.15.57:0/219830531 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:02:35.441 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.434+0000 7ff94ffff700 1 --2- 172.21.15.57:0/219830531 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff950159650 0x7ff950159af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:35.442 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.434+0000 7ff94effd700 1 -- 172.21.15.57:0/219830531 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff950159650 msgr2=0x7ff950159af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:35.442 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.434+0000 7ff94effd700 1 --2- 172.21.15.57:0/219830531 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff950159650 0x7ff950159af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:35.442 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.434+0000 7ff94effd700 1 -- 172.21.15.57:0/219830531 >> v1:172.21.15.105:6789/0 conn(0x7ff950159280 legacy=0x7ff9500cad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:35.442 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.434+0000 7ff94effd700 1 -- 172.21.15.57:0/219830531 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff95015d190 con 0x7ff9500cb410 2023-10-06T03:02:35.443 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.434+0000 7ff94effd700 1 --2- 172.21.15.57:0/219830531 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff9500cb410 0x7ff9500ca420 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ff9440098e0 tx=0x7ff9440091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7cd99191ec639283 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:35.443 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.438+0000 7ff94e7fc700 1 -- 172.21.15.57:0/219830531 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff94400b640 con 0x7ff9500cb410 2023-10-06T03:02:35.443 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.438+0000 7ff94e7fc700 1 -- 172.21.15.57:0/219830531 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff94400b7a0 con 0x7ff9500cb410 2023-10-06T03:02:35.443 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.438+0000 7ff94e7fc700 1 -- 172.21.15.57:0/219830531 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff94400bb40 con 0x7ff9500cb410 2023-10-06T03:02:35.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.438+0000 7ff955b45700 1 -- 172.21.15.57:0/219830531 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff9500cb410 msgr2=0x7ff9500ca420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:35.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.438+0000 7ff955b45700 1 --2- 172.21.15.57:0/219830531 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff9500cb410 0x7ff9500ca420 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ff9440098e0 tx=0x7ff9440091a0 comp rx=0 tx=0).stop 2023-10-06T03:02:35.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.438+0000 7ff955b45700 1 -- 172.21.15.57:0/219830531 shutdown_connections 2023-10-06T03:02:35.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.438+0000 7ff955b45700 1 --2- 172.21.15.57:0/219830531 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff950159650 0x7ff950159af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:35.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.438+0000 7ff955b45700 1 --2- 172.21.15.57:0/219830531 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff9500cb410 0x7ff9500ca420 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:35.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.438+0000 7ff955b45700 1 -- 172.21.15.57:0/219830531 >> 172.21.15.57:0/219830531 conn(0x7ff950067380 msgr2=0x7ff950067780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:35.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.438+0000 7ff955b45700 1 -- 172.21.15.57:0/219830531 shutdown_connections 2023-10-06T03:02:35.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.438+0000 7ff955b45700 1 -- 172.21.15.57:0/219830531 wait complete. 2023-10-06T03:02:35.447 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.442+0000 7ff955b45700 1 Processor -- start 2023-10-06T03:02:35.447 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.442+0000 7ff955b45700 1 -- start start 2023-10-06T03:02:35.449 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.442+0000 7ff955b45700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff9500cb410 0x7ff9500c6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:35.449 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.442+0000 7ff955b45700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff950159280 0x7ff9500b1b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:35.449 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.442+0000 7ff955b45700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff950159650 0x7ff95014e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:35.449 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.442+0000 7ff955b45700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff95014ec90 con 0x7ff950159280 2023-10-06T03:02:35.449 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.442+0000 7ff955b45700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff95015c350 con 0x7ff950159650 2023-10-06T03:02:35.449 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.442+0000 7ff955b45700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff95015c630 con 0x7ff9500cb410 2023-10-06T03:02:35.450 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.442+0000 7ff94effd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff950159280 0x7ff9500b1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:35.450 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.442+0000 7ff94effd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff950159280 0x7ff9500b1b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:52484/0 (socket says 172.21.15.57:52484) 2023-10-06T03:02:35.451 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.442+0000 7ff94effd700 1 -- 172.21.15.57:0/964123350 learned_addr learned my addr 172.21.15.57:0/964123350 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:02:35.451 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.442+0000 7ff94f7fe700 1 --2- 172.21.15.57:0/964123350 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff9500cb410 0x7ff9500c6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:35.451 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.442+0000 7ff94ffff700 1 --2- 172.21.15.57:0/964123350 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff950159650 0x7ff95014e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:35.451 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.442+0000 7ff94effd700 1 -- 172.21.15.57:0/964123350 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff9500cb410 msgr2=0x7ff9500c6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:35.451 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.442+0000 7ff94effd700 1 --2- 172.21.15.57:0/964123350 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff9500cb410 0x7ff9500c6120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:35.451 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.442+0000 7ff94effd700 1 -- 172.21.15.57:0/964123350 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff950159650 msgr2=0x7ff95014e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:35.451 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.442+0000 7ff94effd700 1 --2- 172.21.15.57:0/964123350 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff950159650 0x7ff95014e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:35.451 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.442+0000 7ff94effd700 1 -- 172.21.15.57:0/964123350 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff944009420 con 0x7ff950159280 2023-10-06T03:02:35.451 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.442+0000 7ff94f7fe700 1 --2- 172.21.15.57:0/964123350 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff9500cb410 0x7ff9500c6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:02:35.452 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.446+0000 7ff94effd700 1 --2- 172.21.15.57:0/964123350 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff950159280 0x7ff9500b1b80 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7ff94400a010 tx=0x7ff944017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:35.452 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.446+0000 7ff9377fe700 1 -- 172.21.15.57:0/964123350 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff94401bab0 con 0x7ff950159280 2023-10-06T03:02:35.452 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.446+0000 7ff9377fe700 1 -- 172.21.15.57:0/964123350 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff94401bc30 con 0x7ff950159280 2023-10-06T03:02:35.452 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.446+0000 7ff9377fe700 1 -- 172.21.15.57:0/964123350 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff944025420 con 0x7ff950159280 2023-10-06T03:02:35.452 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.446+0000 7ff955b45700 1 -- 172.21.15.57:0/964123350 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9500c5920 con 0x7ff950159280 2023-10-06T03:02:35.453 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.446+0000 7ff955b45700 1 -- 172.21.15.57:0/964123350 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff95015bb00 con 0x7ff950159280 2023-10-06T03:02:35.453 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.446+0000 7ff955b45700 1 -- 172.21.15.57:0/964123350 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9500712e0 con 0x7ff950159280 2023-10-06T03:02:35.455 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.450+0000 7ff9377fe700 1 -- 172.21.15.57:0/964123350 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7ff944023070 con 0x7ff950159280 2023-10-06T03:02:35.457 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.450+0000 7ff9377fe700 1 --2- 172.21.15.57:0/964123350 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7ff93c060550 0x7ff93c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:35.457 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.450+0000 7ff9377fe700 1 -- 172.21.15.57:0/964123350 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5206+0+0 (secure 0 0 0) 0x7ff94407db00 con 0x7ff950159280 2023-10-06T03:02:35.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.450+0000 7ff94f7fe700 1 --2- 172.21.15.57:0/964123350 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7ff93c060550 0x7ff93c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:35.459 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.454+0000 7ff94f7fe700 1 --2- 172.21.15.57:0/964123350 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7ff93c060550 0x7ff93c062a00 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff940000c00 tx=0x7ff940009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:35.464 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.458+0000 7ff9377fe700 1 -- 172.21.15.57:0/964123350 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7ff94407fe60 con 0x7ff950159280 2023-10-06T03:02:35.634 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.626+0000 7ff955b45700 1 -- 172.21.15.57:0/964123350 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff9500caae0 con 0x7ff950159280 2023-10-06T03:02:35.636 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.630+0000 7ff9377fe700 1 -- 172.21.15.57:0/964123350 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+13650 (secure 0 0 0) 0x7ff94404e240 con 0x7ff950159280 2023-10-06T03:02:35.636 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:02:35.636 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":46,"fsid":"eb56dc0f-9213-41cb-9aad-8ade6c802e98","created":"2023-10-06T03:00:30.806197+0000","modified":"2023-10-06T03:02:34.811646+0000","last_up_change":"2023-10-06T03:00:43.607454+0000","last_in_change":"2023-10-06T03:00:33.943513+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T03:00:44.360651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T03:00:50.466601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"58cf6c90-d704-43e0-b2db-dffe526d5e8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":33053},{"type":"v1","addr":"172.21.15.57:6801","nonce":33053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":33053},{"type":"v1","addr":"172.21.15.57:6803","nonce":33053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":33053},{"type":"v1","addr":"172.21.15.57:6807","nonce":33053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":33053},{"type":"v1","addr":"172.21.15.57:6805","nonce":33053}]},"public_addr":"172.21.15.57:6801/33053","cluster_addr":"172.21.15.57:6803/33053","heartbeat_back_addr":"172.21.15.57:6807/33053","heartbeat_front_addr":"172.21.15.57:6805/33053","state":["exists","up"]},{"osd":1,"uuid":"16afbe70-7f9e-4568-9c92-763e6e348119","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6809","nonce":33052},{"type":"v1","addr":"172.21.15.57:6810","nonce":33052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":33052},{"type":"v1","addr":"172.21.15.57:6813","nonce":33052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":33052},{"type":"v1","addr":"172.21.15.57:6822","nonce":33052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6815","nonce":33052},{"type":"v1","addr":"172.21.15.57:6818","nonce":33052}]},"public_addr":"172.21.15.57:6810/33052","cluster_addr":"172.21.15.57:6813/33052","heartbeat_back_addr":"172.21.15.57:6822/33052","heartbeat_front_addr":"172.21.15.57:6818/33052","state":["exists","up"]},{"osd":2,"uuid":"7255c62e-f92f-470f-a5ce-30228920d9f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":33058},{"type":"v1","addr":"172.21.15.57:6825","nonce":33058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":33058},{"type":"v1","addr":"172.21.15.57:6827","nonce":33058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":33058},{"type":"v1","addr":"172.21.15.57:6831","nonce":33058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":33058},{"type":"v1","addr":"172.21.15.57:6829","nonce":33058}]},"public_addr":"172.21.15.57:6825/33058","cluster_addr":"172.21.15.57:6827/33058","heartbeat_back_addr":"172.21.15.57:6831/33058","heartbeat_front_addr":"172.21.15.57:6829/33058","state":["exists","up"]},{"osd":3,"uuid":"152a236d-f799-4888-8544-74865508d5a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":33057},{"type":"v1","addr":"172.21.15.57:6811","nonce":33057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":33057},{"type":"v1","addr":"172.21.15.57:6816","nonce":33057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6821","nonce":33057},{"type":"v1","addr":"172.21.15.57:6823","nonce":33057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6817","nonce":33057},{"type":"v1","addr":"172.21.15.57:6819","nonce":33057}]},"public_addr":"172.21.15.57:6811/33057","cluster_addr":"172.21.15.57:6816/33057","heartbeat_back_addr":"172.21.15.57:6823/33057","heartbeat_front_addr":"172.21.15.57:6819/33057","state":["exists","up"]},{"osd":4,"uuid":"37db2a65-3566-41d0-9d60-e66c49e1e68e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":33368},{"type":"v1","addr":"172.21.15.105:6801","nonce":33368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":33368},{"type":"v1","addr":"172.21.15.105:6803","nonce":33368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":33368},{"type":"v1","addr":"172.21.15.105:6807","nonce":33368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":33368},{"type":"v1","addr":"172.21.15.105:6805","nonce":33368}]},"public_addr":"172.21.15.105:6801/33368","cluster_addr":"172.21.15.105:6803/33368","heartbeat_back_addr":"172.21.15.105:6807/33368","heartbeat_front_addr":"172.21.15.105:6805/33368","state":["exists","up"]},{"osd":5,"uuid":"35e77918-1bb4-42ca-9b20-f3c14eaa0c04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":33379},{"type":"v1","addr":"172.21.15.105:6818","nonce":33379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":33379},{"type":"v1","addr":"172.21.15.105:6823","nonce":33379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":33379},{"type":"v1","addr":"172.21.15.105:6831","nonce":33379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":33379},{"type":"v1","addr":"172.21.15.105:6827","nonce":33379}]},"public_addr":"172.21.15.105:6818/33379","cluster_addr":"172.21.15.105:6823/33379","heartbeat_back_addr":"172.21.15.105:6831/33379","heartbeat_front_addr":"172.21.15.105:6827/33379","state":["exists","up"]},{"osd":6,"uuid":"b4d9d510-7a45-4173-8287-c6c8d6547f2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":33369},{"type":"v1","addr":"172.21.15.105:6819","nonce":33369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":33369},{"type":"v1","addr":"172.21.15.105:6822","nonce":33369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":33369},{"type":"v1","addr":"172.21.15.105:6830","nonce":33369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":33369},{"type":"v1","addr":"172.21.15.105:6826","nonce":33369}]},"public_addr":"172.21.15.105:6819/33369","cluster_addr":"172.21.15.105:6822/33369","heartbeat_back_addr":"172.21.15.105:6830/33369","heartbeat_front_addr":"172.21.15.105:6826/33369","state":["exists","up"]},{"osd":7,"uuid":"74266fb0-cd84-463f-8bf0-092652a71dc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":33370},{"type":"v1","addr":"172.21.15.105:6809","nonce":33370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":33370},{"type":"v1","addr":"172.21.15.105:6811","nonce":33370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":33370},{"type":"v1","addr":"172.21.15.105:6815","nonce":33370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":33370},{"type":"v1","addr":"172.21.15.105:6813","nonce":33370}]},"public_addr":"172.21.15.105:6809/33370","cluster_addr":"172.21.15.105:6811/33370","heartbeat_back_addr":"172.21.15.105:6815/33370","heartbeat_front_addr":"172.21.15.105:6813/33370","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.596864+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.633851+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.636993+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.529681+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.608601+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.659752+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.661717+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.642221+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:02:35.639 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.634+0000 7ff955b45700 1 -- 172.21.15.57:0/964123350 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7ff93c060550 msgr2=0x7ff93c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:35.639 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.634+0000 7ff955b45700 1 --2- 172.21.15.57:0/964123350 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7ff93c060550 0x7ff93c062a00 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff940000c00 tx=0x7ff940009040 comp rx=0 tx=0).stop 2023-10-06T03:02:35.639 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.634+0000 7ff955b45700 1 -- 172.21.15.57:0/964123350 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff950159280 msgr2=0x7ff9500b1b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:35.639 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.634+0000 7ff955b45700 1 --2- 172.21.15.57:0/964123350 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff950159280 0x7ff9500b1b80 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7ff94400a010 tx=0x7ff944017000 comp rx=0 tx=0).stop 2023-10-06T03:02:35.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.634+0000 7ff955b45700 1 -- 172.21.15.57:0/964123350 shutdown_connections 2023-10-06T03:02:35.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.634+0000 7ff955b45700 1 --2- 172.21.15.57:0/964123350 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff950159650 0x7ff95014e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:35.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.634+0000 7ff955b45700 1 --2- 172.21.15.57:0/964123350 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff950159280 0x7ff9500b1b80 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:35.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.634+0000 7ff955b45700 1 --2- 172.21.15.57:0/964123350 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7ff93c060550 0x7ff93c062a00 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:35.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.634+0000 7ff955b45700 1 --2- 172.21.15.57:0/964123350 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff9500cb410 0x7ff9500c6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:35.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.634+0000 7ff955b45700 1 -- 172.21.15.57:0/964123350 >> 172.21.15.57:0/964123350 conn(0x7ff950067380 msgr2=0x7ff9501562e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:35.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.634+0000 7ff955b45700 1 -- 172.21.15.57:0/964123350 shutdown_connections 2023-10-06T03:02:35.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.634+0000 7ff955b45700 1 -- 172.21.15.57:0/964123350 wait complete. 2023-10-06T03:02:35.659 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T03:00:44.360651+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T03:00:50.466601+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-10-06T03:02:35.660 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T03:02:35.826 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.818+0000 7f0275678700 1 Processor -- start 2023-10-06T03:02:35.827 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.822+0000 7f0275678700 1 -- start start 2023-10-06T03:02:35.830 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.822+0000 7f0275678700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f02700680f0 0x7f02700684c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:35.830 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.822+0000 7f0275678700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f02700c9ab0 0x7f02700c9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:35.831 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.822+0000 7f0275678700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02700ca420 con 0x7f02700ade40 2023-10-06T03:02:35.831 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.822+0000 7f0275678700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02700ae2e0 con 0x7f02700680f0 2023-10-06T03:02:35.831 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.822+0000 7f0275678700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0270159b50 con 0x7f02700c9ab0 2023-10-06T03:02:35.831 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.826+0000 7f026e7fc700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f02700ade40 0x7f0270156f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:58874/0 (socket says 172.21.15.57:58874) 2023-10-06T03:02:35.831 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.826+0000 7f026e7fc700 1 -- 172.21.15.57:0/53663761 learned_addr learned my addr 172.21.15.57:0/53663761 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:02:35.831 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.826+0000 7f026effd700 1 --2- 172.21.15.57:0/53663761 >> v2:172.21.15.57:3300/0 conn(0x7f02700680f0 0x7f02700684c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:35.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.826+0000 7f026f7fe700 1 --2- 172.21.15.57:0/53663761 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f02700c9ab0 0x7f02700c9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:35.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.826+0000 7f026dffb700 1 -- 172.21.15.57:0/53663761 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4106933697 0 0) 0x7f02700ca420 con 0x7f02700ade40 2023-10-06T03:02:35.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.826+0000 7f026dffb700 1 -- 172.21.15.57:0/53663761 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0258003570 con 0x7f02700ade40 2023-10-06T03:02:35.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.826+0000 7f026effd700 1 -- 172.21.15.57:0/53663761 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f02700c9ab0 msgr2=0x7f02700c9ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:35.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.826+0000 7f026effd700 1 --2- 172.21.15.57:0/53663761 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f02700c9ab0 0x7f02700c9ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:35.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.826+0000 7f026effd700 1 -- 172.21.15.57:0/53663761 >> v1:172.21.15.57:6789/0 conn(0x7f02700ade40 legacy=0x7f0270156f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:35.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.826+0000 7f026effd700 1 -- 172.21.15.57:0/53663761 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0270159e30 con 0x7f02700680f0 2023-10-06T03:02:35.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.826+0000 7f026effd700 1 --2- 172.21.15.57:0/53663761 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f02700680f0 0x7f02700684c0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f02600098e0 tx=0x7f02600091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54ecbbdfb0934c76 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:35.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.826+0000 7f026dffb700 1 -- 172.21.15.57:0/53663761 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f026000b640 con 0x7f02700680f0 2023-10-06T03:02:35.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.826+0000 7f026dffb700 1 -- 172.21.15.57:0/53663761 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f026000b7a0 con 0x7f02700680f0 2023-10-06T03:02:35.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.826+0000 7f026dffb700 1 -- 172.21.15.57:0/53663761 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f026000bb40 con 0x7f02700680f0 2023-10-06T03:02:35.834 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.826+0000 7f0275678700 1 -- 172.21.15.57:0/53663761 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f02700680f0 msgr2=0x7f02700684c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:35.834 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.826+0000 7f0275678700 1 --2- 172.21.15.57:0/53663761 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f02700680f0 0x7f02700684c0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f02600098e0 tx=0x7f02600091a0 comp rx=0 tx=0).stop 2023-10-06T03:02:35.835 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.826+0000 7f0275678700 1 -- 172.21.15.57:0/53663761 shutdown_connections 2023-10-06T03:02:35.835 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.826+0000 7f0275678700 1 --2- 172.21.15.57:0/53663761 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f02700c9ab0 0x7f02700c9ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:35.835 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.826+0000 7f0275678700 1 --2- 172.21.15.57:0/53663761 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f02700680f0 0x7f02700684c0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:35.835 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.826+0000 7f0275678700 1 -- 172.21.15.57:0/53663761 >> 172.21.15.57:0/53663761 conn(0x7f027006b9a0 msgr2=0x7f027006bda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:35.835 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.830+0000 7f0275678700 1 -- 172.21.15.57:0/53663761 shutdown_connections 2023-10-06T03:02:35.835 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.830+0000 7f0275678700 1 -- 172.21.15.57:0/53663761 wait complete. 2023-10-06T03:02:35.837 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.830+0000 7f0275678700 1 Processor -- start 2023-10-06T03:02:35.837 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.830+0000 7f0275678700 1 -- start start 2023-10-06T03:02:35.839 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.830+0000 7f0275678700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f02700680f0 0x7f0270171450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:35.839 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.830+0000 7f0275678700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f02700ade40 0x7f0270158a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:35.839 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.830+0000 7f0275678700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f02700c9ab0 0x7f027014fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:35.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.830+0000 7f0275678700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f027016e480 con 0x7f02700680f0 2023-10-06T03:02:35.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.830+0000 7f0275678700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0270171990 con 0x7f02700ade40 2023-10-06T03:02:35.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.830+0000 7f0275678700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f027016d870 con 0x7f02700c9ab0 2023-10-06T03:02:35.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.834+0000 7f026effd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f02700680f0 0x7f0270171450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:35.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.834+0000 7f026effd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f02700680f0 0x7f0270171450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:52510/0 (socket says 172.21.15.57:52510) 2023-10-06T03:02:35.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.834+0000 7f026effd700 1 -- 172.21.15.57:0/1952903631 learned_addr learned my addr 172.21.15.57:0/1952903631 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:02:35.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.834+0000 7f026e7fc700 1 --2- 172.21.15.57:0/1952903631 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f02700ade40 0x7f0270158a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:35.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.834+0000 7f026f7fe700 1 --2- 172.21.15.57:0/1952903631 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f02700c9ab0 0x7f027014fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:35.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.834+0000 7f026effd700 1 -- 172.21.15.57:0/1952903631 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f02700c9ab0 msgr2=0x7f027014fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:35.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.834+0000 7f026effd700 1 --2- 172.21.15.57:0/1952903631 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f02700c9ab0 0x7f027014fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:35.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.834+0000 7f026effd700 1 -- 172.21.15.57:0/1952903631 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f02700ade40 msgr2=0x7f0270158a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:35.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.834+0000 7f026effd700 1 --2- 172.21.15.57:0/1952903631 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f02700ade40 0x7f0270158a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:35.841 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.834+0000 7f026effd700 1 -- 172.21.15.57:0/1952903631 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0260009420 con 0x7f02700680f0 2023-10-06T03:02:35.841 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.834+0000 7f026effd700 1 --2- 172.21.15.57:0/1952903631 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f02700680f0 0x7f0270171450 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f027006c740 tx=0x7f0260017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:35.841 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.834+0000 7f0256ffd700 1 -- 172.21.15.57:0/1952903631 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f026001bcf0 con 0x7f02700680f0 2023-10-06T03:02:35.841 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.834+0000 7f0256ffd700 1 -- 172.21.15.57:0/1952903631 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f026001be70 con 0x7f02700680f0 2023-10-06T03:02:35.842 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.834+0000 7f0275678700 1 -- 172.21.15.57:0/1952903631 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f027016db50 con 0x7f02700680f0 2023-10-06T03:02:35.842 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.834+0000 7f0256ffd700 1 -- 172.21.15.57:0/1952903631 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0260011650 con 0x7f02700680f0 2023-10-06T03:02:35.842 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.834+0000 7f0275678700 1 -- 172.21.15.57:0/1952903631 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f027016e110 con 0x7f02700680f0 2023-10-06T03:02:35.842 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.838+0000 7f0275678700 1 -- 172.21.15.57:0/1952903631 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f027004be40 con 0x7f02700680f0 2023-10-06T03:02:35.844 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.838+0000 7f0256ffd700 1 -- 172.21.15.57:0/1952903631 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f0260011a00 con 0x7f02700680f0 2023-10-06T03:02:35.846 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.838+0000 7f0256ffd700 1 --2- 172.21.15.57:0/1952903631 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f025c060580 0x7f025c062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:35.846 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.838+0000 7f0256ffd700 1 -- 172.21.15.57:0/1952903631 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f026007db50 con 0x7f02700680f0 2023-10-06T03:02:35.846 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.838+0000 7f026e7fc700 1 --2- 172.21.15.57:0/1952903631 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f025c060580 0x7f025c062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:35.847 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.842+0000 7f026e7fc700 1 --2- 172.21.15.57:0/1952903631 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f025c060580 0x7f025c062a30 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f02700c32d0 tx=0x7f0264009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:35.853 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:35.846+0000 7f0256ffd700 1 -- 172.21.15.57:0/1952903631 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f026004e290 con 0x7f02700680f0 2023-10-06T03:02:36.025 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.018+0000 7f0275678700 1 -- 172.21.15.57:0/1952903631 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0270067a70 con 0x7f02700680f0 2023-10-06T03:02:36.026 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.018+0000 7f0256ffd700 1 -- 172.21.15.57:0/1952903631 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v46) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0260011cb0 con 0x7f02700680f0 2023-10-06T03:02:36.026 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2023-10-06T03:02:36.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.022+0000 7f0275678700 1 -- 172.21.15.57:0/1952903631 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f025c060580 msgr2=0x7f025c062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:36.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.022+0000 7f0275678700 1 --2- 172.21.15.57:0/1952903631 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f025c060580 0x7f025c062a30 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f02700c32d0 tx=0x7f0264009040 comp rx=0 tx=0).stop 2023-10-06T03:02:36.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.022+0000 7f0275678700 1 -- 172.21.15.57:0/1952903631 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f02700680f0 msgr2=0x7f0270171450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:36.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.022+0000 7f0275678700 1 --2- 172.21.15.57:0/1952903631 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f02700680f0 0x7f0270171450 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f027006c740 tx=0x7f0260017000 comp rx=0 tx=0).stop 2023-10-06T03:02:36.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.026+0000 7f0275678700 1 -- 172.21.15.57:0/1952903631 shutdown_connections 2023-10-06T03:02:36.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.026+0000 7f0275678700 1 --2- 172.21.15.57:0/1952903631 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f025c060580 0x7f025c062a30 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:36.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.026+0000 7f0275678700 1 --2- 172.21.15.57:0/1952903631 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f02700c9ab0 0x7f027014fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:36.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.026+0000 7f0275678700 1 --2- 172.21.15.57:0/1952903631 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f02700ade40 0x7f0270158a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:36.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.026+0000 7f0275678700 1 --2- 172.21.15.57:0/1952903631 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f02700680f0 0x7f0270171450 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:36.032 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.026+0000 7f0275678700 1 -- 172.21.15.57:0/1952903631 >> 172.21.15.57:0/1952903631 conn(0x7f027006b9a0 msgr2=0x7f0270156f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:36.032 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.026+0000 7f0275678700 1 -- 172.21.15.57:0/1952903631 shutdown_connections 2023-10-06T03:02:36.032 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.026+0000 7f0275678700 1 -- 172.21.15.57:0/1952903631 wait complete. 2023-10-06T03:02:36.051 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T03:02:36.210 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.202+0000 7f6f3728e700 1 Processor -- start 2023-10-06T03:02:36.210 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.202+0000 7f6f3728e700 1 -- start start 2023-10-06T03:02:36.213 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.206+0000 7f6f3728e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6f3006e040 0x7f6f3006b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:36.213 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.206+0000 7f6f3728e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f3006c920 con 0x7f6f300cb140 2023-10-06T03:02:36.214 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.206+0000 7f6f3728e700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f3006d4a0 con 0x7f6f300cb510 2023-10-06T03:02:36.214 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.206+0000 7f6f3628c700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f6f300cb140 0x7f6f300b0080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:58876/0 (socket says 172.21.15.57:58876) 2023-10-06T03:02:36.214 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.206+0000 7f6f3628c700 1 -- 172.21.15.57:0/545125668 learned_addr learned my addr 172.21.15.57:0/545125668 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:02:36.214 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.206+0000 7f6f3728e700 1 -- 172.21.15.57:0/545125668 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f300cb960 con 0x7f6f3006e040 2023-10-06T03:02:36.215 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.206+0000 7f6f36a8d700 1 --2- 172.21.15.57:0/545125668 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6f3006e040 0x7f6f3006b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:36.215 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.210+0000 7f6f3528a700 1 -- 172.21.15.57:0/545125668 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3254131109 0 0) 0x7f6f3006c920 con 0x7f6f300cb140 2023-10-06T03:02:36.216 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.210+0000 7f6f3528a700 1 -- 172.21.15.57:0/545125668 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f1c003570 con 0x7f6f300cb140 2023-10-06T03:02:36.216 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.210+0000 7f6f3528a700 1 -- 172.21.15.57:0/545125668 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1809302066 0 0) 0x7f6f3006d4a0 con 0x7f6f300cb510 2023-10-06T03:02:36.216 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.210+0000 7f6f36a8d700 1 -- 172.21.15.57:0/545125668 >> v1:172.21.15.105:6789/0 conn(0x7f6f300cb510 legacy=0x7f6f3006d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:36.216 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.210+0000 7f6f36a8d700 1 -- 172.21.15.57:0/545125668 >> v1:172.21.15.57:6789/0 conn(0x7f6f300cb140 legacy=0x7f6f300b0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:36.216 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.210+0000 7f6f36a8d700 1 -- 172.21.15.57:0/545125668 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f3006cb70 con 0x7f6f3006e040 2023-10-06T03:02:36.216 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.210+0000 7f6f36a8d700 1 --2- 172.21.15.57:0/545125668 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6f3006e040 0x7f6f3006b330 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6f28009e90 tx=0x7f6f28009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb51f97f38617cc1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:36.216 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.210+0000 7f6f3528a700 1 -- 172.21.15.57:0/545125668 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f2800e070 con 0x7f6f3006e040 2023-10-06T03:02:36.216 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.210+0000 7f6f3528a700 1 -- 172.21.15.57:0/545125668 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f2800bc30 con 0x7f6f3006e040 2023-10-06T03:02:36.217 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.210+0000 7f6f3528a700 1 -- 172.21.15.57:0/545125668 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f28012430 con 0x7f6f3006e040 2023-10-06T03:02:36.217 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.210+0000 7f6f3728e700 1 -- 172.21.15.57:0/545125668 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6f3006e040 msgr2=0x7f6f3006b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:36.217 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.210+0000 7f6f3728e700 1 --2- 172.21.15.57:0/545125668 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6f3006e040 0x7f6f3006b330 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6f28009e90 tx=0x7f6f28009780 comp rx=0 tx=0).stop 2023-10-06T03:02:36.218 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.210+0000 7f6f3728e700 1 -- 172.21.15.57:0/545125668 shutdown_connections 2023-10-06T03:02:36.218 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.210+0000 7f6f3728e700 1 --2- 172.21.15.57:0/545125668 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6f3006e040 0x7f6f3006b330 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:36.218 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.210+0000 7f6f3728e700 1 -- 172.21.15.57:0/545125668 >> 172.21.15.57:0/545125668 conn(0x7f6f300d0a50 msgr2=0x7f6f300cca60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:36.218 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.210+0000 7f6f3728e700 1 -- 172.21.15.57:0/545125668 shutdown_connections 2023-10-06T03:02:36.218 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.210+0000 7f6f3728e700 1 -- 172.21.15.57:0/545125668 wait complete. 2023-10-06T03:02:36.220 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.214+0000 7f6f3728e700 1 Processor -- start 2023-10-06T03:02:36.220 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.214+0000 7f6f3728e700 1 -- start start 2023-10-06T03:02:36.222 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.214+0000 7f6f3728e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6f3006e040 0x7f6f300c3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:36.222 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.214+0000 7f6f3728e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6f300cb140 0x7f6f30157570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:36.222 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.214+0000 7f6f3728e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6f300cb510 0x7f6f30067050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:36.222 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.214+0000 7f6f3728e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f300c3f90 con 0x7f6f300cb510 2023-10-06T03:02:36.222 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.214+0000 7f6f3728e700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f300b5c80 con 0x7f6f300cb140 2023-10-06T03:02:36.223 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.214+0000 7f6f3728e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f30157ab0 con 0x7f6f3006e040 2023-10-06T03:02:36.223 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.218+0000 7f6f36a8d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6f300cb510 0x7f6f30067050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:36.223 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.218+0000 7f6f36a8d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6f300cb510 0x7f6f30067050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:52520/0 (socket says 172.21.15.57:52520) 2023-10-06T03:02:36.223 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.218+0000 7f6f36a8d700 1 -- 172.21.15.57:0/489938457 learned_addr learned my addr 172.21.15.57:0/489938457 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:02:36.223 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.218+0000 7f6f3628c700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6f3006e040 0x7f6f300c3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:36.223 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.218+0000 7f6f35a8b700 1 --2- 172.21.15.57:0/489938457 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6f300cb140 0x7f6f30157570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:36.224 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.218+0000 7f6f36a8d700 1 -- 172.21.15.57:0/489938457 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6f3006e040 msgr2=0x7f6f300c3a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:36.224 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.218+0000 7f6f36a8d700 1 --2- 172.21.15.57:0/489938457 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6f3006e040 0x7f6f300c3a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:36.224 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.218+0000 7f6f36a8d700 1 -- 172.21.15.57:0/489938457 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6f300cb140 msgr2=0x7f6f30157570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:36.224 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.218+0000 7f6f36a8d700 1 --2- 172.21.15.57:0/489938457 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6f300cb140 0x7f6f30157570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:36.224 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.218+0000 7f6f36a8d700 1 -- 172.21.15.57:0/489938457 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f28009a20 con 0x7f6f300cb510 2023-10-06T03:02:36.224 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.218+0000 7f6f36a8d700 1 --2- 172.21.15.57:0/489938457 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6f300cb510 0x7f6f30067050 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f6f28013000 tx=0x7f6f28019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:36.225 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.218+0000 7f6f267fc700 1 -- 172.21.15.57:0/489938457 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f2801b420 con 0x7f6f300cb510 2023-10-06T03:02:36.225 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.218+0000 7f6f267fc700 1 -- 172.21.15.57:0/489938457 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f2801b5a0 con 0x7f6f300cb510 2023-10-06T03:02:36.225 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.218+0000 7f6f3728e700 1 -- 172.21.15.57:0/489938457 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f300c4180 con 0x7f6f300cb510 2023-10-06T03:02:36.225 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.218+0000 7f6f267fc700 1 -- 172.21.15.57:0/489938457 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f2801b960 con 0x7f6f300cb510 2023-10-06T03:02:36.225 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.218+0000 7f6f3728e700 1 -- 172.21.15.57:0/489938457 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f300c4740 con 0x7f6f300cb510 2023-10-06T03:02:36.227 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.222+0000 7f6f3728e700 1 -- 172.21.15.57:0/489938457 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f3004be40 con 0x7f6f300cb510 2023-10-06T03:02:36.229 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.222+0000 7f6f267fc700 1 -- 172.21.15.57:0/489938457 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f6f2801bd10 con 0x7f6f300cb510 2023-10-06T03:02:36.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.226+0000 7f6f267fc700 1 --2- 172.21.15.57:0/489938457 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f6f14060550 0x7f6f14062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:36.231 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.226+0000 7f6f267fc700 1 -- 172.21.15.57:0/489938457 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f6f2807e4c0 con 0x7f6f300cb510 2023-10-06T03:02:36.231 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.226+0000 7f6f3628c700 1 --2- 172.21.15.57:0/489938457 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f6f14060550 0x7f6f14062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:36.232 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.226+0000 7f6f3628c700 1 --2- 172.21.15.57:0/489938457 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f6f14060550 0x7f6f14062a00 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f6f2c007fd0 tx=0x7f6f2c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:36.237 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.230+0000 7f6f267fc700 1 -- 172.21.15.57:0/489938457 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f6f2804ec00 con 0x7f6f300cb510 2023-10-06T03:02:36.412 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.406+0000 7f6f3728e700 1 -- 172.21.15.57:0/489938457 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f6f300cd670 con 0x7f6f300cb510 2023-10-06T03:02:36.413 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.406+0000 7f6f267fc700 1 -- 172.21.15.57:0/489938457 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v46) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6f28052220 con 0x7f6f300cb510 2023-10-06T03:02:36.413 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2023-10-06T03:02:36.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.410+0000 7f6f3728e700 1 -- 172.21.15.57:0/489938457 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f6f14060550 msgr2=0x7f6f14062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:36.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.410+0000 7f6f3728e700 1 --2- 172.21.15.57:0/489938457 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f6f14060550 0x7f6f14062a00 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f6f2c007fd0 tx=0x7f6f2c009040 comp rx=0 tx=0).stop 2023-10-06T03:02:36.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.410+0000 7f6f3728e700 1 -- 172.21.15.57:0/489938457 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6f300cb510 msgr2=0x7f6f30067050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:36.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.410+0000 7f6f3728e700 1 --2- 172.21.15.57:0/489938457 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6f300cb510 0x7f6f30067050 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f6f28013000 tx=0x7f6f28019000 comp rx=0 tx=0).stop 2023-10-06T03:02:36.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.410+0000 7f6f3728e700 1 -- 172.21.15.57:0/489938457 shutdown_connections 2023-10-06T03:02:36.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.410+0000 7f6f3728e700 1 --2- 172.21.15.57:0/489938457 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6f300cb510 0x7f6f30067050 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:36.417 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.410+0000 7f6f3728e700 1 --2- 172.21.15.57:0/489938457 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6f300cb140 0x7f6f30157570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:36.417 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.410+0000 7f6f3728e700 1 --2- 172.21.15.57:0/489938457 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f6f14060550 0x7f6f14062a00 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:36.417 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.410+0000 7f6f3728e700 1 --2- 172.21.15.57:0/489938457 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6f3006e040 0x7f6f300c3a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:36.417 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.410+0000 7f6f3728e700 1 -- 172.21.15.57:0/489938457 >> 172.21.15.57:0/489938457 conn(0x7f6f300d0a50 msgr2=0x7f6f300cdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:36.417 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.410+0000 7f6f3728e700 1 -- 172.21.15.57:0/489938457 shutdown_connections 2023-10-06T03:02:36.417 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.410+0000 7f6f3728e700 1 -- 172.21.15.57:0/489938457 wait complete. 2023-10-06T03:02:36.434 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-06T03:02:36.598 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.590+0000 7ff34359e700 1 Processor -- start 2023-10-06T03:02:36.599 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.594+0000 7ff34359e700 1 -- start start 2023-10-06T03:02:36.601 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.594+0000 7ff34359e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff34406c920 0x7ff34406ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:36.601 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.594+0000 7ff34359e700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7ff3440af0d0 0x7ff3440af550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:36.601 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.594+0000 7ff34359e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff34406b4a0 con 0x7ff34406d230 2023-10-06T03:02:36.601 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.594+0000 7ff34359e700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff34406a890 con 0x7ff3440af0d0 2023-10-06T03:02:36.601 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.594+0000 7ff34359e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff34406ab70 con 0x7ff34406c920 2023-10-06T03:02:36.602 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.594+0000 7ff339d9b700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7ff34406d230 0x7ff3440ae9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:58878/0 (socket says 172.21.15.57:58878) 2023-10-06T03:02:36.602 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.594+0000 7ff339d9b700 1 -- 172.21.15.57:0/1549950999 learned_addr learned my addr 172.21.15.57:0/1549950999 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:02:36.602 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.594+0000 7ff34259c700 1 --2- 172.21.15.57:0/1549950999 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff34406c920 0x7ff34406ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:36.602 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.594+0000 7ff342d9d700 1 --2- 172.21.15.57:0/1549950999 >> v2:172.21.15.105:3300/0 conn(0x7ff3440af0d0 0x7ff3440af550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:36.602 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.594+0000 7ff341d9b700 1 -- 172.21.15.57:0/1549950999 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 402212036 0 0) 0x7ff34406b4a0 con 0x7ff34406d230 2023-10-06T03:02:36.603 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.594+0000 7ff341d9b700 1 -- 172.21.15.57:0/1549950999 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff330003570 con 0x7ff34406d230 2023-10-06T03:02:36.603 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.594+0000 7ff34259c700 1 -- 172.21.15.57:0/1549950999 >> v2:172.21.15.105:3300/0 conn(0x7ff3440af0d0 msgr2=0x7ff3440af550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:36.603 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.594+0000 7ff34259c700 1 --2- 172.21.15.57:0/1549950999 >> v2:172.21.15.105:3300/0 conn(0x7ff3440af0d0 0x7ff3440af550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:36.603 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.594+0000 7ff34259c700 1 -- 172.21.15.57:0/1549950999 >> v1:172.21.15.57:6789/0 conn(0x7ff34406d230 legacy=0x7ff3440ae9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:36.603 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.594+0000 7ff34259c700 1 -- 172.21.15.57:0/1549950999 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff34406ae50 con 0x7ff34406c920 2023-10-06T03:02:36.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.598+0000 7ff34259c700 1 --2- 172.21.15.57:0/1549950999 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff34406c920 0x7ff34406ccf0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff334009e60 tx=0x7ff334009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d1f711029f229a15 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:36.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.598+0000 7ff341d9b700 1 -- 172.21.15.57:0/1549950999 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff33400e070 con 0x7ff34406c920 2023-10-06T03:02:36.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.598+0000 7ff341d9b700 1 -- 172.21.15.57:0/1549950999 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff33400bab0 con 0x7ff34406c920 2023-10-06T03:02:36.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.598+0000 7ff341d9b700 1 -- 172.21.15.57:0/1549950999 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff33400be70 con 0x7ff34406c920 2023-10-06T03:02:36.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.598+0000 7ff34359e700 1 -- 172.21.15.57:0/1549950999 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff34406c920 msgr2=0x7ff34406ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:36.605 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.598+0000 7ff34359e700 1 --2- 172.21.15.57:0/1549950999 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff34406c920 0x7ff34406ccf0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff334009e60 tx=0x7ff334009780 comp rx=0 tx=0).stop 2023-10-06T03:02:36.605 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.598+0000 7ff34359e700 1 -- 172.21.15.57:0/1549950999 shutdown_connections 2023-10-06T03:02:36.605 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.598+0000 7ff34359e700 1 --2- 172.21.15.57:0/1549950999 >> v2:172.21.15.105:3300/0 conn(0x7ff3440af0d0 0x7ff3440af550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:36.605 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.598+0000 7ff34359e700 1 --2- 172.21.15.57:0/1549950999 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff34406c920 0x7ff34406ccf0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:36.605 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.598+0000 7ff34359e700 1 -- 172.21.15.57:0/1549950999 >> 172.21.15.57:0/1549950999 conn(0x7ff3440c85e0 msgr2=0x7ff3440c89e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:36.606 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.598+0000 7ff34359e700 1 -- 172.21.15.57:0/1549950999 shutdown_connections 2023-10-06T03:02:36.606 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.598+0000 7ff34359e700 1 -- 172.21.15.57:0/1549950999 wait complete. 2023-10-06T03:02:36.607 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.602+0000 7ff34359e700 1 Processor -- start 2023-10-06T03:02:36.607 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.602+0000 7ff34359e700 1 -- start start 2023-10-06T03:02:36.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.602+0000 7ff34359e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff34406c920 0x7ff3441542a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:36.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.602+0000 7ff34359e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff34406d230 0x7ff3440c3e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:36.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.602+0000 7ff34359e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff3440af0d0 0x7ff3440c4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:36.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.602+0000 7ff34359e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3440c4360 con 0x7ff34406c920 2023-10-06T03:02:36.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.602+0000 7ff34359e700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3440c6070 con 0x7ff34406d230 2023-10-06T03:02:36.610 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.602+0000 7ff34359e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3440c6350 con 0x7ff3440af0d0 2023-10-06T03:02:36.610 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.602+0000 7ff34259c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff34406c920 0x7ff3441542a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:36.610 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.602+0000 7ff34259c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff34406c920 0x7ff3441542a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:52532/0 (socket says 172.21.15.57:52532) 2023-10-06T03:02:36.610 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.602+0000 7ff34259c700 1 -- 172.21.15.57:0/350124522 learned_addr learned my addr 172.21.15.57:0/350124522 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:02:36.611 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.602+0000 7ff339d9b700 1 --2- 172.21.15.57:0/350124522 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff34406d230 0x7ff3440c3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:36.611 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.602+0000 7ff342d9d700 1 --2- 172.21.15.57:0/350124522 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff3440af0d0 0x7ff3440c4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:36.611 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.602+0000 7ff34259c700 1 -- 172.21.15.57:0/350124522 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff3440af0d0 msgr2=0x7ff3440c4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:36.611 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.602+0000 7ff34259c700 1 --2- 172.21.15.57:0/350124522 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff3440af0d0 0x7ff3440c4690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:36.611 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.602+0000 7ff34259c700 1 -- 172.21.15.57:0/350124522 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff34406d230 msgr2=0x7ff3440c3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:36.611 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.602+0000 7ff34259c700 1 --2- 172.21.15.57:0/350124522 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff34406d230 0x7ff3440c3e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:36.611 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.602+0000 7ff34259c700 1 -- 172.21.15.57:0/350124522 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff334009a20 con 0x7ff34406c920 2023-10-06T03:02:36.611 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.602+0000 7ff342d9d700 1 --2- 172.21.15.57:0/350124522 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff3440af0d0 0x7ff3440c4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:02:36.611 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.606+0000 7ff34259c700 1 --2- 172.21.15.57:0/350124522 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff34406c920 0x7ff3441542a0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7ff34406acb0 tx=0x7ff334019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:36.612 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.606+0000 7ff33affd700 1 -- 172.21.15.57:0/350124522 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff334027470 con 0x7ff34406c920 2023-10-06T03:02:36.612 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.606+0000 7ff33affd700 1 -- 172.21.15.57:0/350124522 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3340275f0 con 0x7ff34406c920 2023-10-06T03:02:36.612 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.606+0000 7ff33affd700 1 -- 172.21.15.57:0/350124522 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3340279b0 con 0x7ff34406c920 2023-10-06T03:02:36.612 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.606+0000 7ff34359e700 1 -- 172.21.15.57:0/350124522 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3440c6630 con 0x7ff34406c920 2023-10-06T03:02:36.612 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.606+0000 7ff34359e700 1 -- 172.21.15.57:0/350124522 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3440c6bf0 con 0x7ff34406c920 2023-10-06T03:02:36.613 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.606+0000 7ff34359e700 1 -- 172.21.15.57:0/350124522 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3440c44d0 con 0x7ff34406c920 2023-10-06T03:02:36.615 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.610+0000 7ff33affd700 1 -- 172.21.15.57:0/350124522 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7ff334024070 con 0x7ff34406c920 2023-10-06T03:02:36.616 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.610+0000 7ff33affd700 1 --2- 172.21.15.57:0/350124522 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7ff324060550 0x7ff324062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:36.617 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.610+0000 7ff33affd700 1 -- 172.21.15.57:0/350124522 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5206+0+0 (secure 0 0 0) 0x7ff33407eec0 con 0x7ff34406c920 2023-10-06T03:02:36.617 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.610+0000 7ff339d9b700 1 --2- 172.21.15.57:0/350124522 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7ff324060550 0x7ff324062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:36.618 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.610+0000 7ff339d9b700 1 --2- 172.21.15.57:0/350124522 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7ff324060550 0x7ff324062a00 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff3440adfc0 tx=0x7ff32c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:36.622 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.614+0000 7ff33affd700 1 -- 172.21.15.57:0/350124522 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7ff33404f600 con 0x7ff34406c920 2023-10-06T03:02:36.794 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.786+0000 7ff34359e700 1 -- 172.21.15.57:0/350124522 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7ff34404be40 con 0x7ff34406c920 2023-10-06T03:02:36.795 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.786+0000 7ff33affd700 1 -- 172.21.15.57:0/350124522 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v46) v1 ==== 84+0+126 (secure 0 0 0) 0x7ff33402c090 con 0x7ff34406c920 2023-10-06T03:02:36.795 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:02:36.795 INFO:teuthology.orchestra.run.smithi057.stdout:[ 2023-10-06T03:02:36.795 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-10-06T03:02:36.795 INFO:teuthology.orchestra.run.smithi057.stdout: "poolnum": 1, 2023-10-06T03:02:36.795 INFO:teuthology.orchestra.run.smithi057.stdout: "poolname": ".mgr" 2023-10-06T03:02:36.795 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-06T03:02:36.795 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-10-06T03:02:36.796 INFO:teuthology.orchestra.run.smithi057.stdout: "poolnum": 2, 2023-10-06T03:02:36.796 INFO:teuthology.orchestra.run.smithi057.stdout: "poolname": "rbd" 2023-10-06T03:02:36.796 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-10-06T03:02:36.796 INFO:teuthology.orchestra.run.smithi057.stdout:] 2023-10-06T03:02:36.797 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.790+0000 7ff34359e700 1 -- 172.21.15.57:0/350124522 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7ff324060550 msgr2=0x7ff324062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:36.798 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.790+0000 7ff34359e700 1 --2- 172.21.15.57:0/350124522 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7ff324060550 0x7ff324062a00 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff3440adfc0 tx=0x7ff32c009040 comp rx=0 tx=0).stop 2023-10-06T03:02:36.798 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.790+0000 7ff34359e700 1 -- 172.21.15.57:0/350124522 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff34406c920 msgr2=0x7ff3441542a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:36.798 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.790+0000 7ff34359e700 1 --2- 172.21.15.57:0/350124522 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff34406c920 0x7ff3441542a0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7ff34406acb0 tx=0x7ff334019000 comp rx=0 tx=0).stop 2023-10-06T03:02:36.798 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.790+0000 7ff34359e700 1 -- 172.21.15.57:0/350124522 shutdown_connections 2023-10-06T03:02:36.798 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.790+0000 7ff34359e700 1 --2- 172.21.15.57:0/350124522 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7ff324060550 0x7ff324062a00 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:36.798 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.790+0000 7ff34359e700 1 --2- 172.21.15.57:0/350124522 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff3440af0d0 0x7ff3440c4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:36.798 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.790+0000 7ff34359e700 1 --2- 172.21.15.57:0/350124522 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff34406d230 0x7ff3440c3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:36.798 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.790+0000 7ff34359e700 1 --2- 172.21.15.57:0/350124522 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff34406c920 0x7ff3441542a0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:36.798 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.790+0000 7ff34359e700 1 -- 172.21.15.57:0/350124522 >> 172.21.15.57:0/350124522 conn(0x7ff3440c85e0 msgr2=0x7ff344156eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:36.798 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.790+0000 7ff34359e700 1 -- 172.21.15.57:0/350124522 shutdown_connections 2023-10-06T03:02:36.799 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.790+0000 7ff34359e700 1 -- 172.21.15.57:0/350124522 wait complete. 2023-10-06T03:02:36.817 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-06T03:02:36.818 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-06T03:02:36.985 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.978+0000 7f77b48ad700 1 Processor -- start 2023-10-06T03:02:36.985 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.978+0000 7f77b48ad700 1 -- start start 2023-10-06T03:02:36.989 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.982+0000 7f77b48ad700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f77b015cb00 0x7f77b006b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:36.989 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.982+0000 7f77b48ad700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f77b0156c50 0x7f77b006bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:36.989 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.982+0000 7f77b48ad700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77b00cb090 con 0x7f77b0156880 2023-10-06T03:02:36.989 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.982+0000 7f77b48ad700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77b00cc600 con 0x7f77b015cb00 2023-10-06T03:02:36.989 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.982+0000 7f77b48ad700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77b015cf90 con 0x7f77b0156c50 2023-10-06T03:02:36.989 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.982+0000 7f77aed9d700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f77b0156880 0x7f77b0159f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:58888/0 (socket says 172.21.15.57:58888) 2023-10-06T03:02:36.989 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.982+0000 7f77aed9d700 1 -- 172.21.15.57:0/1724236314 learned_addr learned my addr 172.21.15.57:0/1724236314 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:02:36.990 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.982+0000 7f77af59e700 1 --2- 172.21.15.57:0/1724236314 >> v2:172.21.15.105:3300/0 conn(0x7f77b0156c50 0x7f77b006bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:36.990 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.982+0000 7f77ae59c700 1 --2- 172.21.15.57:0/1724236314 >> v2:172.21.15.57:3300/0 conn(0x7f77b015cb00 0x7f77b006b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:36.990 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.982+0000 7f77af59e700 1 -- 172.21.15.57:0/1724236314 >> v2:172.21.15.57:3300/0 conn(0x7f77b015cb00 msgr2=0x7f77b006b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:36.990 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.982+0000 7f77af59e700 1 --2- 172.21.15.57:0/1724236314 >> v2:172.21.15.57:3300/0 conn(0x7f77b015cb00 0x7f77b006b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:36.990 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.982+0000 7f77af59e700 1 -- 172.21.15.57:0/1724236314 >> v1:172.21.15.57:6789/0 conn(0x7f77b0156880 legacy=0x7f77b0159f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:36.991 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.982+0000 7f77add9b700 1 -- 172.21.15.57:0/1724236314 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3541507983 0 0) 0x7f77b00cb090 con 0x7f77b0156880 2023-10-06T03:02:36.991 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.982+0000 7f77af59e700 1 -- 172.21.15.57:0/1724236314 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77b015d270 con 0x7f77b0156c50 2023-10-06T03:02:36.991 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.986+0000 7f77af59e700 1 --2- 172.21.15.57:0/1724236314 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f77b0156c50 0x7f77b006bc80 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f77b015ca30 tx=0x7f77a8009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=608db999eef2de27 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:36.992 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.986+0000 7f77add9b700 1 -- 172.21.15.57:0/1724236314 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77a800e070 con 0x7f77b0156c50 2023-10-06T03:02:36.992 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.986+0000 7f77add9b700 1 -- 172.21.15.57:0/1724236314 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77a800bb60 con 0x7f77b0156c50 2023-10-06T03:02:36.992 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.986+0000 7f77add9b700 1 -- 172.21.15.57:0/1724236314 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77a8012430 con 0x7f77b0156c50 2023-10-06T03:02:36.993 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.986+0000 7f77b48ad700 1 -- 172.21.15.57:0/1724236314 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f77b0156c50 msgr2=0x7f77b006bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:36.993 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.986+0000 7f77b48ad700 1 --2- 172.21.15.57:0/1724236314 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f77b0156c50 0x7f77b006bc80 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f77b015ca30 tx=0x7f77a8009780 comp rx=0 tx=0).stop 2023-10-06T03:02:36.993 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.986+0000 7f77b48ad700 1 -- 172.21.15.57:0/1724236314 shutdown_connections 2023-10-06T03:02:36.993 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.986+0000 7f77b48ad700 1 --2- 172.21.15.57:0/1724236314 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f77b0156c50 0x7f77b006bc80 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:36.993 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.986+0000 7f77b48ad700 1 --2- 172.21.15.57:0/1724236314 >> v2:172.21.15.57:3300/0 conn(0x7f77b015cb00 0x7f77b006b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:36.993 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.986+0000 7f77b48ad700 1 -- 172.21.15.57:0/1724236314 >> 172.21.15.57:0/1724236314 conn(0x7f77b00cc9b0 msgr2=0x7f77b00ccdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:36.993 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.986+0000 7f77b48ad700 1 -- 172.21.15.57:0/1724236314 shutdown_connections 2023-10-06T03:02:36.993 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.986+0000 7f77b48ad700 1 -- 172.21.15.57:0/1724236314 wait complete. 2023-10-06T03:02:36.995 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.990+0000 7f77b48ad700 1 Processor -- start 2023-10-06T03:02:36.995 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.990+0000 7f77b48ad700 1 -- start start 2023-10-06T03:02:36.996 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.990+0000 7f77b48ad700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f77b0156880 0x7f77b0158320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:36.996 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.990+0000 7f77b48ad700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f77b0156c50 0x7f77b0155660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:36.997 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.990+0000 7f77b48ad700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f77b015cb00 0x7f77b0155ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:36.997 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.990+0000 7f77b48ad700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77b01560e0 con 0x7f77b0156c50 2023-10-06T03:02:36.997 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.990+0000 7f77b48ad700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77b00b1f00 con 0x7f77b015cb00 2023-10-06T03:02:36.997 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.990+0000 7f77b48ad700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77b00b21e0 con 0x7f77b0156880 2023-10-06T03:02:36.997 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.990+0000 7f77ae59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f77b0156c50 0x7f77b0155660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:36.997 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.990+0000 7f77ae59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f77b0156c50 0x7f77b0155660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:52536/0 (socket says 172.21.15.57:52536) 2023-10-06T03:02:36.997 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.990+0000 7f77ae59c700 1 -- 172.21.15.57:0/2247802376 learned_addr learned my addr 172.21.15.57:0/2247802376 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:02:36.999 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.990+0000 7f77aed9d700 1 --2- 172.21.15.57:0/2247802376 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f77b0156880 0x7f77b0158320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:36.999 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.990+0000 7f77af59e700 1 --2- 172.21.15.57:0/2247802376 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f77b015cb00 0x7f77b0155ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:36.999 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.990+0000 7f77ae59c700 1 -- 172.21.15.57:0/2247802376 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f77b0156880 msgr2=0x7f77b0158320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:36.999 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.990+0000 7f77ae59c700 1 --2- 172.21.15.57:0/2247802376 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f77b0156880 0x7f77b0158320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:36.999 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.990+0000 7f77ae59c700 1 -- 172.21.15.57:0/2247802376 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f77b015cb00 msgr2=0x7f77b0155ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:36.999 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.990+0000 7f77ae59c700 1 --2- 172.21.15.57:0/2247802376 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f77b015cb00 0x7f77b0155ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:36.999 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.990+0000 7f77ae59c700 1 -- 172.21.15.57:0/2247802376 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77a8009a20 con 0x7f77b0156c50 2023-10-06T03:02:36.999 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.990+0000 7f77ae59c700 1 --2- 172.21.15.57:0/2247802376 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f77b0156c50 0x7f77b0155660 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f77a400e930 tx=0x7f77a40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:36.999 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.994+0000 7f7796ffd700 1 -- 172.21.15.57:0/2247802376 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77a400eed0 con 0x7f77b0156c50 2023-10-06T03:02:36.999 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.994+0000 7f7796ffd700 1 -- 172.21.15.57:0/2247802376 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77a400c850 con 0x7f77b0156c50 2023-10-06T03:02:36.999 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.994+0000 7f77b48ad700 1 -- 172.21.15.57:0/2247802376 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77b00b24c0 con 0x7f77b0156c50 2023-10-06T03:02:37.000 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.994+0000 7f7796ffd700 1 -- 172.21.15.57:0/2247802376 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77a400cbf0 con 0x7f77b0156c50 2023-10-06T03:02:37.000 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.994+0000 7f77b48ad700 1 -- 172.21.15.57:0/2247802376 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77b00c4e30 con 0x7f77b0156c50 2023-10-06T03:02:37.000 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.994+0000 7f77b48ad700 1 -- 172.21.15.57:0/2247802376 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77b004be40 con 0x7f77b0156c50 2023-10-06T03:02:37.002 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.994+0000 7f7796ffd700 1 -- 172.21.15.57:0/2247802376 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f77a4013470 con 0x7f77b0156c50 2023-10-06T03:02:37.003 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.998+0000 7f7796ffd700 1 --2- 172.21.15.57:0/2247802376 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f779c060550 0x7f779c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:37.004 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.998+0000 7f7796ffd700 1 -- 172.21.15.57:0/2247802376 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f77a407c870 con 0x7f77b0156c50 2023-10-06T03:02:37.004 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.998+0000 7f77aed9d700 1 --2- 172.21.15.57:0/2247802376 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f779c060550 0x7f779c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:37.004 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:36.998+0000 7f77aed9d700 1 --2- 172.21.15.57:0/2247802376 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f779c060550 0x7f779c062a00 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f77a00011e0 tx=0x7f77a0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:37.011 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:37.006+0000 7f7796ffd700 1 -- 172.21.15.57:0/2247802376 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f77a404cfb0 con 0x7f77b0156c50 2023-10-06T03:02:37.181 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:37.174+0000 7f77b48ad700 1 -- 172.21.15.57:0/2247802376 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f77b015d550 con 0x7f77b0156c50 2023-10-06T03:02:37.824 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:37.818+0000 7f7796ffd700 1 -- 172.21.15.57:0/2247802376 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v47) v1 ==== 138+0+0 (secure 0 0 0) 0x7f77a40505d0 con 0x7f77b0156c50 2023-10-06T03:02:37.829 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:37.822+0000 7f77b48ad700 1 -- 172.21.15.57:0/2247802376 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f779c060550 msgr2=0x7f779c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:37.829 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:37.822+0000 7f77b48ad700 1 --2- 172.21.15.57:0/2247802376 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f779c060550 0x7f779c062a00 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f77a00011e0 tx=0x7f77a0009040 comp rx=0 tx=0).stop 2023-10-06T03:02:37.829 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:37.822+0000 7f77b48ad700 1 -- 172.21.15.57:0/2247802376 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f77b0156c50 msgr2=0x7f77b0155660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:37.829 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:37.822+0000 7f77b48ad700 1 --2- 172.21.15.57:0/2247802376 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f77b0156c50 0x7f77b0155660 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f77a400e930 tx=0x7f77a40091a0 comp rx=0 tx=0).stop 2023-10-06T03:02:37.830 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:37.822+0000 7f77b48ad700 1 -- 172.21.15.57:0/2247802376 shutdown_connections 2023-10-06T03:02:37.830 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:37.822+0000 7f77b48ad700 1 --2- 172.21.15.57:0/2247802376 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f77b015cb00 0x7f77b0155ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:37.830 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:37.822+0000 7f77b48ad700 1 --2- 172.21.15.57:0/2247802376 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f77b0156c50 0x7f77b0155660 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:37.830 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:37.822+0000 7f77b48ad700 1 --2- 172.21.15.57:0/2247802376 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f779c060550 0x7f779c062a00 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:37.830 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:37.822+0000 7f77b48ad700 1 --2- 172.21.15.57:0/2247802376 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f77b0156880 0x7f77b0158320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:37.830 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:37.822+0000 7f77b48ad700 1 -- 172.21.15.57:0/2247802376 >> 172.21.15.57:0/2247802376 conn(0x7f77b00cc9b0 msgr2=0x7f77b015bf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:37.831 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:37.826+0000 7f77b48ad700 1 -- 172.21.15.57:0/2247802376 shutdown_connections 2023-10-06T03:02:37.831 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:37.826+0000 7f77b48ad700 1 -- 172.21.15.57:0/2247802376 wait complete. 2023-10-06T03:02:37.837 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_metadata' created 2023-10-06T03:02:37.856 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-06T03:02:38.038 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:38.030+0000 7ff55266e700 1 Processor -- start 2023-10-06T03:02:38.038 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:38.030+0000 7ff55266e700 1 -- start start 2023-10-06T03:02:38.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:38.034+0000 7ff55266e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff54c159270 0x7ff54c06bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:38.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:38.034+0000 7ff55266e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff54c0c7090 0x7ff54c0c74e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:38.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:38.034+0000 7ff55266e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff54c06b890 con 0x7ff54c06c920 2023-10-06T03:02:38.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:38.034+0000 7ff55266e700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff54c159640 con 0x7ff54c159270 2023-10-06T03:02:38.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:38.034+0000 7ff55266e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff54c06c260 con 0x7ff54c0c7090 2023-10-06T03:02:38.040 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:38.034+0000 7ff54bfff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff54c159270 0x7ff54c06bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:38.040 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:38.034+0000 7ff550c0b700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7ff54c06c920 0x7ff54c0aeb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:58900/0 (socket says 172.21.15.57:58900) 2023-10-06T03:02:38.040 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:38.034+0000 7ff550c0b700 1 -- 172.21.15.57:0/1237221735 learned_addr learned my addr 172.21.15.57:0/1237221735 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:02:38.040 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:38.034+0000 7ff5437fe700 1 --2- 172.21.15.57:0/1237221735 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff54c0c7090 0x7ff54c0c74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:38.041 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:38.034+0000 7ff54b7fe700 1 -- 172.21.15.57:0/1237221735 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 485097388 0 0) 0x7ff54c06b890 con 0x7ff54c06c920 2023-10-06T03:02:38.041 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:38.034+0000 7ff54b7fe700 1 -- 172.21.15.57:0/1237221735 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff538003570 con 0x7ff54c06c920 2023-10-06T03:02:38.041 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:38.034+0000 7ff5437fe700 1 -- 172.21.15.57:0/1237221735 >> v2:172.21.15.57:3300/0 conn(0x7ff54c159270 msgr2=0x7ff54c06bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:38.041 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:38.034+0000 7ff5437fe700 1 --2- 172.21.15.57:0/1237221735 >> v2:172.21.15.57:3300/0 conn(0x7ff54c159270 0x7ff54c06bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:38.041 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:38.034+0000 7ff5437fe700 1 -- 172.21.15.57:0/1237221735 >> v1:172.21.15.57:6789/0 conn(0x7ff54c06c920 legacy=0x7ff54c0aeb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:38.041 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:38.034+0000 7ff5437fe700 1 -- 172.21.15.57:0/1237221735 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff54c06ac80 con 0x7ff54c0c7090 2023-10-06T03:02:38.042 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:38.034+0000 7ff5437fe700 1 --2- 172.21.15.57:0/1237221735 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff54c0c7090 0x7ff54c0c74e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff5340098e0 tx=0x7ff5340091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e13081096a10a0b9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:38.042 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:38.034+0000 7ff54b7fe700 1 -- 172.21.15.57:0/1237221735 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff534011630 con 0x7ff54c0c7090 2023-10-06T03:02:38.042 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:38.034+0000 7ff54b7fe700 1 -- 172.21.15.57:0/1237221735 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff534011790 con 0x7ff54c0c7090 2023-10-06T03:02:38.042 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:38.034+0000 7ff54b7fe700 1 -- 172.21.15.57:0/1237221735 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff534011b30 con 0x7ff54c0c7090 2023-10-06T03:02:38.043 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:38.038+0000 7ff55266e700 1 -- 172.21.15.57:0/1237221735 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff54c0c7090 msgr2=0x7ff54c0c74e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:38.043 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:38.038+0000 7ff55266e700 1 --2- 172.21.15.57:0/1237221735 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff54c0c7090 0x7ff54c0c74e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff5340098e0 tx=0x7ff5340091a0 comp rx=0 tx=0).stop 2023-10-06T03:02:38.043 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:38.038+0000 7ff55266e700 1 -- 172.21.15.57:0/1237221735 shutdown_connections 2023-10-06T03:02:38.043 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:38.038+0000 7ff55266e700 1 --2- 172.21.15.57:0/1237221735 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff54c0c7090 0x7ff54c0c74e0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:38.043 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:38.038+0000 7ff55266e700 1 --2- 172.21.15.57:0/1237221735 >> v2:172.21.15.57:3300/0 conn(0x7ff54c159270 0x7ff54c06bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:38.043 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:38.038+0000 7ff55266e700 1 -- 172.21.15.57:0/1237221735 >> 172.21.15.57:0/1237221735 conn(0x7ff54c0c87b0 msgr2=0x7ff54c0c8bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:38.044 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:38.038+0000 7ff55266e700 1 -- 172.21.15.57:0/1237221735 shutdown_connections 2023-10-06T03:02:38.044 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:38.038+0000 7ff55266e700 1 -- 172.21.15.57:0/1237221735 wait complete. 2023-10-06T03:02:38.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:38.038+0000 7ff55266e700 1 Processor -- start 2023-10-06T03:02:38.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:38.038+0000 7ff55266e700 1 -- start start 2023-10-06T03:02:38.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:38.042+0000 7ff55266e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff54c06c920 0x7ff54c159cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:38.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:38.042+0000 7ff55266e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff54c0c7090 0x7ff54c151050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:38.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:38.042+0000 7ff55266e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff54c159270 0x7ff54c15a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:38.049 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:38.042+0000 7ff55266e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff54c15c400 con 0x7ff54c06c920 2023-10-06T03:02:38.049 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:38.042+0000 7ff55266e700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff54c153b60 con 0x7ff54c159270 2023-10-06T03:02:38.049 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:38.042+0000 7ff55266e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff54c15b430 con 0x7ff54c0c7090 2023-10-06T03:02:38.049 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:38.042+0000 7ff54bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff54c06c920 0x7ff54c159cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:38.049 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:38.042+0000 7ff54bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff54c06c920 0x7ff54c159cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:52562/0 (socket says 172.21.15.57:52562) 2023-10-06T03:02:38.049 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:38.042+0000 7ff54bfff700 1 -- 172.21.15.57:0/4130354968 learned_addr learned my addr 172.21.15.57:0/4130354968 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:02:38.049 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:38.042+0000 7ff5437fe700 1 --2- 172.21.15.57:0/4130354968 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff54c0c7090 0x7ff54c151050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:38.049 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:38.042+0000 7ff550c0b700 1 --2- 172.21.15.57:0/4130354968 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff54c159270 0x7ff54c15a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:38.050 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:38.042+0000 7ff54bfff700 1 -- 172.21.15.57:0/4130354968 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff54c0c7090 msgr2=0x7ff54c151050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:38.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:38.042+0000 7ff54bfff700 1 --2- 172.21.15.57:0/4130354968 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff54c0c7090 0x7ff54c151050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:38.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:38.042+0000 7ff54bfff700 1 -- 172.21.15.57:0/4130354968 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff54c159270 msgr2=0x7ff54c15a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:38.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:38.042+0000 7ff54bfff700 1 --2- 172.21.15.57:0/4130354968 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff54c159270 0x7ff54c15a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:38.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:38.042+0000 7ff54bfff700 1 -- 172.21.15.57:0/4130354968 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff534009420 con 0x7ff54c06c920 2023-10-06T03:02:38.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:38.042+0000 7ff54bfff700 1 --2- 172.21.15.57:0/4130354968 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff54c06c920 0x7ff54c159cd0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7ff53c00e930 tx=0x7ff53c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:38.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:38.042+0000 7ff548ff9700 1 -- 172.21.15.57:0/4130354968 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff53c013680 con 0x7ff54c06c920 2023-10-06T03:02:38.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:38.042+0000 7ff548ff9700 1 -- 172.21.15.57:0/4130354968 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff53c0137e0 con 0x7ff54c06c920 2023-10-06T03:02:38.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:38.042+0000 7ff55266e700 1 -- 172.21.15.57:0/4130354968 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff54c15c650 con 0x7ff54c06c920 2023-10-06T03:02:38.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:38.042+0000 7ff548ff9700 1 -- 172.21.15.57:0/4130354968 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff53c013b80 con 0x7ff54c06c920 2023-10-06T03:02:38.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:38.046+0000 7ff55266e700 1 -- 172.21.15.57:0/4130354968 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff54c1537f0 con 0x7ff54c06c920 2023-10-06T03:02:38.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:38.046+0000 7ff55266e700 1 -- 172.21.15.57:0/4130354968 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff54c0cb880 con 0x7ff54c06c920 2023-10-06T03:02:38.054 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:38.046+0000 7ff548ff9700 1 -- 172.21.15.57:0/4130354968 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7ff53c00c3e0 con 0x7ff54c06c920 2023-10-06T03:02:38.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:38.050+0000 7ff548ff9700 1 --2- 172.21.15.57:0/4130354968 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7ff52c060550 0x7ff52c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:38.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:38.050+0000 7ff548ff9700 1 -- 172.21.15.57:0/4130354968 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5576+0+0 (secure 0 0 0) 0x7ff53c07c880 con 0x7ff54c06c920 2023-10-06T03:02:38.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:38.050+0000 7ff5437fe700 1 --2- 172.21.15.57:0/4130354968 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7ff52c060550 0x7ff52c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:38.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:38.050+0000 7ff5437fe700 1 --2- 172.21.15.57:0/4130354968 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7ff52c060550 0x7ff52c062a00 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff5340091e0 tx=0x7ff534017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:38.061 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:38.054+0000 7ff548ff9700 1 -- 172.21.15.57:0/4130354968 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7ff54c0cb880 con 0x7ff54c06c920 2023-10-06T03:02:38.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:38.222+0000 7ff55266e700 1 -- 172.21.15.57:0/4130354968 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7ff54c15cad0 con 0x7ff54c06c920 2023-10-06T03:02:38.846 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:38.834+0000 7ff548ff9700 1 -- 172.21.15.57:0/4130354968 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v48) v1 ==== 170+0+0 (secure 0 0 0) 0x7ff54c15cad0 con 0x7ff54c06c920 2023-10-06T03:02:38.851 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:38.846+0000 7ff55266e700 1 -- 172.21.15.57:0/4130354968 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7ff52c060550 msgr2=0x7ff52c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:38.851 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:38.846+0000 7ff55266e700 1 --2- 172.21.15.57:0/4130354968 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7ff52c060550 0x7ff52c062a00 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff5340091e0 tx=0x7ff534017000 comp rx=0 tx=0).stop 2023-10-06T03:02:38.851 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:38.846+0000 7ff55266e700 1 -- 172.21.15.57:0/4130354968 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff54c06c920 msgr2=0x7ff54c159cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:38.851 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:38.846+0000 7ff55266e700 1 --2- 172.21.15.57:0/4130354968 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff54c06c920 0x7ff54c159cd0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7ff53c00e930 tx=0x7ff53c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:02:38.852 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:38.846+0000 7ff55266e700 1 -- 172.21.15.57:0/4130354968 shutdown_connections 2023-10-06T03:02:38.852 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:38.846+0000 7ff55266e700 1 --2- 172.21.15.57:0/4130354968 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff54c159270 0x7ff54c15a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:38.852 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:38.846+0000 7ff55266e700 1 --2- 172.21.15.57:0/4130354968 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7ff52c060550 0x7ff52c062a00 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:38.852 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:38.846+0000 7ff55266e700 1 --2- 172.21.15.57:0/4130354968 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff54c0c7090 0x7ff54c151050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:38.852 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:38.846+0000 7ff55266e700 1 --2- 172.21.15.57:0/4130354968 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff54c06c920 0x7ff54c159cd0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:38.852 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:38.846+0000 7ff55266e700 1 -- 172.21.15.57:0/4130354968 >> 172.21.15.57:0/4130354968 conn(0x7ff54c0c87b0 msgr2=0x7ff54c0afdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:38.852 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:38.846+0000 7ff55266e700 1 -- 172.21.15.57:0/4130354968 shutdown_connections 2023-10-06T03:02:38.852 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:38.846+0000 7ff55266e700 1 -- 172.21.15.57:0/4130354968 wait complete. 2023-10-06T03:02:38.858 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_data' created 2023-10-06T03:02:38.879 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-06T03:02:39.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:39.034+0000 7f3cdf0e3700 1 Processor -- start 2023-10-06T03:02:39.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:39.034+0000 7f3cdf0e3700 1 -- start start 2023-10-06T03:02:39.041 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:39.034+0000 7f3cdf0e3700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f3cd80ae240 0x7f3cd80ca1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:39.041 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:39.034+0000 7f3cdf0e3700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3cd8067f30 0x7f3cd8162c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:39.041 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:39.034+0000 7f3cdf0e3700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cd80cab70 con 0x7f3cd80ca710 2023-10-06T03:02:39.041 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:39.034+0000 7f3cdf0e3700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cd8068370 con 0x7f3cd80ae240 2023-10-06T03:02:39.041 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:39.034+0000 7f3cdf0e3700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd806cc70 con 0x7f3cd8067f30 2023-10-06T03:02:39.042 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:39.034+0000 7f3cde0e1700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f3cd80ae240 0x7f3cd80ca1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:39.042 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:39.034+0000 7f3cde0e1700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f3cd80ae240 0x7f3cd80ca1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.57:42002/0 (socket says 172.21.15.57:42002) 2023-10-06T03:02:39.042 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:39.034+0000 7f3cde0e1700 1 -- 172.21.15.57:0/527424730 learned_addr learned my addr 172.21.15.57:0/527424730 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:02:39.042 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:39.034+0000 7f3cde8e2700 1 --2- 172.21.15.57:0/527424730 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3cd8067f30 0x7f3cd8162c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:39.042 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:39.034+0000 7f3cdd8e0700 1 --1- 172.21.15.57:0/527424730 >> v1:172.21.15.105:6789/0 conn(0x7f3cd80ca710 0x7f3cd8067820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.57:59804/0 (socket says 172.21.15.57:59804) 2023-10-06T03:02:39.043 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:39.038+0000 7f3cde0e1700 1 -- 172.21.15.57:0/527424730 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3cd8067f30 msgr2=0x7f3cd8162c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:39.043 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:39.038+0000 7f3cde0e1700 1 --2- 172.21.15.57:0/527424730 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3cd8067f30 0x7f3cd8162c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:39.043 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:39.038+0000 7f3cde0e1700 1 -- 172.21.15.57:0/527424730 >> v1:172.21.15.105:6789/0 conn(0x7f3cd80ca710 legacy=0x7f3cd8067820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:39.043 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:39.038+0000 7f3cde0e1700 1 -- 172.21.15.57:0/527424730 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cd80ae610 con 0x7f3cd80ae240 2023-10-06T03:02:39.043 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:39.038+0000 7f3cde0e1700 1 --2- 172.21.15.57:0/527424730 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3cd80ae240 0x7f3cd80ca1d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f3cd40099b0 tx=0x7f3cd4009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b9c05ddaa1a4fe08 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:39.044 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:39.038+0000 7f3cdd0df700 1 -- 172.21.15.57:0/527424730 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd4009ea0 con 0x7f3cd80ae240 2023-10-06T03:02:39.044 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:39.038+0000 7f3cdd0df700 1 -- 172.21.15.57:0/527424730 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cd400b860 con 0x7f3cd80ae240 2023-10-06T03:02:39.044 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:39.038+0000 7f3cdd0df700 1 -- 172.21.15.57:0/527424730 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd400bc00 con 0x7f3cd80ae240 2023-10-06T03:02:39.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:39.038+0000 7f3cdf0e3700 1 -- 172.21.15.57:0/527424730 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3cd80ae240 msgr2=0x7f3cd80ca1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:39.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:39.038+0000 7f3cdf0e3700 1 --2- 172.21.15.57:0/527424730 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3cd80ae240 0x7f3cd80ca1d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f3cd40099b0 tx=0x7f3cd4009250 comp rx=0 tx=0).stop 2023-10-06T03:02:39.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:39.038+0000 7f3cdf0e3700 1 -- 172.21.15.57:0/527424730 shutdown_connections 2023-10-06T03:02:39.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:39.038+0000 7f3cdf0e3700 1 --2- 172.21.15.57:0/527424730 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3cd8067f30 0x7f3cd8162c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:39.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:39.038+0000 7f3cdf0e3700 1 --2- 172.21.15.57:0/527424730 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3cd80ae240 0x7f3cd80ca1d0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:39.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:39.038+0000 7f3cdf0e3700 1 -- 172.21.15.57:0/527424730 >> 172.21.15.57:0/527424730 conn(0x7f3cd80c8660 msgr2=0x7f3cd80c8a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:39.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:39.038+0000 7f3cdf0e3700 1 -- 172.21.15.57:0/527424730 shutdown_connections 2023-10-06T03:02:39.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:39.038+0000 7f3cdf0e3700 1 -- 172.21.15.57:0/527424730 wait complete. 2023-10-06T03:02:39.047 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:39.042+0000 7f3cdf0e3700 1 Processor -- start 2023-10-06T03:02:39.047 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:39.042+0000 7f3cdf0e3700 1 -- start start 2023-10-06T03:02:39.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:39.042+0000 7f3cdf0e3700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3cd8067f30 0x7f3cd8147640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:39.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:39.042+0000 7f3cdf0e3700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3cd80ae240 0x7f3cd8154800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:39.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:39.042+0000 7f3cdf0e3700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3cd80ca710 0x7f3cd80c0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:39.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:39.042+0000 7f3cdf0e3700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd80c2ca0 con 0x7f3cd80ae240 2023-10-06T03:02:39.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:39.042+0000 7f3cdf0e3700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd80c4530 con 0x7f3cd8067f30 2023-10-06T03:02:39.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:39.042+0000 7f3cdf0e3700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd80aea30 con 0x7f3cd80ca710 2023-10-06T03:02:39.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:39.042+0000 7f3cdd8e0700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3cd80ae240 0x7f3cd8154800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:39.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:39.042+0000 7f3cdd8e0700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3cd80ae240 0x7f3cd8154800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:52572/0 (socket says 172.21.15.57:52572) 2023-10-06T03:02:39.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:39.042+0000 7f3cdd8e0700 1 -- 172.21.15.57:0/2769551870 learned_addr learned my addr 172.21.15.57:0/2769551870 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:02:39.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:39.042+0000 7f3cde8e2700 1 --2- 172.21.15.57:0/2769551870 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3cd80ca710 0x7f3cd80c0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:39.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:39.042+0000 7f3cde0e1700 1 --2- 172.21.15.57:0/2769551870 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3cd8067f30 0x7f3cd8147640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:39.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:39.042+0000 7f3cde0e1700 1 -- 172.21.15.57:0/2769551870 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3cd80ca710 msgr2=0x7f3cd80c0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:39.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:39.042+0000 7f3cde0e1700 1 --2- 172.21.15.57:0/2769551870 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3cd80ca710 0x7f3cd80c0eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:39.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:39.042+0000 7f3cde0e1700 1 -- 172.21.15.57:0/2769551870 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3cd80ae240 msgr2=0x7f3cd8154800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:39.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:39.042+0000 7f3cde0e1700 1 --2- 172.21.15.57:0/2769551870 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3cd80ae240 0x7f3cd8154800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:39.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:39.042+0000 7f3cde0e1700 1 -- 172.21.15.57:0/2769551870 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cd40094f0 con 0x7f3cd8067f30 2023-10-06T03:02:39.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:39.046+0000 7f3cde0e1700 1 --2- 172.21.15.57:0/2769551870 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3cd8067f30 0x7f3cd8147640 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f3cd806f500 tx=0x7f3cd4017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:39.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:39.046+0000 7f3cce7fc700 1 -- 172.21.15.57:0/2769551870 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd4000d10 con 0x7f3cd8067f30 2023-10-06T03:02:39.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:39.046+0000 7f3cce7fc700 1 -- 172.21.15.57:0/2769551870 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cd400bbe0 con 0x7f3cd8067f30 2023-10-06T03:02:39.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:39.046+0000 7f3cdf0e3700 1 -- 172.21.15.57:0/2769551870 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cd80af2d0 con 0x7f3cd8067f30 2023-10-06T03:02:39.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:39.046+0000 7f3cce7fc700 1 -- 172.21.15.57:0/2769551870 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd4011690 con 0x7f3cd8067f30 2023-10-06T03:02:39.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:39.046+0000 7f3cdf0e3700 1 -- 172.21.15.57:0/2769551870 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cd80aec80 con 0x7f3cd8067f30 2023-10-06T03:02:39.054 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:39.046+0000 7f3cdf0e3700 1 -- 172.21.15.57:0/2769551870 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cd804be40 con 0x7f3cd8067f30 2023-10-06T03:02:39.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:39.050+0000 7f3cce7fc700 1 -- 172.21.15.57:0/2769551870 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f3cd4011ac0 con 0x7f3cd8067f30 2023-10-06T03:02:39.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:39.050+0000 7f3cce7fc700 1 --2- 172.21.15.57:0/2769551870 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f3cbc060550 0x7f3cbc062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:39.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:39.050+0000 7f3cce7fc700 1 -- 172.21.15.57:0/2769551870 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5958+0+0 (secure 0 0 0) 0x7f3cd407e200 con 0x7f3cd8067f30 2023-10-06T03:02:39.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:39.050+0000 7f3cdd8e0700 1 --2- 172.21.15.57:0/2769551870 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f3cbc060550 0x7f3cbc062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:39.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:39.054+0000 7f3cdd8e0700 1 --2- 172.21.15.57:0/2769551870 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f3cbc060550 0x7f3cbc062a00 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f3cd8155f40 tx=0x7f3cc8007f70 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:39.066 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:39.058+0000 7f3cce7fc700 1 -- 172.21.15.57:0/2769551870 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f3cd404e650 con 0x7f3cd8067f30 2023-10-06T03:02:39.272 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:39.266+0000 7f3cdf0e3700 1 -- 172.21.15.57:0/2769551870 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f3cd806c920 con 0x7f3cd8067f30 2023-10-06T03:02:39.851 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:39.846+0000 7f3cce7fc700 1 -- 172.21.15.57:0/2769551870 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 7 and data pool 8 v28) v1 ==== 172+0+0 (secure 0 0 0) 0x7f3cd4051c70 con 0x7f3cd8067f30 2023-10-06T03:02:39.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:39.862+0000 7f3cdf0e3700 1 -- 172.21.15.57:0/2769551870 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f3cbc060550 msgr2=0x7f3cbc062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:39.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:39.862+0000 7f3cdf0e3700 1 --2- 172.21.15.57:0/2769551870 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f3cbc060550 0x7f3cbc062a00 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f3cd8155f40 tx=0x7f3cc8007f70 comp rx=0 tx=0).stop 2023-10-06T03:02:39.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:39.862+0000 7f3cdf0e3700 1 -- 172.21.15.57:0/2769551870 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3cd8067f30 msgr2=0x7f3cd8147640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:39.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:39.862+0000 7f3cdf0e3700 1 --2- 172.21.15.57:0/2769551870 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3cd8067f30 0x7f3cd8147640 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f3cd806f500 tx=0x7f3cd4017000 comp rx=0 tx=0).stop 2023-10-06T03:02:39.871 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:39.866+0000 7f3cdf0e3700 1 -- 172.21.15.57:0/2769551870 shutdown_connections 2023-10-06T03:02:39.871 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:39.866+0000 7f3cdf0e3700 1 --2- 172.21.15.57:0/2769551870 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f3cbc060550 0x7f3cbc062a00 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:39.871 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:39.866+0000 7f3cdf0e3700 1 --2- 172.21.15.57:0/2769551870 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3cd80ca710 0x7f3cd80c0eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:39.872 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:39.866+0000 7f3cdf0e3700 1 --2- 172.21.15.57:0/2769551870 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3cd80ae240 0x7f3cd8154800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:39.872 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:39.866+0000 7f3cdf0e3700 1 --2- 172.21.15.57:0/2769551870 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3cd8067f30 0x7f3cd8147640 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:39.872 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:39.866+0000 7f3cdf0e3700 1 -- 172.21.15.57:0/2769551870 >> 172.21.15.57:0/2769551870 conn(0x7f3cd80c8660 msgr2=0x7f3cd8159b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:39.872 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:39.866+0000 7f3cdf0e3700 1 -- 172.21.15.57:0/2769551870 shutdown_connections 2023-10-06T03:02:39.872 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:39.866+0000 7f3cdf0e3700 1 -- 172.21.15.57:0/2769551870 wait complete. 2023-10-06T03:02:39.887 INFO:teuthology.orchestra.run.smithi057.stderr:new fs with metadata pool 7 and data pool 8 2023-10-06T03:02:39.906 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:02:40.063 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.058+0000 7f360f363700 1 Processor -- start 2023-10-06T03:02:40.063 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.058+0000 7f360f363700 1 -- start start 2023-10-06T03:02:40.065 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.058+0000 7f360f363700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f360806d400 0x7f360815dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:40.065 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.058+0000 7f360f363700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f360815e1f0 0x7f36081605d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:40.065 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.058+0000 7f360f363700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f360806b4a0 con 0x7f360806c920 2023-10-06T03:02:40.065 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.058+0000 7f360f363700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36080af9d0 con 0x7f360815e1f0 2023-10-06T03:02:40.065 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.058+0000 7f360f363700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f360806a890 con 0x7f360806d400 2023-10-06T03:02:40.066 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.058+0000 7f360e361700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f360806c920 0x7f360806ccf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:58914/0 (socket says 172.21.15.57:58914) 2023-10-06T03:02:40.066 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.058+0000 7f360e361700 1 -- 172.21.15.57:0/1576894931 learned_addr learned my addr 172.21.15.57:0/1576894931 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:02:40.067 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.058+0000 7f360db60700 1 --2- 172.21.15.57:0/1576894931 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f360806d400 0x7f360815dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:40.067 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.058+0000 7f360eb62700 1 --2- 172.21.15.57:0/1576894931 >> v2:172.21.15.105:3300/0 conn(0x7f360815e1f0 0x7f36081605d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:40.067 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.062+0000 7f360d35f700 1 -- 172.21.15.57:0/1576894931 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 224424145 0 0) 0x7f360806b4a0 con 0x7f360806c920 2023-10-06T03:02:40.067 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.062+0000 7f360d35f700 1 -- 172.21.15.57:0/1576894931 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35f4003570 con 0x7f360806c920 2023-10-06T03:02:40.068 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.062+0000 7f360d35f700 1 -- 172.21.15.57:0/1576894931 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 168237091 0 0) 0x7f35f4003570 con 0x7f360806c920 2023-10-06T03:02:40.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.062+0000 7f360d35f700 1 -- 172.21.15.57:0/1576894931 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f360806d400 msgr2=0x7f360815dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:40.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.062+0000 7f360d35f700 1 --2- 172.21.15.57:0/1576894931 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f360806d400 0x7f360815dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:40.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.062+0000 7f360d35f700 1 -- 172.21.15.57:0/1576894931 >> v2:172.21.15.105:3300/0 conn(0x7f360815e1f0 msgr2=0x7f36081605d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:40.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.062+0000 7f360d35f700 1 --2- 172.21.15.57:0/1576894931 >> v2:172.21.15.105:3300/0 conn(0x7f360815e1f0 0x7f36081605d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:40.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.062+0000 7f360d35f700 1 -- 172.21.15.57:0/1576894931 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f360806ab70 con 0x7f360806c920 2023-10-06T03:02:40.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.062+0000 7f360d35f700 1 -- 172.21.15.57:0/1576894931 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2482400018 0 0) 0x7f36040017f0 con 0x7f360806c920 2023-10-06T03:02:40.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.062+0000 7f360d35f700 1 -- 172.21.15.57:0/1576894931 >> v1:172.21.15.57:6789/0 conn(0x7f360806c920 legacy=0x7f360806ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:40.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.062+0000 7f360d35f700 1 --2- 172.21.15.57:0/1576894931 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f35f4003a60 0x7f35f4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:40.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.062+0000 7f360d35f700 1 --2- 172.21.15.57:0/1576894931 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f360806d400 0x7f35f4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:40.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.062+0000 7f360d35f700 1 --2- 172.21.15.57:0/1576894931 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f35f4004d50 0x7f35f40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:40.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.062+0000 7f360d35f700 1 -- 172.21.15.57:0/1576894931 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36080af9d0 con 0x7f35f4003a60 2023-10-06T03:02:40.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.062+0000 7f360d35f700 1 -- 172.21.15.57:0/1576894931 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f360806a890 con 0x7f35f4004d50 2023-10-06T03:02:40.070 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.062+0000 7f360d35f700 1 -- 172.21.15.57:0/1576894931 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35f400ba60 con 0x7f360806d400 2023-10-06T03:02:40.070 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.062+0000 7f360e361700 1 --2- 172.21.15.57:0/1576894931 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f35f4003a60 0x7f35f4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:40.070 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.062+0000 7f360db60700 1 --2- 172.21.15.57:0/1576894931 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f360806d400 0x7f35f4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:40.070 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.062+0000 7f360eb62700 1 --2- 172.21.15.57:0/1576894931 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f35f4004d50 0x7f35f40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:40.070 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.062+0000 7f360e361700 1 -- 172.21.15.57:0/1576894931 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f360806d400 msgr2=0x7f35f4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:40.070 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.062+0000 7f360e361700 1 --2- 172.21.15.57:0/1576894931 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f360806d400 0x7f35f4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:40.070 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.062+0000 7f360e361700 1 -- 172.21.15.57:0/1576894931 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f35f4004d50 msgr2=0x7f35f40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:40.070 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.062+0000 7f360e361700 1 --2- 172.21.15.57:0/1576894931 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f35f4004d50 0x7f35f40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:40.070 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.062+0000 7f360e361700 1 -- 172.21.15.57:0/1576894931 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35f4003570 con 0x7f35f4003a60 2023-10-06T03:02:40.071 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.062+0000 7f360e361700 1 --2- 172.21.15.57:0/1576894931 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f35f4003a60 0x7f35f4003e70 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f360400a970 tx=0x7f360806b410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8e6afd07eaa5537 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:40.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.062+0000 7f360d35f700 1 -- 172.21.15.57:0/1576894931 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36040070d0 con 0x7f35f4003a60 2023-10-06T03:02:40.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.062+0000 7f360d35f700 1 -- 172.21.15.57:0/1576894931 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3604007270 con 0x7f35f4003a60 2023-10-06T03:02:40.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.062+0000 7f360d35f700 1 -- 172.21.15.57:0/1576894931 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3604007630 con 0x7f35f4003a60 2023-10-06T03:02:40.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.062+0000 7f360f363700 1 -- 172.21.15.57:0/1576894931 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f35f4003a60 msgr2=0x7f35f4003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:40.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.062+0000 7f360f363700 1 --2- 172.21.15.57:0/1576894931 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f35f4003a60 0x7f35f4003e70 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f360400a970 tx=0x7f360806b410 comp rx=0 tx=0).stop 2023-10-06T03:02:40.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.066+0000 7f360eb62700 1 -- 172.21.15.57:0/1576894931 reap_dead start 2023-10-06T03:02:40.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.066+0000 7f360f363700 1 -- 172.21.15.57:0/1576894931 shutdown_connections 2023-10-06T03:02:40.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.066+0000 7f360f363700 1 -- 172.21.15.57:0/1576894931 >> 172.21.15.57:0/1576894931 conn(0x7f36080c85e0 msgr2=0x7f36080c89e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:40.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.066+0000 7f360f363700 1 -- 172.21.15.57:0/1576894931 shutdown_connections 2023-10-06T03:02:40.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.066+0000 7f360f363700 1 -- 172.21.15.57:0/1576894931 wait complete. 2023-10-06T03:02:40.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.066+0000 7f360f363700 1 Processor -- start 2023-10-06T03:02:40.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.066+0000 7f360f363700 1 -- start start 2023-10-06T03:02:40.075 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.070+0000 7f360f363700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f35f4003a60 0x7f36081587b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:40.075 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.070+0000 7f360f363700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f36080aeed0 0x7f36080a98a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:40.075 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.070+0000 7f360f363700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f36080a9de0 0x7f36080c2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:40.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.070+0000 7f360f363700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36080c5460 con 0x7f36080aeed0 2023-10-06T03:02:40.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.070+0000 7f360f363700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36080c6f20 con 0x7f35f4003a60 2023-10-06T03:02:40.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.070+0000 7f360f363700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3608158cf0 con 0x7f36080a9de0 2023-10-06T03:02:40.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.070+0000 7f360db60700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f36080aeed0 0x7f36080a98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:40.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.070+0000 7f360db60700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f36080aeed0 0x7f36080a98a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:52594/0 (socket says 172.21.15.57:52594) 2023-10-06T03:02:40.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.070+0000 7f360db60700 1 -- 172.21.15.57:0/3924516019 learned_addr learned my addr 172.21.15.57:0/3924516019 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:02:40.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.070+0000 7f360e361700 1 --2- 172.21.15.57:0/3924516019 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f35f4003a60 0x7f36081587b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:40.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.070+0000 7f360eb62700 1 --2- 172.21.15.57:0/3924516019 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f36080a9de0 0x7f36080c2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:40.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.070+0000 7f360db60700 1 -- 172.21.15.57:0/3924516019 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f36080a9de0 msgr2=0x7f36080c2b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:40.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.070+0000 7f360db60700 1 --2- 172.21.15.57:0/3924516019 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f36080a9de0 0x7f36080c2b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:40.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.070+0000 7f360db60700 1 -- 172.21.15.57:0/3924516019 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f35f4003a60 msgr2=0x7f36081587b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:40.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.070+0000 7f360db60700 1 --2- 172.21.15.57:0/3924516019 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f35f4003a60 0x7f36081587b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:40.079 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.070+0000 7f360db60700 1 -- 172.21.15.57:0/3924516019 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36080c6910 con 0x7f36080aeed0 2023-10-06T03:02:40.079 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.070+0000 7f360db60700 1 --2- 172.21.15.57:0/3924516019 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f36080aeed0 0x7f36080a98a0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f35f8011d70 tx=0x7f35f80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:40.079 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.070+0000 7f35fe7fc700 1 -- 172.21.15.57:0/3924516019 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35f8009e20 con 0x7f36080aeed0 2023-10-06T03:02:40.079 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.070+0000 7f35fe7fc700 1 -- 172.21.15.57:0/3924516019 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35f800fcd0 con 0x7f36080aeed0 2023-10-06T03:02:40.079 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.070+0000 7f360f363700 1 -- 172.21.15.57:0/3924516019 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36080c4ea0 con 0x7f36080aeed0 2023-10-06T03:02:40.079 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.070+0000 7f35fe7fc700 1 -- 172.21.15.57:0/3924516019 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35f8014650 con 0x7f36080aeed0 2023-10-06T03:02:40.079 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.070+0000 7f360f363700 1 -- 172.21.15.57:0/3924516019 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36080c6bb0 con 0x7f36080aeed0 2023-10-06T03:02:40.079 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.074+0000 7f360f363700 1 -- 172.21.15.57:0/3924516019 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36080c70d0 con 0x7f36080aeed0 2023-10-06T03:02:40.080 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.074+0000 7f35fe7fc700 1 -- 172.21.15.57:0/3924516019 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f35f8014a80 con 0x7f36080aeed0 2023-10-06T03:02:40.083 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.078+0000 7f35fe7fc700 1 --2- 172.21.15.57:0/3924516019 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f35ec060580 0x7f35ec062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:40.083 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.078+0000 7f35fe7fc700 1 -- 172.21.15.57:0/3924516019 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f35f8018030 con 0x7f36080aeed0 2023-10-06T03:02:40.084 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.078+0000 7f360e361700 1 --2- 172.21.15.57:0/3924516019 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f35ec060580 0x7f35ec062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:40.084 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.078+0000 7f360e361700 1 --2- 172.21.15.57:0/3924516019 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f35ec060580 0x7f35ec062a30 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f360400a970 tx=0x7f3604016000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:40.089 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.082+0000 7f35fe7fc700 1 -- 172.21.15.57:0/3924516019 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f36080c70d0 con 0x7f36080aeed0 2023-10-06T03:02:40.257 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.250+0000 7f360f363700 1 -- 172.21.15.57:0/3924516019 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f36080c70d0 con 0x7f36080aeed0 2023-10-06T03:02:40.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.254+0000 7f35fe7fc700 1 -- 172.21.15.57:0/3924516019 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) v1 ==== 74+0+16879 (secure 0 0 0) 0x7f36080c70d0 con 0x7f36080aeed0 2023-10-06T03:02:40.260 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:02:40.260 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":49,"fsid":"eb56dc0f-9213-41cb-9aad-8ade6c802e98","created":"2023-10-06T03:00:30.806197+0000","modified":"2023-10-06T03:02:39.273766+0000","last_up_change":"2023-10-06T03:00:43.607454+0000","last_in_change":"2023-10-06T03:00:33.943513+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T03:00:44.360651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T03:00:50.466601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:02:37.240020+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-10-06T03:02:38.287494+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"58cf6c90-d704-43e0-b2db-dffe526d5e8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":33053},{"type":"v1","addr":"172.21.15.57:6801","nonce":33053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":33053},{"type":"v1","addr":"172.21.15.57:6803","nonce":33053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":33053},{"type":"v1","addr":"172.21.15.57:6807","nonce":33053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":33053},{"type":"v1","addr":"172.21.15.57:6805","nonce":33053}]},"public_addr":"172.21.15.57:6801/33053","cluster_addr":"172.21.15.57:6803/33053","heartbeat_back_addr":"172.21.15.57:6807/33053","heartbeat_front_addr":"172.21.15.57:6805/33053","state":["exists","up"]},{"osd":1,"uuid":"16afbe70-7f9e-4568-9c92-763e6e348119","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6809","nonce":33052},{"type":"v1","addr":"172.21.15.57:6810","nonce":33052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":33052},{"type":"v1","addr":"172.21.15.57:6813","nonce":33052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":33052},{"type":"v1","addr":"172.21.15.57:6822","nonce":33052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6815","nonce":33052},{"type":"v1","addr":"172.21.15.57:6818","nonce":33052}]},"public_addr":"172.21.15.57:6810/33052","cluster_addr":"172.21.15.57:6813/33052","heartbeat_back_addr":"172.21.15.57:6822/33052","heartbeat_front_addr":"172.21.15.57:6818/33052","state":["exists","up"]},{"osd":2,"uuid":"7255c62e-f92f-470f-a5ce-30228920d9f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":33058},{"type":"v1","addr":"172.21.15.57:6825","nonce":33058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":33058},{"type":"v1","addr":"172.21.15.57:6827","nonce":33058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":33058},{"type":"v1","addr":"172.21.15.57:6831","nonce":33058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":33058},{"type":"v1","addr":"172.21.15.57:6829","nonce":33058}]},"public_addr":"172.21.15.57:6825/33058","cluster_addr":"172.21.15.57:6827/33058","heartbeat_back_addr":"172.21.15.57:6831/33058","heartbeat_front_addr":"172.21.15.57:6829/33058","state":["exists","up"]},{"osd":3,"uuid":"152a236d-f799-4888-8544-74865508d5a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":33057},{"type":"v1","addr":"172.21.15.57:6811","nonce":33057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":33057},{"type":"v1","addr":"172.21.15.57:6816","nonce":33057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6821","nonce":33057},{"type":"v1","addr":"172.21.15.57:6823","nonce":33057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6817","nonce":33057},{"type":"v1","addr":"172.21.15.57:6819","nonce":33057}]},"public_addr":"172.21.15.57:6811/33057","cluster_addr":"172.21.15.57:6816/33057","heartbeat_back_addr":"172.21.15.57:6823/33057","heartbeat_front_addr":"172.21.15.57:6819/33057","state":["exists","up"]},{"osd":4,"uuid":"37db2a65-3566-41d0-9d60-e66c49e1e68e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":33368},{"type":"v1","addr":"172.21.15.105:6801","nonce":33368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":33368},{"type":"v1","addr":"172.21.15.105:6803","nonce":33368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":33368},{"type":"v1","addr":"172.21.15.105:6807","nonce":33368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":33368},{"type":"v1","addr":"172.21.15.105:6805","nonce":33368}]},"public_addr":"172.21.15.105:6801/33368","cluster_addr":"172.21.15.105:6803/33368","heartbeat_back_addr":"172.21.15.105:6807/33368","heartbeat_front_addr":"172.21.15.105:6805/33368","state":["exists","up"]},{"osd":5,"uuid":"35e77918-1bb4-42ca-9b20-f3c14eaa0c04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":33379},{"type":"v1","addr":"172.21.15.105:6818","nonce":33379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":33379},{"type":"v1","addr":"172.21.15.105:6823","nonce":33379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":33379},{"type":"v1","addr":"172.21.15.105:6831","nonce":33379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":33379},{"type":"v1","addr":"172.21.15.105:6827","nonce":33379}]},"public_addr":"172.21.15.105:6818/33379","cluster_addr":"172.21.15.105:6823/33379","heartbeat_back_addr":"172.21.15.105:6831/33379","heartbeat_front_addr":"172.21.15.105:6827/33379","state":["exists","up"]},{"osd":6,"uuid":"b4d9d510-7a45-4173-8287-c6c8d6547f2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":33369},{"type":"v1","addr":"172.21.15.105:6819","nonce":33369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":33369},{"type":"v1","addr":"172.21.15.105:6822","nonce":33369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":33369},{"type":"v1","addr":"172.21.15.105:6830","nonce":33369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":33369},{"type":"v1","addr":"172.21.15.105:6826","nonce":33369}]},"public_addr":"172.21.15.105:6819/33369","cluster_addr":"172.21.15.105:6822/33369","heartbeat_back_addr":"172.21.15.105:6830/33369","heartbeat_front_addr":"172.21.15.105:6826/33369","state":["exists","up"]},{"osd":7,"uuid":"74266fb0-cd84-463f-8bf0-092652a71dc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":33370},{"type":"v1","addr":"172.21.15.105:6809","nonce":33370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":33370},{"type":"v1","addr":"172.21.15.105:6811","nonce":33370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":33370},{"type":"v1","addr":"172.21.15.105:6815","nonce":33370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":33370},{"type":"v1","addr":"172.21.15.105:6813","nonce":33370}]},"public_addr":"172.21.15.105:6809/33370","cluster_addr":"172.21.15.105:6811/33370","heartbeat_back_addr":"172.21.15.105:6815/33370","heartbeat_front_addr":"172.21.15.105:6813/33370","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.596864+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.633851+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.636993+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.529681+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.608601+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.659752+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.661717+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.642221+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:02:40.262 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.254+0000 7f360f363700 1 -- 172.21.15.57:0/3924516019 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f35ec060580 msgr2=0x7f35ec062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:40.262 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.254+0000 7f360f363700 1 --2- 172.21.15.57:0/3924516019 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f35ec060580 0x7f35ec062a30 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f360400a970 tx=0x7f3604016000 comp rx=0 tx=0).stop 2023-10-06T03:02:40.262 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.254+0000 7f360f363700 1 -- 172.21.15.57:0/3924516019 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f36080aeed0 msgr2=0x7f36080a98a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:40.262 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.254+0000 7f360f363700 1 --2- 172.21.15.57:0/3924516019 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f36080aeed0 0x7f36080a98a0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f35f8011d70 tx=0x7f35f80091a0 comp rx=0 tx=0).stop 2023-10-06T03:02:40.263 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.254+0000 7f360f363700 1 -- 172.21.15.57:0/3924516019 shutdown_connections 2023-10-06T03:02:40.263 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.254+0000 7f360f363700 1 --2- 172.21.15.57:0/3924516019 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f35ec060580 0x7f35ec062a30 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:40.263 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.254+0000 7f360f363700 1 --2- 172.21.15.57:0/3924516019 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f36080a9de0 0x7f36080c2b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:40.263 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.254+0000 7f360f363700 1 --2- 172.21.15.57:0/3924516019 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f36080aeed0 0x7f36080a98a0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:40.263 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.254+0000 7f360f363700 1 --2- 172.21.15.57:0/3924516019 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f35f4003a60 0x7f36081587b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:40.263 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.254+0000 7f360f363700 1 -- 172.21.15.57:0/3924516019 >> 172.21.15.57:0/3924516019 conn(0x7f36080c85e0 msgr2=0x7f36080ac100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:40.263 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.258+0000 7f360f363700 1 -- 172.21.15.57:0/3924516019 shutdown_connections 2023-10-06T03:02:40.263 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.258+0000 7f360f363700 1 -- 172.21.15.57:0/3924516019 wait complete. 2023-10-06T03:02:40.283 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:02:40.443 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.438+0000 7fd3d759e700 1 Processor -- start 2023-10-06T03:02:40.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.438+0000 7fd3d759e700 1 -- start start 2023-10-06T03:02:40.451 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.442+0000 7fd3d759e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd3d806dc10 0x7fd3d80cb230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:40.451 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.442+0000 7fd3d759e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3d806c920 con 0x7fd3d80afe10 2023-10-06T03:02:40.451 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.442+0000 7fd3d759e700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3d806d780 con 0x7fd3d80ca750 2023-10-06T03:02:40.451 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.442+0000 7fd3d759e700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3d806e0b0 con 0x7fd3d806dc10 2023-10-06T03:02:40.451 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.442+0000 7fd3d5d9b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd3d806dc10 0x7fd3d80cb230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:40.451 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.442+0000 7fd3d6d9d700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fd3d80afe10 0x7fd3d80b0240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:58920/0 (socket says 172.21.15.57:58920) 2023-10-06T03:02:40.452 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.442+0000 7fd3d6d9d700 1 -- 172.21.15.57:0/3009876779 learned_addr learned my addr 172.21.15.57:0/3009876779 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:02:40.452 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.442+0000 7fd3d659c700 1 --1- 172.21.15.57:0/3009876779 >> v1:172.21.15.105:6789/0 conn(0x7fd3d80ca750 0x7fd3d80cab20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.57:59806/0 (socket says 172.21.15.57:59806) 2023-10-06T03:02:40.452 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.442+0000 7fd3d5d9b700 1 -- 172.21.15.57:0/3009876779 >> v1:172.21.15.105:6789/0 conn(0x7fd3d80ca750 legacy=0x7fd3d80cab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:40.452 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.442+0000 7fd3d5d9b700 1 -- 172.21.15.57:0/3009876779 >> v1:172.21.15.57:6789/0 conn(0x7fd3d80afe10 legacy=0x7fd3d80b0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:40.452 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.442+0000 7fd3d5d9b700 1 -- 172.21.15.57:0/3009876779 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3d80af020 con 0x7fd3d806dc10 2023-10-06T03:02:40.452 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.442+0000 7fd3d559a700 1 -- 172.21.15.57:0/3009876779 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1529970410 0 0) 0x7fd3d806c920 con 0x7fd3d80afe10 2023-10-06T03:02:40.452 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.442+0000 7fd3d5d9b700 1 --2- 172.21.15.57:0/3009876779 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3d806dc10 0x7fd3d80cb230 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fd3cc0098e0 tx=0x7fd3cc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d0f4cd8fac10a40 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:40.452 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.442+0000 7fd3d559a700 1 -- 172.21.15.57:0/3009876779 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3cc009e80 con 0x7fd3d806dc10 2023-10-06T03:02:40.452 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.442+0000 7fd3d559a700 1 -- 172.21.15.57:0/3009876779 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3cc00b860 con 0x7fd3d806dc10 2023-10-06T03:02:40.452 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.442+0000 7fd3d559a700 1 -- 172.21.15.57:0/3009876779 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3cc00bbe0 con 0x7fd3d806dc10 2023-10-06T03:02:40.452 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.442+0000 7fd3d759e700 1 -- 172.21.15.57:0/3009876779 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3d806dc10 msgr2=0x7fd3d80cb230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:40.452 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.442+0000 7fd3d759e700 1 --2- 172.21.15.57:0/3009876779 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3d806dc10 0x7fd3d80cb230 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fd3cc0098e0 tx=0x7fd3cc0091a0 comp rx=0 tx=0).stop 2023-10-06T03:02:40.453 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.446+0000 7fd3d759e700 1 -- 172.21.15.57:0/3009876779 shutdown_connections 2023-10-06T03:02:40.453 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.446+0000 7fd3d759e700 1 --2- 172.21.15.57:0/3009876779 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3d806dc10 0x7fd3d80cb230 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:40.453 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.446+0000 7fd3d759e700 1 -- 172.21.15.57:0/3009876779 >> 172.21.15.57:0/3009876779 conn(0x7fd3d80cc9f0 msgr2=0x7fd3d80ccdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:40.453 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.446+0000 7fd3d759e700 1 -- 172.21.15.57:0/3009876779 shutdown_connections 2023-10-06T03:02:40.453 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.446+0000 7fd3d759e700 1 -- 172.21.15.57:0/3009876779 wait complete. 2023-10-06T03:02:40.453 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.446+0000 7fd3d759e700 1 Processor -- start 2023-10-06T03:02:40.454 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.446+0000 7fd3d759e700 1 -- start start 2023-10-06T03:02:40.455 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.450+0000 7fd3d759e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3d806dc10 0x7fd3d815a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:40.455 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.450+0000 7fd3d759e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd3d80afe10 0x7fd3d814dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:40.455 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.450+0000 7fd3d759e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd3d80ca750 0x7fd3d80c5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:40.455 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.450+0000 7fd3d759e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d815ab60 con 0x7fd3d806dc10 2023-10-06T03:02:40.455 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.450+0000 7fd3d759e700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d80c8100 con 0x7fd3d80ca750 2023-10-06T03:02:40.455 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.450+0000 7fd3d759e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d80c83e0 con 0x7fd3d80afe10 2023-10-06T03:02:40.456 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.450+0000 7fd3d659c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3d806dc10 0x7fd3d815a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:40.456 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.450+0000 7fd3d659c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3d806dc10 0x7fd3d815a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:52600/0 (socket says 172.21.15.57:52600) 2023-10-06T03:02:40.457 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.450+0000 7fd3d659c700 1 -- 172.21.15.57:0/4240404879 learned_addr learned my addr 172.21.15.57:0/4240404879 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:02:40.457 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.450+0000 7fd3d6d9d700 1 --2- 172.21.15.57:0/4240404879 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd3d80ca750 0x7fd3d80c5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:40.457 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.450+0000 7fd3d659c700 1 -- 172.21.15.57:0/4240404879 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd3d80afe10 msgr2=0x7fd3d814dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:40.457 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.450+0000 7fd3d5d9b700 1 --2- 172.21.15.57:0/4240404879 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd3d80afe10 0x7fd3d814dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:40.457 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.450+0000 7fd3d659c700 1 --2- 172.21.15.57:0/4240404879 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd3d80afe10 0x7fd3d814dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:40.457 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.450+0000 7fd3d659c700 1 -- 172.21.15.57:0/4240404879 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd3d80ca750 msgr2=0x7fd3d80c5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:40.457 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.450+0000 7fd3d659c700 1 --2- 172.21.15.57:0/4240404879 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd3d80ca750 0x7fd3d80c5810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:40.457 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.450+0000 7fd3d659c700 1 -- 172.21.15.57:0/4240404879 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3cc009420 con 0x7fd3d806dc10 2023-10-06T03:02:40.457 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.450+0000 7fd3d6d9d700 1 --2- 172.21.15.57:0/4240404879 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd3d80ca750 0x7fd3d80c5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:02:40.457 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.450+0000 7fd3d5d9b700 1 --2- 172.21.15.57:0/4240404879 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd3d80afe10 0x7fd3d814dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:02:40.457 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.450+0000 7fd3d659c700 1 --2- 172.21.15.57:0/4240404879 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3d806dc10 0x7fd3d815a620 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fd3c800c560 tx=0x7fd3c8007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:40.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.450+0000 7fd3c67fc700 1 -- 172.21.15.57:0/4240404879 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3c8005a70 con 0x7fd3d806dc10 2023-10-06T03:02:40.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.450+0000 7fd3c67fc700 1 -- 172.21.15.57:0/4240404879 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3c8005bd0 con 0x7fd3d806dc10 2023-10-06T03:02:40.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.450+0000 7fd3c67fc700 1 -- 172.21.15.57:0/4240404879 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3c80070d0 con 0x7fd3d806dc10 2023-10-06T03:02:40.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.450+0000 7fd3d759e700 1 -- 172.21.15.57:0/4240404879 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3d80c86c0 con 0x7fd3d806dc10 2023-10-06T03:02:40.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.450+0000 7fd3d759e700 1 -- 172.21.15.57:0/4240404879 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3d814e160 con 0x7fd3d806dc10 2023-10-06T03:02:40.459 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.454+0000 7fd3d759e700 1 -- 172.21.15.57:0/4240404879 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3d80c8bc0 con 0x7fd3d806dc10 2023-10-06T03:02:40.461 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.454+0000 7fd3c67fc700 1 -- 172.21.15.57:0/4240404879 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fd3c8007480 con 0x7fd3d806dc10 2023-10-06T03:02:40.462 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.454+0000 7fd3c67fc700 1 --2- 172.21.15.57:0/4240404879 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fd3b8060550 0x7fd3b8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:40.462 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.454+0000 7fd3c67fc700 1 -- 172.21.15.57:0/4240404879 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd3c807bf10 con 0x7fd3d806dc10 2023-10-06T03:02:40.462 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.458+0000 7fd3d5d9b700 1 --2- 172.21.15.57:0/4240404879 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fd3b8060550 0x7fd3b8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:40.464 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.458+0000 7fd3d5d9b700 1 --2- 172.21.15.57:0/4240404879 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fd3b8060550 0x7fd3b8062a00 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fd3d80cf5b0 tx=0x7fd3cc017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:40.470 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.462+0000 7fd3c67fc700 1 -- 172.21.15.57:0/4240404879 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fd3c804c300 con 0x7fd3d806dc10 2023-10-06T03:02:40.641 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.634+0000 7fd3d759e700 1 -- 172.21.15.57:0/4240404879 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd3d804be40 con 0x7fd3d806dc10 2023-10-06T03:02:40.643 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.638+0000 7fd3c67fc700 1 -- 172.21.15.57:0/4240404879 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) v1 ==== 74+0+16879 (secure 0 0 0) 0x7fd3c8017090 con 0x7fd3d806dc10 2023-10-06T03:02:40.644 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:02:40.644 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":49,"fsid":"eb56dc0f-9213-41cb-9aad-8ade6c802e98","created":"2023-10-06T03:00:30.806197+0000","modified":"2023-10-06T03:02:39.273766+0000","last_up_change":"2023-10-06T03:00:43.607454+0000","last_in_change":"2023-10-06T03:00:33.943513+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T03:00:44.360651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T03:00:50.466601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:02:37.240020+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-10-06T03:02:38.287494+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"58cf6c90-d704-43e0-b2db-dffe526d5e8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":33053},{"type":"v1","addr":"172.21.15.57:6801","nonce":33053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":33053},{"type":"v1","addr":"172.21.15.57:6803","nonce":33053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":33053},{"type":"v1","addr":"172.21.15.57:6807","nonce":33053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":33053},{"type":"v1","addr":"172.21.15.57:6805","nonce":33053}]},"public_addr":"172.21.15.57:6801/33053","cluster_addr":"172.21.15.57:6803/33053","heartbeat_back_addr":"172.21.15.57:6807/33053","heartbeat_front_addr":"172.21.15.57:6805/33053","state":["exists","up"]},{"osd":1,"uuid":"16afbe70-7f9e-4568-9c92-763e6e348119","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6809","nonce":33052},{"type":"v1","addr":"172.21.15.57:6810","nonce":33052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":33052},{"type":"v1","addr":"172.21.15.57:6813","nonce":33052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":33052},{"type":"v1","addr":"172.21.15.57:6822","nonce":33052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6815","nonce":33052},{"type":"v1","addr":"172.21.15.57:6818","nonce":33052}]},"public_addr":"172.21.15.57:6810/33052","cluster_addr":"172.21.15.57:6813/33052","heartbeat_back_addr":"172.21.15.57:6822/33052","heartbeat_front_addr":"172.21.15.57:6818/33052","state":["exists","up"]},{"osd":2,"uuid":"7255c62e-f92f-470f-a5ce-30228920d9f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":33058},{"type":"v1","addr":"172.21.15.57:6825","nonce":33058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":33058},{"type":"v1","addr":"172.21.15.57:6827","nonce":33058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":33058},{"type":"v1","addr":"172.21.15.57:6831","nonce":33058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":33058},{"type":"v1","addr":"172.21.15.57:6829","nonce":33058}]},"public_addr":"172.21.15.57:6825/33058","cluster_addr":"172.21.15.57:6827/33058","heartbeat_back_addr":"172.21.15.57:6831/33058","heartbeat_front_addr":"172.21.15.57:6829/33058","state":["exists","up"]},{"osd":3,"uuid":"152a236d-f799-4888-8544-74865508d5a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":33057},{"type":"v1","addr":"172.21.15.57:6811","nonce":33057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":33057},{"type":"v1","addr":"172.21.15.57:6816","nonce":33057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6821","nonce":33057},{"type":"v1","addr":"172.21.15.57:6823","nonce":33057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6817","nonce":33057},{"type":"v1","addr":"172.21.15.57:6819","nonce":33057}]},"public_addr":"172.21.15.57:6811/33057","cluster_addr":"172.21.15.57:6816/33057","heartbeat_back_addr":"172.21.15.57:6823/33057","heartbeat_front_addr":"172.21.15.57:6819/33057","state":["exists","up"]},{"osd":4,"uuid":"37db2a65-3566-41d0-9d60-e66c49e1e68e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":33368},{"type":"v1","addr":"172.21.15.105:6801","nonce":33368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":33368},{"type":"v1","addr":"172.21.15.105:6803","nonce":33368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":33368},{"type":"v1","addr":"172.21.15.105:6807","nonce":33368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":33368},{"type":"v1","addr":"172.21.15.105:6805","nonce":33368}]},"public_addr":"172.21.15.105:6801/33368","cluster_addr":"172.21.15.105:6803/33368","heartbeat_back_addr":"172.21.15.105:6807/33368","heartbeat_front_addr":"172.21.15.105:6805/33368","state":["exists","up"]},{"osd":5,"uuid":"35e77918-1bb4-42ca-9b20-f3c14eaa0c04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":33379},{"type":"v1","addr":"172.21.15.105:6818","nonce":33379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":33379},{"type":"v1","addr":"172.21.15.105:6823","nonce":33379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":33379},{"type":"v1","addr":"172.21.15.105:6831","nonce":33379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":33379},{"type":"v1","addr":"172.21.15.105:6827","nonce":33379}]},"public_addr":"172.21.15.105:6818/33379","cluster_addr":"172.21.15.105:6823/33379","heartbeat_back_addr":"172.21.15.105:6831/33379","heartbeat_front_addr":"172.21.15.105:6827/33379","state":["exists","up"]},{"osd":6,"uuid":"b4d9d510-7a45-4173-8287-c6c8d6547f2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":33369},{"type":"v1","addr":"172.21.15.105:6819","nonce":33369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":33369},{"type":"v1","addr":"172.21.15.105:6822","nonce":33369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":33369},{"type":"v1","addr":"172.21.15.105:6830","nonce":33369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":33369},{"type":"v1","addr":"172.21.15.105:6826","nonce":33369}]},"public_addr":"172.21.15.105:6819/33369","cluster_addr":"172.21.15.105:6822/33369","heartbeat_back_addr":"172.21.15.105:6830/33369","heartbeat_front_addr":"172.21.15.105:6826/33369","state":["exists","up"]},{"osd":7,"uuid":"74266fb0-cd84-463f-8bf0-092652a71dc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":33370},{"type":"v1","addr":"172.21.15.105:6809","nonce":33370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":33370},{"type":"v1","addr":"172.21.15.105:6811","nonce":33370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":33370},{"type":"v1","addr":"172.21.15.105:6815","nonce":33370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":33370},{"type":"v1","addr":"172.21.15.105:6813","nonce":33370}]},"public_addr":"172.21.15.105:6809/33370","cluster_addr":"172.21.15.105:6811/33370","heartbeat_back_addr":"172.21.15.105:6815/33370","heartbeat_front_addr":"172.21.15.105:6813/33370","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.596864+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.633851+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.636993+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.529681+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.608601+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.659752+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.661717+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.642221+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:02:40.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.642+0000 7fd3d759e700 1 -- 172.21.15.57:0/4240404879 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fd3b8060550 msgr2=0x7fd3b8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:40.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.642+0000 7fd3d759e700 1 --2- 172.21.15.57:0/4240404879 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fd3b8060550 0x7fd3b8062a00 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fd3d80cf5b0 tx=0x7fd3cc017000 comp rx=0 tx=0).stop 2023-10-06T03:02:40.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.642+0000 7fd3d759e700 1 -- 172.21.15.57:0/4240404879 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3d806dc10 msgr2=0x7fd3d815a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:40.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.642+0000 7fd3d759e700 1 --2- 172.21.15.57:0/4240404879 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3d806dc10 0x7fd3d815a620 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fd3c800c560 tx=0x7fd3c8007f70 comp rx=0 tx=0).stop 2023-10-06T03:02:40.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.642+0000 7fd3d759e700 1 -- 172.21.15.57:0/4240404879 shutdown_connections 2023-10-06T03:02:40.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.642+0000 7fd3d759e700 1 --2- 172.21.15.57:0/4240404879 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd3d80ca750 0x7fd3d80c5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:40.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.642+0000 7fd3d759e700 1 --2- 172.21.15.57:0/4240404879 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fd3b8060550 0x7fd3b8062a00 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:40.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.642+0000 7fd3d759e700 1 --2- 172.21.15.57:0/4240404879 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd3d80afe10 0x7fd3d814dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:40.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.642+0000 7fd3d759e700 1 --2- 172.21.15.57:0/4240404879 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3d806dc10 0x7fd3d815a620 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:40.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.642+0000 7fd3d759e700 1 -- 172.21.15.57:0/4240404879 >> 172.21.15.57:0/4240404879 conn(0x7fd3d80cc9f0 msgr2=0x7fd3d80cdab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:40.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.642+0000 7fd3d759e700 1 -- 172.21.15.57:0/4240404879 shutdown_connections 2023-10-06T03:02:40.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.642+0000 7fd3d759e700 1 -- 172.21.15.57:0/4240404879 wait complete. 2023-10-06T03:02:40.667 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-06T03:02:40.804 INFO:tasks.ceph.mds.c.smithi057.stderr:2023-10-06T03:02:40.798+0000 7fc040344700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T03:02:40.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.826+0000 7fc035078700 1 Processor -- start 2023-10-06T03:02:40.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.826+0000 7fc035078700 1 -- start start 2023-10-06T03:02:40.834 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.826+0000 7fc035078700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc0300bef40 0x7fc0300c6a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:40.834 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.826+0000 7fc035078700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0300ac530 con 0x7fc0300bf310 2023-10-06T03:02:40.834 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.826+0000 7fc035078700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc03006bed0 con 0x7fc03006b9b0 2023-10-06T03:02:40.834 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.826+0000 7fc035078700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc03006dc60 con 0x7fc0300bef40 2023-10-06T03:02:40.835 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.826+0000 7fc02e59c700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fc0300bf310 0x7fc03006b2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:58932/0 (socket says 172.21.15.57:58932) 2023-10-06T03:02:40.835 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.830+0000 7fc02e59c700 1 -- 172.21.15.57:0/1907871970 learned_addr learned my addr 172.21.15.57:0/1907871970 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:02:40.835 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.830+0000 7fc02ed9d700 1 --2- 172.21.15.57:0/1907871970 >> v2:172.21.15.57:3300/0 conn(0x7fc0300bef40 0x7fc0300c6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:40.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.830+0000 7fc02dd9b700 1 -- 172.21.15.57:0/1907871970 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 116383069 0 0) 0x7fc0300ac530 con 0x7fc0300bf310 2023-10-06T03:02:40.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.830+0000 7fc02dd9b700 1 -- 172.21.15.57:0/1907871970 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc018003570 con 0x7fc0300bf310 2023-10-06T03:02:40.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.830+0000 7fc02ed9d700 1 -- 172.21.15.57:0/1907871970 >> v1:172.21.15.105:6789/0 conn(0x7fc03006b9b0 legacy=0x7fc0300ac9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:40.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.830+0000 7fc02ed9d700 1 -- 172.21.15.57:0/1907871970 >> v1:172.21.15.57:6789/0 conn(0x7fc0300bf310 legacy=0x7fc03006b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:40.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.830+0000 7fc02ed9d700 1 -- 172.21.15.57:0/1907871970 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc03006c1b0 con 0x7fc0300bef40 2023-10-06T03:02:40.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.830+0000 7fc02ed9d700 1 --2- 172.21.15.57:0/1907871970 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc0300bef40 0x7fc0300c6a50 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fc0200098e0 tx=0x7fc0200091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7a5fee2876d6522 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:40.837 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.830+0000 7fc02dd9b700 1 -- 172.21.15.57:0/1907871970 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc02000b6d0 con 0x7fc0300bef40 2023-10-06T03:02:40.837 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.830+0000 7fc02dd9b700 1 -- 172.21.15.57:0/1907871970 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc02000b830 con 0x7fc0300bef40 2023-10-06T03:02:40.837 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.830+0000 7fc02dd9b700 1 -- 172.21.15.57:0/1907871970 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc02000bbd0 con 0x7fc0300bef40 2023-10-06T03:02:40.838 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.830+0000 7fc035078700 1 -- 172.21.15.57:0/1907871970 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc0300bef40 msgr2=0x7fc0300c6a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:40.838 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.830+0000 7fc035078700 1 --2- 172.21.15.57:0/1907871970 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc0300bef40 0x7fc0300c6a50 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fc0200098e0 tx=0x7fc0200091a0 comp rx=0 tx=0).stop 2023-10-06T03:02:40.838 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.830+0000 7fc035078700 1 -- 172.21.15.57:0/1907871970 shutdown_connections 2023-10-06T03:02:40.838 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.830+0000 7fc035078700 1 --2- 172.21.15.57:0/1907871970 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc0300bef40 0x7fc0300c6a50 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:40.838 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.830+0000 7fc035078700 1 -- 172.21.15.57:0/1907871970 >> 172.21.15.57:0/1907871970 conn(0x7fc0300c87b0 msgr2=0x7fc0300c8bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:40.839 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.834+0000 7fc035078700 1 -- 172.21.15.57:0/1907871970 shutdown_connections 2023-10-06T03:02:40.839 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.834+0000 7fc035078700 1 -- 172.21.15.57:0/1907871970 wait complete. 2023-10-06T03:02:40.842 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.834+0000 7fc035078700 1 Processor -- start 2023-10-06T03:02:40.842 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.834+0000 7fc035078700 1 -- start start 2023-10-06T03:02:40.844 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.838+0000 7fc035078700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc03006b9b0 0x7fc03016d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:40.844 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.838+0000 7fc035078700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc0300bef40 0x7fc0301594a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:40.844 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.838+0000 7fc035078700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc0300bf310 0x7fc03015e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:40.845 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.838+0000 7fc035078700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc03015ff50 con 0x7fc0300bf310 2023-10-06T03:02:40.845 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.838+0000 7fc035078700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0300c0620 con 0x7fc0300bef40 2023-10-06T03:02:40.845 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.838+0000 7fc035078700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0300bf7a0 con 0x7fc03006b9b0 2023-10-06T03:02:40.845 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.838+0000 7fc02f59e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc0300bf310 0x7fc03015e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:40.845 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.838+0000 7fc02f59e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc0300bf310 0x7fc03015e8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:52624/0 (socket says 172.21.15.57:52624) 2023-10-06T03:02:40.845 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.838+0000 7fc02f59e700 1 -- 172.21.15.57:0/712764440 learned_addr learned my addr 172.21.15.57:0/712764440 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:02:40.846 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.838+0000 7fc02ed9d700 1 --2- 172.21.15.57:0/712764440 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc03006b9b0 0x7fc03016d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:40.846 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.838+0000 7fc02e59c700 1 --2- 172.21.15.57:0/712764440 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc0300bef40 0x7fc0301594a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:40.846 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.838+0000 7fc02f59e700 1 -- 172.21.15.57:0/712764440 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc03006b9b0 msgr2=0x7fc03016d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:40.846 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.838+0000 7fc02f59e700 1 --2- 172.21.15.57:0/712764440 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc03006b9b0 0x7fc03016d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:40.846 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.838+0000 7fc02f59e700 1 -- 172.21.15.57:0/712764440 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc0300bef40 msgr2=0x7fc0301594a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:40.846 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.838+0000 7fc02f59e700 1 --2- 172.21.15.57:0/712764440 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc0300bef40 0x7fc0301594a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:40.846 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.838+0000 7fc02f59e700 1 -- 172.21.15.57:0/712764440 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc020009420 con 0x7fc0300bf310 2023-10-06T03:02:40.846 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.838+0000 7fc02ed9d700 1 --2- 172.21.15.57:0/712764440 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc03006b9b0 0x7fc03016d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:02:40.846 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.838+0000 7fc02f59e700 1 --2- 172.21.15.57:0/712764440 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc0300bf310 0x7fc03015e8d0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fc02800c910 tx=0x7fc028001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:40.852 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.846+0000 7fc016ffd700 1 -- 172.21.15.57:0/712764440 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc028012630 con 0x7fc0300bf310 2023-10-06T03:02:40.853 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.846+0000 7fc016ffd700 1 -- 172.21.15.57:0/712764440 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc028012790 con 0x7fc0300bf310 2023-10-06T03:02:40.853 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.846+0000 7fc035078700 1 -- 172.21.15.57:0/712764440 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0300bfa10 con 0x7fc0300bf310 2023-10-06T03:02:40.853 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.846+0000 7fc016ffd700 1 -- 172.21.15.57:0/712764440 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc028012b30 con 0x7fc0300bf310 2023-10-06T03:02:40.853 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.846+0000 7fc035078700 1 -- 172.21.15.57:0/712764440 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0300bffd0 con 0x7fc0300bf310 2023-10-06T03:02:40.855 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.850+0000 7fc035078700 1 -- 172.21.15.57:0/712764440 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0300712e0 con 0x7fc0300bf310 2023-10-06T03:02:40.857 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.850+0000 7fc016ffd700 1 -- 172.21.15.57:0/712764440 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fc02800a3b0 con 0x7fc0300bf310 2023-10-06T03:02:40.859 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.854+0000 7fc016ffd700 1 --2- 172.21.15.57:0/712764440 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fc01c060550 0x7fc01c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:40.859 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.854+0000 7fc016ffd700 1 -- 172.21.15.57:0/712764440 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc02807cb50 con 0x7fc0300bf310 2023-10-06T03:02:40.859 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.854+0000 7fc02ed9d700 1 --2- 172.21.15.57:0/712764440 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fc01c060550 0x7fc01c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:40.860 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.854+0000 7fc02ed9d700 1 --2- 172.21.15.57:0/712764440 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fc01c060550 0x7fc01c062a00 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc0200093f0 tx=0x7fc020017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:40.864 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:40.858+0000 7fc016ffd700 1 -- 172.21.15.57:0/712764440 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fc028050a70 con 0x7fc0300bf310 2023-10-06T03:02:41.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:41.070+0000 7fc035078700 1 -- 172.21.15.57:0/712764440 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fc0300ac1c0 con 0x7fc0300bf310 2023-10-06T03:02:41.887 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:41.882+0000 7fc016ffd700 1 -- 172.21.15.57:0/712764440 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v30) v1 ==== 118+0+0 (secure 0 0 0) 0x7fc028050600 con 0x7fc0300bf310 2023-10-06T03:02:41.892 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:41.886+0000 7fc035078700 1 -- 172.21.15.57:0/712764440 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fc01c060550 msgr2=0x7fc01c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:41.892 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:41.886+0000 7fc035078700 1 --2- 172.21.15.57:0/712764440 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fc01c060550 0x7fc01c062a00 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc0200093f0 tx=0x7fc020017000 comp rx=0 tx=0).stop 2023-10-06T03:02:41.892 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:41.886+0000 7fc035078700 1 -- 172.21.15.57:0/712764440 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc0300bf310 msgr2=0x7fc03015e8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:41.892 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:41.886+0000 7fc035078700 1 --2- 172.21.15.57:0/712764440 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc0300bf310 0x7fc03015e8d0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fc02800c910 tx=0x7fc028001710 comp rx=0 tx=0).stop 2023-10-06T03:02:41.892 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:41.886+0000 7fc035078700 1 -- 172.21.15.57:0/712764440 shutdown_connections 2023-10-06T03:02:41.892 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:41.886+0000 7fc035078700 1 --2- 172.21.15.57:0/712764440 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc0300bf310 0x7fc03015e8d0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:41.892 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:41.886+0000 7fc035078700 1 --2- 172.21.15.57:0/712764440 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc0300bef40 0x7fc0301594a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:41.892 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:41.886+0000 7fc035078700 1 --2- 172.21.15.57:0/712764440 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fc01c060550 0x7fc01c062a00 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:41.892 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:41.886+0000 7fc035078700 1 --2- 172.21.15.57:0/712764440 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc03006b9b0 0x7fc03016d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:41.892 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:41.886+0000 7fc035078700 1 -- 172.21.15.57:0/712764440 >> 172.21.15.57:0/712764440 conn(0x7fc0300c87b0 msgr2=0x7fc0300b0b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:41.893 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:41.886+0000 7fc035078700 1 -- 172.21.15.57:0/712764440 shutdown_connections 2023-10-06T03:02:41.893 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:41.886+0000 7fc035078700 1 -- 172.21.15.57:0/712764440 wait complete. 2023-10-06T03:02:41.914 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-06T03:02:42.089 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:42.082+0000 7ffa8b785700 1 Processor -- start 2023-10-06T03:02:42.090 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:42.082+0000 7ffa8b785700 1 -- start start 2023-10-06T03:02:42.093 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:42.086+0000 7ffa8b785700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ffa8414fd10 0x7ffa841501b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:42.093 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:42.086+0000 7ffa8b785700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7ffa8406c920 0x7ffa8406cd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:42.093 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:42.086+0000 7ffa8b785700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa8406afb0 con 0x7ffa8415cd50 2023-10-06T03:02:42.093 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:42.086+0000 7ffa8b785700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa841506f0 con 0x7ffa8414fd10 2023-10-06T03:02:42.094 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:42.086+0000 7ffa8b785700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa8406e300 con 0x7ffa8406c920 2023-10-06T03:02:42.094 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:42.086+0000 7ffa89521700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7ffa8415cd50 0x7ffa8415d120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:58940/0 (socket says 172.21.15.57:58940) 2023-10-06T03:02:42.095 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:42.086+0000 7ffa89521700 1 -- 172.21.15.57:0/3476552627 learned_addr learned my addr 172.21.15.57:0/3476552627 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:02:42.095 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:42.086+0000 7ffa88d20700 1 --2- 172.21.15.57:0/3476552627 >> v2:172.21.15.57:3300/0 conn(0x7ffa8414fd10 0x7ffa841501b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:42.095 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:42.086+0000 7ffa89d22700 1 --2- 172.21.15.57:0/3476552627 >> v2:172.21.15.105:3300/0 conn(0x7ffa8406c920 0x7ffa8406cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:42.095 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:42.090+0000 7ffa7bfff700 1 -- 172.21.15.57:0/3476552627 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4023235926 0 0) 0x7ffa8406afb0 con 0x7ffa8415cd50 2023-10-06T03:02:42.095 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:42.090+0000 7ffa7bfff700 1 -- 172.21.15.57:0/3476552627 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa70003570 con 0x7ffa8415cd50 2023-10-06T03:02:42.096 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:42.090+0000 7ffa88d20700 1 -- 172.21.15.57:0/3476552627 >> v2:172.21.15.105:3300/0 conn(0x7ffa8406c920 msgr2=0x7ffa8406cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:42.096 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:42.090+0000 7ffa88d20700 1 --2- 172.21.15.57:0/3476552627 >> v2:172.21.15.105:3300/0 conn(0x7ffa8406c920 0x7ffa8406cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:42.096 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:42.090+0000 7ffa88d20700 1 -- 172.21.15.57:0/3476552627 >> v1:172.21.15.57:6789/0 conn(0x7ffa8415cd50 legacy=0x7ffa8415d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:42.096 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:42.090+0000 7ffa7bfff700 1 -- 172.21.15.57:0/3476552627 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 87030922 0 0) 0x7ffa70003570 con 0x7ffa8415cd50 2023-10-06T03:02:42.096 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:42.090+0000 7ffa88d20700 1 -- 172.21.15.57:0/3476552627 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa8406b290 con 0x7ffa8414fd10 2023-10-06T03:02:42.096 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:42.090+0000 7ffa88d20700 1 --2- 172.21.15.57:0/3476552627 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffa8414fd10 0x7ffa841501b0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7ffa840afd30 tx=0x7ffa740091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=397e74c4544f0c93 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:42.096 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:42.090+0000 7ffa7bfff700 1 -- 172.21.15.57:0/3476552627 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa800017f0 con 0x7ffa8414fd10 2023-10-06T03:02:42.097 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:42.090+0000 7ffa7bfff700 1 -- 172.21.15.57:0/3476552627 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa74011420 con 0x7ffa8414fd10 2023-10-06T03:02:42.097 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:42.090+0000 7ffa7bfff700 1 -- 172.21.15.57:0/3476552627 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa740117c0 con 0x7ffa8414fd10 2023-10-06T03:02:42.097 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:42.090+0000 7ffa8b785700 1 -- 172.21.15.57:0/3476552627 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffa8414fd10 msgr2=0x7ffa841501b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:42.098 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:42.090+0000 7ffa8b785700 1 --2- 172.21.15.57:0/3476552627 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffa8414fd10 0x7ffa841501b0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7ffa840afd30 tx=0x7ffa740091a0 comp rx=0 tx=0).stop 2023-10-06T03:02:42.098 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:42.090+0000 7ffa8b785700 1 -- 172.21.15.57:0/3476552627 shutdown_connections 2023-10-06T03:02:42.098 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:42.090+0000 7ffa8b785700 1 --2- 172.21.15.57:0/3476552627 >> v2:172.21.15.105:3300/0 conn(0x7ffa8406c920 0x7ffa8406cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:42.098 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:42.090+0000 7ffa8b785700 1 --2- 172.21.15.57:0/3476552627 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffa8414fd10 0x7ffa841501b0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:42.098 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:42.090+0000 7ffa8b785700 1 -- 172.21.15.57:0/3476552627 >> 172.21.15.57:0/3476552627 conn(0x7ffa840ccbc0 msgr2=0x7ffa840ccfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:42.098 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:42.090+0000 7ffa8b785700 1 -- 172.21.15.57:0/3476552627 shutdown_connections 2023-10-06T03:02:42.098 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:42.090+0000 7ffa8b785700 1 -- 172.21.15.57:0/3476552627 wait complete. 2023-10-06T03:02:42.099 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:42.094+0000 7ffa8b785700 1 Processor -- start 2023-10-06T03:02:42.099 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:42.094+0000 7ffa8b785700 1 -- start start 2023-10-06T03:02:42.100 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:42.094+0000 7ffa8b785700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffa8406c920 0x7ffa840b3c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:42.100 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:42.094+0000 7ffa8b785700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffa8414fd10 0x7ffa840b51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:42.100 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:42.094+0000 7ffa8b785700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffa8415cd50 0x7ffa8416cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:42.101 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:42.094+0000 7ffa8b785700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa840b4180 con 0x7ffa8414fd10 2023-10-06T03:02:42.101 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:42.094+0000 7ffa8b785700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa841582d0 con 0x7ffa8415cd50 2023-10-06T03:02:42.101 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:42.094+0000 7ffa8b785700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa840b43b0 con 0x7ffa8406c920 2023-10-06T03:02:42.102 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:42.094+0000 7ffa88d20700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffa8414fd10 0x7ffa840b51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:42.102 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:42.094+0000 7ffa88d20700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffa8414fd10 0x7ffa840b51f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:52640/0 (socket says 172.21.15.57:52640) 2023-10-06T03:02:42.102 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:42.094+0000 7ffa88d20700 1 -- 172.21.15.57:0/2783720679 learned_addr learned my addr 172.21.15.57:0/2783720679 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:02:42.102 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:42.094+0000 7ffa89d22700 1 --2- 172.21.15.57:0/2783720679 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffa8415cd50 0x7ffa8416cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:42.102 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:42.094+0000 7ffa89521700 1 --2- 172.21.15.57:0/2783720679 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffa8406c920 0x7ffa840b3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:42.102 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:42.094+0000 7ffa88d20700 1 -- 172.21.15.57:0/2783720679 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffa8406c920 msgr2=0x7ffa840b3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:42.102 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:42.094+0000 7ffa88d20700 1 --2- 172.21.15.57:0/2783720679 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffa8406c920 0x7ffa840b3c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:42.102 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:42.094+0000 7ffa88d20700 1 -- 172.21.15.57:0/2783720679 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffa8415cd50 msgr2=0x7ffa8416cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:42.103 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:42.094+0000 7ffa88d20700 1 --2- 172.21.15.57:0/2783720679 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffa8415cd50 0x7ffa8416cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:42.103 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:42.094+0000 7ffa88d20700 1 -- 172.21.15.57:0/2783720679 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa74009420 con 0x7ffa8414fd10 2023-10-06T03:02:42.103 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:42.094+0000 7ffa88d20700 1 --2- 172.21.15.57:0/2783720679 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffa8414fd10 0x7ffa840b51f0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7ffa74002000 tx=0x7ffa74016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:42.103 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:42.098+0000 7ffa797fa700 1 -- 172.21.15.57:0/2783720679 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa7401cab0 con 0x7ffa8414fd10 2023-10-06T03:02:42.104 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:42.098+0000 7ffa797fa700 1 -- 172.21.15.57:0/2783720679 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa7401cc10 con 0x7ffa8414fd10 2023-10-06T03:02:42.104 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:42.098+0000 7ffa8b785700 1 -- 172.21.15.57:0/2783720679 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa840b4690 con 0x7ffa8414fd10 2023-10-06T03:02:42.104 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:42.098+0000 7ffa797fa700 1 -- 172.21.15.57:0/2783720679 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa7401a450 con 0x7ffa8414fd10 2023-10-06T03:02:42.104 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:42.098+0000 7ffa8b785700 1 -- 172.21.15.57:0/2783720679 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa84158520 con 0x7ffa8414fd10 2023-10-06T03:02:42.104 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:42.098+0000 7ffa8b785700 1 -- 172.21.15.57:0/2783720679 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa840712e0 con 0x7ffa8414fd10 2023-10-06T03:02:42.105 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:42.098+0000 7ffa797fa700 1 -- 172.21.15.57:0/2783720679 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7ffa7401a800 con 0x7ffa8414fd10 2023-10-06T03:02:42.107 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:42.102+0000 7ffa797fa700 1 --2- 172.21.15.57:0/2783720679 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7ffa68060550 0x7ffa68062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:42.107 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:42.102+0000 7ffa797fa700 1 -- 172.21.15.57:0/2783720679 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ffa7407e4d0 con 0x7ffa8414fd10 2023-10-06T03:02:42.107 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:42.102+0000 7ffa89521700 1 --2- 172.21.15.57:0/2783720679 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7ffa68060550 0x7ffa68062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:42.109 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:42.102+0000 7ffa89521700 1 --2- 172.21.15.57:0/2783720679 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7ffa68060550 0x7ffa68062a00 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ffa80001560 tx=0x7ffa80001640 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:42.113 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:42.106+0000 7ffa797fa700 1 -- 172.21.15.57:0/2783720679 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7ffa7404e8c0 con 0x7ffa8414fd10 2023-10-06T03:02:42.320 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:42.314+0000 7ffa8b785700 1 -- 172.21.15.57:0/2783720679 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7ffa8406b570 con 0x7ffa8414fd10 2023-10-06T03:02:42.893 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:42.886+0000 7ffa797fa700 1 -- 172.21.15.57:0/2783720679 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v31) v1 ==== 122+0+0 (secure 0 0 0) 0x7ffa74051ee0 con 0x7ffa8414fd10 2023-10-06T03:02:42.897 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:42.890+0000 7ffa8b785700 1 -- 172.21.15.57:0/2783720679 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7ffa68060550 msgr2=0x7ffa68062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:42.897 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:42.890+0000 7ffa8b785700 1 --2- 172.21.15.57:0/2783720679 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7ffa68060550 0x7ffa68062a00 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ffa80001560 tx=0x7ffa80001640 comp rx=0 tx=0).stop 2023-10-06T03:02:42.898 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:42.890+0000 7ffa8b785700 1 -- 172.21.15.57:0/2783720679 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffa8414fd10 msgr2=0x7ffa840b51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:42.898 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:42.890+0000 7ffa8b785700 1 --2- 172.21.15.57:0/2783720679 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffa8414fd10 0x7ffa840b51f0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7ffa74002000 tx=0x7ffa74016000 comp rx=0 tx=0).stop 2023-10-06T03:02:42.898 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:42.890+0000 7ffa8b785700 1 -- 172.21.15.57:0/2783720679 shutdown_connections 2023-10-06T03:02:42.898 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:42.890+0000 7ffa8b785700 1 --2- 172.21.15.57:0/2783720679 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffa8415cd50 0x7ffa8416cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:42.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:42.890+0000 7ffa8b785700 1 --2- 172.21.15.57:0/2783720679 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffa8414fd10 0x7ffa840b51f0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:42.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:42.890+0000 7ffa8b785700 1 --2- 172.21.15.57:0/2783720679 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7ffa68060550 0x7ffa68062a00 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:42.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:42.890+0000 7ffa8b785700 1 --2- 172.21.15.57:0/2783720679 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffa8406c920 0x7ffa840b3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:42.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:42.890+0000 7ffa8b785700 1 -- 172.21.15.57:0/2783720679 >> 172.21.15.57:0/2783720679 conn(0x7ffa840ccbc0 msgr2=0x7ffa8414f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:42.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:42.890+0000 7ffa8b785700 1 -- 172.21.15.57:0/2783720679 shutdown_connections 2023-10-06T03:02:42.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:42.890+0000 7ffa8b785700 1 -- 172.21.15.57:0/2783720679 wait complete. 2023-10-06T03:02:42.919 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:02:43.082 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.074+0000 7ff3cf4ae700 1 Processor -- start 2023-10-06T03:02:43.082 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.074+0000 7ff3cf4ae700 1 -- start start 2023-10-06T03:02:43.084 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.078+0000 7ff3cf4ae700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7ff3c80cb2f0 0x7ff3c80b01c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:43.084 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.078+0000 7ff3cf4ae700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3c80cb900 con 0x7ff3c8158f70 2023-10-06T03:02:43.084 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.078+0000 7ff3cf4ae700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3c80cbbe0 con 0x7ff3c8159340 2023-10-06T03:02:43.085 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.078+0000 7ff3cf4ae700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3c80cb720 con 0x7ff3c80cb2f0 2023-10-06T03:02:43.085 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.078+0000 7ff3cd24a700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7ff3c8158f70 0x7ff3c806d4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:58946/0 (socket says 172.21.15.57:58946) 2023-10-06T03:02:43.085 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.078+0000 7ff3cd24a700 1 -- 172.21.15.57:0/4028853798 learned_addr learned my addr 172.21.15.57:0/4028853798 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:02:43.085 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.078+0000 7ff3cda4b700 1 --2- 172.21.15.57:0/4028853798 >> v2:172.21.15.105:3300/0 conn(0x7ff3c80cb2f0 0x7ff3c80b01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:43.086 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.078+0000 7ff3cda4b700 1 -- 172.21.15.57:0/4028853798 >> v1:172.21.15.105:6789/0 conn(0x7ff3c8159340 legacy=0x7ff3c806dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:43.086 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.078+0000 7ff3cda4b700 1 -- 172.21.15.57:0/4028853798 >> v1:172.21.15.57:6789/0 conn(0x7ff3c8158f70 legacy=0x7ff3c806d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:43.086 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.078+0000 7ff3cda4b700 1 -- 172.21.15.57:0/4028853798 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3c806c9c0 con 0x7ff3c80cb2f0 2023-10-06T03:02:43.086 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.078+0000 7ff3bffff700 1 -- 172.21.15.57:0/4028853798 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4128900004 0 0) 0x7ff3c80cb900 con 0x7ff3c8158f70 2023-10-06T03:02:43.087 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.082+0000 7ff3cda4b700 1 --2- 172.21.15.57:0/4028853798 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff3c80cb2f0 0x7ff3c80b01c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ff3c0009e60 tx=0x7ff3c0009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a49cb06bc394f95 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:43.087 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.082+0000 7ff3bffff700 1 -- 172.21.15.57:0/4028853798 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c000e070 con 0x7ff3c80cb2f0 2023-10-06T03:02:43.087 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.082+0000 7ff3bffff700 1 -- 172.21.15.57:0/4028853798 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3c000bc30 con 0x7ff3c80cb2f0 2023-10-06T03:02:43.087 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.082+0000 7ff3bffff700 1 -- 172.21.15.57:0/4028853798 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c0012430 con 0x7ff3c80cb2f0 2023-10-06T03:02:43.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.082+0000 7ff3cf4ae700 1 -- 172.21.15.57:0/4028853798 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff3c80cb2f0 msgr2=0x7ff3c80b01c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:43.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.082+0000 7ff3cf4ae700 1 --2- 172.21.15.57:0/4028853798 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff3c80cb2f0 0x7ff3c80b01c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ff3c0009e60 tx=0x7ff3c0009780 comp rx=0 tx=0).stop 2023-10-06T03:02:43.089 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.082+0000 7ff3cf4ae700 1 -- 172.21.15.57:0/4028853798 shutdown_connections 2023-10-06T03:02:43.089 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.082+0000 7ff3cf4ae700 1 --2- 172.21.15.57:0/4028853798 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff3c80cb2f0 0x7ff3c80b01c0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:43.089 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.082+0000 7ff3cf4ae700 1 -- 172.21.15.57:0/4028853798 >> 172.21.15.57:0/4028853798 conn(0x7ff3c80ccbf0 msgr2=0x7ff3c80ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:43.089 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.082+0000 7ff3cf4ae700 1 -- 172.21.15.57:0/4028853798 shutdown_connections 2023-10-06T03:02:43.089 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.082+0000 7ff3cf4ae700 1 -- 172.21.15.57:0/4028853798 wait complete. 2023-10-06T03:02:43.091 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.086+0000 7ff3cf4ae700 1 Processor -- start 2023-10-06T03:02:43.091 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.086+0000 7ff3cf4ae700 1 -- start start 2023-10-06T03:02:43.093 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.086+0000 7ff3cf4ae700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff3c80cb2f0 0x7ff3c80c7b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:43.093 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.086+0000 7ff3cf4ae700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff3c8158f70 0x7ff3c80c8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:43.093 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.086+0000 7ff3cf4ae700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3c8159340 0x7ff3c815d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:43.094 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.086+0000 7ff3cf4ae700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c80b0700 con 0x7ff3c8159340 2023-10-06T03:02:43.094 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.086+0000 7ff3cf4ae700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c81597e0 con 0x7ff3c80cb2f0 2023-10-06T03:02:43.094 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.086+0000 7ff3cf4ae700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c80c8680 con 0x7ff3c8158f70 2023-10-06T03:02:43.094 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.086+0000 7ff3cda4b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3c8159340 0x7ff3c815d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:43.094 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.086+0000 7ff3cda4b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3c8159340 0x7ff3c815d780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:52648/0 (socket says 172.21.15.57:52648) 2023-10-06T03:02:43.094 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.086+0000 7ff3cda4b700 1 -- 172.21.15.57:0/2345163880 learned_addr learned my addr 172.21.15.57:0/2345163880 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:02:43.094 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.086+0000 7ff3cca49700 1 --2- 172.21.15.57:0/2345163880 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff3c8158f70 0x7ff3c80c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:43.094 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.086+0000 7ff3cd24a700 1 --2- 172.21.15.57:0/2345163880 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff3c80cb2f0 0x7ff3c80c7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:43.095 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.086+0000 7ff3cda4b700 1 -- 172.21.15.57:0/2345163880 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff3c8158f70 msgr2=0x7ff3c80c8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:43.095 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.086+0000 7ff3cda4b700 1 --2- 172.21.15.57:0/2345163880 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff3c8158f70 0x7ff3c80c8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:43.096 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.086+0000 7ff3cda4b700 1 -- 172.21.15.57:0/2345163880 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff3c80cb2f0 msgr2=0x7ff3c80c7b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:43.096 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.086+0000 7ff3cda4b700 1 --2- 172.21.15.57:0/2345163880 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff3c80cb2f0 0x7ff3c80c7b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:43.096 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.086+0000 7ff3cda4b700 1 -- 172.21.15.57:0/2345163880 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3c0009a20 con 0x7ff3c8159340 2023-10-06T03:02:43.096 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.086+0000 7ff3cd24a700 1 --2- 172.21.15.57:0/2345163880 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff3c80cb2f0 0x7ff3c80c7b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:02:43.096 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.086+0000 7ff3cca49700 1 --2- 172.21.15.57:0/2345163880 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff3c8158f70 0x7ff3c80c8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:02:43.096 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.090+0000 7ff3cda4b700 1 --2- 172.21.15.57:0/2345163880 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3c8159340 0x7ff3c815d780 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7ff3c0013000 tx=0x7ff3c0019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:43.096 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.090+0000 7ff3bd7fa700 1 -- 172.21.15.57:0/2345163880 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c001b630 con 0x7ff3c8159340 2023-10-06T03:02:43.096 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.090+0000 7ff3bd7fa700 1 -- 172.21.15.57:0/2345163880 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3c001b790 con 0x7ff3c8159340 2023-10-06T03:02:43.096 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.090+0000 7ff3cf4ae700 1 -- 172.21.15.57:0/2345163880 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3c80c8960 con 0x7ff3c8159340 2023-10-06T03:02:43.096 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.090+0000 7ff3bd7fa700 1 -- 172.21.15.57:0/2345163880 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c001bb30 con 0x7ff3c8159340 2023-10-06T03:02:43.096 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.090+0000 7ff3cf4ae700 1 -- 172.21.15.57:0/2345163880 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3c81599f0 con 0x7ff3c8159340 2023-10-06T03:02:43.097 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.090+0000 7ff3cf4ae700 1 -- 172.21.15.57:0/2345163880 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3c8159be0 con 0x7ff3c8159340 2023-10-06T03:02:43.099 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.094+0000 7ff3bd7fa700 1 -- 172.21.15.57:0/2345163880 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7ff3c0003020 con 0x7ff3c8159340 2023-10-06T03:02:43.100 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.094+0000 7ff3bd7fa700 1 --2- 172.21.15.57:0/2345163880 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7ff3ac060580 0x7ff3ac062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:43.100 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.094+0000 7ff3bd7fa700 1 -- 172.21.15.57:0/2345163880 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff3c007e5b0 con 0x7ff3c8159340 2023-10-06T03:02:43.101 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.094+0000 7ff3cd24a700 1 --2- 172.21.15.57:0/2345163880 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7ff3ac060580 0x7ff3ac062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:43.101 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.094+0000 7ff3cd24a700 1 --2- 172.21.15.57:0/2345163880 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7ff3ac060580 0x7ff3ac062a30 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff3c40011e0 tx=0x7ff3c4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:43.108 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.102+0000 7ff3bd7fa700 1 -- 172.21.15.57:0/2345163880 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7ff3c004e9a0 con 0x7ff3c8159340 2023-10-06T03:02:43.316 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.310+0000 7ff3cf4ae700 1 -- 172.21.15.57:0/2345163880 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff3c80712e0 con 0x7ff3c8159340 2023-10-06T03:02:43.317 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.310+0000 7ff3bd7fa700 1 -- 172.21.15.57:0/2345163880 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+4603 (secure 0 0 0) 0x7ff3c0009880 con 0x7ff3c8159340 2023-10-06T03:02:43.317 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:02:43.317 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":31,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5078,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/3441702537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":3441702537},{"type":"v1","addr":"172.21.15.105:6835","nonce":3441702537}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5356,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/1128830333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":1128830333},{"type":"v1","addr":"172.21.15.105:6833","nonce":1128830333}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":5430,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6836/2129396191","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":2129396191},{"type":"v1","addr":"172.21.15.57:6836","nonce":2129396191}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:02:39.274111+0000","modified":"2023-10-06T03:02:42.883803+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5433},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5433":{"gid":5433,"name":"c","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6837/4147766471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6835","nonce":4147766471},{"type":"v1","addr":"172.21.15.57:6837","nonce":4147766471}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T03:02:43.321 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.314+0000 7ff3cf4ae700 1 -- 172.21.15.57:0/2345163880 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7ff3ac060580 msgr2=0x7ff3ac062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:43.321 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.314+0000 7ff3cf4ae700 1 --2- 172.21.15.57:0/2345163880 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7ff3ac060580 0x7ff3ac062a30 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff3c40011e0 tx=0x7ff3c4009040 comp rx=0 tx=0).stop 2023-10-06T03:02:43.321 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.314+0000 7ff3cf4ae700 1 -- 172.21.15.57:0/2345163880 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3c8159340 msgr2=0x7ff3c815d780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:43.321 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.314+0000 7ff3cf4ae700 1 --2- 172.21.15.57:0/2345163880 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3c8159340 0x7ff3c815d780 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7ff3c0013000 tx=0x7ff3c0019000 comp rx=0 tx=0).stop 2023-10-06T03:02:43.321 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.314+0000 7ff3cf4ae700 1 -- 172.21.15.57:0/2345163880 shutdown_connections 2023-10-06T03:02:43.322 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.314+0000 7ff3cf4ae700 1 --2- 172.21.15.57:0/2345163880 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3c8159340 0x7ff3c815d780 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:43.322 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.314+0000 7ff3cf4ae700 1 --2- 172.21.15.57:0/2345163880 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7ff3ac060580 0x7ff3ac062a30 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:43.322 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.314+0000 7ff3cf4ae700 1 --2- 172.21.15.57:0/2345163880 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff3c8158f70 0x7ff3c80c8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:43.322 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.314+0000 7ff3cf4ae700 1 --2- 172.21.15.57:0/2345163880 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff3c80cb2f0 0x7ff3c80c7b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:43.322 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.314+0000 7ff3cf4ae700 1 -- 172.21.15.57:0/2345163880 >> 172.21.15.57:0/2345163880 conn(0x7ff3c80ccbf0 msgr2=0x7ff3c806be70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:43.322 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.314+0000 7ff3cf4ae700 1 -- 172.21.15.57:0/2345163880 shutdown_connections 2023-10-06T03:02:43.322 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.314+0000 7ff3cf4ae700 1 -- 172.21.15.57:0/2345163880 wait complete. 2023-10-06T03:02:43.323 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 31 2023-10-06T03:02:43.340 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:02:43.499 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.494+0000 7f68f759e700 1 Processor -- start 2023-10-06T03:02:43.499 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.494+0000 7f68f759e700 1 -- start start 2023-10-06T03:02:43.503 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.498+0000 7f68f759e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f68f806c920 0x7f68f806ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:43.503 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.498+0000 7f68f759e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f68f806d230 0x7f68f80ae9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:43.503 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.498+0000 7f68f759e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68f806b4a0 con 0x7f68f80aef00 2023-10-06T03:02:43.503 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.498+0000 7f68f759e700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68f806a890 con 0x7f68f806c920 2023-10-06T03:02:43.503 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.498+0000 7f68f759e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68f806ab70 con 0x7f68f806d230 2023-10-06T03:02:43.504 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.498+0000 7f68f659c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f68f806c920 0x7f68f806ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:43.504 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.498+0000 7f68f6d9d700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f68f80aef00 0x7f68f80af380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:58952/0 (socket says 172.21.15.57:58952) 2023-10-06T03:02:43.504 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.498+0000 7f68f6d9d700 1 -- 172.21.15.57:0/1904431165 learned_addr learned my addr 172.21.15.57:0/1904431165 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:02:43.504 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.498+0000 7f68f659c700 1 --2- 172.21.15.57:0/1904431165 >> v2:172.21.15.57:3300/0 conn(0x7f68f806c920 0x7f68f806ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:52650/0 (socket says 172.21.15.57:52650) 2023-10-06T03:02:43.504 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.498+0000 7f68f5d9b700 1 --2- 172.21.15.57:0/1904431165 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f68f806d230 0x7f68f80ae9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:43.504 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.498+0000 7f68f659c700 1 -- 172.21.15.57:0/1904431165 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f68f806d230 msgr2=0x7f68f80ae9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:43.505 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.498+0000 7f68f659c700 1 --2- 172.21.15.57:0/1904431165 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f68f806d230 0x7f68f80ae9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:43.505 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.498+0000 7f68f559a700 1 -- 172.21.15.57:0/1904431165 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 930962320 0 0) 0x7f68f806b4a0 con 0x7f68f80aef00 2023-10-06T03:02:43.505 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.498+0000 7f68f659c700 1 -- 172.21.15.57:0/1904431165 >> v1:172.21.15.57:6789/0 conn(0x7f68f80aef00 legacy=0x7f68f80af380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:43.505 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.498+0000 7f68f659c700 1 -- 172.21.15.57:0/1904431165 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68f806ae50 con 0x7f68f806c920 2023-10-06T03:02:43.506 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.498+0000 7f68f659c700 1 --2- 172.21.15.57:0/1904431165 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f68f806c920 0x7f68f806ccf0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f68e80098e0 tx=0x7f68e80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa6be2b87836aed5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:43.506 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.498+0000 7f68f559a700 1 -- 172.21.15.57:0/1904431165 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e800b640 con 0x7f68f806c920 2023-10-06T03:02:43.506 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.498+0000 7f68f559a700 1 -- 172.21.15.57:0/1904431165 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68e800b7a0 con 0x7f68f806c920 2023-10-06T03:02:43.506 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.498+0000 7f68f559a700 1 -- 172.21.15.57:0/1904431165 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e800bb40 con 0x7f68f806c920 2023-10-06T03:02:43.507 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.502+0000 7f68f759e700 1 -- 172.21.15.57:0/1904431165 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f68f806c920 msgr2=0x7f68f806ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:43.507 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.502+0000 7f68f759e700 1 --2- 172.21.15.57:0/1904431165 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f68f806c920 0x7f68f806ccf0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f68e80098e0 tx=0x7f68e80091a0 comp rx=0 tx=0).stop 2023-10-06T03:02:43.507 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.502+0000 7f68f759e700 1 -- 172.21.15.57:0/1904431165 shutdown_connections 2023-10-06T03:02:43.507 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.502+0000 7f68f759e700 1 --2- 172.21.15.57:0/1904431165 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f68f806d230 0x7f68f80ae9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:43.507 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.502+0000 7f68f759e700 1 --2- 172.21.15.57:0/1904431165 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f68f806c920 0x7f68f806ccf0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:43.508 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.502+0000 7f68f759e700 1 -- 172.21.15.57:0/1904431165 >> 172.21.15.57:0/1904431165 conn(0x7f68f80c85e0 msgr2=0x7f68f80c89e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:43.508 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.502+0000 7f68f759e700 1 -- 172.21.15.57:0/1904431165 shutdown_connections 2023-10-06T03:02:43.508 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.502+0000 7f68f759e700 1 -- 172.21.15.57:0/1904431165 wait complete. 2023-10-06T03:02:43.509 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.502+0000 7f68f759e700 1 Processor -- start 2023-10-06T03:02:43.509 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.502+0000 7f68f759e700 1 -- start start 2023-10-06T03:02:43.510 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.502+0000 7f68f759e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f68f806c920 0x7f68f8145ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:43.510 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.506+0000 7f68f759e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f68f806d230 0x7f68f816c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:43.511 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.506+0000 7f68f759e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f68f80aef00 0x7f68f816c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:43.511 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.506+0000 7f68f759e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68f8144960 con 0x7f68f806d230 2023-10-06T03:02:43.511 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.506+0000 7f68f759e700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68f8143d50 con 0x7f68f80aef00 2023-10-06T03:02:43.511 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.506+0000 7f68f759e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68f8144030 con 0x7f68f806c920 2023-10-06T03:02:43.512 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.506+0000 7f68f5d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f68f806d230 0x7f68f816c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:43.512 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.506+0000 7f68f5d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f68f806d230 0x7f68f816c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:52666/0 (socket says 172.21.15.57:52666) 2023-10-06T03:02:43.512 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.506+0000 7f68f5d9b700 1 -- 172.21.15.57:0/3751312334 learned_addr learned my addr 172.21.15.57:0/3751312334 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:02:43.512 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.506+0000 7f68f659c700 1 --2- 172.21.15.57:0/3751312334 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f68f806c920 0x7f68f8145ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:43.512 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.506+0000 7f68f6d9d700 1 --2- 172.21.15.57:0/3751312334 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f68f80aef00 0x7f68f816c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:43.512 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.506+0000 7f68f5d9b700 1 -- 172.21.15.57:0/3751312334 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f68f806c920 msgr2=0x7f68f8145ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:43.512 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.506+0000 7f68f5d9b700 1 --2- 172.21.15.57:0/3751312334 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f68f806c920 0x7f68f8145ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:43.512 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.506+0000 7f68f5d9b700 1 -- 172.21.15.57:0/3751312334 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f68f80aef00 msgr2=0x7f68f816c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:43.513 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.506+0000 7f68f5d9b700 1 --2- 172.21.15.57:0/3751312334 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f68f80aef00 0x7f68f816c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:43.513 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.506+0000 7f68f5d9b700 1 -- 172.21.15.57:0/3751312334 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68e8009420 con 0x7f68f806d230 2023-10-06T03:02:43.513 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.506+0000 7f68f5d9b700 1 --2- 172.21.15.57:0/3751312334 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f68f806d230 0x7f68f816c230 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f68ec00ec80 tx=0x7f68ec0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:43.513 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.506+0000 7f68e67fc700 1 -- 172.21.15.57:0/3751312334 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68ec00c850 con 0x7f68f806d230 2023-10-06T03:02:43.514 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.506+0000 7f68e67fc700 1 -- 172.21.15.57:0/3751312334 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68ec00c9b0 con 0x7f68f806d230 2023-10-06T03:02:43.514 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.506+0000 7f68f759e700 1 -- 172.21.15.57:0/3751312334 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68f8144310 con 0x7f68f806d230 2023-10-06T03:02:43.514 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.506+0000 7f68e67fc700 1 -- 172.21.15.57:0/3751312334 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68ec00cd50 con 0x7f68f806d230 2023-10-06T03:02:43.514 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.506+0000 7f68f759e700 1 -- 172.21.15.57:0/3751312334 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68f8146430 con 0x7f68f806d230 2023-10-06T03:02:43.514 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.506+0000 7f68f759e700 1 -- 172.21.15.57:0/3751312334 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68f8144b10 con 0x7f68f806d230 2023-10-06T03:02:43.515 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.510+0000 7f68e67fc700 1 -- 172.21.15.57:0/3751312334 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f68ec013680 con 0x7f68f806d230 2023-10-06T03:02:43.517 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.510+0000 7f68e67fc700 1 --2- 172.21.15.57:0/3751312334 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f68d80605d0 0x7f68d8062a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:43.517 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.510+0000 7f68e67fc700 1 -- 172.21.15.57:0/3751312334 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f68ec07ccb0 con 0x7f68f806d230 2023-10-06T03:02:43.517 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.510+0000 7f68f659c700 1 --2- 172.21.15.57:0/3751312334 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f68d80605d0 0x7f68d8062a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:43.518 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.514+0000 7f68f659c700 1 --2- 172.21.15.57:0/3751312334 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f68d80605d0 0x7f68d8062a80 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f68e80093f0 tx=0x7f68e8017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:43.523 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.518+0000 7f68e67fc700 1 -- 172.21.15.57:0/3751312334 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f68ec04d0a0 con 0x7f68f806d230 2023-10-06T03:02:43.697 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.690+0000 7f68f759e700 1 -- 172.21.15.57:0/3751312334 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f68f804be40 con 0x7f68f806d230 2023-10-06T03:02:43.700 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.694+0000 7f68e67fc700 1 -- 172.21.15.57:0/3751312334 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) v1 ==== 74+0+16866 (secure 0 0 0) 0x7f68ec0506c0 con 0x7f68f806d230 2023-10-06T03:02:43.700 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:02:43.700 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":50,"fsid":"eb56dc0f-9213-41cb-9aad-8ade6c802e98","created":"2023-10-06T03:00:30.806197+0000","modified":"2023-10-06T03:02:40.838813+0000","last_up_change":"2023-10-06T03:00:43.607454+0000","last_in_change":"2023-10-06T03:00:33.943513+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T03:00:44.360651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T03:00:50.466601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:02:37.240020+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-10-06T03:02:38.287494+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"58cf6c90-d704-43e0-b2db-dffe526d5e8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":33053},{"type":"v1","addr":"172.21.15.57:6801","nonce":33053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":33053},{"type":"v1","addr":"172.21.15.57:6803","nonce":33053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":33053},{"type":"v1","addr":"172.21.15.57:6807","nonce":33053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":33053},{"type":"v1","addr":"172.21.15.57:6805","nonce":33053}]},"public_addr":"172.21.15.57:6801/33053","cluster_addr":"172.21.15.57:6803/33053","heartbeat_back_addr":"172.21.15.57:6807/33053","heartbeat_front_addr":"172.21.15.57:6805/33053","state":["exists","up"]},{"osd":1,"uuid":"16afbe70-7f9e-4568-9c92-763e6e348119","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6809","nonce":33052},{"type":"v1","addr":"172.21.15.57:6810","nonce":33052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":33052},{"type":"v1","addr":"172.21.15.57:6813","nonce":33052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":33052},{"type":"v1","addr":"172.21.15.57:6822","nonce":33052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6815","nonce":33052},{"type":"v1","addr":"172.21.15.57:6818","nonce":33052}]},"public_addr":"172.21.15.57:6810/33052","cluster_addr":"172.21.15.57:6813/33052","heartbeat_back_addr":"172.21.15.57:6822/33052","heartbeat_front_addr":"172.21.15.57:6818/33052","state":["exists","up"]},{"osd":2,"uuid":"7255c62e-f92f-470f-a5ce-30228920d9f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":33058},{"type":"v1","addr":"172.21.15.57:6825","nonce":33058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":33058},{"type":"v1","addr":"172.21.15.57:6827","nonce":33058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":33058},{"type":"v1","addr":"172.21.15.57:6831","nonce":33058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":33058},{"type":"v1","addr":"172.21.15.57:6829","nonce":33058}]},"public_addr":"172.21.15.57:6825/33058","cluster_addr":"172.21.15.57:6827/33058","heartbeat_back_addr":"172.21.15.57:6831/33058","heartbeat_front_addr":"172.21.15.57:6829/33058","state":["exists","up"]},{"osd":3,"uuid":"152a236d-f799-4888-8544-74865508d5a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":33057},{"type":"v1","addr":"172.21.15.57:6811","nonce":33057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":33057},{"type":"v1","addr":"172.21.15.57:6816","nonce":33057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6821","nonce":33057},{"type":"v1","addr":"172.21.15.57:6823","nonce":33057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6817","nonce":33057},{"type":"v1","addr":"172.21.15.57:6819","nonce":33057}]},"public_addr":"172.21.15.57:6811/33057","cluster_addr":"172.21.15.57:6816/33057","heartbeat_back_addr":"172.21.15.57:6823/33057","heartbeat_front_addr":"172.21.15.57:6819/33057","state":["exists","up"]},{"osd":4,"uuid":"37db2a65-3566-41d0-9d60-e66c49e1e68e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":33368},{"type":"v1","addr":"172.21.15.105:6801","nonce":33368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":33368},{"type":"v1","addr":"172.21.15.105:6803","nonce":33368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":33368},{"type":"v1","addr":"172.21.15.105:6807","nonce":33368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":33368},{"type":"v1","addr":"172.21.15.105:6805","nonce":33368}]},"public_addr":"172.21.15.105:6801/33368","cluster_addr":"172.21.15.105:6803/33368","heartbeat_back_addr":"172.21.15.105:6807/33368","heartbeat_front_addr":"172.21.15.105:6805/33368","state":["exists","up"]},{"osd":5,"uuid":"35e77918-1bb4-42ca-9b20-f3c14eaa0c04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":33379},{"type":"v1","addr":"172.21.15.105:6818","nonce":33379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":33379},{"type":"v1","addr":"172.21.15.105:6823","nonce":33379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":33379},{"type":"v1","addr":"172.21.15.105:6831","nonce":33379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":33379},{"type":"v1","addr":"172.21.15.105:6827","nonce":33379}]},"public_addr":"172.21.15.105:6818/33379","cluster_addr":"172.21.15.105:6823/33379","heartbeat_back_addr":"172.21.15.105:6831/33379","heartbeat_front_addr":"172.21.15.105:6827/33379","state":["exists","up"]},{"osd":6,"uuid":"b4d9d510-7a45-4173-8287-c6c8d6547f2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":33369},{"type":"v1","addr":"172.21.15.105:6819","nonce":33369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":33369},{"type":"v1","addr":"172.21.15.105:6822","nonce":33369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":33369},{"type":"v1","addr":"172.21.15.105:6830","nonce":33369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":33369},{"type":"v1","addr":"172.21.15.105:6826","nonce":33369}]},"public_addr":"172.21.15.105:6819/33369","cluster_addr":"172.21.15.105:6822/33369","heartbeat_back_addr":"172.21.15.105:6830/33369","heartbeat_front_addr":"172.21.15.105:6826/33369","state":["exists","up"]},{"osd":7,"uuid":"74266fb0-cd84-463f-8bf0-092652a71dc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":33370},{"type":"v1","addr":"172.21.15.105:6809","nonce":33370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":33370},{"type":"v1","addr":"172.21.15.105:6811","nonce":33370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":33370},{"type":"v1","addr":"172.21.15.105:6815","nonce":33370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":33370},{"type":"v1","addr":"172.21.15.105:6813","nonce":33370}]},"public_addr":"172.21.15.105:6809/33370","cluster_addr":"172.21.15.105:6811/33370","heartbeat_back_addr":"172.21.15.105:6815/33370","heartbeat_front_addr":"172.21.15.105:6813/33370","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.596864+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.633851+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.636993+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.529681+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.608601+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.659752+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.661717+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.642221+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:02:43.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.694+0000 7f68f759e700 1 -- 172.21.15.57:0/3751312334 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f68d80605d0 msgr2=0x7f68d8062a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:43.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.694+0000 7f68f759e700 1 --2- 172.21.15.57:0/3751312334 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f68d80605d0 0x7f68d8062a80 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f68e80093f0 tx=0x7f68e8017000 comp rx=0 tx=0).stop 2023-10-06T03:02:43.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.694+0000 7f68f759e700 1 -- 172.21.15.57:0/3751312334 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f68f806d230 msgr2=0x7f68f816c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:43.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.694+0000 7f68f759e700 1 --2- 172.21.15.57:0/3751312334 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f68f806d230 0x7f68f816c230 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f68ec00ec80 tx=0x7f68ec0091a0 comp rx=0 tx=0).stop 2023-10-06T03:02:43.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.698+0000 7f68f759e700 1 -- 172.21.15.57:0/3751312334 shutdown_connections 2023-10-06T03:02:43.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.698+0000 7f68f759e700 1 --2- 172.21.15.57:0/3751312334 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f68f80aef00 0x7f68f816c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:43.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.698+0000 7f68f759e700 1 --2- 172.21.15.57:0/3751312334 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f68f806d230 0x7f68f816c230 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:43.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.698+0000 7f68f759e700 1 --2- 172.21.15.57:0/3751312334 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f68d80605d0 0x7f68d8062a80 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:43.704 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.698+0000 7f68f759e700 1 --2- 172.21.15.57:0/3751312334 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f68f806c920 0x7f68f8145ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:43.704 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.698+0000 7f68f759e700 1 -- 172.21.15.57:0/3751312334 >> 172.21.15.57:0/3751312334 conn(0x7f68f80c85e0 msgr2=0x7f68f80ca830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:43.704 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.698+0000 7f68f759e700 1 -- 172.21.15.57:0/3751312334 shutdown_connections 2023-10-06T03:02:43.704 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.698+0000 7f68f759e700 1 -- 172.21.15.57:0/3751312334 wait complete. 2023-10-06T03:02:43.724 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-06T03:02:43.724 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:02:43.887 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.882+0000 7fd3fa2e3700 1 Processor -- start 2023-10-06T03:02:43.888 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.882+0000 7fd3fa2e3700 1 -- start start 2023-10-06T03:02:43.891 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.886+0000 7fd3fa2e3700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd3f4158e90 0x7fd3f406dc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:43.891 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.886+0000 7fd3fa2e3700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd3f4067760 0x7fd3f40c1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:43.891 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.886+0000 7fd3fa2e3700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3f406d7f0 con 0x7fd3f4159260 2023-10-06T03:02:43.892 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.886+0000 7fd3fa2e3700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3f406cf00 con 0x7fd3f4158e90 2023-10-06T03:02:43.892 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.886+0000 7fd3fa2e3700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f40c1e10 con 0x7fd3f4067760 2023-10-06T03:02:43.892 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.886+0000 7fd3f92e1700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd3f4158e90 0x7fd3f406dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:43.895 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.886+0000 7fd3f92e1700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd3f4158e90 0x7fd3f406dc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:52672/0 (socket says 172.21.15.57:52672) 2023-10-06T03:02:43.895 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.886+0000 7fd3f92e1700 1 -- 172.21.15.57:0/2138611114 learned_addr learned my addr 172.21.15.57:0/2138611114 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:02:43.895 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.886+0000 7fd3f9ae2700 1 --2- 172.21.15.57:0/2138611114 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd3f4067760 0x7fd3f40c1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:43.896 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.886+0000 7fd3f92e1700 1 -- 172.21.15.57:0/2138611114 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd3f4067760 msgr2=0x7fd3f40c1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:43.896 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.886+0000 7fd3f92e1700 1 --2- 172.21.15.57:0/2138611114 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd3f4067760 0x7fd3f40c1100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:43.896 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.886+0000 7fd3f92e1700 1 -- 172.21.15.57:0/2138611114 >> v1:172.21.15.105:6789/0 conn(0x7fd3f4159260 legacy=0x7fd3f4067050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:43.896 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.886+0000 7fd3f92e1700 1 -- 172.21.15.57:0/2138611114 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3f406d1a0 con 0x7fd3f4158e90 2023-10-06T03:02:43.897 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.886+0000 7fd3f92e1700 1 --2- 172.21.15.57:0/2138611114 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3f4158e90 0x7fd3f406dc80 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fd3f00099b0 tx=0x7fd3f0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5d160de131b580b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:43.897 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.886+0000 7fd3ebfff700 1 -- 172.21.15.57:0/2138611114 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3f0009ea0 con 0x7fd3f4158e90 2023-10-06T03:02:43.897 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.890+0000 7fd3ebfff700 1 -- 172.21.15.57:0/2138611114 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3f000b860 con 0x7fd3f4158e90 2023-10-06T03:02:43.897 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.890+0000 7fd3ebfff700 1 -- 172.21.15.57:0/2138611114 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3f000bc00 con 0x7fd3f4158e90 2023-10-06T03:02:43.897 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.890+0000 7fd3fa2e3700 1 -- 172.21.15.57:0/2138611114 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3f4158e90 msgr2=0x7fd3f406dc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:43.897 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.890+0000 7fd3fa2e3700 1 --2- 172.21.15.57:0/2138611114 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3f4158e90 0x7fd3f406dc80 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fd3f00099b0 tx=0x7fd3f0009250 comp rx=0 tx=0).stop 2023-10-06T03:02:43.897 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.890+0000 7fd3fa2e3700 1 -- 172.21.15.57:0/2138611114 shutdown_connections 2023-10-06T03:02:43.897 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.890+0000 7fd3fa2e3700 1 --2- 172.21.15.57:0/2138611114 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd3f4067760 0x7fd3f40c1100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:43.897 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.890+0000 7fd3fa2e3700 1 --2- 172.21.15.57:0/2138611114 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3f4158e90 0x7fd3f406dc80 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:43.897 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.890+0000 7fd3fa2e3700 1 -- 172.21.15.57:0/2138611114 >> 172.21.15.57:0/2138611114 conn(0x7fd3f40cbb50 msgr2=0x7fd3f40cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:43.897 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.890+0000 7fd3fa2e3700 1 -- 172.21.15.57:0/2138611114 shutdown_connections 2023-10-06T03:02:43.897 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.890+0000 7fd3fa2e3700 1 -- 172.21.15.57:0/2138611114 wait complete. 2023-10-06T03:02:43.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.894+0000 7fd3fa2e3700 1 Processor -- start 2023-10-06T03:02:43.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.894+0000 7fd3fa2e3700 1 -- start start 2023-10-06T03:02:43.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.894+0000 7fd3fa2e3700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3f4067760 0x7fd3f414d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:43.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.894+0000 7fd3fa2e3700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd3f4158e90 0x7fd3f41502d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:43.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.894+0000 7fd3fa2e3700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd3f4159260 0x7fd3f40c73d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:43.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.894+0000 7fd3fa2e3700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f40af9d0 con 0x7fd3f4067760 2023-10-06T03:02:43.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.894+0000 7fd3fa2e3700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f40aedc0 con 0x7fd3f4159260 2023-10-06T03:02:43.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.894+0000 7fd3fa2e3700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f40af0a0 con 0x7fd3f4158e90 2023-10-06T03:02:43.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.894+0000 7fd3f92e1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3f4067760 0x7fd3f414d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:43.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.894+0000 7fd3f92e1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3f4067760 0x7fd3f414d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:52688/0 (socket says 172.21.15.57:52688) 2023-10-06T03:02:43.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.894+0000 7fd3f92e1700 1 -- 172.21.15.57:0/3242204469 learned_addr learned my addr 172.21.15.57:0/3242204469 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:02:43.902 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.894+0000 7fd3f8ae0700 1 --2- 172.21.15.57:0/3242204469 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd3f4158e90 0x7fd3f41502d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:43.902 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.894+0000 7fd3f9ae2700 1 --2- 172.21.15.57:0/3242204469 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd3f4159260 0x7fd3f40c73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:43.902 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.894+0000 7fd3f92e1700 1 -- 172.21.15.57:0/3242204469 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd3f4158e90 msgr2=0x7fd3f41502d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:43.903 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.894+0000 7fd3f92e1700 1 --2- 172.21.15.57:0/3242204469 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd3f4158e90 0x7fd3f41502d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:43.903 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.894+0000 7fd3f92e1700 1 -- 172.21.15.57:0/3242204469 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd3f4159260 msgr2=0x7fd3f40c73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:43.903 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.894+0000 7fd3f92e1700 1 --2- 172.21.15.57:0/3242204469 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd3f4159260 0x7fd3f40c73d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:43.903 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.894+0000 7fd3f92e1700 1 -- 172.21.15.57:0/3242204469 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3f00094f0 con 0x7fd3f4067760 2023-10-06T03:02:43.903 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.894+0000 7fd3f8ae0700 1 --2- 172.21.15.57:0/3242204469 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd3f4158e90 0x7fd3f41502d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:02:43.903 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.898+0000 7fd3f92e1700 1 --2- 172.21.15.57:0/3242204469 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3f4067760 0x7fd3f414d650 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fd3f40689e0 tx=0x7fd3f0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:43.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.902+0000 7fd3e97fa700 1 -- 172.21.15.57:0/3242204469 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3f000bbe0 con 0x7fd3f4067760 2023-10-06T03:02:43.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.902+0000 7fd3e97fa700 1 -- 172.21.15.57:0/3242204469 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3f0011420 con 0x7fd3f4067760 2023-10-06T03:02:43.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.902+0000 7fd3e97fa700 1 -- 172.21.15.57:0/3242204469 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3f00117c0 con 0x7fd3f4067760 2023-10-06T03:02:43.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.902+0000 7fd3fa2e3700 1 -- 172.21.15.57:0/3242204469 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3f40af380 con 0x7fd3f4067760 2023-10-06T03:02:43.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.902+0000 7fd3fa2e3700 1 -- 172.21.15.57:0/3242204469 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3f414db90 con 0x7fd3f4067760 2023-10-06T03:02:43.909 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.902+0000 7fd3fa2e3700 1 -- 172.21.15.57:0/3242204469 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3f404be40 con 0x7fd3f4067760 2023-10-06T03:02:43.911 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.906+0000 7fd3e97fa700 1 -- 172.21.15.57:0/3242204469 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fd3f0011bf0 con 0x7fd3f4067760 2023-10-06T03:02:43.912 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.906+0000 7fd3e97fa700 1 --2- 172.21.15.57:0/3242204469 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fd3d8060550 0x7fd3d8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:43.912 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.906+0000 7fd3e97fa700 1 -- 172.21.15.57:0/3242204469 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd3f007e230 con 0x7fd3f4067760 2023-10-06T03:02:43.913 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.906+0000 7fd3f8ae0700 1 --2- 172.21.15.57:0/3242204469 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fd3d8060550 0x7fd3d8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:43.914 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.906+0000 7fd3f8ae0700 1 --2- 172.21.15.57:0/3242204469 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fd3d8060550 0x7fd3d8062a00 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fd3e4007fd0 tx=0x7fd3e4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:43.918 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:43.914+0000 7fd3e97fa700 1 -- 172.21.15.57:0/3242204469 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fd3f004e620 con 0x7fd3f4067760 2023-10-06T03:02:44.087 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.082+0000 7fd3fa2e3700 1 -- 172.21.15.57:0/3242204469 --> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd3f40afb10 con 0x7fd3d8060550 2023-10-06T03:02:44.100 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.094+0000 7fd3e97fa700 1 -- 172.21.15.57:0/3242204469 <== mgr.4103 v2:172.21.15.57:6832/32947 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+305875 (secure 0 0 0) 0x7fd3e4001d20 con 0x7fd3d8060550 2023-10-06T03:02:44.105 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:02:44.109 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.102+0000 7fd3fa2e3700 1 -- 172.21.15.57:0/3242204469 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fd3d8060550 msgr2=0x7fd3d8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:44.109 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.102+0000 7fd3fa2e3700 1 --2- 172.21.15.57:0/3242204469 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fd3d8060550 0x7fd3d8062a00 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fd3e4007fd0 tx=0x7fd3e4009040 comp rx=0 tx=0).stop 2023-10-06T03:02:44.109 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.102+0000 7fd3fa2e3700 1 -- 172.21.15.57:0/3242204469 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3f4067760 msgr2=0x7fd3f414d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:44.109 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.102+0000 7fd3fa2e3700 1 --2- 172.21.15.57:0/3242204469 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3f4067760 0x7fd3f414d650 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fd3f40689e0 tx=0x7fd3f0017000 comp rx=0 tx=0).stop 2023-10-06T03:02:44.109 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.102+0000 7fd3fa2e3700 1 -- 172.21.15.57:0/3242204469 shutdown_connections 2023-10-06T03:02:44.109 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.102+0000 7fd3fa2e3700 1 --2- 172.21.15.57:0/3242204469 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd3f4159260 0x7fd3f40c73d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:44.109 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.102+0000 7fd3fa2e3700 1 --2- 172.21.15.57:0/3242204469 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fd3d8060550 0x7fd3d8062a00 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:44.109 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.102+0000 7fd3fa2e3700 1 --2- 172.21.15.57:0/3242204469 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd3f4158e90 0x7fd3f41502d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:44.109 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.102+0000 7fd3fa2e3700 1 --2- 172.21.15.57:0/3242204469 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3f4067760 0x7fd3f414d650 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:44.110 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.102+0000 7fd3fa2e3700 1 -- 172.21.15.57:0/3242204469 >> 172.21.15.57:0/3242204469 conn(0x7fd3f40cbb50 msgr2=0x7fd3f406b460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:44.110 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.102+0000 7fd3fa2e3700 1 -- 172.21.15.57:0/3242204469 shutdown_connections 2023-10-06T03:02:44.110 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.102+0000 7fd3fa2e3700 1 -- 172.21.15.57:0/3242204469 wait complete. 2023-10-06T03:02:44.111 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2023-10-06T03:02:44.128 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":102,"stamp":"2023-10-06T03:02:42.305349+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":67,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2404312,"kb_used_data":5528,"kb_used_omap":0,"kb_used_meta":2398720,"kb_avail":752570408,"statfs":{"total":773094113280,"available":770632097792,"internally_reserved":0,"allocated":5660672,"data_stored":3089840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2456289280},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.481300"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.845590+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:29:10.864990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.845802+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:27:35.234159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.851319+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:29:30.158378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.847718+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:18.879270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.841376+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:06:26.036575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.847453+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:23:18.217898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.854346+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:53:57.831764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.862103+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:17:48.382984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.862874+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:28:01.768786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.845785+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:06:26.036575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.841036+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:44:39.912786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.864917+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:17:46.359437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.846156+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:58:26.925821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.851625+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:41:45.880609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.845061+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:06:26.036575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.844877+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:58:03.418004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.853710+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:40:05.112188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.845091+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:58:26.925821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.850808+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:47:29.067808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.847201+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:02:36.798629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.847460+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:16:22.934040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.860493+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:18.879270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.841921+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:02:36.798629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.849036+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:27:35.234159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.851108+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:17:48.382984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.865759+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:40:05.112188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.843612+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:37:35.950737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.846351+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:43:59.979418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.850023+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:46:40.611565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.846537+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:12:14.521260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.853140+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:17:46.359437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.851907+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:17:48.382984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.845465+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:03:37.092106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.856515+0000","last_change":"2023-10-06T03:02:38.856515+0000","last_active":"2023-10-06T03:02:38.856515+0000","last_peered":"2023-10-06T03:02:38.856515+0000","last_clean":"2023-10-06T03:02:38.856515+0000","last_became_active":"2023-10-06T03:02:38.856154+0000","last_became_peered":"2023-10-06T03:02:38.856154+0000","last_unstale":"2023-10-06T03:02:38.856515+0000","last_undegraded":"2023-10-06T03:02:38.856515+0000","last_fullsized":"2023-10-06T03:02:38.856515+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:31:46.112896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.849055+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:12:14.521260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.870422+0000","last_change":"2023-10-06T03:02:38.870422+0000","last_active":"2023-10-06T03:02:38.870422+0000","last_peered":"2023-10-06T03:02:38.870422+0000","last_clean":"2023-10-06T03:02:38.870422+0000","last_became_active":"2023-10-06T03:02:38.869951+0000","last_became_peered":"2023-10-06T03:02:38.869951+0000","last_unstale":"2023-10-06T03:02:38.870422+0000","last_undegraded":"2023-10-06T03:02:38.870422+0000","last_fullsized":"2023-10-06T03:02:38.870422+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:01:14.978500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.846743+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:44:39.912786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.858140+0000","last_change":"2023-10-06T03:02:38.858140+0000","last_active":"2023-10-06T03:02:38.858140+0000","last_peered":"2023-10-06T03:02:38.858140+0000","last_clean":"2023-10-06T03:02:38.858140+0000","last_became_active":"2023-10-06T03:02:38.857805+0000","last_became_peered":"2023-10-06T03:02:38.857805+0000","last_unstale":"2023-10-06T03:02:38.858140+0000","last_undegraded":"2023-10-06T03:02:38.858140+0000","last_fullsized":"2023-10-06T03:02:38.858140+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:14:55.765174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.861373+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:46:40.611565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.873915+0000","last_change":"2023-10-06T03:02:38.873915+0000","last_active":"2023-10-06T03:02:38.873915+0000","last_peered":"2023-10-06T03:02:38.873915+0000","last_clean":"2023-10-06T03:02:38.873915+0000","last_became_active":"2023-10-06T03:02:38.873404+0000","last_became_peered":"2023-10-06T03:02:38.873404+0000","last_unstale":"2023-10-06T03:02:38.873915+0000","last_undegraded":"2023-10-06T03:02:38.873915+0000","last_fullsized":"2023-10-06T03:02:38.873915+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:58:25.908183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.840383+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:14:47.594861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.857653+0000","last_change":"2023-10-06T03:02:38.857653+0000","last_active":"2023-10-06T03:02:38.857653+0000","last_peered":"2023-10-06T03:02:38.857653+0000","last_clean":"2023-10-06T03:02:38.857653+0000","last_became_active":"2023-10-06T03:02:38.857368+0000","last_became_peered":"2023-10-06T03:02:38.857368+0000","last_unstale":"2023-10-06T03:02:38.857653+0000","last_undegraded":"2023-10-06T03:02:38.857653+0000","last_fullsized":"2023-10-06T03:02:38.857653+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:04:38.128587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.848288+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:39:42.661414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.854422+0000","last_change":"2023-10-06T03:02:38.854422+0000","last_active":"2023-10-06T03:02:38.854422+0000","last_peered":"2023-10-06T03:02:38.854422+0000","last_clean":"2023-10-06T03:02:38.854422+0000","last_became_active":"2023-10-06T03:02:38.854088+0000","last_became_peered":"2023-10-06T03:02:38.854088+0000","last_unstale":"2023-10-06T03:02:38.854422+0000","last_undegraded":"2023-10-06T03:02:38.854422+0000","last_fullsized":"2023-10-06T03:02:38.854422+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:41:45.591282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.864711+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:12:14.521260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.858755+0000","last_change":"2023-10-06T03:02:38.858755+0000","last_active":"2023-10-06T03:02:38.858755+0000","last_peered":"2023-10-06T03:02:38.858755+0000","last_clean":"2023-10-06T03:02:38.858755+0000","last_became_active":"2023-10-06T03:02:38.858405+0000","last_became_peered":"2023-10-06T03:02:38.858405+0000","last_unstale":"2023-10-06T03:02:38.858755+0000","last_undegraded":"2023-10-06T03:02:38.858755+0000","last_fullsized":"2023-10-06T03:02:38.858755+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:59:48.860090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.845190+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:23:18.217898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.863407+0000","last_change":"2023-10-06T03:02:38.863407+0000","last_active":"2023-10-06T03:02:38.863407+0000","last_peered":"2023-10-06T03:02:38.863407+0000","last_clean":"2023-10-06T03:02:38.863407+0000","last_became_active":"2023-10-06T03:02:38.863081+0000","last_became_peered":"2023-10-06T03:02:38.863081+0000","last_unstale":"2023-10-06T03:02:38.863407+0000","last_undegraded":"2023-10-06T03:02:38.863407+0000","last_fullsized":"2023-10-06T03:02:38.863407+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:58:02.400366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.840362+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:04:39.146225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.860246+0000","last_change":"2023-10-06T03:02:38.860246+0000","last_active":"2023-10-06T03:02:38.860246+0000","last_peered":"2023-10-06T03:02:38.860246+0000","last_clean":"2023-10-06T03:02:38.860246+0000","last_became_active":"2023-10-06T03:02:38.859969+0000","last_became_peered":"2023-10-06T03:02:38.859969+0000","last_unstale":"2023-10-06T03:02:38.860246+0000","last_undegraded":"2023-10-06T03:02:38.860246+0000","last_fullsized":"2023-10-06T03:02:38.860246+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:16:59.767516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.850848+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:46:40.611565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.869322+0000","last_change":"2023-10-06T03:02:38.869322+0000","last_active":"2023-10-06T03:02:38.869322+0000","last_peered":"2023-10-06T03:02:38.869322+0000","last_clean":"2023-10-06T03:02:38.869322+0000","last_became_active":"2023-10-06T03:02:38.868958+0000","last_became_peered":"2023-10-06T03:02:38.868958+0000","last_unstale":"2023-10-06T03:02:38.869322+0000","last_undegraded":"2023-10-06T03:02:38.869322+0000","last_fullsized":"2023-10-06T03:02:38.869322+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:18:12.245614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.851092+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:28:01.768786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.861193+0000","last_change":"2023-10-06T03:02:38.861193+0000","last_active":"2023-10-06T03:02:38.861193+0000","last_peered":"2023-10-06T03:02:38.861193+0000","last_clean":"2023-10-06T03:02:38.861193+0000","last_became_active":"2023-10-06T03:02:38.860904+0000","last_became_peered":"2023-10-06T03:02:38.860904+0000","last_unstale":"2023-10-06T03:02:38.861193+0000","last_undegraded":"2023-10-06T03:02:38.861193+0000","last_fullsized":"2023-10-06T03:02:38.861193+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:04:38.128587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.840714+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:58:03.418004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.871902+0000","last_change":"2023-10-06T03:02:38.871902+0000","last_active":"2023-10-06T03:02:38.871902+0000","last_peered":"2023-10-06T03:02:38.871902+0000","last_clean":"2023-10-06T03:02:38.871902+0000","last_became_active":"2023-10-06T03:02:38.871585+0000","last_became_peered":"2023-10-06T03:02:38.871585+0000","last_unstale":"2023-10-06T03:02:38.871902+0000","last_undegraded":"2023-10-06T03:02:38.871902+0000","last_fullsized":"2023-10-06T03:02:38.871902+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:29:09.847352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.851097+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:47:29.067808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.863229+0000","last_change":"2023-10-06T03:02:38.863229+0000","last_active":"2023-10-06T03:02:38.863229+0000","last_peered":"2023-10-06T03:02:38.863229+0000","last_clean":"2023-10-06T03:02:38.863229+0000","last_became_active":"2023-10-06T03:02:38.862751+0000","last_became_peered":"2023-10-06T03:02:38.862751+0000","last_unstale":"2023-10-06T03:02:38.863229+0000","last_undegraded":"2023-10-06T03:02:38.863229+0000","last_fullsized":"2023-10-06T03:02:38.863229+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:41:45.591282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.850206+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:12:14.521260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.864366+0000","last_change":"2023-10-06T03:02:38.864366+0000","last_active":"2023-10-06T03:02:38.864366+0000","last_peered":"2023-10-06T03:02:38.864366+0000","last_clean":"2023-10-06T03:02:38.864366+0000","last_became_active":"2023-10-06T03:02:38.864042+0000","last_became_peered":"2023-10-06T03:02:38.864042+0000","last_unstale":"2023-10-06T03:02:38.864366+0000","last_undegraded":"2023-10-06T03:02:38.864366+0000","last_fullsized":"2023-10-06T03:02:38.864366+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:14:45.231794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.865305+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:08:51.831968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.858014+0000","last_change":"2023-10-06T03:02:38.858014+0000","last_active":"2023-10-06T03:02:38.858014+0000","last_peered":"2023-10-06T03:02:38.858014+0000","last_clean":"2023-10-06T03:02:38.858014+0000","last_became_active":"2023-10-06T03:02:38.857708+0000","last_became_peered":"2023-10-06T03:02:38.857708+0000","last_unstale":"2023-10-06T03:02:38.858014+0000","last_undegraded":"2023-10-06T03:02:38.858014+0000","last_fullsized":"2023-10-06T03:02:38.858014+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:37:34.933099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.855648+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:19:46.946130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.872336+0000","last_change":"2023-10-06T03:02:38.872336+0000","last_active":"2023-10-06T03:02:38.872336+0000","last_peered":"2023-10-06T03:02:38.872336+0000","last_clean":"2023-10-06T03:02:38.872336+0000","last_became_active":"2023-10-06T03:02:38.871712+0000","last_became_peered":"2023-10-06T03:02:38.871712+0000","last_unstale":"2023-10-06T03:02:38.872336+0000","last_undegraded":"2023-10-06T03:02:38.872336+0000","last_fullsized":"2023-10-06T03:02:38.872336+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:06:25.018937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.861542+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:47:29.067808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.876423+0000","last_change":"2023-10-06T03:02:38.876423+0000","last_active":"2023-10-06T03:02:38.876423+0000","last_peered":"2023-10-06T03:02:38.876423+0000","last_clean":"2023-10-06T03:02:38.876423+0000","last_became_active":"2023-10-06T03:02:38.876118+0000","last_became_peered":"2023-10-06T03:02:38.876118+0000","last_unstale":"2023-10-06T03:02:38.876423+0000","last_undegraded":"2023-10-06T03:02:38.876423+0000","last_fullsized":"2023-10-06T03:02:38.876423+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:58:25.908183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.843494+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:17:00.785154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.861028+0000","last_change":"2023-10-06T03:02:38.861028+0000","last_active":"2023-10-06T03:02:38.861028+0000","last_peered":"2023-10-06T03:02:38.861028+0000","last_clean":"2023-10-06T03:02:38.861028+0000","last_became_active":"2023-10-06T03:02:38.859084+0000","last_became_peered":"2023-10-06T03:02:38.859084+0000","last_unstale":"2023-10-06T03:02:38.861028+0000","last_undegraded":"2023-10-06T03:02:38.861028+0000","last_fullsized":"2023-10-06T03:02:38.861028+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:37:03.894863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.840919+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:29:10.864990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.861356+0000","last_change":"2023-10-06T03:02:38.861356+0000","last_active":"2023-10-06T03:02:38.861356+0000","last_peered":"2023-10-06T03:02:38.861356+0000","last_clean":"2023-10-06T03:02:38.861356+0000","last_became_active":"2023-10-06T03:02:38.861051+0000","last_became_peered":"2023-10-06T03:02:38.861051+0000","last_unstale":"2023-10-06T03:02:38.861356+0000","last_undegraded":"2023-10-06T03:02:38.861356+0000","last_fullsized":"2023-10-06T03:02:38.861356+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:51:34.107940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.843354+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:18:13.263253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.873865+0000","last_change":"2023-10-06T03:02:38.873865+0000","last_active":"2023-10-06T03:02:38.873865+0000","last_peered":"2023-10-06T03:02:38.873865+0000","last_clean":"2023-10-06T03:02:38.873865+0000","last_became_active":"2023-10-06T03:02:38.873448+0000","last_became_peered":"2023-10-06T03:02:38.873448+0000","last_unstale":"2023-10-06T03:02:38.873865+0000","last_undegraded":"2023-10-06T03:02:38.873865+0000","last_fullsized":"2023-10-06T03:02:38.873865+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:01:19.591702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.850589+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:39:42.661414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.861807+0000","last_change":"2023-10-06T03:02:38.861807+0000","last_active":"2023-10-06T03:02:38.861807+0000","last_peered":"2023-10-06T03:02:38.861807+0000","last_clean":"2023-10-06T03:02:38.861807+0000","last_became_active":"2023-10-06T03:02:38.861513+0000","last_became_peered":"2023-10-06T03:02:38.861513+0000","last_unstale":"2023-10-06T03:02:38.861807+0000","last_undegraded":"2023-10-06T03:02:38.861807+0000","last_fullsized":"2023-10-06T03:02:38.861807+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:56:07.918211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.852214+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:18:27.259723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.872303+0000","last_change":"2023-10-06T03:02:38.872303+0000","last_active":"2023-10-06T03:02:38.872303+0000","last_peered":"2023-10-06T03:02:38.872303+0000","last_clean":"2023-10-06T03:02:38.872303+0000","last_became_active":"2023-10-06T03:02:38.871590+0000","last_became_peered":"2023-10-06T03:02:38.871590+0000","last_unstale":"2023-10-06T03:02:38.872303+0000","last_undegraded":"2023-10-06T03:02:38.872303+0000","last_fullsized":"2023-10-06T03:02:38.872303+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:58:02.400366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.849827+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:39:42.661414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.867297+0000","last_change":"2023-10-06T03:02:38.867297+0000","last_active":"2023-10-06T03:02:38.867297+0000","last_peered":"2023-10-06T03:02:38.867297+0000","last_clean":"2023-10-06T03:02:38.867297+0000","last_became_active":"2023-10-06T03:02:38.866855+0000","last_became_peered":"2023-10-06T03:02:38.866855+0000","last_unstale":"2023-10-06T03:02:38.867297+0000","last_undegraded":"2023-10-06T03:02:38.867297+0000","last_fullsized":"2023-10-06T03:02:38.867297+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:29:09.847352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.844058+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:14:47.594861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.860777+0000","last_change":"2023-10-06T03:02:38.860777+0000","last_active":"2023-10-06T03:02:38.860777+0000","last_peered":"2023-10-06T03:02:38.860777+0000","last_clean":"2023-10-06T03:02:38.860777+0000","last_became_active":"2023-10-06T03:02:38.858664+0000","last_became_peered":"2023-10-06T03:02:38.858664+0000","last_unstale":"2023-10-06T03:02:38.860777+0000","last_undegraded":"2023-10-06T03:02:38.860777+0000","last_fullsized":"2023-10-06T03:02:38.860777+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:47:47.993117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.849391+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:48:50.971382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.867362+0000","last_change":"2023-10-06T03:02:38.867362+0000","last_active":"2023-10-06T03:02:38.867362+0000","last_peered":"2023-10-06T03:02:38.867362+0000","last_clean":"2023-10-06T03:02:38.867362+0000","last_became_active":"2023-10-06T03:02:38.863794+0000","last_became_peered":"2023-10-06T03:02:38.863794+0000","last_unstale":"2023-10-06T03:02:38.867362+0000","last_undegraded":"2023-10-06T03:02:38.867362+0000","last_fullsized":"2023-10-06T03:02:38.867362+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:06:25.018937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":185,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T03:02:37.828500+0000","last_change":"2023-10-06T03:00:45.709165+0000","last_active":"2023-10-06T03:02:37.828500+0000","last_peered":"2023-10-06T03:02:37.828500+0000","last_clean":"2023-10-06T03:02:37.828500+0000","last_became_active":"2023-10-06T03:00:45.707771+0000","last_became_peered":"2023-10-06T03:00:45.707771+0000","last_unstale":"2023-10-06T03:02:37.828500+0000","last_undegraded":"2023-10-06T03:02:37.828500+0000","last_fullsized":"2023-10-06T03:02:37.828500+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:44.625353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:44.625353+0000","last_clean_scrub_stamp":"2023-10-06T03:00:44.625353+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:31:31.774239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":31,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T03:02:37.831669+0000","last_change":"2023-10-06T03:00:51.905381+0000","last_active":"2023-10-06T03:02:37.831669+0000","last_peered":"2023-10-06T03:02:37.831669+0000","last_clean":"2023-10-06T03:02:37.831669+0000","last_became_active":"2023-10-06T03:00:51.904974+0000","last_became_peered":"2023-10-06T03:00:51.904974+0000","last_unstale":"2023-10-06T03:02:37.831669+0000","last_undegraded":"2023-10-06T03:02:37.831669+0000","last_fullsized":"2023-10-06T03:02:37.831669+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:15:19.182956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.843912+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:04:39.146225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.858174+0000","last_change":"2023-10-06T03:02:38.858174+0000","last_active":"2023-10-06T03:02:38.858174+0000","last_peered":"2023-10-06T03:02:38.858174+0000","last_clean":"2023-10-06T03:02:38.858174+0000","last_became_active":"2023-10-06T03:02:38.857843+0000","last_became_peered":"2023-10-06T03:02:38.857843+0000","last_unstale":"2023-10-06T03:02:38.858174+0000","last_undegraded":"2023-10-06T03:02:38.858174+0000","last_fullsized":"2023-10-06T03:02:38.858174+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:14:46.577223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":32,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T03:02:37.828379+0000","last_change":"2023-10-06T03:00:51.906480+0000","last_active":"2023-10-06T03:02:37.828379+0000","last_peered":"2023-10-06T03:02:37.828379+0000","last_clean":"2023-10-06T03:02:37.828379+0000","last_became_active":"2023-10-06T03:00:51.905956+0000","last_became_peered":"2023-10-06T03:00:51.905956+0000","last_unstale":"2023-10-06T03:02:37.828379+0000","last_undegraded":"2023-10-06T03:02:37.828379+0000","last_fullsized":"2023-10-06T03:02:37.828379+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:15:19.182956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.860881+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:39:42.661414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.857592+0000","last_change":"2023-10-06T03:02:38.857592+0000","last_active":"2023-10-06T03:02:38.857592+0000","last_peered":"2023-10-06T03:02:38.857592+0000","last_clean":"2023-10-06T03:02:38.857592+0000","last_became_active":"2023-10-06T03:02:38.857248+0000","last_became_peered":"2023-10-06T03:02:38.857248+0000","last_unstale":"2023-10-06T03:02:38.857592+0000","last_undegraded":"2023-10-06T03:02:38.857592+0000","last_fullsized":"2023-10-06T03:02:38.857592+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:14:46.577223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":32,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T03:02:37.831975+0000","last_change":"2023-10-06T03:00:51.902453+0000","last_active":"2023-10-06T03:02:37.831975+0000","last_peered":"2023-10-06T03:02:37.831975+0000","last_clean":"2023-10-06T03:02:37.831975+0000","last_became_active":"2023-10-06T03:00:51.901948+0000","last_became_peered":"2023-10-06T03:00:51.901948+0000","last_unstale":"2023-10-06T03:02:37.831975+0000","last_undegraded":"2023-10-06T03:02:37.831975+0000","last_fullsized":"2023-10-06T03:02:37.831975+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:13:30.721650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.849375+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:27:35.234159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.864320+0000","last_change":"2023-10-06T03:02:38.864320+0000","last_active":"2023-10-06T03:02:38.864320+0000","last_peered":"2023-10-06T03:02:38.864320+0000","last_clean":"2023-10-06T03:02:38.864320+0000","last_became_active":"2023-10-06T03:02:38.864020+0000","last_became_peered":"2023-10-06T03:02:38.864020+0000","last_unstale":"2023-10-06T03:02:38.864320+0000","last_undegraded":"2023-10-06T03:02:38.864320+0000","last_fullsized":"2023-10-06T03:02:38.864320+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:37:03.894863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":31,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T03:02:37.831524+0000","last_change":"2023-10-06T03:00:51.904148+0000","last_active":"2023-10-06T03:02:37.831524+0000","last_peered":"2023-10-06T03:02:37.831524+0000","last_clean":"2023-10-06T03:02:37.831524+0000","last_became_active":"2023-10-06T03:00:51.903729+0000","last_became_peered":"2023-10-06T03:00:51.903729+0000","last_unstale":"2023-10-06T03:02:37.831524+0000","last_undegraded":"2023-10-06T03:02:37.831524+0000","last_fullsized":"2023-10-06T03:02:37.831524+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:17:25.070478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.852876+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:08:51.831968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.867268+0000","last_change":"2023-10-06T03:02:38.867268+0000","last_active":"2023-10-06T03:02:38.867268+0000","last_peered":"2023-10-06T03:02:38.867268+0000","last_clean":"2023-10-06T03:02:38.867268+0000","last_became_active":"2023-10-06T03:02:38.867007+0000","last_became_peered":"2023-10-06T03:02:38.867007+0000","last_unstale":"2023-10-06T03:02:38.867268+0000","last_undegraded":"2023-10-06T03:02:38.867268+0000","last_fullsized":"2023-10-06T03:02:38.867268+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:56:07.918211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":29,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T03:02:37.832579+0000","last_change":"2023-10-06T03:00:52.484317+0000","last_active":"2023-10-06T03:02:37.832579+0000","last_peered":"2023-10-06T03:02:37.832579+0000","last_clean":"2023-10-06T03:02:37.832579+0000","last_became_active":"2023-10-06T03:00:52.483818+0000","last_became_peered":"2023-10-06T03:00:52.483818+0000","last_unstale":"2023-10-06T03:02:37.832579+0000","last_undegraded":"2023-10-06T03:02:37.832579+0000","last_fullsized":"2023-10-06T03:02:37.832579+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:17:24.136459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.859205+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:27:35.234159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.861581+0000","last_change":"2023-10-06T03:02:38.861581+0000","last_active":"2023-10-06T03:02:38.861581+0000","last_peered":"2023-10-06T03:02:38.861581+0000","last_clean":"2023-10-06T03:02:38.861581+0000","last_became_active":"2023-10-06T03:02:38.861190+0000","last_became_peered":"2023-10-06T03:02:38.861190+0000","last_unstale":"2023-10-06T03:02:38.861581+0000","last_undegraded":"2023-10-06T03:02:38.861581+0000","last_fullsized":"2023-10-06T03:02:38.861581+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:23:17.200260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":32,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T03:02:37.829601+0000","last_change":"2023-10-06T03:00:52.485186+0000","last_active":"2023-10-06T03:02:37.829601+0000","last_peered":"2023-10-06T03:02:37.829601+0000","last_clean":"2023-10-06T03:02:37.829601+0000","last_became_active":"2023-10-06T03:00:52.484615+0000","last_became_peered":"2023-10-06T03:00:52.484615+0000","last_unstale":"2023-10-06T03:02:37.829601+0000","last_undegraded":"2023-10-06T03:02:37.829601+0000","last_fullsized":"2023-10-06T03:02:37.829601+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:17:25.070478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.849461+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:18.879270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.872801+0000","last_change":"2023-10-06T03:02:38.872801+0000","last_active":"2023-10-06T03:02:38.872801+0000","last_peered":"2023-10-06T03:02:38.872801+0000","last_clean":"2023-10-06T03:02:38.872801+0000","last_became_active":"2023-10-06T03:02:38.872498+0000","last_became_peered":"2023-10-06T03:02:38.872498+0000","last_unstale":"2023-10-06T03:02:38.872801+0000","last_undegraded":"2023-10-06T03:02:38.872801+0000","last_fullsized":"2023-10-06T03:02:38.872801+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:58:25.908183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":29,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T03:02:37.833264+0000","last_change":"2023-10-06T03:00:51.903388+0000","last_active":"2023-10-06T03:02:37.833264+0000","last_peered":"2023-10-06T03:02:37.833264+0000","last_clean":"2023-10-06T03:02:37.833264+0000","last_became_active":"2023-10-06T03:00:51.902959+0000","last_became_peered":"2023-10-06T03:00:51.902959+0000","last_unstale":"2023-10-06T03:02:37.833264+0000","last_undegraded":"2023-10-06T03:02:37.833264+0000","last_fullsized":"2023-10-06T03:02:37.833264+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:30:16.907470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.849170+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:18.879270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.872473+0000","last_change":"2023-10-06T03:02:38.872473+0000","last_active":"2023-10-06T03:02:38.872473+0000","last_peered":"2023-10-06T03:02:38.872473+0000","last_clean":"2023-10-06T03:02:38.872473+0000","last_became_active":"2023-10-06T03:02:38.871994+0000","last_became_peered":"2023-10-06T03:02:38.871994+0000","last_unstale":"2023-10-06T03:02:38.872473+0000","last_undegraded":"2023-10-06T03:02:38.872473+0000","last_fullsized":"2023-10-06T03:02:38.872473+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:23:17.200260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":31,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T03:02:37.833840+0000","last_change":"2023-10-06T03:00:51.903242+0000","last_active":"2023-10-06T03:02:37.833840+0000","last_peered":"2023-10-06T03:02:37.833840+0000","last_clean":"2023-10-06T03:02:37.833840+0000","last_became_active":"2023-10-06T03:00:51.902929+0000","last_became_peered":"2023-10-06T03:00:51.902929+0000","last_unstale":"2023-10-06T03:02:37.833840+0000","last_undegraded":"2023-10-06T03:02:37.833840+0000","last_fullsized":"2023-10-06T03:02:37.833840+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:34:12.274158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574874,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302504,"kb_used_data":1120,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069336,"statfs":{"total":96636764160,"available":96327000064,"internally_reserved":0,"allocated":1146880,"data_stored":825698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"min":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":4.7930000000000001,"5min":4.7930000000000001,"15min":4.7930000000000001},"last":0.89000000000000001},{"interface":"front","average":{"1min":1.5780000000000001,"5min":1.5780000000000001,"15min":1.5780000000000001},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":9.9689999999999994,"5min":9.9689999999999994,"15min":9.9689999999999994},"last":0.92700000000000005}]},{"osd":1,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":10.867000000000001,"5min":10.867000000000001,"15min":10.867000000000001},"last":1.2450000000000001},{"interface":"front","average":{"1min":1.6779999999999999,"5min":1.6779999999999999,"15min":1.6779999999999999},"min":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":10.255000000000001,"5min":10.255000000000001,"15min":10.255000000000001},"last":1.3580000000000001}]},{"osd":2,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.6799999999999999,"5min":1.6799999999999999,"15min":1.6799999999999999},"min":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"max":{"1min":7.9939999999999998,"5min":7.9939999999999998,"15min":7.9939999999999998},"last":1.391},{"interface":"front","average":{"1min":1.6970000000000001,"5min":1.6970000000000001,"15min":1.6970000000000001},"min":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"max":{"1min":10.098000000000001,"5min":10.098000000000001,"15min":10.098000000000001},"last":1.421}]},{"osd":3,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"min":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"max":{"1min":4.3090000000000002,"5min":4.3090000000000002,"15min":4.3090000000000002},"last":1.167},{"interface":"front","average":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"min":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":8.3770000000000007,"5min":8.3770000000000007,"15min":8.3770000000000007},"last":1.04}]},{"osd":4,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.7889999999999999,"5min":1.7889999999999999,"15min":1.7889999999999999},"min":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"max":{"1min":11.391999999999999,"5min":11.391999999999999,"15min":11.391999999999999},"last":1.21},{"interface":"front","average":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"min":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"max":{"1min":3.9220000000000002,"5min":3.9220000000000002,"15min":3.9220000000000002},"last":1.4730000000000001}]},{"osd":5,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.796,"5min":1.796,"15min":1.796},"min":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"max":{"1min":11.951000000000001,"5min":11.951000000000001,"15min":11.951000000000001},"last":1.323},{"interface":"front","average":{"1min":1.9259999999999999,"5min":1.9259999999999999,"15min":1.9259999999999999},"min":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"max":{"1min":10.994999999999999,"5min":10.994999999999999,"15min":10.994999999999999},"last":1.109}]},{"osd":6,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.9890000000000001,"5min":1.9890000000000001,"15min":1.9890000000000001},"min":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"max":{"1min":11.513,"5min":11.513,"15min":11.513},"last":1.444},{"interface":"front","average":{"1min":1.958,"5min":1.958,"15min":1.958},"min":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"max":{"1min":10.714,"5min":10.714,"15min":10.714},"last":1.286}]}]},{"osd":6,"up_from":13,"seq":55834574874,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297840,"kb_used_data":552,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074000,"statfs":{"total":96636764160,"available":96331776000,"internally_reserved":0,"allocated":565248,"data_stored":241946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":0.79900000000000004},{"interface":"front","average":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":2.1419999999999999,"5min":2.1419999999999999,"15min":2.1419999999999999},"last":0.99299999999999999}]},{"osd":1,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"min":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"max":{"1min":1.9159999999999999,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":0.93899999999999995},{"interface":"front","average":{"1min":1.256,"5min":1.256,"15min":1.256},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":1.677,"5min":1.677,"15min":1.677},"last":0.90200000000000002}]},{"osd":2,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.167,"15min":1.167},"min":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":1.659,"5min":1.659,"15min":1.659},"last":0.83699999999999997},{"interface":"front","average":{"1min":1.236,"5min":1.236,"15min":1.236},"min":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"max":{"1min":1.78,"5min":1.78,"15min":1.78},"last":0.86899999999999999}]},{"osd":3,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.284,"5min":1.284,"15min":1.284},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":0.75900000000000001},{"interface":"front","average":{"1min":1.343,"5min":1.343,"15min":1.343},"min":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":2.2200000000000002,"5min":2.2200000000000002,"15min":2.2200000000000002},"last":0.72199999999999998}]},{"osd":4,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.286,"5min":1.286,"15min":1.286},"min":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"max":{"1min":1.889,"5min":1.889,"15min":1.889},"last":0.69999999999999996},{"interface":"front","average":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"min":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":2.2610000000000001,"5min":2.2610000000000001,"15min":2.2610000000000001},"last":0.91700000000000004}]},{"osd":5,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"min":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"max":{"1min":1.994,"5min":1.994,"15min":1.994},"last":1.0169999999999999},{"interface":"front","average":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"min":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"max":{"1min":2.0129999999999999,"5min":2.0129999999999999,"15min":2.0129999999999999},"last":0.95799999999999996}]},{"osd":7,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"min":{"1min":1.016,"5min":1.016,"15min":1.016},"max":{"1min":2.0920000000000001,"5min":2.0920000000000001,"15min":2.0920000000000001},"last":1.0449999999999999},{"interface":"front","average":{"1min":1.5469999999999999,"5min":1.5469999999999999,"15min":1.5469999999999999},"min":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"max":{"1min":2.0310000000000001,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":1.0589999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574874,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297840,"kb_used_data":552,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074000,"statfs":{"total":96636764160,"available":96331776000,"internally_reserved":0,"allocated":565248,"data_stored":241946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":1.1539999999999999},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.5,"5min":1.5,"15min":1.5},"last":1.3640000000000001}]},{"osd":1,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"min":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":1.984,"5min":1.984,"15min":1.984},"last":1.0029999999999999},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.708,"5min":1.708,"15min":1.708},"last":1.1990000000000001}]},{"osd":2,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.395,"5min":1.395,"15min":1.395},"min":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"max":{"1min":1.78,"5min":1.78,"15min":1.78},"last":1.3979999999999999},{"interface":"front","average":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"min":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":2.8319999999999999,"5min":2.8319999999999999,"15min":2.8319999999999999},"last":1.4099999999999999}]},{"osd":3,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"min":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":3.1789999999999998,"5min":3.1789999999999998,"15min":3.1789999999999998},"last":1.1140000000000001},{"interface":"front","average":{"1min":1.272,"5min":1.272,"15min":1.272},"min":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"max":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":1.327}]},{"osd":4,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":1.302,"15min":1.302},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":2.5899999999999999,"5min":2.5899999999999999,"15min":2.5899999999999999},"last":1.2869999999999999},{"interface":"front","average":{"1min":1.516,"5min":1.516,"15min":1.516},"min":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"max":{"1min":4.5419999999999998,"5min":4.5419999999999998,"15min":4.5419999999999998},"last":1.48}]},{"osd":6,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.847,"5min":1.847,"15min":1.847},"last":1.506},{"interface":"front","average":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"min":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":2.9239999999999999,"5min":2.9239999999999999,"15min":2.9239999999999999},"last":1.5329999999999999}]},{"osd":7,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":4.4489999999999998,"5min":4.4489999999999998,"15min":4.4489999999999998},"last":1.2509999999999999},{"interface":"front","average":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"min":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"max":{"1min":1.98,"5min":1.98,"15min":1.98},"last":1.454}]}]},{"osd":4,"up_from":13,"seq":55834574873,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297840,"kb_used_data":552,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074000,"statfs":{"total":96636764160,"available":96331776000,"internally_reserved":0,"allocated":565248,"data_stored":241946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.6040000000000001,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":0.84199999999999997},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.585,"5min":1.585,"15min":1.585},"last":1.1559999999999999}]},{"osd":1,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.403,"5min":1.403,"15min":1.403},"last":1.244},{"interface":"front","average":{"1min":1.169,"5min":1.169,"15min":1.169},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.73,"5min":1.73,"15min":1.73},"last":1.1279999999999999}]},{"osd":2,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.696,"5min":1.696,"15min":1.696},"last":1.425},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":1.788,"5min":1.788,"15min":1.788},"last":1.1850000000000001}]},{"osd":3,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.248,"15min":1.248},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.625,"5min":1.625,"15min":1.625},"last":0.996},{"interface":"front","average":{"1min":1.232,"5min":1.232,"15min":1.232},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.7629999999999999,"5min":1.7629999999999999,"15min":1.7629999999999999},"last":1.089}]},{"osd":5,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.198,"5min":1.198,"15min":1.198},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.71,"5min":1.71,"15min":1.71},"last":0.56799999999999995},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.7889999999999999,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":1.212}]},{"osd":6,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":2.9100000000000001,"5min":2.9100000000000001,"15min":2.9100000000000001},"last":0.93500000000000005},{"interface":"front","average":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":3.282,"5min":3.282,"15min":3.282},"last":0.74299999999999999}]},{"osd":7,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.544,"5min":1.544,"15min":1.544},"min":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"max":{"1min":2.145,"5min":2.145,"15min":2.145},"last":1.286},{"interface":"front","average":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"min":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.927,"5min":1.927,"15min":1.927},"last":1.341}]}]},{"osd":3,"up_from":13,"seq":55834574873,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301936,"kb_used_data":552,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069904,"statfs":{"total":96636764160,"available":96327581696,"internally_reserved":0,"allocated":565248,"data_stored":241946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:01:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":2.298,"5min":2.298,"15min":2.298},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.998,"5min":0.998,"15min":0.998},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":2.1850000000000001,"5min":2.1850000000000001,"15min":2.1850000000000001},"last":0.60699999999999998}]},{"osd":1,"last update":"Fri Oct 6 03:01:46 2023","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.974,"5min":1.974,"15min":1.974},"last":0.58599999999999997},{"interface":"front","average":{"1min":1.137,"5min":1.137,"15min":1.137},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.71,"5min":1.71,"15min":1.71},"last":0.63700000000000001}]},{"osd":2,"last update":"Fri Oct 6 03:01:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":2.8849999999999998,"5min":2.8849999999999998,"15min":2.8849999999999998},"last":0.44500000000000001},{"interface":"front","average":{"1min":1.095,"5min":1.095,"15min":1.095},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":2.8220000000000001,"5min":2.8220000000000001,"15min":2.8220000000000001},"last":0.86699999999999999}]},{"osd":4,"last update":"Fri Oct 6 03:01:46 2023","interfaces":[{"interface":"back","average":{"1min":1.456,"5min":1.456,"15min":1.456},"min":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"max":{"1min":3.6560000000000001,"5min":3.6560000000000001,"15min":3.6560000000000001},"last":0.751},{"interface":"front","average":{"1min":1.466,"5min":1.466,"15min":1.466},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":3.7749999999999999,"5min":3.7749999999999999,"15min":3.7749999999999999},"last":0.76800000000000002}]},{"osd":5,"last update":"Fri Oct 6 03:01:46 2023","interfaces":[{"interface":"back","average":{"1min":1.534,"5min":1.534,"15min":1.534},"min":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"max":{"1min":3.4910000000000001,"5min":3.4910000000000001,"15min":3.4910000000000001},"last":0.83099999999999996},{"interface":"front","average":{"1min":1.494,"5min":1.494,"15min":1.494},"min":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"max":{"1min":2.6240000000000001,"5min":2.6240000000000001,"15min":2.6240000000000001},"last":1.101}]},{"osd":6,"last update":"Fri Oct 6 03:01:46 2023","interfaces":[{"interface":"back","average":{"1min":1.5780000000000001,"5min":1.5780000000000001,"15min":1.5780000000000001},"min":{"1min":1.046,"5min":1.046,"15min":1.046},"max":{"1min":3.7050000000000001,"5min":3.7050000000000001,"15min":3.7050000000000001},"last":0.84599999999999997},{"interface":"front","average":{"1min":1.583,"5min":1.583,"15min":1.583},"min":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"max":{"1min":3.9300000000000002,"5min":3.9300000000000002,"15min":3.9300000000000002},"last":0.80900000000000005}]},{"osd":7,"last update":"Fri Oct 6 03:01:46 2023","interfaces":[{"interface":"back","average":{"1min":1.635,"5min":1.635,"15min":1.635},"min":{"1min":1.149,"5min":1.149,"15min":1.149},"max":{"1min":2.96,"5min":2.96,"15min":2.96},"last":1.0369999999999999},{"interface":"front","average":{"1min":1.7729999999999999,"5min":1.7729999999999999,"15min":1.7729999999999999},"min":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"max":{"1min":3.8559999999999999,"5min":3.8559999999999999,"15min":3.8559999999999999},"last":0.90600000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574873,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301924,"kb_used_data":540,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069916,"statfs":{"total":96636764160,"available":96327593984,"internally_reserved":0,"allocated":552960,"data_stored":235330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.6950000000000001,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":1.165},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":0.79100000000000004}]},{"osd":1,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.5449999999999999,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":1.2889999999999999},{"interface":"front","average":{"1min":1.232,"5min":1.232,"15min":1.232},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":2.1800000000000002,"5min":2.1800000000000002,"15min":2.1800000000000002},"last":0.99099999999999999}]},{"osd":3,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.91300000000000003},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":2.806,"5min":2.806,"15min":2.806},"last":1.0349999999999999}]},{"osd":4,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.389,"5min":1.389,"15min":1.389},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":2.1739999999999999,"5min":2.1739999999999999,"15min":2.1739999999999999},"last":1.3939999999999999},{"interface":"front","average":{"1min":1.458,"5min":1.458,"15min":1.458},"min":{"1min":1,"5min":1,"15min":1},"max":{"1min":3.028,"5min":3.028,"15min":3.028},"last":1.4219999999999999}]},{"osd":5,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.55,"5min":1.55,"15min":1.55},"min":{"1min":1.036,"5min":1.036,"15min":1.036},"max":{"1min":3.1499999999999999,"5min":3.1499999999999999,"15min":3.1499999999999999},"last":1.3380000000000001},{"interface":"front","average":{"1min":1.512,"5min":1.512,"15min":1.512},"min":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"max":{"1min":2.8580000000000001,"5min":2.8580000000000001,"15min":2.8580000000000001},"last":1.3500000000000001}]},{"osd":6,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"min":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"max":{"1min":2.6659999999999999,"5min":2.6659999999999999,"15min":2.6659999999999999},"last":1.115},{"interface":"front","average":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"min":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"max":{"1min":2.411,"5min":2.411,"15min":2.411},"last":1.458}]},{"osd":7,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"min":{"1min":1.01,"5min":1.01,"15min":1.01},"max":{"1min":3.2160000000000002,"5min":3.2160000000000002,"15min":3.2160000000000002},"last":1.2110000000000001},{"interface":"front","average":{"1min":1.631,"5min":1.631,"15min":1.631},"min":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"max":{"1min":3.1059999999999999,"5min":3.1059999999999999,"15min":3.1059999999999999},"last":1.2370000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574874,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301924,"kb_used_data":540,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069916,"statfs":{"total":96636764160,"available":96327593984,"internally_reserved":0,"allocated":552960,"data_stored":235330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.7749999999999999,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":0.96699999999999997},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":2.3260000000000001,"5min":2.3260000000000001,"15min":2.3260000000000001},"last":1.135}]},{"osd":2,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":3.5459999999999998,"5min":3.5459999999999998,"15min":3.5459999999999998},"last":1.0309999999999999},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.706,"5min":1.706,"15min":1.706},"last":1.226}]},{"osd":3,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.625,"5min":1.625,"15min":1.625},"last":1.3049999999999999},{"interface":"front","average":{"1min":1.196,"5min":1.196,"15min":1.196},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":3.331,"5min":3.331,"15min":3.331},"last":1.504}]},{"osd":4,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.339,"5min":1.339,"15min":1.339},"min":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"max":{"1min":1.8660000000000001,"5min":1.8660000000000001,"15min":1.8660000000000001},"last":1.196},{"interface":"front","average":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":3.2250000000000001,"5min":3.2250000000000001,"15min":3.2250000000000001},"last":1.2490000000000001}]},{"osd":5,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"min":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"max":{"1min":2.8439999999999999,"5min":2.8439999999999999,"15min":2.8439999999999999},"last":1.1100000000000001},{"interface":"front","average":{"1min":1.484,"5min":1.484,"15min":1.484},"min":{"1min":1.01,"5min":1.01,"15min":1.01},"max":{"1min":2.4590000000000001,"5min":2.4590000000000001,"15min":2.4590000000000001},"last":1.4550000000000001}]},{"osd":6,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"min":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"max":{"1min":2.96,"5min":2.96,"15min":2.96},"last":1.371},{"interface":"front","average":{"1min":1.504,"5min":1.504,"15min":1.504},"min":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"max":{"1min":2.5859999999999999,"5min":2.5859999999999999,"15min":2.5859999999999999},"last":1.548}]},{"osd":7,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.6040000000000001,"5min":1.6040000000000001,"15min":1.6040000000000001},"min":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"max":{"1min":3.4460000000000002,"5min":3.4460000000000002,"15min":3.4460000000000002},"last":1.3859999999999999},{"interface":"front","average":{"1min":1.538,"5min":1.538,"15min":1.538},"min":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"max":{"1min":3.113,"5min":3.113,"15min":3.113},"last":1.427}]}]},{"osd":0,"up_from":13,"seq":55834574873,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302504,"kb_used_data":1120,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069336,"statfs":{"total":96636764160,"available":96327000064,"internally_reserved":0,"allocated":1146880,"data_stored":825698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.381,"5min":1.381,"15min":1.381},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.999,"5min":0.999,"15min":0.999},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":1.1319999999999999}]},{"osd":2,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":1.26},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.794,"5min":1.794,"15min":1.794},"last":1.484}]},{"osd":3,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.532,"5min":1.532,"15min":1.532},"last":0.70499999999999996},{"interface":"front","average":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.613,"5min":1.613,"15min":1.613},"last":0.88800000000000001}]},{"osd":4,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"min":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"max":{"1min":2.0680000000000001,"5min":2.0680000000000001,"15min":2.0680000000000001},"last":1.4139999999999999},{"interface":"front","average":{"1min":1.339,"5min":1.339,"15min":1.339},"min":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"max":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":1.4450000000000001}]},{"osd":5,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"min":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"max":{"1min":1.893,"5min":1.893,"15min":1.893},"last":1.5680000000000001},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"min":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":2.2080000000000002,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":1.2070000000000001}]},{"osd":6,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.421,"5min":1.421,"15min":1.421},"min":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"max":{"1min":1.96,"5min":1.96,"15min":1.96},"last":1.52},{"interface":"front","average":{"1min":1.552,"5min":1.552,"15min":1.552},"min":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"max":{"1min":1.9910000000000001,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":1.2949999999999999}]},{"osd":7,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.6319999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"min":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"max":{"1min":2.1019999999999999,"5min":2.1019999999999999,"15min":2.1019999999999999},"last":1.349},{"interface":"front","average":{"1min":1.431,"5min":1.431,"15min":1.431},"min":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"max":{"1min":2.1499999999999999,"5min":2.1499999999999999,"15min":2.1499999999999999},"last":1.3220000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:02:44.134 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:02:44.340 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.334+0000 7f003d4cd700 1 Processor -- start 2023-10-06T03:02:44.340 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.334+0000 7f003d4cd700 1 -- start start 2023-10-06T03:02:44.343 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.334+0000 7f003d4cd700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0038159340 0x7f00380cb2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:44.343 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.334+0000 7f003d4cd700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f00380b01c0 0x7f003806dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:44.343 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.334+0000 7f003d4cd700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00380b0660 con 0x7f0038158f70 2023-10-06T03:02:44.343 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.334+0000 7f003d4cd700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00380cb900 con 0x7f00380b01c0 2023-10-06T03:02:44.343 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.334+0000 7f003d4cd700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00380cbbe0 con 0x7f0038159340 2023-10-06T03:02:44.344 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.338+0000 7f002ffff700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0038159340 0x7f00380cb2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:44.344 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.338+0000 7f002ffff700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0038159340 0x7f00380cb2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.57:46970/0 (socket says 172.21.15.57:46970) 2023-10-06T03:02:44.344 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.338+0000 7f002ffff700 1 -- 172.21.15.57:0/2060504524 learned_addr learned my addr 172.21.15.57:0/2060504524 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:02:44.344 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.338+0000 7f00377fe700 1 --2- 172.21.15.57:0/2060504524 >> v2:172.21.15.105:3300/0 conn(0x7f00380b01c0 0x7f003806dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:44.344 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.338+0000 7f002ffff700 1 -- 172.21.15.57:0/2060504524 >> v2:172.21.15.105:3300/0 conn(0x7f00380b01c0 msgr2=0x7f003806dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:44.344 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.338+0000 7f002ffff700 1 --2- 172.21.15.57:0/2060504524 >> v2:172.21.15.105:3300/0 conn(0x7f00380b01c0 0x7f003806dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:44.344 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.338+0000 7f002ffff700 1 -- 172.21.15.57:0/2060504524 >> v1:172.21.15.105:6789/0 conn(0x7f0038158f70 legacy=0x7f003806d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:44.345 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.338+0000 7f002ffff700 1 -- 172.21.15.57:0/2060504524 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f003806c9c0 con 0x7f0038159340 2023-10-06T03:02:44.345 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.338+0000 7f002ffff700 1 --2- 172.21.15.57:0/2060504524 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0038159340 0x7f00380cb2f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f00200099b0 tx=0x7f0020009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb40acebd9322132 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:44.345 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.338+0000 7f00367fc700 1 -- 172.21.15.57:0/2060504524 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0020009ea0 con 0x7f0038159340 2023-10-06T03:02:44.346 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.338+0000 7f00367fc700 1 -- 172.21.15.57:0/2060504524 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f002000b860 con 0x7f0038159340 2023-10-06T03:02:44.346 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.338+0000 7f00367fc700 1 -- 172.21.15.57:0/2060504524 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f002000bc00 con 0x7f0038159340 2023-10-06T03:02:44.347 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.338+0000 7f003d4cd700 1 -- 172.21.15.57:0/2060504524 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0038159340 msgr2=0x7f00380cb2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:44.347 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.338+0000 7f003d4cd700 1 --2- 172.21.15.57:0/2060504524 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0038159340 0x7f00380cb2f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f00200099b0 tx=0x7f0020009250 comp rx=0 tx=0).stop 2023-10-06T03:02:44.347 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.342+0000 7f003d4cd700 1 -- 172.21.15.57:0/2060504524 shutdown_connections 2023-10-06T03:02:44.347 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.342+0000 7f003d4cd700 1 --2- 172.21.15.57:0/2060504524 >> v2:172.21.15.105:3300/0 conn(0x7f00380b01c0 0x7f003806dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:44.347 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.342+0000 7f003d4cd700 1 --2- 172.21.15.57:0/2060504524 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0038159340 0x7f00380cb2f0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:44.347 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.342+0000 7f003d4cd700 1 -- 172.21.15.57:0/2060504524 >> 172.21.15.57:0/2060504524 conn(0x7f00380ccbf0 msgr2=0x7f00380ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:44.347 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.342+0000 7f003d4cd700 1 -- 172.21.15.57:0/2060504524 shutdown_connections 2023-10-06T03:02:44.347 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.342+0000 7f003d4cd700 1 -- 172.21.15.57:0/2060504524 wait complete. 2023-10-06T03:02:44.348 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.342+0000 7f003d4cd700 1 Processor -- start 2023-10-06T03:02:44.349 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.342+0000 7f003d4cd700 1 -- start start 2023-10-06T03:02:44.350 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.342+0000 7f003d4cd700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00380b01c0 0x7f00381507a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:44.350 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.342+0000 7f003d4cd700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0038158f70 0x7f0038156da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:44.350 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.342+0000 7f003d4cd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0038159340 0x7f00381572e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:44.350 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.342+0000 7f003d4cd700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0038150ce0 con 0x7f0038159340 2023-10-06T03:02:44.350 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.342+0000 7f003d4cd700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0038158500 con 0x7f0038158f70 2023-10-06T03:02:44.350 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.342+0000 7f003d4cd700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00381578f0 con 0x7f00380b01c0 2023-10-06T03:02:44.351 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.342+0000 7f00377fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0038159340 0x7f00381572e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:44.352 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.346+0000 7f00377fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0038159340 0x7f00381572e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:52694/0 (socket says 172.21.15.57:52694) 2023-10-06T03:02:44.352 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.346+0000 7f00377fe700 1 -- 172.21.15.57:0/705351785 learned_addr learned my addr 172.21.15.57:0/705351785 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:02:44.352 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.346+0000 7f0036ffd700 1 --2- 172.21.15.57:0/705351785 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00380b01c0 0x7f00381507a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:44.352 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.346+0000 7f002ffff700 1 --2- 172.21.15.57:0/705351785 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0038158f70 0x7f0038156da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:44.352 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.346+0000 7f00377fe700 1 -- 172.21.15.57:0/705351785 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00380b01c0 msgr2=0x7f00381507a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:44.352 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.346+0000 7f00377fe700 1 --2- 172.21.15.57:0/705351785 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00380b01c0 0x7f00381507a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:44.352 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.346+0000 7f00377fe700 1 -- 172.21.15.57:0/705351785 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0038158f70 msgr2=0x7f0038156da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:44.352 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.346+0000 7f00377fe700 1 --2- 172.21.15.57:0/705351785 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0038158f70 0x7f0038156da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:44.352 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.346+0000 7f00377fe700 1 -- 172.21.15.57:0/705351785 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00200094f0 con 0x7f0038159340 2023-10-06T03:02:44.352 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.346+0000 7f00377fe700 1 --2- 172.21.15.57:0/705351785 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0038159340 0x7f00381572e0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f0030009e20 tx=0x7f003000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:44.353 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.346+0000 7f002effd700 1 -- 172.21.15.57:0/705351785 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f003000cc20 con 0x7f0038159340 2023-10-06T03:02:44.353 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.346+0000 7f002effd700 1 -- 172.21.15.57:0/705351785 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f003000f040 con 0x7f0038159340 2023-10-06T03:02:44.353 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.346+0000 7f002effd700 1 -- 172.21.15.57:0/705351785 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0030014480 con 0x7f0038159340 2023-10-06T03:02:44.353 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.346+0000 7f003d4cd700 1 -- 172.21.15.57:0/705351785 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0038157bd0 con 0x7f0038159340 2023-10-06T03:02:44.354 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.346+0000 7f003d4cd700 1 -- 172.21.15.57:0/705351785 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0038158190 con 0x7f0038159340 2023-10-06T03:02:44.355 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.350+0000 7f003d4cd700 1 -- 172.21.15.57:0/705351785 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00380cc150 con 0x7f0038159340 2023-10-06T03:02:44.356 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.350+0000 7f002effd700 1 -- 172.21.15.57:0/705351785 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f00300147f0 con 0x7f0038159340 2023-10-06T03:02:44.357 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.350+0000 7f002effd700 1 --2- 172.21.15.57:0/705351785 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f0018060550 0x7f0018062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:44.357 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.350+0000 7f002effd700 1 -- 172.21.15.57:0/705351785 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f003007d640 con 0x7f0038159340 2023-10-06T03:02:44.357 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.350+0000 7f0036ffd700 1 --2- 172.21.15.57:0/705351785 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f0018060550 0x7f0018062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:44.359 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.354+0000 7f0036ffd700 1 --2- 172.21.15.57:0/705351785 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f0018060550 0x7f0018062a00 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f00280037c0 tx=0x7f0028009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:44.364 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.358+0000 7f002effd700 1 -- 172.21.15.57:0/705351785 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f00380cc150 con 0x7f0038159340 2023-10-06T03:02:44.530 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.522+0000 7f003d4cd700 1 -- 172.21.15.57:0/705351785 --> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0038158380 con 0x7f0018060550 2023-10-06T03:02:44.540 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.534+0000 7f002effd700 1 -- 172.21.15.57:0/705351785 <== mgr.4103 v2:172.21.15.57:6832/32947 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+305875 (secure 0 0 0) 0x7f0028013420 con 0x7f0018060550 2023-10-06T03:02:44.545 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:02:44.549 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.542+0000 7f003d4cd700 1 -- 172.21.15.57:0/705351785 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f0018060550 msgr2=0x7f0018062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:44.549 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.542+0000 7f003d4cd700 1 --2- 172.21.15.57:0/705351785 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f0018060550 0x7f0018062a00 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f00280037c0 tx=0x7f0028009040 comp rx=0 tx=0).stop 2023-10-06T03:02:44.550 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.542+0000 7f003d4cd700 1 -- 172.21.15.57:0/705351785 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0038159340 msgr2=0x7f00381572e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:44.550 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.542+0000 7f003d4cd700 1 --2- 172.21.15.57:0/705351785 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0038159340 0x7f00381572e0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f0030009e20 tx=0x7f003000b040 comp rx=0 tx=0).stop 2023-10-06T03:02:44.550 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.542+0000 7f003d4cd700 1 -- 172.21.15.57:0/705351785 shutdown_connections 2023-10-06T03:02:44.550 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.542+0000 7f003d4cd700 1 --2- 172.21.15.57:0/705351785 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0038159340 0x7f00381572e0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:44.550 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.542+0000 7f003d4cd700 1 --2- 172.21.15.57:0/705351785 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0038158f70 0x7f0038156da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:44.550 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.542+0000 7f003d4cd700 1 --2- 172.21.15.57:0/705351785 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f0018060550 0x7f0018062a00 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:44.550 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.542+0000 7f003d4cd700 1 --2- 172.21.15.57:0/705351785 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00380b01c0 0x7f00381507a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:44.550 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.542+0000 7f003d4cd700 1 -- 172.21.15.57:0/705351785 >> 172.21.15.57:0/705351785 conn(0x7f00380ccbf0 msgr2=0x7f00380cdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:44.550 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.542+0000 7f003d4cd700 1 -- 172.21.15.57:0/705351785 shutdown_connections 2023-10-06T03:02:44.551 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.542+0000 7f003d4cd700 1 -- 172.21.15.57:0/705351785 wait complete. 2023-10-06T03:02:44.552 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2023-10-06T03:02:44.570 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":103,"stamp":"2023-10-06T03:02:44.305862+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":67,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2404312,"kb_used_data":5528,"kb_used_omap":0,"kb_used_meta":2398720,"kb_avail":752570408,"statfs":{"total":773094113280,"available":770632097792,"internally_reserved":0,"allocated":5660672,"data_stored":3089840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2456289280},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001560"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.845590+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:29:10.864990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.845802+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:27:35.234159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.851319+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:29:30.158378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.847718+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:18.879270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.841376+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:06:26.036575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.847453+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:23:18.217898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.854346+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:53:57.831764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.862103+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:17:48.382984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.862874+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:28:01.768786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.845785+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:06:26.036575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.841036+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:44:39.912786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.864917+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:17:46.359437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.846156+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:58:26.925821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.851625+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:41:45.880609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.845061+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:06:26.036575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.844877+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:58:03.418004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.853710+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:40:05.112188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.845091+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:58:26.925821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.850808+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:47:29.067808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.847201+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:02:36.798629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.847460+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:16:22.934040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.860493+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:18.879270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.841921+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:02:36.798629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.849036+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:27:35.234159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.851108+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:17:48.382984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.865759+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:40:05.112188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.843612+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:37:35.950737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.846351+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:43:59.979418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.850023+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:46:40.611565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.846537+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:12:14.521260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.853140+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:17:46.359437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.851907+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:17:48.382984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.845465+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:03:37.092106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.856515+0000","last_change":"2023-10-06T03:02:38.856515+0000","last_active":"2023-10-06T03:02:38.856515+0000","last_peered":"2023-10-06T03:02:38.856515+0000","last_clean":"2023-10-06T03:02:38.856515+0000","last_became_active":"2023-10-06T03:02:38.856154+0000","last_became_peered":"2023-10-06T03:02:38.856154+0000","last_unstale":"2023-10-06T03:02:38.856515+0000","last_undegraded":"2023-10-06T03:02:38.856515+0000","last_fullsized":"2023-10-06T03:02:38.856515+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:31:46.112896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.849055+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:12:14.521260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.870422+0000","last_change":"2023-10-06T03:02:38.870422+0000","last_active":"2023-10-06T03:02:38.870422+0000","last_peered":"2023-10-06T03:02:38.870422+0000","last_clean":"2023-10-06T03:02:38.870422+0000","last_became_active":"2023-10-06T03:02:38.869951+0000","last_became_peered":"2023-10-06T03:02:38.869951+0000","last_unstale":"2023-10-06T03:02:38.870422+0000","last_undegraded":"2023-10-06T03:02:38.870422+0000","last_fullsized":"2023-10-06T03:02:38.870422+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:01:14.978500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.846743+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:44:39.912786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.858140+0000","last_change":"2023-10-06T03:02:38.858140+0000","last_active":"2023-10-06T03:02:38.858140+0000","last_peered":"2023-10-06T03:02:38.858140+0000","last_clean":"2023-10-06T03:02:38.858140+0000","last_became_active":"2023-10-06T03:02:38.857805+0000","last_became_peered":"2023-10-06T03:02:38.857805+0000","last_unstale":"2023-10-06T03:02:38.858140+0000","last_undegraded":"2023-10-06T03:02:38.858140+0000","last_fullsized":"2023-10-06T03:02:38.858140+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:14:55.765174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.861373+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:46:40.611565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.873915+0000","last_change":"2023-10-06T03:02:38.873915+0000","last_active":"2023-10-06T03:02:38.873915+0000","last_peered":"2023-10-06T03:02:38.873915+0000","last_clean":"2023-10-06T03:02:38.873915+0000","last_became_active":"2023-10-06T03:02:38.873404+0000","last_became_peered":"2023-10-06T03:02:38.873404+0000","last_unstale":"2023-10-06T03:02:38.873915+0000","last_undegraded":"2023-10-06T03:02:38.873915+0000","last_fullsized":"2023-10-06T03:02:38.873915+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:58:25.908183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.840383+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:14:47.594861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.857653+0000","last_change":"2023-10-06T03:02:38.857653+0000","last_active":"2023-10-06T03:02:38.857653+0000","last_peered":"2023-10-06T03:02:38.857653+0000","last_clean":"2023-10-06T03:02:38.857653+0000","last_became_active":"2023-10-06T03:02:38.857368+0000","last_became_peered":"2023-10-06T03:02:38.857368+0000","last_unstale":"2023-10-06T03:02:38.857653+0000","last_undegraded":"2023-10-06T03:02:38.857653+0000","last_fullsized":"2023-10-06T03:02:38.857653+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:04:38.128587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.848288+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:39:42.661414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.854422+0000","last_change":"2023-10-06T03:02:38.854422+0000","last_active":"2023-10-06T03:02:38.854422+0000","last_peered":"2023-10-06T03:02:38.854422+0000","last_clean":"2023-10-06T03:02:38.854422+0000","last_became_active":"2023-10-06T03:02:38.854088+0000","last_became_peered":"2023-10-06T03:02:38.854088+0000","last_unstale":"2023-10-06T03:02:38.854422+0000","last_undegraded":"2023-10-06T03:02:38.854422+0000","last_fullsized":"2023-10-06T03:02:38.854422+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:41:45.591282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.864711+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:12:14.521260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.858755+0000","last_change":"2023-10-06T03:02:38.858755+0000","last_active":"2023-10-06T03:02:38.858755+0000","last_peered":"2023-10-06T03:02:38.858755+0000","last_clean":"2023-10-06T03:02:38.858755+0000","last_became_active":"2023-10-06T03:02:38.858405+0000","last_became_peered":"2023-10-06T03:02:38.858405+0000","last_unstale":"2023-10-06T03:02:38.858755+0000","last_undegraded":"2023-10-06T03:02:38.858755+0000","last_fullsized":"2023-10-06T03:02:38.858755+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:59:48.860090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.845190+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:23:18.217898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.863407+0000","last_change":"2023-10-06T03:02:38.863407+0000","last_active":"2023-10-06T03:02:38.863407+0000","last_peered":"2023-10-06T03:02:38.863407+0000","last_clean":"2023-10-06T03:02:38.863407+0000","last_became_active":"2023-10-06T03:02:38.863081+0000","last_became_peered":"2023-10-06T03:02:38.863081+0000","last_unstale":"2023-10-06T03:02:38.863407+0000","last_undegraded":"2023-10-06T03:02:38.863407+0000","last_fullsized":"2023-10-06T03:02:38.863407+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:58:02.400366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.840362+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:04:39.146225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.860246+0000","last_change":"2023-10-06T03:02:38.860246+0000","last_active":"2023-10-06T03:02:38.860246+0000","last_peered":"2023-10-06T03:02:38.860246+0000","last_clean":"2023-10-06T03:02:38.860246+0000","last_became_active":"2023-10-06T03:02:38.859969+0000","last_became_peered":"2023-10-06T03:02:38.859969+0000","last_unstale":"2023-10-06T03:02:38.860246+0000","last_undegraded":"2023-10-06T03:02:38.860246+0000","last_fullsized":"2023-10-06T03:02:38.860246+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:16:59.767516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.850848+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:46:40.611565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.869322+0000","last_change":"2023-10-06T03:02:38.869322+0000","last_active":"2023-10-06T03:02:38.869322+0000","last_peered":"2023-10-06T03:02:38.869322+0000","last_clean":"2023-10-06T03:02:38.869322+0000","last_became_active":"2023-10-06T03:02:38.868958+0000","last_became_peered":"2023-10-06T03:02:38.868958+0000","last_unstale":"2023-10-06T03:02:38.869322+0000","last_undegraded":"2023-10-06T03:02:38.869322+0000","last_fullsized":"2023-10-06T03:02:38.869322+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:18:12.245614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.851092+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:28:01.768786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.861193+0000","last_change":"2023-10-06T03:02:38.861193+0000","last_active":"2023-10-06T03:02:38.861193+0000","last_peered":"2023-10-06T03:02:38.861193+0000","last_clean":"2023-10-06T03:02:38.861193+0000","last_became_active":"2023-10-06T03:02:38.860904+0000","last_became_peered":"2023-10-06T03:02:38.860904+0000","last_unstale":"2023-10-06T03:02:38.861193+0000","last_undegraded":"2023-10-06T03:02:38.861193+0000","last_fullsized":"2023-10-06T03:02:38.861193+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:04:38.128587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.840714+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:58:03.418004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.871902+0000","last_change":"2023-10-06T03:02:38.871902+0000","last_active":"2023-10-06T03:02:38.871902+0000","last_peered":"2023-10-06T03:02:38.871902+0000","last_clean":"2023-10-06T03:02:38.871902+0000","last_became_active":"2023-10-06T03:02:38.871585+0000","last_became_peered":"2023-10-06T03:02:38.871585+0000","last_unstale":"2023-10-06T03:02:38.871902+0000","last_undegraded":"2023-10-06T03:02:38.871902+0000","last_fullsized":"2023-10-06T03:02:38.871902+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:29:09.847352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.851097+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:47:29.067808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.863229+0000","last_change":"2023-10-06T03:02:38.863229+0000","last_active":"2023-10-06T03:02:38.863229+0000","last_peered":"2023-10-06T03:02:38.863229+0000","last_clean":"2023-10-06T03:02:38.863229+0000","last_became_active":"2023-10-06T03:02:38.862751+0000","last_became_peered":"2023-10-06T03:02:38.862751+0000","last_unstale":"2023-10-06T03:02:38.863229+0000","last_undegraded":"2023-10-06T03:02:38.863229+0000","last_fullsized":"2023-10-06T03:02:38.863229+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:41:45.591282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.850206+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:12:14.521260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.864366+0000","last_change":"2023-10-06T03:02:38.864366+0000","last_active":"2023-10-06T03:02:38.864366+0000","last_peered":"2023-10-06T03:02:38.864366+0000","last_clean":"2023-10-06T03:02:38.864366+0000","last_became_active":"2023-10-06T03:02:38.864042+0000","last_became_peered":"2023-10-06T03:02:38.864042+0000","last_unstale":"2023-10-06T03:02:38.864366+0000","last_undegraded":"2023-10-06T03:02:38.864366+0000","last_fullsized":"2023-10-06T03:02:38.864366+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:14:45.231794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.865305+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:08:51.831968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.858014+0000","last_change":"2023-10-06T03:02:38.858014+0000","last_active":"2023-10-06T03:02:38.858014+0000","last_peered":"2023-10-06T03:02:38.858014+0000","last_clean":"2023-10-06T03:02:38.858014+0000","last_became_active":"2023-10-06T03:02:38.857708+0000","last_became_peered":"2023-10-06T03:02:38.857708+0000","last_unstale":"2023-10-06T03:02:38.858014+0000","last_undegraded":"2023-10-06T03:02:38.858014+0000","last_fullsized":"2023-10-06T03:02:38.858014+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:37:34.933099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.855648+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:19:46.946130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.872336+0000","last_change":"2023-10-06T03:02:38.872336+0000","last_active":"2023-10-06T03:02:38.872336+0000","last_peered":"2023-10-06T03:02:38.872336+0000","last_clean":"2023-10-06T03:02:38.872336+0000","last_became_active":"2023-10-06T03:02:38.871712+0000","last_became_peered":"2023-10-06T03:02:38.871712+0000","last_unstale":"2023-10-06T03:02:38.872336+0000","last_undegraded":"2023-10-06T03:02:38.872336+0000","last_fullsized":"2023-10-06T03:02:38.872336+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:06:25.018937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.861542+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:47:29.067808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.876423+0000","last_change":"2023-10-06T03:02:38.876423+0000","last_active":"2023-10-06T03:02:38.876423+0000","last_peered":"2023-10-06T03:02:38.876423+0000","last_clean":"2023-10-06T03:02:38.876423+0000","last_became_active":"2023-10-06T03:02:38.876118+0000","last_became_peered":"2023-10-06T03:02:38.876118+0000","last_unstale":"2023-10-06T03:02:38.876423+0000","last_undegraded":"2023-10-06T03:02:38.876423+0000","last_fullsized":"2023-10-06T03:02:38.876423+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:58:25.908183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.843494+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:17:00.785154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.861028+0000","last_change":"2023-10-06T03:02:38.861028+0000","last_active":"2023-10-06T03:02:38.861028+0000","last_peered":"2023-10-06T03:02:38.861028+0000","last_clean":"2023-10-06T03:02:38.861028+0000","last_became_active":"2023-10-06T03:02:38.859084+0000","last_became_peered":"2023-10-06T03:02:38.859084+0000","last_unstale":"2023-10-06T03:02:38.861028+0000","last_undegraded":"2023-10-06T03:02:38.861028+0000","last_fullsized":"2023-10-06T03:02:38.861028+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:37:03.894863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.840919+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:29:10.864990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.861356+0000","last_change":"2023-10-06T03:02:38.861356+0000","last_active":"2023-10-06T03:02:38.861356+0000","last_peered":"2023-10-06T03:02:38.861356+0000","last_clean":"2023-10-06T03:02:38.861356+0000","last_became_active":"2023-10-06T03:02:38.861051+0000","last_became_peered":"2023-10-06T03:02:38.861051+0000","last_unstale":"2023-10-06T03:02:38.861356+0000","last_undegraded":"2023-10-06T03:02:38.861356+0000","last_fullsized":"2023-10-06T03:02:38.861356+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:51:34.107940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.843354+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:18:13.263253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.873865+0000","last_change":"2023-10-06T03:02:38.873865+0000","last_active":"2023-10-06T03:02:38.873865+0000","last_peered":"2023-10-06T03:02:38.873865+0000","last_clean":"2023-10-06T03:02:38.873865+0000","last_became_active":"2023-10-06T03:02:38.873448+0000","last_became_peered":"2023-10-06T03:02:38.873448+0000","last_unstale":"2023-10-06T03:02:38.873865+0000","last_undegraded":"2023-10-06T03:02:38.873865+0000","last_fullsized":"2023-10-06T03:02:38.873865+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:01:19.591702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.850589+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:39:42.661414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.861807+0000","last_change":"2023-10-06T03:02:38.861807+0000","last_active":"2023-10-06T03:02:38.861807+0000","last_peered":"2023-10-06T03:02:38.861807+0000","last_clean":"2023-10-06T03:02:38.861807+0000","last_became_active":"2023-10-06T03:02:38.861513+0000","last_became_peered":"2023-10-06T03:02:38.861513+0000","last_unstale":"2023-10-06T03:02:38.861807+0000","last_undegraded":"2023-10-06T03:02:38.861807+0000","last_fullsized":"2023-10-06T03:02:38.861807+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:56:07.918211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.852214+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:18:27.259723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.872303+0000","last_change":"2023-10-06T03:02:38.872303+0000","last_active":"2023-10-06T03:02:38.872303+0000","last_peered":"2023-10-06T03:02:38.872303+0000","last_clean":"2023-10-06T03:02:38.872303+0000","last_became_active":"2023-10-06T03:02:38.871590+0000","last_became_peered":"2023-10-06T03:02:38.871590+0000","last_unstale":"2023-10-06T03:02:38.872303+0000","last_undegraded":"2023-10-06T03:02:38.872303+0000","last_fullsized":"2023-10-06T03:02:38.872303+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:58:02.400366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.849827+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:39:42.661414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.867297+0000","last_change":"2023-10-06T03:02:38.867297+0000","last_active":"2023-10-06T03:02:38.867297+0000","last_peered":"2023-10-06T03:02:38.867297+0000","last_clean":"2023-10-06T03:02:38.867297+0000","last_became_active":"2023-10-06T03:02:38.866855+0000","last_became_peered":"2023-10-06T03:02:38.866855+0000","last_unstale":"2023-10-06T03:02:38.867297+0000","last_undegraded":"2023-10-06T03:02:38.867297+0000","last_fullsized":"2023-10-06T03:02:38.867297+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:29:09.847352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.844058+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:14:47.594861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.860777+0000","last_change":"2023-10-06T03:02:38.860777+0000","last_active":"2023-10-06T03:02:38.860777+0000","last_peered":"2023-10-06T03:02:38.860777+0000","last_clean":"2023-10-06T03:02:38.860777+0000","last_became_active":"2023-10-06T03:02:38.858664+0000","last_became_peered":"2023-10-06T03:02:38.858664+0000","last_unstale":"2023-10-06T03:02:38.860777+0000","last_undegraded":"2023-10-06T03:02:38.860777+0000","last_fullsized":"2023-10-06T03:02:38.860777+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:47:47.993117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.849391+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:48:50.971382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.867362+0000","last_change":"2023-10-06T03:02:38.867362+0000","last_active":"2023-10-06T03:02:38.867362+0000","last_peered":"2023-10-06T03:02:38.867362+0000","last_clean":"2023-10-06T03:02:38.867362+0000","last_became_active":"2023-10-06T03:02:38.863794+0000","last_became_peered":"2023-10-06T03:02:38.863794+0000","last_unstale":"2023-10-06T03:02:38.867362+0000","last_undegraded":"2023-10-06T03:02:38.867362+0000","last_fullsized":"2023-10-06T03:02:38.867362+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:06:25.018937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":185,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T03:02:37.828500+0000","last_change":"2023-10-06T03:00:45.709165+0000","last_active":"2023-10-06T03:02:37.828500+0000","last_peered":"2023-10-06T03:02:37.828500+0000","last_clean":"2023-10-06T03:02:37.828500+0000","last_became_active":"2023-10-06T03:00:45.707771+0000","last_became_peered":"2023-10-06T03:00:45.707771+0000","last_unstale":"2023-10-06T03:02:37.828500+0000","last_undegraded":"2023-10-06T03:02:37.828500+0000","last_fullsized":"2023-10-06T03:02:37.828500+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:44.625353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:44.625353+0000","last_clean_scrub_stamp":"2023-10-06T03:00:44.625353+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:31:31.774239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":31,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T03:02:37.831669+0000","last_change":"2023-10-06T03:00:51.905381+0000","last_active":"2023-10-06T03:02:37.831669+0000","last_peered":"2023-10-06T03:02:37.831669+0000","last_clean":"2023-10-06T03:02:37.831669+0000","last_became_active":"2023-10-06T03:00:51.904974+0000","last_became_peered":"2023-10-06T03:00:51.904974+0000","last_unstale":"2023-10-06T03:02:37.831669+0000","last_undegraded":"2023-10-06T03:02:37.831669+0000","last_fullsized":"2023-10-06T03:02:37.831669+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:15:19.182956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.843912+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:04:39.146225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.858174+0000","last_change":"2023-10-06T03:02:38.858174+0000","last_active":"2023-10-06T03:02:38.858174+0000","last_peered":"2023-10-06T03:02:38.858174+0000","last_clean":"2023-10-06T03:02:38.858174+0000","last_became_active":"2023-10-06T03:02:38.857843+0000","last_became_peered":"2023-10-06T03:02:38.857843+0000","last_unstale":"2023-10-06T03:02:38.858174+0000","last_undegraded":"2023-10-06T03:02:38.858174+0000","last_fullsized":"2023-10-06T03:02:38.858174+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:14:46.577223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":32,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T03:02:37.828379+0000","last_change":"2023-10-06T03:00:51.906480+0000","last_active":"2023-10-06T03:02:37.828379+0000","last_peered":"2023-10-06T03:02:37.828379+0000","last_clean":"2023-10-06T03:02:37.828379+0000","last_became_active":"2023-10-06T03:00:51.905956+0000","last_became_peered":"2023-10-06T03:00:51.905956+0000","last_unstale":"2023-10-06T03:02:37.828379+0000","last_undegraded":"2023-10-06T03:02:37.828379+0000","last_fullsized":"2023-10-06T03:02:37.828379+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:15:19.182956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.860881+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:39:42.661414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.857592+0000","last_change":"2023-10-06T03:02:38.857592+0000","last_active":"2023-10-06T03:02:38.857592+0000","last_peered":"2023-10-06T03:02:38.857592+0000","last_clean":"2023-10-06T03:02:38.857592+0000","last_became_active":"2023-10-06T03:02:38.857248+0000","last_became_peered":"2023-10-06T03:02:38.857248+0000","last_unstale":"2023-10-06T03:02:38.857592+0000","last_undegraded":"2023-10-06T03:02:38.857592+0000","last_fullsized":"2023-10-06T03:02:38.857592+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:14:46.577223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":32,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T03:02:37.831975+0000","last_change":"2023-10-06T03:00:51.902453+0000","last_active":"2023-10-06T03:02:37.831975+0000","last_peered":"2023-10-06T03:02:37.831975+0000","last_clean":"2023-10-06T03:02:37.831975+0000","last_became_active":"2023-10-06T03:00:51.901948+0000","last_became_peered":"2023-10-06T03:00:51.901948+0000","last_unstale":"2023-10-06T03:02:37.831975+0000","last_undegraded":"2023-10-06T03:02:37.831975+0000","last_fullsized":"2023-10-06T03:02:37.831975+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:13:30.721650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.849375+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:27:35.234159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.864320+0000","last_change":"2023-10-06T03:02:38.864320+0000","last_active":"2023-10-06T03:02:38.864320+0000","last_peered":"2023-10-06T03:02:38.864320+0000","last_clean":"2023-10-06T03:02:38.864320+0000","last_became_active":"2023-10-06T03:02:38.864020+0000","last_became_peered":"2023-10-06T03:02:38.864020+0000","last_unstale":"2023-10-06T03:02:38.864320+0000","last_undegraded":"2023-10-06T03:02:38.864320+0000","last_fullsized":"2023-10-06T03:02:38.864320+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:37:03.894863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":31,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T03:02:37.831524+0000","last_change":"2023-10-06T03:00:51.904148+0000","last_active":"2023-10-06T03:02:37.831524+0000","last_peered":"2023-10-06T03:02:37.831524+0000","last_clean":"2023-10-06T03:02:37.831524+0000","last_became_active":"2023-10-06T03:00:51.903729+0000","last_became_peered":"2023-10-06T03:00:51.903729+0000","last_unstale":"2023-10-06T03:02:37.831524+0000","last_undegraded":"2023-10-06T03:02:37.831524+0000","last_fullsized":"2023-10-06T03:02:37.831524+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:17:25.070478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.852876+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:08:51.831968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.867268+0000","last_change":"2023-10-06T03:02:38.867268+0000","last_active":"2023-10-06T03:02:38.867268+0000","last_peered":"2023-10-06T03:02:38.867268+0000","last_clean":"2023-10-06T03:02:38.867268+0000","last_became_active":"2023-10-06T03:02:38.867007+0000","last_became_peered":"2023-10-06T03:02:38.867007+0000","last_unstale":"2023-10-06T03:02:38.867268+0000","last_undegraded":"2023-10-06T03:02:38.867268+0000","last_fullsized":"2023-10-06T03:02:38.867268+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:56:07.918211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":29,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T03:02:37.832579+0000","last_change":"2023-10-06T03:00:52.484317+0000","last_active":"2023-10-06T03:02:37.832579+0000","last_peered":"2023-10-06T03:02:37.832579+0000","last_clean":"2023-10-06T03:02:37.832579+0000","last_became_active":"2023-10-06T03:00:52.483818+0000","last_became_peered":"2023-10-06T03:00:52.483818+0000","last_unstale":"2023-10-06T03:02:37.832579+0000","last_undegraded":"2023-10-06T03:02:37.832579+0000","last_fullsized":"2023-10-06T03:02:37.832579+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:17:24.136459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.859205+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:27:35.234159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.861581+0000","last_change":"2023-10-06T03:02:38.861581+0000","last_active":"2023-10-06T03:02:38.861581+0000","last_peered":"2023-10-06T03:02:38.861581+0000","last_clean":"2023-10-06T03:02:38.861581+0000","last_became_active":"2023-10-06T03:02:38.861190+0000","last_became_peered":"2023-10-06T03:02:38.861190+0000","last_unstale":"2023-10-06T03:02:38.861581+0000","last_undegraded":"2023-10-06T03:02:38.861581+0000","last_fullsized":"2023-10-06T03:02:38.861581+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:23:17.200260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":32,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T03:02:37.829601+0000","last_change":"2023-10-06T03:00:52.485186+0000","last_active":"2023-10-06T03:02:37.829601+0000","last_peered":"2023-10-06T03:02:37.829601+0000","last_clean":"2023-10-06T03:02:37.829601+0000","last_became_active":"2023-10-06T03:00:52.484615+0000","last_became_peered":"2023-10-06T03:00:52.484615+0000","last_unstale":"2023-10-06T03:02:37.829601+0000","last_undegraded":"2023-10-06T03:02:37.829601+0000","last_fullsized":"2023-10-06T03:02:37.829601+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:17:25.070478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.849461+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:18.879270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.872801+0000","last_change":"2023-10-06T03:02:38.872801+0000","last_active":"2023-10-06T03:02:38.872801+0000","last_peered":"2023-10-06T03:02:38.872801+0000","last_clean":"2023-10-06T03:02:38.872801+0000","last_became_active":"2023-10-06T03:02:38.872498+0000","last_became_peered":"2023-10-06T03:02:38.872498+0000","last_unstale":"2023-10-06T03:02:38.872801+0000","last_undegraded":"2023-10-06T03:02:38.872801+0000","last_fullsized":"2023-10-06T03:02:38.872801+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:58:25.908183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":29,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T03:02:37.833264+0000","last_change":"2023-10-06T03:00:51.903388+0000","last_active":"2023-10-06T03:02:37.833264+0000","last_peered":"2023-10-06T03:02:37.833264+0000","last_clean":"2023-10-06T03:02:37.833264+0000","last_became_active":"2023-10-06T03:00:51.902959+0000","last_became_peered":"2023-10-06T03:00:51.902959+0000","last_unstale":"2023-10-06T03:02:37.833264+0000","last_undegraded":"2023-10-06T03:02:37.833264+0000","last_fullsized":"2023-10-06T03:02:37.833264+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:30:16.907470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.849170+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:18.879270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.872473+0000","last_change":"2023-10-06T03:02:38.872473+0000","last_active":"2023-10-06T03:02:38.872473+0000","last_peered":"2023-10-06T03:02:38.872473+0000","last_clean":"2023-10-06T03:02:38.872473+0000","last_became_active":"2023-10-06T03:02:38.871994+0000","last_became_peered":"2023-10-06T03:02:38.871994+0000","last_unstale":"2023-10-06T03:02:38.872473+0000","last_undegraded":"2023-10-06T03:02:38.872473+0000","last_fullsized":"2023-10-06T03:02:38.872473+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:23:17.200260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":31,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T03:02:37.833840+0000","last_change":"2023-10-06T03:00:51.903242+0000","last_active":"2023-10-06T03:02:37.833840+0000","last_peered":"2023-10-06T03:02:37.833840+0000","last_clean":"2023-10-06T03:02:37.833840+0000","last_became_active":"2023-10-06T03:00:51.902929+0000","last_became_peered":"2023-10-06T03:00:51.902929+0000","last_unstale":"2023-10-06T03:02:37.833840+0000","last_undegraded":"2023-10-06T03:02:37.833840+0000","last_fullsized":"2023-10-06T03:02:37.833840+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:34:12.274158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574874,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302504,"kb_used_data":1120,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069336,"statfs":{"total":96636764160,"available":96327000064,"internally_reserved":0,"allocated":1146880,"data_stored":825698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"min":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":4.7930000000000001,"5min":4.7930000000000001,"15min":4.7930000000000001},"last":0.89000000000000001},{"interface":"front","average":{"1min":1.5780000000000001,"5min":1.5780000000000001,"15min":1.5780000000000001},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":9.9689999999999994,"5min":9.9689999999999994,"15min":9.9689999999999994},"last":0.92700000000000005}]},{"osd":1,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":10.867000000000001,"5min":10.867000000000001,"15min":10.867000000000001},"last":1.2450000000000001},{"interface":"front","average":{"1min":1.6779999999999999,"5min":1.6779999999999999,"15min":1.6779999999999999},"min":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":10.255000000000001,"5min":10.255000000000001,"15min":10.255000000000001},"last":1.3580000000000001}]},{"osd":2,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.6799999999999999,"5min":1.6799999999999999,"15min":1.6799999999999999},"min":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"max":{"1min":7.9939999999999998,"5min":7.9939999999999998,"15min":7.9939999999999998},"last":1.391},{"interface":"front","average":{"1min":1.6970000000000001,"5min":1.6970000000000001,"15min":1.6970000000000001},"min":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"max":{"1min":10.098000000000001,"5min":10.098000000000001,"15min":10.098000000000001},"last":1.421}]},{"osd":3,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"min":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"max":{"1min":4.3090000000000002,"5min":4.3090000000000002,"15min":4.3090000000000002},"last":1.167},{"interface":"front","average":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"min":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":8.3770000000000007,"5min":8.3770000000000007,"15min":8.3770000000000007},"last":1.04}]},{"osd":4,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.7889999999999999,"5min":1.7889999999999999,"15min":1.7889999999999999},"min":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"max":{"1min":11.391999999999999,"5min":11.391999999999999,"15min":11.391999999999999},"last":1.21},{"interface":"front","average":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"min":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"max":{"1min":3.9220000000000002,"5min":3.9220000000000002,"15min":3.9220000000000002},"last":1.4730000000000001}]},{"osd":5,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.796,"5min":1.796,"15min":1.796},"min":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"max":{"1min":11.951000000000001,"5min":11.951000000000001,"15min":11.951000000000001},"last":1.323},{"interface":"front","average":{"1min":1.9259999999999999,"5min":1.9259999999999999,"15min":1.9259999999999999},"min":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"max":{"1min":10.994999999999999,"5min":10.994999999999999,"15min":10.994999999999999},"last":1.109}]},{"osd":6,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.9890000000000001,"5min":1.9890000000000001,"15min":1.9890000000000001},"min":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"max":{"1min":11.513,"5min":11.513,"15min":11.513},"last":1.444},{"interface":"front","average":{"1min":1.958,"5min":1.958,"15min":1.958},"min":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"max":{"1min":10.714,"5min":10.714,"15min":10.714},"last":1.286}]}]},{"osd":6,"up_from":13,"seq":55834574874,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297840,"kb_used_data":552,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074000,"statfs":{"total":96636764160,"available":96331776000,"internally_reserved":0,"allocated":565248,"data_stored":241946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":0.79900000000000004},{"interface":"front","average":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":2.1419999999999999,"5min":2.1419999999999999,"15min":2.1419999999999999},"last":0.99299999999999999}]},{"osd":1,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"min":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"max":{"1min":1.9159999999999999,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":0.93899999999999995},{"interface":"front","average":{"1min":1.256,"5min":1.256,"15min":1.256},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":1.677,"5min":1.677,"15min":1.677},"last":0.90200000000000002}]},{"osd":2,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.167,"15min":1.167},"min":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":1.659,"5min":1.659,"15min":1.659},"last":0.83699999999999997},{"interface":"front","average":{"1min":1.236,"5min":1.236,"15min":1.236},"min":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"max":{"1min":1.78,"5min":1.78,"15min":1.78},"last":0.86899999999999999}]},{"osd":3,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.284,"5min":1.284,"15min":1.284},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":0.75900000000000001},{"interface":"front","average":{"1min":1.343,"5min":1.343,"15min":1.343},"min":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":2.2200000000000002,"5min":2.2200000000000002,"15min":2.2200000000000002},"last":0.72199999999999998}]},{"osd":4,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.286,"5min":1.286,"15min":1.286},"min":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"max":{"1min":1.889,"5min":1.889,"15min":1.889},"last":0.69999999999999996},{"interface":"front","average":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"min":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":2.2610000000000001,"5min":2.2610000000000001,"15min":2.2610000000000001},"last":0.91700000000000004}]},{"osd":5,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"min":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"max":{"1min":1.994,"5min":1.994,"15min":1.994},"last":1.0169999999999999},{"interface":"front","average":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"min":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"max":{"1min":2.0129999999999999,"5min":2.0129999999999999,"15min":2.0129999999999999},"last":0.95799999999999996}]},{"osd":7,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"min":{"1min":1.016,"5min":1.016,"15min":1.016},"max":{"1min":2.0920000000000001,"5min":2.0920000000000001,"15min":2.0920000000000001},"last":1.0449999999999999},{"interface":"front","average":{"1min":1.5469999999999999,"5min":1.5469999999999999,"15min":1.5469999999999999},"min":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"max":{"1min":2.0310000000000001,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":1.0589999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574874,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297840,"kb_used_data":552,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074000,"statfs":{"total":96636764160,"available":96331776000,"internally_reserved":0,"allocated":565248,"data_stored":241946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":1.1539999999999999},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.5,"5min":1.5,"15min":1.5},"last":1.3640000000000001}]},{"osd":1,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"min":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":1.984,"5min":1.984,"15min":1.984},"last":1.0029999999999999},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.708,"5min":1.708,"15min":1.708},"last":1.1990000000000001}]},{"osd":2,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.395,"5min":1.395,"15min":1.395},"min":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"max":{"1min":1.78,"5min":1.78,"15min":1.78},"last":1.3979999999999999},{"interface":"front","average":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"min":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":2.8319999999999999,"5min":2.8319999999999999,"15min":2.8319999999999999},"last":1.4099999999999999}]},{"osd":3,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"min":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":3.1789999999999998,"5min":3.1789999999999998,"15min":3.1789999999999998},"last":1.1140000000000001},{"interface":"front","average":{"1min":1.272,"5min":1.272,"15min":1.272},"min":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"max":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":1.327}]},{"osd":4,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":1.302,"15min":1.302},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":2.5899999999999999,"5min":2.5899999999999999,"15min":2.5899999999999999},"last":1.2869999999999999},{"interface":"front","average":{"1min":1.516,"5min":1.516,"15min":1.516},"min":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"max":{"1min":4.5419999999999998,"5min":4.5419999999999998,"15min":4.5419999999999998},"last":1.48}]},{"osd":6,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.847,"5min":1.847,"15min":1.847},"last":1.506},{"interface":"front","average":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"min":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":2.9239999999999999,"5min":2.9239999999999999,"15min":2.9239999999999999},"last":1.5329999999999999}]},{"osd":7,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":4.4489999999999998,"5min":4.4489999999999998,"15min":4.4489999999999998},"last":1.2509999999999999},{"interface":"front","average":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"min":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"max":{"1min":1.98,"5min":1.98,"15min":1.98},"last":1.454}]}]},{"osd":4,"up_from":13,"seq":55834574873,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297840,"kb_used_data":552,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074000,"statfs":{"total":96636764160,"available":96331776000,"internally_reserved":0,"allocated":565248,"data_stored":241946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.6040000000000001,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":0.84199999999999997},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.585,"5min":1.585,"15min":1.585},"last":1.1559999999999999}]},{"osd":1,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.403,"5min":1.403,"15min":1.403},"last":1.244},{"interface":"front","average":{"1min":1.169,"5min":1.169,"15min":1.169},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.73,"5min":1.73,"15min":1.73},"last":1.1279999999999999}]},{"osd":2,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.696,"5min":1.696,"15min":1.696},"last":1.425},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":1.788,"5min":1.788,"15min":1.788},"last":1.1850000000000001}]},{"osd":3,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.248,"15min":1.248},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.625,"5min":1.625,"15min":1.625},"last":0.996},{"interface":"front","average":{"1min":1.232,"5min":1.232,"15min":1.232},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.7629999999999999,"5min":1.7629999999999999,"15min":1.7629999999999999},"last":1.089}]},{"osd":5,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.198,"5min":1.198,"15min":1.198},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.71,"5min":1.71,"15min":1.71},"last":0.56799999999999995},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.7889999999999999,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":1.212}]},{"osd":6,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":2.9100000000000001,"5min":2.9100000000000001,"15min":2.9100000000000001},"last":0.93500000000000005},{"interface":"front","average":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":3.282,"5min":3.282,"15min":3.282},"last":0.74299999999999999}]},{"osd":7,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.544,"5min":1.544,"15min":1.544},"min":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"max":{"1min":2.145,"5min":2.145,"15min":2.145},"last":1.286},{"interface":"front","average":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"min":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.927,"5min":1.927,"15min":1.927},"last":1.341}]}]},{"osd":3,"up_from":13,"seq":55834574873,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301936,"kb_used_data":552,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069904,"statfs":{"total":96636764160,"available":96327581696,"internally_reserved":0,"allocated":565248,"data_stored":241946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:01:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":2.298,"5min":2.298,"15min":2.298},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.998,"5min":0.998,"15min":0.998},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":2.1850000000000001,"5min":2.1850000000000001,"15min":2.1850000000000001},"last":0.60699999999999998}]},{"osd":1,"last update":"Fri Oct 6 03:01:46 2023","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.974,"5min":1.974,"15min":1.974},"last":0.58599999999999997},{"interface":"front","average":{"1min":1.137,"5min":1.137,"15min":1.137},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.71,"5min":1.71,"15min":1.71},"last":0.63700000000000001}]},{"osd":2,"last update":"Fri Oct 6 03:01:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":2.8849999999999998,"5min":2.8849999999999998,"15min":2.8849999999999998},"last":0.44500000000000001},{"interface":"front","average":{"1min":1.095,"5min":1.095,"15min":1.095},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":2.8220000000000001,"5min":2.8220000000000001,"15min":2.8220000000000001},"last":0.86699999999999999}]},{"osd":4,"last update":"Fri Oct 6 03:01:46 2023","interfaces":[{"interface":"back","average":{"1min":1.456,"5min":1.456,"15min":1.456},"min":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"max":{"1min":3.6560000000000001,"5min":3.6560000000000001,"15min":3.6560000000000001},"last":0.751},{"interface":"front","average":{"1min":1.466,"5min":1.466,"15min":1.466},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":3.7749999999999999,"5min":3.7749999999999999,"15min":3.7749999999999999},"last":0.76800000000000002}]},{"osd":5,"last update":"Fri Oct 6 03:01:46 2023","interfaces":[{"interface":"back","average":{"1min":1.534,"5min":1.534,"15min":1.534},"min":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"max":{"1min":3.4910000000000001,"5min":3.4910000000000001,"15min":3.4910000000000001},"last":0.83099999999999996},{"interface":"front","average":{"1min":1.494,"5min":1.494,"15min":1.494},"min":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"max":{"1min":2.6240000000000001,"5min":2.6240000000000001,"15min":2.6240000000000001},"last":1.101}]},{"osd":6,"last update":"Fri Oct 6 03:01:46 2023","interfaces":[{"interface":"back","average":{"1min":1.5780000000000001,"5min":1.5780000000000001,"15min":1.5780000000000001},"min":{"1min":1.046,"5min":1.046,"15min":1.046},"max":{"1min":3.7050000000000001,"5min":3.7050000000000001,"15min":3.7050000000000001},"last":0.84599999999999997},{"interface":"front","average":{"1min":1.583,"5min":1.583,"15min":1.583},"min":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"max":{"1min":3.9300000000000002,"5min":3.9300000000000002,"15min":3.9300000000000002},"last":0.80900000000000005}]},{"osd":7,"last update":"Fri Oct 6 03:01:46 2023","interfaces":[{"interface":"back","average":{"1min":1.635,"5min":1.635,"15min":1.635},"min":{"1min":1.149,"5min":1.149,"15min":1.149},"max":{"1min":2.96,"5min":2.96,"15min":2.96},"last":1.0369999999999999},{"interface":"front","average":{"1min":1.7729999999999999,"5min":1.7729999999999999,"15min":1.7729999999999999},"min":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"max":{"1min":3.8559999999999999,"5min":3.8559999999999999,"15min":3.8559999999999999},"last":0.90600000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574873,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301924,"kb_used_data":540,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069916,"statfs":{"total":96636764160,"available":96327593984,"internally_reserved":0,"allocated":552960,"data_stored":235330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.6950000000000001,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":1.165},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":0.79100000000000004}]},{"osd":1,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.5449999999999999,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":1.2889999999999999},{"interface":"front","average":{"1min":1.232,"5min":1.232,"15min":1.232},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":2.1800000000000002,"5min":2.1800000000000002,"15min":2.1800000000000002},"last":0.99099999999999999}]},{"osd":3,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.91300000000000003},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":2.806,"5min":2.806,"15min":2.806},"last":1.0349999999999999}]},{"osd":4,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.389,"5min":1.389,"15min":1.389},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":2.1739999999999999,"5min":2.1739999999999999,"15min":2.1739999999999999},"last":1.3939999999999999},{"interface":"front","average":{"1min":1.458,"5min":1.458,"15min":1.458},"min":{"1min":1,"5min":1,"15min":1},"max":{"1min":3.028,"5min":3.028,"15min":3.028},"last":1.4219999999999999}]},{"osd":5,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.55,"5min":1.55,"15min":1.55},"min":{"1min":1.036,"5min":1.036,"15min":1.036},"max":{"1min":3.1499999999999999,"5min":3.1499999999999999,"15min":3.1499999999999999},"last":1.3380000000000001},{"interface":"front","average":{"1min":1.512,"5min":1.512,"15min":1.512},"min":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"max":{"1min":2.8580000000000001,"5min":2.8580000000000001,"15min":2.8580000000000001},"last":1.3500000000000001}]},{"osd":6,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"min":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"max":{"1min":2.6659999999999999,"5min":2.6659999999999999,"15min":2.6659999999999999},"last":1.115},{"interface":"front","average":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"min":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"max":{"1min":2.411,"5min":2.411,"15min":2.411},"last":1.458}]},{"osd":7,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"min":{"1min":1.01,"5min":1.01,"15min":1.01},"max":{"1min":3.2160000000000002,"5min":3.2160000000000002,"15min":3.2160000000000002},"last":1.2110000000000001},{"interface":"front","average":{"1min":1.631,"5min":1.631,"15min":1.631},"min":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"max":{"1min":3.1059999999999999,"5min":3.1059999999999999,"15min":3.1059999999999999},"last":1.2370000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574874,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301924,"kb_used_data":540,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069916,"statfs":{"total":96636764160,"available":96327593984,"internally_reserved":0,"allocated":552960,"data_stored":235330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.7749999999999999,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":0.96699999999999997},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":2.3260000000000001,"5min":2.3260000000000001,"15min":2.3260000000000001},"last":1.135}]},{"osd":2,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":3.5459999999999998,"5min":3.5459999999999998,"15min":3.5459999999999998},"last":1.0309999999999999},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.706,"5min":1.706,"15min":1.706},"last":1.226}]},{"osd":3,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.625,"5min":1.625,"15min":1.625},"last":1.3049999999999999},{"interface":"front","average":{"1min":1.196,"5min":1.196,"15min":1.196},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":3.331,"5min":3.331,"15min":3.331},"last":1.504}]},{"osd":4,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.339,"5min":1.339,"15min":1.339},"min":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"max":{"1min":1.8660000000000001,"5min":1.8660000000000001,"15min":1.8660000000000001},"last":1.196},{"interface":"front","average":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":3.2250000000000001,"5min":3.2250000000000001,"15min":3.2250000000000001},"last":1.2490000000000001}]},{"osd":5,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"min":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"max":{"1min":2.8439999999999999,"5min":2.8439999999999999,"15min":2.8439999999999999},"last":1.1100000000000001},{"interface":"front","average":{"1min":1.484,"5min":1.484,"15min":1.484},"min":{"1min":1.01,"5min":1.01,"15min":1.01},"max":{"1min":2.4590000000000001,"5min":2.4590000000000001,"15min":2.4590000000000001},"last":1.4550000000000001}]},{"osd":6,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"min":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"max":{"1min":2.96,"5min":2.96,"15min":2.96},"last":1.371},{"interface":"front","average":{"1min":1.504,"5min":1.504,"15min":1.504},"min":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"max":{"1min":2.5859999999999999,"5min":2.5859999999999999,"15min":2.5859999999999999},"last":1.548}]},{"osd":7,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.6040000000000001,"5min":1.6040000000000001,"15min":1.6040000000000001},"min":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"max":{"1min":3.4460000000000002,"5min":3.4460000000000002,"15min":3.4460000000000002},"last":1.3859999999999999},{"interface":"front","average":{"1min":1.538,"5min":1.538,"15min":1.538},"min":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"max":{"1min":3.113,"5min":3.113,"15min":3.113},"last":1.427}]}]},{"osd":0,"up_from":13,"seq":55834574873,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302504,"kb_used_data":1120,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069336,"statfs":{"total":96636764160,"available":96327000064,"internally_reserved":0,"allocated":1146880,"data_stored":825698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.381,"5min":1.381,"15min":1.381},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.999,"5min":0.999,"15min":0.999},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":1.1319999999999999}]},{"osd":2,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":1.26},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.794,"5min":1.794,"15min":1.794},"last":1.484}]},{"osd":3,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.532,"5min":1.532,"15min":1.532},"last":0.70499999999999996},{"interface":"front","average":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.613,"5min":1.613,"15min":1.613},"last":0.88800000000000001}]},{"osd":4,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"min":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"max":{"1min":2.0680000000000001,"5min":2.0680000000000001,"15min":2.0680000000000001},"last":1.4139999999999999},{"interface":"front","average":{"1min":1.339,"5min":1.339,"15min":1.339},"min":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"max":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":1.4450000000000001}]},{"osd":5,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"min":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"max":{"1min":1.893,"5min":1.893,"15min":1.893},"last":1.5680000000000001},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"min":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":2.2080000000000002,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":1.2070000000000001}]},{"osd":6,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.421,"5min":1.421,"15min":1.421},"min":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"max":{"1min":1.96,"5min":1.96,"15min":1.96},"last":1.52},{"interface":"front","average":{"1min":1.552,"5min":1.552,"15min":1.552},"min":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"max":{"1min":1.9910000000000001,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":1.2949999999999999}]},{"osd":7,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.6319999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"min":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"max":{"1min":2.1019999999999999,"5min":2.1019999999999999,"15min":2.1019999999999999},"last":1.349},{"interface":"front","average":{"1min":1.431,"5min":1.431,"15min":1.431},"min":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"max":{"1min":2.1499999999999999,"5min":2.1499999999999999,"15min":2.1499999999999999},"last":1.3220000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:02:44.577 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:02:44.779 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.774+0000 7fc211a6b700 1 Processor -- start 2023-10-06T03:02:44.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.774+0000 7fc211a6b700 1 -- start start 2023-10-06T03:02:44.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.774+0000 7fc211a6b700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fc20c06d400 0x7fc20c15dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:44.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.774+0000 7fc211a6b700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc20c15e1f0 0x7fc20c1605d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:44.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.774+0000 7fc211a6b700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc20c06b4a0 con 0x7fc20c06c920 2023-10-06T03:02:44.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.774+0000 7fc211a6b700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc20c0af9d0 con 0x7fc20c06d400 2023-10-06T03:02:44.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.774+0000 7fc211a6b700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc20c06a890 con 0x7fc20c15e1f0 2023-10-06T03:02:44.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.774+0000 7fc21126a700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc20c15e1f0 0x7fc20c1605d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:44.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.774+0000 7fc203fff700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fc20c06d400 0x7fc20c15dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:44.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.774+0000 7fc210a69700 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7fc20c06c920 0x7fc20c06ccf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.57:49482/0 (socket says 172.21.15.57:49482) 2023-10-06T03:02:44.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.774+0000 7fc210a69700 1 -- 172.21.15.57:0/3452354763 learned_addr learned my addr 172.21.15.57:0/3452354763 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:02:44.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.778+0000 7fc203fff700 1 -- 172.21.15.57:0/3452354763 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc20c15e1f0 msgr2=0x7fc20c1605d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:44.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.778+0000 7fc203fff700 1 --2- 172.21.15.57:0/3452354763 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc20c15e1f0 0x7fc20c1605d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:44.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.778+0000 7fc203fff700 1 -- 172.21.15.57:0/3452354763 >> v1:172.21.15.105:6789/0 conn(0x7fc20c06c920 legacy=0x7fc20c06ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:44.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.778+0000 7fc2037fe700 1 -- 172.21.15.57:0/3452354763 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1372344809 0 0) 0x7fc20c06b4a0 con 0x7fc20c06c920 2023-10-06T03:02:44.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.778+0000 7fc203fff700 1 -- 172.21.15.57:0/3452354763 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc20c06ab70 con 0x7fc20c06d400 2023-10-06T03:02:44.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.778+0000 7fc203fff700 1 --2- 172.21.15.57:0/3452354763 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc20c06d400 0x7fc20c15dcb0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fc1fc0098e0 tx=0x7fc1fc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=79776c9a391a3900 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:44.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.778+0000 7fc2037fe700 1 -- 172.21.15.57:0/3452354763 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1fc00b640 con 0x7fc20c06d400 2023-10-06T03:02:44.785 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.778+0000 7fc2037fe700 1 -- 172.21.15.57:0/3452354763 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1fc00b7a0 con 0x7fc20c06d400 2023-10-06T03:02:44.785 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.778+0000 7fc2037fe700 1 -- 172.21.15.57:0/3452354763 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1fc00bb40 con 0x7fc20c06d400 2023-10-06T03:02:44.785 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.778+0000 7fc211a6b700 1 -- 172.21.15.57:0/3452354763 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc20c06d400 msgr2=0x7fc20c15dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:44.785 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.778+0000 7fc211a6b700 1 --2- 172.21.15.57:0/3452354763 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc20c06d400 0x7fc20c15dcb0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fc1fc0098e0 tx=0x7fc1fc0091a0 comp rx=0 tx=0).stop 2023-10-06T03:02:44.786 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.778+0000 7fc211a6b700 1 -- 172.21.15.57:0/3452354763 shutdown_connections 2023-10-06T03:02:44.786 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.778+0000 7fc211a6b700 1 --2- 172.21.15.57:0/3452354763 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc20c15e1f0 0x7fc20c1605d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:44.786 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.778+0000 7fc211a6b700 1 --2- 172.21.15.57:0/3452354763 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc20c06d400 0x7fc20c15dcb0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:44.786 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.778+0000 7fc211a6b700 1 -- 172.21.15.57:0/3452354763 >> 172.21.15.57:0/3452354763 conn(0x7fc20c0c85e0 msgr2=0x7fc20c0c89e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:44.786 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.778+0000 7fc211a6b700 1 -- 172.21.15.57:0/3452354763 shutdown_connections 2023-10-06T03:02:44.786 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.778+0000 7fc211a6b700 1 -- 172.21.15.57:0/3452354763 wait complete. 2023-10-06T03:02:44.787 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.782+0000 7fc211a6b700 1 Processor -- start 2023-10-06T03:02:44.787 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.782+0000 7fc211a6b700 1 -- start start 2023-10-06T03:02:44.789 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.782+0000 7fc211a6b700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc20c06c920 0x7fc20c169d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:44.789 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.782+0000 7fc211a6b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc20c06d400 0x7fc20c159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:44.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.782+0000 7fc211a6b700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc20c15e1f0 0x7fc20c0c6530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:44.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.782+0000 7fc211a6b700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc20c0c45f0 con 0x7fc20c06d400 2023-10-06T03:02:44.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.782+0000 7fc211a6b700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc20c0c4ce0 con 0x7fc20c15e1f0 2023-10-06T03:02:44.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.782+0000 7fc211a6b700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc20c16cec0 con 0x7fc20c06c920 2023-10-06T03:02:44.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.782+0000 7fc203fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc20c06d400 0x7fc20c159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:44.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.782+0000 7fc203fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc20c06d400 0x7fc20c159fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:59600/0 (socket says 172.21.15.57:59600) 2023-10-06T03:02:44.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.782+0000 7fc203fff700 1 -- 172.21.15.57:0/2159834450 learned_addr learned my addr 172.21.15.57:0/2159834450 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:02:44.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.782+0000 7fc21126a700 1 --2- 172.21.15.57:0/2159834450 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc20c15e1f0 0x7fc20c0c6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:44.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.782+0000 7fc210a69700 1 --2- 172.21.15.57:0/2159834450 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc20c06c920 0x7fc20c169d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:44.791 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.782+0000 7fc203fff700 1 -- 172.21.15.57:0/2159834450 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc20c06c920 msgr2=0x7fc20c169d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:44.791 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.782+0000 7fc203fff700 1 --2- 172.21.15.57:0/2159834450 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc20c06c920 0x7fc20c169d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:44.792 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.782+0000 7fc203fff700 1 -- 172.21.15.57:0/2159834450 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc20c15e1f0 msgr2=0x7fc20c0c6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:44.792 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.782+0000 7fc203fff700 1 --2- 172.21.15.57:0/2159834450 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc20c15e1f0 0x7fc20c0c6530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:44.792 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.782+0000 7fc203fff700 1 -- 172.21.15.57:0/2159834450 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1fc009420 con 0x7fc20c06d400 2023-10-06T03:02:44.792 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.786+0000 7fc203fff700 1 --2- 172.21.15.57:0/2159834450 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc20c06d400 0x7fc20c159fa0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fc1fc0093f0 tx=0x7fc1fc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:44.792 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.786+0000 7fc200ff9700 1 -- 172.21.15.57:0/2159834450 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1fc00bb20 con 0x7fc20c06d400 2023-10-06T03:02:44.792 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.786+0000 7fc200ff9700 1 -- 172.21.15.57:0/2159834450 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1fc011420 con 0x7fc20c06d400 2023-10-06T03:02:44.792 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.786+0000 7fc200ff9700 1 -- 172.21.15.57:0/2159834450 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1fc011800 con 0x7fc20c06d400 2023-10-06T03:02:44.792 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.786+0000 7fc211a6b700 1 -- 172.21.15.57:0/2159834450 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc20c16d1a0 con 0x7fc20c06d400 2023-10-06T03:02:44.792 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.786+0000 7fc211a6b700 1 -- 172.21.15.57:0/2159834450 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc20c15a4e0 con 0x7fc20c06d400 2023-10-06T03:02:44.793 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.786+0000 7fc211a6b700 1 -- 172.21.15.57:0/2159834450 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc20c0c4b30 con 0x7fc20c06d400 2023-10-06T03:02:44.794 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.786+0000 7fc200ff9700 1 -- 172.21.15.57:0/2159834450 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fc1fc011c30 con 0x7fc20c06d400 2023-10-06T03:02:44.796 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.790+0000 7fc200ff9700 1 --2- 172.21.15.57:0/2159834450 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fc1f8060550 0x7fc1f8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:44.796 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.790+0000 7fc200ff9700 1 -- 172.21.15.57:0/2159834450 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc1fc07e3b0 con 0x7fc20c06d400 2023-10-06T03:02:44.796 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.790+0000 7fc210a69700 1 --2- 172.21.15.57:0/2159834450 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fc1f8060550 0x7fc1f8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:44.797 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.790+0000 7fc210a69700 1 --2- 172.21.15.57:0/2159834450 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fc1f8060550 0x7fc1f8062a00 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fc208001560 tx=0x7fc208009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:44.801 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.794+0000 7fc200ff9700 1 -- 172.21.15.57:0/2159834450 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fc1fc04e7a0 con 0x7fc20c06d400 2023-10-06T03:02:44.973 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.966+0000 7fc211a6b700 1 -- 172.21.15.57:0/2159834450 --> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc20c04be40 con 0x7fc1f8060550 2023-10-06T03:02:44.989 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.982+0000 7fc200ff9700 1 -- 172.21.15.57:0/2159834450 <== mgr.4103 v2:172.21.15.57:6832/32947 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+305875 (secure 0 0 0) 0x7fc20c04be40 con 0x7fc1f8060550 2023-10-06T03:02:44.994 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:02:44.996 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.990+0000 7fc211a6b700 1 -- 172.21.15.57:0/2159834450 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fc1f8060550 msgr2=0x7fc1f8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:44.997 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.990+0000 7fc211a6b700 1 --2- 172.21.15.57:0/2159834450 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fc1f8060550 0x7fc1f8062a00 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fc208001560 tx=0x7fc208009040 comp rx=0 tx=0).stop 2023-10-06T03:02:44.997 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.990+0000 7fc211a6b700 1 -- 172.21.15.57:0/2159834450 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc20c06d400 msgr2=0x7fc20c159fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:44.997 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.990+0000 7fc211a6b700 1 --2- 172.21.15.57:0/2159834450 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc20c06d400 0x7fc20c159fa0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fc1fc0093f0 tx=0x7fc1fc017000 comp rx=0 tx=0).stop 2023-10-06T03:02:44.997 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.990+0000 7fc211a6b700 1 -- 172.21.15.57:0/2159834450 shutdown_connections 2023-10-06T03:02:44.997 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.990+0000 7fc211a6b700 1 --2- 172.21.15.57:0/2159834450 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc20c15e1f0 0x7fc20c0c6530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:44.997 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.990+0000 7fc211a6b700 1 --2- 172.21.15.57:0/2159834450 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc20c06d400 0x7fc20c159fa0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:44.997 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.990+0000 7fc211a6b700 1 --2- 172.21.15.57:0/2159834450 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fc1f8060550 0x7fc1f8062a00 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:44.997 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.990+0000 7fc211a6b700 1 --2- 172.21.15.57:0/2159834450 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc20c06c920 0x7fc20c169d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:44.997 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.990+0000 7fc211a6b700 1 -- 172.21.15.57:0/2159834450 >> 172.21.15.57:0/2159834450 conn(0x7fc20c0c85e0 msgr2=0x7fc20c0aa8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:44.998 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.990+0000 7fc211a6b700 1 -- 172.21.15.57:0/2159834450 shutdown_connections 2023-10-06T03:02:44.998 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:44.990+0000 7fc211a6b700 1 -- 172.21.15.57:0/2159834450 wait complete. 2023-10-06T03:02:44.999 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2023-10-06T03:02:45.017 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":103,"stamp":"2023-10-06T03:02:44.305862+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":67,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2404312,"kb_used_data":5528,"kb_used_omap":0,"kb_used_meta":2398720,"kb_avail":752570408,"statfs":{"total":773094113280,"available":770632097792,"internally_reserved":0,"allocated":5660672,"data_stored":3089840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2456289280},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001560"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.845590+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:29:10.864990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.845802+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:27:35.234159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.851319+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:29:30.158378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.847718+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:18.879270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.841376+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:06:26.036575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.847453+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:23:18.217898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.854346+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:53:57.831764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.862103+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:17:48.382984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.862874+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:28:01.768786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.845785+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:06:26.036575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.841036+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:44:39.912786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.864917+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:17:46.359437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.846156+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:58:26.925821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.851625+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:41:45.880609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.845061+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:06:26.036575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.844877+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:58:03.418004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.853710+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:40:05.112188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.845091+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:58:26.925821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.850808+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:47:29.067808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.847201+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:02:36.798629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.847460+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:16:22.934040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.860493+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:18.879270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.841921+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:02:36.798629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.849036+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:27:35.234159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.851108+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:17:48.382984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.865759+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:40:05.112188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.843612+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:37:35.950737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.846351+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:43:59.979418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.850023+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:46:40.611565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.846537+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:12:14.521260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.853140+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:17:46.359437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.851907+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:17:48.382984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.845465+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:03:37.092106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.856515+0000","last_change":"2023-10-06T03:02:38.856515+0000","last_active":"2023-10-06T03:02:38.856515+0000","last_peered":"2023-10-06T03:02:38.856515+0000","last_clean":"2023-10-06T03:02:38.856515+0000","last_became_active":"2023-10-06T03:02:38.856154+0000","last_became_peered":"2023-10-06T03:02:38.856154+0000","last_unstale":"2023-10-06T03:02:38.856515+0000","last_undegraded":"2023-10-06T03:02:38.856515+0000","last_fullsized":"2023-10-06T03:02:38.856515+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:31:46.112896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.849055+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:12:14.521260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.870422+0000","last_change":"2023-10-06T03:02:38.870422+0000","last_active":"2023-10-06T03:02:38.870422+0000","last_peered":"2023-10-06T03:02:38.870422+0000","last_clean":"2023-10-06T03:02:38.870422+0000","last_became_active":"2023-10-06T03:02:38.869951+0000","last_became_peered":"2023-10-06T03:02:38.869951+0000","last_unstale":"2023-10-06T03:02:38.870422+0000","last_undegraded":"2023-10-06T03:02:38.870422+0000","last_fullsized":"2023-10-06T03:02:38.870422+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:01:14.978500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.846743+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:44:39.912786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.858140+0000","last_change":"2023-10-06T03:02:38.858140+0000","last_active":"2023-10-06T03:02:38.858140+0000","last_peered":"2023-10-06T03:02:38.858140+0000","last_clean":"2023-10-06T03:02:38.858140+0000","last_became_active":"2023-10-06T03:02:38.857805+0000","last_became_peered":"2023-10-06T03:02:38.857805+0000","last_unstale":"2023-10-06T03:02:38.858140+0000","last_undegraded":"2023-10-06T03:02:38.858140+0000","last_fullsized":"2023-10-06T03:02:38.858140+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:14:55.765174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.861373+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:46:40.611565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.873915+0000","last_change":"2023-10-06T03:02:38.873915+0000","last_active":"2023-10-06T03:02:38.873915+0000","last_peered":"2023-10-06T03:02:38.873915+0000","last_clean":"2023-10-06T03:02:38.873915+0000","last_became_active":"2023-10-06T03:02:38.873404+0000","last_became_peered":"2023-10-06T03:02:38.873404+0000","last_unstale":"2023-10-06T03:02:38.873915+0000","last_undegraded":"2023-10-06T03:02:38.873915+0000","last_fullsized":"2023-10-06T03:02:38.873915+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:58:25.908183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.840383+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:14:47.594861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.857653+0000","last_change":"2023-10-06T03:02:38.857653+0000","last_active":"2023-10-06T03:02:38.857653+0000","last_peered":"2023-10-06T03:02:38.857653+0000","last_clean":"2023-10-06T03:02:38.857653+0000","last_became_active":"2023-10-06T03:02:38.857368+0000","last_became_peered":"2023-10-06T03:02:38.857368+0000","last_unstale":"2023-10-06T03:02:38.857653+0000","last_undegraded":"2023-10-06T03:02:38.857653+0000","last_fullsized":"2023-10-06T03:02:38.857653+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:04:38.128587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.848288+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:39:42.661414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.854422+0000","last_change":"2023-10-06T03:02:38.854422+0000","last_active":"2023-10-06T03:02:38.854422+0000","last_peered":"2023-10-06T03:02:38.854422+0000","last_clean":"2023-10-06T03:02:38.854422+0000","last_became_active":"2023-10-06T03:02:38.854088+0000","last_became_peered":"2023-10-06T03:02:38.854088+0000","last_unstale":"2023-10-06T03:02:38.854422+0000","last_undegraded":"2023-10-06T03:02:38.854422+0000","last_fullsized":"2023-10-06T03:02:38.854422+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:41:45.591282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.864711+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:12:14.521260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.858755+0000","last_change":"2023-10-06T03:02:38.858755+0000","last_active":"2023-10-06T03:02:38.858755+0000","last_peered":"2023-10-06T03:02:38.858755+0000","last_clean":"2023-10-06T03:02:38.858755+0000","last_became_active":"2023-10-06T03:02:38.858405+0000","last_became_peered":"2023-10-06T03:02:38.858405+0000","last_unstale":"2023-10-06T03:02:38.858755+0000","last_undegraded":"2023-10-06T03:02:38.858755+0000","last_fullsized":"2023-10-06T03:02:38.858755+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:59:48.860090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.845190+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:23:18.217898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.863407+0000","last_change":"2023-10-06T03:02:38.863407+0000","last_active":"2023-10-06T03:02:38.863407+0000","last_peered":"2023-10-06T03:02:38.863407+0000","last_clean":"2023-10-06T03:02:38.863407+0000","last_became_active":"2023-10-06T03:02:38.863081+0000","last_became_peered":"2023-10-06T03:02:38.863081+0000","last_unstale":"2023-10-06T03:02:38.863407+0000","last_undegraded":"2023-10-06T03:02:38.863407+0000","last_fullsized":"2023-10-06T03:02:38.863407+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:58:02.400366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.840362+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:04:39.146225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.860246+0000","last_change":"2023-10-06T03:02:38.860246+0000","last_active":"2023-10-06T03:02:38.860246+0000","last_peered":"2023-10-06T03:02:38.860246+0000","last_clean":"2023-10-06T03:02:38.860246+0000","last_became_active":"2023-10-06T03:02:38.859969+0000","last_became_peered":"2023-10-06T03:02:38.859969+0000","last_unstale":"2023-10-06T03:02:38.860246+0000","last_undegraded":"2023-10-06T03:02:38.860246+0000","last_fullsized":"2023-10-06T03:02:38.860246+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:16:59.767516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.850848+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:46:40.611565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.869322+0000","last_change":"2023-10-06T03:02:38.869322+0000","last_active":"2023-10-06T03:02:38.869322+0000","last_peered":"2023-10-06T03:02:38.869322+0000","last_clean":"2023-10-06T03:02:38.869322+0000","last_became_active":"2023-10-06T03:02:38.868958+0000","last_became_peered":"2023-10-06T03:02:38.868958+0000","last_unstale":"2023-10-06T03:02:38.869322+0000","last_undegraded":"2023-10-06T03:02:38.869322+0000","last_fullsized":"2023-10-06T03:02:38.869322+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:18:12.245614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.851092+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:28:01.768786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.861193+0000","last_change":"2023-10-06T03:02:38.861193+0000","last_active":"2023-10-06T03:02:38.861193+0000","last_peered":"2023-10-06T03:02:38.861193+0000","last_clean":"2023-10-06T03:02:38.861193+0000","last_became_active":"2023-10-06T03:02:38.860904+0000","last_became_peered":"2023-10-06T03:02:38.860904+0000","last_unstale":"2023-10-06T03:02:38.861193+0000","last_undegraded":"2023-10-06T03:02:38.861193+0000","last_fullsized":"2023-10-06T03:02:38.861193+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:04:38.128587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.840714+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:58:03.418004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.871902+0000","last_change":"2023-10-06T03:02:38.871902+0000","last_active":"2023-10-06T03:02:38.871902+0000","last_peered":"2023-10-06T03:02:38.871902+0000","last_clean":"2023-10-06T03:02:38.871902+0000","last_became_active":"2023-10-06T03:02:38.871585+0000","last_became_peered":"2023-10-06T03:02:38.871585+0000","last_unstale":"2023-10-06T03:02:38.871902+0000","last_undegraded":"2023-10-06T03:02:38.871902+0000","last_fullsized":"2023-10-06T03:02:38.871902+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:29:09.847352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.851097+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:47:29.067808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.863229+0000","last_change":"2023-10-06T03:02:38.863229+0000","last_active":"2023-10-06T03:02:38.863229+0000","last_peered":"2023-10-06T03:02:38.863229+0000","last_clean":"2023-10-06T03:02:38.863229+0000","last_became_active":"2023-10-06T03:02:38.862751+0000","last_became_peered":"2023-10-06T03:02:38.862751+0000","last_unstale":"2023-10-06T03:02:38.863229+0000","last_undegraded":"2023-10-06T03:02:38.863229+0000","last_fullsized":"2023-10-06T03:02:38.863229+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:41:45.591282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.850206+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:12:14.521260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.864366+0000","last_change":"2023-10-06T03:02:38.864366+0000","last_active":"2023-10-06T03:02:38.864366+0000","last_peered":"2023-10-06T03:02:38.864366+0000","last_clean":"2023-10-06T03:02:38.864366+0000","last_became_active":"2023-10-06T03:02:38.864042+0000","last_became_peered":"2023-10-06T03:02:38.864042+0000","last_unstale":"2023-10-06T03:02:38.864366+0000","last_undegraded":"2023-10-06T03:02:38.864366+0000","last_fullsized":"2023-10-06T03:02:38.864366+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:14:45.231794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.865305+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:08:51.831968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.858014+0000","last_change":"2023-10-06T03:02:38.858014+0000","last_active":"2023-10-06T03:02:38.858014+0000","last_peered":"2023-10-06T03:02:38.858014+0000","last_clean":"2023-10-06T03:02:38.858014+0000","last_became_active":"2023-10-06T03:02:38.857708+0000","last_became_peered":"2023-10-06T03:02:38.857708+0000","last_unstale":"2023-10-06T03:02:38.858014+0000","last_undegraded":"2023-10-06T03:02:38.858014+0000","last_fullsized":"2023-10-06T03:02:38.858014+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:37:34.933099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.855648+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:19:46.946130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.872336+0000","last_change":"2023-10-06T03:02:38.872336+0000","last_active":"2023-10-06T03:02:38.872336+0000","last_peered":"2023-10-06T03:02:38.872336+0000","last_clean":"2023-10-06T03:02:38.872336+0000","last_became_active":"2023-10-06T03:02:38.871712+0000","last_became_peered":"2023-10-06T03:02:38.871712+0000","last_unstale":"2023-10-06T03:02:38.872336+0000","last_undegraded":"2023-10-06T03:02:38.872336+0000","last_fullsized":"2023-10-06T03:02:38.872336+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:06:25.018937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.861542+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:47:29.067808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.876423+0000","last_change":"2023-10-06T03:02:38.876423+0000","last_active":"2023-10-06T03:02:38.876423+0000","last_peered":"2023-10-06T03:02:38.876423+0000","last_clean":"2023-10-06T03:02:38.876423+0000","last_became_active":"2023-10-06T03:02:38.876118+0000","last_became_peered":"2023-10-06T03:02:38.876118+0000","last_unstale":"2023-10-06T03:02:38.876423+0000","last_undegraded":"2023-10-06T03:02:38.876423+0000","last_fullsized":"2023-10-06T03:02:38.876423+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:58:25.908183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.843494+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:17:00.785154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.861028+0000","last_change":"2023-10-06T03:02:38.861028+0000","last_active":"2023-10-06T03:02:38.861028+0000","last_peered":"2023-10-06T03:02:38.861028+0000","last_clean":"2023-10-06T03:02:38.861028+0000","last_became_active":"2023-10-06T03:02:38.859084+0000","last_became_peered":"2023-10-06T03:02:38.859084+0000","last_unstale":"2023-10-06T03:02:38.861028+0000","last_undegraded":"2023-10-06T03:02:38.861028+0000","last_fullsized":"2023-10-06T03:02:38.861028+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:37:03.894863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.840919+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:29:10.864990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.861356+0000","last_change":"2023-10-06T03:02:38.861356+0000","last_active":"2023-10-06T03:02:38.861356+0000","last_peered":"2023-10-06T03:02:38.861356+0000","last_clean":"2023-10-06T03:02:38.861356+0000","last_became_active":"2023-10-06T03:02:38.861051+0000","last_became_peered":"2023-10-06T03:02:38.861051+0000","last_unstale":"2023-10-06T03:02:38.861356+0000","last_undegraded":"2023-10-06T03:02:38.861356+0000","last_fullsized":"2023-10-06T03:02:38.861356+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:51:34.107940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.843354+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:18:13.263253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.873865+0000","last_change":"2023-10-06T03:02:38.873865+0000","last_active":"2023-10-06T03:02:38.873865+0000","last_peered":"2023-10-06T03:02:38.873865+0000","last_clean":"2023-10-06T03:02:38.873865+0000","last_became_active":"2023-10-06T03:02:38.873448+0000","last_became_peered":"2023-10-06T03:02:38.873448+0000","last_unstale":"2023-10-06T03:02:38.873865+0000","last_undegraded":"2023-10-06T03:02:38.873865+0000","last_fullsized":"2023-10-06T03:02:38.873865+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:01:19.591702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.850589+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:39:42.661414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.861807+0000","last_change":"2023-10-06T03:02:38.861807+0000","last_active":"2023-10-06T03:02:38.861807+0000","last_peered":"2023-10-06T03:02:38.861807+0000","last_clean":"2023-10-06T03:02:38.861807+0000","last_became_active":"2023-10-06T03:02:38.861513+0000","last_became_peered":"2023-10-06T03:02:38.861513+0000","last_unstale":"2023-10-06T03:02:38.861807+0000","last_undegraded":"2023-10-06T03:02:38.861807+0000","last_fullsized":"2023-10-06T03:02:38.861807+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:56:07.918211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.852214+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:18:27.259723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.872303+0000","last_change":"2023-10-06T03:02:38.872303+0000","last_active":"2023-10-06T03:02:38.872303+0000","last_peered":"2023-10-06T03:02:38.872303+0000","last_clean":"2023-10-06T03:02:38.872303+0000","last_became_active":"2023-10-06T03:02:38.871590+0000","last_became_peered":"2023-10-06T03:02:38.871590+0000","last_unstale":"2023-10-06T03:02:38.872303+0000","last_undegraded":"2023-10-06T03:02:38.872303+0000","last_fullsized":"2023-10-06T03:02:38.872303+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:58:02.400366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.849827+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:39:42.661414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.867297+0000","last_change":"2023-10-06T03:02:38.867297+0000","last_active":"2023-10-06T03:02:38.867297+0000","last_peered":"2023-10-06T03:02:38.867297+0000","last_clean":"2023-10-06T03:02:38.867297+0000","last_became_active":"2023-10-06T03:02:38.866855+0000","last_became_peered":"2023-10-06T03:02:38.866855+0000","last_unstale":"2023-10-06T03:02:38.867297+0000","last_undegraded":"2023-10-06T03:02:38.867297+0000","last_fullsized":"2023-10-06T03:02:38.867297+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:29:09.847352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.844058+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:14:47.594861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.860777+0000","last_change":"2023-10-06T03:02:38.860777+0000","last_active":"2023-10-06T03:02:38.860777+0000","last_peered":"2023-10-06T03:02:38.860777+0000","last_clean":"2023-10-06T03:02:38.860777+0000","last_became_active":"2023-10-06T03:02:38.858664+0000","last_became_peered":"2023-10-06T03:02:38.858664+0000","last_unstale":"2023-10-06T03:02:38.860777+0000","last_undegraded":"2023-10-06T03:02:38.860777+0000","last_fullsized":"2023-10-06T03:02:38.860777+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:47:47.993117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.849391+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:48:50.971382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.867362+0000","last_change":"2023-10-06T03:02:38.867362+0000","last_active":"2023-10-06T03:02:38.867362+0000","last_peered":"2023-10-06T03:02:38.867362+0000","last_clean":"2023-10-06T03:02:38.867362+0000","last_became_active":"2023-10-06T03:02:38.863794+0000","last_became_peered":"2023-10-06T03:02:38.863794+0000","last_unstale":"2023-10-06T03:02:38.867362+0000","last_undegraded":"2023-10-06T03:02:38.867362+0000","last_fullsized":"2023-10-06T03:02:38.867362+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:06:25.018937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":185,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T03:02:37.828500+0000","last_change":"2023-10-06T03:00:45.709165+0000","last_active":"2023-10-06T03:02:37.828500+0000","last_peered":"2023-10-06T03:02:37.828500+0000","last_clean":"2023-10-06T03:02:37.828500+0000","last_became_active":"2023-10-06T03:00:45.707771+0000","last_became_peered":"2023-10-06T03:00:45.707771+0000","last_unstale":"2023-10-06T03:02:37.828500+0000","last_undegraded":"2023-10-06T03:02:37.828500+0000","last_fullsized":"2023-10-06T03:02:37.828500+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:44.625353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:44.625353+0000","last_clean_scrub_stamp":"2023-10-06T03:00:44.625353+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:31:31.774239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":31,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T03:02:37.831669+0000","last_change":"2023-10-06T03:00:51.905381+0000","last_active":"2023-10-06T03:02:37.831669+0000","last_peered":"2023-10-06T03:02:37.831669+0000","last_clean":"2023-10-06T03:02:37.831669+0000","last_became_active":"2023-10-06T03:00:51.904974+0000","last_became_peered":"2023-10-06T03:00:51.904974+0000","last_unstale":"2023-10-06T03:02:37.831669+0000","last_undegraded":"2023-10-06T03:02:37.831669+0000","last_fullsized":"2023-10-06T03:02:37.831669+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:15:19.182956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.843912+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:04:39.146225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.858174+0000","last_change":"2023-10-06T03:02:38.858174+0000","last_active":"2023-10-06T03:02:38.858174+0000","last_peered":"2023-10-06T03:02:38.858174+0000","last_clean":"2023-10-06T03:02:38.858174+0000","last_became_active":"2023-10-06T03:02:38.857843+0000","last_became_peered":"2023-10-06T03:02:38.857843+0000","last_unstale":"2023-10-06T03:02:38.858174+0000","last_undegraded":"2023-10-06T03:02:38.858174+0000","last_fullsized":"2023-10-06T03:02:38.858174+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:14:46.577223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":32,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T03:02:37.828379+0000","last_change":"2023-10-06T03:00:51.906480+0000","last_active":"2023-10-06T03:02:37.828379+0000","last_peered":"2023-10-06T03:02:37.828379+0000","last_clean":"2023-10-06T03:02:37.828379+0000","last_became_active":"2023-10-06T03:00:51.905956+0000","last_became_peered":"2023-10-06T03:00:51.905956+0000","last_unstale":"2023-10-06T03:02:37.828379+0000","last_undegraded":"2023-10-06T03:02:37.828379+0000","last_fullsized":"2023-10-06T03:02:37.828379+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:15:19.182956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.860881+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:39:42.661414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.857592+0000","last_change":"2023-10-06T03:02:38.857592+0000","last_active":"2023-10-06T03:02:38.857592+0000","last_peered":"2023-10-06T03:02:38.857592+0000","last_clean":"2023-10-06T03:02:38.857592+0000","last_became_active":"2023-10-06T03:02:38.857248+0000","last_became_peered":"2023-10-06T03:02:38.857248+0000","last_unstale":"2023-10-06T03:02:38.857592+0000","last_undegraded":"2023-10-06T03:02:38.857592+0000","last_fullsized":"2023-10-06T03:02:38.857592+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:14:46.577223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":32,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T03:02:37.831975+0000","last_change":"2023-10-06T03:00:51.902453+0000","last_active":"2023-10-06T03:02:37.831975+0000","last_peered":"2023-10-06T03:02:37.831975+0000","last_clean":"2023-10-06T03:02:37.831975+0000","last_became_active":"2023-10-06T03:00:51.901948+0000","last_became_peered":"2023-10-06T03:00:51.901948+0000","last_unstale":"2023-10-06T03:02:37.831975+0000","last_undegraded":"2023-10-06T03:02:37.831975+0000","last_fullsized":"2023-10-06T03:02:37.831975+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:13:30.721650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.849375+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:27:35.234159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.864320+0000","last_change":"2023-10-06T03:02:38.864320+0000","last_active":"2023-10-06T03:02:38.864320+0000","last_peered":"2023-10-06T03:02:38.864320+0000","last_clean":"2023-10-06T03:02:38.864320+0000","last_became_active":"2023-10-06T03:02:38.864020+0000","last_became_peered":"2023-10-06T03:02:38.864020+0000","last_unstale":"2023-10-06T03:02:38.864320+0000","last_undegraded":"2023-10-06T03:02:38.864320+0000","last_fullsized":"2023-10-06T03:02:38.864320+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:37:03.894863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":31,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T03:02:37.831524+0000","last_change":"2023-10-06T03:00:51.904148+0000","last_active":"2023-10-06T03:02:37.831524+0000","last_peered":"2023-10-06T03:02:37.831524+0000","last_clean":"2023-10-06T03:02:37.831524+0000","last_became_active":"2023-10-06T03:00:51.903729+0000","last_became_peered":"2023-10-06T03:00:51.903729+0000","last_unstale":"2023-10-06T03:02:37.831524+0000","last_undegraded":"2023-10-06T03:02:37.831524+0000","last_fullsized":"2023-10-06T03:02:37.831524+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:17:25.070478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.852876+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:08:51.831968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.867268+0000","last_change":"2023-10-06T03:02:38.867268+0000","last_active":"2023-10-06T03:02:38.867268+0000","last_peered":"2023-10-06T03:02:38.867268+0000","last_clean":"2023-10-06T03:02:38.867268+0000","last_became_active":"2023-10-06T03:02:38.867007+0000","last_became_peered":"2023-10-06T03:02:38.867007+0000","last_unstale":"2023-10-06T03:02:38.867268+0000","last_undegraded":"2023-10-06T03:02:38.867268+0000","last_fullsized":"2023-10-06T03:02:38.867268+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:56:07.918211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":29,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T03:02:37.832579+0000","last_change":"2023-10-06T03:00:52.484317+0000","last_active":"2023-10-06T03:02:37.832579+0000","last_peered":"2023-10-06T03:02:37.832579+0000","last_clean":"2023-10-06T03:02:37.832579+0000","last_became_active":"2023-10-06T03:00:52.483818+0000","last_became_peered":"2023-10-06T03:00:52.483818+0000","last_unstale":"2023-10-06T03:02:37.832579+0000","last_undegraded":"2023-10-06T03:02:37.832579+0000","last_fullsized":"2023-10-06T03:02:37.832579+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:17:24.136459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.859205+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:27:35.234159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.861581+0000","last_change":"2023-10-06T03:02:38.861581+0000","last_active":"2023-10-06T03:02:38.861581+0000","last_peered":"2023-10-06T03:02:38.861581+0000","last_clean":"2023-10-06T03:02:38.861581+0000","last_became_active":"2023-10-06T03:02:38.861190+0000","last_became_peered":"2023-10-06T03:02:38.861190+0000","last_unstale":"2023-10-06T03:02:38.861581+0000","last_undegraded":"2023-10-06T03:02:38.861581+0000","last_fullsized":"2023-10-06T03:02:38.861581+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:23:17.200260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":32,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T03:02:37.829601+0000","last_change":"2023-10-06T03:00:52.485186+0000","last_active":"2023-10-06T03:02:37.829601+0000","last_peered":"2023-10-06T03:02:37.829601+0000","last_clean":"2023-10-06T03:02:37.829601+0000","last_became_active":"2023-10-06T03:00:52.484615+0000","last_became_peered":"2023-10-06T03:00:52.484615+0000","last_unstale":"2023-10-06T03:02:37.829601+0000","last_undegraded":"2023-10-06T03:02:37.829601+0000","last_fullsized":"2023-10-06T03:02:37.829601+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:17:25.070478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.849461+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:18.879270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.872801+0000","last_change":"2023-10-06T03:02:38.872801+0000","last_active":"2023-10-06T03:02:38.872801+0000","last_peered":"2023-10-06T03:02:38.872801+0000","last_clean":"2023-10-06T03:02:38.872801+0000","last_became_active":"2023-10-06T03:02:38.872498+0000","last_became_peered":"2023-10-06T03:02:38.872498+0000","last_unstale":"2023-10-06T03:02:38.872801+0000","last_undegraded":"2023-10-06T03:02:38.872801+0000","last_fullsized":"2023-10-06T03:02:38.872801+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:58:25.908183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":29,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T03:02:37.833264+0000","last_change":"2023-10-06T03:00:51.903388+0000","last_active":"2023-10-06T03:02:37.833264+0000","last_peered":"2023-10-06T03:02:37.833264+0000","last_clean":"2023-10-06T03:02:37.833264+0000","last_became_active":"2023-10-06T03:00:51.902959+0000","last_became_peered":"2023-10-06T03:00:51.902959+0000","last_unstale":"2023-10-06T03:02:37.833264+0000","last_undegraded":"2023-10-06T03:02:37.833264+0000","last_fullsized":"2023-10-06T03:02:37.833264+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:30:16.907470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.849170+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:18.879270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.872473+0000","last_change":"2023-10-06T03:02:38.872473+0000","last_active":"2023-10-06T03:02:38.872473+0000","last_peered":"2023-10-06T03:02:38.872473+0000","last_clean":"2023-10-06T03:02:38.872473+0000","last_became_active":"2023-10-06T03:02:38.871994+0000","last_became_peered":"2023-10-06T03:02:38.871994+0000","last_unstale":"2023-10-06T03:02:38.872473+0000","last_undegraded":"2023-10-06T03:02:38.872473+0000","last_fullsized":"2023-10-06T03:02:38.872473+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:23:17.200260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":31,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T03:02:37.833840+0000","last_change":"2023-10-06T03:00:51.903242+0000","last_active":"2023-10-06T03:02:37.833840+0000","last_peered":"2023-10-06T03:02:37.833840+0000","last_clean":"2023-10-06T03:02:37.833840+0000","last_became_active":"2023-10-06T03:00:51.902929+0000","last_became_peered":"2023-10-06T03:00:51.902929+0000","last_unstale":"2023-10-06T03:02:37.833840+0000","last_undegraded":"2023-10-06T03:02:37.833840+0000","last_fullsized":"2023-10-06T03:02:37.833840+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:34:12.274158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574874,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302504,"kb_used_data":1120,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069336,"statfs":{"total":96636764160,"available":96327000064,"internally_reserved":0,"allocated":1146880,"data_stored":825698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"min":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":4.7930000000000001,"5min":4.7930000000000001,"15min":4.7930000000000001},"last":0.89000000000000001},{"interface":"front","average":{"1min":1.5780000000000001,"5min":1.5780000000000001,"15min":1.5780000000000001},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":9.9689999999999994,"5min":9.9689999999999994,"15min":9.9689999999999994},"last":0.92700000000000005}]},{"osd":1,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":10.867000000000001,"5min":10.867000000000001,"15min":10.867000000000001},"last":1.2450000000000001},{"interface":"front","average":{"1min":1.6779999999999999,"5min":1.6779999999999999,"15min":1.6779999999999999},"min":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":10.255000000000001,"5min":10.255000000000001,"15min":10.255000000000001},"last":1.3580000000000001}]},{"osd":2,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.6799999999999999,"5min":1.6799999999999999,"15min":1.6799999999999999},"min":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"max":{"1min":7.9939999999999998,"5min":7.9939999999999998,"15min":7.9939999999999998},"last":1.391},{"interface":"front","average":{"1min":1.6970000000000001,"5min":1.6970000000000001,"15min":1.6970000000000001},"min":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"max":{"1min":10.098000000000001,"5min":10.098000000000001,"15min":10.098000000000001},"last":1.421}]},{"osd":3,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"min":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"max":{"1min":4.3090000000000002,"5min":4.3090000000000002,"15min":4.3090000000000002},"last":1.167},{"interface":"front","average":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"min":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":8.3770000000000007,"5min":8.3770000000000007,"15min":8.3770000000000007},"last":1.04}]},{"osd":4,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.7889999999999999,"5min":1.7889999999999999,"15min":1.7889999999999999},"min":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"max":{"1min":11.391999999999999,"5min":11.391999999999999,"15min":11.391999999999999},"last":1.21},{"interface":"front","average":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"min":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"max":{"1min":3.9220000000000002,"5min":3.9220000000000002,"15min":3.9220000000000002},"last":1.4730000000000001}]},{"osd":5,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.796,"5min":1.796,"15min":1.796},"min":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"max":{"1min":11.951000000000001,"5min":11.951000000000001,"15min":11.951000000000001},"last":1.323},{"interface":"front","average":{"1min":1.9259999999999999,"5min":1.9259999999999999,"15min":1.9259999999999999},"min":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"max":{"1min":10.994999999999999,"5min":10.994999999999999,"15min":10.994999999999999},"last":1.109}]},{"osd":6,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.9890000000000001,"5min":1.9890000000000001,"15min":1.9890000000000001},"min":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"max":{"1min":11.513,"5min":11.513,"15min":11.513},"last":1.444},{"interface":"front","average":{"1min":1.958,"5min":1.958,"15min":1.958},"min":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"max":{"1min":10.714,"5min":10.714,"15min":10.714},"last":1.286}]}]},{"osd":6,"up_from":13,"seq":55834574874,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297840,"kb_used_data":552,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074000,"statfs":{"total":96636764160,"available":96331776000,"internally_reserved":0,"allocated":565248,"data_stored":241946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":0.79900000000000004},{"interface":"front","average":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":2.1419999999999999,"5min":2.1419999999999999,"15min":2.1419999999999999},"last":0.99299999999999999}]},{"osd":1,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"min":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"max":{"1min":1.9159999999999999,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":0.93899999999999995},{"interface":"front","average":{"1min":1.256,"5min":1.256,"15min":1.256},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":1.677,"5min":1.677,"15min":1.677},"last":0.90200000000000002}]},{"osd":2,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.167,"15min":1.167},"min":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":1.659,"5min":1.659,"15min":1.659},"last":0.83699999999999997},{"interface":"front","average":{"1min":1.236,"5min":1.236,"15min":1.236},"min":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"max":{"1min":1.78,"5min":1.78,"15min":1.78},"last":0.86899999999999999}]},{"osd":3,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.284,"5min":1.284,"15min":1.284},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":0.75900000000000001},{"interface":"front","average":{"1min":1.343,"5min":1.343,"15min":1.343},"min":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":2.2200000000000002,"5min":2.2200000000000002,"15min":2.2200000000000002},"last":0.72199999999999998}]},{"osd":4,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.286,"5min":1.286,"15min":1.286},"min":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"max":{"1min":1.889,"5min":1.889,"15min":1.889},"last":0.69999999999999996},{"interface":"front","average":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"min":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":2.2610000000000001,"5min":2.2610000000000001,"15min":2.2610000000000001},"last":0.91700000000000004}]},{"osd":5,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"min":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"max":{"1min":1.994,"5min":1.994,"15min":1.994},"last":1.0169999999999999},{"interface":"front","average":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"min":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"max":{"1min":2.0129999999999999,"5min":2.0129999999999999,"15min":2.0129999999999999},"last":0.95799999999999996}]},{"osd":7,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"min":{"1min":1.016,"5min":1.016,"15min":1.016},"max":{"1min":2.0920000000000001,"5min":2.0920000000000001,"15min":2.0920000000000001},"last":1.0449999999999999},{"interface":"front","average":{"1min":1.5469999999999999,"5min":1.5469999999999999,"15min":1.5469999999999999},"min":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"max":{"1min":2.0310000000000001,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":1.0589999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574874,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297840,"kb_used_data":552,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074000,"statfs":{"total":96636764160,"available":96331776000,"internally_reserved":0,"allocated":565248,"data_stored":241946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":1.1539999999999999},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.5,"5min":1.5,"15min":1.5},"last":1.3640000000000001}]},{"osd":1,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"min":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":1.984,"5min":1.984,"15min":1.984},"last":1.0029999999999999},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.708,"5min":1.708,"15min":1.708},"last":1.1990000000000001}]},{"osd":2,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.395,"5min":1.395,"15min":1.395},"min":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"max":{"1min":1.78,"5min":1.78,"15min":1.78},"last":1.3979999999999999},{"interface":"front","average":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"min":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":2.8319999999999999,"5min":2.8319999999999999,"15min":2.8319999999999999},"last":1.4099999999999999}]},{"osd":3,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"min":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":3.1789999999999998,"5min":3.1789999999999998,"15min":3.1789999999999998},"last":1.1140000000000001},{"interface":"front","average":{"1min":1.272,"5min":1.272,"15min":1.272},"min":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"max":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":1.327}]},{"osd":4,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":1.302,"15min":1.302},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":2.5899999999999999,"5min":2.5899999999999999,"15min":2.5899999999999999},"last":1.2869999999999999},{"interface":"front","average":{"1min":1.516,"5min":1.516,"15min":1.516},"min":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"max":{"1min":4.5419999999999998,"5min":4.5419999999999998,"15min":4.5419999999999998},"last":1.48}]},{"osd":6,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.847,"5min":1.847,"15min":1.847},"last":1.506},{"interface":"front","average":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"min":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":2.9239999999999999,"5min":2.9239999999999999,"15min":2.9239999999999999},"last":1.5329999999999999}]},{"osd":7,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":4.4489999999999998,"5min":4.4489999999999998,"15min":4.4489999999999998},"last":1.2509999999999999},{"interface":"front","average":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"min":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"max":{"1min":1.98,"5min":1.98,"15min":1.98},"last":1.454}]}]},{"osd":4,"up_from":13,"seq":55834574873,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297840,"kb_used_data":552,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074000,"statfs":{"total":96636764160,"available":96331776000,"internally_reserved":0,"allocated":565248,"data_stored":241946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.6040000000000001,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":0.84199999999999997},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.585,"5min":1.585,"15min":1.585},"last":1.1559999999999999}]},{"osd":1,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.403,"5min":1.403,"15min":1.403},"last":1.244},{"interface":"front","average":{"1min":1.169,"5min":1.169,"15min":1.169},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.73,"5min":1.73,"15min":1.73},"last":1.1279999999999999}]},{"osd":2,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.696,"5min":1.696,"15min":1.696},"last":1.425},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":1.788,"5min":1.788,"15min":1.788},"last":1.1850000000000001}]},{"osd":3,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.248,"15min":1.248},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.625,"5min":1.625,"15min":1.625},"last":0.996},{"interface":"front","average":{"1min":1.232,"5min":1.232,"15min":1.232},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.7629999999999999,"5min":1.7629999999999999,"15min":1.7629999999999999},"last":1.089}]},{"osd":5,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.198,"5min":1.198,"15min":1.198},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.71,"5min":1.71,"15min":1.71},"last":0.56799999999999995},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.7889999999999999,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":1.212}]},{"osd":6,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":2.9100000000000001,"5min":2.9100000000000001,"15min":2.9100000000000001},"last":0.93500000000000005},{"interface":"front","average":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":3.282,"5min":3.282,"15min":3.282},"last":0.74299999999999999}]},{"osd":7,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.544,"5min":1.544,"15min":1.544},"min":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"max":{"1min":2.145,"5min":2.145,"15min":2.145},"last":1.286},{"interface":"front","average":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"min":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.927,"5min":1.927,"15min":1.927},"last":1.341}]}]},{"osd":3,"up_from":13,"seq":55834574873,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301936,"kb_used_data":552,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069904,"statfs":{"total":96636764160,"available":96327581696,"internally_reserved":0,"allocated":565248,"data_stored":241946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:01:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":2.298,"5min":2.298,"15min":2.298},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.998,"5min":0.998,"15min":0.998},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":2.1850000000000001,"5min":2.1850000000000001,"15min":2.1850000000000001},"last":0.60699999999999998}]},{"osd":1,"last update":"Fri Oct 6 03:01:46 2023","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.974,"5min":1.974,"15min":1.974},"last":0.58599999999999997},{"interface":"front","average":{"1min":1.137,"5min":1.137,"15min":1.137},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.71,"5min":1.71,"15min":1.71},"last":0.63700000000000001}]},{"osd":2,"last update":"Fri Oct 6 03:01:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":2.8849999999999998,"5min":2.8849999999999998,"15min":2.8849999999999998},"last":0.44500000000000001},{"interface":"front","average":{"1min":1.095,"5min":1.095,"15min":1.095},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":2.8220000000000001,"5min":2.8220000000000001,"15min":2.8220000000000001},"last":0.86699999999999999}]},{"osd":4,"last update":"Fri Oct 6 03:01:46 2023","interfaces":[{"interface":"back","average":{"1min":1.456,"5min":1.456,"15min":1.456},"min":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"max":{"1min":3.6560000000000001,"5min":3.6560000000000001,"15min":3.6560000000000001},"last":0.751},{"interface":"front","average":{"1min":1.466,"5min":1.466,"15min":1.466},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":3.7749999999999999,"5min":3.7749999999999999,"15min":3.7749999999999999},"last":0.76800000000000002}]},{"osd":5,"last update":"Fri Oct 6 03:01:46 2023","interfaces":[{"interface":"back","average":{"1min":1.534,"5min":1.534,"15min":1.534},"min":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"max":{"1min":3.4910000000000001,"5min":3.4910000000000001,"15min":3.4910000000000001},"last":0.83099999999999996},{"interface":"front","average":{"1min":1.494,"5min":1.494,"15min":1.494},"min":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"max":{"1min":2.6240000000000001,"5min":2.6240000000000001,"15min":2.6240000000000001},"last":1.101}]},{"osd":6,"last update":"Fri Oct 6 03:01:46 2023","interfaces":[{"interface":"back","average":{"1min":1.5780000000000001,"5min":1.5780000000000001,"15min":1.5780000000000001},"min":{"1min":1.046,"5min":1.046,"15min":1.046},"max":{"1min":3.7050000000000001,"5min":3.7050000000000001,"15min":3.7050000000000001},"last":0.84599999999999997},{"interface":"front","average":{"1min":1.583,"5min":1.583,"15min":1.583},"min":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"max":{"1min":3.9300000000000002,"5min":3.9300000000000002,"15min":3.9300000000000002},"last":0.80900000000000005}]},{"osd":7,"last update":"Fri Oct 6 03:01:46 2023","interfaces":[{"interface":"back","average":{"1min":1.635,"5min":1.635,"15min":1.635},"min":{"1min":1.149,"5min":1.149,"15min":1.149},"max":{"1min":2.96,"5min":2.96,"15min":2.96},"last":1.0369999999999999},{"interface":"front","average":{"1min":1.7729999999999999,"5min":1.7729999999999999,"15min":1.7729999999999999},"min":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"max":{"1min":3.8559999999999999,"5min":3.8559999999999999,"15min":3.8559999999999999},"last":0.90600000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574873,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301924,"kb_used_data":540,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069916,"statfs":{"total":96636764160,"available":96327593984,"internally_reserved":0,"allocated":552960,"data_stored":235330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.6950000000000001,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":1.165},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":0.79100000000000004}]},{"osd":1,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.5449999999999999,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":1.2889999999999999},{"interface":"front","average":{"1min":1.232,"5min":1.232,"15min":1.232},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":2.1800000000000002,"5min":2.1800000000000002,"15min":2.1800000000000002},"last":0.99099999999999999}]},{"osd":3,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.91300000000000003},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":2.806,"5min":2.806,"15min":2.806},"last":1.0349999999999999}]},{"osd":4,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.389,"5min":1.389,"15min":1.389},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":2.1739999999999999,"5min":2.1739999999999999,"15min":2.1739999999999999},"last":1.3939999999999999},{"interface":"front","average":{"1min":1.458,"5min":1.458,"15min":1.458},"min":{"1min":1,"5min":1,"15min":1},"max":{"1min":3.028,"5min":3.028,"15min":3.028},"last":1.4219999999999999}]},{"osd":5,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.55,"5min":1.55,"15min":1.55},"min":{"1min":1.036,"5min":1.036,"15min":1.036},"max":{"1min":3.1499999999999999,"5min":3.1499999999999999,"15min":3.1499999999999999},"last":1.3380000000000001},{"interface":"front","average":{"1min":1.512,"5min":1.512,"15min":1.512},"min":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"max":{"1min":2.8580000000000001,"5min":2.8580000000000001,"15min":2.8580000000000001},"last":1.3500000000000001}]},{"osd":6,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"min":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"max":{"1min":2.6659999999999999,"5min":2.6659999999999999,"15min":2.6659999999999999},"last":1.115},{"interface":"front","average":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"min":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"max":{"1min":2.411,"5min":2.411,"15min":2.411},"last":1.458}]},{"osd":7,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"min":{"1min":1.01,"5min":1.01,"15min":1.01},"max":{"1min":3.2160000000000002,"5min":3.2160000000000002,"15min":3.2160000000000002},"last":1.2110000000000001},{"interface":"front","average":{"1min":1.631,"5min":1.631,"15min":1.631},"min":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"max":{"1min":3.1059999999999999,"5min":3.1059999999999999,"15min":3.1059999999999999},"last":1.2370000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574874,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301924,"kb_used_data":540,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069916,"statfs":{"total":96636764160,"available":96327593984,"internally_reserved":0,"allocated":552960,"data_stored":235330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.7749999999999999,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":0.96699999999999997},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":2.3260000000000001,"5min":2.3260000000000001,"15min":2.3260000000000001},"last":1.135}]},{"osd":2,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":3.5459999999999998,"5min":3.5459999999999998,"15min":3.5459999999999998},"last":1.0309999999999999},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.706,"5min":1.706,"15min":1.706},"last":1.226}]},{"osd":3,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.625,"5min":1.625,"15min":1.625},"last":1.3049999999999999},{"interface":"front","average":{"1min":1.196,"5min":1.196,"15min":1.196},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":3.331,"5min":3.331,"15min":3.331},"last":1.504}]},{"osd":4,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.339,"5min":1.339,"15min":1.339},"min":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"max":{"1min":1.8660000000000001,"5min":1.8660000000000001,"15min":1.8660000000000001},"last":1.196},{"interface":"front","average":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":3.2250000000000001,"5min":3.2250000000000001,"15min":3.2250000000000001},"last":1.2490000000000001}]},{"osd":5,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"min":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"max":{"1min":2.8439999999999999,"5min":2.8439999999999999,"15min":2.8439999999999999},"last":1.1100000000000001},{"interface":"front","average":{"1min":1.484,"5min":1.484,"15min":1.484},"min":{"1min":1.01,"5min":1.01,"15min":1.01},"max":{"1min":2.4590000000000001,"5min":2.4590000000000001,"15min":2.4590000000000001},"last":1.4550000000000001}]},{"osd":6,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"min":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"max":{"1min":2.96,"5min":2.96,"15min":2.96},"last":1.371},{"interface":"front","average":{"1min":1.504,"5min":1.504,"15min":1.504},"min":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"max":{"1min":2.5859999999999999,"5min":2.5859999999999999,"15min":2.5859999999999999},"last":1.548}]},{"osd":7,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.6040000000000001,"5min":1.6040000000000001,"15min":1.6040000000000001},"min":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"max":{"1min":3.4460000000000002,"5min":3.4460000000000002,"15min":3.4460000000000002},"last":1.3859999999999999},{"interface":"front","average":{"1min":1.538,"5min":1.538,"15min":1.538},"min":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"max":{"1min":3.113,"5min":3.113,"15min":3.113},"last":1.427}]}]},{"osd":0,"up_from":13,"seq":55834574873,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302504,"kb_used_data":1120,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069336,"statfs":{"total":96636764160,"available":96327000064,"internally_reserved":0,"allocated":1146880,"data_stored":825698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.381,"5min":1.381,"15min":1.381},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.999,"5min":0.999,"15min":0.999},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":1.1319999999999999}]},{"osd":2,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":1.26},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.794,"5min":1.794,"15min":1.794},"last":1.484}]},{"osd":3,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.532,"5min":1.532,"15min":1.532},"last":0.70499999999999996},{"interface":"front","average":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.613,"5min":1.613,"15min":1.613},"last":0.88800000000000001}]},{"osd":4,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"min":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"max":{"1min":2.0680000000000001,"5min":2.0680000000000001,"15min":2.0680000000000001},"last":1.4139999999999999},{"interface":"front","average":{"1min":1.339,"5min":1.339,"15min":1.339},"min":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"max":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":1.4450000000000001}]},{"osd":5,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"min":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"max":{"1min":1.893,"5min":1.893,"15min":1.893},"last":1.5680000000000001},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"min":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":2.2080000000000002,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":1.2070000000000001}]},{"osd":6,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.421,"5min":1.421,"15min":1.421},"min":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"max":{"1min":1.96,"5min":1.96,"15min":1.96},"last":1.52},{"interface":"front","average":{"1min":1.552,"5min":1.552,"15min":1.552},"min":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"max":{"1min":1.9910000000000001,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":1.2949999999999999}]},{"osd":7,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.6319999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"min":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"max":{"1min":2.1019999999999999,"5min":2.1019999999999999,"15min":2.1019999999999999},"last":1.349},{"interface":"front","average":{"1min":1.431,"5min":1.431,"15min":1.431},"min":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"max":{"1min":2.1499999999999999,"5min":2.1499999999999999,"15min":2.1499999999999999},"last":1.3220000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:02:45.024 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3f is not active+clean 2023-10-06T03:02:45.024 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:02:38.822196+0000', 'last_change': '2023-10-06T03:02:38.845590+0000', 'last_active': '2023-10-06T03:02:38.822196+0000', 'last_peered': '2023-10-06T03:02:38.822196+0000', 'last_clean': '2023-10-06T03:02:38.822196+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:02:38.822196+0000', 'last_undegraded': '2023-10-06T03:02:38.822196+0000', 'last_fullsized': '2023-10-06T03:02:38.822196+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_clean_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T09:29:10.864990+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T03:02:45.024 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3e is not active+clean 2023-10-06T03:02:45.024 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:02:38.822196+0000', 'last_change': '2023-10-06T03:02:38.845802+0000', 'last_active': '2023-10-06T03:02:38.822196+0000', 'last_peered': '2023-10-06T03:02:38.822196+0000', 'last_clean': '2023-10-06T03:02:38.822196+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:02:38.822196+0000', 'last_undegraded': '2023-10-06T03:02:38.822196+0000', 'last_fullsized': '2023-10-06T03:02:38.822196+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_clean_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T08:27:35.234159+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T03:02:45.024 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3d is not active+clean 2023-10-06T03:02:45.024 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:02:38.822196+0000', 'last_change': '2023-10-06T03:02:38.851319+0000', 'last_active': '2023-10-06T03:02:38.822196+0000', 'last_peered': '2023-10-06T03:02:38.822196+0000', 'last_clean': '2023-10-06T03:02:38.822196+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:02:38.822196+0000', 'last_undegraded': '2023-10-06T03:02:38.822196+0000', 'last_fullsized': '2023-10-06T03:02:38.822196+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_clean_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T03:29:30.158378+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T03:02:45.025 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3c is not active+clean 2023-10-06T03:02:45.025 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:02:38.822196+0000', 'last_change': '2023-10-06T03:02:38.847718+0000', 'last_active': '2023-10-06T03:02:38.822196+0000', 'last_peered': '2023-10-06T03:02:38.822196+0000', 'last_clean': '2023-10-06T03:02:38.822196+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:02:38.822196+0000', 'last_undegraded': '2023-10-06T03:02:38.822196+0000', 'last_fullsized': '2023-10-06T03:02:38.822196+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_clean_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T12:02:18.879270+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T03:02:45.025 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3b is not active+clean 2023-10-06T03:02:45.025 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:02:38.822196+0000', 'last_change': '2023-10-06T03:02:38.841376+0000', 'last_active': '2023-10-06T03:02:38.822196+0000', 'last_peered': '2023-10-06T03:02:38.822196+0000', 'last_clean': '2023-10-06T03:02:38.822196+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:02:38.822196+0000', 'last_undegraded': '2023-10-06T03:02:38.822196+0000', 'last_fullsized': '2023-10-06T03:02:38.822196+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_clean_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T03:06:26.036575+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T03:02:45.025 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3a is not active+clean 2023-10-06T03:02:45.025 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:02:38.822196+0000', 'last_change': '2023-10-06T03:02:38.847453+0000', 'last_active': '2023-10-06T03:02:38.822196+0000', 'last_peered': '2023-10-06T03:02:38.822196+0000', 'last_clean': '2023-10-06T03:02:38.822196+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:02:38.822196+0000', 'last_undegraded': '2023-10-06T03:02:38.822196+0000', 'last_fullsized': '2023-10-06T03:02:38.822196+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_clean_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T09:23:18.217898+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T03:02:45.025 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.39 is not active+clean 2023-10-06T03:02:45.025 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:02:38.822196+0000', 'last_change': '2023-10-06T03:02:38.854346+0000', 'last_active': '2023-10-06T03:02:38.822196+0000', 'last_peered': '2023-10-06T03:02:38.822196+0000', 'last_clean': '2023-10-06T03:02:38.822196+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:02:38.822196+0000', 'last_undegraded': '2023-10-06T03:02:38.822196+0000', 'last_fullsized': '2023-10-06T03:02:38.822196+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_clean_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T12:53:57.831764+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T03:02:45.025 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.38 is not active+clean 2023-10-06T03:02:45.026 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:02:38.822196+0000', 'last_change': '2023-10-06T03:02:38.862103+0000', 'last_active': '2023-10-06T03:02:38.822196+0000', 'last_peered': '2023-10-06T03:02:38.822196+0000', 'last_clean': '2023-10-06T03:02:38.822196+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:02:38.822196+0000', 'last_undegraded': '2023-10-06T03:02:38.822196+0000', 'last_fullsized': '2023-10-06T03:02:38.822196+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_clean_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T03:17:48.382984+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T03:02:45.026 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.37 is not active+clean 2023-10-06T03:02:45.026 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:02:38.822196+0000', 'last_change': '2023-10-06T03:02:38.862874+0000', 'last_active': '2023-10-06T03:02:38.822196+0000', 'last_peered': '2023-10-06T03:02:38.822196+0000', 'last_clean': '2023-10-06T03:02:38.822196+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:02:38.822196+0000', 'last_undegraded': '2023-10-06T03:02:38.822196+0000', 'last_fullsized': '2023-10-06T03:02:38.822196+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_clean_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T14:28:01.768786+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T03:02:45.026 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.36 is not active+clean 2023-10-06T03:02:45.026 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:02:38.822196+0000', 'last_change': '2023-10-06T03:02:38.845785+0000', 'last_active': '2023-10-06T03:02:38.822196+0000', 'last_peered': '2023-10-06T03:02:38.822196+0000', 'last_clean': '2023-10-06T03:02:38.822196+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:02:38.822196+0000', 'last_undegraded': '2023-10-06T03:02:38.822196+0000', 'last_fullsized': '2023-10-06T03:02:38.822196+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_clean_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T03:06:26.036575+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T03:02:45.026 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.35 is not active+clean 2023-10-06T03:02:45.026 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:02:38.822196+0000', 'last_change': '2023-10-06T03:02:38.841036+0000', 'last_active': '2023-10-06T03:02:38.822196+0000', 'last_peered': '2023-10-06T03:02:38.822196+0000', 'last_clean': '2023-10-06T03:02:38.822196+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:02:38.822196+0000', 'last_undegraded': '2023-10-06T03:02:38.822196+0000', 'last_fullsized': '2023-10-06T03:02:38.822196+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_clean_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T10:44:39.912786+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T03:02:45.026 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.34 is not active+clean 2023-10-06T03:02:45.027 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:02:38.822196+0000', 'last_change': '2023-10-06T03:02:38.864917+0000', 'last_active': '2023-10-06T03:02:38.822196+0000', 'last_peered': '2023-10-06T03:02:38.822196+0000', 'last_clean': '2023-10-06T03:02:38.822196+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:02:38.822196+0000', 'last_undegraded': '2023-10-06T03:02:38.822196+0000', 'last_fullsized': '2023-10-06T03:02:38.822196+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_clean_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T10:17:46.359437+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T03:02:45.027 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.33 is not active+clean 2023-10-06T03:02:45.027 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:02:38.822196+0000', 'last_change': '2023-10-06T03:02:38.846156+0000', 'last_active': '2023-10-06T03:02:38.822196+0000', 'last_peered': '2023-10-06T03:02:38.822196+0000', 'last_clean': '2023-10-06T03:02:38.822196+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:02:38.822196+0000', 'last_undegraded': '2023-10-06T03:02:38.822196+0000', 'last_fullsized': '2023-10-06T03:02:38.822196+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_clean_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T05:58:26.925821+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T03:02:45.027 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.32 is not active+clean 2023-10-06T03:02:45.027 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:02:38.822196+0000', 'last_change': '2023-10-06T03:02:38.851625+0000', 'last_active': '2023-10-06T03:02:38.822196+0000', 'last_peered': '2023-10-06T03:02:38.822196+0000', 'last_clean': '2023-10-06T03:02:38.822196+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:02:38.822196+0000', 'last_undegraded': '2023-10-06T03:02:38.822196+0000', 'last_fullsized': '2023-10-06T03:02:38.822196+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_clean_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T09:41:45.880609+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T03:02:45.027 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.31 is not active+clean 2023-10-06T03:02:45.027 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:02:38.822196+0000', 'last_change': '2023-10-06T03:02:38.845061+0000', 'last_active': '2023-10-06T03:02:38.822196+0000', 'last_peered': '2023-10-06T03:02:38.822196+0000', 'last_clean': '2023-10-06T03:02:38.822196+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:02:38.822196+0000', 'last_undegraded': '2023-10-06T03:02:38.822196+0000', 'last_fullsized': '2023-10-06T03:02:38.822196+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_clean_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T03:06:26.036575+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T03:02:45.027 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.30 is not active+clean 2023-10-06T03:02:45.027 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:02:38.822196+0000', 'last_change': '2023-10-06T03:02:38.844877+0000', 'last_active': '2023-10-06T03:02:38.822196+0000', 'last_peered': '2023-10-06T03:02:38.822196+0000', 'last_clean': '2023-10-06T03:02:38.822196+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:02:38.822196+0000', 'last_undegraded': '2023-10-06T03:02:38.822196+0000', 'last_fullsized': '2023-10-06T03:02:38.822196+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_clean_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T10:58:03.418004+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T03:02:45.027 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2f is not active+clean 2023-10-06T03:02:45.028 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:02:38.822196+0000', 'last_change': '2023-10-06T03:02:38.853710+0000', 'last_active': '2023-10-06T03:02:38.822196+0000', 'last_peered': '2023-10-06T03:02:38.822196+0000', 'last_clean': '2023-10-06T03:02:38.822196+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:02:38.822196+0000', 'last_undegraded': '2023-10-06T03:02:38.822196+0000', 'last_fullsized': '2023-10-06T03:02:38.822196+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_clean_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T08:40:05.112188+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T03:02:45.028 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2e is not active+clean 2023-10-06T03:02:45.028 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:02:38.822196+0000', 'last_change': '2023-10-06T03:02:38.845091+0000', 'last_active': '2023-10-06T03:02:38.822196+0000', 'last_peered': '2023-10-06T03:02:38.822196+0000', 'last_clean': '2023-10-06T03:02:38.822196+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:02:38.822196+0000', 'last_undegraded': '2023-10-06T03:02:38.822196+0000', 'last_fullsized': '2023-10-06T03:02:38.822196+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_clean_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T05:58:26.925821+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T03:02:45.028 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2d is not active+clean 2023-10-06T03:02:45.028 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:02:38.822196+0000', 'last_change': '2023-10-06T03:02:38.850808+0000', 'last_active': '2023-10-06T03:02:38.822196+0000', 'last_peered': '2023-10-06T03:02:38.822196+0000', 'last_clean': '2023-10-06T03:02:38.822196+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:02:38.822196+0000', 'last_undegraded': '2023-10-06T03:02:38.822196+0000', 'last_fullsized': '2023-10-06T03:02:38.822196+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_clean_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T07:47:29.067808+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T03:02:45.028 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2c is not active+clean 2023-10-06T03:02:45.028 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:02:38.822196+0000', 'last_change': '2023-10-06T03:02:38.847201+0000', 'last_active': '2023-10-06T03:02:38.822196+0000', 'last_peered': '2023-10-06T03:02:38.822196+0000', 'last_clean': '2023-10-06T03:02:38.822196+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:02:38.822196+0000', 'last_undegraded': '2023-10-06T03:02:38.822196+0000', 'last_fullsized': '2023-10-06T03:02:38.822196+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_clean_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T10:02:36.798629+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T03:02:45.028 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2b is not active+clean 2023-10-06T03:02:45.028 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:02:38.822196+0000', 'last_change': '2023-10-06T03:02:38.847460+0000', 'last_active': '2023-10-06T03:02:38.822196+0000', 'last_peered': '2023-10-06T03:02:38.822196+0000', 'last_clean': '2023-10-06T03:02:38.822196+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:02:38.822196+0000', 'last_undegraded': '2023-10-06T03:02:38.822196+0000', 'last_fullsized': '2023-10-06T03:02:38.822196+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_clean_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T10:16:22.934040+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T03:02:45.029 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2a is not active+clean 2023-10-06T03:02:45.029 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:02:38.822196+0000', 'last_change': '2023-10-06T03:02:38.860493+0000', 'last_active': '2023-10-06T03:02:38.822196+0000', 'last_peered': '2023-10-06T03:02:38.822196+0000', 'last_clean': '2023-10-06T03:02:38.822196+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:02:38.822196+0000', 'last_undegraded': '2023-10-06T03:02:38.822196+0000', 'last_fullsized': '2023-10-06T03:02:38.822196+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_clean_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T12:02:18.879270+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T03:02:45.029 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.29 is not active+clean 2023-10-06T03:02:45.029 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:02:38.822196+0000', 'last_change': '2023-10-06T03:02:38.841921+0000', 'last_active': '2023-10-06T03:02:38.822196+0000', 'last_peered': '2023-10-06T03:02:38.822196+0000', 'last_clean': '2023-10-06T03:02:38.822196+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:02:38.822196+0000', 'last_undegraded': '2023-10-06T03:02:38.822196+0000', 'last_fullsized': '2023-10-06T03:02:38.822196+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_clean_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T10:02:36.798629+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T03:02:45.029 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.28 is not active+clean 2023-10-06T03:02:45.029 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:02:38.822196+0000', 'last_change': '2023-10-06T03:02:38.849036+0000', 'last_active': '2023-10-06T03:02:38.822196+0000', 'last_peered': '2023-10-06T03:02:38.822196+0000', 'last_clean': '2023-10-06T03:02:38.822196+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:02:38.822196+0000', 'last_undegraded': '2023-10-06T03:02:38.822196+0000', 'last_fullsized': '2023-10-06T03:02:38.822196+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_clean_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T08:27:35.234159+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T03:02:45.029 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.27 is not active+clean 2023-10-06T03:02:45.029 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:02:38.822196+0000', 'last_change': '2023-10-06T03:02:38.851108+0000', 'last_active': '2023-10-06T03:02:38.822196+0000', 'last_peered': '2023-10-06T03:02:38.822196+0000', 'last_clean': '2023-10-06T03:02:38.822196+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:02:38.822196+0000', 'last_undegraded': '2023-10-06T03:02:38.822196+0000', 'last_fullsized': '2023-10-06T03:02:38.822196+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_clean_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T03:17:48.382984+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T03:02:45.029 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.26 is not active+clean 2023-10-06T03:02:45.029 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:02:38.822196+0000', 'last_change': '2023-10-06T03:02:38.865759+0000', 'last_active': '2023-10-06T03:02:38.822196+0000', 'last_peered': '2023-10-06T03:02:38.822196+0000', 'last_clean': '2023-10-06T03:02:38.822196+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:02:38.822196+0000', 'last_undegraded': '2023-10-06T03:02:38.822196+0000', 'last_fullsized': '2023-10-06T03:02:38.822196+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_clean_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T08:40:05.112188+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T03:02:45.030 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.25 is not active+clean 2023-10-06T03:02:45.030 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:02:38.822196+0000', 'last_change': '2023-10-06T03:02:38.843612+0000', 'last_active': '2023-10-06T03:02:38.822196+0000', 'last_peered': '2023-10-06T03:02:38.822196+0000', 'last_clean': '2023-10-06T03:02:38.822196+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:02:38.822196+0000', 'last_undegraded': '2023-10-06T03:02:38.822196+0000', 'last_fullsized': '2023-10-06T03:02:38.822196+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_clean_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T13:37:35.950737+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T03:02:45.030 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.24 is not active+clean 2023-10-06T03:02:45.030 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:02:38.822196+0000', 'last_change': '2023-10-06T03:02:38.846351+0000', 'last_active': '2023-10-06T03:02:38.822196+0000', 'last_peered': '2023-10-06T03:02:38.822196+0000', 'last_clean': '2023-10-06T03:02:38.822196+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:02:38.822196+0000', 'last_undegraded': '2023-10-06T03:02:38.822196+0000', 'last_fullsized': '2023-10-06T03:02:38.822196+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_clean_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T04:43:59.979418+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T03:02:45.030 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.23 is not active+clean 2023-10-06T03:02:45.030 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:02:38.822196+0000', 'last_change': '2023-10-06T03:02:38.850023+0000', 'last_active': '2023-10-06T03:02:38.822196+0000', 'last_peered': '2023-10-06T03:02:38.822196+0000', 'last_clean': '2023-10-06T03:02:38.822196+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:02:38.822196+0000', 'last_undegraded': '2023-10-06T03:02:38.822196+0000', 'last_fullsized': '2023-10-06T03:02:38.822196+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_clean_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T12:46:40.611565+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T03:02:45.030 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.22 is not active+clean 2023-10-06T03:02:45.030 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:02:38.822196+0000', 'last_change': '2023-10-06T03:02:38.846537+0000', 'last_active': '2023-10-06T03:02:38.822196+0000', 'last_peered': '2023-10-06T03:02:38.822196+0000', 'last_clean': '2023-10-06T03:02:38.822196+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:02:38.822196+0000', 'last_undegraded': '2023-10-06T03:02:38.822196+0000', 'last_fullsized': '2023-10-06T03:02:38.822196+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_clean_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T07:12:14.521260+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T03:02:45.031 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.21 is not active+clean 2023-10-06T03:02:45.031 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:02:38.822196+0000', 'last_change': '2023-10-06T03:02:38.853140+0000', 'last_active': '2023-10-06T03:02:38.822196+0000', 'last_peered': '2023-10-06T03:02:38.822196+0000', 'last_clean': '2023-10-06T03:02:38.822196+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:02:38.822196+0000', 'last_undegraded': '2023-10-06T03:02:38.822196+0000', 'last_fullsized': '2023-10-06T03:02:38.822196+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_clean_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T10:17:46.359437+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T03:02:45.031 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.20 is not active+clean 2023-10-06T03:02:45.031 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:02:38.822196+0000', 'last_change': '2023-10-06T03:02:38.851907+0000', 'last_active': '2023-10-06T03:02:38.822196+0000', 'last_peered': '2023-10-06T03:02:38.822196+0000', 'last_clean': '2023-10-06T03:02:38.822196+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:02:38.822196+0000', 'last_undegraded': '2023-10-06T03:02:38.822196+0000', 'last_fullsized': '2023-10-06T03:02:38.822196+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_clean_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T03:17:48.382984+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T03:02:45.031 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.10 is not active+clean 2023-10-06T03:02:45.031 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:02:38.822196+0000', 'last_change': '2023-10-06T03:02:38.845465+0000', 'last_active': '2023-10-06T03:02:38.822196+0000', 'last_peered': '2023-10-06T03:02:38.822196+0000', 'last_clean': '2023-10-06T03:02:38.822196+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:02:38.822196+0000', 'last_undegraded': '2023-10-06T03:02:38.822196+0000', 'last_fullsized': '2023-10-06T03:02:38.822196+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_clean_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T10:03:37.092106+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T03:02:45.031 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.11 is not active+clean 2023-10-06T03:02:45.031 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:02:38.822196+0000', 'last_change': '2023-10-06T03:02:38.849055+0000', 'last_active': '2023-10-06T03:02:38.822196+0000', 'last_peered': '2023-10-06T03:02:38.822196+0000', 'last_clean': '2023-10-06T03:02:38.822196+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:02:38.822196+0000', 'last_undegraded': '2023-10-06T03:02:38.822196+0000', 'last_fullsized': '2023-10-06T03:02:38.822196+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_clean_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T07:12:14.521260+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T03:02:45.031 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.12 is not active+clean 2023-10-06T03:02:45.031 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:02:38.822196+0000', 'last_change': '2023-10-06T03:02:38.846743+0000', 'last_active': '2023-10-06T03:02:38.822196+0000', 'last_peered': '2023-10-06T03:02:38.822196+0000', 'last_clean': '2023-10-06T03:02:38.822196+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:02:38.822196+0000', 'last_undegraded': '2023-10-06T03:02:38.822196+0000', 'last_fullsized': '2023-10-06T03:02:38.822196+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_clean_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T10:44:39.912786+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T03:02:45.032 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.13 is not active+clean 2023-10-06T03:02:45.032 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:02:38.822196+0000', 'last_change': '2023-10-06T03:02:38.861373+0000', 'last_active': '2023-10-06T03:02:38.822196+0000', 'last_peered': '2023-10-06T03:02:38.822196+0000', 'last_clean': '2023-10-06T03:02:38.822196+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:02:38.822196+0000', 'last_undegraded': '2023-10-06T03:02:38.822196+0000', 'last_fullsized': '2023-10-06T03:02:38.822196+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_clean_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T12:46:40.611565+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T03:02:45.032 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.14 is not active+clean 2023-10-06T03:02:45.032 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:02:38.822196+0000', 'last_change': '2023-10-06T03:02:38.840383+0000', 'last_active': '2023-10-06T03:02:38.822196+0000', 'last_peered': '2023-10-06T03:02:38.822196+0000', 'last_clean': '2023-10-06T03:02:38.822196+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:02:38.822196+0000', 'last_undegraded': '2023-10-06T03:02:38.822196+0000', 'last_fullsized': '2023-10-06T03:02:38.822196+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_clean_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T07:14:47.594861+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T03:02:45.032 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.15 is not active+clean 2023-10-06T03:02:45.032 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:02:38.822196+0000', 'last_change': '2023-10-06T03:02:38.848288+0000', 'last_active': '2023-10-06T03:02:38.822196+0000', 'last_peered': '2023-10-06T03:02:38.822196+0000', 'last_clean': '2023-10-06T03:02:38.822196+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:02:38.822196+0000', 'last_undegraded': '2023-10-06T03:02:38.822196+0000', 'last_fullsized': '2023-10-06T03:02:38.822196+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_clean_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T08:39:42.661414+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T03:02:45.032 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.16 is not active+clean 2023-10-06T03:02:45.032 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:02:38.822196+0000', 'last_change': '2023-10-06T03:02:38.864711+0000', 'last_active': '2023-10-06T03:02:38.822196+0000', 'last_peered': '2023-10-06T03:02:38.822196+0000', 'last_clean': '2023-10-06T03:02:38.822196+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:02:38.822196+0000', 'last_undegraded': '2023-10-06T03:02:38.822196+0000', 'last_fullsized': '2023-10-06T03:02:38.822196+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_clean_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T07:12:14.521260+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T03:02:45.032 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.17 is not active+clean 2023-10-06T03:02:45.032 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:02:38.822196+0000', 'last_change': '2023-10-06T03:02:38.845190+0000', 'last_active': '2023-10-06T03:02:38.822196+0000', 'last_peered': '2023-10-06T03:02:38.822196+0000', 'last_clean': '2023-10-06T03:02:38.822196+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:02:38.822196+0000', 'last_undegraded': '2023-10-06T03:02:38.822196+0000', 'last_fullsized': '2023-10-06T03:02:38.822196+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_clean_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T09:23:18.217898+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T03:02:45.033 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.18 is not active+clean 2023-10-06T03:02:45.033 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:02:38.822196+0000', 'last_change': '2023-10-06T03:02:38.840362+0000', 'last_active': '2023-10-06T03:02:38.822196+0000', 'last_peered': '2023-10-06T03:02:38.822196+0000', 'last_clean': '2023-10-06T03:02:38.822196+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:02:38.822196+0000', 'last_undegraded': '2023-10-06T03:02:38.822196+0000', 'last_fullsized': '2023-10-06T03:02:38.822196+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_clean_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T10:04:39.146225+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T03:02:45.033 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.19 is not active+clean 2023-10-06T03:02:45.033 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:02:38.822196+0000', 'last_change': '2023-10-06T03:02:38.850848+0000', 'last_active': '2023-10-06T03:02:38.822196+0000', 'last_peered': '2023-10-06T03:02:38.822196+0000', 'last_clean': '2023-10-06T03:02:38.822196+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:02:38.822196+0000', 'last_undegraded': '2023-10-06T03:02:38.822196+0000', 'last_fullsized': '2023-10-06T03:02:38.822196+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_clean_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T12:46:40.611565+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T03:02:45.033 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1a is not active+clean 2023-10-06T03:02:45.033 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:02:38.822196+0000', 'last_change': '2023-10-06T03:02:38.851092+0000', 'last_active': '2023-10-06T03:02:38.822196+0000', 'last_peered': '2023-10-06T03:02:38.822196+0000', 'last_clean': '2023-10-06T03:02:38.822196+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:02:38.822196+0000', 'last_undegraded': '2023-10-06T03:02:38.822196+0000', 'last_fullsized': '2023-10-06T03:02:38.822196+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_clean_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T14:28:01.768786+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T03:02:45.033 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1b is not active+clean 2023-10-06T03:02:45.033 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:02:38.822196+0000', 'last_change': '2023-10-06T03:02:38.840714+0000', 'last_active': '2023-10-06T03:02:38.822196+0000', 'last_peered': '2023-10-06T03:02:38.822196+0000', 'last_clean': '2023-10-06T03:02:38.822196+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:02:38.822196+0000', 'last_undegraded': '2023-10-06T03:02:38.822196+0000', 'last_fullsized': '2023-10-06T03:02:38.822196+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_clean_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T10:58:03.418004+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T03:02:45.033 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1c is not active+clean 2023-10-06T03:02:45.033 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:02:38.822196+0000', 'last_change': '2023-10-06T03:02:38.851097+0000', 'last_active': '2023-10-06T03:02:38.822196+0000', 'last_peered': '2023-10-06T03:02:38.822196+0000', 'last_clean': '2023-10-06T03:02:38.822196+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:02:38.822196+0000', 'last_undegraded': '2023-10-06T03:02:38.822196+0000', 'last_fullsized': '2023-10-06T03:02:38.822196+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_clean_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T07:47:29.067808+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T03:02:45.034 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1d is not active+clean 2023-10-06T03:02:45.034 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:02:38.822196+0000', 'last_change': '2023-10-06T03:02:38.850206+0000', 'last_active': '2023-10-06T03:02:38.822196+0000', 'last_peered': '2023-10-06T03:02:38.822196+0000', 'last_clean': '2023-10-06T03:02:38.822196+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:02:38.822196+0000', 'last_undegraded': '2023-10-06T03:02:38.822196+0000', 'last_fullsized': '2023-10-06T03:02:38.822196+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_clean_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T07:12:14.521260+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T03:02:45.034 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1e is not active+clean 2023-10-06T03:02:45.034 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:02:38.822196+0000', 'last_change': '2023-10-06T03:02:38.865305+0000', 'last_active': '2023-10-06T03:02:38.822196+0000', 'last_peered': '2023-10-06T03:02:38.822196+0000', 'last_clean': '2023-10-06T03:02:38.822196+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:02:38.822196+0000', 'last_undegraded': '2023-10-06T03:02:38.822196+0000', 'last_fullsized': '2023-10-06T03:02:38.822196+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_clean_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T11:08:51.831968+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T03:02:45.034 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1f is not active+clean 2023-10-06T03:02:45.034 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:02:38.822196+0000', 'last_change': '2023-10-06T03:02:38.855648+0000', 'last_active': '2023-10-06T03:02:38.822196+0000', 'last_peered': '2023-10-06T03:02:38.822196+0000', 'last_clean': '2023-10-06T03:02:38.822196+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:02:38.822196+0000', 'last_undegraded': '2023-10-06T03:02:38.822196+0000', 'last_fullsized': '2023-10-06T03:02:38.822196+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_clean_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T10:19:46.946130+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T03:02:45.034 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.0 is not active+clean 2023-10-06T03:02:45.034 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:02:38.822196+0000', 'last_change': '2023-10-06T03:02:38.861542+0000', 'last_active': '2023-10-06T03:02:38.822196+0000', 'last_peered': '2023-10-06T03:02:38.822196+0000', 'last_clean': '2023-10-06T03:02:38.822196+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:02:38.822196+0000', 'last_undegraded': '2023-10-06T03:02:38.822196+0000', 'last_fullsized': '2023-10-06T03:02:38.822196+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_clean_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T07:47:29.067808+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T03:02:45.034 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1 is not active+clean 2023-10-06T03:02:45.035 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:02:38.822196+0000', 'last_change': '2023-10-06T03:02:38.843494+0000', 'last_active': '2023-10-06T03:02:38.822196+0000', 'last_peered': '2023-10-06T03:02:38.822196+0000', 'last_clean': '2023-10-06T03:02:38.822196+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:02:38.822196+0000', 'last_undegraded': '2023-10-06T03:02:38.822196+0000', 'last_fullsized': '2023-10-06T03:02:38.822196+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_clean_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T03:17:00.785154+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T03:02:45.035 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2 is not active+clean 2023-10-06T03:02:45.035 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:02:38.822196+0000', 'last_change': '2023-10-06T03:02:38.840919+0000', 'last_active': '2023-10-06T03:02:38.822196+0000', 'last_peered': '2023-10-06T03:02:38.822196+0000', 'last_clean': '2023-10-06T03:02:38.822196+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:02:38.822196+0000', 'last_undegraded': '2023-10-06T03:02:38.822196+0000', 'last_fullsized': '2023-10-06T03:02:38.822196+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_clean_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T09:29:10.864990+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T03:02:45.035 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3 is not active+clean 2023-10-06T03:02:45.035 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:02:38.822196+0000', 'last_change': '2023-10-06T03:02:38.843354+0000', 'last_active': '2023-10-06T03:02:38.822196+0000', 'last_peered': '2023-10-06T03:02:38.822196+0000', 'last_clean': '2023-10-06T03:02:38.822196+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:02:38.822196+0000', 'last_undegraded': '2023-10-06T03:02:38.822196+0000', 'last_fullsized': '2023-10-06T03:02:38.822196+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_clean_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T05:18:13.263253+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T03:02:45.035 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.4 is not active+clean 2023-10-06T03:02:45.035 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:02:38.822196+0000', 'last_change': '2023-10-06T03:02:38.850589+0000', 'last_active': '2023-10-06T03:02:38.822196+0000', 'last_peered': '2023-10-06T03:02:38.822196+0000', 'last_clean': '2023-10-06T03:02:38.822196+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:02:38.822196+0000', 'last_undegraded': '2023-10-06T03:02:38.822196+0000', 'last_fullsized': '2023-10-06T03:02:38.822196+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_clean_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T08:39:42.661414+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T03:02:45.035 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.5 is not active+clean 2023-10-06T03:02:45.035 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:02:38.822196+0000', 'last_change': '2023-10-06T03:02:38.852214+0000', 'last_active': '2023-10-06T03:02:38.822196+0000', 'last_peered': '2023-10-06T03:02:38.822196+0000', 'last_clean': '2023-10-06T03:02:38.822196+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:02:38.822196+0000', 'last_undegraded': '2023-10-06T03:02:38.822196+0000', 'last_fullsized': '2023-10-06T03:02:38.822196+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_clean_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T13:18:27.259723+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T03:02:45.035 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.6 is not active+clean 2023-10-06T03:02:45.036 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:02:38.822196+0000', 'last_change': '2023-10-06T03:02:38.849827+0000', 'last_active': '2023-10-06T03:02:38.822196+0000', 'last_peered': '2023-10-06T03:02:38.822196+0000', 'last_clean': '2023-10-06T03:02:38.822196+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:02:38.822196+0000', 'last_undegraded': '2023-10-06T03:02:38.822196+0000', 'last_fullsized': '2023-10-06T03:02:38.822196+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_clean_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T08:39:42.661414+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T03:02:45.036 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.7 is not active+clean 2023-10-06T03:02:45.036 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:02:38.822196+0000', 'last_change': '2023-10-06T03:02:38.844058+0000', 'last_active': '2023-10-06T03:02:38.822196+0000', 'last_peered': '2023-10-06T03:02:38.822196+0000', 'last_clean': '2023-10-06T03:02:38.822196+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:02:38.822196+0000', 'last_undegraded': '2023-10-06T03:02:38.822196+0000', 'last_fullsized': '2023-10-06T03:02:38.822196+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_clean_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T07:14:47.594861+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T03:02:45.036 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.9 is not active+clean 2023-10-06T03:02:45.036 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:02:38.822196+0000', 'last_change': '2023-10-06T03:02:38.849391+0000', 'last_active': '2023-10-06T03:02:38.822196+0000', 'last_peered': '2023-10-06T03:02:38.822196+0000', 'last_clean': '2023-10-06T03:02:38.822196+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:02:38.822196+0000', 'last_undegraded': '2023-10-06T03:02:38.822196+0000', 'last_fullsized': '2023-10-06T03:02:38.822196+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_clean_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T04:48:50.971382+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T03:02:45.036 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.a is not active+clean 2023-10-06T03:02:45.036 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:02:38.822196+0000', 'last_change': '2023-10-06T03:02:38.843912+0000', 'last_active': '2023-10-06T03:02:38.822196+0000', 'last_peered': '2023-10-06T03:02:38.822196+0000', 'last_clean': '2023-10-06T03:02:38.822196+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:02:38.822196+0000', 'last_undegraded': '2023-10-06T03:02:38.822196+0000', 'last_fullsized': '2023-10-06T03:02:38.822196+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_clean_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T10:04:39.146225+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T03:02:45.036 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.b is not active+clean 2023-10-06T03:02:45.036 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:02:38.822196+0000', 'last_change': '2023-10-06T03:02:38.860881+0000', 'last_active': '2023-10-06T03:02:38.822196+0000', 'last_peered': '2023-10-06T03:02:38.822196+0000', 'last_clean': '2023-10-06T03:02:38.822196+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:02:38.822196+0000', 'last_undegraded': '2023-10-06T03:02:38.822196+0000', 'last_fullsized': '2023-10-06T03:02:38.822196+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_clean_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T08:39:42.661414+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T03:02:45.037 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.8 is not active+clean 2023-10-06T03:02:45.037 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:02:38.822196+0000', 'last_change': '2023-10-06T03:02:38.849375+0000', 'last_active': '2023-10-06T03:02:38.822196+0000', 'last_peered': '2023-10-06T03:02:38.822196+0000', 'last_clean': '2023-10-06T03:02:38.822196+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:02:38.822196+0000', 'last_undegraded': '2023-10-06T03:02:38.822196+0000', 'last_fullsized': '2023-10-06T03:02:38.822196+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_clean_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T08:27:35.234159+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T03:02:45.037 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.e is not active+clean 2023-10-06T03:02:45.037 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:02:38.822196+0000', 'last_change': '2023-10-06T03:02:38.852876+0000', 'last_active': '2023-10-06T03:02:38.822196+0000', 'last_peered': '2023-10-06T03:02:38.822196+0000', 'last_clean': '2023-10-06T03:02:38.822196+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:02:38.822196+0000', 'last_undegraded': '2023-10-06T03:02:38.822196+0000', 'last_fullsized': '2023-10-06T03:02:38.822196+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_clean_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T11:08:51.831968+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T03:02:45.037 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.f is not active+clean 2023-10-06T03:02:45.037 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:02:38.822196+0000', 'last_change': '2023-10-06T03:02:38.859205+0000', 'last_active': '2023-10-06T03:02:38.822196+0000', 'last_peered': '2023-10-06T03:02:38.822196+0000', 'last_clean': '2023-10-06T03:02:38.822196+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:02:38.822196+0000', 'last_undegraded': '2023-10-06T03:02:38.822196+0000', 'last_fullsized': '2023-10-06T03:02:38.822196+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_clean_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T08:27:35.234159+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T03:02:45.037 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.c is not active+clean 2023-10-06T03:02:45.037 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:02:38.822196+0000', 'last_change': '2023-10-06T03:02:38.849461+0000', 'last_active': '2023-10-06T03:02:38.822196+0000', 'last_peered': '2023-10-06T03:02:38.822196+0000', 'last_clean': '2023-10-06T03:02:38.822196+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:02:38.822196+0000', 'last_undegraded': '2023-10-06T03:02:38.822196+0000', 'last_fullsized': '2023-10-06T03:02:38.822196+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_clean_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T12:02:18.879270+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T03:02:45.037 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.d is not active+clean 2023-10-06T03:02:45.037 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:02:38.822196+0000', 'last_change': '2023-10-06T03:02:38.849170+0000', 'last_active': '2023-10-06T03:02:38.822196+0000', 'last_peered': '2023-10-06T03:02:38.822196+0000', 'last_clean': '2023-10-06T03:02:38.822196+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:02:38.822196+0000', 'last_undegraded': '2023-10-06T03:02:38.822196+0000', 'last_fullsized': '2023-10-06T03:02:38.822196+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'last_clean_scrub_stamp': '2023-10-06T03:02:38.822196+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T12:02:18.879270+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T03:02:45.038 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-06T03:02:45.222 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.214+0000 7fd2218f0700 1 Processor -- start 2023-10-06T03:02:45.222 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.218+0000 7fd2218f0700 1 -- start start 2023-10-06T03:02:45.226 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.218+0000 7fd2218f0700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd21c140980 0x7fd21c06c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:45.226 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.218+0000 7fd2218f0700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd21c06dca0 con 0x7fd21c0c7310 2023-10-06T03:02:45.226 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.218+0000 7fd2218f0700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd21c06d090 con 0x7fd21c1405b0 2023-10-06T03:02:45.226 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.218+0000 7fd2218f0700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd21c06d370 con 0x7fd21c140980 2023-10-06T03:02:45.227 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.222+0000 7fd2127fc700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fd21c0c7310 0x7fd21c158770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:53322/0 (socket says 172.21.15.57:53322) 2023-10-06T03:02:45.227 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.222+0000 7fd2127fc700 1 -- 172.21.15.57:0/1556487507 learned_addr learned my addr 172.21.15.57:0/1556487507 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:02:45.227 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.222+0000 7fd21b7fe700 1 --2- 172.21.15.57:0/1556487507 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd21c140980 0x7fd21c06c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:45.228 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.222+0000 7fd21a7fc700 1 -- 172.21.15.57:0/1556487507 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2018885593 0 0) 0x7fd21c06dca0 con 0x7fd21c0c7310 2023-10-06T03:02:45.228 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.222+0000 7fd21a7fc700 1 -- 172.21.15.57:0/1556487507 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd208003570 con 0x7fd21c0c7310 2023-10-06T03:02:45.228 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.222+0000 7fd21a7fc700 1 -- 172.21.15.57:0/1556487507 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 875639184 0 0) 0x7fd21c06d090 con 0x7fd21c1405b0 2023-10-06T03:02:45.228 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.222+0000 7fd21a7fc700 1 -- 172.21.15.57:0/1556487507 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd21c06dca0 con 0x7fd21c1405b0 2023-10-06T03:02:45.228 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.222+0000 7fd21b7fe700 1 -- 172.21.15.57:0/1556487507 >> v1:172.21.15.105:6789/0 conn(0x7fd21c1405b0 legacy=0x7fd21c0c6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:45.228 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.222+0000 7fd21a7fc700 1 -- 172.21.15.57:0/1556487507 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4099586973 0 0) 0x7fd208003570 con 0x7fd21c0c7310 2023-10-06T03:02:45.228 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.222+0000 7fd21b7fe700 1 -- 172.21.15.57:0/1556487507 >> v1:172.21.15.57:6789/0 conn(0x7fd21c0c7310 legacy=0x7fd21c158770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:45.228 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.222+0000 7fd21b7fe700 1 -- 172.21.15.57:0/1556487507 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd21c06d650 con 0x7fd21c140980 2023-10-06T03:02:45.229 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.222+0000 7fd21b7fe700 1 --2- 172.21.15.57:0/1556487507 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd21c140980 0x7fd21c06c160 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd214009e90 tx=0x7fd214009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=67c45ab8f9309729 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:45.229 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.222+0000 7fd21a7fc700 1 -- 172.21.15.57:0/1556487507 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd21400e070 con 0x7fd21c140980 2023-10-06T03:02:45.229 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.222+0000 7fd21a7fc700 1 -- 172.21.15.57:0/1556487507 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd21400b870 con 0x7fd21c140980 2023-10-06T03:02:45.229 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.222+0000 7fd21a7fc700 1 -- 172.21.15.57:0/1556487507 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd204001470 con 0x7fd21c140980 2023-10-06T03:02:45.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.222+0000 7fd2218f0700 1 -- 172.21.15.57:0/1556487507 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd21c140980 msgr2=0x7fd21c06c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:45.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.222+0000 7fd2218f0700 1 --2- 172.21.15.57:0/1556487507 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd21c140980 0x7fd21c06c160 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd214009e90 tx=0x7fd214009780 comp rx=0 tx=0).stop 2023-10-06T03:02:45.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.222+0000 7fd2218f0700 1 -- 172.21.15.57:0/1556487507 shutdown_connections 2023-10-06T03:02:45.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.222+0000 7fd2218f0700 1 --2- 172.21.15.57:0/1556487507 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd21c140980 0x7fd21c06c160 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:45.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.222+0000 7fd2218f0700 1 -- 172.21.15.57:0/1556487507 >> 172.21.15.57:0/1556487507 conn(0x7fd21c0c8790 msgr2=0x7fd21c0c8b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:45.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.222+0000 7fd2218f0700 1 -- 172.21.15.57:0/1556487507 shutdown_connections 2023-10-06T03:02:45.231 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.222+0000 7fd2218f0700 1 -- 172.21.15.57:0/1556487507 wait complete. 2023-10-06T03:02:45.232 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.226+0000 7fd2218f0700 1 Processor -- start 2023-10-06T03:02:45.233 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.226+0000 7fd2218f0700 1 -- start start 2023-10-06T03:02:45.235 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.226+0000 7fd2218f0700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd21c0c7310 0x7fd21c13d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:45.235 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.226+0000 7fd2218f0700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd21c1405b0 0x7fd21c0c4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:45.236 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.226+0000 7fd2218f0700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd21c140980 0x7fd21c0a5930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:45.236 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.230+0000 7fd2218f0700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd21c0a54a0 con 0x7fd21c140980 2023-10-06T03:02:45.236 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.230+0000 7fd2218f0700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd21c0a4890 con 0x7fd21c0c7310 2023-10-06T03:02:45.236 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.230+0000 7fd2218f0700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd21c0a4b70 con 0x7fd21c1405b0 2023-10-06T03:02:45.236 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.230+0000 7fd21b7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd21c140980 0x7fd21c0a5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:45.236 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.230+0000 7fd21b7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd21c140980 0x7fd21c0a5930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:59610/0 (socket says 172.21.15.57:59610) 2023-10-06T03:02:45.236 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.230+0000 7fd21b7fe700 1 -- 172.21.15.57:0/1424266602 learned_addr learned my addr 172.21.15.57:0/1424266602 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:02:45.236 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.230+0000 7fd2127fc700 1 --2- 172.21.15.57:0/1424266602 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd21c1405b0 0x7fd21c0c4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:45.236 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.230+0000 7fd21affd700 1 --2- 172.21.15.57:0/1424266602 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd21c0c7310 0x7fd21c13d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:45.236 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.230+0000 7fd21b7fe700 1 -- 172.21.15.57:0/1424266602 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd21c1405b0 msgr2=0x7fd21c0c4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:45.236 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.230+0000 7fd21b7fe700 1 --2- 172.21.15.57:0/1424266602 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd21c1405b0 0x7fd21c0c4f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:45.236 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.230+0000 7fd21b7fe700 1 -- 172.21.15.57:0/1424266602 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd21c0c7310 msgr2=0x7fd21c13d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:45.237 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.230+0000 7fd21b7fe700 1 --2- 172.21.15.57:0/1424266602 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd21c0c7310 0x7fd21c13d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:45.237 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.230+0000 7fd21b7fe700 1 -- 172.21.15.57:0/1424266602 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd214009a20 con 0x7fd21c140980 2023-10-06T03:02:45.237 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.230+0000 7fd2127fc700 1 --2- 172.21.15.57:0/1424266602 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd21c1405b0 0x7fd21c0c4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:02:45.237 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.230+0000 7fd21b7fe700 1 --2- 172.21.15.57:0/1424266602 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd21c140980 0x7fd21c0a5930 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fd214009de0 tx=0x7fd214017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:45.238 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.230+0000 7fd2137fe700 1 -- 172.21.15.57:0/1424266602 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd214012d80 con 0x7fd21c140980 2023-10-06T03:02:45.238 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.230+0000 7fd2137fe700 1 -- 172.21.15.57:0/1424266602 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd21401e450 con 0x7fd21c140980 2023-10-06T03:02:45.238 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.230+0000 7fd2218f0700 1 -- 172.21.15.57:0/1424266602 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd21c0a4e50 con 0x7fd21c140980 2023-10-06T03:02:45.238 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.230+0000 7fd2137fe700 1 -- 172.21.15.57:0/1424266602 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd21401e810 con 0x7fd21c140980 2023-10-06T03:02:45.238 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.230+0000 7fd2218f0700 1 -- 172.21.15.57:0/1424266602 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd21c13dcf0 con 0x7fd21c140980 2023-10-06T03:02:45.239 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.234+0000 7fd2218f0700 1 -- 172.21.15.57:0/1424266602 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd21c0a5650 con 0x7fd21c140980 2023-10-06T03:02:45.240 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.234+0000 7fd2137fe700 1 -- 172.21.15.57:0/1424266602 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fd21401ec40 con 0x7fd21c140980 2023-10-06T03:02:45.241 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.234+0000 7fd2137fe700 1 --2- 172.21.15.57:0/1424266602 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fd1fc060550 0x7fd1fc062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:45.241 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.234+0000 7fd2137fe700 1 -- 172.21.15.57:0/1424266602 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd21407e900 con 0x7fd21c140980 2023-10-06T03:02:45.242 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.234+0000 7fd21affd700 1 --2- 172.21.15.57:0/1424266602 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fd1fc060550 0x7fd1fc062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:45.242 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.238+0000 7fd21affd700 1 --2- 172.21.15.57:0/1424266602 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fd1fc060550 0x7fd1fc062a00 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd20c003870 tx=0x7fd20c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:45.248 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.242+0000 7fd2137fe700 1 -- 172.21.15.57:0/1424266602 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fd21c0a5650 con 0x7fd21c140980 2023-10-06T03:02:45.473 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.466+0000 7fd2218f0700 1 -- 172.21.15.57:0/1424266602 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fd21c04be40 con 0x7fd21c140980 2023-10-06T03:02:45.474 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.466+0000 7fd2137fe700 1 -- 172.21.15.57:0/1424266602 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1456 (secure 0 0 0) 0x7fd21404ecf0 con 0x7fd21c140980 2023-10-06T03:02:45.474 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:02:45.474 INFO:teuthology.orchestra.run.smithi057.stdout:{"fsid":"eb56dc0f-9213-41cb-9aad-8ade6c802e98","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":134,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":50,"num_osds":8,"num_up_osds":8,"osd_up_since":1696561243,"num_in_osds":8,"osd_in_since":1696561233,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":41}],"num_pgs":105,"num_pools":4,"num_objects":2,"data_bytes":590368,"bytes_used":2462015488,"bytes_avail":770632097792,"bytes_total":773094113280,"inactive_pgs_ratio":0.60952383279800415},"fsmap":{"epoch":31,"id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"c","status":"up:active","gid":5433}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2023-10-06T03:02:28.301921+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-06T03:02:45.476 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.470+0000 7fd2218f0700 1 -- 172.21.15.57:0/1424266602 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fd1fc060550 msgr2=0x7fd1fc062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:45.477 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.470+0000 7fd2218f0700 1 --2- 172.21.15.57:0/1424266602 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fd1fc060550 0x7fd1fc062a00 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd20c003870 tx=0x7fd20c009040 comp rx=0 tx=0).stop 2023-10-06T03:02:45.477 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.470+0000 7fd2218f0700 1 -- 172.21.15.57:0/1424266602 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd21c140980 msgr2=0x7fd21c0a5930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:45.477 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.470+0000 7fd2218f0700 1 --2- 172.21.15.57:0/1424266602 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd21c140980 0x7fd21c0a5930 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fd214009de0 tx=0x7fd214017000 comp rx=0 tx=0).stop 2023-10-06T03:02:45.477 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.470+0000 7fd2218f0700 1 -- 172.21.15.57:0/1424266602 shutdown_connections 2023-10-06T03:02:45.477 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.470+0000 7fd2218f0700 1 --2- 172.21.15.57:0/1424266602 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd21c140980 0x7fd21c0a5930 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:45.478 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.470+0000 7fd2218f0700 1 --2- 172.21.15.57:0/1424266602 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fd1fc060550 0x7fd1fc062a00 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:45.478 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.470+0000 7fd2218f0700 1 --2- 172.21.15.57:0/1424266602 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd21c1405b0 0x7fd21c0c4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:45.478 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.470+0000 7fd2218f0700 1 --2- 172.21.15.57:0/1424266602 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd21c0c7310 0x7fd21c13d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:45.478 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.470+0000 7fd2218f0700 1 -- 172.21.15.57:0/1424266602 >> 172.21.15.57:0/1424266602 conn(0x7fd21c0c8790 msgr2=0x7fd21c0c2600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:45.478 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.470+0000 7fd2218f0700 1 -- 172.21.15.57:0/1424266602 shutdown_connections 2023-10-06T03:02:45.478 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.470+0000 7fd2218f0700 1 -- 172.21.15.57:0/1424266602 wait complete. 2023-10-06T03:02:45.500 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-06T03:02:45.500 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:02:45.658 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.650+0000 7f5b414cd700 1 Processor -- start 2023-10-06T03:02:45.658 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.650+0000 7f5b414cd700 1 -- start start 2023-10-06T03:02:45.660 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.654+0000 7f5b414cd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5b3c159340 0x7f5b3c0cb2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:45.660 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.654+0000 7f5b414cd700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5b3c0b01c0 0x7f5b3c06dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:45.660 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.654+0000 7f5b414cd700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b3c0b0640 con 0x7f5b3c158f70 2023-10-06T03:02:45.660 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.654+0000 7f5b414cd700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b3c0cb900 con 0x7f5b3c159340 2023-10-06T03:02:45.660 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.654+0000 7f5b414cd700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b3c0cbbe0 con 0x7f5b3c0b01c0 2023-10-06T03:02:45.660 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.654+0000 7f5b3affd700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f5b3c158f70 0x7f5b3c06d4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:53332/0 (socket says 172.21.15.57:53332) 2023-10-06T03:02:45.660 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.654+0000 7f5b3affd700 1 -- 172.21.15.57:0/3078394516 learned_addr learned my addr 172.21.15.57:0/3078394516 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:02:45.662 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.654+0000 7f5b33fff700 1 --2- 172.21.15.57:0/3078394516 >> v2:172.21.15.57:3300/0 conn(0x7f5b3c159340 0x7f5b3c0cb2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:45.662 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.654+0000 7f5b3b7fe700 1 --2- 172.21.15.57:0/3078394516 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5b3c0b01c0 0x7f5b3c06dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:45.662 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.654+0000 7f5b3a7fc700 1 -- 172.21.15.57:0/3078394516 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4117643448 0 0) 0x7f5b3c0b0640 con 0x7f5b3c158f70 2023-10-06T03:02:45.662 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.654+0000 7f5b3a7fc700 1 -- 172.21.15.57:0/3078394516 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b28003570 con 0x7f5b3c158f70 2023-10-06T03:02:45.662 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.654+0000 7f5b3a7fc700 1 -- 172.21.15.57:0/3078394516 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1284284287 0 0) 0x7f5b28003570 con 0x7f5b3c158f70 2023-10-06T03:02:45.662 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.654+0000 7f5b3a7fc700 1 -- 172.21.15.57:0/3078394516 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5b3c0b01c0 msgr2=0x7f5b3c06dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:45.662 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.654+0000 7f5b3a7fc700 1 --2- 172.21.15.57:0/3078394516 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5b3c0b01c0 0x7f5b3c06dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:45.662 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.654+0000 7f5b3a7fc700 1 -- 172.21.15.57:0/3078394516 >> v2:172.21.15.57:3300/0 conn(0x7f5b3c159340 msgr2=0x7f5b3c0cb2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:45.662 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.654+0000 7f5b3a7fc700 1 --2- 172.21.15.57:0/3078394516 >> v2:172.21.15.57:3300/0 conn(0x7f5b3c159340 0x7f5b3c0cb2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:45.663 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.654+0000 7f5b3a7fc700 1 -- 172.21.15.57:0/3078394516 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b3c06c9c0 con 0x7f5b3c158f70 2023-10-06T03:02:45.663 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.654+0000 7f5b3a7fc700 1 -- 172.21.15.57:0/3078394516 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2482400018 0 0) 0x7f5b2c001490 con 0x7f5b3c158f70 2023-10-06T03:02:45.663 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.654+0000 7f5b3a7fc700 1 -- 172.21.15.57:0/3078394516 >> v1:172.21.15.57:6789/0 conn(0x7f5b3c158f70 legacy=0x7f5b3c06d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:45.663 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.654+0000 7f5b3a7fc700 1 --2- 172.21.15.57:0/3078394516 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5b28003a60 0x7f5b28003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:45.663 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.654+0000 7f5b3a7fc700 1 --2- 172.21.15.57:0/3078394516 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5b28004810 0x7f5b28004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:45.663 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.654+0000 7f5b3a7fc700 1 --2- 172.21.15.57:0/3078394516 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5b3c0b01c0 0x7f5b280051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:45.663 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.654+0000 7f5b3a7fc700 1 -- 172.21.15.57:0/3078394516 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b3c0cb900 con 0x7f5b28004810 2023-10-06T03:02:45.663 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.654+0000 7f5b3a7fc700 1 -- 172.21.15.57:0/3078394516 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b3c0cbbe0 con 0x7f5b28003a60 2023-10-06T03:02:45.663 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.654+0000 7f5b3a7fc700 1 -- 172.21.15.57:0/3078394516 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b2800ba60 con 0x7f5b3c0b01c0 2023-10-06T03:02:45.663 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.654+0000 7f5b33fff700 1 --2- 172.21.15.57:0/3078394516 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5b28004810 0x7f5b28004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:45.665 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.658+0000 7f5b3b7fe700 1 --2- 172.21.15.57:0/3078394516 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5b3c0b01c0 0x7f5b280051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:45.665 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.658+0000 7f5b3affd700 1 --2- 172.21.15.57:0/3078394516 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5b28003a60 0x7f5b28003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:45.665 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.658+0000 7f5b33fff700 1 -- 172.21.15.57:0/3078394516 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5b3c0b01c0 msgr2=0x7f5b280051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:45.665 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.658+0000 7f5b33fff700 1 --2- 172.21.15.57:0/3078394516 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5b3c0b01c0 0x7f5b280051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:45.665 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.658+0000 7f5b33fff700 1 -- 172.21.15.57:0/3078394516 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5b28003a60 msgr2=0x7f5b28003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:45.665 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.658+0000 7f5b33fff700 1 --2- 172.21.15.57:0/3078394516 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5b28003a60 0x7f5b28003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:45.665 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.658+0000 7f5b33fff700 1 -- 172.21.15.57:0/3078394516 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b28003570 con 0x7f5b28004810 2023-10-06T03:02:45.665 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.658+0000 7f5b33fff700 1 --2- 172.21.15.57:0/3078394516 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5b28004810 0x7f5b28004c80 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f5b24009c00 tx=0x7f5b240091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=667aa5e1e258090b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:45.665 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.658+0000 7f5b3a7fc700 1 -- 172.21.15.57:0/3078394516 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b2400e710 con 0x7f5b28004810 2023-10-06T03:02:45.666 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.658+0000 7f5b3a7fc700 1 -- 172.21.15.57:0/3078394516 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b2400e870 con 0x7f5b28004810 2023-10-06T03:02:45.666 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.658+0000 7f5b3a7fc700 1 -- 172.21.15.57:0/3078394516 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b2400ec30 con 0x7f5b28004810 2023-10-06T03:02:45.666 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.658+0000 7f5b414cd700 1 -- 172.21.15.57:0/3078394516 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5b28004810 msgr2=0x7f5b28004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:45.666 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.658+0000 7f5b414cd700 1 --2- 172.21.15.57:0/3078394516 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5b28004810 0x7f5b28004c80 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f5b24009c00 tx=0x7f5b240091a0 comp rx=0 tx=0).stop 2023-10-06T03:02:45.666 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.658+0000 7f5b3b7fe700 1 -- 172.21.15.57:0/3078394516 reap_dead start 2023-10-06T03:02:45.666 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.658+0000 7f5b414cd700 1 -- 172.21.15.57:0/3078394516 shutdown_connections 2023-10-06T03:02:45.666 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.658+0000 7f5b414cd700 1 -- 172.21.15.57:0/3078394516 >> 172.21.15.57:0/3078394516 conn(0x7f5b3c0ccbf0 msgr2=0x7f5b3c0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:45.666 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.658+0000 7f5b414cd700 1 -- 172.21.15.57:0/3078394516 shutdown_connections 2023-10-06T03:02:45.666 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.658+0000 7f5b414cd700 1 -- 172.21.15.57:0/3078394516 wait complete. 2023-10-06T03:02:45.667 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.662+0000 7f5b414cd700 1 Processor -- start 2023-10-06T03:02:45.667 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.662+0000 7f5b414cd700 1 -- start start 2023-10-06T03:02:45.668 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.662+0000 7f5b414cd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5b28004810 0x7f5b3c169540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:45.668 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.662+0000 7f5b414cd700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5b3c156710 0x7f5b3c151940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:45.669 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.662+0000 7f5b414cd700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5b3c0c9c50 0x7f5b3c0c8c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:45.669 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.662+0000 7f5b414cd700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b3c151e80 con 0x7f5b28004810 2023-10-06T03:02:45.669 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.662+0000 7f5b414cd700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b3c0c7320 con 0x7f5b3c0c9c50 2023-10-06T03:02:45.669 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.662+0000 7f5b414cd700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b3c169b50 con 0x7f5b3c156710 2023-10-06T03:02:45.669 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.662+0000 7f5b3affd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5b28004810 0x7f5b3c169540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:45.669 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.662+0000 7f5b3affd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5b28004810 0x7f5b3c169540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:59636/0 (socket says 172.21.15.57:59636) 2023-10-06T03:02:45.669 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.662+0000 7f5b3affd700 1 -- 172.21.15.57:0/1228299316 learned_addr learned my addr 172.21.15.57:0/1228299316 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:02:45.669 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.662+0000 7f5b33fff700 1 --2- 172.21.15.57:0/1228299316 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5b3c156710 0x7f5b3c151940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:45.669 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.662+0000 7f5b3b7fe700 1 --2- 172.21.15.57:0/1228299316 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5b3c0c9c50 0x7f5b3c0c8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:45.670 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.662+0000 7f5b3affd700 1 -- 172.21.15.57:0/1228299316 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5b3c156710 msgr2=0x7f5b3c151940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:45.670 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.662+0000 7f5b3affd700 1 --2- 172.21.15.57:0/1228299316 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5b3c156710 0x7f5b3c151940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:45.670 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.662+0000 7f5b3affd700 1 -- 172.21.15.57:0/1228299316 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5b3c0c9c50 msgr2=0x7f5b3c0c8c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:45.671 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.662+0000 7f5b3affd700 1 --2- 172.21.15.57:0/1228299316 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5b3c0c9c50 0x7f5b3c0c8c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:45.671 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.662+0000 7f5b3affd700 1 -- 172.21.15.57:0/1228299316 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b3c169e30 con 0x7f5b28004810 2023-10-06T03:02:45.671 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.662+0000 7f5b33fff700 1 --2- 172.21.15.57:0/1228299316 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5b3c156710 0x7f5b3c151940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:02:45.671 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.662+0000 7f5b3affd700 1 --2- 172.21.15.57:0/1228299316 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5b28004810 0x7f5b3c169540 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c00eb90 tx=0x7f5b3c0681f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:45.671 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.662+0000 7f5b32ffd700 1 -- 172.21.15.57:0/1228299316 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b2c00c760 con 0x7f5b28004810 2023-10-06T03:02:45.671 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.662+0000 7f5b32ffd700 1 -- 172.21.15.57:0/1228299316 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b2c00c8e0 con 0x7f5b28004810 2023-10-06T03:02:45.671 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.662+0000 7f5b414cd700 1 -- 172.21.15.57:0/1228299316 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b3c16a110 con 0x7f5b28004810 2023-10-06T03:02:45.671 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.662+0000 7f5b32ffd700 1 -- 172.21.15.57:0/1228299316 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b2c00cca0 con 0x7f5b28004810 2023-10-06T03:02:45.671 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.662+0000 7f5b414cd700 1 -- 172.21.15.57:0/1228299316 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b3c0ca0f0 con 0x7f5b28004810 2023-10-06T03:02:45.672 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.666+0000 7f5b414cd700 1 -- 172.21.15.57:0/1228299316 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b3c0712e0 con 0x7f5b28004810 2023-10-06T03:02:45.673 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.666+0000 7f5b32ffd700 1 -- 172.21.15.57:0/1228299316 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f5b2c013630 con 0x7f5b28004810 2023-10-06T03:02:45.674 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.666+0000 7f5b32ffd700 1 --2- 172.21.15.57:0/1228299316 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f5b1c060580 0x7f5b1c062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:45.674 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.670+0000 7f5b32ffd700 1 -- 172.21.15.57:0/1228299316 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5b2c07c9d0 con 0x7f5b28004810 2023-10-06T03:02:45.675 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.670+0000 7f5b33fff700 1 --2- 172.21.15.57:0/1228299316 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f5b1c060580 0x7f5b1c062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:45.676 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.670+0000 7f5b33fff700 1 --2- 172.21.15.57:0/1228299316 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f5b1c060580 0x7f5b1c062a30 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f5b240091e0 tx=0x7f5b2401a000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:45.681 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.674+0000 7f5b32ffd700 1 -- 172.21.15.57:0/1228299316 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f5b2c04cdc0 con 0x7f5b28004810 2023-10-06T03:02:45.849 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.842+0000 7f5b414cd700 1 -- 172.21.15.57:0/1228299316 --> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5b3c0c7460 con 0x7f5b1c060580 2023-10-06T03:02:45.865 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.858+0000 7f5b32ffd700 1 -- 172.21.15.57:0/1228299316 <== mgr.4103 v2:172.21.15.57:6832/32947 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+305875 (secure 0 0 0) 0x7f5b24024040 con 0x7f5b1c060580 2023-10-06T03:02:45.870 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:02:45.874 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.870+0000 7f5b414cd700 1 -- 172.21.15.57:0/1228299316 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f5b1c060580 msgr2=0x7f5b1c062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:45.874 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.870+0000 7f5b414cd700 1 --2- 172.21.15.57:0/1228299316 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f5b1c060580 0x7f5b1c062a30 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f5b240091e0 tx=0x7f5b2401a000 comp rx=0 tx=0).stop 2023-10-06T03:02:45.874 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.870+0000 7f5b414cd700 1 -- 172.21.15.57:0/1228299316 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5b28004810 msgr2=0x7f5b3c169540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:45.875 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.870+0000 7f5b414cd700 1 --2- 172.21.15.57:0/1228299316 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5b28004810 0x7f5b3c169540 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c00eb90 tx=0x7f5b3c0681f0 comp rx=0 tx=0).stop 2023-10-06T03:02:45.875 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.870+0000 7f5b414cd700 1 -- 172.21.15.57:0/1228299316 shutdown_connections 2023-10-06T03:02:45.875 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.870+0000 7f5b414cd700 1 --2- 172.21.15.57:0/1228299316 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5b3c0c9c50 0x7f5b3c0c8c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:45.876 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.870+0000 7f5b414cd700 1 --2- 172.21.15.57:0/1228299316 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f5b1c060580 0x7f5b1c062a30 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:45.876 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.870+0000 7f5b414cd700 1 --2- 172.21.15.57:0/1228299316 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5b3c156710 0x7f5b3c151940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:45.876 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.870+0000 7f5b414cd700 1 --2- 172.21.15.57:0/1228299316 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5b28004810 0x7f5b3c169540 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:45.876 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.870+0000 7f5b414cd700 1 -- 172.21.15.57:0/1228299316 >> 172.21.15.57:0/1228299316 conn(0x7f5b3c0ccbf0 msgr2=0x7f5b3c0cdcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:45.876 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.870+0000 7f5b414cd700 1 -- 172.21.15.57:0/1228299316 shutdown_connections 2023-10-06T03:02:45.876 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:45.870+0000 7f5b414cd700 1 -- 172.21.15.57:0/1228299316 wait complete. 2023-10-06T03:02:45.877 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2023-10-06T03:02:45.895 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":103,"stamp":"2023-10-06T03:02:44.305862+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":67,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2404312,"kb_used_data":5528,"kb_used_omap":0,"kb_used_meta":2398720,"kb_avail":752570408,"statfs":{"total":773094113280,"available":770632097792,"internally_reserved":0,"allocated":5660672,"data_stored":3089840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2456289280},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001560"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.845590+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:29:10.864990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.845802+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:27:35.234159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.851319+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:29:30.158378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.847718+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:18.879270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.841376+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:06:26.036575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.847453+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:23:18.217898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.854346+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:53:57.831764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.862103+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:17:48.382984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.862874+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:28:01.768786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.845785+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:06:26.036575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.841036+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:44:39.912786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.864917+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:17:46.359437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.846156+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:58:26.925821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.851625+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:41:45.880609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.845061+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:06:26.036575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.844877+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:58:03.418004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.853710+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:40:05.112188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.845091+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:58:26.925821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.850808+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:47:29.067808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.847201+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:02:36.798629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.847460+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:16:22.934040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.860493+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:18.879270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.841921+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:02:36.798629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.849036+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:27:35.234159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.851108+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:17:48.382984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.865759+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:40:05.112188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.843612+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:37:35.950737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.846351+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:43:59.979418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.850023+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:46:40.611565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.846537+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:12:14.521260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.853140+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:17:46.359437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.851907+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:17:48.382984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.845465+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:03:37.092106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.856515+0000","last_change":"2023-10-06T03:02:38.856515+0000","last_active":"2023-10-06T03:02:38.856515+0000","last_peered":"2023-10-06T03:02:38.856515+0000","last_clean":"2023-10-06T03:02:38.856515+0000","last_became_active":"2023-10-06T03:02:38.856154+0000","last_became_peered":"2023-10-06T03:02:38.856154+0000","last_unstale":"2023-10-06T03:02:38.856515+0000","last_undegraded":"2023-10-06T03:02:38.856515+0000","last_fullsized":"2023-10-06T03:02:38.856515+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:31:46.112896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.849055+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:12:14.521260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.870422+0000","last_change":"2023-10-06T03:02:38.870422+0000","last_active":"2023-10-06T03:02:38.870422+0000","last_peered":"2023-10-06T03:02:38.870422+0000","last_clean":"2023-10-06T03:02:38.870422+0000","last_became_active":"2023-10-06T03:02:38.869951+0000","last_became_peered":"2023-10-06T03:02:38.869951+0000","last_unstale":"2023-10-06T03:02:38.870422+0000","last_undegraded":"2023-10-06T03:02:38.870422+0000","last_fullsized":"2023-10-06T03:02:38.870422+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:01:14.978500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.846743+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:44:39.912786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.858140+0000","last_change":"2023-10-06T03:02:38.858140+0000","last_active":"2023-10-06T03:02:38.858140+0000","last_peered":"2023-10-06T03:02:38.858140+0000","last_clean":"2023-10-06T03:02:38.858140+0000","last_became_active":"2023-10-06T03:02:38.857805+0000","last_became_peered":"2023-10-06T03:02:38.857805+0000","last_unstale":"2023-10-06T03:02:38.858140+0000","last_undegraded":"2023-10-06T03:02:38.858140+0000","last_fullsized":"2023-10-06T03:02:38.858140+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:14:55.765174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.861373+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:46:40.611565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.873915+0000","last_change":"2023-10-06T03:02:38.873915+0000","last_active":"2023-10-06T03:02:38.873915+0000","last_peered":"2023-10-06T03:02:38.873915+0000","last_clean":"2023-10-06T03:02:38.873915+0000","last_became_active":"2023-10-06T03:02:38.873404+0000","last_became_peered":"2023-10-06T03:02:38.873404+0000","last_unstale":"2023-10-06T03:02:38.873915+0000","last_undegraded":"2023-10-06T03:02:38.873915+0000","last_fullsized":"2023-10-06T03:02:38.873915+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:58:25.908183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.840383+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:14:47.594861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.857653+0000","last_change":"2023-10-06T03:02:38.857653+0000","last_active":"2023-10-06T03:02:38.857653+0000","last_peered":"2023-10-06T03:02:38.857653+0000","last_clean":"2023-10-06T03:02:38.857653+0000","last_became_active":"2023-10-06T03:02:38.857368+0000","last_became_peered":"2023-10-06T03:02:38.857368+0000","last_unstale":"2023-10-06T03:02:38.857653+0000","last_undegraded":"2023-10-06T03:02:38.857653+0000","last_fullsized":"2023-10-06T03:02:38.857653+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:04:38.128587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.848288+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:39:42.661414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.854422+0000","last_change":"2023-10-06T03:02:38.854422+0000","last_active":"2023-10-06T03:02:38.854422+0000","last_peered":"2023-10-06T03:02:38.854422+0000","last_clean":"2023-10-06T03:02:38.854422+0000","last_became_active":"2023-10-06T03:02:38.854088+0000","last_became_peered":"2023-10-06T03:02:38.854088+0000","last_unstale":"2023-10-06T03:02:38.854422+0000","last_undegraded":"2023-10-06T03:02:38.854422+0000","last_fullsized":"2023-10-06T03:02:38.854422+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:41:45.591282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.864711+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:12:14.521260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.858755+0000","last_change":"2023-10-06T03:02:38.858755+0000","last_active":"2023-10-06T03:02:38.858755+0000","last_peered":"2023-10-06T03:02:38.858755+0000","last_clean":"2023-10-06T03:02:38.858755+0000","last_became_active":"2023-10-06T03:02:38.858405+0000","last_became_peered":"2023-10-06T03:02:38.858405+0000","last_unstale":"2023-10-06T03:02:38.858755+0000","last_undegraded":"2023-10-06T03:02:38.858755+0000","last_fullsized":"2023-10-06T03:02:38.858755+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:59:48.860090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.845190+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:23:18.217898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.863407+0000","last_change":"2023-10-06T03:02:38.863407+0000","last_active":"2023-10-06T03:02:38.863407+0000","last_peered":"2023-10-06T03:02:38.863407+0000","last_clean":"2023-10-06T03:02:38.863407+0000","last_became_active":"2023-10-06T03:02:38.863081+0000","last_became_peered":"2023-10-06T03:02:38.863081+0000","last_unstale":"2023-10-06T03:02:38.863407+0000","last_undegraded":"2023-10-06T03:02:38.863407+0000","last_fullsized":"2023-10-06T03:02:38.863407+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:58:02.400366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.840362+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:04:39.146225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.860246+0000","last_change":"2023-10-06T03:02:38.860246+0000","last_active":"2023-10-06T03:02:38.860246+0000","last_peered":"2023-10-06T03:02:38.860246+0000","last_clean":"2023-10-06T03:02:38.860246+0000","last_became_active":"2023-10-06T03:02:38.859969+0000","last_became_peered":"2023-10-06T03:02:38.859969+0000","last_unstale":"2023-10-06T03:02:38.860246+0000","last_undegraded":"2023-10-06T03:02:38.860246+0000","last_fullsized":"2023-10-06T03:02:38.860246+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:16:59.767516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.850848+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:46:40.611565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.869322+0000","last_change":"2023-10-06T03:02:38.869322+0000","last_active":"2023-10-06T03:02:38.869322+0000","last_peered":"2023-10-06T03:02:38.869322+0000","last_clean":"2023-10-06T03:02:38.869322+0000","last_became_active":"2023-10-06T03:02:38.868958+0000","last_became_peered":"2023-10-06T03:02:38.868958+0000","last_unstale":"2023-10-06T03:02:38.869322+0000","last_undegraded":"2023-10-06T03:02:38.869322+0000","last_fullsized":"2023-10-06T03:02:38.869322+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:18:12.245614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.851092+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:28:01.768786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.861193+0000","last_change":"2023-10-06T03:02:38.861193+0000","last_active":"2023-10-06T03:02:38.861193+0000","last_peered":"2023-10-06T03:02:38.861193+0000","last_clean":"2023-10-06T03:02:38.861193+0000","last_became_active":"2023-10-06T03:02:38.860904+0000","last_became_peered":"2023-10-06T03:02:38.860904+0000","last_unstale":"2023-10-06T03:02:38.861193+0000","last_undegraded":"2023-10-06T03:02:38.861193+0000","last_fullsized":"2023-10-06T03:02:38.861193+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:04:38.128587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.840714+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:58:03.418004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.871902+0000","last_change":"2023-10-06T03:02:38.871902+0000","last_active":"2023-10-06T03:02:38.871902+0000","last_peered":"2023-10-06T03:02:38.871902+0000","last_clean":"2023-10-06T03:02:38.871902+0000","last_became_active":"2023-10-06T03:02:38.871585+0000","last_became_peered":"2023-10-06T03:02:38.871585+0000","last_unstale":"2023-10-06T03:02:38.871902+0000","last_undegraded":"2023-10-06T03:02:38.871902+0000","last_fullsized":"2023-10-06T03:02:38.871902+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:29:09.847352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.851097+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:47:29.067808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.863229+0000","last_change":"2023-10-06T03:02:38.863229+0000","last_active":"2023-10-06T03:02:38.863229+0000","last_peered":"2023-10-06T03:02:38.863229+0000","last_clean":"2023-10-06T03:02:38.863229+0000","last_became_active":"2023-10-06T03:02:38.862751+0000","last_became_peered":"2023-10-06T03:02:38.862751+0000","last_unstale":"2023-10-06T03:02:38.863229+0000","last_undegraded":"2023-10-06T03:02:38.863229+0000","last_fullsized":"2023-10-06T03:02:38.863229+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:41:45.591282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.850206+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:12:14.521260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.864366+0000","last_change":"2023-10-06T03:02:38.864366+0000","last_active":"2023-10-06T03:02:38.864366+0000","last_peered":"2023-10-06T03:02:38.864366+0000","last_clean":"2023-10-06T03:02:38.864366+0000","last_became_active":"2023-10-06T03:02:38.864042+0000","last_became_peered":"2023-10-06T03:02:38.864042+0000","last_unstale":"2023-10-06T03:02:38.864366+0000","last_undegraded":"2023-10-06T03:02:38.864366+0000","last_fullsized":"2023-10-06T03:02:38.864366+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:14:45.231794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.865305+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:08:51.831968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.858014+0000","last_change":"2023-10-06T03:02:38.858014+0000","last_active":"2023-10-06T03:02:38.858014+0000","last_peered":"2023-10-06T03:02:38.858014+0000","last_clean":"2023-10-06T03:02:38.858014+0000","last_became_active":"2023-10-06T03:02:38.857708+0000","last_became_peered":"2023-10-06T03:02:38.857708+0000","last_unstale":"2023-10-06T03:02:38.858014+0000","last_undegraded":"2023-10-06T03:02:38.858014+0000","last_fullsized":"2023-10-06T03:02:38.858014+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:37:34.933099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.855648+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:19:46.946130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.872336+0000","last_change":"2023-10-06T03:02:38.872336+0000","last_active":"2023-10-06T03:02:38.872336+0000","last_peered":"2023-10-06T03:02:38.872336+0000","last_clean":"2023-10-06T03:02:38.872336+0000","last_became_active":"2023-10-06T03:02:38.871712+0000","last_became_peered":"2023-10-06T03:02:38.871712+0000","last_unstale":"2023-10-06T03:02:38.872336+0000","last_undegraded":"2023-10-06T03:02:38.872336+0000","last_fullsized":"2023-10-06T03:02:38.872336+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:06:25.018937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.861542+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:47:29.067808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.876423+0000","last_change":"2023-10-06T03:02:38.876423+0000","last_active":"2023-10-06T03:02:38.876423+0000","last_peered":"2023-10-06T03:02:38.876423+0000","last_clean":"2023-10-06T03:02:38.876423+0000","last_became_active":"2023-10-06T03:02:38.876118+0000","last_became_peered":"2023-10-06T03:02:38.876118+0000","last_unstale":"2023-10-06T03:02:38.876423+0000","last_undegraded":"2023-10-06T03:02:38.876423+0000","last_fullsized":"2023-10-06T03:02:38.876423+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:58:25.908183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.843494+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:17:00.785154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.861028+0000","last_change":"2023-10-06T03:02:38.861028+0000","last_active":"2023-10-06T03:02:38.861028+0000","last_peered":"2023-10-06T03:02:38.861028+0000","last_clean":"2023-10-06T03:02:38.861028+0000","last_became_active":"2023-10-06T03:02:38.859084+0000","last_became_peered":"2023-10-06T03:02:38.859084+0000","last_unstale":"2023-10-06T03:02:38.861028+0000","last_undegraded":"2023-10-06T03:02:38.861028+0000","last_fullsized":"2023-10-06T03:02:38.861028+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:37:03.894863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.840919+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:29:10.864990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.861356+0000","last_change":"2023-10-06T03:02:38.861356+0000","last_active":"2023-10-06T03:02:38.861356+0000","last_peered":"2023-10-06T03:02:38.861356+0000","last_clean":"2023-10-06T03:02:38.861356+0000","last_became_active":"2023-10-06T03:02:38.861051+0000","last_became_peered":"2023-10-06T03:02:38.861051+0000","last_unstale":"2023-10-06T03:02:38.861356+0000","last_undegraded":"2023-10-06T03:02:38.861356+0000","last_fullsized":"2023-10-06T03:02:38.861356+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:51:34.107940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.843354+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:18:13.263253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.873865+0000","last_change":"2023-10-06T03:02:38.873865+0000","last_active":"2023-10-06T03:02:38.873865+0000","last_peered":"2023-10-06T03:02:38.873865+0000","last_clean":"2023-10-06T03:02:38.873865+0000","last_became_active":"2023-10-06T03:02:38.873448+0000","last_became_peered":"2023-10-06T03:02:38.873448+0000","last_unstale":"2023-10-06T03:02:38.873865+0000","last_undegraded":"2023-10-06T03:02:38.873865+0000","last_fullsized":"2023-10-06T03:02:38.873865+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:01:19.591702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.850589+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:39:42.661414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.861807+0000","last_change":"2023-10-06T03:02:38.861807+0000","last_active":"2023-10-06T03:02:38.861807+0000","last_peered":"2023-10-06T03:02:38.861807+0000","last_clean":"2023-10-06T03:02:38.861807+0000","last_became_active":"2023-10-06T03:02:38.861513+0000","last_became_peered":"2023-10-06T03:02:38.861513+0000","last_unstale":"2023-10-06T03:02:38.861807+0000","last_undegraded":"2023-10-06T03:02:38.861807+0000","last_fullsized":"2023-10-06T03:02:38.861807+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:56:07.918211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.852214+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:18:27.259723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.872303+0000","last_change":"2023-10-06T03:02:38.872303+0000","last_active":"2023-10-06T03:02:38.872303+0000","last_peered":"2023-10-06T03:02:38.872303+0000","last_clean":"2023-10-06T03:02:38.872303+0000","last_became_active":"2023-10-06T03:02:38.871590+0000","last_became_peered":"2023-10-06T03:02:38.871590+0000","last_unstale":"2023-10-06T03:02:38.872303+0000","last_undegraded":"2023-10-06T03:02:38.872303+0000","last_fullsized":"2023-10-06T03:02:38.872303+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:58:02.400366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.849827+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:39:42.661414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.867297+0000","last_change":"2023-10-06T03:02:38.867297+0000","last_active":"2023-10-06T03:02:38.867297+0000","last_peered":"2023-10-06T03:02:38.867297+0000","last_clean":"2023-10-06T03:02:38.867297+0000","last_became_active":"2023-10-06T03:02:38.866855+0000","last_became_peered":"2023-10-06T03:02:38.866855+0000","last_unstale":"2023-10-06T03:02:38.867297+0000","last_undegraded":"2023-10-06T03:02:38.867297+0000","last_fullsized":"2023-10-06T03:02:38.867297+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:29:09.847352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.844058+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:14:47.594861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.860777+0000","last_change":"2023-10-06T03:02:38.860777+0000","last_active":"2023-10-06T03:02:38.860777+0000","last_peered":"2023-10-06T03:02:38.860777+0000","last_clean":"2023-10-06T03:02:38.860777+0000","last_became_active":"2023-10-06T03:02:38.858664+0000","last_became_peered":"2023-10-06T03:02:38.858664+0000","last_unstale":"2023-10-06T03:02:38.860777+0000","last_undegraded":"2023-10-06T03:02:38.860777+0000","last_fullsized":"2023-10-06T03:02:38.860777+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:47:47.993117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.849391+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:48:50.971382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.867362+0000","last_change":"2023-10-06T03:02:38.867362+0000","last_active":"2023-10-06T03:02:38.867362+0000","last_peered":"2023-10-06T03:02:38.867362+0000","last_clean":"2023-10-06T03:02:38.867362+0000","last_became_active":"2023-10-06T03:02:38.863794+0000","last_became_peered":"2023-10-06T03:02:38.863794+0000","last_unstale":"2023-10-06T03:02:38.867362+0000","last_undegraded":"2023-10-06T03:02:38.867362+0000","last_fullsized":"2023-10-06T03:02:38.867362+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:06:25.018937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":185,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T03:02:37.828500+0000","last_change":"2023-10-06T03:00:45.709165+0000","last_active":"2023-10-06T03:02:37.828500+0000","last_peered":"2023-10-06T03:02:37.828500+0000","last_clean":"2023-10-06T03:02:37.828500+0000","last_became_active":"2023-10-06T03:00:45.707771+0000","last_became_peered":"2023-10-06T03:00:45.707771+0000","last_unstale":"2023-10-06T03:02:37.828500+0000","last_undegraded":"2023-10-06T03:02:37.828500+0000","last_fullsized":"2023-10-06T03:02:37.828500+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:44.625353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:44.625353+0000","last_clean_scrub_stamp":"2023-10-06T03:00:44.625353+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:31:31.774239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":31,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T03:02:37.831669+0000","last_change":"2023-10-06T03:00:51.905381+0000","last_active":"2023-10-06T03:02:37.831669+0000","last_peered":"2023-10-06T03:02:37.831669+0000","last_clean":"2023-10-06T03:02:37.831669+0000","last_became_active":"2023-10-06T03:00:51.904974+0000","last_became_peered":"2023-10-06T03:00:51.904974+0000","last_unstale":"2023-10-06T03:02:37.831669+0000","last_undegraded":"2023-10-06T03:02:37.831669+0000","last_fullsized":"2023-10-06T03:02:37.831669+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:15:19.182956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.843912+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:04:39.146225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.858174+0000","last_change":"2023-10-06T03:02:38.858174+0000","last_active":"2023-10-06T03:02:38.858174+0000","last_peered":"2023-10-06T03:02:38.858174+0000","last_clean":"2023-10-06T03:02:38.858174+0000","last_became_active":"2023-10-06T03:02:38.857843+0000","last_became_peered":"2023-10-06T03:02:38.857843+0000","last_unstale":"2023-10-06T03:02:38.858174+0000","last_undegraded":"2023-10-06T03:02:38.858174+0000","last_fullsized":"2023-10-06T03:02:38.858174+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:14:46.577223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":32,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T03:02:37.828379+0000","last_change":"2023-10-06T03:00:51.906480+0000","last_active":"2023-10-06T03:02:37.828379+0000","last_peered":"2023-10-06T03:02:37.828379+0000","last_clean":"2023-10-06T03:02:37.828379+0000","last_became_active":"2023-10-06T03:00:51.905956+0000","last_became_peered":"2023-10-06T03:00:51.905956+0000","last_unstale":"2023-10-06T03:02:37.828379+0000","last_undegraded":"2023-10-06T03:02:37.828379+0000","last_fullsized":"2023-10-06T03:02:37.828379+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:15:19.182956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.860881+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:39:42.661414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.857592+0000","last_change":"2023-10-06T03:02:38.857592+0000","last_active":"2023-10-06T03:02:38.857592+0000","last_peered":"2023-10-06T03:02:38.857592+0000","last_clean":"2023-10-06T03:02:38.857592+0000","last_became_active":"2023-10-06T03:02:38.857248+0000","last_became_peered":"2023-10-06T03:02:38.857248+0000","last_unstale":"2023-10-06T03:02:38.857592+0000","last_undegraded":"2023-10-06T03:02:38.857592+0000","last_fullsized":"2023-10-06T03:02:38.857592+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:14:46.577223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":32,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T03:02:37.831975+0000","last_change":"2023-10-06T03:00:51.902453+0000","last_active":"2023-10-06T03:02:37.831975+0000","last_peered":"2023-10-06T03:02:37.831975+0000","last_clean":"2023-10-06T03:02:37.831975+0000","last_became_active":"2023-10-06T03:00:51.901948+0000","last_became_peered":"2023-10-06T03:00:51.901948+0000","last_unstale":"2023-10-06T03:02:37.831975+0000","last_undegraded":"2023-10-06T03:02:37.831975+0000","last_fullsized":"2023-10-06T03:02:37.831975+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:13:30.721650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.849375+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:27:35.234159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.864320+0000","last_change":"2023-10-06T03:02:38.864320+0000","last_active":"2023-10-06T03:02:38.864320+0000","last_peered":"2023-10-06T03:02:38.864320+0000","last_clean":"2023-10-06T03:02:38.864320+0000","last_became_active":"2023-10-06T03:02:38.864020+0000","last_became_peered":"2023-10-06T03:02:38.864020+0000","last_unstale":"2023-10-06T03:02:38.864320+0000","last_undegraded":"2023-10-06T03:02:38.864320+0000","last_fullsized":"2023-10-06T03:02:38.864320+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:37:03.894863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":31,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T03:02:37.831524+0000","last_change":"2023-10-06T03:00:51.904148+0000","last_active":"2023-10-06T03:02:37.831524+0000","last_peered":"2023-10-06T03:02:37.831524+0000","last_clean":"2023-10-06T03:02:37.831524+0000","last_became_active":"2023-10-06T03:00:51.903729+0000","last_became_peered":"2023-10-06T03:00:51.903729+0000","last_unstale":"2023-10-06T03:02:37.831524+0000","last_undegraded":"2023-10-06T03:02:37.831524+0000","last_fullsized":"2023-10-06T03:02:37.831524+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:17:25.070478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.852876+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:08:51.831968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.867268+0000","last_change":"2023-10-06T03:02:38.867268+0000","last_active":"2023-10-06T03:02:38.867268+0000","last_peered":"2023-10-06T03:02:38.867268+0000","last_clean":"2023-10-06T03:02:38.867268+0000","last_became_active":"2023-10-06T03:02:38.867007+0000","last_became_peered":"2023-10-06T03:02:38.867007+0000","last_unstale":"2023-10-06T03:02:38.867268+0000","last_undegraded":"2023-10-06T03:02:38.867268+0000","last_fullsized":"2023-10-06T03:02:38.867268+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:56:07.918211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":29,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T03:02:37.832579+0000","last_change":"2023-10-06T03:00:52.484317+0000","last_active":"2023-10-06T03:02:37.832579+0000","last_peered":"2023-10-06T03:02:37.832579+0000","last_clean":"2023-10-06T03:02:37.832579+0000","last_became_active":"2023-10-06T03:00:52.483818+0000","last_became_peered":"2023-10-06T03:00:52.483818+0000","last_unstale":"2023-10-06T03:02:37.832579+0000","last_undegraded":"2023-10-06T03:02:37.832579+0000","last_fullsized":"2023-10-06T03:02:37.832579+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:17:24.136459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.859205+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:27:35.234159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.861581+0000","last_change":"2023-10-06T03:02:38.861581+0000","last_active":"2023-10-06T03:02:38.861581+0000","last_peered":"2023-10-06T03:02:38.861581+0000","last_clean":"2023-10-06T03:02:38.861581+0000","last_became_active":"2023-10-06T03:02:38.861190+0000","last_became_peered":"2023-10-06T03:02:38.861190+0000","last_unstale":"2023-10-06T03:02:38.861581+0000","last_undegraded":"2023-10-06T03:02:38.861581+0000","last_fullsized":"2023-10-06T03:02:38.861581+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:23:17.200260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":32,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T03:02:37.829601+0000","last_change":"2023-10-06T03:00:52.485186+0000","last_active":"2023-10-06T03:02:37.829601+0000","last_peered":"2023-10-06T03:02:37.829601+0000","last_clean":"2023-10-06T03:02:37.829601+0000","last_became_active":"2023-10-06T03:00:52.484615+0000","last_became_peered":"2023-10-06T03:00:52.484615+0000","last_unstale":"2023-10-06T03:02:37.829601+0000","last_undegraded":"2023-10-06T03:02:37.829601+0000","last_fullsized":"2023-10-06T03:02:37.829601+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:17:25.070478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.849461+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:18.879270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.872801+0000","last_change":"2023-10-06T03:02:38.872801+0000","last_active":"2023-10-06T03:02:38.872801+0000","last_peered":"2023-10-06T03:02:38.872801+0000","last_clean":"2023-10-06T03:02:38.872801+0000","last_became_active":"2023-10-06T03:02:38.872498+0000","last_became_peered":"2023-10-06T03:02:38.872498+0000","last_unstale":"2023-10-06T03:02:38.872801+0000","last_undegraded":"2023-10-06T03:02:38.872801+0000","last_fullsized":"2023-10-06T03:02:38.872801+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:58:25.908183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":29,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T03:02:37.833264+0000","last_change":"2023-10-06T03:00:51.903388+0000","last_active":"2023-10-06T03:02:37.833264+0000","last_peered":"2023-10-06T03:02:37.833264+0000","last_clean":"2023-10-06T03:02:37.833264+0000","last_became_active":"2023-10-06T03:00:51.902959+0000","last_became_peered":"2023-10-06T03:00:51.902959+0000","last_unstale":"2023-10-06T03:02:37.833264+0000","last_undegraded":"2023-10-06T03:02:37.833264+0000","last_fullsized":"2023-10-06T03:02:37.833264+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:30:16.907470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:02:38.822196+0000","last_change":"2023-10-06T03:02:38.849170+0000","last_active":"2023-10-06T03:02:38.822196+0000","last_peered":"2023-10-06T03:02:38.822196+0000","last_clean":"2023-10-06T03:02:38.822196+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:02:38.822196+0000","last_undegraded":"2023-10-06T03:02:38.822196+0000","last_fullsized":"2023-10-06T03:02:38.822196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:18.879270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":8,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-10-06T03:02:38.872473+0000","last_change":"2023-10-06T03:02:38.872473+0000","last_active":"2023-10-06T03:02:38.872473+0000","last_peered":"2023-10-06T03:02:38.872473+0000","last_clean":"2023-10-06T03:02:38.872473+0000","last_became_active":"2023-10-06T03:02:38.871994+0000","last_became_peered":"2023-10-06T03:02:38.871994+0000","last_unstale":"2023-10-06T03:02:38.872473+0000","last_undegraded":"2023-10-06T03:02:38.872473+0000","last_fullsized":"2023-10-06T03:02:38.872473+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:23:17.200260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":31,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-10-06T03:02:37.833840+0000","last_change":"2023-10-06T03:00:51.903242+0000","last_active":"2023-10-06T03:02:37.833840+0000","last_peered":"2023-10-06T03:02:37.833840+0000","last_clean":"2023-10-06T03:02:37.833840+0000","last_became_active":"2023-10-06T03:00:51.902929+0000","last_became_peered":"2023-10-06T03:00:51.902929+0000","last_unstale":"2023-10-06T03:02:37.833840+0000","last_undegraded":"2023-10-06T03:02:37.833840+0000","last_fullsized":"2023-10-06T03:02:37.833840+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:34:12.274158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574874,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302504,"kb_used_data":1120,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069336,"statfs":{"total":96636764160,"available":96327000064,"internally_reserved":0,"allocated":1146880,"data_stored":825698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"min":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":4.7930000000000001,"5min":4.7930000000000001,"15min":4.7930000000000001},"last":0.89000000000000001},{"interface":"front","average":{"1min":1.5780000000000001,"5min":1.5780000000000001,"15min":1.5780000000000001},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":9.9689999999999994,"5min":9.9689999999999994,"15min":9.9689999999999994},"last":0.92700000000000005}]},{"osd":1,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":10.867000000000001,"5min":10.867000000000001,"15min":10.867000000000001},"last":1.2450000000000001},{"interface":"front","average":{"1min":1.6779999999999999,"5min":1.6779999999999999,"15min":1.6779999999999999},"min":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":10.255000000000001,"5min":10.255000000000001,"15min":10.255000000000001},"last":1.3580000000000001}]},{"osd":2,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.6799999999999999,"5min":1.6799999999999999,"15min":1.6799999999999999},"min":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"max":{"1min":7.9939999999999998,"5min":7.9939999999999998,"15min":7.9939999999999998},"last":1.391},{"interface":"front","average":{"1min":1.6970000000000001,"5min":1.6970000000000001,"15min":1.6970000000000001},"min":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"max":{"1min":10.098000000000001,"5min":10.098000000000001,"15min":10.098000000000001},"last":1.421}]},{"osd":3,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"min":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"max":{"1min":4.3090000000000002,"5min":4.3090000000000002,"15min":4.3090000000000002},"last":1.167},{"interface":"front","average":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"min":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":8.3770000000000007,"5min":8.3770000000000007,"15min":8.3770000000000007},"last":1.04}]},{"osd":4,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.7889999999999999,"5min":1.7889999999999999,"15min":1.7889999999999999},"min":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"max":{"1min":11.391999999999999,"5min":11.391999999999999,"15min":11.391999999999999},"last":1.21},{"interface":"front","average":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"min":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"max":{"1min":3.9220000000000002,"5min":3.9220000000000002,"15min":3.9220000000000002},"last":1.4730000000000001}]},{"osd":5,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.796,"5min":1.796,"15min":1.796},"min":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"max":{"1min":11.951000000000001,"5min":11.951000000000001,"15min":11.951000000000001},"last":1.323},{"interface":"front","average":{"1min":1.9259999999999999,"5min":1.9259999999999999,"15min":1.9259999999999999},"min":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"max":{"1min":10.994999999999999,"5min":10.994999999999999,"15min":10.994999999999999},"last":1.109}]},{"osd":6,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.9890000000000001,"5min":1.9890000000000001,"15min":1.9890000000000001},"min":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"max":{"1min":11.513,"5min":11.513,"15min":11.513},"last":1.444},{"interface":"front","average":{"1min":1.958,"5min":1.958,"15min":1.958},"min":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"max":{"1min":10.714,"5min":10.714,"15min":10.714},"last":1.286}]}]},{"osd":6,"up_from":13,"seq":55834574874,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297840,"kb_used_data":552,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074000,"statfs":{"total":96636764160,"available":96331776000,"internally_reserved":0,"allocated":565248,"data_stored":241946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":0.79900000000000004},{"interface":"front","average":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":2.1419999999999999,"5min":2.1419999999999999,"15min":2.1419999999999999},"last":0.99299999999999999}]},{"osd":1,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"min":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"max":{"1min":1.9159999999999999,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":0.93899999999999995},{"interface":"front","average":{"1min":1.256,"5min":1.256,"15min":1.256},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":1.677,"5min":1.677,"15min":1.677},"last":0.90200000000000002}]},{"osd":2,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.167,"15min":1.167},"min":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":1.659,"5min":1.659,"15min":1.659},"last":0.83699999999999997},{"interface":"front","average":{"1min":1.236,"5min":1.236,"15min":1.236},"min":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"max":{"1min":1.78,"5min":1.78,"15min":1.78},"last":0.86899999999999999}]},{"osd":3,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.284,"5min":1.284,"15min":1.284},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":0.75900000000000001},{"interface":"front","average":{"1min":1.343,"5min":1.343,"15min":1.343},"min":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":2.2200000000000002,"5min":2.2200000000000002,"15min":2.2200000000000002},"last":0.72199999999999998}]},{"osd":4,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.286,"5min":1.286,"15min":1.286},"min":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"max":{"1min":1.889,"5min":1.889,"15min":1.889},"last":0.69999999999999996},{"interface":"front","average":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"min":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":2.2610000000000001,"5min":2.2610000000000001,"15min":2.2610000000000001},"last":0.91700000000000004}]},{"osd":5,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"min":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"max":{"1min":1.994,"5min":1.994,"15min":1.994},"last":1.0169999999999999},{"interface":"front","average":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"min":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"max":{"1min":2.0129999999999999,"5min":2.0129999999999999,"15min":2.0129999999999999},"last":0.95799999999999996}]},{"osd":7,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"min":{"1min":1.016,"5min":1.016,"15min":1.016},"max":{"1min":2.0920000000000001,"5min":2.0920000000000001,"15min":2.0920000000000001},"last":1.0449999999999999},{"interface":"front","average":{"1min":1.5469999999999999,"5min":1.5469999999999999,"15min":1.5469999999999999},"min":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"max":{"1min":2.0310000000000001,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":1.0589999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574874,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297840,"kb_used_data":552,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074000,"statfs":{"total":96636764160,"available":96331776000,"internally_reserved":0,"allocated":565248,"data_stored":241946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":1.1539999999999999},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.5,"5min":1.5,"15min":1.5},"last":1.3640000000000001}]},{"osd":1,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"min":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":1.984,"5min":1.984,"15min":1.984},"last":1.0029999999999999},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.708,"5min":1.708,"15min":1.708},"last":1.1990000000000001}]},{"osd":2,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.395,"5min":1.395,"15min":1.395},"min":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"max":{"1min":1.78,"5min":1.78,"15min":1.78},"last":1.3979999999999999},{"interface":"front","average":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"min":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":2.8319999999999999,"5min":2.8319999999999999,"15min":2.8319999999999999},"last":1.4099999999999999}]},{"osd":3,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"min":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":3.1789999999999998,"5min":3.1789999999999998,"15min":3.1789999999999998},"last":1.1140000000000001},{"interface":"front","average":{"1min":1.272,"5min":1.272,"15min":1.272},"min":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"max":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":1.327}]},{"osd":4,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":1.302,"15min":1.302},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":2.5899999999999999,"5min":2.5899999999999999,"15min":2.5899999999999999},"last":1.2869999999999999},{"interface":"front","average":{"1min":1.516,"5min":1.516,"15min":1.516},"min":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"max":{"1min":4.5419999999999998,"5min":4.5419999999999998,"15min":4.5419999999999998},"last":1.48}]},{"osd":6,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.847,"5min":1.847,"15min":1.847},"last":1.506},{"interface":"front","average":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"min":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":2.9239999999999999,"5min":2.9239999999999999,"15min":2.9239999999999999},"last":1.5329999999999999}]},{"osd":7,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":4.4489999999999998,"5min":4.4489999999999998,"15min":4.4489999999999998},"last":1.2509999999999999},{"interface":"front","average":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"min":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"max":{"1min":1.98,"5min":1.98,"15min":1.98},"last":1.454}]}]},{"osd":4,"up_from":13,"seq":55834574873,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297840,"kb_used_data":552,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074000,"statfs":{"total":96636764160,"available":96331776000,"internally_reserved":0,"allocated":565248,"data_stored":241946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.6040000000000001,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":0.84199999999999997},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.585,"5min":1.585,"15min":1.585},"last":1.1559999999999999}]},{"osd":1,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.403,"5min":1.403,"15min":1.403},"last":1.244},{"interface":"front","average":{"1min":1.169,"5min":1.169,"15min":1.169},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.73,"5min":1.73,"15min":1.73},"last":1.1279999999999999}]},{"osd":2,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.696,"5min":1.696,"15min":1.696},"last":1.425},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":1.788,"5min":1.788,"15min":1.788},"last":1.1850000000000001}]},{"osd":3,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.248,"15min":1.248},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.625,"5min":1.625,"15min":1.625},"last":0.996},{"interface":"front","average":{"1min":1.232,"5min":1.232,"15min":1.232},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.7629999999999999,"5min":1.7629999999999999,"15min":1.7629999999999999},"last":1.089}]},{"osd":5,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.198,"5min":1.198,"15min":1.198},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.71,"5min":1.71,"15min":1.71},"last":0.56799999999999995},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.7889999999999999,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":1.212}]},{"osd":6,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":2.9100000000000001,"5min":2.9100000000000001,"15min":2.9100000000000001},"last":0.93500000000000005},{"interface":"front","average":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":3.282,"5min":3.282,"15min":3.282},"last":0.74299999999999999}]},{"osd":7,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.544,"5min":1.544,"15min":1.544},"min":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"max":{"1min":2.145,"5min":2.145,"15min":2.145},"last":1.286},{"interface":"front","average":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"min":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.927,"5min":1.927,"15min":1.927},"last":1.341}]}]},{"osd":3,"up_from":13,"seq":55834574873,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301936,"kb_used_data":552,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069904,"statfs":{"total":96636764160,"available":96327581696,"internally_reserved":0,"allocated":565248,"data_stored":241946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:01:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":2.298,"5min":2.298,"15min":2.298},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.998,"5min":0.998,"15min":0.998},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":2.1850000000000001,"5min":2.1850000000000001,"15min":2.1850000000000001},"last":0.60699999999999998}]},{"osd":1,"last update":"Fri Oct 6 03:01:46 2023","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.974,"5min":1.974,"15min":1.974},"last":0.58599999999999997},{"interface":"front","average":{"1min":1.137,"5min":1.137,"15min":1.137},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.71,"5min":1.71,"15min":1.71},"last":0.63700000000000001}]},{"osd":2,"last update":"Fri Oct 6 03:01:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":2.8849999999999998,"5min":2.8849999999999998,"15min":2.8849999999999998},"last":0.44500000000000001},{"interface":"front","average":{"1min":1.095,"5min":1.095,"15min":1.095},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":2.8220000000000001,"5min":2.8220000000000001,"15min":2.8220000000000001},"last":0.86699999999999999}]},{"osd":4,"last update":"Fri Oct 6 03:01:46 2023","interfaces":[{"interface":"back","average":{"1min":1.456,"5min":1.456,"15min":1.456},"min":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"max":{"1min":3.6560000000000001,"5min":3.6560000000000001,"15min":3.6560000000000001},"last":0.751},{"interface":"front","average":{"1min":1.466,"5min":1.466,"15min":1.466},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":3.7749999999999999,"5min":3.7749999999999999,"15min":3.7749999999999999},"last":0.76800000000000002}]},{"osd":5,"last update":"Fri Oct 6 03:01:46 2023","interfaces":[{"interface":"back","average":{"1min":1.534,"5min":1.534,"15min":1.534},"min":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"max":{"1min":3.4910000000000001,"5min":3.4910000000000001,"15min":3.4910000000000001},"last":0.83099999999999996},{"interface":"front","average":{"1min":1.494,"5min":1.494,"15min":1.494},"min":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"max":{"1min":2.6240000000000001,"5min":2.6240000000000001,"15min":2.6240000000000001},"last":1.101}]},{"osd":6,"last update":"Fri Oct 6 03:01:46 2023","interfaces":[{"interface":"back","average":{"1min":1.5780000000000001,"5min":1.5780000000000001,"15min":1.5780000000000001},"min":{"1min":1.046,"5min":1.046,"15min":1.046},"max":{"1min":3.7050000000000001,"5min":3.7050000000000001,"15min":3.7050000000000001},"last":0.84599999999999997},{"interface":"front","average":{"1min":1.583,"5min":1.583,"15min":1.583},"min":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"max":{"1min":3.9300000000000002,"5min":3.9300000000000002,"15min":3.9300000000000002},"last":0.80900000000000005}]},{"osd":7,"last update":"Fri Oct 6 03:01:46 2023","interfaces":[{"interface":"back","average":{"1min":1.635,"5min":1.635,"15min":1.635},"min":{"1min":1.149,"5min":1.149,"15min":1.149},"max":{"1min":2.96,"5min":2.96,"15min":2.96},"last":1.0369999999999999},{"interface":"front","average":{"1min":1.7729999999999999,"5min":1.7729999999999999,"15min":1.7729999999999999},"min":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"max":{"1min":3.8559999999999999,"5min":3.8559999999999999,"15min":3.8559999999999999},"last":0.90600000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574873,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301924,"kb_used_data":540,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069916,"statfs":{"total":96636764160,"available":96327593984,"internally_reserved":0,"allocated":552960,"data_stored":235330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.6950000000000001,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":1.165},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":0.79100000000000004}]},{"osd":1,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.5449999999999999,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":1.2889999999999999},{"interface":"front","average":{"1min":1.232,"5min":1.232,"15min":1.232},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":2.1800000000000002,"5min":2.1800000000000002,"15min":2.1800000000000002},"last":0.99099999999999999}]},{"osd":3,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.91300000000000003},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":2.806,"5min":2.806,"15min":2.806},"last":1.0349999999999999}]},{"osd":4,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.389,"5min":1.389,"15min":1.389},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":2.1739999999999999,"5min":2.1739999999999999,"15min":2.1739999999999999},"last":1.3939999999999999},{"interface":"front","average":{"1min":1.458,"5min":1.458,"15min":1.458},"min":{"1min":1,"5min":1,"15min":1},"max":{"1min":3.028,"5min":3.028,"15min":3.028},"last":1.4219999999999999}]},{"osd":5,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.55,"5min":1.55,"15min":1.55},"min":{"1min":1.036,"5min":1.036,"15min":1.036},"max":{"1min":3.1499999999999999,"5min":3.1499999999999999,"15min":3.1499999999999999},"last":1.3380000000000001},{"interface":"front","average":{"1min":1.512,"5min":1.512,"15min":1.512},"min":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"max":{"1min":2.8580000000000001,"5min":2.8580000000000001,"15min":2.8580000000000001},"last":1.3500000000000001}]},{"osd":6,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"min":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"max":{"1min":2.6659999999999999,"5min":2.6659999999999999,"15min":2.6659999999999999},"last":1.115},{"interface":"front","average":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"min":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"max":{"1min":2.411,"5min":2.411,"15min":2.411},"last":1.458}]},{"osd":7,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"min":{"1min":1.01,"5min":1.01,"15min":1.01},"max":{"1min":3.2160000000000002,"5min":3.2160000000000002,"15min":3.2160000000000002},"last":1.2110000000000001},{"interface":"front","average":{"1min":1.631,"5min":1.631,"15min":1.631},"min":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"max":{"1min":3.1059999999999999,"5min":3.1059999999999999,"15min":3.1059999999999999},"last":1.2370000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574874,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301924,"kb_used_data":540,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069916,"statfs":{"total":96636764160,"available":96327593984,"internally_reserved":0,"allocated":552960,"data_stored":235330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.7749999999999999,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":0.96699999999999997},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":2.3260000000000001,"5min":2.3260000000000001,"15min":2.3260000000000001},"last":1.135}]},{"osd":2,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":3.5459999999999998,"5min":3.5459999999999998,"15min":3.5459999999999998},"last":1.0309999999999999},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.706,"5min":1.706,"15min":1.706},"last":1.226}]},{"osd":3,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.625,"5min":1.625,"15min":1.625},"last":1.3049999999999999},{"interface":"front","average":{"1min":1.196,"5min":1.196,"15min":1.196},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":3.331,"5min":3.331,"15min":3.331},"last":1.504}]},{"osd":4,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.339,"5min":1.339,"15min":1.339},"min":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"max":{"1min":1.8660000000000001,"5min":1.8660000000000001,"15min":1.8660000000000001},"last":1.196},{"interface":"front","average":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":3.2250000000000001,"5min":3.2250000000000001,"15min":3.2250000000000001},"last":1.2490000000000001}]},{"osd":5,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"min":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"max":{"1min":2.8439999999999999,"5min":2.8439999999999999,"15min":2.8439999999999999},"last":1.1100000000000001},{"interface":"front","average":{"1min":1.484,"5min":1.484,"15min":1.484},"min":{"1min":1.01,"5min":1.01,"15min":1.01},"max":{"1min":2.4590000000000001,"5min":2.4590000000000001,"15min":2.4590000000000001},"last":1.4550000000000001}]},{"osd":6,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"min":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"max":{"1min":2.96,"5min":2.96,"15min":2.96},"last":1.371},{"interface":"front","average":{"1min":1.504,"5min":1.504,"15min":1.504},"min":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"max":{"1min":2.5859999999999999,"5min":2.5859999999999999,"15min":2.5859999999999999},"last":1.548}]},{"osd":7,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.6040000000000001,"5min":1.6040000000000001,"15min":1.6040000000000001},"min":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"max":{"1min":3.4460000000000002,"5min":3.4460000000000002,"15min":3.4460000000000002},"last":1.3859999999999999},{"interface":"front","average":{"1min":1.538,"5min":1.538,"15min":1.538},"min":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"max":{"1min":3.113,"5min":3.113,"15min":3.113},"last":1.427}]}]},{"osd":0,"up_from":13,"seq":55834574873,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302504,"kb_used_data":1120,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069336,"statfs":{"total":96636764160,"available":96327000064,"internally_reserved":0,"allocated":1146880,"data_stored":825698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.381,"5min":1.381,"15min":1.381},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.999,"5min":0.999,"15min":0.999},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":1.1319999999999999}]},{"osd":2,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":1.26},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.794,"5min":1.794,"15min":1.794},"last":1.484}]},{"osd":3,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.532,"5min":1.532,"15min":1.532},"last":0.70499999999999996},{"interface":"front","average":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.613,"5min":1.613,"15min":1.613},"last":0.88800000000000001}]},{"osd":4,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"min":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"max":{"1min":2.0680000000000001,"5min":2.0680000000000001,"15min":2.0680000000000001},"last":1.4139999999999999},{"interface":"front","average":{"1min":1.339,"5min":1.339,"15min":1.339},"min":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"max":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":1.4450000000000001}]},{"osd":5,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"min":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"max":{"1min":1.893,"5min":1.893,"15min":1.893},"last":1.5680000000000001},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"min":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":2.2080000000000002,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":1.2070000000000001}]},{"osd":6,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.421,"5min":1.421,"15min":1.421},"min":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"max":{"1min":1.96,"5min":1.96,"15min":1.96},"last":1.52},{"interface":"front","average":{"1min":1.552,"5min":1.552,"15min":1.552},"min":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"max":{"1min":1.9910000000000001,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":1.2949999999999999}]},{"osd":7,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.6319999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"min":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"max":{"1min":2.1019999999999999,"5min":2.1019999999999999,"15min":2.1019999999999999},"last":1.349},{"interface":"front","average":{"1min":1.431,"5min":1.431,"15min":1.431},"min":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"max":{"1min":2.1499999999999999,"5min":2.1499999999999999,"15min":2.1499999999999999},"last":1.3220000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:02:48.219 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:02:48.227 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:02:48.902 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:02:49.067 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.066+0000 7f5f01b63700 1 Processor -- start 2023-10-06T03:02:49.067 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.066+0000 7f5f01b63700 1 -- start start 2023-10-06T03:02:49.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.066+0000 7f5f01b63700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f5efc06d400 0x7f5efc15dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:49.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.066+0000 7f5f01b63700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5efc15e1f0 0x7f5efc1605d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:49.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.066+0000 7f5f01b63700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5efc06b4a0 con 0x7f5efc06c920 2023-10-06T03:02:49.070 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.066+0000 7f5f01b63700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5efc0af9d0 con 0x7f5efc15e1f0 2023-10-06T03:02:49.070 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.066+0000 7f5f01b63700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5efc06a890 con 0x7f5efc06d400 2023-10-06T03:02:49.070 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.066+0000 7f5f00b61700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f5efc06c920 0x7f5efc06ccf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:53336/0 (socket says 172.21.15.57:53336) 2023-10-06T03:02:49.070 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.066+0000 7f5f00b61700 1 -- 172.21.15.57:0/1727142465 learned_addr learned my addr 172.21.15.57:0/1727142465 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:02:49.070 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.066+0000 7f5f01362700 1 --2- 172.21.15.57:0/1727142465 >> v2:172.21.15.57:3300/0 conn(0x7f5efc15e1f0 0x7f5efc1605d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:49.071 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.066+0000 7f5ef3fff700 1 --2- 172.21.15.57:0/1727142465 >> v2:172.21.15.105:3300/0 conn(0x7f5efc06d400 0x7f5efc15dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:49.071 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.070+0000 7f5f01362700 1 -- 172.21.15.57:0/1727142465 >> v2:172.21.15.105:3300/0 conn(0x7f5efc06d400 msgr2=0x7f5efc15dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:49.071 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.070+0000 7f5ef37fe700 1 -- 172.21.15.57:0/1727142465 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3442728846 0 0) 0x7f5efc06b4a0 con 0x7f5efc06c920 2023-10-06T03:02:49.071 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.070+0000 7f5f01362700 1 --2- 172.21.15.57:0/1727142465 >> v2:172.21.15.105:3300/0 conn(0x7f5efc06d400 0x7f5efc15dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:49.071 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.070+0000 7f5f01362700 1 -- 172.21.15.57:0/1727142465 >> v1:172.21.15.57:6789/0 conn(0x7f5efc06c920 legacy=0x7f5efc06ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:49.071 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.070+0000 7f5f01362700 1 -- 172.21.15.57:0/1727142465 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5efc06ab70 con 0x7f5efc15e1f0 2023-10-06T03:02:49.071 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.070+0000 7f5f01362700 1 --2- 172.21.15.57:0/1727142465 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5efc15e1f0 0x7f5efc1605d0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f5efc06e520 tx=0x7f5ef4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0dffa917dfa494d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:49.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.070+0000 7f5ef37fe700 1 -- 172.21.15.57:0/1727142465 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef400e070 con 0x7f5efc15e1f0 2023-10-06T03:02:49.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.070+0000 7f5ef37fe700 1 -- 172.21.15.57:0/1727142465 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ef400bb60 con 0x7f5efc15e1f0 2023-10-06T03:02:49.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.070+0000 7f5ef37fe700 1 -- 172.21.15.57:0/1727142465 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef4012430 con 0x7f5efc15e1f0 2023-10-06T03:02:49.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.070+0000 7f5f01b63700 1 -- 172.21.15.57:0/1727142465 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5efc15e1f0 msgr2=0x7f5efc1605d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:49.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.070+0000 7f5f01b63700 1 --2- 172.21.15.57:0/1727142465 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5efc15e1f0 0x7f5efc1605d0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f5efc06e520 tx=0x7f5ef4009780 comp rx=0 tx=0).stop 2023-10-06T03:02:49.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.070+0000 7f5f01b63700 1 -- 172.21.15.57:0/1727142465 shutdown_connections 2023-10-06T03:02:49.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.070+0000 7f5f01b63700 1 --2- 172.21.15.57:0/1727142465 >> v2:172.21.15.105:3300/0 conn(0x7f5efc06d400 0x7f5efc15dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:49.074 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.070+0000 7f5f01b63700 1 --2- 172.21.15.57:0/1727142465 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5efc15e1f0 0x7f5efc1605d0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:49.074 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.070+0000 7f5f01b63700 1 -- 172.21.15.57:0/1727142465 >> 172.21.15.57:0/1727142465 conn(0x7f5efc0c85e0 msgr2=0x7f5efc0c89e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:49.074 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.070+0000 7f5f01b63700 1 -- 172.21.15.57:0/1727142465 shutdown_connections 2023-10-06T03:02:49.074 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.070+0000 7f5f01b63700 1 -- 172.21.15.57:0/1727142465 wait complete. 2023-10-06T03:02:49.075 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.074+0000 7f5f01b63700 1 Processor -- start 2023-10-06T03:02:49.075 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.074+0000 7f5f01b63700 1 -- start start 2023-10-06T03:02:49.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.074+0000 7f5f01b63700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5efc06c920 0x7f5efc15b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:49.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.074+0000 7f5f01b63700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5efc06d400 0x7f5efc145dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:49.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.074+0000 7f5f01b63700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5efc15e1f0 0x7f5efc15c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:49.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.074+0000 7f5f01b63700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5efc154170 con 0x7f5efc06c920 2023-10-06T03:02:49.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.074+0000 7f5f01b63700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5efc15be30 con 0x7f5efc15e1f0 2023-10-06T03:02:49.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.074+0000 7f5f01b63700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5efc15bb40 con 0x7f5efc06d400 2023-10-06T03:02:49.079 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.074+0000 7f5f00b61700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5efc06c920 0x7f5efc15b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:49.079 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.074+0000 7f5f00b61700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5efc06c920 0x7f5efc15b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:59656/0 (socket says 172.21.15.57:59656) 2023-10-06T03:02:49.079 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.074+0000 7f5f00b61700 1 -- 172.21.15.57:0/208289724 learned_addr learned my addr 172.21.15.57:0/208289724 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:02:49.079 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.074+0000 7f5f01362700 1 --2- 172.21.15.57:0/208289724 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5efc15e1f0 0x7f5efc15c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:49.079 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.074+0000 7f5ef3fff700 1 --2- 172.21.15.57:0/208289724 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5efc06d400 0x7f5efc145dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:49.079 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.074+0000 7f5f00b61700 1 -- 172.21.15.57:0/208289724 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5efc06d400 msgr2=0x7f5efc145dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:49.079 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.074+0000 7f5f00b61700 1 --2- 172.21.15.57:0/208289724 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5efc06d400 0x7f5efc145dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:49.079 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.074+0000 7f5f00b61700 1 -- 172.21.15.57:0/208289724 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5efc15e1f0 msgr2=0x7f5efc15c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:49.079 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.074+0000 7f5f00b61700 1 --2- 172.21.15.57:0/208289724 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5efc15e1f0 0x7f5efc15c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:49.079 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.074+0000 7f5f00b61700 1 -- 172.21.15.57:0/208289724 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ef4009a20 con 0x7f5efc06c920 2023-10-06T03:02:49.080 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.074+0000 7f5f01362700 1 --2- 172.21.15.57:0/208289724 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5efc15e1f0 0x7f5efc15c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:02:49.080 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.074+0000 7f5f00b61700 1 --2- 172.21.15.57:0/208289724 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5efc06c920 0x7f5efc15b600 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f5ef800c7e0 tx=0x7f5ef8007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:49.080 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.078+0000 7f5ef0ff9700 1 -- 172.21.15.57:0/208289724 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef8005b30 con 0x7f5efc06c920 2023-10-06T03:02:49.080 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.078+0000 7f5ef0ff9700 1 -- 172.21.15.57:0/208289724 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ef8005c90 con 0x7f5efc06c920 2023-10-06T03:02:49.080 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.078+0000 7f5f01b63700 1 -- 172.21.15.57:0/208289724 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5efc0c5b30 con 0x7f5efc06c920 2023-10-06T03:02:49.080 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.078+0000 7f5ef0ff9700 1 -- 172.21.15.57:0/208289724 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef8007300 con 0x7f5efc06c920 2023-10-06T03:02:49.080 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.078+0000 7f5f01b63700 1 -- 172.21.15.57:0/208289724 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5efc15c430 con 0x7f5efc06c920 2023-10-06T03:02:49.081 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.078+0000 7f5f01b63700 1 -- 172.21.15.57:0/208289724 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5efc04be40 con 0x7f5efc06c920 2023-10-06T03:02:49.081 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.078+0000 7f5ef0ff9700 1 -- 172.21.15.57:0/208289724 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f5ef801b400 con 0x7f5efc06c920 2023-10-06T03:02:49.083 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.082+0000 7f5ef0ff9700 1 --2- 172.21.15.57:0/208289724 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f5ee8060620 0x7f5ee8062ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:49.083 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.082+0000 7f5ef0ff9700 1 -- 172.21.15.57:0/208289724 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5ef807c3b0 con 0x7f5efc06c920 2023-10-06T03:02:49.083 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.082+0000 7f5ef3fff700 1 --2- 172.21.15.57:0/208289724 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f5ee8060620 0x7f5ee8062ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:49.084 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.082+0000 7f5ef3fff700 1 --2- 172.21.15.57:0/208289724 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f5ee8060620 0x7f5ee8062ad0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f5efc1594b0 tx=0x7f5eec008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:49.089 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.086+0000 7f5ef0ff9700 1 -- 172.21.15.57:0/208289724 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f5ef804c8a0 con 0x7f5efc06c920 2023-10-06T03:02:49.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.254+0000 7f5f01b63700 1 -- 172.21.15.57:0/208289724 --> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5efc06ae50 con 0x7f5ee8060620 2023-10-06T03:02:49.272 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.270+0000 7f5ef0ff9700 1 -- 172.21.15.57:0/208289724 <== mgr.4103 v2:172.21.15.57:6832/32947 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+308611 (secure 0 0 0) 0x7f5efc06ae50 con 0x7f5ee8060620 2023-10-06T03:02:49.276 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:02:49.279 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.274+0000 7f5f01b63700 1 -- 172.21.15.57:0/208289724 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f5ee8060620 msgr2=0x7f5ee8062ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:49.279 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.274+0000 7f5f01b63700 1 --2- 172.21.15.57:0/208289724 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f5ee8060620 0x7f5ee8062ad0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f5efc1594b0 tx=0x7f5eec008040 comp rx=0 tx=0).stop 2023-10-06T03:02:49.279 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.274+0000 7f5f01b63700 1 -- 172.21.15.57:0/208289724 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5efc06c920 msgr2=0x7f5efc15b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:49.279 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.274+0000 7f5f01b63700 1 --2- 172.21.15.57:0/208289724 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5efc06c920 0x7f5efc15b600 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f5ef800c7e0 tx=0x7f5ef8007df0 comp rx=0 tx=0).stop 2023-10-06T03:02:49.279 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.278+0000 7f5f01b63700 1 -- 172.21.15.57:0/208289724 shutdown_connections 2023-10-06T03:02:49.279 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.278+0000 7f5f01b63700 1 --2- 172.21.15.57:0/208289724 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5efc15e1f0 0x7f5efc15c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:49.280 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.278+0000 7f5f01b63700 1 --2- 172.21.15.57:0/208289724 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f5ee8060620 0x7f5ee8062ad0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:49.280 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.278+0000 7f5f01b63700 1 --2- 172.21.15.57:0/208289724 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5efc06d400 0x7f5efc145dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:49.280 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.278+0000 7f5f01b63700 1 --2- 172.21.15.57:0/208289724 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5efc06c920 0x7f5efc15b600 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:49.280 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.278+0000 7f5f01b63700 1 -- 172.21.15.57:0/208289724 >> 172.21.15.57:0/208289724 conn(0x7f5efc0c85e0 msgr2=0x7f5efc0b1550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:49.280 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.278+0000 7f5f01b63700 1 -- 172.21.15.57:0/208289724 shutdown_connections 2023-10-06T03:02:49.280 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.278+0000 7f5f01b63700 1 -- 172.21.15.57:0/208289724 wait complete. 2023-10-06T03:02:49.281 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2023-10-06T03:02:49.300 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":105,"stamp":"2023-10-06T03:02:48.307441+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":200,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2408712,"kb_used_data":5832,"kb_used_omap":0,"kb_used_meta":2402816,"kb_avail":752566008,"statfs":{"total":773094113280,"available":770627592192,"internally_reserved":0,"allocated":5971968,"data_stored":3230972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2460483584},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":57,"apply_latency_ms":57,"commit_latency_ns":57000000,"apply_latency_ns":57000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.464124"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:02:39.879601+0000","last_change":"2023-10-06T03:02:39.872440+0000","last_active":"2023-10-06T03:02:39.879601+0000","last_peered":"2023-10-06T03:02:39.879601+0000","last_clean":"2023-10-06T03:02:39.879601+0000","last_became_active":"2023-10-06T03:02:39.872171+0000","last_became_peered":"2023-10-06T03:02:39.872171+0000","last_unstale":"2023-10-06T03:02:39.879601+0000","last_undegraded":"2023-10-06T03:02:39.879601+0000","last_fullsized":"2023-10-06T03:02:39.879601+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:27:35.234159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:02:39.873568+0000","last_change":"2023-10-06T03:02:39.867506+0000","last_active":"2023-10-06T03:02:39.873568+0000","last_peered":"2023-10-06T03:02:39.873568+0000","last_clean":"2023-10-06T03:02:39.873568+0000","last_became_active":"2023-10-06T03:02:39.866881+0000","last_became_peered":"2023-10-06T03:02:39.866881+0000","last_unstale":"2023-10-06T03:02:39.873568+0000","last_undegraded":"2023-10-06T03:02:39.873568+0000","last_fullsized":"2023-10-06T03:02:39.873568+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:47:29.067808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:02:39.892178+0000","last_change":"2023-10-06T03:02:39.884581+0000","last_active":"2023-10-06T03:02:39.892178+0000","last_peered":"2023-10-06T03:02:39.892178+0000","last_clean":"2023-10-06T03:02:39.892178+0000","last_became_active":"2023-10-06T03:02:39.884256+0000","last_became_peered":"2023-10-06T03:02:39.884256+0000","last_unstale":"2023-10-06T03:02:39.892178+0000","last_undegraded":"2023-10-06T03:02:39.892178+0000","last_fullsized":"2023-10-06T03:02:39.892178+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:31:30.859527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:02:39.883156+0000","last_change":"2023-10-06T03:02:39.876802+0000","last_active":"2023-10-06T03:02:39.883156+0000","last_peered":"2023-10-06T03:02:39.883156+0000","last_clean":"2023-10-06T03:02:39.883156+0000","last_became_active":"2023-10-06T03:02:39.876529+0000","last_became_peered":"2023-10-06T03:02:39.876529+0000","last_unstale":"2023-10-06T03:02:39.883156+0000","last_undegraded":"2023-10-06T03:02:39.883156+0000","last_fullsized":"2023-10-06T03:02:39.883156+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:08:51.831968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:02:39.873962+0000","last_change":"2023-10-06T03:02:39.863628+0000","last_active":"2023-10-06T03:02:39.873962+0000","last_peered":"2023-10-06T03:02:39.873962+0000","last_clean":"2023-10-06T03:02:39.873962+0000","last_became_active":"2023-10-06T03:02:39.863337+0000","last_became_peered":"2023-10-06T03:02:39.863337+0000","last_unstale":"2023-10-06T03:02:39.873962+0000","last_undegraded":"2023-10-06T03:02:39.873962+0000","last_fullsized":"2023-10-06T03:02:39.873962+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:03:37.092106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:02:39.880230+0000","last_change":"2023-10-06T03:02:39.875072+0000","last_active":"2023-10-06T03:02:39.880230+0000","last_peered":"2023-10-06T03:02:39.880230+0000","last_clean":"2023-10-06T03:02:39.880230+0000","last_became_active":"2023-10-06T03:02:39.874758+0000","last_became_peered":"2023-10-06T03:02:39.874758+0000","last_unstale":"2023-10-06T03:02:39.880230+0000","last_undegraded":"2023-10-06T03:02:39.880230+0000","last_fullsized":"2023-10-06T03:02:39.880230+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:12:14.521260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:02:39.893463+0000","last_change":"2023-10-06T03:02:39.885519+0000","last_active":"2023-10-06T03:02:39.893463+0000","last_peered":"2023-10-06T03:02:39.893463+0000","last_clean":"2023-10-06T03:02:39.893463+0000","last_became_active":"2023-10-06T03:02:39.885257+0000","last_became_peered":"2023-10-06T03:02:39.885257+0000","last_unstale":"2023-10-06T03:02:39.893463+0000","last_undegraded":"2023-10-06T03:02:39.893463+0000","last_fullsized":"2023-10-06T03:02:39.893463+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:39:47.795405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:02:39.879322+0000","last_change":"2023-10-06T03:02:39.875237+0000","last_active":"2023-10-06T03:02:39.879322+0000","last_peered":"2023-10-06T03:02:39.879322+0000","last_clean":"2023-10-06T03:02:39.879322+0000","last_became_active":"2023-10-06T03:02:39.874937+0000","last_became_peered":"2023-10-06T03:02:39.874937+0000","last_unstale":"2023-10-06T03:02:39.879322+0000","last_undegraded":"2023-10-06T03:02:39.879322+0000","last_fullsized":"2023-10-06T03:02:39.879322+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:13:17.059763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:02:39.893140+0000","last_change":"2023-10-06T03:02:39.889645+0000","last_active":"2023-10-06T03:02:39.893140+0000","last_peered":"2023-10-06T03:02:39.893140+0000","last_clean":"2023-10-06T03:02:39.893140+0000","last_became_active":"2023-10-06T03:02:39.888992+0000","last_became_peered":"2023-10-06T03:02:39.888992+0000","last_unstale":"2023-10-06T03:02:39.893140+0000","last_undegraded":"2023-10-06T03:02:39.893140+0000","last_fullsized":"2023-10-06T03:02:39.893140+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:31:30.859527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:02:39.880081+0000","last_change":"2023-10-06T03:02:39.874606+0000","last_active":"2023-10-06T03:02:39.880081+0000","last_peered":"2023-10-06T03:02:39.880081+0000","last_clean":"2023-10-06T03:02:39.880081+0000","last_became_active":"2023-10-06T03:02:39.874268+0000","last_became_peered":"2023-10-06T03:02:39.874268+0000","last_unstale":"2023-10-06T03:02:39.880081+0000","last_undegraded":"2023-10-06T03:02:39.880081+0000","last_fullsized":"2023-10-06T03:02:39.880081+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:46:40.611565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:02:39.882878+0000","last_change":"2023-10-06T03:02:39.879008+0000","last_active":"2023-10-06T03:02:39.882878+0000","last_peered":"2023-10-06T03:02:39.882878+0000","last_clean":"2023-10-06T03:02:39.882878+0000","last_became_active":"2023-10-06T03:02:39.878370+0000","last_became_peered":"2023-10-06T03:02:39.878370+0000","last_unstale":"2023-10-06T03:02:39.882878+0000","last_undegraded":"2023-10-06T03:02:39.882878+0000","last_fullsized":"2023-10-06T03:02:39.882878+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:42:00.495787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:02:39.875997+0000","last_change":"2023-10-06T03:02:39.865419+0000","last_active":"2023-10-06T03:02:39.875997+0000","last_peered":"2023-10-06T03:02:39.875997+0000","last_clean":"2023-10-06T03:02:39.875997+0000","last_became_active":"2023-10-06T03:02:39.864769+0000","last_became_peered":"2023-10-06T03:02:39.864769+0000","last_unstale":"2023-10-06T03:02:39.875997+0000","last_undegraded":"2023-10-06T03:02:39.875997+0000","last_fullsized":"2023-10-06T03:02:39.875997+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:03:58.508623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:02:39.879489+0000","last_change":"2023-10-06T03:02:39.866840+0000","last_active":"2023-10-06T03:02:39.879489+0000","last_peered":"2023-10-06T03:02:39.879489+0000","last_clean":"2023-10-06T03:02:39.879489+0000","last_became_active":"2023-10-06T03:02:39.866510+0000","last_became_peered":"2023-10-06T03:02:39.866510+0000","last_unstale":"2023-10-06T03:02:39.879489+0000","last_undegraded":"2023-10-06T03:02:39.879489+0000","last_fullsized":"2023-10-06T03:02:39.879489+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:17:48.382984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:02:39.893361+0000","last_change":"2023-10-06T03:02:39.884918+0000","last_active":"2023-10-06T03:02:39.893361+0000","last_peered":"2023-10-06T03:02:39.893361+0000","last_clean":"2023-10-06T03:02:39.893361+0000","last_became_active":"2023-10-06T03:02:39.884602+0000","last_became_peered":"2023-10-06T03:02:39.884602+0000","last_unstale":"2023-10-06T03:02:39.893361+0000","last_undegraded":"2023-10-06T03:02:39.893361+0000","last_fullsized":"2023-10-06T03:02:39.893361+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:27:39.022740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:02:39.872039+0000","last_change":"2023-10-06T03:02:39.863639+0000","last_active":"2023-10-06T03:02:39.872039+0000","last_peered":"2023-10-06T03:02:39.872039+0000","last_clean":"2023-10-06T03:02:39.872039+0000","last_became_active":"2023-10-06T03:02:39.863319+0000","last_became_peered":"2023-10-06T03:02:39.863319+0000","last_unstale":"2023-10-06T03:02:39.872039+0000","last_undegraded":"2023-10-06T03:02:39.872039+0000","last_fullsized":"2023-10-06T03:02:39.872039+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:28:01.768786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:02:39.880203+0000","last_change":"2023-10-06T03:02:39.874778+0000","last_active":"2023-10-06T03:02:39.880203+0000","last_peered":"2023-10-06T03:02:39.880203+0000","last_clean":"2023-10-06T03:02:39.880203+0000","last_became_active":"2023-10-06T03:02:39.874373+0000","last_became_peered":"2023-10-06T03:02:39.874373+0000","last_unstale":"2023-10-06T03:02:39.880203+0000","last_undegraded":"2023-10-06T03:02:39.880203+0000","last_fullsized":"2023-10-06T03:02:39.880203+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:28:01.768786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:02:39.891811+0000","last_change":"2023-10-06T03:02:39.870081+0000","last_active":"2023-10-06T03:02:39.891811+0000","last_peered":"2023-10-06T03:02:39.891811+0000","last_clean":"2023-10-06T03:02:39.891811+0000","last_became_active":"2023-10-06T03:02:39.868467+0000","last_became_peered":"2023-10-06T03:02:39.868467+0000","last_unstale":"2023-10-06T03:02:39.891811+0000","last_undegraded":"2023-10-06T03:02:39.891811+0000","last_fullsized":"2023-10-06T03:02:39.891811+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:43:35.009784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:02:39.873586+0000","last_change":"2023-10-06T03:02:39.867639+0000","last_active":"2023-10-06T03:02:39.873586+0000","last_peered":"2023-10-06T03:02:39.873586+0000","last_clean":"2023-10-06T03:02:39.873586+0000","last_became_active":"2023-10-06T03:02:39.867224+0000","last_became_peered":"2023-10-06T03:02:39.867224+0000","last_unstale":"2023-10-06T03:02:39.873586+0000","last_undegraded":"2023-10-06T03:02:39.873586+0000","last_fullsized":"2023-10-06T03:02:39.873586+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:46:40.611565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:02:39.891829+0000","last_change":"2023-10-06T03:02:39.871558+0000","last_active":"2023-10-06T03:02:39.891829+0000","last_peered":"2023-10-06T03:02:39.891829+0000","last_clean":"2023-10-06T03:02:39.891829+0000","last_became_active":"2023-10-06T03:02:39.870931+0000","last_became_peered":"2023-10-06T03:02:39.870931+0000","last_unstale":"2023-10-06T03:02:39.891829+0000","last_undegraded":"2023-10-06T03:02:39.891829+0000","last_fullsized":"2023-10-06T03:02:39.891829+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:08:09.446743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:02:39.860543+0000","last_change":"2023-10-06T03:02:39.857059+0000","last_active":"2023-10-06T03:02:39.860543+0000","last_peered":"2023-10-06T03:02:39.860543+0000","last_clean":"2023-10-06T03:02:39.860543+0000","last_became_active":"2023-10-06T03:02:39.856686+0000","last_became_peered":"2023-10-06T03:02:39.856686+0000","last_unstale":"2023-10-06T03:02:39.860543+0000","last_undegraded":"2023-10-06T03:02:39.860543+0000","last_fullsized":"2023-10-06T03:02:39.860543+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:01:15.996138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:02:39.877467+0000","last_change":"2023-10-06T03:02:39.866622+0000","last_active":"2023-10-06T03:02:39.877467+0000","last_peered":"2023-10-06T03:02:39.877467+0000","last_clean":"2023-10-06T03:02:39.877467+0000","last_became_active":"2023-10-06T03:02:39.865418+0000","last_became_peered":"2023-10-06T03:02:39.865418+0000","last_unstale":"2023-10-06T03:02:39.877467+0000","last_undegraded":"2023-10-06T03:02:39.877467+0000","last_fullsized":"2023-10-06T03:02:39.877467+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:00:58.053775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:02:39.877804+0000","last_change":"2023-10-06T03:02:39.872357+0000","last_active":"2023-10-06T03:02:39.877804+0000","last_peered":"2023-10-06T03:02:39.877804+0000","last_clean":"2023-10-06T03:02:39.877804+0000","last_became_active":"2023-10-06T03:02:39.872049+0000","last_became_peered":"2023-10-06T03:02:39.872049+0000","last_unstale":"2023-10-06T03:02:39.877804+0000","last_undegraded":"2023-10-06T03:02:39.877804+0000","last_fullsized":"2023-10-06T03:02:39.877804+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:52:35.005686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:02:39.882859+0000","last_change":"2023-10-06T03:02:39.878755+0000","last_active":"2023-10-06T03:02:39.882859+0000","last_peered":"2023-10-06T03:02:39.882859+0000","last_clean":"2023-10-06T03:02:39.882859+0000","last_became_active":"2023-10-06T03:02:39.878332+0000","last_became_peered":"2023-10-06T03:02:39.878332+0000","last_unstale":"2023-10-06T03:02:39.882859+0000","last_undegraded":"2023-10-06T03:02:39.882859+0000","last_fullsized":"2023-10-06T03:02:39.882859+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:16:22.934040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:02:39.887173+0000","last_change":"2023-10-06T03:02:39.864758+0000","last_active":"2023-10-06T03:02:39.887173+0000","last_peered":"2023-10-06T03:02:39.887173+0000","last_clean":"2023-10-06T03:02:39.887173+0000","last_became_active":"2023-10-06T03:02:39.864184+0000","last_became_peered":"2023-10-06T03:02:39.864184+0000","last_unstale":"2023-10-06T03:02:39.887173+0000","last_undegraded":"2023-10-06T03:02:39.887173+0000","last_fullsized":"2023-10-06T03:02:39.887173+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:52:23.072783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:02:39.891892+0000","last_change":"2023-10-06T03:02:39.870418+0000","last_active":"2023-10-06T03:02:39.891892+0000","last_peered":"2023-10-06T03:02:39.891892+0000","last_clean":"2023-10-06T03:02:39.891892+0000","last_became_active":"2023-10-06T03:02:39.869775+0000","last_became_peered":"2023-10-06T03:02:39.869775+0000","last_unstale":"2023-10-06T03:02:39.891892+0000","last_undegraded":"2023-10-06T03:02:39.891892+0000","last_fullsized":"2023-10-06T03:02:39.891892+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:13:17.059763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:02:39.877886+0000","last_change":"2023-10-06T03:02:39.868896+0000","last_active":"2023-10-06T03:02:39.877886+0000","last_peered":"2023-10-06T03:02:39.877886+0000","last_clean":"2023-10-06T03:02:39.877886+0000","last_became_active":"2023-10-06T03:02:39.868375+0000","last_became_peered":"2023-10-06T03:02:39.868375+0000","last_unstale":"2023-10-06T03:02:39.877886+0000","last_undegraded":"2023-10-06T03:02:39.877886+0000","last_fullsized":"2023-10-06T03:02:39.877886+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:27:39.022740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:02:39.890440+0000","last_change":"2023-10-06T03:02:39.888048+0000","last_active":"2023-10-06T03:02:39.890440+0000","last_peered":"2023-10-06T03:02:39.890440+0000","last_clean":"2023-10-06T03:02:39.890440+0000","last_became_active":"2023-10-06T03:02:39.887735+0000","last_became_peered":"2023-10-06T03:02:39.887735+0000","last_unstale":"2023-10-06T03:02:39.890440+0000","last_undegraded":"2023-10-06T03:02:39.890440+0000","last_fullsized":"2023-10-06T03:02:39.890440+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:18.879270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:02:39.862362+0000","last_change":"2023-10-06T03:02:39.858941+0000","last_active":"2023-10-06T03:02:39.862362+0000","last_peered":"2023-10-06T03:02:39.862362+0000","last_clean":"2023-10-06T03:02:39.862362+0000","last_became_active":"2023-10-06T03:02:39.858631+0000","last_became_peered":"2023-10-06T03:02:39.858631+0000","last_unstale":"2023-10-06T03:02:39.862362+0000","last_undegraded":"2023-10-06T03:02:39.862362+0000","last_fullsized":"2023-10-06T03:02:39.862362+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:14:56.782812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:02:39.886754+0000","last_change":"2023-10-06T03:02:39.861679+0000","last_active":"2023-10-06T03:02:39.886754+0000","last_peered":"2023-10-06T03:02:39.886754+0000","last_clean":"2023-10-06T03:02:39.886754+0000","last_became_active":"2023-10-06T03:02:39.861375+0000","last_became_peered":"2023-10-06T03:02:39.861375+0000","last_unstale":"2023-10-06T03:02:39.886754+0000","last_undegraded":"2023-10-06T03:02:39.886754+0000","last_fullsized":"2023-10-06T03:02:39.886754+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:01:52.583855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:02:39.875247+0000","last_change":"2023-10-06T03:02:39.869122+0000","last_active":"2023-10-06T03:02:39.875247+0000","last_peered":"2023-10-06T03:02:39.875247+0000","last_clean":"2023-10-06T03:02:39.875247+0000","last_became_active":"2023-10-06T03:02:39.867973+0000","last_became_peered":"2023-10-06T03:02:39.867973+0000","last_unstale":"2023-10-06T03:02:39.875247+0000","last_undegraded":"2023-10-06T03:02:39.875247+0000","last_fullsized":"2023-10-06T03:02:39.875247+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:17:48.382984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:02:39.893486+0000","last_change":"2023-10-06T03:02:39.886157+0000","last_active":"2023-10-06T03:02:39.893486+0000","last_peered":"2023-10-06T03:02:39.893486+0000","last_clean":"2023-10-06T03:02:39.893486+0000","last_became_active":"2023-10-06T03:02:39.885844+0000","last_became_peered":"2023-10-06T03:02:39.885844+0000","last_unstale":"2023-10-06T03:02:39.893486+0000","last_undegraded":"2023-10-06T03:02:39.893486+0000","last_fullsized":"2023-10-06T03:02:39.893486+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:06:27.988048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:02:39.883436+0000","last_change":"2023-10-06T03:02:39.880872+0000","last_active":"2023-10-06T03:02:39.883436+0000","last_peered":"2023-10-06T03:02:39.883436+0000","last_clean":"2023-10-06T03:02:39.883436+0000","last_became_active":"2023-10-06T03:02:39.880560+0000","last_became_peered":"2023-10-06T03:02:39.880560+0000","last_unstale":"2023-10-06T03:02:39.883436+0000","last_undegraded":"2023-10-06T03:02:39.883436+0000","last_fullsized":"2023-10-06T03:02:39.883436+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:40:05.112188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:02:39.871189+0000","last_change":"2023-10-06T03:02:39.863068+0000","last_active":"2023-10-06T03:02:39.871189+0000","last_peered":"2023-10-06T03:02:39.871189+0000","last_clean":"2023-10-06T03:02:39.871189+0000","last_became_active":"2023-10-06T03:02:39.862794+0000","last_became_peered":"2023-10-06T03:02:39.862794+0000","last_unstale":"2023-10-06T03:02:39.871189+0000","last_undegraded":"2023-10-06T03:02:39.871189+0000","last_fullsized":"2023-10-06T03:02:39.871189+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:17:46.359437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"49'4","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:02:39.882453+0000","last_change":"2023-10-06T03:02:38.856515+0000","last_active":"2023-10-06T03:02:39.882453+0000","last_peered":"2023-10-06T03:02:39.882453+0000","last_clean":"2023-10-06T03:02:39.882453+0000","last_became_active":"2023-10-06T03:02:38.856154+0000","last_became_peered":"2023-10-06T03:02:38.856154+0000","last_unstale":"2023-10-06T03:02:39.882453+0000","last_undegraded":"2023-10-06T03:02:39.882453+0000","last_fullsized":"2023-10-06T03:02:39.882453+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:31:46.112896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:02:39.870226+0000","last_change":"2023-10-06T03:02:39.866816+0000","last_active":"2023-10-06T03:02:39.870226+0000","last_peered":"2023-10-06T03:02:39.870226+0000","last_clean":"2023-10-06T03:02:39.870226+0000","last_became_active":"2023-10-06T03:02:39.865392+0000","last_became_peered":"2023-10-06T03:02:39.865392+0000","last_unstale":"2023-10-06T03:02:39.870226+0000","last_undegraded":"2023-10-06T03:02:39.870226+0000","last_fullsized":"2023-10-06T03:02:39.870226+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:28:01.768786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"49'1","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:02:39.879771+0000","last_change":"2023-10-06T03:02:38.870422+0000","last_active":"2023-10-06T03:02:39.879771+0000","last_peered":"2023-10-06T03:02:39.879771+0000","last_clean":"2023-10-06T03:02:39.879771+0000","last_became_active":"2023-10-06T03:02:38.869951+0000","last_became_peered":"2023-10-06T03:02:38.869951+0000","last_unstale":"2023-10-06T03:02:39.879771+0000","last_undegraded":"2023-10-06T03:02:39.879771+0000","last_fullsized":"2023-10-06T03:02:39.879771+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:01:14.978500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:02:39.877296+0000","last_change":"2023-10-06T03:02:39.866160+0000","last_active":"2023-10-06T03:02:39.877296+0000","last_peered":"2023-10-06T03:02:39.877296+0000","last_clean":"2023-10-06T03:02:39.877296+0000","last_became_active":"2023-10-06T03:02:39.865875+0000","last_became_peered":"2023-10-06T03:02:39.865875+0000","last_unstale":"2023-10-06T03:02:39.877296+0000","last_undegraded":"2023-10-06T03:02:39.877296+0000","last_fullsized":"2023-10-06T03:02:39.877296+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:42:00.495787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"49'2","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:02:39.880535+0000","last_change":"2023-10-06T03:02:38.858140+0000","last_active":"2023-10-06T03:02:39.880535+0000","last_peered":"2023-10-06T03:02:39.880535+0000","last_clean":"2023-10-06T03:02:39.880535+0000","last_became_active":"2023-10-06T03:02:38.857805+0000","last_became_peered":"2023-10-06T03:02:38.857805+0000","last_unstale":"2023-10-06T03:02:39.880535+0000","last_undegraded":"2023-10-06T03:02:39.880535+0000","last_fullsized":"2023-10-06T03:02:39.880535+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:14:55.765174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:02:39.879193+0000","last_change":"2023-10-06T03:02:39.875868+0000","last_active":"2023-10-06T03:02:39.879193+0000","last_peered":"2023-10-06T03:02:39.879193+0000","last_clean":"2023-10-06T03:02:39.879193+0000","last_became_active":"2023-10-06T03:02:39.875550+0000","last_became_peered":"2023-10-06T03:02:39.875550+0000","last_unstale":"2023-10-06T03:02:39.879193+0000","last_undegraded":"2023-10-06T03:02:39.879193+0000","last_fullsized":"2023-10-06T03:02:39.879193+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:52:23.072783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"49'2","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:02:39.880536+0000","last_change":"2023-10-06T03:02:38.873915+0000","last_active":"2023-10-06T03:02:39.880536+0000","last_peered":"2023-10-06T03:02:39.880536+0000","last_clean":"2023-10-06T03:02:39.880536+0000","last_became_active":"2023-10-06T03:02:38.873404+0000","last_became_peered":"2023-10-06T03:02:38.873404+0000","last_unstale":"2023-10-06T03:02:39.880536+0000","last_undegraded":"2023-10-06T03:02:39.880536+0000","last_fullsized":"2023-10-06T03:02:39.880536+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:58:25.908183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:02:39.874656+0000","last_change":"2023-10-06T03:02:39.871386+0000","last_active":"2023-10-06T03:02:39.874656+0000","last_peered":"2023-10-06T03:02:39.874656+0000","last_clean":"2023-10-06T03:02:39.874656+0000","last_became_active":"2023-10-06T03:02:39.871084+0000","last_became_peered":"2023-10-06T03:02:39.871084+0000","last_unstale":"2023-10-06T03:02:39.874656+0000","last_undegraded":"2023-10-06T03:02:39.874656+0000","last_fullsized":"2023-10-06T03:02:39.874656+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:23:18.217898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"49'1","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:02:39.891889+0000","last_change":"2023-10-06T03:02:38.857653+0000","last_active":"2023-10-06T03:02:39.891889+0000","last_peered":"2023-10-06T03:02:39.891889+0000","last_clean":"2023-10-06T03:02:39.891889+0000","last_became_active":"2023-10-06T03:02:38.857368+0000","last_became_peered":"2023-10-06T03:02:38.857368+0000","last_unstale":"2023-10-06T03:02:39.891889+0000","last_undegraded":"2023-10-06T03:02:39.891889+0000","last_fullsized":"2023-10-06T03:02:39.891889+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:04:38.128587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:02:39.882381+0000","last_change":"2023-10-06T03:02:39.876234+0000","last_active":"2023-10-06T03:02:39.882381+0000","last_peered":"2023-10-06T03:02:39.882381+0000","last_clean":"2023-10-06T03:02:39.882381+0000","last_became_active":"2023-10-06T03:02:39.875935+0000","last_became_peered":"2023-10-06T03:02:39.875935+0000","last_unstale":"2023-10-06T03:02:39.882381+0000","last_undegraded":"2023-10-06T03:02:39.882381+0000","last_fullsized":"2023-10-06T03:02:39.882381+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:29:30.158378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"49'1","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:02:39.878657+0000","last_change":"2023-10-06T03:02:38.854422+0000","last_active":"2023-10-06T03:02:39.878657+0000","last_peered":"2023-10-06T03:02:39.878657+0000","last_clean":"2023-10-06T03:02:39.878657+0000","last_became_active":"2023-10-06T03:02:38.854088+0000","last_became_peered":"2023-10-06T03:02:38.854088+0000","last_unstale":"2023-10-06T03:02:39.878657+0000","last_undegraded":"2023-10-06T03:02:39.878657+0000","last_fullsized":"2023-10-06T03:02:39.878657+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:41:45.591282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:02:39.877869+0000","last_change":"2023-10-06T03:02:39.868643+0000","last_active":"2023-10-06T03:02:39.877869+0000","last_peered":"2023-10-06T03:02:39.877869+0000","last_clean":"2023-10-06T03:02:39.877869+0000","last_became_active":"2023-10-06T03:02:39.867939+0000","last_became_peered":"2023-10-06T03:02:39.867939+0000","last_unstale":"2023-10-06T03:02:39.877869+0000","last_undegraded":"2023-10-06T03:02:39.877869+0000","last_fullsized":"2023-10-06T03:02:39.877869+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:08:09.446743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":10,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:02:39.848777+0000","last_change":"2023-10-06T03:02:38.858755+0000","last_active":"2023-10-06T03:02:39.848777+0000","last_peered":"2023-10-06T03:02:39.848777+0000","last_clean":"2023-10-06T03:02:39.848777+0000","last_became_active":"2023-10-06T03:02:38.858405+0000","last_became_peered":"2023-10-06T03:02:38.858405+0000","last_unstale":"2023-10-06T03:02:39.848777+0000","last_undegraded":"2023-10-06T03:02:39.848777+0000","last_fullsized":"2023-10-06T03:02:39.848777+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:59:48.860090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:02:39.875526+0000","last_change":"2023-10-06T03:02:39.872575+0000","last_active":"2023-10-06T03:02:39.875526+0000","last_peered":"2023-10-06T03:02:39.875526+0000","last_clean":"2023-10-06T03:02:39.875526+0000","last_became_active":"2023-10-06T03:02:39.872298+0000","last_became_peered":"2023-10-06T03:02:39.872298+0000","last_unstale":"2023-10-06T03:02:39.875526+0000","last_undegraded":"2023-10-06T03:02:39.875526+0000","last_fullsized":"2023-10-06T03:02:39.875526+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:41:45.880609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":10,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:02:39.847381+0000","last_change":"2023-10-06T03:02:38.863407+0000","last_active":"2023-10-06T03:02:39.847381+0000","last_peered":"2023-10-06T03:02:39.847381+0000","last_clean":"2023-10-06T03:02:39.847381+0000","last_became_active":"2023-10-06T03:02:38.863081+0000","last_became_peered":"2023-10-06T03:02:38.863081+0000","last_unstale":"2023-10-06T03:02:39.847381+0000","last_undegraded":"2023-10-06T03:02:39.847381+0000","last_fullsized":"2023-10-06T03:02:39.847381+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:58:02.400366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:02:39.868395+0000","last_change":"2023-10-06T03:02:39.861413+0000","last_active":"2023-10-06T03:02:39.868395+0000","last_peered":"2023-10-06T03:02:39.868395+0000","last_clean":"2023-10-06T03:02:39.868395+0000","last_became_active":"2023-10-06T03:02:39.861080+0000","last_became_peered":"2023-10-06T03:02:39.861080+0000","last_unstale":"2023-10-06T03:02:39.868395+0000","last_undegraded":"2023-10-06T03:02:39.868395+0000","last_fullsized":"2023-10-06T03:02:39.868395+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:12:14.521260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":10,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:02:39.859362+0000","last_change":"2023-10-06T03:02:38.860246+0000","last_active":"2023-10-06T03:02:39.859362+0000","last_peered":"2023-10-06T03:02:39.859362+0000","last_clean":"2023-10-06T03:02:39.859362+0000","last_became_active":"2023-10-06T03:02:38.859969+0000","last_became_peered":"2023-10-06T03:02:38.859969+0000","last_unstale":"2023-10-06T03:02:39.859362+0000","last_undegraded":"2023-10-06T03:02:39.859362+0000","last_fullsized":"2023-10-06T03:02:39.859362+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:16:59.767516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:02:39.868966+0000","last_change":"2023-10-06T03:02:39.862386+0000","last_active":"2023-10-06T03:02:39.868966+0000","last_peered":"2023-10-06T03:02:39.868966+0000","last_clean":"2023-10-06T03:02:39.868966+0000","last_became_active":"2023-10-06T03:02:39.862128+0000","last_became_peered":"2023-10-06T03:02:39.862128+0000","last_unstale":"2023-10-06T03:02:39.868966+0000","last_undegraded":"2023-10-06T03:02:39.868966+0000","last_fullsized":"2023-10-06T03:02:39.868966+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:29:30.158378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":10,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:02:39.849180+0000","last_change":"2023-10-06T03:02:38.869322+0000","last_active":"2023-10-06T03:02:39.849180+0000","last_peered":"2023-10-06T03:02:39.849180+0000","last_clean":"2023-10-06T03:02:39.849180+0000","last_became_active":"2023-10-06T03:02:38.868958+0000","last_became_peered":"2023-10-06T03:02:38.868958+0000","last_unstale":"2023-10-06T03:02:39.849180+0000","last_undegraded":"2023-10-06T03:02:39.849180+0000","last_fullsized":"2023-10-06T03:02:39.849180+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:18:12.245614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:02:39.885036+0000","last_change":"2023-10-06T03:02:39.861027+0000","last_active":"2023-10-06T03:02:39.885036+0000","last_peered":"2023-10-06T03:02:39.885036+0000","last_clean":"2023-10-06T03:02:39.885036+0000","last_became_active":"2023-10-06T03:02:39.860588+0000","last_became_peered":"2023-10-06T03:02:39.860588+0000","last_unstale":"2023-10-06T03:02:39.885036+0000","last_undegraded":"2023-10-06T03:02:39.885036+0000","last_fullsized":"2023-10-06T03:02:39.885036+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:10:09.770751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"49'3","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:02:39.881885+0000","last_change":"2023-10-06T03:02:38.861193+0000","last_active":"2023-10-06T03:02:39.881885+0000","last_peered":"2023-10-06T03:02:39.881885+0000","last_clean":"2023-10-06T03:02:39.881885+0000","last_became_active":"2023-10-06T03:02:38.860904+0000","last_became_peered":"2023-10-06T03:02:38.860904+0000","last_unstale":"2023-10-06T03:02:39.881885+0000","last_undegraded":"2023-10-06T03:02:39.881885+0000","last_fullsized":"2023-10-06T03:02:39.881885+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:04:38.128587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:02:39.873983+0000","last_change":"2023-10-06T03:02:39.866309+0000","last_active":"2023-10-06T03:02:39.873983+0000","last_peered":"2023-10-06T03:02:39.873983+0000","last_clean":"2023-10-06T03:02:39.873983+0000","last_became_active":"2023-10-06T03:02:39.866011+0000","last_became_peered":"2023-10-06T03:02:39.866011+0000","last_unstale":"2023-10-06T03:02:39.873983+0000","last_undegraded":"2023-10-06T03:02:39.873983+0000","last_fullsized":"2023-10-06T03:02:39.873983+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:58:26.925821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"49'6","reported_seq":16,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:02:39.895024+0000","last_change":"2023-10-06T03:02:38.871902+0000","last_active":"2023-10-06T03:02:39.895024+0000","last_peered":"2023-10-06T03:02:39.895024+0000","last_clean":"2023-10-06T03:02:39.895024+0000","last_became_active":"2023-10-06T03:02:38.871585+0000","last_became_peered":"2023-10-06T03:02:38.871585+0000","last_unstale":"2023-10-06T03:02:39.895024+0000","last_undegraded":"2023-10-06T03:02:39.895024+0000","last_fullsized":"2023-10-06T03:02:39.895024+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:29:09.847352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:02:39.870309+0000","last_change":"2023-10-06T03:02:39.866858+0000","last_active":"2023-10-06T03:02:39.870309+0000","last_peered":"2023-10-06T03:02:39.870309+0000","last_clean":"2023-10-06T03:02:39.870309+0000","last_became_active":"2023-10-06T03:02:39.865318+0000","last_became_peered":"2023-10-06T03:02:39.865318+0000","last_unstale":"2023-10-06T03:02:39.870309+0000","last_undegraded":"2023-10-06T03:02:39.870309+0000","last_fullsized":"2023-10-06T03:02:39.870309+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:08:51.831968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"49'2","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:02:39.892005+0000","last_change":"2023-10-06T03:02:38.863229+0000","last_active":"2023-10-06T03:02:39.892005+0000","last_peered":"2023-10-06T03:02:39.892005+0000","last_clean":"2023-10-06T03:02:39.892005+0000","last_became_active":"2023-10-06T03:02:38.862751+0000","last_became_peered":"2023-10-06T03:02:38.862751+0000","last_unstale":"2023-10-06T03:02:39.892005+0000","last_undegraded":"2023-10-06T03:02:39.892005+0000","last_fullsized":"2023-10-06T03:02:39.892005+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:41:45.591282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:02:39.892156+0000","last_change":"2023-10-06T03:02:39.874836+0000","last_active":"2023-10-06T03:02:39.892156+0000","last_peered":"2023-10-06T03:02:39.892156+0000","last_clean":"2023-10-06T03:02:39.892156+0000","last_became_active":"2023-10-06T03:02:39.874568+0000","last_became_peered":"2023-10-06T03:02:39.874568+0000","last_unstale":"2023-10-06T03:02:39.892156+0000","last_undegraded":"2023-10-06T03:02:39.892156+0000","last_fullsized":"2023-10-06T03:02:39.892156+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:52:35.005686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":10,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:02:39.850017+0000","last_change":"2023-10-06T03:02:38.864366+0000","last_active":"2023-10-06T03:02:39.850017+0000","last_peered":"2023-10-06T03:02:39.850017+0000","last_clean":"2023-10-06T03:02:39.850017+0000","last_became_active":"2023-10-06T03:02:38.864042+0000","last_became_peered":"2023-10-06T03:02:38.864042+0000","last_unstale":"2023-10-06T03:02:39.850017+0000","last_undegraded":"2023-10-06T03:02:39.850017+0000","last_fullsized":"2023-10-06T03:02:39.850017+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:14:45.231794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:02:39.877902+0000","last_change":"2023-10-06T03:02:39.872604+0000","last_active":"2023-10-06T03:02:39.877902+0000","last_peered":"2023-10-06T03:02:39.877902+0000","last_clean":"2023-10-06T03:02:39.877902+0000","last_became_active":"2023-10-06T03:02:39.872334+0000","last_became_peered":"2023-10-06T03:02:39.872334+0000","last_unstale":"2023-10-06T03:02:39.877902+0000","last_undegraded":"2023-10-06T03:02:39.877902+0000","last_fullsized":"2023-10-06T03:02:39.877902+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:53:57.831764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":10,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:02:39.855014+0000","last_change":"2023-10-06T03:02:38.858014+0000","last_active":"2023-10-06T03:02:39.855014+0000","last_peered":"2023-10-06T03:02:39.855014+0000","last_clean":"2023-10-06T03:02:39.855014+0000","last_became_active":"2023-10-06T03:02:38.857708+0000","last_became_peered":"2023-10-06T03:02:38.857708+0000","last_unstale":"2023-10-06T03:02:39.855014+0000","last_undegraded":"2023-10-06T03:02:39.855014+0000","last_fullsized":"2023-10-06T03:02:39.855014+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:37:34.933099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:02:39.891916+0000","last_change":"2023-10-06T03:02:39.870747+0000","last_active":"2023-10-06T03:02:39.891916+0000","last_peered":"2023-10-06T03:02:39.891916+0000","last_clean":"2023-10-06T03:02:39.891916+0000","last_became_active":"2023-10-06T03:02:39.870035+0000","last_became_peered":"2023-10-06T03:02:39.870035+0000","last_unstale":"2023-10-06T03:02:39.891916+0000","last_undegraded":"2023-10-06T03:02:39.891916+0000","last_fullsized":"2023-10-06T03:02:39.891916+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:57:40.687459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"49'8","reported_seq":18,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:02:39.892812+0000","last_change":"2023-10-06T03:02:38.872336+0000","last_active":"2023-10-06T03:02:39.892812+0000","last_peered":"2023-10-06T03:02:39.892812+0000","last_clean":"2023-10-06T03:02:39.892812+0000","last_became_active":"2023-10-06T03:02:38.871712+0000","last_became_peered":"2023-10-06T03:02:38.871712+0000","last_unstale":"2023-10-06T03:02:39.892812+0000","last_undegraded":"2023-10-06T03:02:39.892812+0000","last_fullsized":"2023-10-06T03:02:39.892812+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:06:25.018937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:02:39.879300+0000","last_change":"2023-10-06T03:02:39.870326+0000","last_active":"2023-10-06T03:02:39.879300+0000","last_peered":"2023-10-06T03:02:39.879300+0000","last_clean":"2023-10-06T03:02:39.879300+0000","last_became_active":"2023-10-06T03:02:39.869927+0000","last_became_peered":"2023-10-06T03:02:39.869927+0000","last_unstale":"2023-10-06T03:02:39.879300+0000","last_undegraded":"2023-10-06T03:02:39.879300+0000","last_fullsized":"2023-10-06T03:02:39.879300+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:29:30.158378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"49'1","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:02:39.892017+0000","last_change":"2023-10-06T03:02:38.876423+0000","last_active":"2023-10-06T03:02:39.892017+0000","last_peered":"2023-10-06T03:02:39.892017+0000","last_clean":"2023-10-06T03:02:39.892017+0000","last_became_active":"2023-10-06T03:02:38.876118+0000","last_became_peered":"2023-10-06T03:02:38.876118+0000","last_unstale":"2023-10-06T03:02:39.892017+0000","last_undegraded":"2023-10-06T03:02:39.892017+0000","last_fullsized":"2023-10-06T03:02:39.892017+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:58:25.908183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:02:39.890458+0000","last_change":"2023-10-06T03:02:39.888339+0000","last_active":"2023-10-06T03:02:39.890458+0000","last_peered":"2023-10-06T03:02:39.890458+0000","last_clean":"2023-10-06T03:02:39.890458+0000","last_became_active":"2023-10-06T03:02:39.887806+0000","last_became_peered":"2023-10-06T03:02:39.887806+0000","last_unstale":"2023-10-06T03:02:39.890458+0000","last_undegraded":"2023-10-06T03:02:39.890458+0000","last_fullsized":"2023-10-06T03:02:39.890458+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:47:29.067808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"49'2","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:02:39.881137+0000","last_change":"2023-10-06T03:02:38.861028+0000","last_active":"2023-10-06T03:02:39.881137+0000","last_peered":"2023-10-06T03:02:39.881137+0000","last_clean":"2023-10-06T03:02:39.881137+0000","last_became_active":"2023-10-06T03:02:38.859084+0000","last_became_peered":"2023-10-06T03:02:38.859084+0000","last_unstale":"2023-10-06T03:02:39.881137+0000","last_undegraded":"2023-10-06T03:02:39.881137+0000","last_fullsized":"2023-10-06T03:02:39.881137+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:37:03.894863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:02:39.874575+0000","last_change":"2023-10-06T03:02:39.871887+0000","last_active":"2023-10-06T03:02:39.874575+0000","last_peered":"2023-10-06T03:02:39.874575+0000","last_clean":"2023-10-06T03:02:39.874575+0000","last_became_active":"2023-10-06T03:02:39.871605+0000","last_became_peered":"2023-10-06T03:02:39.871605+0000","last_unstale":"2023-10-06T03:02:39.874575+0000","last_undegraded":"2023-10-06T03:02:39.874575+0000","last_fullsized":"2023-10-06T03:02:39.874575+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:27:35.234159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"49'1","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:02:39.881675+0000","last_change":"2023-10-06T03:02:38.861356+0000","last_active":"2023-10-06T03:02:39.881675+0000","last_peered":"2023-10-06T03:02:39.881675+0000","last_clean":"2023-10-06T03:02:39.881675+0000","last_became_active":"2023-10-06T03:02:38.861051+0000","last_became_peered":"2023-10-06T03:02:38.861051+0000","last_unstale":"2023-10-06T03:02:39.881675+0000","last_undegraded":"2023-10-06T03:02:39.881675+0000","last_fullsized":"2023-10-06T03:02:39.881675+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:51:34.107940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:02:39.880258+0000","last_change":"2023-10-06T03:02:39.872939+0000","last_active":"2023-10-06T03:02:39.880258+0000","last_peered":"2023-10-06T03:02:39.880258+0000","last_clean":"2023-10-06T03:02:39.880258+0000","last_became_active":"2023-10-06T03:02:39.872580+0000","last_became_peered":"2023-10-06T03:02:39.872580+0000","last_unstale":"2023-10-06T03:02:39.880258+0000","last_undegraded":"2023-10-06T03:02:39.880258+0000","last_fullsized":"2023-10-06T03:02:39.880258+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:39:42.661414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":10,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:02:39.850460+0000","last_change":"2023-10-06T03:02:38.873865+0000","last_active":"2023-10-06T03:02:39.850460+0000","last_peered":"2023-10-06T03:02:39.850460+0000","last_clean":"2023-10-06T03:02:39.850460+0000","last_became_active":"2023-10-06T03:02:38.873448+0000","last_became_peered":"2023-10-06T03:02:38.873448+0000","last_unstale":"2023-10-06T03:02:39.850460+0000","last_undegraded":"2023-10-06T03:02:39.850460+0000","last_fullsized":"2023-10-06T03:02:39.850460+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:01:19.591702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:02:39.868284+0000","last_change":"2023-10-06T03:02:39.862340+0000","last_active":"2023-10-06T03:02:39.868284+0000","last_peered":"2023-10-06T03:02:39.868284+0000","last_clean":"2023-10-06T03:02:39.868284+0000","last_became_active":"2023-10-06T03:02:39.862048+0000","last_became_peered":"2023-10-06T03:02:39.862048+0000","last_unstale":"2023-10-06T03:02:39.868284+0000","last_undegraded":"2023-10-06T03:02:39.868284+0000","last_fullsized":"2023-10-06T03:02:39.868284+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:41:45.880609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"49'2","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:02:39.881887+0000","last_change":"2023-10-06T03:02:38.861807+0000","last_active":"2023-10-06T03:02:39.881887+0000","last_peered":"2023-10-06T03:02:39.881887+0000","last_clean":"2023-10-06T03:02:39.881887+0000","last_became_active":"2023-10-06T03:02:38.861513+0000","last_became_peered":"2023-10-06T03:02:38.861513+0000","last_unstale":"2023-10-06T03:02:39.881887+0000","last_undegraded":"2023-10-06T03:02:39.881887+0000","last_fullsized":"2023-10-06T03:02:39.881887+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:56:07.918211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:02:39.860555+0000","last_change":"2023-10-06T03:02:39.856971+0000","last_active":"2023-10-06T03:02:39.860555+0000","last_peered":"2023-10-06T03:02:39.860555+0000","last_clean":"2023-10-06T03:02:39.860555+0000","last_became_active":"2023-10-06T03:02:39.856663+0000","last_became_peered":"2023-10-06T03:02:39.856663+0000","last_unstale":"2023-10-06T03:02:39.860555+0000","last_undegraded":"2023-10-06T03:02:39.860555+0000","last_fullsized":"2023-10-06T03:02:39.860555+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:56:08.935850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":10,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:02:39.854278+0000","last_change":"2023-10-06T03:02:38.872303+0000","last_active":"2023-10-06T03:02:39.854278+0000","last_peered":"2023-10-06T03:02:39.854278+0000","last_clean":"2023-10-06T03:02:39.854278+0000","last_became_active":"2023-10-06T03:02:38.871590+0000","last_became_peered":"2023-10-06T03:02:38.871590+0000","last_unstale":"2023-10-06T03:02:39.854278+0000","last_undegraded":"2023-10-06T03:02:39.854278+0000","last_fullsized":"2023-10-06T03:02:39.854278+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:58:02.400366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:02:39.891596+0000","last_change":"2023-10-06T03:02:39.869648+0000","last_active":"2023-10-06T03:02:39.891596+0000","last_peered":"2023-10-06T03:02:39.891596+0000","last_clean":"2023-10-06T03:02:39.891596+0000","last_became_active":"2023-10-06T03:02:39.869326+0000","last_became_peered":"2023-10-06T03:02:39.869326+0000","last_unstale":"2023-10-06T03:02:39.891596+0000","last_undegraded":"2023-10-06T03:02:39.891596+0000","last_fullsized":"2023-10-06T03:02:39.891596+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:03:58.508623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":10,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:02:39.849189+0000","last_change":"2023-10-06T03:02:38.867297+0000","last_active":"2023-10-06T03:02:39.849189+0000","last_peered":"2023-10-06T03:02:39.849189+0000","last_clean":"2023-10-06T03:02:39.849189+0000","last_became_active":"2023-10-06T03:02:38.866855+0000","last_became_peered":"2023-10-06T03:02:38.866855+0000","last_unstale":"2023-10-06T03:02:39.849189+0000","last_undegraded":"2023-10-06T03:02:39.849189+0000","last_fullsized":"2023-10-06T03:02:39.849189+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:29:09.847352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:02:39.886798+0000","last_change":"2023-10-06T03:02:39.878805+0000","last_active":"2023-10-06T03:02:39.886798+0000","last_peered":"2023-10-06T03:02:39.886798+0000","last_clean":"2023-10-06T03:02:39.886798+0000","last_became_active":"2023-10-06T03:02:39.878483+0000","last_became_peered":"2023-10-06T03:02:39.878483+0000","last_unstale":"2023-10-06T03:02:39.886798+0000","last_undegraded":"2023-10-06T03:02:39.886798+0000","last_fullsized":"2023-10-06T03:02:39.886798+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:29:30.158378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":10,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:02:39.852079+0000","last_change":"2023-10-06T03:02:38.860777+0000","last_active":"2023-10-06T03:02:39.852079+0000","last_peered":"2023-10-06T03:02:39.852079+0000","last_clean":"2023-10-06T03:02:39.852079+0000","last_became_active":"2023-10-06T03:02:38.858664+0000","last_became_peered":"2023-10-06T03:02:38.858664+0000","last_unstale":"2023-10-06T03:02:39.852079+0000","last_undegraded":"2023-10-06T03:02:39.852079+0000","last_fullsized":"2023-10-06T03:02:39.852079+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:47:47.993117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:02:39.862577+0000","last_change":"2023-10-06T03:02:39.859299+0000","last_active":"2023-10-06T03:02:39.862577+0000","last_peered":"2023-10-06T03:02:39.862577+0000","last_clean":"2023-10-06T03:02:39.862577+0000","last_became_active":"2023-10-06T03:02:39.858833+0000","last_became_peered":"2023-10-06T03:02:39.858833+0000","last_unstale":"2023-10-06T03:02:39.862577+0000","last_undegraded":"2023-10-06T03:02:39.862577+0000","last_fullsized":"2023-10-06T03:02:39.862577+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:47:44.821972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"50'1","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-06T03:02:41.515113+0000","last_change":"2023-10-06T03:02:38.867362+0000","last_active":"2023-10-06T03:02:41.515113+0000","last_peered":"2023-10-06T03:02:41.515113+0000","last_clean":"2023-10-06T03:02:41.515113+0000","last_became_active":"2023-10-06T03:02:38.863794+0000","last_became_peered":"2023-10-06T03:02:38.863794+0000","last_unstale":"2023-10-06T03:02:41.515113+0000","last_undegraded":"2023-10-06T03:02:41.515113+0000","last_fullsized":"2023-10-06T03:02:41.515113+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:06:25.018937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":187,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:02:39.854890+0000","last_change":"2023-10-06T03:00:45.709165+0000","last_active":"2023-10-06T03:02:39.854890+0000","last_peered":"2023-10-06T03:02:39.854890+0000","last_clean":"2023-10-06T03:02:39.854890+0000","last_became_active":"2023-10-06T03:00:45.707771+0000","last_became_peered":"2023-10-06T03:00:45.707771+0000","last_unstale":"2023-10-06T03:02:39.854890+0000","last_undegraded":"2023-10-06T03:02:39.854890+0000","last_fullsized":"2023-10-06T03:02:39.854890+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:44.625353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:44.625353+0000","last_clean_scrub_stamp":"2023-10-06T03:00:44.625353+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:31:31.774239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":33,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:02:39.853637+0000","last_change":"2023-10-06T03:00:51.905381+0000","last_active":"2023-10-06T03:02:39.853637+0000","last_peered":"2023-10-06T03:02:39.853637+0000","last_clean":"2023-10-06T03:02:39.853637+0000","last_became_active":"2023-10-06T03:00:51.904974+0000","last_became_peered":"2023-10-06T03:00:51.904974+0000","last_unstale":"2023-10-06T03:02:39.853637+0000","last_undegraded":"2023-10-06T03:02:39.853637+0000","last_fullsized":"2023-10-06T03:02:39.853637+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:15:19.182956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:02:39.886767+0000","last_change":"2023-10-06T03:02:39.878260+0000","last_active":"2023-10-06T03:02:39.886767+0000","last_peered":"2023-10-06T03:02:39.886767+0000","last_clean":"2023-10-06T03:02:39.886767+0000","last_became_active":"2023-10-06T03:02:39.877967+0000","last_became_peered":"2023-10-06T03:02:39.877967+0000","last_unstale":"2023-10-06T03:02:39.886767+0000","last_undegraded":"2023-10-06T03:02:39.886767+0000","last_fullsized":"2023-10-06T03:02:39.886767+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:03:37.092106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":10,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:02:39.859318+0000","last_change":"2023-10-06T03:02:38.858174+0000","last_active":"2023-10-06T03:02:39.859318+0000","last_peered":"2023-10-06T03:02:39.859318+0000","last_clean":"2023-10-06T03:02:39.859318+0000","last_became_active":"2023-10-06T03:02:38.857843+0000","last_became_peered":"2023-10-06T03:02:38.857843+0000","last_unstale":"2023-10-06T03:02:39.859318+0000","last_undegraded":"2023-10-06T03:02:39.859318+0000","last_fullsized":"2023-10-06T03:02:39.859318+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:14:46.577223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":34,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:02:39.854795+0000","last_change":"2023-10-06T03:00:51.906480+0000","last_active":"2023-10-06T03:02:39.854795+0000","last_peered":"2023-10-06T03:02:39.854795+0000","last_clean":"2023-10-06T03:02:39.854795+0000","last_became_active":"2023-10-06T03:00:51.905956+0000","last_became_peered":"2023-10-06T03:00:51.905956+0000","last_unstale":"2023-10-06T03:02:39.854795+0000","last_undegraded":"2023-10-06T03:02:39.854795+0000","last_fullsized":"2023-10-06T03:02:39.854795+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:15:19.182956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:02:39.875395+0000","last_change":"2023-10-06T03:02:39.861393+0000","last_active":"2023-10-06T03:02:39.875395+0000","last_peered":"2023-10-06T03:02:39.875395+0000","last_clean":"2023-10-06T03:02:39.875395+0000","last_became_active":"2023-10-06T03:02:39.861102+0000","last_became_peered":"2023-10-06T03:02:39.861102+0000","last_unstale":"2023-10-06T03:02:39.875395+0000","last_undegraded":"2023-10-06T03:02:39.875395+0000","last_fullsized":"2023-10-06T03:02:39.875395+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:41:45.880609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":10,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:02:39.847766+0000","last_change":"2023-10-06T03:02:38.857592+0000","last_active":"2023-10-06T03:02:39.847766+0000","last_peered":"2023-10-06T03:02:39.847766+0000","last_clean":"2023-10-06T03:02:39.847766+0000","last_became_active":"2023-10-06T03:02:38.857248+0000","last_became_peered":"2023-10-06T03:02:38.857248+0000","last_unstale":"2023-10-06T03:02:39.847766+0000","last_undegraded":"2023-10-06T03:02:39.847766+0000","last_fullsized":"2023-10-06T03:02:39.847766+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:14:46.577223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":34,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:02:39.858566+0000","last_change":"2023-10-06T03:00:51.902453+0000","last_active":"2023-10-06T03:02:39.858566+0000","last_peered":"2023-10-06T03:02:39.858566+0000","last_clean":"2023-10-06T03:02:39.858566+0000","last_became_active":"2023-10-06T03:00:51.901948+0000","last_became_peered":"2023-10-06T03:00:51.901948+0000","last_unstale":"2023-10-06T03:02:39.858566+0000","last_undegraded":"2023-10-06T03:02:39.858566+0000","last_fullsized":"2023-10-06T03:02:39.858566+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:13:30.721650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:02:39.883454+0000","last_change":"2023-10-06T03:02:39.880878+0000","last_active":"2023-10-06T03:02:39.883454+0000","last_peered":"2023-10-06T03:02:39.883454+0000","last_clean":"2023-10-06T03:02:39.883454+0000","last_became_active":"2023-10-06T03:02:39.880579+0000","last_became_peered":"2023-10-06T03:02:39.880579+0000","last_unstale":"2023-10-06T03:02:39.883454+0000","last_undegraded":"2023-10-06T03:02:39.883454+0000","last_fullsized":"2023-10-06T03:02:39.883454+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:03:58.508623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"49'2","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:02:39.893347+0000","last_change":"2023-10-06T03:02:38.864320+0000","last_active":"2023-10-06T03:02:39.893347+0000","last_peered":"2023-10-06T03:02:39.893347+0000","last_clean":"2023-10-06T03:02:39.893347+0000","last_became_active":"2023-10-06T03:02:38.864020+0000","last_became_peered":"2023-10-06T03:02:38.864020+0000","last_unstale":"2023-10-06T03:02:39.893347+0000","last_undegraded":"2023-10-06T03:02:39.893347+0000","last_fullsized":"2023-10-06T03:02:39.893347+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:37:03.894863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":33,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:02:39.853376+0000","last_change":"2023-10-06T03:00:51.904148+0000","last_active":"2023-10-06T03:02:39.853376+0000","last_peered":"2023-10-06T03:02:39.853376+0000","last_clean":"2023-10-06T03:02:39.853376+0000","last_became_active":"2023-10-06T03:00:51.903729+0000","last_became_peered":"2023-10-06T03:00:51.903729+0000","last_unstale":"2023-10-06T03:02:39.853376+0000","last_undegraded":"2023-10-06T03:02:39.853376+0000","last_fullsized":"2023-10-06T03:02:39.853376+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:17:25.070478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:02:39.892256+0000","last_change":"2023-10-06T03:02:39.884053+0000","last_active":"2023-10-06T03:02:39.892256+0000","last_peered":"2023-10-06T03:02:39.892256+0000","last_clean":"2023-10-06T03:02:39.892256+0000","last_became_active":"2023-10-06T03:02:39.883738+0000","last_became_peered":"2023-10-06T03:02:39.883738+0000","last_unstale":"2023-10-06T03:02:39.892256+0000","last_undegraded":"2023-10-06T03:02:39.892256+0000","last_fullsized":"2023-10-06T03:02:39.892256+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:36:41.813545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":10,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:02:39.848829+0000","last_change":"2023-10-06T03:02:38.867268+0000","last_active":"2023-10-06T03:02:39.848829+0000","last_peered":"2023-10-06T03:02:39.848829+0000","last_clean":"2023-10-06T03:02:39.848829+0000","last_became_active":"2023-10-06T03:02:38.867007+0000","last_became_peered":"2023-10-06T03:02:38.867007+0000","last_unstale":"2023-10-06T03:02:39.848829+0000","last_undegraded":"2023-10-06T03:02:39.848829+0000","last_fullsized":"2023-10-06T03:02:39.848829+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:56:07.918211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":31,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:02:39.858958+0000","last_change":"2023-10-06T03:00:52.484317+0000","last_active":"2023-10-06T03:02:39.858958+0000","last_peered":"2023-10-06T03:02:39.858958+0000","last_clean":"2023-10-06T03:02:39.858958+0000","last_became_active":"2023-10-06T03:00:52.483818+0000","last_became_peered":"2023-10-06T03:00:52.483818+0000","last_unstale":"2023-10-06T03:02:39.858958+0000","last_undegraded":"2023-10-06T03:02:39.858958+0000","last_fullsized":"2023-10-06T03:02:39.858958+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:17:24.136459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:02:39.890889+0000","last_change":"2023-10-06T03:02:39.879901+0000","last_active":"2023-10-06T03:02:39.890889+0000","last_peered":"2023-10-06T03:02:39.890889+0000","last_clean":"2023-10-06T03:02:39.890889+0000","last_became_active":"2023-10-06T03:02:39.879499+0000","last_became_peered":"2023-10-06T03:02:39.879499+0000","last_unstale":"2023-10-06T03:02:39.890889+0000","last_undegraded":"2023-10-06T03:02:39.890889+0000","last_fullsized":"2023-10-06T03:02:39.890889+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:19:46.946130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":10,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:02:39.854192+0000","last_change":"2023-10-06T03:02:38.861581+0000","last_active":"2023-10-06T03:02:39.854192+0000","last_peered":"2023-10-06T03:02:39.854192+0000","last_clean":"2023-10-06T03:02:39.854192+0000","last_became_active":"2023-10-06T03:02:38.861190+0000","last_became_peered":"2023-10-06T03:02:38.861190+0000","last_unstale":"2023-10-06T03:02:39.854192+0000","last_undegraded":"2023-10-06T03:02:39.854192+0000","last_fullsized":"2023-10-06T03:02:39.854192+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:23:17.200260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":34,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:02:39.859398+0000","last_change":"2023-10-06T03:00:52.485186+0000","last_active":"2023-10-06T03:02:39.859398+0000","last_peered":"2023-10-06T03:02:39.859398+0000","last_clean":"2023-10-06T03:02:39.859398+0000","last_became_active":"2023-10-06T03:00:52.484615+0000","last_became_peered":"2023-10-06T03:00:52.484615+0000","last_unstale":"2023-10-06T03:02:39.859398+0000","last_undegraded":"2023-10-06T03:02:39.859398+0000","last_fullsized":"2023-10-06T03:02:39.859398+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:17:25.070478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:02:39.891576+0000","last_change":"2023-10-06T03:02:39.869085+0000","last_active":"2023-10-06T03:02:39.891576+0000","last_peered":"2023-10-06T03:02:39.891576+0000","last_clean":"2023-10-06T03:02:39.891576+0000","last_became_active":"2023-10-06T03:02:39.868596+0000","last_became_peered":"2023-10-06T03:02:39.868596+0000","last_unstale":"2023-10-06T03:02:39.891576+0000","last_undegraded":"2023-10-06T03:02:39.891576+0000","last_fullsized":"2023-10-06T03:02:39.891576+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:57:21.209227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":10,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:02:39.860171+0000","last_change":"2023-10-06T03:02:38.872801+0000","last_active":"2023-10-06T03:02:39.860171+0000","last_peered":"2023-10-06T03:02:39.860171+0000","last_clean":"2023-10-06T03:02:39.860171+0000","last_became_active":"2023-10-06T03:02:38.872498+0000","last_became_peered":"2023-10-06T03:02:38.872498+0000","last_unstale":"2023-10-06T03:02:39.860171+0000","last_undegraded":"2023-10-06T03:02:39.860171+0000","last_fullsized":"2023-10-06T03:02:39.860171+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:58:25.908183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":31,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:02:39.859624+0000","last_change":"2023-10-06T03:00:51.903388+0000","last_active":"2023-10-06T03:02:39.859624+0000","last_peered":"2023-10-06T03:02:39.859624+0000","last_clean":"2023-10-06T03:02:39.859624+0000","last_became_active":"2023-10-06T03:00:51.902959+0000","last_became_peered":"2023-10-06T03:00:51.902959+0000","last_unstale":"2023-10-06T03:02:39.859624+0000","last_undegraded":"2023-10-06T03:02:39.859624+0000","last_fullsized":"2023-10-06T03:02:39.859624+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:30:16.907470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:02:39.870085+0000","last_change":"2023-10-06T03:02:39.866506+0000","last_active":"2023-10-06T03:02:39.870085+0000","last_peered":"2023-10-06T03:02:39.870085+0000","last_clean":"2023-10-06T03:02:39.870085+0000","last_became_active":"2023-10-06T03:02:39.866205+0000","last_became_peered":"2023-10-06T03:02:39.866205+0000","last_unstale":"2023-10-06T03:02:39.870085+0000","last_undegraded":"2023-10-06T03:02:39.870085+0000","last_fullsized":"2023-10-06T03:02:39.870085+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:38.822196+0000","last_clean_scrub_stamp":"2023-10-06T03:02:38.822196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:17:46.359437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":10,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:02:39.854284+0000","last_change":"2023-10-06T03:02:38.872473+0000","last_active":"2023-10-06T03:02:39.854284+0000","last_peered":"2023-10-06T03:02:39.854284+0000","last_clean":"2023-10-06T03:02:39.854284+0000","last_became_active":"2023-10-06T03:02:38.871994+0000","last_became_peered":"2023-10-06T03:02:38.871994+0000","last_unstale":"2023-10-06T03:02:39.854284+0000","last_undegraded":"2023-10-06T03:02:39.854284+0000","last_fullsized":"2023-10-06T03:02:39.854284+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:02:37.804558+0000","last_clean_scrub_stamp":"2023-10-06T03:02:37.804558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:23:17.200260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":33,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-06T03:02:39.850126+0000","last_change":"2023-10-06T03:00:51.903242+0000","last_active":"2023-10-06T03:02:39.850126+0000","last_peered":"2023-10-06T03:02:39.850126+0000","last_clean":"2023-10-06T03:02:39.850126+0000","last_became_active":"2023-10-06T03:00:51.902929+0000","last_became_peered":"2023-10-06T03:00:51.902929+0000","last_unstale":"2023-10-06T03:02:39.850126+0000","last_undegraded":"2023-10-06T03:02:39.850126+0000","last_fullsized":"2023-10-06T03:02:39.850126+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:34:12.274158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574875,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302548,"kb_used_data":1164,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069292,"statfs":{"total":96636764160,"available":96326955008,"internally_reserved":0,"allocated":1191936,"data_stored":846195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"min":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":4.7930000000000001,"5min":4.7930000000000001,"15min":4.7930000000000001},"last":0.89000000000000001},{"interface":"front","average":{"1min":1.5780000000000001,"5min":1.5780000000000001,"15min":1.5780000000000001},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":9.9689999999999994,"5min":9.9689999999999994,"15min":9.9689999999999994},"last":0.92700000000000005}]},{"osd":1,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":10.867000000000001,"5min":10.867000000000001,"15min":10.867000000000001},"last":1.2450000000000001},{"interface":"front","average":{"1min":1.6779999999999999,"5min":1.6779999999999999,"15min":1.6779999999999999},"min":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":10.255000000000001,"5min":10.255000000000001,"15min":10.255000000000001},"last":1.3580000000000001}]},{"osd":2,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.6799999999999999,"5min":1.6799999999999999,"15min":1.6799999999999999},"min":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"max":{"1min":7.9939999999999998,"5min":7.9939999999999998,"15min":7.9939999999999998},"last":1.391},{"interface":"front","average":{"1min":1.6970000000000001,"5min":1.6970000000000001,"15min":1.6970000000000001},"min":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"max":{"1min":10.098000000000001,"5min":10.098000000000001,"15min":10.098000000000001},"last":1.421}]},{"osd":3,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"min":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"max":{"1min":4.3090000000000002,"5min":4.3090000000000002,"15min":4.3090000000000002},"last":1.167},{"interface":"front","average":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"min":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":8.3770000000000007,"5min":8.3770000000000007,"15min":8.3770000000000007},"last":1.04}]},{"osd":4,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.7889999999999999,"5min":1.7889999999999999,"15min":1.7889999999999999},"min":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"max":{"1min":11.391999999999999,"5min":11.391999999999999,"15min":11.391999999999999},"last":1.21},{"interface":"front","average":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"min":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"max":{"1min":3.9220000000000002,"5min":3.9220000000000002,"15min":3.9220000000000002},"last":1.4730000000000001}]},{"osd":5,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.796,"5min":1.796,"15min":1.796},"min":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"max":{"1min":11.951000000000001,"5min":11.951000000000001,"15min":11.951000000000001},"last":1.323},{"interface":"front","average":{"1min":1.9259999999999999,"5min":1.9259999999999999,"15min":1.9259999999999999},"min":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"max":{"1min":10.994999999999999,"5min":10.994999999999999,"15min":10.994999999999999},"last":1.109}]},{"osd":6,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.9890000000000001,"5min":1.9890000000000001,"15min":1.9890000000000001},"min":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"max":{"1min":11.513,"5min":11.513,"15min":11.513},"last":1.444},{"interface":"front","average":{"1min":1.958,"5min":1.958,"15min":1.958},"min":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"max":{"1min":10.714,"5min":10.714,"15min":10.714},"last":1.286}]}]},{"osd":6,"up_from":13,"seq":55834574875,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297872,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073968,"statfs":{"total":96636764160,"available":96331743232,"internally_reserved":0,"allocated":598016,"data_stored":256327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":1.1839999999999999},{"interface":"front","average":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":2.1419999999999999,"5min":2.1419999999999999,"15min":2.1419999999999999},"last":1.3819999999999999}]},{"osd":1,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"min":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"max":{"1min":1.9159999999999999,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":1.3029999999999999},{"interface":"front","average":{"1min":1.256,"5min":1.256,"15min":1.256},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":1.677,"5min":1.677,"15min":1.677},"last":1.482}]},{"osd":2,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.167,"15min":1.167},"min":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":1.659,"5min":1.659,"15min":1.659},"last":1.0900000000000001},{"interface":"front","average":{"1min":1.236,"5min":1.236,"15min":1.236},"min":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"max":{"1min":1.78,"5min":1.78,"15min":1.78},"last":0.88600000000000001}]},{"osd":3,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.284,"5min":1.284,"15min":1.284},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":1.2450000000000001},{"interface":"front","average":{"1min":1.343,"5min":1.343,"15min":1.343},"min":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":2.2200000000000002,"5min":2.2200000000000002,"15min":2.2200000000000002},"last":0.81100000000000005}]},{"osd":4,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.286,"5min":1.286,"15min":1.286},"min":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"max":{"1min":1.889,"5min":1.889,"15min":1.889},"last":1.325},{"interface":"front","average":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"min":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":2.2610000000000001,"5min":2.2610000000000001,"15min":2.2610000000000001},"last":1.218}]},{"osd":5,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"min":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"max":{"1min":1.994,"5min":1.994,"15min":1.994},"last":1.143},{"interface":"front","average":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"min":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"max":{"1min":2.0129999999999999,"5min":2.0129999999999999,"15min":2.0129999999999999},"last":1.413}]},{"osd":7,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"min":{"1min":1.016,"5min":1.016,"15min":1.016},"max":{"1min":2.0920000000000001,"5min":2.0920000000000001,"15min":2.0920000000000001},"last":1.2729999999999999},{"interface":"front","average":{"1min":1.5469999999999999,"5min":1.5469999999999999,"15min":1.5469999999999999},"min":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"max":{"1min":2.0310000000000001,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":1.3560000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574875,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297864,"kb_used_data":576,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073976,"statfs":{"total":96636764160,"available":96331751424,"internally_reserved":0,"allocated":589824,"data_stored":255703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":0.995},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.5,"5min":1.5,"15min":1.5},"last":1.0669999999999999}]},{"osd":1,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"min":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":1.984,"5min":1.984,"15min":1.984},"last":0.76600000000000001},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.708,"5min":1.708,"15min":1.708},"last":0.92500000000000004}]},{"osd":2,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.395,"5min":1.395,"15min":1.395},"min":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"max":{"1min":1.78,"5min":1.78,"15min":1.78},"last":0.81899999999999995},{"interface":"front","average":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"min":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":2.8319999999999999,"5min":2.8319999999999999,"15min":2.8319999999999999},"last":1.3100000000000001}]},{"osd":3,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"min":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":3.1789999999999998,"5min":3.1789999999999998,"15min":3.1789999999999998},"last":1.212},{"interface":"front","average":{"1min":1.272,"5min":1.272,"15min":1.272},"min":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"max":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":1.03}]},{"osd":4,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":1.302,"15min":1.302},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":2.5899999999999999,"5min":2.5899999999999999,"15min":2.5899999999999999},"last":1.169},{"interface":"front","average":{"1min":1.516,"5min":1.516,"15min":1.516},"min":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"max":{"1min":4.5419999999999998,"5min":4.5419999999999998,"15min":4.5419999999999998},"last":1.4399999999999999}]},{"osd":6,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.847,"5min":1.847,"15min":1.847},"last":1.1200000000000001},{"interface":"front","average":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"min":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":2.9239999999999999,"5min":2.9239999999999999,"15min":2.9239999999999999},"last":0.85899999999999999}]},{"osd":7,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":4.4489999999999998,"5min":4.4489999999999998,"15min":4.4489999999999998},"last":1.357},{"interface":"front","average":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"min":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"max":{"1min":1.98,"5min":1.98,"15min":1.98},"last":1.2509999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574874,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301964,"kb_used_data":580,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069876,"statfs":{"total":96636764160,"available":96327553024,"internally_reserved":0,"allocated":593920,"data_stored":256257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.6040000000000001,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":0.94399999999999995},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.585,"5min":1.585,"15min":1.585},"last":1.0820000000000001}]},{"osd":1,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.403,"5min":1.403,"15min":1.403},"last":0.88800000000000001},{"interface":"front","average":{"1min":1.169,"5min":1.169,"15min":1.169},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.73,"5min":1.73,"15min":1.73},"last":1.3080000000000001}]},{"osd":2,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.696,"5min":1.696,"15min":1.696},"last":0.98799999999999999},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":1.788,"5min":1.788,"15min":1.788},"last":0.83499999999999996}]},{"osd":3,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.248,"15min":1.248},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.625,"5min":1.625,"15min":1.625},"last":1.244},{"interface":"front","average":{"1min":1.232,"5min":1.232,"15min":1.232},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.7629999999999999,"5min":1.7629999999999999,"15min":1.7629999999999999},"last":1.2809999999999999}]},{"osd":5,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.198,"5min":1.198,"15min":1.198},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.71,"5min":1.71,"15min":1.71},"last":1.413},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.7889999999999999,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":1.46}]},{"osd":6,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":2.9100000000000001,"5min":2.9100000000000001,"15min":2.9100000000000001},"last":1.202},{"interface":"front","average":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":3.282,"5min":3.282,"15min":3.282},"last":1.488}]},{"osd":7,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.544,"5min":1.544,"15min":1.544},"min":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"max":{"1min":2.145,"5min":2.145,"15min":2.145},"last":1.367},{"interface":"front","average":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"min":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.927,"5min":1.927,"15min":1.927},"last":1.5169999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574874,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301976,"kb_used_data":592,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069864,"statfs":{"total":96636764160,"available":96327540736,"internally_reserved":0,"allocated":606208,"data_stored":257261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:01:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":2.298,"5min":2.298,"15min":2.298},"last":0.95199999999999996},{"interface":"front","average":{"1min":0.998,"5min":0.998,"15min":0.998},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":2.1850000000000001,"5min":2.1850000000000001,"15min":2.1850000000000001},"last":0.80200000000000005}]},{"osd":1,"last update":"Fri Oct 6 03:01:46 2023","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.974,"5min":1.974,"15min":1.974},"last":1.2709999999999999},{"interface":"front","average":{"1min":1.137,"5min":1.137,"15min":1.137},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.71,"5min":1.71,"15min":1.71},"last":1.081}]},{"osd":2,"last update":"Fri Oct 6 03:01:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":2.8849999999999998,"5min":2.8849999999999998,"15min":2.8849999999999998},"last":1.345},{"interface":"front","average":{"1min":1.095,"5min":1.095,"15min":1.095},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":2.8220000000000001,"5min":2.8220000000000001,"15min":2.8220000000000001},"last":1.0109999999999999}]},{"osd":4,"last update":"Fri Oct 6 03:01:46 2023","interfaces":[{"interface":"back","average":{"1min":1.456,"5min":1.456,"15min":1.456},"min":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"max":{"1min":3.6560000000000001,"5min":3.6560000000000001,"15min":3.6560000000000001},"last":1.238},{"interface":"front","average":{"1min":1.466,"5min":1.466,"15min":1.466},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":3.7749999999999999,"5min":3.7749999999999999,"15min":3.7749999999999999},"last":1.4630000000000001}]},{"osd":5,"last update":"Fri Oct 6 03:01:46 2023","interfaces":[{"interface":"back","average":{"1min":1.534,"5min":1.534,"15min":1.534},"min":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"max":{"1min":3.4910000000000001,"5min":3.4910000000000001,"15min":3.4910000000000001},"last":1.536},{"interface":"front","average":{"1min":1.494,"5min":1.494,"15min":1.494},"min":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"max":{"1min":2.6240000000000001,"5min":2.6240000000000001,"15min":2.6240000000000001},"last":1.319}]},{"osd":6,"last update":"Fri Oct 6 03:01:46 2023","interfaces":[{"interface":"back","average":{"1min":1.5780000000000001,"5min":1.5780000000000001,"15min":1.5780000000000001},"min":{"1min":1.046,"5min":1.046,"15min":1.046},"max":{"1min":3.7050000000000001,"5min":3.7050000000000001,"15min":3.7050000000000001},"last":1.1319999999999999},{"interface":"front","average":{"1min":1.583,"5min":1.583,"15min":1.583},"min":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"max":{"1min":3.9300000000000002,"5min":3.9300000000000002,"15min":3.9300000000000002},"last":1.393}]},{"osd":7,"last update":"Fri Oct 6 03:01:46 2023","interfaces":[{"interface":"back","average":{"1min":1.635,"5min":1.635,"15min":1.635},"min":{"1min":1.149,"5min":1.149,"15min":1.149},"max":{"1min":2.96,"5min":2.96,"15min":2.96},"last":1.4219999999999999},{"interface":"front","average":{"1min":1.7729999999999999,"5min":1.7729999999999999,"15min":1.7729999999999999},"min":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"max":{"1min":3.8559999999999999,"5min":3.8559999999999999,"15min":3.8559999999999999},"last":1.498}]}]},{"osd":2,"up_from":13,"seq":55834574874,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301972,"kb_used_data":588,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069868,"statfs":{"total":96636764160,"available":96327544832,"internally_reserved":0,"allocated":602112,"data_stored":257239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.6950000000000001,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":0.82399999999999995}]},{"osd":1,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.5449999999999999,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":0.88700000000000001},{"interface":"front","average":{"1min":1.232,"5min":1.232,"15min":1.232},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":2.1800000000000002,"5min":2.1800000000000002,"15min":2.1800000000000002},"last":1.077}]},{"osd":3,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.64200000000000002},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":2.806,"5min":2.806,"15min":2.806},"last":1.167}]},{"osd":4,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.389,"5min":1.389,"15min":1.389},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":2.1739999999999999,"5min":2.1739999999999999,"15min":2.1739999999999999},"last":1.2929999999999999},{"interface":"front","average":{"1min":1.458,"5min":1.458,"15min":1.458},"min":{"1min":1,"5min":1,"15min":1},"max":{"1min":3.028,"5min":3.028,"15min":3.028},"last":1.325}]},{"osd":5,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.55,"5min":1.55,"15min":1.55},"min":{"1min":1.036,"5min":1.036,"15min":1.036},"max":{"1min":3.1499999999999999,"5min":3.1499999999999999,"15min":3.1499999999999999},"last":1.5089999999999999},{"interface":"front","average":{"1min":1.512,"5min":1.512,"15min":1.512},"min":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"max":{"1min":2.8580000000000001,"5min":2.8580000000000001,"15min":2.8580000000000001},"last":1.4730000000000001}]},{"osd":6,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"min":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"max":{"1min":2.6659999999999999,"5min":2.6659999999999999,"15min":2.6659999999999999},"last":1.6619999999999999},{"interface":"front","average":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"min":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"max":{"1min":2.411,"5min":2.411,"15min":2.411},"last":1.71}]},{"osd":7,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"min":{"1min":1.01,"5min":1.01,"15min":1.01},"max":{"1min":3.2160000000000002,"5min":3.2160000000000002,"15min":3.2160000000000002},"last":1.6319999999999999},{"interface":"front","average":{"1min":1.631,"5min":1.631,"15min":1.631},"min":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"max":{"1min":3.1059999999999999,"5min":3.1059999999999999,"15min":3.1059999999999999},"last":1.7629999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574875,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301968,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069872,"statfs":{"total":96636764160,"available":96327548928,"internally_reserved":0,"allocated":598016,"data_stored":255863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.7749999999999999,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":1.1100000000000001},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":2.3260000000000001,"5min":2.3260000000000001,"15min":2.3260000000000001},"last":0.79300000000000004}]},{"osd":2,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":3.5459999999999998,"5min":3.5459999999999998,"15min":3.5459999999999998},"last":1.3859999999999999},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.706,"5min":1.706,"15min":1.706},"last":0.84599999999999997}]},{"osd":3,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.625,"5min":1.625,"15min":1.625},"last":0.71499999999999997},{"interface":"front","average":{"1min":1.196,"5min":1.196,"15min":1.196},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":3.331,"5min":3.331,"15min":3.331},"last":0.91500000000000004}]},{"osd":4,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.339,"5min":1.339,"15min":1.339},"min":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"max":{"1min":1.8660000000000001,"5min":1.8660000000000001,"15min":1.8660000000000001},"last":1.46},{"interface":"front","average":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":3.2250000000000001,"5min":3.2250000000000001,"15min":3.2250000000000001},"last":1.411}]},{"osd":5,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"min":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"max":{"1min":2.8439999999999999,"5min":2.8439999999999999,"15min":2.8439999999999999},"last":1.3580000000000001},{"interface":"front","average":{"1min":1.484,"5min":1.484,"15min":1.484},"min":{"1min":1.01,"5min":1.01,"15min":1.01},"max":{"1min":2.4590000000000001,"5min":2.4590000000000001,"15min":2.4590000000000001},"last":1.1599999999999999}]},{"osd":6,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"min":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"max":{"1min":2.96,"5min":2.96,"15min":2.96},"last":1.29},{"interface":"front","average":{"1min":1.504,"5min":1.504,"15min":1.504},"min":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"max":{"1min":2.5859999999999999,"5min":2.5859999999999999,"15min":2.5859999999999999},"last":1.054}]},{"osd":7,"last update":"Fri Oct 6 03:01:45 2023","interfaces":[{"interface":"back","average":{"1min":1.6040000000000001,"5min":1.6040000000000001,"15min":1.6040000000000001},"min":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"max":{"1min":3.4460000000000002,"5min":3.4460000000000002,"15min":3.4460000000000002},"last":1.196},{"interface":"front","average":{"1min":1.538,"5min":1.538,"15min":1.538},"min":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"max":{"1min":3.113,"5min":3.113,"15min":3.113},"last":1.492}]}]},{"osd":0,"up_from":13,"seq":55834574874,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302548,"kb_used_data":1164,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069292,"statfs":{"total":96636764160,"available":96326955008,"internally_reserved":0,"allocated":1191936,"data_stored":846127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.381,"5min":1.381,"15min":1.381},"last":1.089},{"interface":"front","average":{"1min":0.999,"5min":0.999,"15min":0.999},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.75800000000000001}]},{"osd":2,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.98399999999999999},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.794,"5min":1.794,"15min":1.794},"last":0.90600000000000003}]},{"osd":3,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.532,"5min":1.532,"15min":1.532},"last":0.52900000000000003},{"interface":"front","average":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.613,"5min":1.613,"15min":1.613},"last":0.81000000000000005}]},{"osd":4,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"min":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"max":{"1min":2.0680000000000001,"5min":2.0680000000000001,"15min":2.0680000000000001},"last":1.2629999999999999},{"interface":"front","average":{"1min":1.339,"5min":1.339,"15min":1.339},"min":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"max":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":1.2230000000000001}]},{"osd":5,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"min":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"max":{"1min":1.893,"5min":1.893,"15min":1.893},"last":1.02},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"min":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":2.2080000000000002,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":0.96699999999999997}]},{"osd":6,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.421,"5min":1.421,"15min":1.421},"min":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"max":{"1min":1.96,"5min":1.96,"15min":1.96},"last":1.337},{"interface":"front","average":{"1min":1.552,"5min":1.552,"15min":1.552},"min":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"max":{"1min":1.9910000000000001,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":1.151}]},{"osd":7,"last update":"Fri Oct 6 03:01:44 2023","interfaces":[{"interface":"back","average":{"1min":1.6319999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"min":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"max":{"1min":2.1019999999999999,"5min":2.1019999999999999,"15min":2.1019999999999999},"last":1.2989999999999999},{"interface":"front","average":{"1min":1.431,"5min":1.431,"15min":1.431},"min":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"max":{"1min":2.1499999999999999,"5min":2.1499999999999999,"15min":2.1499999999999999},"last":0.875}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:02:49.306 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-06T03:02:49.306 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-06T03:02:49.518 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.514+0000 7f64f2fc5700 1 Processor -- start 2023-10-06T03:02:49.518 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.514+0000 7f64f2fc5700 1 -- start start 2023-10-06T03:02:49.520 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.518+0000 7f64f2fc5700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f64ec14fd10 0x7f64ec150180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:49.520 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.518+0000 7f64f2fc5700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f64ec06c920 0x7f64ec06cd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:49.520 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.518+0000 7f64f2fc5700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64ec1506c0 con 0x7f64ec15cd50 2023-10-06T03:02:49.520 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.518+0000 7f64f2fc5700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64ec06e300 con 0x7f64ec06c920 2023-10-06T03:02:49.520 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.518+0000 7f64f2fc5700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64ec06afb0 con 0x7f64ec14fd10 2023-10-06T03:02:49.521 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.518+0000 7f64ebfff700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f64ec14fd10 0x7f64ec150180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:49.521 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.518+0000 7f64ebfff700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f64ec14fd10 0x7f64ec150180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.57:50056/0 (socket says 172.21.15.57:50056) 2023-10-06T03:02:49.521 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.518+0000 7f64ebfff700 1 -- 172.21.15.57:0/3885317835 learned_addr learned my addr 172.21.15.57:0/3885317835 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:02:49.521 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.518+0000 7f64f1562700 1 --2- 172.21.15.57:0/3885317835 >> v2:172.21.15.105:3300/0 conn(0x7f64ec06c920 0x7f64ec06cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:49.522 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.518+0000 7f64ebfff700 1 -- 172.21.15.57:0/3885317835 >> v2:172.21.15.105:3300/0 conn(0x7f64ec06c920 msgr2=0x7f64ec06cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:49.522 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.518+0000 7f64ebfff700 1 --2- 172.21.15.57:0/3885317835 >> v2:172.21.15.105:3300/0 conn(0x7f64ec06c920 0x7f64ec06cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:49.522 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.518+0000 7f64ebfff700 1 -- 172.21.15.57:0/3885317835 >> v1:172.21.15.105:6789/0 conn(0x7f64ec15cd50 legacy=0x7f64ec15d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:49.522 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.518+0000 7f64ebfff700 1 -- 172.21.15.57:0/3885317835 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64ec06b290 con 0x7f64ec14fd10 2023-10-06T03:02:49.522 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.522+0000 7f64ebfff700 1 --2- 172.21.15.57:0/3885317835 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f64ec14fd10 0x7f64ec150180 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f64d80099b0 tx=0x7f64d8009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=202b560df9906cb2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:49.523 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.522+0000 7f64eb7fe700 1 -- 172.21.15.57:0/3885317835 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d8009ea0 con 0x7f64ec14fd10 2023-10-06T03:02:49.523 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.522+0000 7f64eb7fe700 1 -- 172.21.15.57:0/3885317835 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64d800b860 con 0x7f64ec14fd10 2023-10-06T03:02:49.524 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.522+0000 7f64eb7fe700 1 -- 172.21.15.57:0/3885317835 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d800bc00 con 0x7f64ec14fd10 2023-10-06T03:02:49.525 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.522+0000 7f64f2fc5700 1 -- 172.21.15.57:0/3885317835 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f64ec14fd10 msgr2=0x7f64ec150180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:49.525 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.522+0000 7f64f2fc5700 1 --2- 172.21.15.57:0/3885317835 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f64ec14fd10 0x7f64ec150180 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f64d80099b0 tx=0x7f64d8009250 comp rx=0 tx=0).stop 2023-10-06T03:02:49.525 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.522+0000 7f64f2fc5700 1 -- 172.21.15.57:0/3885317835 shutdown_connections 2023-10-06T03:02:49.525 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.522+0000 7f64f2fc5700 1 --2- 172.21.15.57:0/3885317835 >> v2:172.21.15.105:3300/0 conn(0x7f64ec06c920 0x7f64ec06cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:49.525 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.522+0000 7f64f2fc5700 1 --2- 172.21.15.57:0/3885317835 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f64ec14fd10 0x7f64ec150180 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:49.525 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.522+0000 7f64f2fc5700 1 -- 172.21.15.57:0/3885317835 >> 172.21.15.57:0/3885317835 conn(0x7f64ec0ccbc0 msgr2=0x7f64ec0ccfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:49.526 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.522+0000 7f64f2fc5700 1 -- 172.21.15.57:0/3885317835 shutdown_connections 2023-10-06T03:02:49.526 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.522+0000 7f64f2fc5700 1 -- 172.21.15.57:0/3885317835 wait complete. 2023-10-06T03:02:49.528 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.526+0000 7f64f2fc5700 1 Processor -- start 2023-10-06T03:02:49.529 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.526+0000 7f64f2fc5700 1 -- start start 2023-10-06T03:02:49.532 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.526+0000 7f64f2fc5700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f64ec06c920 0x7f64ec143600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:49.532 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.526+0000 7f64f2fc5700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f64ec14fd10 0x7f64ec150f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:49.532 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.526+0000 7f64f2fc5700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f64ec15cd50 0x7f64ec0c7160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:49.532 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.530+0000 7f64f2fc5700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64ec0c6730 con 0x7f64ec14fd10 2023-10-06T03:02:49.532 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.530+0000 7f64f2fc5700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64ec0c9e00 con 0x7f64ec15cd50 2023-10-06T03:02:49.533 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.530+0000 7f64f2fc5700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64ec0c91f0 con 0x7f64ec06c920 2023-10-06T03:02:49.533 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.530+0000 7f64ebfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f64ec14fd10 0x7f64ec150f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:49.533 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.530+0000 7f64f0d61700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f64ec06c920 0x7f64ec143600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:49.533 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.530+0000 7f64f1562700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f64ec15cd50 0x7f64ec0c7160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:49.533 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.530+0000 7f64f0d61700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f64ec06c920 0x7f64ec143600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.57:50060/0 (socket says 172.21.15.57:50060) 2023-10-06T03:02:49.533 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.530+0000 7f64ebfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f64ec14fd10 0x7f64ec150f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:59662/0 (socket says 172.21.15.57:59662) 2023-10-06T03:02:49.533 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.530+0000 7f64ebfff700 1 -- 172.21.15.57:0/1074689657 learned_addr learned my addr 172.21.15.57:0/1074689657 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:02:49.533 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.530+0000 7f64f1562700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f64ec15cd50 0x7f64ec0c7160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.57:40910/0 (socket says 172.21.15.57:40910) 2023-10-06T03:02:49.533 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.530+0000 7f64f0d61700 1 -- 172.21.15.57:0/1074689657 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f64ec15cd50 msgr2=0x7f64ec0c7160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:49.533 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.530+0000 7f64f0d61700 1 --2- 172.21.15.57:0/1074689657 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f64ec15cd50 0x7f64ec0c7160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:49.533 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.530+0000 7f64f0d61700 1 -- 172.21.15.57:0/1074689657 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f64ec14fd10 msgr2=0x7f64ec150f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:49.533 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.530+0000 7f64f0d61700 1 --2- 172.21.15.57:0/1074689657 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f64ec14fd10 0x7f64ec150f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:49.534 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.530+0000 7f64f0d61700 1 -- 172.21.15.57:0/1074689657 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64d80094f0 con 0x7f64ec06c920 2023-10-06T03:02:49.534 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.530+0000 7f64f0d61700 1 --2- 172.21.15.57:0/1074689657 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f64ec06c920 0x7f64ec143600 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f64e000c490 tx=0x7f64e0007ec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:49.534 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.530+0000 7f64e8ff9700 1 -- 172.21.15.57:0/1074689657 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64e000ce40 con 0x7f64ec06c920 2023-10-06T03:02:49.534 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.530+0000 7f64e8ff9700 1 -- 172.21.15.57:0/1074689657 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64e0011590 con 0x7f64ec06c920 2023-10-06T03:02:49.535 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.530+0000 7f64f2fc5700 1 -- 172.21.15.57:0/1074689657 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64ec0c94d0 con 0x7f64ec06c920 2023-10-06T03:02:49.535 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.530+0000 7f64e8ff9700 1 -- 172.21.15.57:0/1074689657 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64e0011950 con 0x7f64ec06c920 2023-10-06T03:02:49.535 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.530+0000 7f64f2fc5700 1 -- 172.21.15.57:0/1074689657 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64ec0c9a90 con 0x7f64ec06c920 2023-10-06T03:02:49.535 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.534+0000 7f64f2fc5700 1 -- 172.21.15.57:0/1074689657 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64ec0712e0 con 0x7f64ec06c920 2023-10-06T03:02:49.537 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.534+0000 7f64e8ff9700 1 -- 172.21.15.57:0/1074689657 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f64e0011cc0 con 0x7f64ec06c920 2023-10-06T03:02:49.538 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.538+0000 7f64e8ff9700 1 --2- 172.21.15.57:0/1074689657 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f64d0060580 0x7f64d0062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:49.538 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.538+0000 7f64e8ff9700 1 -- 172.21.15.57:0/1074689657 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f64e007bcb0 con 0x7f64ec06c920 2023-10-06T03:02:49.539 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.538+0000 7f64ebfff700 1 --2- 172.21.15.57:0/1074689657 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f64d0060580 0x7f64d0062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:49.540 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.538+0000 7f64ebfff700 1 --2- 172.21.15.57:0/1074689657 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f64d0060580 0x7f64d0062a30 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f64ec0c8e60 tx=0x7f64d8017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:49.546 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.542+0000 7f64e8ff9700 1 -- 172.21.15.57:0/1074689657 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f64e004c0a0 con 0x7f64ec06c920 2023-10-06T03:02:49.773 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.770+0000 7f64f2fc5700 1 -- 172.21.15.57:0/1074689657 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f64ec06b570 con 0x7f64ec06c920 2023-10-06T03:02:49.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.782+0000 7f64e8ff9700 1 -- 172.21.15.57:0/1074689657 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v12) v1 ==== 190+0+0 (secure 0 0 0) 0x7f64e004f6c0 con 0x7f64ec06c920 2023-10-06T03:02:49.789 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.786+0000 7f64f2fc5700 1 -- 172.21.15.57:0/1074689657 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f64d0060580 msgr2=0x7f64d0062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:49.789 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.786+0000 7f64f2fc5700 1 --2- 172.21.15.57:0/1074689657 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f64d0060580 0x7f64d0062a30 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f64ec0c8e60 tx=0x7f64d8017000 comp rx=0 tx=0).stop 2023-10-06T03:02:49.789 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.786+0000 7f64f2fc5700 1 -- 172.21.15.57:0/1074689657 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f64ec06c920 msgr2=0x7f64ec143600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:49.789 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.786+0000 7f64f2fc5700 1 --2- 172.21.15.57:0/1074689657 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f64ec06c920 0x7f64ec143600 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f64e000c490 tx=0x7f64e0007ec0 comp rx=0 tx=0).stop 2023-10-06T03:02:49.789 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.786+0000 7f64f2fc5700 1 -- 172.21.15.57:0/1074689657 shutdown_connections 2023-10-06T03:02:49.789 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.786+0000 7f64f2fc5700 1 --2- 172.21.15.57:0/1074689657 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f64ec15cd50 0x7f64ec0c7160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:49.789 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.786+0000 7f64f2fc5700 1 --2- 172.21.15.57:0/1074689657 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f64ec14fd10 0x7f64ec150f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:49.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.786+0000 7f64f2fc5700 1 --2- 172.21.15.57:0/1074689657 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f64d0060580 0x7f64d0062a30 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:49.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.786+0000 7f64f2fc5700 1 --2- 172.21.15.57:0/1074689657 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f64ec06c920 0x7f64ec143600 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:49.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.786+0000 7f64f2fc5700 1 -- 172.21.15.57:0/1074689657 >> 172.21.15.57:0/1074689657 conn(0x7f64ec0ccbc0 msgr2=0x7f64ec14f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:49.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.786+0000 7f64f2fc5700 1 -- 172.21.15.57:0/1074689657 shutdown_connections 2023-10-06T03:02:49.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.786+0000 7f64f2fc5700 1 -- 172.21.15.57:0/1074689657 wait complete. 2023-10-06T03:02:49.792 INFO:teuthology.orchestra.run.smithi057.stderr:updated caps for client.0 2023-10-06T03:02:49.809 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:02:49.970 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.966+0000 7fcbb91c5700 1 Processor -- start 2023-10-06T03:02:49.970 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.966+0000 7fcbb91c5700 1 -- start start 2023-10-06T03:02:49.971 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.970+0000 7fcbb91c5700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fcbb4158f70 0x7fcbb40cb2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:49.971 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.970+0000 7fcbb91c5700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcbb4159340 0x7fcbb40b01c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:49.971 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.970+0000 7fcbb91c5700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbb40cb900 con 0x7fcbb406d4a0 2023-10-06T03:02:49.972 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.970+0000 7fcbb91c5700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbb40b0700 con 0x7fcbb4158f70 2023-10-06T03:02:49.972 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.970+0000 7fcbb91c5700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb40cbbe0 con 0x7fcbb4159340 2023-10-06T03:02:49.972 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.970+0000 7fcbb359e700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fcbb406d4a0 0x7fcbb406d940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:53338/0 (socket says 172.21.15.57:53338) 2023-10-06T03:02:49.972 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.970+0000 7fcbb359e700 1 -- 172.21.15.57:0/2833371498 learned_addr learned my addr 172.21.15.57:0/2833371498 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:02:49.973 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.970+0000 7fcbb2d9d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fcbb4158f70 0x7fcbb40cb2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:49.973 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.970+0000 7fcbaa59c700 1 --2- 172.21.15.57:0/2833371498 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcbb4159340 0x7fcbb40b01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:49.973 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.970+0000 7fcbb259c700 1 -- 172.21.15.57:0/2833371498 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2052733604 0 0) 0x7fcbb40cb900 con 0x7fcbb406d4a0 2023-10-06T03:02:49.974 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.970+0000 7fcbb2d9d700 1 -- 172.21.15.57:0/2833371498 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcbb4159340 msgr2=0x7fcbb40b01c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:49.974 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.970+0000 7fcbb2d9d700 1 --2- 172.21.15.57:0/2833371498 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcbb4159340 0x7fcbb40b01c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:49.974 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.970+0000 7fcbb2d9d700 1 -- 172.21.15.57:0/2833371498 >> v1:172.21.15.57:6789/0 conn(0x7fcbb406d4a0 legacy=0x7fcbb406d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:49.974 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.970+0000 7fcbb2d9d700 1 -- 172.21.15.57:0/2833371498 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbb406c9c0 con 0x7fcbb4158f70 2023-10-06T03:02:49.975 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.970+0000 7fcbb2d9d700 1 --2- 172.21.15.57:0/2833371498 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcbb4158f70 0x7fcbb40cb2f0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fcba40098e0 tx=0x7fcba40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a285c9a570e410e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:49.975 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.970+0000 7fcbb259c700 1 -- 172.21.15.57:0/2833371498 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcba400b640 con 0x7fcbb4158f70 2023-10-06T03:02:49.975 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.974+0000 7fcbb259c700 1 -- 172.21.15.57:0/2833371498 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcba400b7a0 con 0x7fcbb4158f70 2023-10-06T03:02:49.975 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.974+0000 7fcbb259c700 1 -- 172.21.15.57:0/2833371498 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcba400bb40 con 0x7fcbb4158f70 2023-10-06T03:02:49.976 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.974+0000 7fcbb91c5700 1 -- 172.21.15.57:0/2833371498 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcbb4158f70 msgr2=0x7fcbb40cb2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:49.976 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.974+0000 7fcbb91c5700 1 --2- 172.21.15.57:0/2833371498 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcbb4158f70 0x7fcbb40cb2f0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fcba40098e0 tx=0x7fcba40091a0 comp rx=0 tx=0).stop 2023-10-06T03:02:49.976 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.974+0000 7fcbb91c5700 1 -- 172.21.15.57:0/2833371498 shutdown_connections 2023-10-06T03:02:49.976 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.974+0000 7fcbb91c5700 1 --2- 172.21.15.57:0/2833371498 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcbb4159340 0x7fcbb40b01c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:49.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.974+0000 7fcbb91c5700 1 --2- 172.21.15.57:0/2833371498 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcbb4158f70 0x7fcbb40cb2f0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:49.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.974+0000 7fcbb91c5700 1 -- 172.21.15.57:0/2833371498 >> 172.21.15.57:0/2833371498 conn(0x7fcbb40ccbf0 msgr2=0x7fcbb40ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:49.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.974+0000 7fcbb91c5700 1 -- 172.21.15.57:0/2833371498 shutdown_connections 2023-10-06T03:02:49.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.974+0000 7fcbb91c5700 1 -- 172.21.15.57:0/2833371498 wait complete. 2023-10-06T03:02:49.980 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.978+0000 7fcbb91c5700 1 Processor -- start 2023-10-06T03:02:49.980 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.978+0000 7fcbb91c5700 1 -- start start 2023-10-06T03:02:49.983 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.978+0000 7fcbb91c5700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcbb406d4a0 0x7fcbb4157980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:49.983 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.978+0000 7fcbb91c5700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcbb4158f70 0x7fcbb415df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:49.983 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.978+0000 7fcbb91c5700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcbb4159340 0x7fcbb40cebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:49.983 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.978+0000 7fcbb91c5700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb40879b0 con 0x7fcbb406d4a0 2023-10-06T03:02:49.984 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.978+0000 7fcbb91c5700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb4157ec0 con 0x7fcbb4158f70 2023-10-06T03:02:49.984 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.978+0000 7fcbb91c5700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb416d930 con 0x7fcbb4159340 2023-10-06T03:02:49.984 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.978+0000 7fcbb2d9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcbb406d4a0 0x7fcbb4157980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:49.984 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.982+0000 7fcbb2d9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcbb406d4a0 0x7fcbb4157980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:59688/0 (socket says 172.21.15.57:59688) 2023-10-06T03:02:49.984 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.982+0000 7fcbb2d9d700 1 -- 172.21.15.57:0/238117317 learned_addr learned my addr 172.21.15.57:0/238117317 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:02:49.984 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.982+0000 7fcbb359e700 1 --2- 172.21.15.57:0/238117317 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcbb4159340 0x7fcbb40cebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:49.984 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.982+0000 7fcbaa59c700 1 --2- 172.21.15.57:0/238117317 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcbb4158f70 0x7fcbb415df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:49.985 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.982+0000 7fcbb2d9d700 1 -- 172.21.15.57:0/238117317 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcbb4159340 msgr2=0x7fcbb40cebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:49.985 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.982+0000 7fcbb2d9d700 1 --2- 172.21.15.57:0/238117317 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcbb4159340 0x7fcbb40cebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:49.985 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.982+0000 7fcbb2d9d700 1 -- 172.21.15.57:0/238117317 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcbb4158f70 msgr2=0x7fcbb415df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:49.985 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.982+0000 7fcbb2d9d700 1 --2- 172.21.15.57:0/238117317 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcbb4158f70 0x7fcbb415df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:49.985 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.982+0000 7fcbb2d9d700 1 -- 172.21.15.57:0/238117317 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcba4009420 con 0x7fcbb406d4a0 2023-10-06T03:02:49.985 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.982+0000 7fcbb359e700 1 --2- 172.21.15.57:0/238117317 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcbb4159340 0x7fcbb40cebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:02:49.986 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.982+0000 7fcbb2d9d700 1 --2- 172.21.15.57:0/238117317 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcbb406d4a0 0x7fcbb4157980 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fcbb406a650 tx=0x7fcba4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:49.986 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.982+0000 7fcbab7fe700 1 -- 172.21.15.57:0/238117317 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcba400bb20 con 0x7fcbb406d4a0 2023-10-06T03:02:49.986 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.982+0000 7fcbab7fe700 1 -- 172.21.15.57:0/238117317 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcba4000c90 con 0x7fcbb406d4a0 2023-10-06T03:02:49.986 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.982+0000 7fcbab7fe700 1 -- 172.21.15.57:0/238117317 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcba4011630 con 0x7fcbb406d4a0 2023-10-06T03:02:49.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.982+0000 7fcbb91c5700 1 -- 172.21.15.57:0/238117317 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbb416dc10 con 0x7fcbb406d4a0 2023-10-06T03:02:49.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.982+0000 7fcbb91c5700 1 -- 172.21.15.57:0/238117317 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbb416e1d0 con 0x7fcbb406d4a0 2023-10-06T03:02:49.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.982+0000 7fcbb91c5700 1 -- 172.21.15.57:0/238117317 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbb40712e0 con 0x7fcbb406d4a0 2023-10-06T03:02:49.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.986+0000 7fcbab7fe700 1 -- 172.21.15.57:0/238117317 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fcba40119a0 con 0x7fcbb406d4a0 2023-10-06T03:02:49.989 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.986+0000 7fcbab7fe700 1 --2- 172.21.15.57:0/238117317 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fcb94060550 0x7fcb94062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:49.989 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.986+0000 7fcbab7fe700 1 -- 172.21.15.57:0/238117317 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fcba407dc50 con 0x7fcbb406d4a0 2023-10-06T03:02:49.989 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.986+0000 7fcbaa59c700 1 --2- 172.21.15.57:0/238117317 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fcb94060550 0x7fcb94062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:49.990 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.986+0000 7fcbaa59c700 1 --2- 172.21.15.57:0/238117317 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fcb94060550 0x7fcb94062a00 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fcbb415d860 tx=0x7fcb9c0091a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:49.996 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:49.994+0000 7fcbab7fe700 1 -- 172.21.15.57:0/238117317 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fcba404e040 con 0x7fcbb406d4a0 2023-10-06T03:02:50.202 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.198+0000 7fcbb91c5700 1 -- 172.21.15.57:0/238117317 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcbb40b30b0 con 0x7fcbb406d4a0 2023-10-06T03:02:50.204 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.202+0000 7fcbab7fe700 1 -- 172.21.15.57:0/238117317 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+4603 (secure 0 0 0) 0x7fcba4051660 con 0x7fcbb406d4a0 2023-10-06T03:02:50.204 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:02:50.204 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":31,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5078,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/3441702537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":3441702537},{"type":"v1","addr":"172.21.15.105:6835","nonce":3441702537}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5356,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/1128830333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":1128830333},{"type":"v1","addr":"172.21.15.105:6833","nonce":1128830333}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":5430,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6836/2129396191","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":2129396191},{"type":"v1","addr":"172.21.15.57:6836","nonce":2129396191}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:02:39.274111+0000","modified":"2023-10-06T03:02:42.883803+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5433},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5433":{"gid":5433,"name":"c","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6837/4147766471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6835","nonce":4147766471},{"type":"v1","addr":"172.21.15.57:6837","nonce":4147766471}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T03:02:50.208 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.206+0000 7fcbb91c5700 1 -- 172.21.15.57:0/238117317 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fcb94060550 msgr2=0x7fcb94062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:50.208 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.206+0000 7fcbb91c5700 1 --2- 172.21.15.57:0/238117317 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fcb94060550 0x7fcb94062a00 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fcbb415d860 tx=0x7fcb9c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:02:50.209 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.206+0000 7fcbb91c5700 1 -- 172.21.15.57:0/238117317 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcbb406d4a0 msgr2=0x7fcbb4157980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:50.209 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.206+0000 7fcbb91c5700 1 --2- 172.21.15.57:0/238117317 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcbb406d4a0 0x7fcbb4157980 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fcbb406a650 tx=0x7fcba4017000 comp rx=0 tx=0).stop 2023-10-06T03:02:50.209 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.206+0000 7fcbb91c5700 1 -- 172.21.15.57:0/238117317 shutdown_connections 2023-10-06T03:02:50.209 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.206+0000 7fcbb91c5700 1 --2- 172.21.15.57:0/238117317 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fcb94060550 0x7fcb94062a00 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:50.209 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.206+0000 7fcbb91c5700 1 --2- 172.21.15.57:0/238117317 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcbb4159340 0x7fcbb40cebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:50.209 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.206+0000 7fcbb91c5700 1 --2- 172.21.15.57:0/238117317 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcbb4158f70 0x7fcbb415df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:50.209 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.206+0000 7fcbb91c5700 1 --2- 172.21.15.57:0/238117317 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcbb406d4a0 0x7fcbb4157980 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:50.209 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.206+0000 7fcbb91c5700 1 -- 172.21.15.57:0/238117317 >> 172.21.15.57:0/238117317 conn(0x7fcbb40ccbf0 msgr2=0x7fcbb40b58c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:50.209 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.206+0000 7fcbb91c5700 1 -- 172.21.15.57:0/238117317 shutdown_connections 2023-10-06T03:02:50.209 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.206+0000 7fcbb91c5700 1 -- 172.21.15.57:0/238117317 wait complete. 2023-10-06T03:02:50.211 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 31 2023-10-06T03:02:50.632 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 31, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T03:02:39.274111+0000', 'modified': '2023-10-06T03:02:42.883803+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5433}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5433': {'gid': 5433, 'name': 'c', 'rank': 0, 'incarnation': 28, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.57:6837/4147766471', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6835', 'nonce': 4147766471}, {'type': 'v1', 'addr': '172.21.15.57:6837', 'nonce': 4147766471}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T03:02:50.632 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T03:02:50.632 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-06T03:02:50.799 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.797+0000 7f33024ae700 1 Processor -- start 2023-10-06T03:02:50.799 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.797+0000 7f33024ae700 1 -- start start 2023-10-06T03:02:50.801 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.797+0000 7f33024ae700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f32fc0c8d40 0x7f32fc069090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:50.801 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.797+0000 7f33024ae700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f32fc0c9110 0x7f32fc0695d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:50.802 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.797+0000 7f33024ae700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32fc15d4c0 con 0x7f32fc1596c0 2023-10-06T03:02:50.802 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.797+0000 7f33024ae700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32fc15a420 con 0x7f32fc0c8d40 2023-10-06T03:02:50.802 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.797+0000 7f33024ae700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32fc15ce70 con 0x7f32fc0c9110 2023-10-06T03:02:50.802 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.797+0000 7f32fbfff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f32fc0c8d40 0x7f32fc069090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:50.803 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.797+0000 7f32fbfff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f32fc0c8d40 0x7f32fc069090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:59690/0 (socket says 172.21.15.57:59690) 2023-10-06T03:02:50.803 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.797+0000 7f32fbfff700 1 -- 172.21.15.57:0/974262486 learned_addr learned my addr 172.21.15.57:0/974262486 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:02:50.803 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.801+0000 7f32fbfff700 1 -- 172.21.15.57:0/974262486 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f32fc0c9110 msgr2=0x7f32fc0695d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:50.803 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.801+0000 7f32fb7fe700 1 --2- 172.21.15.57:0/974262486 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f32fc0c9110 0x7f32fc0695d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:50.803 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.801+0000 7f32fbfff700 1 --2- 172.21.15.57:0/974262486 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f32fc0c9110 0x7f32fc0695d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:50.804 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.801+0000 7f32fbfff700 1 -- 172.21.15.57:0/974262486 >> v1:172.21.15.105:6789/0 conn(0x7f32fc1596c0 legacy=0x7f32fc159b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:50.804 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.801+0000 7f32fbfff700 1 -- 172.21.15.57:0/974262486 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32fc15d150 con 0x7f32fc0c8d40 2023-10-06T03:02:50.804 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.801+0000 7f32fb7fe700 1 --2- 172.21.15.57:0/974262486 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f32fc0c9110 0x7f32fc0695d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:02:50.804 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.801+0000 7f32fbfff700 1 --2- 172.21.15.57:0/974262486 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f32fc0c8d40 0x7f32fc069090 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f32ec009990 tx=0x7f32ec009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60fc9aaccc2ca717 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:50.804 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.801+0000 7f32faffd700 1 -- 172.21.15.57:0/974262486 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32ec005c10 con 0x7f32fc0c8d40 2023-10-06T03:02:50.804 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.801+0000 7f32faffd700 1 -- 172.21.15.57:0/974262486 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32ec005d70 con 0x7f32fc0c8d40 2023-10-06T03:02:50.804 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.801+0000 7f32faffd700 1 -- 172.21.15.57:0/974262486 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32ec00b880 con 0x7f32fc0c8d40 2023-10-06T03:02:50.805 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.801+0000 7f33024ae700 1 -- 172.21.15.57:0/974262486 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f32fc0c8d40 msgr2=0x7f32fc069090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:50.805 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.801+0000 7f33024ae700 1 --2- 172.21.15.57:0/974262486 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f32fc0c8d40 0x7f32fc069090 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f32ec009990 tx=0x7f32ec009220 comp rx=0 tx=0).stop 2023-10-06T03:02:50.806 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.801+0000 7f33024ae700 1 -- 172.21.15.57:0/974262486 shutdown_connections 2023-10-06T03:02:50.806 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.801+0000 7f33024ae700 1 --2- 172.21.15.57:0/974262486 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f32fc0c9110 0x7f32fc0695d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:50.806 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.801+0000 7f33024ae700 1 --2- 172.21.15.57:0/974262486 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f32fc0c8d40 0x7f32fc069090 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:50.806 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.801+0000 7f33024ae700 1 -- 172.21.15.57:0/974262486 >> 172.21.15.57:0/974262486 conn(0x7f32fc0c9860 msgr2=0x7f32fc0c9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:50.806 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.801+0000 7f33024ae700 1 -- 172.21.15.57:0/974262486 shutdown_connections 2023-10-06T03:02:50.806 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.801+0000 7f33024ae700 1 -- 172.21.15.57:0/974262486 wait complete. 2023-10-06T03:02:50.808 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.805+0000 7f33024ae700 1 Processor -- start 2023-10-06T03:02:50.808 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.805+0000 7f33024ae700 1 -- start start 2023-10-06T03:02:50.810 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.805+0000 7f33024ae700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f32fc0c8d40 0x7f32fc14df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:50.810 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.805+0000 7f33024ae700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f32fc0c9110 0x7f32fc0c20a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:50.810 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.805+0000 7f33024ae700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f32fc1596c0 0x7f32fc0c25e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:50.810 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.805+0000 7f33024ae700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32fc0b07a0 con 0x7f32fc1596c0 2023-10-06T03:02:50.810 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.805+0000 7f33024ae700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32fc14e4a0 con 0x7f32fc0c9110 2023-10-06T03:02:50.810 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.805+0000 7f33024ae700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32fc0b0c30 con 0x7f32fc0c8d40 2023-10-06T03:02:50.811 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.809+0000 7f3300a4b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f32fc1596c0 0x7f32fc0c25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:50.811 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.809+0000 7f32fb7fe700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f32fc0c9110 0x7f32fc0c20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:50.811 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.809+0000 7f32fbfff700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f32fc0c8d40 0x7f32fc14df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:50.811 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.809+0000 7f32fb7fe700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f32fc0c9110 0x7f32fc0c20a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.57:40928/0 (socket says 172.21.15.57:40928) 2023-10-06T03:02:50.811 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.809+0000 7f32fb7fe700 1 -- 172.21.15.57:0/697729264 learned_addr learned my addr 172.21.15.57:0/697729264 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:02:50.812 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.809+0000 7f32fbfff700 1 -- 172.21.15.57:0/697729264 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f32fc0c9110 msgr2=0x7f32fc0c20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:50.812 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.809+0000 7f32fbfff700 1 --2- 172.21.15.57:0/697729264 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f32fc0c9110 0x7f32fc0c20a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:50.812 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.809+0000 7f32fbfff700 1 -- 172.21.15.57:0/697729264 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f32fc1596c0 msgr2=0x7f32fc0c25e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:50.812 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.809+0000 7f32fbfff700 1 --2- 172.21.15.57:0/697729264 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f32fc1596c0 0x7f32fc0c25e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:50.812 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.809+0000 7f32fbfff700 1 -- 172.21.15.57:0/697729264 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32ec009480 con 0x7f32fc0c8d40 2023-10-06T03:02:50.812 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.809+0000 7f3300a4b700 1 --2- 172.21.15.57:0/697729264 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f32fc1596c0 0x7f32fc0c25e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:02:50.813 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.809+0000 7f32fb7fe700 1 --2- 172.21.15.57:0/697729264 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f32fc0c9110 0x7f32fc0c20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:02:50.813 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.809+0000 7f32fbfff700 1 --2- 172.21.15.57:0/697729264 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f32fc0c8d40 0x7f32fc14df60 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f32ec015000 tx=0x7f32ec016000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:50.813 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.809+0000 7f32e3fff700 1 -- 172.21.15.57:0/697729264 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32ec011730 con 0x7f32fc0c8d40 2023-10-06T03:02:50.813 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.809+0000 7f32e3fff700 1 -- 172.21.15.57:0/697729264 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32ec020070 con 0x7f32fc0c8d40 2023-10-06T03:02:50.813 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.809+0000 7f33024ae700 1 -- 172.21.15.57:0/697729264 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32fc0afb90 con 0x7f32fc0c8d40 2023-10-06T03:02:50.814 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.809+0000 7f32e3fff700 1 -- 172.21.15.57:0/697729264 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32ec011ac0 con 0x7f32fc0c8d40 2023-10-06T03:02:50.814 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.809+0000 7f33024ae700 1 -- 172.21.15.57:0/697729264 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32fc0b0150 con 0x7f32fc0c8d40 2023-10-06T03:02:50.817 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.813+0000 7f32e3fff700 1 -- 172.21.15.57:0/697729264 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f32ec022030 con 0x7f32fc0c8d40 2023-10-06T03:02:50.819 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.817+0000 7f32e3fff700 1 --2- 172.21.15.57:0/697729264 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f32e8060580 0x7f32e8062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:50.819 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.817+0000 7f32e3fff700 1 -- 172.21.15.57:0/697729264 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f32ec07e440 con 0x7f32fc0c8d40 2023-10-06T03:02:50.820 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.817+0000 7f3304736740 1 Processor -- start 2023-10-06T03:02:50.820 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.817+0000 7f32fb7fe700 1 --2- 172.21.15.57:0/697729264 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f32e8060580 0x7f32e8062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:50.820 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.817+0000 7f3304736740 1 -- start start 2023-10-06T03:02:50.823 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.817+0000 7f32fb7fe700 1 --2- 172.21.15.57:0/697729264 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f32e8060580 0x7f32e8062a30 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f32fc153c90 tx=0x7f32f0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:50.823 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.817+0000 7f3304736740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x225cae0 0x24d9e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:50.824 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.817+0000 7f3304736740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x225c710 0x24da390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:50.824 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.817+0000 7f3304736740 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x22a7790 0x24da8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:50.824 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.817+0000 7f3304736740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x2407f30 con 0x225cae0 2023-10-06T03:02:50.824 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.817+0000 7f3304736740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x2403ed0 con 0x225c710 2023-10-06T03:02:50.824 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.817+0000 7f3304736740 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x23ca0b0 con 0x22a7790 2023-10-06T03:02:50.824 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.817+0000 7f32fbfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x225cae0 0x24d9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:50.824 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.817+0000 7f32fbfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x225cae0 0x24d9e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:59702/0 (socket says 172.21.15.57:59702) 2023-10-06T03:02:50.824 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.817+0000 7f32fbfff700 1 -- 172.21.15.57:0/1514605226 learned_addr learned my addr 172.21.15.57:0/1514605226 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:02:50.825 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.817+0000 7f32fb7fe700 1 --2- 172.21.15.57:0/1514605226 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x225c710 0x24da390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:50.825 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.817+0000 7f3300a4b700 1 --2- 172.21.15.57:0/1514605226 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x22a7790 0x24da8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:50.825 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.821+0000 7f32fbfff700 1 -- 172.21.15.57:0/1514605226 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x22a7790 msgr2=0x24da8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:50.825 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.821+0000 7f32fbfff700 1 --2- 172.21.15.57:0/1514605226 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x22a7790 0x24da8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:50.825 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.821+0000 7f32fbfff700 1 -- 172.21.15.57:0/1514605226 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x225c710 msgr2=0x24da390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:50.826 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.821+0000 7f32fbfff700 1 --2- 172.21.15.57:0/1514605226 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x225c710 0x24da390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:50.826 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.821+0000 7f32fbfff700 1 -- 172.21.15.57:0/1514605226 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x22a89e0 con 0x225cae0 2023-10-06T03:02:50.826 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.821+0000 7f32fbfff700 1 --2- 172.21.15.57:0/1514605226 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x225cae0 0x24d9e50 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f32ec00b3c0 tx=0x7f32ec01e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=228198174a4a6257 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:50.826 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.821+0000 7f32e17fa700 1 -- 172.21.15.57:0/1514605226 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32ec055800 con 0x225cae0 2023-10-06T03:02:50.826 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.821+0000 7f32e17fa700 1 -- 172.21.15.57:0/1514605226 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32ec0594d0 con 0x225cae0 2023-10-06T03:02:50.826 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.821+0000 7f32e17fa700 1 -- 172.21.15.57:0/1514605226 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32ec050630 con 0x225cae0 2023-10-06T03:02:50.829 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.821+0000 7f3304736740 1 -- 172.21.15.57:0/1514605226 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x225cae0 msgr2=0x24d9e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:50.829 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.821+0000 7f3304736740 1 --2- 172.21.15.57:0/1514605226 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x225cae0 0x24d9e50 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f32ec00b3c0 tx=0x7f32ec01e040 comp rx=0 tx=0).stop 2023-10-06T03:02:50.829 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.821+0000 7f3304736740 1 -- 172.21.15.57:0/1514605226 shutdown_connections 2023-10-06T03:02:50.829 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.821+0000 7f3304736740 1 --2- 172.21.15.57:0/1514605226 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x22a7790 0x24da8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:50.829 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.821+0000 7f3304736740 1 --2- 172.21.15.57:0/1514605226 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x225c710 0x24da390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:50.829 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.821+0000 7f3304736740 1 --2- 172.21.15.57:0/1514605226 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x225cae0 0x24d9e50 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:50.829 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.821+0000 7f3304736740 1 -- 172.21.15.57:0/1514605226 >> 172.21.15.57:0/1514605226 conn(0x225ceb0 msgr2=0x2496880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:50.829 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.821+0000 7f3304736740 1 -- 172.21.15.57:0/1514605226 shutdown_connections 2023-10-06T03:02:50.829 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.821+0000 7f3304736740 1 -- 172.21.15.57:0/1514605226 wait complete. 2023-10-06T03:02:50.830 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.821+0000 7f3304736740 1 -- start start 2023-10-06T03:02:50.830 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.821+0000 7f3304736740 1 Processor -- start 2023-10-06T03:02:50.830 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.825+0000 7f3304736740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x225c710 0x2496740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:50.830 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.825+0000 7f3304736740 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x225cae0 0x24bfc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:50.830 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.825+0000 7f3304736740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x22a7790 0x24c0140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:50.830 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.825+0000 7f3304736740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x23c9d50 con 0x22a7790 2023-10-06T03:02:50.830 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.825+0000 7f3304736740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x23a2970 con 0x225c710 2023-10-06T03:02:50.830 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.825+0000 7f3304736740 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x240a290 con 0x225cae0 2023-10-06T03:02:50.830 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.825+0000 7f3304736740 10 client.0 _ll_register_callbacks cb 0x244db00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:02:50.830 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.825+0000 7f3300a4b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x22a7790 0x24c0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:50.830 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.825+0000 7f32fbfff700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x225c710 0x2496740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:50.831 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.825+0000 7f32fbfff700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x225c710 0x2496740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.57:40942/0 (socket says 172.21.15.57:40942) 2023-10-06T03:02:50.831 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.825+0000 7f32fbfff700 1 -- 172.21.15.57:0/2643872532 learned_addr learned my addr 172.21.15.57:0/2643872532 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:02:50.831 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.825+0000 7f3300a4b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x22a7790 0x24c0140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:59712/0 (socket says 172.21.15.57:59712) 2023-10-06T03:02:50.831 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.825+0000 7f32fb7fe700 1 --2- 172.21.15.57:0/2643872532 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x225cae0 0x24bfc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:50.831 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.825+0000 7f32fbfff700 1 -- 172.21.15.57:0/2643872532 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x225cae0 msgr2=0x24bfc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:50.831 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.825+0000 7f32fbfff700 1 --2- 172.21.15.57:0/2643872532 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x225cae0 0x24bfc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:50.831 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.825+0000 7f32fbfff700 1 -- 172.21.15.57:0/2643872532 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x22a7790 msgr2=0x24c0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:50.831 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.825+0000 7f32fbfff700 1 --2- 172.21.15.57:0/2643872532 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x22a7790 0x24c0140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:50.831 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.825+0000 7f32fbfff700 1 -- 172.21.15.57:0/2643872532 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32fc0b0150 con 0x225c710 2023-10-06T03:02:50.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.825+0000 7f32fbfff700 1 --2- 172.21.15.57:0/2643872532 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x225c710 0x2496740 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f32ec007fd0 tx=0x7f32ec064000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3fd2908a32d56c4d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:50.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.825+0000 7f32da7fc700 10 client.0 ms_handle_connect on v2:172.21.15.105:3300/0 2023-10-06T03:02:50.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.825+0000 7f32da7fc700 1 -- 172.21.15.57:0/2643872532 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32ec07a070 con 0x225c710 2023-10-06T03:02:50.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.825+0000 7f32da7fc700 1 -- 172.21.15.57:0/2643872532 <== mon.1 v2:172.21.15.105:3300/0 2 ==== osd_map(50..50 src has 1..50) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f32ec01a390 con 0x225c710 2023-10-06T03:02:50.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.825+0000 7f3304736740 1 -- 172.21.15.57:0/2643872532 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x23a2cc0 con 0x225c710 2023-10-06T03:02:50.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.825+0000 7f32da7fc700 1 -- 172.21.15.57:0/2643872532 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f32ec076ea0 con 0x225c710 2023-10-06T03:02:50.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.825+0000 7f3304736740 10 client.5518 fetch_fsmap learned FSMap version 31 2023-10-06T03:02:50.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.825+0000 7f3304736740 1 -- 172.21.15.57:0/2643872532 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=2+}) v3 -- 0x23d2370 con 0x225c710 2023-10-06T03:02:50.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.829+0000 7f32da7fc700 1 -- 172.21.15.57:0/2643872532 <== mon.1 v2:172.21.15.105:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x23a2cc0 con 0x225c710 2023-10-06T03:02:50.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.829+0000 7f32da7fc700 1 -- 172.21.15.57:0/2643872532 <== mon.1 v2:172.21.15.105:3300/0 5 ==== fsmap(e 31) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f32ec07c2b0 con 0x225c710 2023-10-06T03:02:50.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.829+0000 7f3304736740 10 client.5518 fetch_fsmap finished waiting for FSMap version 31 2023-10-06T03:02:50.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.829+0000 7f3304736740 10 client.5518 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T03:02:50.834 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.829+0000 7f3304736740 20 client.5518 populate_metadata read hostname 'smithi057' 2023-10-06T03:02:50.834 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.829+0000 7f3304736740 1 --2- 172.21.15.57:0/2643872532 >> [v2:172.21.15.57:6835/4147766471,v1:172.21.15.57:6837/4147766471] conn(0x24e66b0 0x24e8a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:50.834 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.829+0000 7f3304736740 4 client.5518 mds_command: new command op to 5433 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T03:02:50.834 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.829+0000 7f3304736740 1 -- 172.21.15.57:0/2643872532 --> [v2:172.21.15.57:6835/4147766471,v1:172.21.15.57:6837/4147766471] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x23a63e0 con 0x24e66b0 2023-10-06T03:02:50.834 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.829+0000 7f32fb7fe700 1 --2- 172.21.15.57:0/2643872532 >> [v2:172.21.15.57:6835/4147766471,v1:172.21.15.57:6837/4147766471] conn(0x24e66b0 0x24e8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:50.834 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.829+0000 7f32fb7fe700 1 --2- 172.21.15.57:0/2643872532 >> [v2:172.21.15.57:6835/4147766471,v1:172.21.15.57:6837/4147766471] conn(0x24e66b0 0x24e8a90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bb86ad1e1f8773dd server_cookie=103c9ccfb5c3d4c9 in_seq=0 out_seq=0 2023-10-06T03:02:50.834 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.829+0000 7f32da7fc700 10 client.5518 ms_handle_connect on v2:172.21.15.57:6835/4147766471 2023-10-06T03:02:50.835 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.829+0000 7f32da7fc700 1 -- 172.21.15.57:0/2643872532 <== mds.0 v2:172.21.15.57:6835/4147766471 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x23a63e0 con 0x24e66b0 2023-10-06T03:02:50.835 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.829+0000 7f32da7fc700 10 client.5518 handle_command_reply: tid=0 2023-10-06T03:02:50.835 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.829+0000 7f3304736740 1 client.5518 shutdown 2023-10-06T03:02:50.835 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.829+0000 7f3304736740 1 -- 172.21.15.57:0/2643872532 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x225c710 msgr2=0x2496740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:50.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.829+0000 7f3304736740 1 --2- 172.21.15.57:0/2643872532 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x225c710 0x2496740 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f32ec007fd0 tx=0x7f32ec064000 comp rx=0 tx=0).stop 2023-10-06T03:02:50.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.829+0000 7f3304736740 1 -- 172.21.15.57:0/2643872532 shutdown_connections 2023-10-06T03:02:50.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.829+0000 7f3304736740 1 --2- 172.21.15.57:0/2643872532 >> [v2:172.21.15.57:6835/4147766471,v1:172.21.15.57:6837/4147766471] conn(0x24e66b0 0x24e8a90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:50.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.829+0000 7f3304736740 1 --2- 172.21.15.57:0/2643872532 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x22a7790 0x24c0140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:50.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.829+0000 7f3304736740 1 --2- 172.21.15.57:0/2643872532 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x225cae0 0x24bfc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:50.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.829+0000 7f3304736740 1 --2- 172.21.15.57:0/2643872532 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x225c710 0x2496740 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:50.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.829+0000 7f3304736740 1 -- 172.21.15.57:0/2643872532 >> 172.21.15.57:0/2643872532 conn(0x225ceb0 msgr2=0x248eed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:50.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.829+0000 7f32da7fc700 0 client.5518 ms_handle_reset on v2:172.21.15.57:6835/4147766471 2023-10-06T03:02:50.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.829+0000 7f3304736740 1 -- 172.21.15.57:0/2643872532 shutdown_connections 2023-10-06T03:02:50.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.829+0000 7f3304736740 1 -- 172.21.15.57:0/2643872532 wait complete. 2023-10-06T03:02:50.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.833+0000 7f3304736740 20 client.5518 trim_cache size 0 max 16384 2023-10-06T03:02:50.854 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.849+0000 7f3304736740 1 Processor -- start 2023-10-06T03:02:50.854 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.849+0000 7f3304736740 1 -- start start 2023-10-06T03:02:50.856 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.853+0000 7f3304736740 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x225c710 0x24e8a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:50.857 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.853+0000 7f3304736740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x225cae0 0x24e8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:50.857 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.853+0000 7f3304736740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x22a7790 0x24e9510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:50.857 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.853+0000 7f3304736740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x23c9d50 con 0x22a7790 2023-10-06T03:02:50.857 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.853+0000 7f3304736740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x231eef0 con 0x225cae0 2023-10-06T03:02:50.857 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.853+0000 7f3304736740 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x23b2e00 con 0x225c710 2023-10-06T03:02:50.858 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.853+0000 7f3300a4b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x22a7790 0x24e9510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:50.858 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.853+0000 7f3300a4b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x22a7790 0x24e9510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:59716/0 (socket says 172.21.15.57:59716) 2023-10-06T03:02:50.858 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.853+0000 7f3300a4b700 1 -- 172.21.15.57:0/1730837009 learned_addr learned my addr 172.21.15.57:0/1730837009 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:02:50.858 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.853+0000 7f32fbfff700 1 --2- 172.21.15.57:0/1730837009 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x225c710 0x24e8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:50.858 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.853+0000 7f32fb7fe700 1 --2- 172.21.15.57:0/1730837009 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x225cae0 0x24e8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:50.858 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.853+0000 7f3300a4b700 1 -- 172.21.15.57:0/1730837009 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x225c710 msgr2=0x24e8a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:50.858 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.853+0000 7f3300a4b700 1 --2- 172.21.15.57:0/1730837009 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x225c710 0x24e8a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:50.858 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.853+0000 7f3300a4b700 1 -- 172.21.15.57:0/1730837009 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x225cae0 msgr2=0x24e8fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:50.859 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.853+0000 7f3300a4b700 1 --2- 172.21.15.57:0/1730837009 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x225cae0 0x24e8fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:50.859 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.853+0000 7f3300a4b700 1 -- 172.21.15.57:0/1730837009 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32fc06ed60 con 0x22a7790 2023-10-06T03:02:50.859 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.853+0000 7f32fb7fe700 1 --2- 172.21.15.57:0/1730837009 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x225cae0 0x24e8fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:02:50.859 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.857+0000 7f3300a4b700 1 --2- 172.21.15.57:0/1730837009 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x22a7790 0x24e9510 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f32f40135a0 tx=0x7f32f4009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c465b2d2d008c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:50.860 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.857+0000 7f32e1ffb700 1 -- 172.21.15.57:0/1730837009 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f4015410 con 0x22a7790 2023-10-06T03:02:50.860 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.857+0000 7f32e1ffb700 1 -- 172.21.15.57:0/1730837009 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32f4015590 con 0x22a7790 2023-10-06T03:02:50.860 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.857+0000 7f32e1ffb700 1 -- 172.21.15.57:0/1730837009 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f4015950 con 0x22a7790 2023-10-06T03:02:50.860 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.857+0000 7f3304736740 1 -- 172.21.15.57:0/1730837009 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x22a7790 msgr2=0x24e9510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:50.860 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.857+0000 7f3304736740 1 --2- 172.21.15.57:0/1730837009 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x22a7790 0x24e9510 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f32f40135a0 tx=0x7f32f4009040 comp rx=0 tx=0).stop 2023-10-06T03:02:50.861 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.857+0000 7f3304736740 1 -- 172.21.15.57:0/1730837009 shutdown_connections 2023-10-06T03:02:50.861 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.857+0000 7f3304736740 1 --2- 172.21.15.57:0/1730837009 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x22a7790 0x24e9510 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:50.861 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.857+0000 7f3304736740 1 --2- 172.21.15.57:0/1730837009 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x225cae0 0x24e8fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:50.861 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.857+0000 7f3304736740 1 --2- 172.21.15.57:0/1730837009 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x225c710 0x24e8a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:50.861 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.857+0000 7f3304736740 1 -- 172.21.15.57:0/1730837009 >> 172.21.15.57:0/1730837009 conn(0x225ceb0 msgr2=0x24bec30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:50.861 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.857+0000 7f3304736740 1 -- 172.21.15.57:0/1730837009 shutdown_connections 2023-10-06T03:02:50.861 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.857+0000 7f3304736740 1 -- 172.21.15.57:0/1730837009 wait complete. 2023-10-06T03:02:50.861 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.857+0000 7f3304736740 1 -- start start 2023-10-06T03:02:50.861 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.857+0000 7f3304736740 1 Processor -- start 2023-10-06T03:02:50.862 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.857+0000 7f3304736740 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x225c710 0x24bb900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:50.862 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.857+0000 7f3304736740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x225cae0 0x24bbe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:50.863 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.857+0000 7f3304736740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x22a7790 0x24bc380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:50.863 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.857+0000 7f3304736740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x23d7040 con 0x22a7790 2023-10-06T03:02:50.863 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.857+0000 7f3304736740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x2401890 con 0x225cae0 2023-10-06T03:02:50.863 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.857+0000 7f3304736740 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x244a120 con 0x225c710 2023-10-06T03:02:50.863 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.857+0000 7f3304736740 10 client.0 _ll_register_callbacks cb 0x23200e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:02:50.863 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.857+0000 7f3300a4b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x22a7790 0x24bc380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:50.863 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.861+0000 7f3300a4b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x22a7790 0x24bc380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:59730/0 (socket says 172.21.15.57:59730) 2023-10-06T03:02:50.863 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.861+0000 7f3300a4b700 1 -- 172.21.15.57:0/636684684 learned_addr learned my addr 172.21.15.57:0/636684684 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:02:50.864 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.861+0000 7f32fbfff700 1 --2- 172.21.15.57:0/636684684 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x225c710 0x24bb900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:50.864 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.861+0000 7f32fb7fe700 1 --2- 172.21.15.57:0/636684684 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x225cae0 0x24bbe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:50.864 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.861+0000 7f3300a4b700 1 -- 172.21.15.57:0/636684684 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x225c710 msgr2=0x24bb900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:50.864 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.861+0000 7f3300a4b700 1 --2- 172.21.15.57:0/636684684 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x225c710 0x24bb900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:50.865 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.861+0000 7f3300a4b700 1 -- 172.21.15.57:0/636684684 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x225cae0 msgr2=0x24bbe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:50.865 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.861+0000 7f3300a4b700 1 --2- 172.21.15.57:0/636684684 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x225cae0 0x24bbe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:50.865 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.861+0000 7f3300a4b700 1 -- 172.21.15.57:0/636684684 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32fc15d4c0 con 0x22a7790 2023-10-06T03:02:50.865 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.861+0000 7f32fbfff700 1 --2- 172.21.15.57:0/636684684 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x225c710 0x24bb900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:02:50.865 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.861+0000 7f3300a4b700 1 --2- 172.21.15.57:0/636684684 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x22a7790 0x24bc380 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f32f4013cc0 tx=0x7f32f4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=985f5df8d8a9fcd1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:50.865 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.861+0000 7f32da7fc700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-10-06T03:02:50.865 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.861+0000 7f32da7fc700 1 -- 172.21.15.57:0/636684684 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f40207d0 con 0x22a7790 2023-10-06T03:02:50.865 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.861+0000 7f3304736740 1 -- 172.21.15.57:0/636684684 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f32ec0594d0 con 0x22a7790 2023-10-06T03:02:50.865 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.861+0000 7f32da7fc700 1 -- 172.21.15.57:0/636684684 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(50..50 src has 1..50) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f32f402ac10 con 0x22a7790 2023-10-06T03:02:50.866 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.861+0000 7f32da7fc700 1 -- 172.21.15.57:0/636684684 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f32f4020930 con 0x22a7790 2023-10-06T03:02:50.867 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.861+0000 7f3304736740 10 client.5610 fetch_fsmap learned FSMap version 31 2023-10-06T03:02:50.867 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.861+0000 7f3304736740 1 -- 172.21.15.57:0/636684684 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=2+}) v3 -- 0x23b8d80 con 0x22a7790 2023-10-06T03:02:50.867 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.861+0000 7f32da7fc700 1 -- 172.21.15.57:0/636684684 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32ec0594d0 con 0x22a7790 2023-10-06T03:02:50.867 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.861+0000 7f32da7fc700 1 -- 172.21.15.57:0/636684684 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 31) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f32f4020a90 con 0x22a7790 2023-10-06T03:02:50.867 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.861+0000 7f3304736740 10 client.5610 fetch_fsmap finished waiting for FSMap version 31 2023-10-06T03:02:50.867 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.861+0000 7f3304736740 10 client.5610 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T03:02:50.867 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.861+0000 7f3304736740 20 client.5610 populate_metadata read hostname 'smithi057' 2023-10-06T03:02:50.867 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.861+0000 7f3304736740 1 --2- 172.21.15.57:0/636684684 >> [v2:172.21.15.57:6835/4147766471,v1:172.21.15.57:6837/4147766471] conn(0x2539af0 0x253bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:50.867 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.861+0000 7f3304736740 4 client.5610 mds_command: new command op to 5433 tid=0[{"prefix": "status"}] 2023-10-06T03:02:50.867 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.861+0000 7f3304736740 1 -- 172.21.15.57:0/636684684 --> [v2:172.21.15.57:6835/4147766471,v1:172.21.15.57:6837/4147766471] -- command(tid 0: {"prefix": "status"}) v1 -- 0x23d8410 con 0x2539af0 2023-10-06T03:02:50.868 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.861+0000 7f32fbfff700 1 --2- 172.21.15.57:0/636684684 >> [v2:172.21.15.57:6835/4147766471,v1:172.21.15.57:6837/4147766471] conn(0x2539af0 0x253bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:50.868 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.865+0000 7f32fbfff700 1 --2- 172.21.15.57:0/636684684 >> [v2:172.21.15.57:6835/4147766471,v1:172.21.15.57:6837/4147766471] conn(0x2539af0 0x253bed0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ed6328e85ca2b9f server_cookie=a1b16e7c08d616e4 in_seq=0 out_seq=0 2023-10-06T03:02:50.868 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.865+0000 7f32da7fc700 10 client.5610 ms_handle_connect on v2:172.21.15.57:6835/4147766471 2023-10-06T03:02:50.869 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.865+0000 7f32da7fc700 1 -- 172.21.15.57:0/636684684 <== mds.0 v2:172.21.15.57:6835/4147766471 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x23d8410 con 0x2539af0 2023-10-06T03:02:50.869 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.865+0000 7f32da7fc700 10 client.5610 handle_command_reply: tid=0 2023-10-06T03:02:50.869 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.865+0000 7f3304736740 1 client.5610 shutdown 2023-10-06T03:02:50.869 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.865+0000 7f3304736740 1 -- 172.21.15.57:0/636684684 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x22a7790 msgr2=0x24bc380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:50.869 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.865+0000 7f3304736740 1 --2- 172.21.15.57:0/636684684 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x22a7790 0x24bc380 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f32f4013cc0 tx=0x7f32f4019000 comp rx=0 tx=0).stop 2023-10-06T03:02:50.869 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.865+0000 7f3304736740 1 -- 172.21.15.57:0/636684684 shutdown_connections 2023-10-06T03:02:50.869 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.865+0000 7f3304736740 1 --2- 172.21.15.57:0/636684684 >> [v2:172.21.15.57:6835/4147766471,v1:172.21.15.57:6837/4147766471] conn(0x2539af0 0x253bed0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:50.869 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.865+0000 7f3304736740 1 --2- 172.21.15.57:0/636684684 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x22a7790 0x24bc380 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:50.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.865+0000 7f3304736740 1 --2- 172.21.15.57:0/636684684 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x225cae0 0x24bbe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:50.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.865+0000 7f3304736740 1 --2- 172.21.15.57:0/636684684 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x225c710 0x24bb900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:50.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.865+0000 7f32da7fc700 0 client.5610 ms_handle_reset on v2:172.21.15.57:6835/4147766471 2023-10-06T03:02:50.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.865+0000 7f3304736740 1 -- 172.21.15.57:0/636684684 >> 172.21.15.57:0/636684684 conn(0x225ceb0 msgr2=0x24bfda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:50.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.865+0000 7f3304736740 1 -- 172.21.15.57:0/636684684 shutdown_connections 2023-10-06T03:02:50.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.865+0000 7f3304736740 1 -- 172.21.15.57:0/636684684 wait complete. 2023-10-06T03:02:50.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.865+0000 7f3304736740 20 client.5610 trim_cache size 0 max 16384 2023-10-06T03:02:50.870 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-10-06T03:02:50.870 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_fsid": "eb56dc0f-9213-41cb-9aad-8ade6c802e98", 2023-10-06T03:02:50.871 INFO:teuthology.orchestra.run.smithi057.stdout: "whoami": 0, 2023-10-06T03:02:50.871 INFO:teuthology.orchestra.run.smithi057.stdout: "id": 5433, 2023-10-06T03:02:50.871 INFO:teuthology.orchestra.run.smithi057.stdout: "want_state": "up:active", 2023-10-06T03:02:50.871 INFO:teuthology.orchestra.run.smithi057.stdout: "state": "up:active", 2023-10-06T03:02:50.871 INFO:teuthology.orchestra.run.smithi057.stdout: "fs_name": "cephfs", 2023-10-06T03:02:50.871 INFO:teuthology.orchestra.run.smithi057.stdout: "rank_uptime": 11.025523531999999, 2023-10-06T03:02:50.871 INFO:teuthology.orchestra.run.smithi057.stdout: "mdsmap_epoch": 31, 2023-10-06T03:02:50.871 INFO:teuthology.orchestra.run.smithi057.stdout: "osdmap_epoch": 50, 2023-10-06T03:02:50.871 INFO:teuthology.orchestra.run.smithi057.stdout: "osdmap_epoch_barrier": 50, 2023-10-06T03:02:50.871 INFO:teuthology.orchestra.run.smithi057.stdout: "uptime": 16.945914916 2023-10-06T03:02:50.871 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-10-06T03:02:50.872 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.865+0000 7f33024ae700 1 -- 172.21.15.57:0/697729264 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f32e8060580 msgr2=0x7f32e8062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:50.872 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.865+0000 7f33024ae700 1 --2- 172.21.15.57:0/697729264 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f32e8060580 0x7f32e8062a30 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f32fc153c90 tx=0x7f32f0008040 comp rx=0 tx=0).stop 2023-10-06T03:02:50.872 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.865+0000 7f33024ae700 1 -- 172.21.15.57:0/697729264 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f32fc0c8d40 msgr2=0x7f32fc14df60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:50.873 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.865+0000 7f33024ae700 1 --2- 172.21.15.57:0/697729264 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f32fc0c8d40 0x7f32fc14df60 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f32ec015000 tx=0x7f32ec016000 comp rx=0 tx=0).stop 2023-10-06T03:02:50.873 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.865+0000 7f33024ae700 1 -- 172.21.15.57:0/697729264 shutdown_connections 2023-10-06T03:02:50.873 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.865+0000 7f33024ae700 1 --2- 172.21.15.57:0/697729264 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f32fc1596c0 0x7f32fc0c25e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:50.873 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.865+0000 7f33024ae700 1 --2- 172.21.15.57:0/697729264 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f32fc0c9110 0x7f32fc0c20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:50.873 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.865+0000 7f33024ae700 1 --2- 172.21.15.57:0/697729264 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f32e8060580 0x7f32e8062a30 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:50.873 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.865+0000 7f33024ae700 1 --2- 172.21.15.57:0/697729264 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f32fc0c8d40 0x7f32fc14df60 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:50.873 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.865+0000 7f33024ae700 1 -- 172.21.15.57:0/697729264 >> 172.21.15.57:0/697729264 conn(0x7f32fc0c9860 msgr2=0x7f32fc0ca9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:50.873 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.865+0000 7f33024ae700 1 -- 172.21.15.57:0/697729264 shutdown_connections 2023-10-06T03:02:50.873 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:50.865+0000 7f33024ae700 1 -- 172.21.15.57:0/697729264 wait complete. 2023-10-06T03:02:50.892 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T03:02:51.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:51.057+0000 7fdb0f385700 1 Processor -- start 2023-10-06T03:02:51.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:51.057+0000 7fdb0f385700 1 -- start start 2023-10-06T03:02:51.061 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:51.057+0000 7fdb0f385700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fdb080671f0 0x7fdb080675c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:51.061 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:51.057+0000 7fdb0f385700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb0806deb0 0x7fdb080aff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:51.061 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:51.057+0000 7fdb0f385700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb0806da20 con 0x7fdb0806aac0 2023-10-06T03:02:51.061 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:51.057+0000 7fdb0f385700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb0806ce10 con 0x7fdb080671f0 2023-10-06T03:02:51.061 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:51.057+0000 7fdb0f385700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb0806d0f0 con 0x7fdb0806deb0 2023-10-06T03:02:51.062 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:51.057+0000 7fdb0d121700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fdb080671f0 0x7fdb080675c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:51.062 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:51.057+0000 7fdb0d121700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fdb080671f0 0x7fdb080675c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.57:40964/0 (socket says 172.21.15.57:40964) 2023-10-06T03:02:51.062 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:51.057+0000 7fdb0d121700 1 -- 172.21.15.57:0/848595352 learned_addr learned my addr 172.21.15.57:0/848595352 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:02:51.063 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:51.057+0000 7fdb0c920700 1 --2- 172.21.15.57:0/848595352 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb0806deb0 0x7fdb080aff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:51.064 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:51.061+0000 7fdb0d121700 1 -- 172.21.15.57:0/848595352 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb0806deb0 msgr2=0x7fdb080aff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:51.064 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:51.061+0000 7fdb0d121700 1 --2- 172.21.15.57:0/848595352 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb0806deb0 0x7fdb080aff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:51.064 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:51.061+0000 7fdb0d121700 1 -- 172.21.15.57:0/848595352 >> v1:172.21.15.105:6789/0 conn(0x7fdb0806aac0 legacy=0x7fdb0806af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:51.065 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:51.061+0000 7fdb0d121700 1 -- 172.21.15.57:0/848595352 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb0806d3d0 con 0x7fdb080671f0 2023-10-06T03:02:51.065 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:51.061+0000 7fdb0d121700 1 --2- 172.21.15.57:0/848595352 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdb080671f0 0x7fdb080675c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fdb040099b0 tx=0x7fdb04009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7ac51e695b8c8d2c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:51.065 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:51.061+0000 7fdafffff700 1 -- 172.21.15.57:0/848595352 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb04009ea0 con 0x7fdb080671f0 2023-10-06T03:02:51.065 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:51.061+0000 7fdafffff700 1 -- 172.21.15.57:0/848595352 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb0400b860 con 0x7fdb080671f0 2023-10-06T03:02:51.065 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:51.061+0000 7fdafffff700 1 -- 172.21.15.57:0/848595352 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb0400bc00 con 0x7fdb080671f0 2023-10-06T03:02:51.066 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:51.061+0000 7fdb0f385700 1 -- 172.21.15.57:0/848595352 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdb080671f0 msgr2=0x7fdb080675c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:51.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:51.061+0000 7fdb0f385700 1 --2- 172.21.15.57:0/848595352 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdb080671f0 0x7fdb080675c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fdb040099b0 tx=0x7fdb04009250 comp rx=0 tx=0).stop 2023-10-06T03:02:51.070 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:51.061+0000 7fdb0f385700 1 -- 172.21.15.57:0/848595352 shutdown_connections 2023-10-06T03:02:51.070 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:51.061+0000 7fdb0f385700 1 --2- 172.21.15.57:0/848595352 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb0806deb0 0x7fdb080aff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:51.070 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:51.061+0000 7fdb0f385700 1 --2- 172.21.15.57:0/848595352 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdb080671f0 0x7fdb080675c0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:51.070 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:51.061+0000 7fdb0f385700 1 -- 172.21.15.57:0/848595352 >> 172.21.15.57:0/848595352 conn(0x7fdb080cbdd0 msgr2=0x7fdb080cc1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:51.070 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:51.061+0000 7fdb0f385700 1 -- 172.21.15.57:0/848595352 shutdown_connections 2023-10-06T03:02:51.071 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:51.061+0000 7fdb0f385700 1 -- 172.21.15.57:0/848595352 wait complete. 2023-10-06T03:02:51.075 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:51.065+0000 7fdb0f385700 1 Processor -- start 2023-10-06T03:02:51.075 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:51.065+0000 7fdb0f385700 1 -- start start 2023-10-06T03:02:51.075 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:51.069+0000 7fdb0f385700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb080671f0 0x7fdb0814e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:51.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:51.069+0000 7fdb0f385700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdb0806aac0 0x7fdb08153310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:51.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:51.069+0000 7fdb0f385700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb0806deb0 0x7fdb0814d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:51.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:51.069+0000 7fdb0f385700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb0816d8c0 con 0x7fdb0806deb0 2023-10-06T03:02:51.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:51.069+0000 7fdb0f385700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb08153850 con 0x7fdb0806aac0 2023-10-06T03:02:51.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:51.069+0000 7fdb0f385700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb0814d620 con 0x7fdb080671f0 2023-10-06T03:02:51.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:51.069+0000 7fdb0d922700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb0806deb0 0x7fdb0814d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:51.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:51.069+0000 7fdb0d922700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb0806deb0 0x7fdb0814d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:59738/0 (socket says 172.21.15.57:59738) 2023-10-06T03:02:51.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:51.069+0000 7fdb0d922700 1 -- 172.21.15.57:0/3399769460 learned_addr learned my addr 172.21.15.57:0/3399769460 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:02:51.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:51.069+0000 7fdb0c920700 1 --2- 172.21.15.57:0/3399769460 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdb0806aac0 0x7fdb08153310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:51.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:51.069+0000 7fdb0d121700 1 --2- 172.21.15.57:0/3399769460 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb080671f0 0x7fdb0814e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:51.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:51.069+0000 7fdb0d922700 1 -- 172.21.15.57:0/3399769460 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb080671f0 msgr2=0x7fdb0814e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:51.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:51.069+0000 7fdb0d922700 1 --2- 172.21.15.57:0/3399769460 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb080671f0 0x7fdb0814e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:51.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:51.069+0000 7fdb0d922700 1 -- 172.21.15.57:0/3399769460 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdb0806aac0 msgr2=0x7fdb08153310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:51.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:51.069+0000 7fdb0d922700 1 --2- 172.21.15.57:0/3399769460 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdb0806aac0 0x7fdb08153310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:51.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:51.069+0000 7fdb0d922700 1 -- 172.21.15.57:0/3399769460 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb040094f0 con 0x7fdb0806deb0 2023-10-06T03:02:51.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:51.069+0000 7fdb0c920700 1 --2- 172.21.15.57:0/3399769460 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdb0806aac0 0x7fdb08153310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:02:51.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:51.069+0000 7fdb0d922700 1 --2- 172.21.15.57:0/3399769460 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb0806deb0 0x7fdb0814d0e0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fdb0000c910 tx=0x7fdb000016d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:51.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:51.069+0000 7fdafd7fa700 1 -- 172.21.15.57:0/3399769460 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb00012630 con 0x7fdb0806deb0 2023-10-06T03:02:51.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:51.069+0000 7fdafd7fa700 1 -- 172.21.15.57:0/3399769460 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb000127b0 con 0x7fdb0806deb0 2023-10-06T03:02:51.079 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:51.069+0000 7fdafd7fa700 1 -- 172.21.15.57:0/3399769460 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb00012b70 con 0x7fdb0806deb0 2023-10-06T03:02:51.079 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:51.069+0000 7fdb0f385700 1 -- 172.21.15.57:0/3399769460 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb0814efb0 con 0x7fdb0806deb0 2023-10-06T03:02:51.079 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:51.069+0000 7fdb0f385700 1 -- 172.21.15.57:0/3399769460 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb0814f570 con 0x7fdb0806deb0 2023-10-06T03:02:51.079 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:51.073+0000 7fdb0f385700 1 -- 172.21.15.57:0/3399769460 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb0816da30 con 0x7fdb0806deb0 2023-10-06T03:02:51.080 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:51.073+0000 7fdafd7fa700 1 -- 172.21.15.57:0/3399769460 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fdb00003030 con 0x7fdb0806deb0 2023-10-06T03:02:51.080 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:51.073+0000 7fdafd7fa700 1 --2- 172.21.15.57:0/3399769460 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fdaec060550 0x7fdaec062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:51.080 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:51.077+0000 7fdafd7fa700 1 -- 172.21.15.57:0/3399769460 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fdb0007c8f0 con 0x7fdb0806deb0 2023-10-06T03:02:51.081 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:51.077+0000 7fdb0d121700 1 --2- 172.21.15.57:0/3399769460 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fdaec060550 0x7fdaec062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:51.081 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:51.077+0000 7fdb0d121700 1 --2- 172.21.15.57:0/3399769460 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fdaec060550 0x7fdaec062a00 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fdb040099b0 tx=0x7fdb04017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:51.085 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:51.081+0000 7fdafd7fa700 1 -- 172.21.15.57:0/3399769460 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fdb0004cce0 con 0x7fdb0806deb0 2023-10-06T03:02:51.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:51.293+0000 7fdb0f385700 1 -- 172.21.15.57:0/3399769460 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fdb080712e0 con 0x7fdb0806deb0 2023-10-06T03:02:51.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:51.293+0000 7fdafd7fa700 1 -- 172.21.15.57:0/3399769460 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v31) v1 ==== 53+0+73 (secure 0 0 0) 0x7fdb00050300 con 0x7fdb0806deb0 2023-10-06T03:02:51.297 INFO:teuthology.orchestra.run.smithi057.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T03:02:51.300 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:51.297+0000 7fdb0f385700 1 -- 172.21.15.57:0/3399769460 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fdaec060550 msgr2=0x7fdaec062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:51.301 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:51.297+0000 7fdb0f385700 1 --2- 172.21.15.57:0/3399769460 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fdaec060550 0x7fdaec062a00 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fdb040099b0 tx=0x7fdb04017000 comp rx=0 tx=0).stop 2023-10-06T03:02:51.301 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:51.297+0000 7fdb0f385700 1 -- 172.21.15.57:0/3399769460 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb0806deb0 msgr2=0x7fdb0814d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:51.301 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:51.297+0000 7fdb0f385700 1 --2- 172.21.15.57:0/3399769460 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb0806deb0 0x7fdb0814d0e0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fdb0000c910 tx=0x7fdb000016d0 comp rx=0 tx=0).stop 2023-10-06T03:02:51.301 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:51.297+0000 7fdb0f385700 1 -- 172.21.15.57:0/3399769460 shutdown_connections 2023-10-06T03:02:51.301 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:51.297+0000 7fdb0f385700 1 --2- 172.21.15.57:0/3399769460 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb0806deb0 0x7fdb0814d0e0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:51.301 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:51.297+0000 7fdb0f385700 1 --2- 172.21.15.57:0/3399769460 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdb0806aac0 0x7fdb08153310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:51.302 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:51.297+0000 7fdb0f385700 1 --2- 172.21.15.57:0/3399769460 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fdaec060550 0x7fdaec062a00 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:51.302 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:51.297+0000 7fdb0f385700 1 --2- 172.21.15.57:0/3399769460 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb080671f0 0x7fdb0814e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:51.302 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:51.297+0000 7fdb0f385700 1 -- 172.21.15.57:0/3399769460 >> 172.21.15.57:0/3399769460 conn(0x7fdb080cbdd0 msgr2=0x7fdb0815a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:51.302 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:51.297+0000 7fdb0f385700 1 -- 172.21.15.57:0/3399769460 shutdown_connections 2023-10-06T03:02:51.302 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:51.297+0000 7fdb0f385700 1 -- 172.21.15.57:0/3399769460 wait complete. 2023-10-06T03:02:51.321 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-06T03:02:51.321 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T03:02:51.321 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi057.front.sepia.ceph.com 2023-10-06T03:02:51.321 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T03:02:51.321 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T03:02:51.322 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-06T03:02:51.322 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-06T03:02:51.322 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T03:02:51.322 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T03:02:51.322 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:02:51.322 DEBUG:teuthology.orchestra.run.smithi057:> ip addr 2023-10-06T03:02:51.341 INFO:teuthology.orchestra.run.smithi057.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T03:02:51.341 INFO:teuthology.orchestra.run.smithi057.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T03:02:51.341 INFO:teuthology.orchestra.run.smithi057.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T03:02:51.341 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:02:51.341 INFO:teuthology.orchestra.run.smithi057.stdout: inet6 ::1/128 scope host 2023-10-06T03:02:51.341 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:02:51.342 INFO:teuthology.orchestra.run.smithi057.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-06T03:02:51.342 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether 0c:c4:7a:6b:ff:86 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:02:51.342 INFO:teuthology.orchestra.run.smithi057.stdout: altname enp7s0f0 2023-10-06T03:02:51.342 INFO:teuthology.orchestra.run.smithi057.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-06T03:02:51.342 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether 0c:c4:7a:6b:ff:87 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:02:51.342 INFO:teuthology.orchestra.run.smithi057.stdout: altname enp7s0f1 2023-10-06T03:02:51.342 INFO:teuthology.orchestra.run.smithi057.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T03:02:51.342 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether 0c:c4:7a:bd:15:62 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:02:51.342 INFO:teuthology.orchestra.run.smithi057.stdout: altname enp1s0f0 2023-10-06T03:02:51.342 INFO:teuthology.orchestra.run.smithi057.stdout: inet 172.21.15.57/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-10-06T03:02:51.343 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft 42313sec preferred_lft 42313sec 2023-10-06T03:02:51.343 INFO:teuthology.orchestra.run.smithi057.stdout: inet6 fe80::ec4:7aff:febd:1562/64 scope link 2023-10-06T03:02:51.343 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:02:51.343 INFO:teuthology.orchestra.run.smithi057.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-06T03:02:51.343 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether 0c:c4:7a:bd:15:63 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:02:51.343 INFO:teuthology.orchestra.run.smithi057.stdout: altname enp1s0f1 2023-10-06T03:02:51.343 INFO:teuthology.orchestra.run.smithi057.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-06T03:02:51.343 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether 02:42:3c:a1:4c:1b brd ff:ff:ff:ff:ff:ff 2023-10-06T03:02:51.343 INFO:teuthology.orchestra.run.smithi057.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-06T03:02:51.343 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:02:51.343 INFO:teuthology.orchestra.run.smithi057.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T03:02:51.343 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether 0a:8c:35:a4:dd:f1 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:02:51.343 INFO:teuthology.orchestra.run.smithi057.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T03:02:51.344 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:02:51.344 INFO:teuthology.orchestra.run.smithi057.stdout: inet6 fe80::581d:6bff:fe09:33c7/64 scope link 2023-10-06T03:02:51.344 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:02:51.344 INFO:teuthology.orchestra.run.smithi057.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T03:02:51.344 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether 0a:8c:35:a4:dd:f1 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T03:02:51.344 INFO:teuthology.orchestra.run.smithi057.stdout: inet6 fe80::88c:35ff:fea4:ddf1/64 scope link 2023-10-06T03:02:51.344 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:02:51.344 INFO:teuthology.orchestra.run.smithi057.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T03:02:51.344 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether 26:13:92:42:22:14 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T03:02:51.344 INFO:teuthology.orchestra.run.smithi057.stdout: inet6 fe80::2413:92ff:fe42:2214/64 scope link 2023-10-06T03:02:51.344 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:02:51.345 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:02:51.345 DEBUG:teuthology.orchestra.run.smithi057:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T03:02:51.428 INFO:teuthology.orchestra.run.smithi057.stdout:1 2023-10-06T03:02:51.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:02:51.432 DEBUG:teuthology.orchestra.run.smithi057:> route 2023-10-06T03:02:51.495 INFO:teuthology.orchestra.run.smithi057.stdout:Kernel IP routing table 2023-10-06T03:02:51.495 INFO:teuthology.orchestra.run.smithi057.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T03:02:51.495 INFO:teuthology.orchestra.run.smithi057.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-10-06T03:02:51.496 INFO:teuthology.orchestra.run.smithi057.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-06T03:02:51.496 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-10-06T03:02:51.496 INFO:teuthology.orchestra.run.smithi057.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T03:02:51.497 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:02:51.497 DEBUG:teuthology.orchestra.run.smithi057:> (cd / && exec bash -c ' 2023-10-06T03:02:51.497 DEBUG:teuthology.orchestra.run.smithi057:> set -e 2023-10-06T03:02:51.497 DEBUG:teuthology.orchestra.run.smithi057:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-06T03:02:51.497 DEBUG:teuthology.orchestra.run.smithi057:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-06T03:02:51.497 DEBUG:teuthology.orchestra.run.smithi057:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-06T03:02:51.497 DEBUG:teuthology.orchestra.run.smithi057:> ') 2023-10-06T03:02:51.628 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:02:51.628 DEBUG:teuthology.orchestra.run.smithi057:> ip netns list 2023-10-06T03:02:51.645 INFO:teuthology.orchestra.run.smithi057.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T03:02:51.645 INFO:teuthology.orchestra.run.smithi057.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T03:02:51.646 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T03:02:51.646 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:02:51.646 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip link set brx.0 up 2023-10-06T03:02:51.720 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:02:51.720 DEBUG:teuthology.orchestra.run.smithi057:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T03:02:51.780 INFO:teuthology.orchestra.run.smithi057.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T03:02:51.781 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:02:51.781 DEBUG:teuthology.orchestra.run.smithi057:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T03:02:51.840 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-06T03:02:51.840 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T03:02:51.840 DEBUG:teuthology.orchestra.run.smithi057:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-06T03:02:51.965 INFO:teuthology.orchestra.run.smithi057.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-06T03:02:51.965 INFO:teuthology.orchestra.run.smithi057.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-06T03:02:51.965 INFO:teuthology.orchestra.run.smithi057.stdout:invalid new device string format 2023-10-06T03:02:51.992 INFO:teuthology.orchestra.run.smithi057.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-06T03:02:51.992 INFO:teuthology.orchestra.run.smithi057.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-06T03:02:51.992 INFO:teuthology.orchestra.run.smithi057.stdout:invalid new device string format 2023-10-06T03:02:51.992 INFO:teuthology.orchestra.run.smithi057.stdout:mount.ceph: resolved to: "172.21.15.57:3300,172.21.15.105:3300,172.21.15.105:3301" 2023-10-06T03:02:51.992 INFO:teuthology.orchestra.run.smithi057.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T03:02:52.006 INFO:teuthology.orchestra.run.smithi057.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-06T03:02:52.007 INFO:teuthology.orchestra.run.smithi057.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-06T03:02:52.007 INFO:teuthology.orchestra.run.smithi057.stdout:invalid new device string format 2023-10-06T03:02:52.007 INFO:teuthology.orchestra.run.smithi057.stdout:mount.ceph: resolved to: "172.21.15.57:3300,172.21.15.105:3300,172.21.15.105:3301" 2023-10-06T03:02:52.007 INFO:teuthology.orchestra.run.smithi057.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T03:02:52.007 INFO:teuthology.orchestra.run.smithi057.stdout:mount.ceph: resolved to: "172.21.15.57:6789,172.21.15.105:6789,172.21.15.105:6790" 2023-10-06T03:02:52.007 INFO:teuthology.orchestra.run.smithi057.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.57:6789,172.21.15.105:6789,172.21.15.105:6790:/ 2023-10-06T03:02:52.007 INFO:teuthology.orchestra.run.smithi057.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=eb56dc0f-9213-41cb-9aad-8ade6c802e98" will pass to kernel 2023-10-06T03:02:52.013 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T03:02:52.013 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:02:52.013 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T03:02:52.046 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-06T03:02:52.096 DEBUG:teuthology.orchestra.run.smithi105:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-06T03:02:52.174 INFO:teuthology.orchestra.run.smithi057.stdout:[global] 2023-10-06T03:02:52.175 INFO:teuthology.orchestra.run.smithi057.stdout: chdir = "" 2023-10-06T03:02:52.175 INFO:teuthology.orchestra.run.smithi057.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-06T03:02:52.175 INFO:teuthology.orchestra.run.smithi057.stdout: auth supported = cephx 2023-10-06T03:02:52.175 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:02:52.175 INFO:teuthology.orchestra.run.smithi057.stdout: filestore xattr use omap = true 2023-10-06T03:02:52.175 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:02:52.175 INFO:teuthology.orchestra.run.smithi057.stdout: mon clock drift allowed = 1.000 2023-10-06T03:02:52.175 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:02:52.175 INFO:teuthology.orchestra.run.smithi057.stdout: osd crush chooseleaf type = 0 2023-10-06T03:02:52.175 INFO:teuthology.orchestra.run.smithi057.stdout: auth debug = true 2023-10-06T03:02:52.176 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:02:52.176 INFO:teuthology.orchestra.run.smithi057.stdout: ms die on old message = true 2023-10-06T03:02:52.176 INFO:teuthology.orchestra.run.smithi057.stdout: ms die on bug = true 2023-10-06T03:02:52.176 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:02:52.176 INFO:teuthology.orchestra.run.smithi057.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-06T03:02:52.176 INFO:teuthology.orchestra.run.smithi057.stdout: mon pg warn max object skew = 0 2023-10-06T03:02:52.176 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:02:52.176 INFO:teuthology.orchestra.run.smithi057.stdout: # disable pg_autoscaler by default for new pools 2023-10-06T03:02:52.176 INFO:teuthology.orchestra.run.smithi057.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-06T03:02:52.176 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:02:52.176 INFO:teuthology.orchestra.run.smithi057.stdout: osd pool default size = 2 2023-10-06T03:02:52.176 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:02:52.177 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd allow primary affinity = true 2023-10-06T03:02:52.177 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd allow pg remap = true 2023-10-06T03:02:52.177 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on legacy crush tunables = false 2023-10-06T03:02:52.177 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on crush straw calc version zero = false 2023-10-06T03:02:52.177 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on no sortbitwise = false 2023-10-06T03:02:52.177 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on osd down out interval zero = false 2023-10-06T03:02:52.177 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on too few osds = false 2023-10-06T03:02:52.177 INFO:teuthology.orchestra.run.smithi057.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-06T03:02:52.177 INFO:teuthology.orchestra.run.smithi057.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-06T03:02:52.177 INFO:teuthology.orchestra.run.smithi057.stdout: mon_allow_pool_size_one = true 2023-10-06T03:02:52.177 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:02:52.177 INFO:teuthology.orchestra.run.smithi057.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-06T03:02:52.178 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:02:52.178 INFO:teuthology.orchestra.run.smithi057.stdout: osd default data pool replay window = 5 2023-10-06T03:02:52.178 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:02:52.178 INFO:teuthology.orchestra.run.smithi057.stdout: mon allow pool delete = true 2023-10-06T03:02:52.178 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:02:52.178 INFO:teuthology.orchestra.run.smithi057.stdout: mon cluster log file level = debug 2023-10-06T03:02:52.178 INFO:teuthology.orchestra.run.smithi057.stdout: debug asserts on shutdown = true 2023-10-06T03:02:52.179 INFO:teuthology.orchestra.run.smithi057.stdout: mon health detail to clog = false 2023-10-06T03:02:52.179 INFO:teuthology.orchestra.run.smithi057.stdout: mon host = "172.21.15.57,172.21.15.105,[v2:172.21.15.105:3301,v1:172.21.15.105:6790]" 2023-10-06T03:02:52.179 INFO:teuthology.orchestra.run.smithi057.stdout: ms die on skipped message = False 2023-10-06T03:02:52.179 INFO:teuthology.orchestra.run.smithi057.stdout: fsid = eb56dc0f-9213-41cb-9aad-8ade6c802e98 2023-10-06T03:02:52.179 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:02:52.179 INFO:teuthology.orchestra.run.smithi057.stdout:[osd] 2023-10-06T03:02:52.179 INFO:teuthology.orchestra.run.smithi057.stdout: osd journal size = 100 2023-10-06T03:02:52.179 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:02:52.179 INFO:teuthology.orchestra.run.smithi057.stdout: osd scrub load threshold = 5.0 2023-10-06T03:02:52.179 INFO:teuthology.orchestra.run.smithi057.stdout: osd scrub max interval = 600 2023-10-06T03:02:52.180 INFO:teuthology.orchestra.run.smithi057.stdout: osd mclock profile = high_recovery_ops 2023-10-06T03:02:52.180 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:02:52.180 INFO:teuthology.orchestra.run.smithi057.stdout: osd recover clone overlap = true 2023-10-06T03:02:52.180 INFO:teuthology.orchestra.run.smithi057.stdout: osd recovery max chunk = 1048576 2023-10-06T03:02:52.180 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:02:52.180 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug shutdown = true 2023-10-06T03:02:52.180 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug op order = true 2023-10-06T03:02:52.180 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug verify stray on activate = true 2023-10-06T03:02:52.180 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:02:52.180 INFO:teuthology.orchestra.run.smithi057.stdout: osd open classes on start = true 2023-10-06T03:02:52.180 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug pg log writeout = true 2023-10-06T03:02:52.180 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:02:52.181 INFO:teuthology.orchestra.run.smithi057.stdout: osd deep scrub update digest min age = 30 2023-10-06T03:02:52.181 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:02:52.181 INFO:teuthology.orchestra.run.smithi057.stdout: osd map max advance = 10 2023-10-06T03:02:52.181 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:02:52.181 INFO:teuthology.orchestra.run.smithi057.stdout: journal zero on create = true 2023-10-06T03:02:52.181 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:02:52.181 INFO:teuthology.orchestra.run.smithi057.stdout: filestore ondisk finisher threads = 3 2023-10-06T03:02:52.181 INFO:teuthology.orchestra.run.smithi057.stdout: filestore apply finisher threads = 3 2023-10-06T03:02:52.181 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:02:52.181 INFO:teuthology.orchestra.run.smithi057.stdout: bdev debug aio = true 2023-10-06T03:02:52.181 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug misdirected ops = true 2023-10-06T03:02:52.182 INFO:teuthology.orchestra.run.smithi057.stdout: bdev async discard = True 2023-10-06T03:02:52.182 INFO:teuthology.orchestra.run.smithi057.stdout: bdev enable discard = True 2023-10-06T03:02:52.182 INFO:teuthology.orchestra.run.smithi057.stdout: bluestore allocator = bitmap 2023-10-06T03:02:52.182 INFO:teuthology.orchestra.run.smithi057.stdout: bluestore block size = 96636764160 2023-10-06T03:02:52.182 INFO:teuthology.orchestra.run.smithi057.stdout: bluestore fsck on mount = True 2023-10-06T03:02:52.182 INFO:teuthology.orchestra.run.smithi057.stdout: debug bluefs = 1/20 2023-10-06T03:02:52.182 INFO:teuthology.orchestra.run.smithi057.stdout: debug bluestore = 1/20 2023-10-06T03:02:52.182 INFO:teuthology.orchestra.run.smithi057.stdout: debug ms = 1 2023-10-06T03:02:52.182 INFO:teuthology.orchestra.run.smithi057.stdout: debug osd = 20 2023-10-06T03:02:52.182 INFO:teuthology.orchestra.run.smithi057.stdout: debug rocksdb = 4/10 2023-10-06T03:02:52.182 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd backfillfull_ratio = 0.85 2023-10-06T03:02:52.182 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd full ratio = 0.9 2023-10-06T03:02:52.183 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd nearfull ratio = 0.8 2023-10-06T03:02:52.183 INFO:teuthology.orchestra.run.smithi057.stdout: osd failsafe full ratio = 0.95 2023-10-06T03:02:52.183 INFO:teuthology.orchestra.run.smithi057.stdout: osd objectstore = bluestore 2023-10-06T03:02:52.183 INFO:teuthology.orchestra.run.smithi057.stdout: osd op complaint time = 180 2023-10-06T03:02:52.183 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:02:52.183 INFO:teuthology.orchestra.run.smithi057.stdout:[mgr] 2023-10-06T03:02:52.183 INFO:teuthology.orchestra.run.smithi057.stdout: debug ms = 1 2023-10-06T03:02:52.183 INFO:teuthology.orchestra.run.smithi057.stdout: debug mgr = 20 2023-10-06T03:02:52.183 INFO:teuthology.orchestra.run.smithi057.stdout: debug mon = 20 2023-10-06T03:02:52.183 INFO:teuthology.orchestra.run.smithi057.stdout: debug auth = 20 2023-10-06T03:02:52.183 INFO:teuthology.orchestra.run.smithi057.stdout: mon reweight min pgs per osd = 4 2023-10-06T03:02:52.183 INFO:teuthology.orchestra.run.smithi057.stdout: mon reweight min bytes per osd = 10 2023-10-06T03:02:52.184 INFO:teuthology.orchestra.run.smithi057.stdout: mgr/telemetry/nag = false 2023-10-06T03:02:52.184 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:02:52.184 INFO:teuthology.orchestra.run.smithi057.stdout:[mon] 2023-10-06T03:02:52.184 INFO:teuthology.orchestra.run.smithi057.stdout: debug ms = 1 2023-10-06T03:02:52.184 INFO:teuthology.orchestra.run.smithi057.stdout: debug mon = 20 2023-10-06T03:02:52.184 INFO:teuthology.orchestra.run.smithi057.stdout: debug paxos = 20 2023-10-06T03:02:52.184 INFO:teuthology.orchestra.run.smithi057.stdout: debug auth = 20 2023-10-06T03:02:52.184 INFO:teuthology.orchestra.run.smithi057.stdout: mon data avail warn = 5 2023-10-06T03:02:52.184 INFO:teuthology.orchestra.run.smithi057.stdout: mon mgr mkfs grace = 240 2023-10-06T03:02:52.184 INFO:teuthology.orchestra.run.smithi057.stdout: mon reweight min pgs per osd = 4 2023-10-06T03:02:52.184 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd reporter subtree level = osd 2023-10-06T03:02:52.184 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd prime pg temp = true 2023-10-06T03:02:52.184 INFO:teuthology.orchestra.run.smithi057.stdout: mon reweight min bytes per osd = 10 2023-10-06T03:02:52.185 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:02:52.185 INFO:teuthology.orchestra.run.smithi057.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-06T03:02:52.185 INFO:teuthology.orchestra.run.smithi057.stdout: auth mon ticket ttl = 660 # 11m 2023-10-06T03:02:52.185 INFO:teuthology.orchestra.run.smithi057.stdout: auth service ticket ttl = 240 # 4m 2023-10-06T03:02:52.185 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:02:52.185 INFO:teuthology.orchestra.run.smithi057.stdout: # don't complain about insecure global_id in the test suite 2023-10-06T03:02:52.185 INFO:teuthology.orchestra.run.smithi057.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-06T03:02:52.185 INFO:teuthology.orchestra.run.smithi057.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-06T03:02:52.185 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:02:52.185 INFO:teuthology.orchestra.run.smithi057.stdout: # 1m isn't quite enough 2023-10-06T03:02:52.185 INFO:teuthology.orchestra.run.smithi057.stdout: mon_down_mkfs_grace = 2m 2023-10-06T03:02:52.185 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:02:52.186 INFO:teuthology.orchestra.run.smithi057.stdout: mon_warn_on_filestore_osds = false 2023-10-06T03:02:52.186 INFO:teuthology.orchestra.run.smithi057.stdout: mon op complaint time = 120 2023-10-06T03:02:52.186 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:02:52.186 INFO:teuthology.orchestra.run.smithi057.stdout:[client] 2023-10-06T03:02:52.186 INFO:teuthology.orchestra.run.smithi057.stdout: rgw cache enabled = true 2023-10-06T03:02:52.186 INFO:teuthology.orchestra.run.smithi057.stdout: rgw enable ops log = true 2023-10-06T03:02:52.186 INFO:teuthology.orchestra.run.smithi057.stdout: rgw enable usage log = true 2023-10-06T03:02:52.186 INFO:teuthology.orchestra.run.smithi057.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-06T03:02:52.186 INFO:teuthology.orchestra.run.smithi057.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-06T03:02:52.186 INFO:teuthology.orchestra.run.smithi057.stdout: client mount timeout = 600 2023-10-06T03:02:52.186 INFO:teuthology.orchestra.run.smithi057.stdout: debug client = 20 2023-10-06T03:02:52.186 INFO:teuthology.orchestra.run.smithi057.stdout: debug ms = 1 2023-10-06T03:02:52.187 INFO:teuthology.orchestra.run.smithi057.stdout: pid file = "" 2023-10-06T03:02:52.187 INFO:teuthology.orchestra.run.smithi057.stdout: rados mon op timeout = 900 2023-10-06T03:02:52.187 INFO:teuthology.orchestra.run.smithi057.stdout: rados osd op timeout = 900 2023-10-06T03:02:52.187 INFO:teuthology.orchestra.run.smithi057.stdout:[mon.a] 2023-10-06T03:02:52.187 INFO:teuthology.orchestra.run.smithi057.stdout:[mon.b] 2023-10-06T03:02:52.187 INFO:teuthology.orchestra.run.smithi057.stdout:[mon.c] 2023-10-06T03:02:52.187 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.a] 2023-10-06T03:02:52.187 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.c] 2023-10-06T03:02:52.187 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.b] 2023-10-06T03:02:52.187 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.d] 2023-10-06T03:02:52.187 INFO:teuthology.orchestra.run.smithi057.stdout:[mds] 2023-10-06T03:02:52.187 INFO:teuthology.orchestra.run.smithi057.stdout: debug mds = 20 2023-10-06T03:02:52.187 INFO:teuthology.orchestra.run.smithi057.stdout: debug ms = 1 2023-10-06T03:02:52.188 INFO:teuthology.orchestra.run.smithi057.stdout: mds debug frag = True 2023-10-06T03:02:52.188 INFO:teuthology.orchestra.run.smithi057.stdout: mds debug scatterstat = True 2023-10-06T03:02:52.188 INFO:teuthology.orchestra.run.smithi057.stdout: mds op complaint time = 180 2023-10-06T03:02:52.188 INFO:teuthology.orchestra.run.smithi057.stdout: mds verify scatter = True 2023-10-06T03:02:52.188 INFO:teuthology.orchestra.run.smithi057.stdout: osd op complaint time = 180 2023-10-06T03:02:52.188 INFO:teuthology.orchestra.run.smithi057.stdout: rados mon op timeout = 900 2023-10-06T03:02:52.188 INFO:teuthology.orchestra.run.smithi057.stdout: rados osd op timeout = 900 2023-10-06T03:02:52.188 INFO:teuthology.orchestra.run.smithi057.stdout: osd_deep_scrub_large_omap_object_key_threshold = 1 2023-10-06T03:02:52.189 INFO:teuthology.orchestra.run.smithi105.stdout:[global] 2023-10-06T03:02:52.189 INFO:teuthology.orchestra.run.smithi105.stdout: chdir = "" 2023-10-06T03:02:52.189 INFO:teuthology.orchestra.run.smithi105.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-06T03:02:52.189 INFO:teuthology.orchestra.run.smithi105.stdout: auth supported = cephx 2023-10-06T03:02:52.189 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:02:52.189 INFO:teuthology.orchestra.run.smithi105.stdout: filestore xattr use omap = true 2023-10-06T03:02:52.189 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:02:52.189 INFO:teuthology.orchestra.run.smithi105.stdout: mon clock drift allowed = 1.000 2023-10-06T03:02:52.189 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:02:52.189 INFO:teuthology.orchestra.run.smithi105.stdout: osd crush chooseleaf type = 0 2023-10-06T03:02:52.189 INFO:teuthology.orchestra.run.smithi105.stdout: auth debug = true 2023-10-06T03:02:52.190 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:02:52.190 INFO:teuthology.orchestra.run.smithi105.stdout: ms die on old message = true 2023-10-06T03:02:52.190 INFO:teuthology.orchestra.run.smithi105.stdout: ms die on bug = true 2023-10-06T03:02:52.190 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:02:52.190 INFO:teuthology.orchestra.run.smithi105.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-06T03:02:52.190 INFO:teuthology.orchestra.run.smithi105.stdout: mon pg warn max object skew = 0 2023-10-06T03:02:52.190 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:02:52.190 INFO:teuthology.orchestra.run.smithi105.stdout: # disable pg_autoscaler by default for new pools 2023-10-06T03:02:52.190 INFO:teuthology.orchestra.run.smithi105.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-06T03:02:52.190 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:02:52.190 INFO:teuthology.orchestra.run.smithi105.stdout: osd pool default size = 2 2023-10-06T03:02:52.191 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:02:52.191 INFO:teuthology.orchestra.run.smithi105.stdout: mon osd allow primary affinity = true 2023-10-06T03:02:52.191 INFO:teuthology.orchestra.run.smithi105.stdout: mon osd allow pg remap = true 2023-10-06T03:02:52.191 INFO:teuthology.orchestra.run.smithi105.stdout: mon warn on legacy crush tunables = false 2023-10-06T03:02:52.191 INFO:teuthology.orchestra.run.smithi105.stdout: mon warn on crush straw calc version zero = false 2023-10-06T03:02:52.191 INFO:teuthology.orchestra.run.smithi105.stdout: mon warn on no sortbitwise = false 2023-10-06T03:02:52.191 INFO:teuthology.orchestra.run.smithi105.stdout: mon warn on osd down out interval zero = false 2023-10-06T03:02:52.191 INFO:teuthology.orchestra.run.smithi105.stdout: mon warn on too few osds = false 2023-10-06T03:02:52.191 INFO:teuthology.orchestra.run.smithi105.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-06T03:02:52.191 INFO:teuthology.orchestra.run.smithi105.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-06T03:02:52.191 INFO:teuthology.orchestra.run.smithi105.stdout: mon_allow_pool_size_one = true 2023-10-06T03:02:52.191 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:02:52.192 INFO:teuthology.orchestra.run.smithi105.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-06T03:02:52.192 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:02:52.192 INFO:teuthology.orchestra.run.smithi105.stdout: osd default data pool replay window = 5 2023-10-06T03:02:52.192 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:02:52.192 INFO:teuthology.orchestra.run.smithi105.stdout: mon allow pool delete = true 2023-10-06T03:02:52.192 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:02:52.192 INFO:teuthology.orchestra.run.smithi105.stdout: mon cluster log file level = debug 2023-10-06T03:02:52.192 INFO:teuthology.orchestra.run.smithi105.stdout: debug asserts on shutdown = true 2023-10-06T03:02:52.192 INFO:teuthology.orchestra.run.smithi105.stdout: mon health detail to clog = false 2023-10-06T03:02:52.192 INFO:teuthology.orchestra.run.smithi105.stdout: mon host = "172.21.15.57,172.21.15.105,[v2:172.21.15.105:3301,v1:172.21.15.105:6790]" 2023-10-06T03:02:52.193 INFO:teuthology.orchestra.run.smithi105.stdout: ms die on skipped message = False 2023-10-06T03:02:52.193 INFO:teuthology.orchestra.run.smithi105.stdout: fsid = eb56dc0f-9213-41cb-9aad-8ade6c802e98 2023-10-06T03:02:52.193 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:02:52.193 INFO:teuthology.orchestra.run.smithi105.stdout:[osd] 2023-10-06T03:02:52.193 INFO:teuthology.orchestra.run.smithi105.stdout: osd journal size = 100 2023-10-06T03:02:52.193 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:02:52.193 INFO:teuthology.orchestra.run.smithi105.stdout: osd scrub load threshold = 5.0 2023-10-06T03:02:52.193 INFO:teuthology.orchestra.run.smithi105.stdout: osd scrub max interval = 600 2023-10-06T03:02:52.193 INFO:teuthology.orchestra.run.smithi105.stdout: osd mclock profile = high_recovery_ops 2023-10-06T03:02:52.193 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:02:52.193 INFO:teuthology.orchestra.run.smithi105.stdout: osd recover clone overlap = true 2023-10-06T03:02:52.194 INFO:teuthology.orchestra.run.smithi105.stdout: osd recovery max chunk = 1048576 2023-10-06T03:02:52.194 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:02:52.194 INFO:teuthology.orchestra.run.smithi105.stdout: osd debug shutdown = true 2023-10-06T03:02:52.194 INFO:teuthology.orchestra.run.smithi105.stdout: osd debug op order = true 2023-10-06T03:02:52.194 INFO:teuthology.orchestra.run.smithi105.stdout: osd debug verify stray on activate = true 2023-10-06T03:02:52.194 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:02:52.194 INFO:teuthology.orchestra.run.smithi105.stdout: osd open classes on start = true 2023-10-06T03:02:52.194 INFO:teuthology.orchestra.run.smithi105.stdout: osd debug pg log writeout = true 2023-10-06T03:02:52.194 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:02:52.194 INFO:teuthology.orchestra.run.smithi105.stdout: osd deep scrub update digest min age = 30 2023-10-06T03:02:52.194 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:02:52.195 INFO:teuthology.orchestra.run.smithi105.stdout: osd map max advance = 10 2023-10-06T03:02:52.195 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:02:52.195 INFO:teuthology.orchestra.run.smithi105.stdout: journal zero on create = true 2023-10-06T03:02:52.195 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:02:52.196 INFO:teuthology.orchestra.run.smithi105.stdout: filestore ondisk finisher threads = 3 2023-10-06T03:02:52.196 INFO:teuthology.orchestra.run.smithi105.stdout: filestore apply finisher threads = 3 2023-10-06T03:02:52.196 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:02:52.196 INFO:teuthology.orchestra.run.smithi105.stdout: bdev debug aio = true 2023-10-06T03:02:52.197 INFO:teuthology.orchestra.run.smithi105.stdout: osd debug misdirected ops = true 2023-10-06T03:02:52.197 INFO:teuthology.orchestra.run.smithi105.stdout: bdev async discard = True 2023-10-06T03:02:52.197 INFO:teuthology.orchestra.run.smithi105.stdout: bdev enable discard = True 2023-10-06T03:02:52.197 INFO:teuthology.orchestra.run.smithi105.stdout: bluestore allocator = bitmap 2023-10-06T03:02:52.197 INFO:teuthology.orchestra.run.smithi105.stdout: bluestore block size = 96636764160 2023-10-06T03:02:52.197 INFO:teuthology.orchestra.run.smithi105.stdout: bluestore fsck on mount = True 2023-10-06T03:02:52.197 INFO:teuthology.orchestra.run.smithi105.stdout: debug bluefs = 1/20 2023-10-06T03:02:52.197 INFO:teuthology.orchestra.run.smithi105.stdout: debug bluestore = 1/20 2023-10-06T03:02:52.197 INFO:teuthology.orchestra.run.smithi105.stdout: debug ms = 1 2023-10-06T03:02:52.197 INFO:teuthology.orchestra.run.smithi105.stdout: debug osd = 20 2023-10-06T03:02:52.197 INFO:teuthology.orchestra.run.smithi105.stdout: debug rocksdb = 4/10 2023-10-06T03:02:52.198 INFO:teuthology.orchestra.run.smithi105.stdout: mon osd backfillfull_ratio = 0.85 2023-10-06T03:02:52.198 INFO:teuthology.orchestra.run.smithi105.stdout: mon osd full ratio = 0.9 2023-10-06T03:02:52.198 INFO:teuthology.orchestra.run.smithi105.stdout: mon osd nearfull ratio = 0.8 2023-10-06T03:02:52.198 INFO:teuthology.orchestra.run.smithi105.stdout: osd failsafe full ratio = 0.95 2023-10-06T03:02:52.198 INFO:teuthology.orchestra.run.smithi105.stdout: osd objectstore = bluestore 2023-10-06T03:02:52.198 INFO:teuthology.orchestra.run.smithi105.stdout: osd op complaint time = 180 2023-10-06T03:02:52.198 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:02:52.198 INFO:teuthology.orchestra.run.smithi105.stdout:[mgr] 2023-10-06T03:02:52.198 INFO:teuthology.orchestra.run.smithi105.stdout: debug ms = 1 2023-10-06T03:02:52.198 INFO:teuthology.orchestra.run.smithi105.stdout: debug mgr = 20 2023-10-06T03:02:52.198 INFO:teuthology.orchestra.run.smithi105.stdout: debug mon = 20 2023-10-06T03:02:52.198 INFO:teuthology.orchestra.run.smithi105.stdout: debug auth = 20 2023-10-06T03:02:52.199 INFO:teuthology.orchestra.run.smithi105.stdout: mon reweight min pgs per osd = 4 2023-10-06T03:02:52.199 INFO:teuthology.orchestra.run.smithi105.stdout: mon reweight min bytes per osd = 10 2023-10-06T03:02:52.199 INFO:teuthology.orchestra.run.smithi105.stdout: mgr/telemetry/nag = false 2023-10-06T03:02:52.199 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:02:52.199 INFO:teuthology.orchestra.run.smithi105.stdout:[mon] 2023-10-06T03:02:52.199 INFO:teuthology.orchestra.run.smithi105.stdout: debug ms = 1 2023-10-06T03:02:52.199 INFO:teuthology.orchestra.run.smithi105.stdout: debug mon = 20 2023-10-06T03:02:52.199 INFO:teuthology.orchestra.run.smithi105.stdout: debug paxos = 20 2023-10-06T03:02:52.199 INFO:teuthology.orchestra.run.smithi105.stdout: debug auth = 20 2023-10-06T03:02:52.199 INFO:teuthology.orchestra.run.smithi105.stdout: mon data avail warn = 5 2023-10-06T03:02:52.199 INFO:teuthology.orchestra.run.smithi105.stdout: mon mgr mkfs grace = 240 2023-10-06T03:02:52.199 INFO:teuthology.orchestra.run.smithi105.stdout: mon reweight min pgs per osd = 4 2023-10-06T03:02:52.200 INFO:teuthology.orchestra.run.smithi105.stdout: mon osd reporter subtree level = osd 2023-10-06T03:02:52.200 INFO:teuthology.orchestra.run.smithi105.stdout: mon osd prime pg temp = true 2023-10-06T03:02:52.200 INFO:teuthology.orchestra.run.smithi105.stdout: mon reweight min bytes per osd = 10 2023-10-06T03:02:52.200 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:02:52.200 INFO:teuthology.orchestra.run.smithi105.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-06T03:02:52.200 INFO:teuthology.orchestra.run.smithi105.stdout: auth mon ticket ttl = 660 # 11m 2023-10-06T03:02:52.200 INFO:teuthology.orchestra.run.smithi105.stdout: auth service ticket ttl = 240 # 4m 2023-10-06T03:02:52.200 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:02:52.200 INFO:teuthology.orchestra.run.smithi105.stdout: # don't complain about insecure global_id in the test suite 2023-10-06T03:02:52.200 INFO:teuthology.orchestra.run.smithi105.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-06T03:02:52.200 INFO:teuthology.orchestra.run.smithi105.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-06T03:02:52.200 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:02:52.201 INFO:teuthology.orchestra.run.smithi105.stdout: # 1m isn't quite enough 2023-10-06T03:02:52.201 INFO:teuthology.orchestra.run.smithi105.stdout: mon_down_mkfs_grace = 2m 2023-10-06T03:02:52.201 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:02:52.201 INFO:teuthology.orchestra.run.smithi105.stdout: mon_warn_on_filestore_osds = false 2023-10-06T03:02:52.201 INFO:teuthology.orchestra.run.smithi105.stdout: mon op complaint time = 120 2023-10-06T03:02:52.201 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:02:52.201 INFO:teuthology.orchestra.run.smithi105.stdout:[client] 2023-10-06T03:02:52.201 INFO:teuthology.orchestra.run.smithi105.stdout: rgw cache enabled = true 2023-10-06T03:02:52.201 INFO:teuthology.orchestra.run.smithi105.stdout: rgw enable ops log = true 2023-10-06T03:02:52.201 INFO:teuthology.orchestra.run.smithi105.stdout: rgw enable usage log = true 2023-10-06T03:02:52.201 INFO:teuthology.orchestra.run.smithi105.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-06T03:02:52.201 INFO:teuthology.orchestra.run.smithi105.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-06T03:02:52.202 INFO:teuthology.orchestra.run.smithi105.stdout: client mount timeout = 600 2023-10-06T03:02:52.202 INFO:teuthology.orchestra.run.smithi105.stdout: debug client = 20 2023-10-06T03:02:52.202 INFO:teuthology.orchestra.run.smithi105.stdout: debug ms = 1 2023-10-06T03:02:52.202 INFO:teuthology.orchestra.run.smithi105.stdout: pid file = "" 2023-10-06T03:02:52.202 INFO:teuthology.orchestra.run.smithi105.stdout: rados mon op timeout = 900 2023-10-06T03:02:52.202 INFO:teuthology.orchestra.run.smithi105.stdout: rados osd op timeout = 900 2023-10-06T03:02:52.202 INFO:teuthology.orchestra.run.smithi105.stdout:[mon.a] 2023-10-06T03:02:52.202 INFO:teuthology.orchestra.run.smithi105.stdout:[mon.b] 2023-10-06T03:02:52.202 INFO:teuthology.orchestra.run.smithi105.stdout:[mon.c] 2023-10-06T03:02:52.202 INFO:teuthology.orchestra.run.smithi105.stdout:[mds.a] 2023-10-06T03:02:52.202 INFO:teuthology.orchestra.run.smithi105.stdout:[mds.c] 2023-10-06T03:02:52.203 INFO:teuthology.orchestra.run.smithi105.stdout:[mds.b] 2023-10-06T03:02:52.203 INFO:teuthology.orchestra.run.smithi105.stdout:[mds.d] 2023-10-06T03:02:52.203 INFO:teuthology.orchestra.run.smithi105.stdout:[mds] 2023-10-06T03:02:52.203 INFO:teuthology.orchestra.run.smithi105.stdout: debug mds = 20 2023-10-06T03:02:52.203 INFO:teuthology.orchestra.run.smithi105.stdout: debug ms = 1 2023-10-06T03:02:52.203 INFO:teuthology.orchestra.run.smithi105.stdout: mds debug frag = True 2023-10-06T03:02:52.203 INFO:teuthology.orchestra.run.smithi105.stdout: mds debug scatterstat = True 2023-10-06T03:02:52.203 INFO:teuthology.orchestra.run.smithi105.stdout: mds op complaint time = 180 2023-10-06T03:02:52.203 INFO:teuthology.orchestra.run.smithi105.stdout: mds verify scatter = True 2023-10-06T03:02:52.203 INFO:teuthology.orchestra.run.smithi105.stdout: osd op complaint time = 180 2023-10-06T03:02:52.203 INFO:teuthology.orchestra.run.smithi105.stdout: rados mon op timeout = 900 2023-10-06T03:02:52.203 INFO:teuthology.orchestra.run.smithi105.stdout: rados osd op timeout = 900 2023-10-06T03:02:52.203 INFO:teuthology.orchestra.run.smithi105.stdout: osd_deep_scrub_large_omap_object_key_threshold = 1 2023-10-06T03:02:52.206 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-06T03:02:52.206 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-06T03:02:52.206 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-06T03:02:52.207 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:02:52.207 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-06T03:02:52.207 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-06T03:02:52.207 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-06T03:02:52.207 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:02:52.207 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-06T03:02:52.208 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-06T03:02:52.208 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-06T03:02:52.208 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:02:52.208 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-06T03:02:52.208 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-06T03:02:52.208 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-06T03:02:52.208 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:02:52.232 INFO:tasks.ceph.mds.a:Stopped 2023-10-06T03:02:52.232 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-06T03:02:52.233 INFO:tasks.ceph.mds.d:Stopped 2023-10-06T03:02:52.234 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-06T03:02:52.234 INFO:tasks.ceph.mds.b:Stopped 2023-10-06T03:02:52.235 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-06T03:02:52.236 INFO:tasks.ceph.mds.c:Stopped 2023-10-06T03:02:52.236 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-06T03:02:52.282 INFO:tasks.ceph.mds.d:Started 2023-10-06T03:02:52.283 DEBUG:teuthology.parallel:result is None 2023-10-06T03:02:52.287 INFO:tasks.ceph.mds.b:Started 2023-10-06T03:02:52.288 DEBUG:teuthology.parallel:result is None 2023-10-06T03:02:52.288 INFO:tasks.ceph.mds.a:Started 2023-10-06T03:02:52.289 DEBUG:teuthology.parallel:result is None 2023-10-06T03:02:52.292 INFO:tasks.ceph.mds.c:Started 2023-10-06T03:02:52.292 DEBUG:teuthology.parallel:result is None 2023-10-06T03:02:52.292 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:02:52.394 INFO:tasks.ceph.mds.a.smithi057.stdout:starting mds.a at 2023-10-06T03:02:52.397 INFO:tasks.ceph.mds.d.smithi105.stdout:starting mds.d at 2023-10-06T03:02:52.398 INFO:tasks.ceph.mds.c.smithi057.stdout:starting mds.c at 2023-10-06T03:02:52.399 INFO:tasks.ceph.mds.b.smithi105.stdout:starting mds.b at 2023-10-06T03:02:52.456 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:52.453+0000 7f8299763700 1 Processor -- start 2023-10-06T03:02:52.456 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:52.453+0000 7f8299763700 1 -- start start 2023-10-06T03:02:52.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:52.453+0000 7f8299763700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f82940b1350 0x7f82940b3250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:52.459 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:52.453+0000 7f8299763700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82940ae390 con 0x7f82940d0770 2023-10-06T03:02:52.459 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:52.453+0000 7f8299763700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82940d0d50 con 0x7f829415c730 2023-10-06T03:02:52.459 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:52.453+0000 7f8299763700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82940d1030 con 0x7f82940b1350 2023-10-06T03:02:52.459 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:52.457+0000 7f828b7fe700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f82940d0770 0x7f82940b0c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:53354/0 (socket says 172.21.15.57:53354) 2023-10-06T03:02:52.459 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:52.457+0000 7f828b7fe700 1 -- 172.21.15.57:0/2498804339 learned_addr learned my addr 172.21.15.57:0/2498804339 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:02:52.459 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:52.457+0000 7f8298f62700 1 --2- 172.21.15.57:0/2498804339 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f82940b1350 0x7f82940b3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:52.460 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:52.457+0000 7f82937fe700 1 -- 172.21.15.57:0/2498804339 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1553629742 0 0) 0x7f82940ae390 con 0x7f82940d0770 2023-10-06T03:02:52.460 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:52.457+0000 7f82937fe700 1 -- 172.21.15.57:0/2498804339 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8280003570 con 0x7f82940d0770 2023-10-06T03:02:52.461 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:52.457+0000 7f82937fe700 1 -- 172.21.15.57:0/2498804339 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3380290192 0 0) 0x7f82940d0d50 con 0x7f829415c730 2023-10-06T03:02:52.461 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:52.457+0000 7f82937fe700 1 -- 172.21.15.57:0/2498804339 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82940ae390 con 0x7f829415c730 2023-10-06T03:02:52.461 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:52.457+0000 7f8298f62700 1 -- 172.21.15.57:0/2498804339 >> v1:172.21.15.105:6789/0 conn(0x7f829415c730 legacy=0x7f829415d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:52.461 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:52.457+0000 7f8298f62700 1 -- 172.21.15.57:0/2498804339 >> v1:172.21.15.57:6789/0 conn(0x7f82940d0770 legacy=0x7f82940b0c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:52.461 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:52.457+0000 7f8298f62700 1 -- 172.21.15.57:0/2498804339 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82940add40 con 0x7f82940b1350 2023-10-06T03:02:52.462 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:52.457+0000 7f8298f62700 1 --2- 172.21.15.57:0/2498804339 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f82940b1350 0x7f82940b3250 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f828c009e90 tx=0x7f828c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df2708917aaf28f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:52.462 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:52.457+0000 7f82937fe700 1 -- 172.21.15.57:0/2498804339 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828c00e070 con 0x7f82940b1350 2023-10-06T03:02:52.462 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:52.457+0000 7f82937fe700 1 -- 172.21.15.57:0/2498804339 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f828c00bb80 con 0x7f82940b1350 2023-10-06T03:02:52.462 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:52.457+0000 7f82937fe700 1 -- 172.21.15.57:0/2498804339 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828c012430 con 0x7f82940b1350 2023-10-06T03:02:52.462 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:52.457+0000 7f8299763700 1 -- 172.21.15.57:0/2498804339 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f82940b1350 msgr2=0x7f82940b3250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:52.462 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:52.457+0000 7f8299763700 1 --2- 172.21.15.57:0/2498804339 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f82940b1350 0x7f82940b3250 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f828c009e90 tx=0x7f828c009780 comp rx=0 tx=0).stop 2023-10-06T03:02:52.463 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:52.461+0000 7f8299763700 1 -- 172.21.15.57:0/2498804339 shutdown_connections 2023-10-06T03:02:52.463 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:52.461+0000 7f8299763700 1 --2- 172.21.15.57:0/2498804339 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f82940b1350 0x7f82940b3250 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:52.463 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:52.461+0000 7f8299763700 1 -- 172.21.15.57:0/2498804339 >> 172.21.15.57:0/2498804339 conn(0x7f829406ef40 msgr2=0x7f82940d0060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:52.463 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:52.461+0000 7f8299763700 1 -- 172.21.15.57:0/2498804339 shutdown_connections 2023-10-06T03:02:52.464 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:52.461+0000 7f8299763700 1 -- 172.21.15.57:0/2498804339 wait complete. 2023-10-06T03:02:52.464 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:52.461+0000 7f8299763700 1 Processor -- start 2023-10-06T03:02:52.465 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:52.461+0000 7f8299763700 1 -- start start 2023-10-06T03:02:52.466 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:52.461+0000 7f8299763700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82940b1350 0x7f829416c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:52.466 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:52.461+0000 7f8299763700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f82940d0770 0x7f829415a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:52.467 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:52.461+0000 7f8299763700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f829415c730 0x7f829415a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:52.467 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:52.461+0000 7f8299763700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f829409cd60 con 0x7f82940d0770 2023-10-06T03:02:52.467 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:52.461+0000 7f8299763700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f829409c150 con 0x7f82940b1350 2023-10-06T03:02:52.467 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:52.461+0000 7f8299763700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f829409c430 con 0x7f829415c730 2023-10-06T03:02:52.467 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:52.465+0000 7f828b7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f82940d0770 0x7f829415a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:52.467 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:52.465+0000 7f828b7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f82940d0770 0x7f829415a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:59756/0 (socket says 172.21.15.57:59756) 2023-10-06T03:02:52.468 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:52.465+0000 7f828b7fe700 1 -- 172.21.15.57:0/2349277374 learned_addr learned my addr 172.21.15.57:0/2349277374 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:02:52.469 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:52.465+0000 7f8298f62700 1 --2- 172.21.15.57:0/2349277374 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f829415c730 0x7f829415a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:52.469 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:52.465+0000 7f8293fff700 1 --2- 172.21.15.57:0/2349277374 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82940b1350 0x7f829416c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:52.469 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:52.465+0000 7f828b7fe700 1 -- 172.21.15.57:0/2349277374 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f829415c730 msgr2=0x7f829415a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:52.469 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:52.465+0000 7f828b7fe700 1 --2- 172.21.15.57:0/2349277374 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f829415c730 0x7f829415a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:52.470 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:52.465+0000 7f828b7fe700 1 -- 172.21.15.57:0/2349277374 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82940b1350 msgr2=0x7f829416c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:52.470 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:52.465+0000 7f828b7fe700 1 --2- 172.21.15.57:0/2349277374 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82940b1350 0x7f829416c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:52.470 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:52.465+0000 7f828b7fe700 1 -- 172.21.15.57:0/2349277374 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f828c009a20 con 0x7f82940d0770 2023-10-06T03:02:52.470 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:52.465+0000 7f8293fff700 1 --2- 172.21.15.57:0/2349277374 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82940b1350 0x7f829416c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:02:52.470 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:52.465+0000 7f828b7fe700 1 --2- 172.21.15.57:0/2349277374 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f82940d0770 0x7f829415a400 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f828400c790 tx=0x7f8284007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:52.470 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:52.465+0000 7f8290ff9700 1 -- 172.21.15.57:0/2349277374 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8284005b30 con 0x7f82940d0770 2023-10-06T03:02:52.470 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:52.465+0000 7f8290ff9700 1 -- 172.21.15.57:0/2349277374 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8284005c90 con 0x7f82940d0770 2023-10-06T03:02:52.470 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:52.465+0000 7f8299763700 1 -- 172.21.15.57:0/2349277374 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f829409c710 con 0x7f82940d0770 2023-10-06T03:02:52.470 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:52.465+0000 7f8290ff9700 1 -- 172.21.15.57:0/2349277374 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8284007300 con 0x7f82940d0770 2023-10-06T03:02:52.470 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:52.465+0000 7f8299763700 1 -- 172.21.15.57:0/2349277374 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f829416c670 con 0x7f82940d0770 2023-10-06T03:02:52.471 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:52.465+0000 7f8299763700 1 -- 172.21.15.57:0/2349277374 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82940af2c0 con 0x7f82940d0770 2023-10-06T03:02:52.472 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:52.469+0000 7f8290ff9700 1 -- 172.21.15.57:0/2349277374 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f828401b400 con 0x7f82940d0770 2023-10-06T03:02:52.473 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:52.469+0000 7f8290ff9700 1 --2- 172.21.15.57:0/2349277374 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f8274060550 0x7f8274062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:52.474 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:52.469+0000 7f8290ff9700 1 -- 172.21.15.57:0/2349277374 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f828407c4d0 con 0x7f82940d0770 2023-10-06T03:02:52.474 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:52.469+0000 7f8293fff700 1 --2- 172.21.15.57:0/2349277374 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f8274060550 0x7f8274062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:52.475 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:52.473+0000 7f8293fff700 1 --2- 172.21.15.57:0/2349277374 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f8274060550 0x7f8274062a00 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f827c007fd0 tx=0x7f827c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:52.480 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:52.477+0000 7f8290ff9700 1 -- 172.21.15.57:0/2349277374 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f82940af2c0 con 0x7f82940d0770 2023-10-06T03:02:52.686 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:52.681+0000 7f8299763700 1 -- 172.21.15.57:0/2349277374 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f82940af2c0 con 0x7f82940d0770 2023-10-06T03:02:52.687 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:52.685+0000 7f8290ff9700 1 -- 172.21.15.57:0/2349277374 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+4603 (secure 0 0 0) 0x7f82940af2c0 con 0x7f82940d0770 2023-10-06T03:02:52.687 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:02:52.687 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":31,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5078,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/3441702537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":3441702537},{"type":"v1","addr":"172.21.15.105:6835","nonce":3441702537}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5356,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/1128830333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":1128830333},{"type":"v1","addr":"172.21.15.105:6833","nonce":1128830333}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":5430,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6836/2129396191","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":2129396191},{"type":"v1","addr":"172.21.15.57:6836","nonce":2129396191}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:02:39.274111+0000","modified":"2023-10-06T03:02:42.883803+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5433},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5433":{"gid":5433,"name":"c","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6837/4147766471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6835","nonce":4147766471},{"type":"v1","addr":"172.21.15.57:6837","nonce":4147766471}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T03:02:52.690 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:52.685+0000 7f8299763700 1 -- 172.21.15.57:0/2349277374 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f8274060550 msgr2=0x7f8274062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:52.690 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:52.685+0000 7f8299763700 1 --2- 172.21.15.57:0/2349277374 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f8274060550 0x7f8274062a00 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f827c007fd0 tx=0x7f827c009040 comp rx=0 tx=0).stop 2023-10-06T03:02:52.691 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:52.685+0000 7f8299763700 1 -- 172.21.15.57:0/2349277374 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f82940d0770 msgr2=0x7f829415a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:52.691 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:52.685+0000 7f8299763700 1 --2- 172.21.15.57:0/2349277374 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f82940d0770 0x7f829415a400 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f828400c790 tx=0x7f8284007ea0 comp rx=0 tx=0).stop 2023-10-06T03:02:52.691 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:52.685+0000 7f8299763700 1 -- 172.21.15.57:0/2349277374 shutdown_connections 2023-10-06T03:02:52.691 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:52.685+0000 7f8299763700 1 --2- 172.21.15.57:0/2349277374 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f8274060550 0x7f8274062a00 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:52.691 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:52.685+0000 7f8299763700 1 --2- 172.21.15.57:0/2349277374 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f829415c730 0x7f829415a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:52.691 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:52.685+0000 7f8299763700 1 --2- 172.21.15.57:0/2349277374 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f82940d0770 0x7f829415a400 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:52.691 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:52.685+0000 7f8299763700 1 --2- 172.21.15.57:0/2349277374 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82940b1350 0x7f829416c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:52.691 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:52.685+0000 7f8299763700 1 -- 172.21.15.57:0/2349277374 >> 172.21.15.57:0/2349277374 conn(0x7f829406ef40 msgr2=0x7f8294068d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:52.691 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:52.689+0000 7f8299763700 1 -- 172.21.15.57:0/2349277374 shutdown_connections 2023-10-06T03:02:52.691 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:52.689+0000 7f8299763700 1 -- 172.21.15.57:0/2349277374 wait complete. 2023-10-06T03:02:52.693 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 31 2023-10-06T03:02:52.817 INFO:tasks.ceph.mon.a.smithi057.stderr:2023-10-06T03:02:52.813+0000 7f3ec399e700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T03:02:53.113 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 31, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T03:02:39.274111+0000', 'modified': '2023-10-06T03:02:42.883803+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5433}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5433': {'gid': 5433, 'name': 'c', 'rank': 0, 'incarnation': 28, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.57:6837/4147766471', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6835', 'nonce': 4147766471}, {'type': 'v1', 'addr': '172.21.15.57:6837', 'nonce': 4147766471}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T03:02:53.113 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T03:02:53.114 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-06T03:02:53.279 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.277+0000 7fa8667cc700 1 Processor -- start 2023-10-06T03:02:53.280 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.277+0000 7fa8667cc700 1 -- start start 2023-10-06T03:02:53.283 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.281+0000 7fa8667cc700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa8600c9b00 0x7fa8600c8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:53.283 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.281+0000 7fa8667cc700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fa8600c9ed0 0x7fa8600c6340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:53.283 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.281+0000 7fa8667cc700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8600cadb0 con 0x7fa860161180 2023-10-06T03:02:53.284 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.281+0000 7fa8667cc700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8600c6b00 con 0x7fa8600c9ed0 2023-10-06T03:02:53.284 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.281+0000 7fa8667cc700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8600c6880 con 0x7fa8600c9b00 2023-10-06T03:02:53.284 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.281+0000 7fa865fcb700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fa860161180 0x7fa86015db80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:53356/0 (socket says 172.21.15.57:53356) 2023-10-06T03:02:53.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.281+0000 7fa865fcb700 1 -- 172.21.15.57:0/3173288388 learned_addr learned my addr 172.21.15.57:0/3173288388 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:02:53.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.281+0000 7fa8657ca700 1 --2- 172.21.15.57:0/3173288388 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa8600c9b00 0x7fa8600c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:53.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.281+0000 7fa864fc9700 1 --2- 172.21.15.57:0/3173288388 >> v2:172.21.15.105:3300/0 conn(0x7fa8600c9ed0 0x7fa8600c6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:53.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.281+0000 7fa857fff700 1 -- 172.21.15.57:0/3173288388 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 864515698 0 0) 0x7fa8600cadb0 con 0x7fa860161180 2023-10-06T03:02:53.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.281+0000 7fa857fff700 1 -- 172.21.15.57:0/3173288388 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa84c003570 con 0x7fa860161180 2023-10-06T03:02:53.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.281+0000 7fa8657ca700 1 -- 172.21.15.57:0/3173288388 >> v2:172.21.15.105:3300/0 conn(0x7fa8600c9ed0 msgr2=0x7fa8600c6340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:53.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.281+0000 7fa8657ca700 1 --2- 172.21.15.57:0/3173288388 >> v2:172.21.15.105:3300/0 conn(0x7fa8600c9ed0 0x7fa8600c6340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:53.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.281+0000 7fa8657ca700 1 -- 172.21.15.57:0/3173288388 >> v1:172.21.15.57:6789/0 conn(0x7fa860161180 legacy=0x7fa86015db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:53.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.281+0000 7fa8657ca700 1 -- 172.21.15.57:0/3173288388 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8600ca480 con 0x7fa8600c9b00 2023-10-06T03:02:53.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.281+0000 7fa8657ca700 1 --2- 172.21.15.57:0/3173288388 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa8600c9b00 0x7fa8600c8120 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa85c0098e0 tx=0x7fa85c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb3b2ca066f3d523 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:53.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.285+0000 7fa857fff700 1 -- 172.21.15.57:0/3173288388 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa85c011630 con 0x7fa8600c9b00 2023-10-06T03:02:53.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.285+0000 7fa857fff700 1 -- 172.21.15.57:0/3173288388 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa85c011790 con 0x7fa8600c9b00 2023-10-06T03:02:53.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.285+0000 7fa857fff700 1 -- 172.21.15.57:0/3173288388 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa85c011b30 con 0x7fa8600c9b00 2023-10-06T03:02:53.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.285+0000 7fa8667cc700 1 -- 172.21.15.57:0/3173288388 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa8600c9b00 msgr2=0x7fa8600c8120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:53.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.285+0000 7fa8667cc700 1 --2- 172.21.15.57:0/3173288388 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa8600c9b00 0x7fa8600c8120 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa85c0098e0 tx=0x7fa85c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:02:53.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.285+0000 7fa8667cc700 1 -- 172.21.15.57:0/3173288388 shutdown_connections 2023-10-06T03:02:53.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.285+0000 7fa8667cc700 1 --2- 172.21.15.57:0/3173288388 >> v2:172.21.15.105:3300/0 conn(0x7fa8600c9ed0 0x7fa8600c6340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:53.289 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.285+0000 7fa8667cc700 1 --2- 172.21.15.57:0/3173288388 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa8600c9b00 0x7fa8600c8120 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:53.289 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.285+0000 7fa8667cc700 1 -- 172.21.15.57:0/3173288388 >> 172.21.15.57:0/3173288388 conn(0x7fa860067b00 msgr2=0x7fa8600cbd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:53.289 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.285+0000 7fa8667cc700 1 -- 172.21.15.57:0/3173288388 shutdown_connections 2023-10-06T03:02:53.289 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.285+0000 7fa8667cc700 1 -- 172.21.15.57:0/3173288388 wait complete. 2023-10-06T03:02:53.290 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.289+0000 7fa8667cc700 1 Processor -- start 2023-10-06T03:02:53.291 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.289+0000 7fa8667cc700 1 -- start start 2023-10-06T03:02:53.292 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.289+0000 7fa8667cc700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa8600c9b00 0x7fa8601562d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:53.292 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.289+0000 7fa8667cc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa8600c9ed0 0x7fa86015ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:53.292 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.289+0000 7fa8667cc700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa860161180 0x7fa86015b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:53.292 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.289+0000 7fa8667cc700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa860158860 con 0x7fa8600c9ed0 2023-10-06T03:02:53.292 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.289+0000 7fa8667cc700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa86016de00 con 0x7fa8600c9b00 2023-10-06T03:02:53.293 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.289+0000 7fa8667cc700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa86016dad0 con 0x7fa860161180 2023-10-06T03:02:53.293 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.289+0000 7fa864fc9700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa8600c9ed0 0x7fa86015ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:53.294 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.289+0000 7fa864fc9700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa8600c9ed0 0x7fa86015ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:59760/0 (socket says 172.21.15.57:59760) 2023-10-06T03:02:53.294 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.289+0000 7fa864fc9700 1 -- 172.21.15.57:0/1118493393 learned_addr learned my addr 172.21.15.57:0/1118493393 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:02:53.294 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.289+0000 7fa8657ca700 1 --2- 172.21.15.57:0/1118493393 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa8600c9b00 0x7fa8601562d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:53.294 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.289+0000 7fa865fcb700 1 --2- 172.21.15.57:0/1118493393 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa860161180 0x7fa86015b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:53.294 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.289+0000 7fa864fc9700 1 -- 172.21.15.57:0/1118493393 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa860161180 msgr2=0x7fa86015b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:53.294 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.289+0000 7fa864fc9700 1 --2- 172.21.15.57:0/1118493393 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa860161180 0x7fa86015b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:53.294 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.289+0000 7fa864fc9700 1 -- 172.21.15.57:0/1118493393 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa8600c9b00 msgr2=0x7fa8601562d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:53.294 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.289+0000 7fa864fc9700 1 --2- 172.21.15.57:0/1118493393 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa8600c9b00 0x7fa8601562d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:53.294 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.289+0000 7fa864fc9700 1 -- 172.21.15.57:0/1118493393 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa85c009420 con 0x7fa8600c9ed0 2023-10-06T03:02:53.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.289+0000 7fa864fc9700 1 --2- 172.21.15.57:0/1118493393 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa8600c9ed0 0x7fa86015ac90 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fa85000e930 tx=0x7fa8500091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:53.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.293+0000 7fa8557fa700 1 -- 172.21.15.57:0/1118493393 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa850013680 con 0x7fa8600c9ed0 2023-10-06T03:02:53.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.293+0000 7fa8557fa700 1 -- 172.21.15.57:0/1118493393 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8500137e0 con 0x7fa8600c9ed0 2023-10-06T03:02:53.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.293+0000 7fa8667cc700 1 -- 172.21.15.57:0/1118493393 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8600c58b0 con 0x7fa8600c9ed0 2023-10-06T03:02:53.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.293+0000 7fa8557fa700 1 -- 172.21.15.57:0/1118493393 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa850013b80 con 0x7fa8600c9ed0 2023-10-06T03:02:53.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.293+0000 7fa8667cc700 1 -- 172.21.15.57:0/1118493393 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8600c5e70 con 0x7fa8600c9ed0 2023-10-06T03:02:53.298 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.293+0000 7fa8557fa700 1 -- 172.21.15.57:0/1118493393 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fa85000c460 con 0x7fa8600c9ed0 2023-10-06T03:02:53.300 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.297+0000 7fa8557fa700 1 --2- 172.21.15.57:0/1118493393 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fa844060550 0x7fa844062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:53.300 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.297+0000 7fa8557fa700 1 -- 172.21.15.57:0/1118493393 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6144+0+0 (secure 0 0 0) 0x7fa85007cb10 con 0x7fa8600c9ed0 2023-10-06T03:02:53.300 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.297+0000 7fa8657ca700 1 --2- 172.21.15.57:0/1118493393 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fa844060550 0x7fa844062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:53.300 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.297+0000 7fa869cc0740 1 Processor -- start 2023-10-06T03:02:53.301 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.297+0000 7fa869cc0740 1 -- start start 2023-10-06T03:02:53.301 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.297+0000 7fa8657ca700 1 --2- 172.21.15.57:0/1118493393 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fa844060550 0x7fa844062a00 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fa85c0091e0 tx=0x7fa85c017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:53.302 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.297+0000 7fa869cc0740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x1f36ae0 0x21b3e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:53.302 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.297+0000 7fa869cc0740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1f36710 0x21b4390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:53.302 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.297+0000 7fa869cc0740 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x1f81790 0x21b48d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:53.302 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.297+0000 7fa869cc0740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x20e1f30 con 0x1f36710 2023-10-06T03:02:53.303 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.297+0000 7fa869cc0740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x20dded0 con 0x1f36ae0 2023-10-06T03:02:53.303 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.297+0000 7fa869cc0740 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x20a40b0 con 0x1f81790 2023-10-06T03:02:53.304 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.301+0000 7fa864fc9700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1f36710 0x21b4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:53.304 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.301+0000 7fa864fc9700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1f36710 0x21b4390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:59762/0 (socket says 172.21.15.57:59762) 2023-10-06T03:02:53.304 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.301+0000 7fa864fc9700 1 -- 172.21.15.57:0/2890662972 learned_addr learned my addr 172.21.15.57:0/2890662972 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:02:53.304 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.301+0000 7fa8657ca700 1 --2- 172.21.15.57:0/2890662972 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x1f36ae0 0x21b3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:53.304 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.301+0000 7fa865fcb700 1 --2- 172.21.15.57:0/2890662972 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x1f81790 0x21b48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:53.304 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.301+0000 7fa864fc9700 1 -- 172.21.15.57:0/2890662972 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x1f81790 msgr2=0x21b48d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:53.305 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.301+0000 7fa864fc9700 1 --2- 172.21.15.57:0/2890662972 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x1f81790 0x21b48d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:53.305 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.301+0000 7fa864fc9700 1 -- 172.21.15.57:0/2890662972 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x1f36ae0 msgr2=0x21b3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:53.305 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.301+0000 7fa864fc9700 1 --2- 172.21.15.57:0/2890662972 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x1f36ae0 0x21b3e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:53.305 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.301+0000 7fa864fc9700 1 -- 172.21.15.57:0/2890662972 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1f829e0 con 0x1f36710 2023-10-06T03:02:53.305 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.301+0000 7fa8657ca700 1 --2- 172.21.15.57:0/2890662972 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x1f36ae0 0x21b3e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:02:53.305 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.301+0000 7fa865fcb700 1 --2- 172.21.15.57:0/2890662972 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x1f81790 0x21b48d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:02:53.305 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.301+0000 7fa864fc9700 1 --2- 172.21.15.57:0/2890662972 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1f36710 0x21b4390 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fa85007add0 tx=0x7fa85007ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8b477a81d694f65 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:53.305 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.301+0000 7fa84a7fc700 1 -- 172.21.15.57:0/2890662972 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa850057b70 con 0x1f36710 2023-10-06T03:02:53.305 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.301+0000 7fa84a7fc700 1 -- 172.21.15.57:0/2890662972 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa850050b90 con 0x1f36710 2023-10-06T03:02:53.305 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.301+0000 7fa84a7fc700 1 -- 172.21.15.57:0/2890662972 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa85004ef30 con 0x1f36710 2023-10-06T03:02:53.306 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.301+0000 7fa869cc0740 1 -- 172.21.15.57:0/2890662972 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1f36710 msgr2=0x21b4390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:53.306 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.301+0000 7fa869cc0740 1 --2- 172.21.15.57:0/2890662972 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1f36710 0x21b4390 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fa85007add0 tx=0x7fa85007ad60 comp rx=0 tx=0).stop 2023-10-06T03:02:53.306 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.301+0000 7fa869cc0740 1 -- 172.21.15.57:0/2890662972 shutdown_connections 2023-10-06T03:02:53.307 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.301+0000 7fa869cc0740 1 --2- 172.21.15.57:0/2890662972 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x1f81790 0x21b48d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:53.307 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.301+0000 7fa869cc0740 1 --2- 172.21.15.57:0/2890662972 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1f36710 0x21b4390 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:53.307 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.301+0000 7fa869cc0740 1 --2- 172.21.15.57:0/2890662972 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x1f36ae0 0x21b3e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:53.307 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.301+0000 7fa869cc0740 1 -- 172.21.15.57:0/2890662972 >> 172.21.15.57:0/2890662972 conn(0x1f36eb0 msgr2=0x2170880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:53.307 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.301+0000 7fa869cc0740 1 -- 172.21.15.57:0/2890662972 shutdown_connections 2023-10-06T03:02:53.307 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.301+0000 7fa869cc0740 1 -- 172.21.15.57:0/2890662972 wait complete. 2023-10-06T03:02:53.307 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.305+0000 7fa869cc0740 1 -- start start 2023-10-06T03:02:53.308 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.305+0000 7fa869cc0740 1 Processor -- start 2023-10-06T03:02:53.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.305+0000 7fa869cc0740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x1f36710 0x2170740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:53.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.305+0000 7fa869cc0740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1f36ae0 0x2199c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:53.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.305+0000 7fa869cc0740 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x1f81790 0x219a140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:53.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.305+0000 7fa869cc0740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x20a3d50 con 0x1f36ae0 2023-10-06T03:02:53.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.305+0000 7fa869cc0740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x207c970 con 0x1f36710 2023-10-06T03:02:53.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.305+0000 7fa869cc0740 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x20de770 con 0x1f81790 2023-10-06T03:02:53.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.305+0000 7fa869cc0740 10 client.0 _ll_register_callbacks cb 0x2127b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:02:53.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.305+0000 7fa864fc9700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1f36ae0 0x2199c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:53.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.305+0000 7fa864fc9700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1f36ae0 0x2199c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:59778/0 (socket says 172.21.15.57:59778) 2023-10-06T03:02:53.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.305+0000 7fa864fc9700 1 -- 172.21.15.57:0/3729830792 learned_addr learned my addr 172.21.15.57:0/3729830792 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:02:53.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.305+0000 7fa865fcb700 1 --2- 172.21.15.57:0/3729830792 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x1f81790 0x219a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:53.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.305+0000 7fa8657ca700 1 --2- 172.21.15.57:0/3729830792 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x1f36710 0x2170740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:53.312 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.309+0000 7fa864fc9700 1 -- 172.21.15.57:0/3729830792 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x1f81790 msgr2=0x219a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:53.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.309+0000 7fa864fc9700 1 --2- 172.21.15.57:0/3729830792 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x1f81790 0x219a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:53.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.309+0000 7fa864fc9700 1 -- 172.21.15.57:0/3729830792 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x1f36710 msgr2=0x2170740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:53.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.309+0000 7fa864fc9700 1 --2- 172.21.15.57:0/3729830792 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x1f36710 0x2170740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:53.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.309+0000 7fa864fc9700 1 -- 172.21.15.57:0/3729830792 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8600c5e70 con 0x1f36ae0 2023-10-06T03:02:53.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.309+0000 7fa864fc9700 1 --2- 172.21.15.57:0/3729830792 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1f36ae0 0x2199c00 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fa85004d5b0 tx=0x7fa850067000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbe150cd1b7e5868 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:53.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.309+0000 7fa83f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-10-06T03:02:53.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.309+0000 7fa83f7fe700 1 -- 172.21.15.57:0/3729830792 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa85006e070 con 0x1f36ae0 2023-10-06T03:02:53.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.309+0000 7fa869cc0740 1 -- 172.21.15.57:0/3729830792 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x207ccc0 con 0x1f36ae0 2023-10-06T03:02:53.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.309+0000 7fa83f7fe700 1 -- 172.21.15.57:0/3729830792 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(54..54 src has 1..54) v4 ==== 6144+0+0 (secure 0 0 0) 0x7fa85004ecd0 con 0x1f36ae0 2023-10-06T03:02:53.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.309+0000 7fa83f7fe700 1 -- 172.21.15.57:0/3729830792 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa850050080 con 0x1f36ae0 2023-10-06T03:02:53.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.309+0000 7fa869cc0740 10 client.5661 fetch_fsmap learned FSMap version 34 2023-10-06T03:02:53.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.309+0000 7fa869cc0740 1 -- 172.21.15.57:0/3729830792 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=2+}) v3 -- 0x20ac370 con 0x1f36ae0 2023-10-06T03:02:53.314 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.309+0000 7fa83f7fe700 1 -- 172.21.15.57:0/3729830792 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x207ccc0 con 0x1f36ae0 2023-10-06T03:02:53.314 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.309+0000 7fa83f7fe700 1 -- 172.21.15.57:0/3729830792 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 34) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fa850071030 con 0x1f36ae0 2023-10-06T03:02:53.314 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.309+0000 7fa869cc0740 10 client.5661 fetch_fsmap finished waiting for FSMap version 34 2023-10-06T03:02:53.314 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.309+0000 7fa869cc0740 10 client.5661 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T03:02:53.314 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.309+0000 7fa869cc0740 20 client.5661 populate_metadata read hostname 'smithi057' 2023-10-06T03:02:53.314 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.309+0000 7fa869cc0740 1 --2- 172.21.15.57:0/3729830792 >> [v2:172.21.15.57:6836/3347844181,v1:172.21.15.57:6837/3347844181] conn(0x21c06b0 0x21c2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:53.314 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.309+0000 7fa869cc0740 4 client.5661 mds_command: new command op to 5643 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T03:02:53.314 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.309+0000 7fa869cc0740 1 -- 172.21.15.57:0/3729830792 --> [v2:172.21.15.57:6836/3347844181,v1:172.21.15.57:6837/3347844181] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x20803e0 con 0x21c06b0 2023-10-06T03:02:53.315 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.309+0000 7fa8657ca700 1 --2- 172.21.15.57:0/3729830792 >> [v2:172.21.15.57:6836/3347844181,v1:172.21.15.57:6837/3347844181] conn(0x21c06b0 0x21c2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:53.315 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.309+0000 7fa83f7fe700 10 client.5661 ms_handle_connect on v2:172.21.15.57:6836/3347844181 2023-10-06T03:02:53.315 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.309+0000 7fa8657ca700 1 --2- 172.21.15.57:0/3729830792 >> [v2:172.21.15.57:6836/3347844181,v1:172.21.15.57:6837/3347844181] conn(0x21c06b0 0x21c2a90 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1d18ee12ab08e9fe server_cookie=785a58e8859e7067 in_seq=0 out_seq=0 2023-10-06T03:02:53.315 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.313+0000 7fa83f7fe700 1 -- 172.21.15.57:0/3729830792 <== mds.0 v2:172.21.15.57:6836/3347844181 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x20803e0 con 0x21c06b0 2023-10-06T03:02:53.315 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.313+0000 7fa83f7fe700 10 client.5661 handle_command_reply: tid=0 2023-10-06T03:02:53.315 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.313+0000 7fa869cc0740 1 client.5661 shutdown 2023-10-06T03:02:53.316 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.313+0000 7fa869cc0740 1 -- 172.21.15.57:0/3729830792 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1f36ae0 msgr2=0x2199c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:53.316 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.313+0000 7fa869cc0740 1 --2- 172.21.15.57:0/3729830792 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1f36ae0 0x2199c00 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fa85004d5b0 tx=0x7fa850067000 comp rx=0 tx=0).stop 2023-10-06T03:02:53.316 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.313+0000 7fa869cc0740 1 -- 172.21.15.57:0/3729830792 shutdown_connections 2023-10-06T03:02:53.316 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.313+0000 7fa869cc0740 1 --2- 172.21.15.57:0/3729830792 >> [v2:172.21.15.57:6836/3347844181,v1:172.21.15.57:6837/3347844181] conn(0x21c06b0 0x21c2a90 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:53.316 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.313+0000 7fa869cc0740 1 --2- 172.21.15.57:0/3729830792 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x1f81790 0x219a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:53.317 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.313+0000 7fa869cc0740 1 --2- 172.21.15.57:0/3729830792 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1f36ae0 0x2199c00 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:53.317 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.313+0000 7fa869cc0740 1 --2- 172.21.15.57:0/3729830792 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x1f36710 0x2170740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:53.317 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.313+0000 7fa83f7fe700 0 client.5661 ms_handle_reset on v2:172.21.15.57:6836/3347844181 2023-10-06T03:02:53.317 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.313+0000 7fa869cc0740 1 -- 172.21.15.57:0/3729830792 >> 172.21.15.57:0/3729830792 conn(0x1f36eb0 msgr2=0x2168ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:53.317 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.313+0000 7fa869cc0740 1 -- 172.21.15.57:0/3729830792 shutdown_connections 2023-10-06T03:02:53.317 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.313+0000 7fa869cc0740 1 -- 172.21.15.57:0/3729830792 wait complete. 2023-10-06T03:02:53.317 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.313+0000 7fa869cc0740 20 client.5661 trim_cache size 0 max 16384 2023-10-06T03:02:53.334 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.329+0000 7fa869cc0740 1 Processor -- start 2023-10-06T03:02:53.334 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.329+0000 7fa869cc0740 1 -- start start 2023-10-06T03:02:53.335 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.333+0000 7fa869cc0740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x1f36710 0x21c2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:53.335 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.333+0000 7fa869cc0740 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x1f36ae0 0x21c2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:53.335 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.333+0000 7fa869cc0740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1f81790 0x21c3510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:53.335 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.333+0000 7fa869cc0740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x20a3d50 con 0x1f81790 2023-10-06T03:02:53.335 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.333+0000 7fa869cc0740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x21053b0 con 0x1f36710 2023-10-06T03:02:53.335 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.333+0000 7fa869cc0740 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x20e0590 con 0x1f36ae0 2023-10-06T03:02:53.336 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.333+0000 7fa865fcb700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1f81790 0x21c3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:53.336 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.333+0000 7fa865fcb700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1f81790 0x21c3510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:59780/0 (socket says 172.21.15.57:59780) 2023-10-06T03:02:53.336 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.333+0000 7fa865fcb700 1 -- 172.21.15.57:0/499141362 learned_addr learned my addr 172.21.15.57:0/499141362 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:02:53.336 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.333+0000 7fa864fc9700 1 --2- 172.21.15.57:0/499141362 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x1f36ae0 0x21c2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:53.336 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.333+0000 7fa8657ca700 1 --2- 172.21.15.57:0/499141362 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x1f36710 0x21c2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:53.337 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.333+0000 7fa865fcb700 1 -- 172.21.15.57:0/499141362 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x1f36ae0 msgr2=0x21c2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:53.337 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.333+0000 7fa865fcb700 1 --2- 172.21.15.57:0/499141362 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x1f36ae0 0x21c2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:53.337 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.333+0000 7fa865fcb700 1 -- 172.21.15.57:0/499141362 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x1f36710 msgr2=0x21c2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:53.337 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.333+0000 7fa865fcb700 1 --2- 172.21.15.57:0/499141362 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x1f36710 0x21c2a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:53.337 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.333+0000 7fa865fcb700 1 -- 172.21.15.57:0/499141362 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa86006dca0 con 0x1f81790 2023-10-06T03:02:53.337 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.333+0000 7fa865fcb700 1 --2- 172.21.15.57:0/499141362 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1f81790 0x21c3510 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fa8580020a0 tx=0x7fa858009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31a9ca62bda5dfdc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:53.338 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.333+0000 7fa84affd700 1 -- 172.21.15.57:0/499141362 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8580079a0 con 0x1f81790 2023-10-06T03:02:53.338 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.333+0000 7fa84affd700 1 -- 172.21.15.57:0/499141362 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa858007b00 con 0x1f81790 2023-10-06T03:02:53.338 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.333+0000 7fa84affd700 1 -- 172.21.15.57:0/499141362 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8580166d0 con 0x1f81790 2023-10-06T03:02:53.339 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.333+0000 7fa869cc0740 1 -- 172.21.15.57:0/499141362 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1f81790 msgr2=0x21c3510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:53.339 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.333+0000 7fa869cc0740 1 --2- 172.21.15.57:0/499141362 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1f81790 0x21c3510 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fa8580020a0 tx=0x7fa858009040 comp rx=0 tx=0).stop 2023-10-06T03:02:53.339 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.333+0000 7fa869cc0740 1 -- 172.21.15.57:0/499141362 shutdown_connections 2023-10-06T03:02:53.339 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.333+0000 7fa869cc0740 1 --2- 172.21.15.57:0/499141362 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1f81790 0x21c3510 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:53.339 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.333+0000 7fa869cc0740 1 --2- 172.21.15.57:0/499141362 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x1f36ae0 0x21c2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:53.339 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.333+0000 7fa869cc0740 1 --2- 172.21.15.57:0/499141362 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x1f36710 0x21c2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:53.339 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.333+0000 7fa869cc0740 1 -- 172.21.15.57:0/499141362 >> 172.21.15.57:0/499141362 conn(0x1f36eb0 msgr2=0x2169760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:53.339 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.333+0000 7fa869cc0740 1 -- 172.21.15.57:0/499141362 shutdown_connections 2023-10-06T03:02:53.339 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.333+0000 7fa869cc0740 1 -- 172.21.15.57:0/499141362 wait complete. 2023-10-06T03:02:53.339 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.337+0000 7fa869cc0740 1 -- start start 2023-10-06T03:02:53.340 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.337+0000 7fa869cc0740 1 Processor -- start 2023-10-06T03:02:53.340 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.337+0000 7fa869cc0740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x1f36710 0x2194b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:53.340 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.337+0000 7fa869cc0740 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x1f36ae0 0x21950d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:53.340 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.337+0000 7fa869cc0740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1f81790 0x2195610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:53.340 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.337+0000 7fa869cc0740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x20b6910 con 0x1f81790 2023-10-06T03:02:53.340 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.337+0000 7fa869cc0740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x208f550 con 0x1f36710 2023-10-06T03:02:53.341 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.337+0000 7fa869cc0740 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x2087510 con 0x1f36ae0 2023-10-06T03:02:53.341 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.337+0000 7fa869cc0740 10 client.0 _ll_register_callbacks cb 0x1ffa0e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:02:53.341 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.337+0000 7fa865fcb700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1f81790 0x2195610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:53.342 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.337+0000 7fa865fcb700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1f81790 0x2195610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:59786/0 (socket says 172.21.15.57:59786) 2023-10-06T03:02:53.342 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.337+0000 7fa865fcb700 1 -- 172.21.15.57:0/3982357709 learned_addr learned my addr 172.21.15.57:0/3982357709 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:02:53.342 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.337+0000 7fa8657ca700 1 --2- 172.21.15.57:0/3982357709 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x1f36710 0x2194b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:53.342 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.337+0000 7fa864fc9700 1 --2- 172.21.15.57:0/3982357709 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x1f36ae0 0x21950d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:53.342 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.337+0000 7fa8657ca700 1 -- 172.21.15.57:0/3982357709 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x1f36ae0 msgr2=0x21950d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:53.342 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.337+0000 7fa8657ca700 1 --2- 172.21.15.57:0/3982357709 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x1f36ae0 0x21950d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:53.342 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.337+0000 7fa8657ca700 1 -- 172.21.15.57:0/3982357709 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1f81790 msgr2=0x2195610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:53.342 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.337+0000 7fa8657ca700 1 --2- 172.21.15.57:0/3982357709 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1f81790 0x2195610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:53.342 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.337+0000 7fa8657ca700 1 -- 172.21.15.57:0/3982357709 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa85800f040 con 0x1f36710 2023-10-06T03:02:53.342 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.337+0000 7fa865fcb700 1 --2- 172.21.15.57:0/3982357709 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1f81790 0x2195610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:02:53.343 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.337+0000 7fa8657ca700 1 --2- 172.21.15.57:0/3982357709 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x1f36710 0x2194b90 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fa85c016000 tx=0x7fa85c014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f30a9d302f84cb4f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:53.343 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.341+0000 7fa83f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.105:3300/0 2023-10-06T03:02:53.343 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.341+0000 7fa83f7fe700 1 -- 172.21.15.57:0/3982357709 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa85c021070 con 0x1f36710 2023-10-06T03:02:53.343 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.341+0000 7fa83f7fe700 1 -- 172.21.15.57:0/3982357709 <== mon.1 v2:172.21.15.105:3300/0 2 ==== osd_map(54..54 src has 1..54) v4 ==== 6144+0+0 (secure 0 0 0) 0x7fa85c0354b0 con 0x1f36710 2023-10-06T03:02:53.343 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.341+0000 7fa869cc0740 1 -- 172.21.15.57:0/3982357709 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa850050b90 con 0x1f36710 2023-10-06T03:02:53.344 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.341+0000 7fa83f7fe700 1 -- 172.21.15.57:0/3982357709 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa85c035670 con 0x1f36710 2023-10-06T03:02:53.344 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.341+0000 7fa869cc0740 10 client.5578 fetch_fsmap learned FSMap version 34 2023-10-06T03:02:53.344 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.341+0000 7fa869cc0740 1 -- 172.21.15.57:0/3982357709 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=2+}) v3 -- 0x2092d80 con 0x1f36710 2023-10-06T03:02:53.345 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.341+0000 7fa83f7fe700 1 -- 172.21.15.57:0/3982357709 <== mon.1 v2:172.21.15.105:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa850050b90 con 0x1f36710 2023-10-06T03:02:53.345 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.341+0000 7fa83f7fe700 1 -- 172.21.15.57:0/3982357709 <== mon.1 v2:172.21.15.105:3300/0 5 ==== fsmap(e 34) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fa85c0357d0 con 0x1f36710 2023-10-06T03:02:53.345 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.341+0000 7fa869cc0740 10 client.5578 fetch_fsmap finished waiting for FSMap version 34 2023-10-06T03:02:53.345 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.341+0000 7fa869cc0740 10 client.5578 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T03:02:53.345 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.341+0000 7fa869cc0740 20 client.5578 populate_metadata read hostname 'smithi057' 2023-10-06T03:02:53.345 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.341+0000 7fa869cc0740 1 --2- 172.21.15.57:0/3982357709 >> [v2:172.21.15.57:6836/3347844181,v1:172.21.15.57:6837/3347844181] conn(0x2213110 0x22154f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:53.346 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.341+0000 7fa869cc0740 4 client.5578 mds_command: new command op to 5643 tid=0[{"prefix": "status"}] 2023-10-06T03:02:53.346 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.341+0000 7fa869cc0740 1 -- 172.21.15.57:0/3982357709 --> [v2:172.21.15.57:6836/3347844181,v1:172.21.15.57:6837/3347844181] -- command(tid 0: {"prefix": "status"}) v1 -- 0x20b2410 con 0x2213110 2023-10-06T03:02:53.346 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.341+0000 7fa864fc9700 1 --2- 172.21.15.57:0/3982357709 >> [v2:172.21.15.57:6836/3347844181,v1:172.21.15.57:6837/3347844181] conn(0x2213110 0x22154f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:53.346 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.341+0000 7fa864fc9700 1 --2- 172.21.15.57:0/3982357709 >> [v2:172.21.15.57:6836/3347844181,v1:172.21.15.57:6837/3347844181] conn(0x2213110 0x22154f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=16f3999aca051100 server_cookie=4340b9920faca5c9 in_seq=0 out_seq=0 2023-10-06T03:02:53.346 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.341+0000 7fa83f7fe700 10 client.5578 ms_handle_connect on v2:172.21.15.57:6836/3347844181 2023-10-06T03:02:53.346 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.345+0000 7fa83f7fe700 1 -- 172.21.15.57:0/3982357709 <== mds.0 v2:172.21.15.57:6836/3347844181 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+530 (crc 0 0 0) 0x20b2410 con 0x2213110 2023-10-06T03:02:53.346 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.345+0000 7fa83f7fe700 10 client.5578 handle_command_reply: tid=0 2023-10-06T03:02:53.347 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.345+0000 7fa869cc0740 1 client.5578 shutdown 2023-10-06T03:02:53.347 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.345+0000 7fa869cc0740 1 -- 172.21.15.57:0/3982357709 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x1f36710 msgr2=0x2194b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:53.348 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.345+0000 7fa869cc0740 1 --2- 172.21.15.57:0/3982357709 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x1f36710 0x2194b90 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fa85c016000 tx=0x7fa85c014000 comp rx=0 tx=0).stop 2023-10-06T03:02:53.348 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.345+0000 7fa869cc0740 1 -- 172.21.15.57:0/3982357709 shutdown_connections 2023-10-06T03:02:53.348 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.345+0000 7fa869cc0740 1 --2- 172.21.15.57:0/3982357709 >> [v2:172.21.15.57:6836/3347844181,v1:172.21.15.57:6837/3347844181] conn(0x2213110 0x22154f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:53.348 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.345+0000 7fa869cc0740 1 --2- 172.21.15.57:0/3982357709 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1f81790 0x2195610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:53.348 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.345+0000 7fa869cc0740 1 --2- 172.21.15.57:0/3982357709 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x1f36ae0 0x21950d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:53.348 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.345+0000 7fa83f7fe700 0 client.5578 ms_handle_reset on v2:172.21.15.57:6836/3347844181 2023-10-06T03:02:53.348 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.345+0000 7fa869cc0740 1 --2- 172.21.15.57:0/3982357709 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x1f36710 0x2194b90 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:53.348 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.345+0000 7fa869cc0740 1 -- 172.21.15.57:0/3982357709 >> 172.21.15.57:0/3982357709 conn(0x1f36eb0 msgr2=0x2169760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:53.348 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.345+0000 7fa869cc0740 1 -- 172.21.15.57:0/3982357709 shutdown_connections 2023-10-06T03:02:53.348 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.345+0000 7fa869cc0740 1 -- 172.21.15.57:0/3982357709 wait complete. 2023-10-06T03:02:53.348 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.345+0000 7fa869cc0740 20 client.5578 trim_cache size 0 max 16384 2023-10-06T03:02:53.349 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-10-06T03:02:53.349 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_fsid": "eb56dc0f-9213-41cb-9aad-8ade6c802e98", 2023-10-06T03:02:53.349 INFO:teuthology.orchestra.run.smithi057.stdout: "whoami": 0, 2023-10-06T03:02:53.349 INFO:teuthology.orchestra.run.smithi057.stdout: "id": 5643, 2023-10-06T03:02:53.349 INFO:teuthology.orchestra.run.smithi057.stdout: "want_state": "up:reconnect", 2023-10-06T03:02:53.349 INFO:teuthology.orchestra.run.smithi057.stdout: "state": "up:replay", 2023-10-06T03:02:53.349 INFO:teuthology.orchestra.run.smithi057.stdout: "fs_name": "cephfs", 2023-10-06T03:02:53.349 INFO:teuthology.orchestra.run.smithi057.stdout: "replay_status": { 2023-10-06T03:02:53.349 INFO:teuthology.orchestra.run.smithi057.stdout: "journal_read_pos": 4195454, 2023-10-06T03:02:53.350 INFO:teuthology.orchestra.run.smithi057.stdout: "journal_write_pos": 4195454, 2023-10-06T03:02:53.350 INFO:teuthology.orchestra.run.smithi057.stdout: "journal_expire_pos": 4194304, 2023-10-06T03:02:53.350 INFO:teuthology.orchestra.run.smithi057.stdout: "num_events": 2, 2023-10-06T03:02:53.350 INFO:teuthology.orchestra.run.smithi057.stdout: "num_segments": 1 2023-10-06T03:02:53.350 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-06T03:02:53.350 INFO:teuthology.orchestra.run.smithi057.stdout: "rank_uptime": 0.51327755100000005, 2023-10-06T03:02:53.350 INFO:teuthology.orchestra.run.smithi057.stdout: "mdsmap_epoch": 34, 2023-10-06T03:02:53.350 INFO:teuthology.orchestra.run.smithi057.stdout: "osdmap_epoch": 54, 2023-10-06T03:02:53.350 INFO:teuthology.orchestra.run.smithi057.stdout: "osdmap_epoch_barrier": 0, 2023-10-06T03:02:53.350 INFO:teuthology.orchestra.run.smithi057.stdout: "uptime": 0.94181318999999997 2023-10-06T03:02:53.350 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-10-06T03:02:53.351 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.345+0000 7fa8667cc700 1 -- 172.21.15.57:0/1118493393 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fa844060550 msgr2=0x7fa844062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:53.351 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.345+0000 7fa8667cc700 1 --2- 172.21.15.57:0/1118493393 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fa844060550 0x7fa844062a00 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fa85c0091e0 tx=0x7fa85c017000 comp rx=0 tx=0).stop 2023-10-06T03:02:53.351 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.345+0000 7fa8667cc700 1 -- 172.21.15.57:0/1118493393 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa8600c9ed0 msgr2=0x7fa86015ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:53.351 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.345+0000 7fa8667cc700 1 --2- 172.21.15.57:0/1118493393 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa8600c9ed0 0x7fa86015ac90 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fa85000e930 tx=0x7fa8500091a0 comp rx=0 tx=0).stop 2023-10-06T03:02:53.352 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.345+0000 7fa8667cc700 1 -- 172.21.15.57:0/1118493393 shutdown_connections 2023-10-06T03:02:53.352 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.345+0000 7fa8667cc700 1 --2- 172.21.15.57:0/1118493393 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fa844060550 0x7fa844062a00 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:53.352 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.345+0000 7fa8667cc700 1 --2- 172.21.15.57:0/1118493393 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa860161180 0x7fa86015b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:53.352 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.345+0000 7fa8667cc700 1 --2- 172.21.15.57:0/1118493393 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa8600c9ed0 0x7fa86015ac90 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:53.352 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.345+0000 7fa8667cc700 1 --2- 172.21.15.57:0/1118493393 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa8600c9b00 0x7fa8601562d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:53.352 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.345+0000 7fa8667cc700 1 -- 172.21.15.57:0/1118493393 >> 172.21.15.57:0/1118493393 conn(0x7fa860067b00 msgr2=0x7fa860156f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:53.352 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.345+0000 7fa8667cc700 1 -- 172.21.15.57:0/1118493393 shutdown_connections 2023-10-06T03:02:53.352 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:53.345+0000 7fa8667cc700 1 -- 172.21.15.57:0/1118493393 wait complete. 2023-10-06T03:02:54.371 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:02:54.535 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:54.533+0000 7f0b6180c700 1 Processor -- start 2023-10-06T03:02:54.536 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:54.533+0000 7f0b6180c700 1 -- start start 2023-10-06T03:02:54.538 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:54.533+0000 7f0b6180c700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0b5c159c80 0x7f0b5c15a050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:54.538 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:54.533+0000 7f0b6180c700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b5c0c77a0 con 0x7f0b5c155930 2023-10-06T03:02:54.538 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:54.533+0000 7f0b6180c700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b5c0c6b90 con 0x7f0b5c06eb70 2023-10-06T03:02:54.539 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:54.533+0000 7f0b6180c700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b5c0c7c30 con 0x7f0b5c159c80 2023-10-06T03:02:54.539 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:54.537+0000 7f0b6100b700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f0b5c155930 0x7f0b5c155db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:53410/0 (socket says 172.21.15.57:53410) 2023-10-06T03:02:54.539 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:54.537+0000 7f0b5bfff700 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f0b5c06eb70 0x7f0b5c0c6340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.57:37912/0 (socket says 172.21.15.57:37912) 2023-10-06T03:02:54.539 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:54.537+0000 7f0b6100b700 1 -- 172.21.15.57:0/1121212822 learned_addr learned my addr 172.21.15.57:0/1121212822 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:02:54.539 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:54.537+0000 7f0b6080a700 1 --2- 172.21.15.57:0/1121212822 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0b5c159c80 0x7f0b5c15a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:54.540 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:54.537+0000 7f0b5b7fe700 1 -- 172.21.15.57:0/1121212822 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 267759222 0 0) 0x7f0b5c0c6b90 con 0x7f0b5c06eb70 2023-10-06T03:02:54.540 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:54.537+0000 7f0b5b7fe700 1 -- 172.21.15.57:0/1121212822 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b4c003570 con 0x7f0b5c06eb70 2023-10-06T03:02:54.541 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:54.537+0000 7f0b5b7fe700 1 -- 172.21.15.57:0/1121212822 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 848052365 0 0) 0x7f0b5c0c77a0 con 0x7f0b5c155930 2023-10-06T03:02:54.541 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:54.537+0000 7f0b5b7fe700 1 -- 172.21.15.57:0/1121212822 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b5c0c6b90 con 0x7f0b5c155930 2023-10-06T03:02:54.541 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:54.537+0000 7f0b6080a700 1 -- 172.21.15.57:0/1121212822 >> v1:172.21.15.105:6789/0 conn(0x7f0b5c06eb70 legacy=0x7f0b5c0c6340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:54.541 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:54.537+0000 7f0b6080a700 1 -- 172.21.15.57:0/1121212822 >> v1:172.21.15.57:6789/0 conn(0x7f0b5c155930 legacy=0x7f0b5c155db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:54.541 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:54.537+0000 7f0b6080a700 1 -- 172.21.15.57:0/1121212822 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b5c0c6e70 con 0x7f0b5c159c80 2023-10-06T03:02:54.542 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:54.537+0000 7f0b6080a700 1 --2- 172.21.15.57:0/1121212822 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0b5c159c80 0x7f0b5c15a050 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0b50009910 tx=0x7f0b500091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1350e896fc68d61d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:54.542 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:54.537+0000 7f0b5b7fe700 1 -- 172.21.15.57:0/1121212822 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b50011630 con 0x7f0b5c159c80 2023-10-06T03:02:54.542 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:54.537+0000 7f0b5b7fe700 1 -- 172.21.15.57:0/1121212822 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b50011790 con 0x7f0b5c159c80 2023-10-06T03:02:54.542 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:54.537+0000 7f0b5b7fe700 1 -- 172.21.15.57:0/1121212822 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b50011b30 con 0x7f0b5c159c80 2023-10-06T03:02:54.543 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:54.537+0000 7f0b6180c700 1 -- 172.21.15.57:0/1121212822 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0b5c159c80 msgr2=0x7f0b5c15a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:54.543 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:54.537+0000 7f0b6180c700 1 --2- 172.21.15.57:0/1121212822 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0b5c159c80 0x7f0b5c15a050 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0b50009910 tx=0x7f0b500091a0 comp rx=0 tx=0).stop 2023-10-06T03:02:54.543 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:54.541+0000 7f0b6180c700 1 -- 172.21.15.57:0/1121212822 shutdown_connections 2023-10-06T03:02:54.543 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:54.541+0000 7f0b6180c700 1 --2- 172.21.15.57:0/1121212822 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0b5c159c80 0x7f0b5c15a050 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:54.543 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:54.541+0000 7f0b6180c700 1 -- 172.21.15.57:0/1121212822 >> 172.21.15.57:0/1121212822 conn(0x7f0b5c067b00 msgr2=0x7f0b5c0cbd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:54.543 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:54.541+0000 7f0b6180c700 1 -- 172.21.15.57:0/1121212822 shutdown_connections 2023-10-06T03:02:54.544 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:54.541+0000 7f0b6180c700 1 -- 172.21.15.57:0/1121212822 wait complete. 2023-10-06T03:02:54.544 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:54.541+0000 7f0b6180c700 1 Processor -- start 2023-10-06T03:02:54.545 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:54.541+0000 7f0b6180c700 1 -- start start 2023-10-06T03:02:54.546 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:54.541+0000 7f0b6180c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b5c06eb70 0x7f0b5c140750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:54.546 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:54.541+0000 7f0b6180c700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0b5c155930 0x7f0b5c14b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:54.546 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:54.541+0000 7f0b6180c700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0b5c159c80 0x7f0b5c14bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:54.546 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:54.541+0000 7f0b6180c700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b5c140c90 con 0x7f0b5c06eb70 2023-10-06T03:02:54.546 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:54.541+0000 7f0b6180c700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b5c0af8b0 con 0x7f0b5c159c80 2023-10-06T03:02:54.546 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:54.541+0000 7f0b6180c700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b5c0afb90 con 0x7f0b5c155930 2023-10-06T03:02:54.548 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:54.545+0000 7f0b6080a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b5c06eb70 0x7f0b5c140750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:54.548 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:54.545+0000 7f0b6080a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b5c06eb70 0x7f0b5c140750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33860/0 (socket says 172.21.15.57:33860) 2023-10-06T03:02:54.548 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:54.545+0000 7f0b6080a700 1 -- 172.21.15.57:0/2277318834 learned_addr learned my addr 172.21.15.57:0/2277318834 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:02:54.548 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:54.545+0000 7f0b5bfff700 1 --2- 172.21.15.57:0/2277318834 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0b5c155930 0x7f0b5c14b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:54.548 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:54.545+0000 7f0b6100b700 1 --2- 172.21.15.57:0/2277318834 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0b5c159c80 0x7f0b5c14bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:54.548 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:54.545+0000 7f0b6080a700 1 -- 172.21.15.57:0/2277318834 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0b5c155930 msgr2=0x7f0b5c14b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:54.548 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:54.545+0000 7f0b6080a700 1 --2- 172.21.15.57:0/2277318834 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0b5c155930 0x7f0b5c14b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:54.548 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:54.545+0000 7f0b6080a700 1 -- 172.21.15.57:0/2277318834 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0b5c159c80 msgr2=0x7f0b5c14bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:54.549 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:54.545+0000 7f0b6080a700 1 --2- 172.21.15.57:0/2277318834 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0b5c159c80 0x7f0b5c14bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:54.549 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:54.545+0000 7f0b6080a700 1 -- 172.21.15.57:0/2277318834 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b50009420 con 0x7f0b5c06eb70 2023-10-06T03:02:54.549 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:54.545+0000 7f0b6100b700 1 --2- 172.21.15.57:0/2277318834 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0b5c159c80 0x7f0b5c14bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:02:54.549 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:54.545+0000 7f0b6080a700 1 --2- 172.21.15.57:0/2277318834 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b5c06eb70 0x7f0b5c140750 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f0b50009f00 tx=0x7f0b50017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:54.549 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:54.545+0000 7f0b58ff9700 1 -- 172.21.15.57:0/2277318834 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b5001f070 con 0x7f0b5c06eb70 2023-10-06T03:02:54.550 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:54.545+0000 7f0b58ff9700 1 -- 172.21.15.57:0/2277318834 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b50000bc0 con 0x7f0b5c06eb70 2023-10-06T03:02:54.550 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:54.545+0000 7f0b58ff9700 1 -- 172.21.15.57:0/2277318834 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b50025420 con 0x7f0b5c06eb70 2023-10-06T03:02:54.550 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:54.545+0000 7f0b6180c700 1 -- 172.21.15.57:0/2277318834 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b5c0afe70 con 0x7f0b5c06eb70 2023-10-06T03:02:54.550 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:54.545+0000 7f0b6180c700 1 -- 172.21.15.57:0/2277318834 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b5c0b0430 con 0x7f0b5c06eb70 2023-10-06T03:02:54.550 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:54.545+0000 7f0b6180c700 1 -- 172.21.15.57:0/2277318834 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b5c0645e0 con 0x7f0b5c06eb70 2023-10-06T03:02:54.552 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:54.549+0000 7f0b58ff9700 1 -- 172.21.15.57:0/2277318834 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f0b50023070 con 0x7f0b5c06eb70 2023-10-06T03:02:54.553 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:54.549+0000 7f0b58ff9700 1 --2- 172.21.15.57:0/2277318834 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f0b40060550 0x7f0b40062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:54.554 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:54.549+0000 7f0b58ff9700 1 -- 172.21.15.57:0/2277318834 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6144+0+0 (secure 0 0 0) 0x7f0b5007dd80 con 0x7f0b5c06eb70 2023-10-06T03:02:54.554 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:54.549+0000 7f0b5bfff700 1 --2- 172.21.15.57:0/2277318834 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f0b40060550 0x7f0b40062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:54.555 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:54.553+0000 7f0b5bfff700 1 --2- 172.21.15.57:0/2277318834 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f0b40060550 0x7f0b40062a00 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c14d130 tx=0x7f0b48007d60 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:54.559 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:54.557+0000 7f0b58ff9700 1 -- 172.21.15.57:0/2277318834 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f0b5004e140 con 0x7f0b5c06eb70 2023-10-06T03:02:54.766 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:54.761+0000 7f0b6180c700 1 -- 172.21.15.57:0/2277318834 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0b5c0c5f10 con 0x7f0b5c06eb70 2023-10-06T03:02:54.767 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:54.765+0000 7f0b58ff9700 1 -- 172.21.15.57:0/2277318834 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+4601 (secure 0 0 0) 0x7f0b50015090 con 0x7f0b5c06eb70 2023-10-06T03:02:54.767 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:02:54.767 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":35,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5222,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/879829980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":879829980},{"type":"v1","addr":"172.21.15.105:6833","nonce":879829980}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5225,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/3705921279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":3705921279},{"type":"v1","addr":"172.21.15.105:6835","nonce":3705921279}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/251759282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":251759282},{"type":"v1","addr":"172.21.15.57:6835","nonce":251759282}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:02:39.274111+0000","modified":"2023-10-06T03:02:53.828017+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":54,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5643},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5643":{"gid":5643,"name":"c","rank":0,"incarnation":34,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.57:6837/3347844181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6836","nonce":3347844181},{"type":"v1","addr":"172.21.15.57:6837","nonce":3347844181}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T03:02:54.769 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:54.765+0000 7f0b6180c700 1 -- 172.21.15.57:0/2277318834 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f0b40060550 msgr2=0x7f0b40062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:54.770 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:54.765+0000 7f0b6180c700 1 --2- 172.21.15.57:0/2277318834 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f0b40060550 0x7f0b40062a00 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c14d130 tx=0x7f0b48007d60 comp rx=0 tx=0).stop 2023-10-06T03:02:54.770 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:54.765+0000 7f0b6180c700 1 -- 172.21.15.57:0/2277318834 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b5c06eb70 msgr2=0x7f0b5c140750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:54.770 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:54.765+0000 7f0b6180c700 1 --2- 172.21.15.57:0/2277318834 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b5c06eb70 0x7f0b5c140750 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f0b50009f00 tx=0x7f0b50017000 comp rx=0 tx=0).stop 2023-10-06T03:02:54.770 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:54.765+0000 7f0b6180c700 1 -- 172.21.15.57:0/2277318834 shutdown_connections 2023-10-06T03:02:54.770 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:54.765+0000 7f0b6180c700 1 --2- 172.21.15.57:0/2277318834 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0b5c159c80 0x7f0b5c14bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:54.770 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:54.765+0000 7f0b6180c700 1 --2- 172.21.15.57:0/2277318834 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f0b40060550 0x7f0b40062a00 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:54.770 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:54.765+0000 7f0b6180c700 1 --2- 172.21.15.57:0/2277318834 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0b5c155930 0x7f0b5c14b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:54.770 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:54.765+0000 7f0b6180c700 1 --2- 172.21.15.57:0/2277318834 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b5c06eb70 0x7f0b5c140750 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:54.770 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:54.765+0000 7f0b6180c700 1 -- 172.21.15.57:0/2277318834 >> 172.21.15.57:0/2277318834 conn(0x7f0b5c067b00 msgr2=0x7f0b5c0c8680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:54.771 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:54.765+0000 7f0b6180c700 1 -- 172.21.15.57:0/2277318834 shutdown_connections 2023-10-06T03:02:54.771 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:54.765+0000 7f0b6180c700 1 -- 172.21.15.57:0/2277318834 wait complete. 2023-10-06T03:02:54.773 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 35 2023-10-06T03:02:55.192 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 35, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T03:02:39.274111+0000', 'modified': '2023-10-06T03:02:53.828017+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 54, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5643}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5643': {'gid': 5643, 'name': 'c', 'rank': 0, 'incarnation': 34, 'state': 'up:reconnect', 'state_seq': 2, 'addr': '172.21.15.57:6837/3347844181', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6836', 'nonce': 3347844181}, {'type': 'v1', 'addr': '172.21.15.57:6837', 'nonce': 3347844181}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T03:02:55.192 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5643:up:reconnect 2023-10-06T03:02:56.193 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:02:56.362 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:56.357+0000 7fe7f6b45700 1 Processor -- start 2023-10-06T03:02:56.363 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:56.361+0000 7fe7f6b45700 1 -- start start 2023-10-06T03:02:56.365 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:56.361+0000 7fe7f6b45700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe7f00c6510 0x7fe7f006d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:56.366 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:56.361+0000 7fe7f6b45700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe7f00c0c70 0x7fe7f00c2540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:56.366 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:56.361+0000 7fe7f6b45700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7f00c14a0 con 0x7fe7f00c2a80 2023-10-06T03:02:56.366 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:56.361+0000 7fe7f6b45700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7f00c1780 con 0x7fe7f00c6510 2023-10-06T03:02:56.366 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:56.361+0000 7fe7f6b45700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f00c1a60 con 0x7fe7f00c0c70 2023-10-06T03:02:56.367 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:56.361+0000 7fe7f48e1700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe7f00c6510 0x7fe7f006d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:56.367 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:56.361+0000 7fe7f48e1700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe7f00c6510 0x7fe7f006d0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33874/0 (socket says 172.21.15.57:33874) 2023-10-06T03:02:56.367 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:56.361+0000 7fe7f48e1700 1 -- 172.21.15.57:0/4192949080 learned_addr learned my addr 172.21.15.57:0/4192949080 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:02:56.367 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:56.361+0000 7fe7f50e2700 1 --1- 172.21.15.57:0/4192949080 >> v1:172.21.15.57:6789/0 conn(0x7fe7f00c2a80 0x7fe7f00aec90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:53414/0 (socket says 172.21.15.57:53414) 2023-10-06T03:02:56.367 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:56.361+0000 7fe7effff700 1 --2- 172.21.15.57:0/4192949080 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe7f00c0c70 0x7fe7f00c2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:56.368 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:56.365+0000 7fe7f48e1700 1 -- 172.21.15.57:0/4192949080 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe7f00c0c70 msgr2=0x7fe7f00c2540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:56.368 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:56.365+0000 7fe7f48e1700 1 --2- 172.21.15.57:0/4192949080 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe7f00c0c70 0x7fe7f00c2540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:56.368 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:56.365+0000 7fe7f48e1700 1 -- 172.21.15.57:0/4192949080 >> v1:172.21.15.57:6789/0 conn(0x7fe7f00c2a80 legacy=0x7fe7f00aec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:56.368 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:56.365+0000 7fe7f48e1700 1 -- 172.21.15.57:0/4192949080 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7f00c1d40 con 0x7fe7f00c6510 2023-10-06T03:02:56.369 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:56.365+0000 7fe7f48e1700 1 --2- 172.21.15.57:0/4192949080 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7f00c6510 0x7fe7f006d0d0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fe7e40099a0 tx=0x7fe7e4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bd279f03f3daf36 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:56.369 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:56.365+0000 7fe7ef7fe700 1 -- 172.21.15.57:0/4192949080 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7e4009e90 con 0x7fe7f00c6510 2023-10-06T03:02:56.369 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:56.365+0000 7fe7ef7fe700 1 -- 172.21.15.57:0/4192949080 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7e400b860 con 0x7fe7f00c6510 2023-10-06T03:02:56.369 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:56.365+0000 7fe7ef7fe700 1 -- 172.21.15.57:0/4192949080 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7e400bc20 con 0x7fe7f00c6510 2023-10-06T03:02:56.369 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:56.365+0000 7fe7f6b45700 1 -- 172.21.15.57:0/4192949080 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7f00c6510 msgr2=0x7fe7f006d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:56.369 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:56.365+0000 7fe7f6b45700 1 --2- 172.21.15.57:0/4192949080 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7f00c6510 0x7fe7f006d0d0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fe7e40099a0 tx=0x7fe7e4009250 comp rx=0 tx=0).stop 2023-10-06T03:02:56.370 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:56.365+0000 7fe7f6b45700 1 -- 172.21.15.57:0/4192949080 shutdown_connections 2023-10-06T03:02:56.370 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:56.365+0000 7fe7f6b45700 1 --2- 172.21.15.57:0/4192949080 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe7f00c0c70 0x7fe7f00c2540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:56.370 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:56.365+0000 7fe7f6b45700 1 --2- 172.21.15.57:0/4192949080 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7f00c6510 0x7fe7f006d0d0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:56.371 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:56.365+0000 7fe7f6b45700 1 -- 172.21.15.57:0/4192949080 >> 172.21.15.57:0/4192949080 conn(0x7fe7f00cbed0 msgr2=0x7fe7f00cc2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:56.371 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:56.365+0000 7fe7f6b45700 1 -- 172.21.15.57:0/4192949080 shutdown_connections 2023-10-06T03:02:56.371 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:56.365+0000 7fe7f6b45700 1 -- 172.21.15.57:0/4192949080 wait complete. 2023-10-06T03:02:56.371 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:56.369+0000 7fe7f6b45700 1 Processor -- start 2023-10-06T03:02:56.372 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:56.369+0000 7fe7f6b45700 1 -- start start 2023-10-06T03:02:56.373 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:56.369+0000 7fe7f6b45700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe7f00c0c70 0x7fe7f00c49e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:56.373 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:56.369+0000 7fe7f6b45700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe7f00c2a80 0x7fe7f0158ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:56.373 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:56.369+0000 7fe7f6b45700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7f00c6510 0x7fe7f013b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:56.373 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:56.369+0000 7fe7f6b45700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f00c4f20 con 0x7fe7f00c6510 2023-10-06T03:02:56.373 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:56.369+0000 7fe7f6b45700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f0158ff0 con 0x7fe7f00c2a80 2023-10-06T03:02:56.374 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:56.369+0000 7fe7f6b45700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f016d340 con 0x7fe7f00c0c70 2023-10-06T03:02:56.374 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:56.369+0000 7fe7f50e2700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7f00c6510 0x7fe7f013b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:56.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:56.369+0000 7fe7f50e2700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7f00c6510 0x7fe7f013b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33880/0 (socket says 172.21.15.57:33880) 2023-10-06T03:02:56.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:56.369+0000 7fe7f50e2700 1 -- 172.21.15.57:0/2735791497 learned_addr learned my addr 172.21.15.57:0/2735791497 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:02:56.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:56.369+0000 7fe7f48e1700 1 --2- 172.21.15.57:0/2735791497 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe7f00c0c70 0x7fe7f00c49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:56.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:56.369+0000 7fe7effff700 1 --2- 172.21.15.57:0/2735791497 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe7f00c2a80 0x7fe7f0158ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:56.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:56.369+0000 7fe7f50e2700 1 -- 172.21.15.57:0/2735791497 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe7f00c0c70 msgr2=0x7fe7f00c49e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:56.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:56.369+0000 7fe7f50e2700 1 --2- 172.21.15.57:0/2735791497 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe7f00c0c70 0x7fe7f00c49e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:56.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:56.369+0000 7fe7f50e2700 1 -- 172.21.15.57:0/2735791497 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe7f00c2a80 msgr2=0x7fe7f0158ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:56.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:56.369+0000 7fe7f50e2700 1 --2- 172.21.15.57:0/2735791497 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe7f00c2a80 0x7fe7f0158ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:56.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:56.373+0000 7fe7f50e2700 1 -- 172.21.15.57:0/2735791497 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7e4009490 con 0x7fe7f00c6510 2023-10-06T03:02:56.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:56.373+0000 7fe7f50e2700 1 --2- 172.21.15.57:0/2735791497 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7f00c6510 0x7fe7f013b9d0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fe7e800cd30 tx=0x7fe7e8001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:56.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:56.373+0000 7fe7ecff9700 1 -- 172.21.15.57:0/2735791497 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7e800ce30 con 0x7fe7f00c6510 2023-10-06T03:02:56.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:56.373+0000 7fe7ecff9700 1 -- 172.21.15.57:0/2735791497 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7e8005df0 con 0x7fe7f00c6510 2023-10-06T03:02:56.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:56.373+0000 7fe7f6b45700 1 -- 172.21.15.57:0/2735791497 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7f016d620 con 0x7fe7f00c6510 2023-10-06T03:02:56.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:56.373+0000 7fe7ecff9700 1 -- 172.21.15.57:0/2735791497 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7e800ab00 con 0x7fe7f00c6510 2023-10-06T03:02:56.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:56.373+0000 7fe7f6b45700 1 -- 172.21.15.57:0/2735791497 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7f016dbe0 con 0x7fe7f00c6510 2023-10-06T03:02:56.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:56.373+0000 7fe7f6b45700 1 -- 172.21.15.57:0/2735791497 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7f006b970 con 0x7fe7f00c6510 2023-10-06T03:02:56.379 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:56.377+0000 7fe7ecff9700 1 -- 172.21.15.57:0/2735791497 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fe7e80070f0 con 0x7fe7f00c6510 2023-10-06T03:02:56.380 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:56.377+0000 7fe7ecff9700 1 --2- 172.21.15.57:0/2735791497 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fe7dc060550 0x7fe7dc062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:56.380 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:56.377+0000 7fe7ecff9700 1 -- 172.21.15.57:0/2735791497 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6144+0+0 (secure 0 0 0) 0x7fe7e807ca30 con 0x7fe7f00c6510 2023-10-06T03:02:56.381 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:56.377+0000 7fe7f48e1700 1 --2- 172.21.15.57:0/2735791497 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fe7dc060550 0x7fe7dc062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:56.381 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:56.377+0000 7fe7f48e1700 1 --2- 172.21.15.57:0/2735791497 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fe7dc060550 0x7fe7dc062a00 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fe7e40099a0 tx=0x7fe7e4017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:56.387 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:56.385+0000 7fe7ecff9700 1 -- 172.21.15.57:0/2735791497 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fe7e804ce70 con 0x7fe7f00c6510 2023-10-06T03:02:56.592 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:56.589+0000 7fe7f6b45700 1 -- 172.21.15.57:0/2735791497 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe7f00c50c0 con 0x7fe7f00c6510 2023-10-06T03:02:56.593 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:56.589+0000 7fe7ecff9700 1 -- 172.21.15.57:0/2735791497 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+4604 (secure 0 0 0) 0x7fe7e8050490 con 0x7fe7f00c6510 2023-10-06T03:02:56.594 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:02:56.594 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":37,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5222,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/879829980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":879829980},{"type":"v1","addr":"172.21.15.105:6833","nonce":879829980}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5225,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/3705921279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":3705921279},{"type":"v1","addr":"172.21.15.105:6835","nonce":3705921279}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/251759282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":251759282},{"type":"v1","addr":"172.21.15.57:6835","nonce":251759282}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:02:39.274111+0000","modified":"2023-10-06T03:02:55.845135+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":54,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5643},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5643":{"gid":5643,"name":"c","rank":0,"incarnation":34,"state":"up:clientreplay","state_seq":4,"addr":"172.21.15.57:6837/3347844181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6836","nonce":3347844181},{"type":"v1","addr":"172.21.15.57:6837","nonce":3347844181}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T03:02:56.596 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:56.593+0000 7fe7f6b45700 1 -- 172.21.15.57:0/2735791497 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fe7dc060550 msgr2=0x7fe7dc062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:56.596 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:56.593+0000 7fe7f6b45700 1 --2- 172.21.15.57:0/2735791497 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fe7dc060550 0x7fe7dc062a00 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fe7e40099a0 tx=0x7fe7e4017000 comp rx=0 tx=0).stop 2023-10-06T03:02:56.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:56.593+0000 7fe7f6b45700 1 -- 172.21.15.57:0/2735791497 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7f00c6510 msgr2=0x7fe7f013b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:56.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:56.593+0000 7fe7f6b45700 1 --2- 172.21.15.57:0/2735791497 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7f00c6510 0x7fe7f013b9d0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fe7e800cd30 tx=0x7fe7e8001ab0 comp rx=0 tx=0).stop 2023-10-06T03:02:56.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:56.593+0000 7fe7f6b45700 1 -- 172.21.15.57:0/2735791497 shutdown_connections 2023-10-06T03:02:56.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:56.593+0000 7fe7f6b45700 1 --2- 172.21.15.57:0/2735791497 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7f00c6510 0x7fe7f013b9d0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:56.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:56.593+0000 7fe7f6b45700 1 --2- 172.21.15.57:0/2735791497 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe7f00c2a80 0x7fe7f0158ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:56.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:56.593+0000 7fe7f6b45700 1 --2- 172.21.15.57:0/2735791497 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fe7dc060550 0x7fe7dc062a00 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:56.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:56.593+0000 7fe7f6b45700 1 --2- 172.21.15.57:0/2735791497 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe7f00c0c70 0x7fe7f00c49e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:56.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:56.593+0000 7fe7f6b45700 1 -- 172.21.15.57:0/2735791497 >> 172.21.15.57:0/2735791497 conn(0x7fe7f00cbed0 msgr2=0x7fe7f013ffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:56.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:56.593+0000 7fe7f6b45700 1 -- 172.21.15.57:0/2735791497 shutdown_connections 2023-10-06T03:02:56.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:56.593+0000 7fe7f6b45700 1 -- 172.21.15.57:0/2735791497 wait complete. 2023-10-06T03:02:56.598 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 37 2023-10-06T03:02:57.020 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 37, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T03:02:39.274111+0000', 'modified': '2023-10-06T03:02:55.845135+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 54, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5643}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5643': {'gid': 5643, 'name': 'c', 'rank': 0, 'incarnation': 34, 'state': 'up:clientreplay', 'state_seq': 4, 'addr': '172.21.15.57:6837/3347844181', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6836', 'nonce': 3347844181}, {'type': 'v1', 'addr': '172.21.15.57:6837', 'nonce': 3347844181}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T03:02:57.020 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5643:up:clientreplay 2023-10-06T03:02:57.836 INFO:tasks.ceph.mds.c.smithi057.stderr:2023-10-06T03:02:57.833+0000 7f4ba9df1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T03:02:58.021 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:02:58.187 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:58.185+0000 7f72aebc5700 1 Processor -- start 2023-10-06T03:02:58.187 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:58.185+0000 7f72aebc5700 1 -- start start 2023-10-06T03:02:58.191 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:58.189+0000 7f72aebc5700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f72a8155e10 0x7f72a80c0c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:58.191 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:58.189+0000 7f72aebc5700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f72a81561e0 0x7f72a8159c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:58.192 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:58.189+0000 7f72aebc5700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72a80c7e70 con 0x7f72a815a160 2023-10-06T03:02:58.192 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:58.189+0000 7f72aebc5700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72a80c11b0 con 0x7f72a8155e10 2023-10-06T03:02:58.192 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:58.189+0000 7f72aebc5700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72a80c7260 con 0x7f72a81561e0 2023-10-06T03:02:58.192 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:58.189+0000 7f72ac961700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f72a8155e10 0x7f72a80c0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:58.192 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:58.189+0000 7f72ac961700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f72a8155e10 0x7f72a80c0c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33886/0 (socket says 172.21.15.57:33886) 2023-10-06T03:02:58.192 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:58.189+0000 7f72ac961700 1 -- 172.21.15.57:0/4228589633 learned_addr learned my addr 172.21.15.57:0/4228589633 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:02:58.193 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:58.189+0000 7f72a7fff700 1 --2- 172.21.15.57:0/4228589633 >> v2:172.21.15.105:3300/0 conn(0x7f72a81561e0 0x7f72a8159c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:58.193 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:58.189+0000 7f72ac961700 1 -- 172.21.15.57:0/4228589633 >> v2:172.21.15.105:3300/0 conn(0x7f72a81561e0 msgr2=0x7f72a8159c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:58.193 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:58.189+0000 7f72ac961700 1 --2- 172.21.15.57:0/4228589633 >> v2:172.21.15.105:3300/0 conn(0x7f72a81561e0 0x7f72a8159c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:58.193 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:58.189+0000 7f72ac961700 1 -- 172.21.15.57:0/4228589633 >> v1:172.21.15.105:6789/0 conn(0x7f72a815a160 legacy=0x7f72a806d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:58.193 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:58.189+0000 7f72ac961700 1 -- 172.21.15.57:0/4228589633 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72a80c7540 con 0x7f72a8155e10 2023-10-06T03:02:58.193 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:58.189+0000 7f72a7fff700 1 --2- 172.21.15.57:0/4228589633 >> v2:172.21.15.105:3300/0 conn(0x7f72a81561e0 0x7f72a8159c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:02:58.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:58.189+0000 7f72ac961700 1 --2- 172.21.15.57:0/4228589633 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f72a8155e10 0x7f72a80c0c70 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f72a806c9e0 tx=0x7f729c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3a1e1c84357a2e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:58.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:58.189+0000 7f72a77fe700 1 -- 172.21.15.57:0/4228589633 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f729c00b860 con 0x7f72a8155e10 2023-10-06T03:02:58.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:58.189+0000 7f72a77fe700 1 -- 172.21.15.57:0/4228589633 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f729c00b9c0 con 0x7f72a8155e10 2023-10-06T03:02:58.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:58.189+0000 7f72a77fe700 1 -- 172.21.15.57:0/4228589633 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f729c00bd60 con 0x7f72a8155e10 2023-10-06T03:02:58.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:58.193+0000 7f72aebc5700 1 -- 172.21.15.57:0/4228589633 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f72a8155e10 msgr2=0x7f72a80c0c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:58.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:58.193+0000 7f72aebc5700 1 --2- 172.21.15.57:0/4228589633 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f72a8155e10 0x7f72a80c0c70 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f72a806c9e0 tx=0x7f729c009250 comp rx=0 tx=0).stop 2023-10-06T03:02:58.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:58.193+0000 7f72aebc5700 1 -- 172.21.15.57:0/4228589633 shutdown_connections 2023-10-06T03:02:58.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:58.193+0000 7f72aebc5700 1 --2- 172.21.15.57:0/4228589633 >> v2:172.21.15.105:3300/0 conn(0x7f72a81561e0 0x7f72a8159c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:58.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:58.193+0000 7f72aebc5700 1 --2- 172.21.15.57:0/4228589633 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f72a8155e10 0x7f72a80c0c70 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:58.196 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:58.193+0000 7f72aebc5700 1 -- 172.21.15.57:0/4228589633 >> 172.21.15.57:0/4228589633 conn(0x7f72a80cbed0 msgr2=0x7f72a80cc2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:58.196 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:58.193+0000 7f72aebc5700 1 -- 172.21.15.57:0/4228589633 shutdown_connections 2023-10-06T03:02:58.196 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:58.193+0000 7f72aebc5700 1 -- 172.21.15.57:0/4228589633 wait complete. 2023-10-06T03:02:58.197 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:58.193+0000 7f72aebc5700 1 Processor -- start 2023-10-06T03:02:58.198 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:58.193+0000 7f72aebc5700 1 -- start start 2023-10-06T03:02:58.200 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:58.197+0000 7f72aebc5700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f72a8155e10 0x7f72a81568c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:58.200 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:58.197+0000 7f72aebc5700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f72a81561e0 0x7f72a80ad0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:58.200 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:58.197+0000 7f72aebc5700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f72a815a160 0x7f72a8140530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:58.200 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:58.197+0000 7f72aebc5700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72a80af7d0 con 0x7f72a8155e10 2023-10-06T03:02:58.200 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:58.197+0000 7f72aebc5700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72a80afab0 con 0x7f72a81561e0 2023-10-06T03:02:58.200 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:58.197+0000 7f72aebc5700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72a80ada80 con 0x7f72a815a160 2023-10-06T03:02:58.200 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:58.197+0000 7f72ac961700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f72a8155e10 0x7f72a81568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:58.201 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:58.197+0000 7f72ac961700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f72a8155e10 0x7f72a81568c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33900/0 (socket says 172.21.15.57:33900) 2023-10-06T03:02:58.201 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:58.197+0000 7f72ac961700 1 -- 172.21.15.57:0/3004056283 learned_addr learned my addr 172.21.15.57:0/3004056283 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:02:58.201 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:58.197+0000 7f72a7fff700 1 --2- 172.21.15.57:0/3004056283 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f72a81561e0 0x7f72a80ad0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:58.202 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:58.197+0000 7f72ad162700 1 --2- 172.21.15.57:0/3004056283 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f72a815a160 0x7f72a8140530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:58.202 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:58.197+0000 7f72ac961700 1 -- 172.21.15.57:0/3004056283 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f72a815a160 msgr2=0x7f72a8140530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:58.202 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:58.197+0000 7f72ac961700 1 --2- 172.21.15.57:0/3004056283 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f72a815a160 0x7f72a8140530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:58.202 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:58.197+0000 7f72ac961700 1 -- 172.21.15.57:0/3004056283 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f72a81561e0 msgr2=0x7f72a80ad0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:58.202 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:58.197+0000 7f72ac961700 1 --2- 172.21.15.57:0/3004056283 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f72a81561e0 0x7f72a80ad0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:58.202 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:58.197+0000 7f72ac961700 1 -- 172.21.15.57:0/3004056283 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f729c009490 con 0x7f72a8155e10 2023-10-06T03:02:58.202 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:58.197+0000 7f72ac961700 1 --2- 172.21.15.57:0/3004056283 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f72a8155e10 0x7f72a81568c0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f729c0090b0 tx=0x7f729c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:58.203 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:58.197+0000 7f72a4ff9700 1 -- 172.21.15.57:0/3004056283 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f729c00b860 con 0x7f72a8155e10 2023-10-06T03:02:58.203 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:58.197+0000 7f72a4ff9700 1 -- 172.21.15.57:0/3004056283 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f729c01f070 con 0x7f72a8155e10 2023-10-06T03:02:58.203 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:58.197+0000 7f72aebc5700 1 -- 172.21.15.57:0/3004056283 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72a80add60 con 0x7f72a8155e10 2023-10-06T03:02:58.203 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:58.201+0000 7f72a4ff9700 1 -- 172.21.15.57:0/3004056283 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f729c026480 con 0x7f72a8155e10 2023-10-06T03:02:58.203 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:58.201+0000 7f72aebc5700 1 -- 172.21.15.57:0/3004056283 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72a8156e00 con 0x7f72a8155e10 2023-10-06T03:02:58.205 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:58.201+0000 7f72aebc5700 1 -- 172.21.15.57:0/3004056283 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72a8156ff0 con 0x7f72a8155e10 2023-10-06T03:02:58.206 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:58.201+0000 7f72a4ff9700 1 -- 172.21.15.57:0/3004056283 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f729c01a430 con 0x7f72a8155e10 2023-10-06T03:02:58.207 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:58.205+0000 7f72a4ff9700 1 --2- 172.21.15.57:0/3004056283 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f728c060580 0x7f728c062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:58.207 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:58.205+0000 7f72a4ff9700 1 -- 172.21.15.57:0/3004056283 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6144+0+0 (secure 0 0 0) 0x7f729c021070 con 0x7f72a8155e10 2023-10-06T03:02:58.208 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:58.205+0000 7f72a7fff700 1 --2- 172.21.15.57:0/3004056283 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f728c060580 0x7f728c062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:58.209 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:58.205+0000 7f72a7fff700 1 --2- 172.21.15.57:0/3004056283 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f728c060580 0x7f728c062a30 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f72a816d320 tx=0x7f7294008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:58.213 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:58.209+0000 7f72a4ff9700 1 -- 172.21.15.57:0/3004056283 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f729c04ebb0 con 0x7f72a8155e10 2023-10-06T03:02:58.422 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:58.417+0000 7f72aebc5700 1 -- 172.21.15.57:0/3004056283 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f72a80c7820 con 0x7f72a8155e10 2023-10-06T03:02:58.423 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:58.421+0000 7f72a4ff9700 1 -- 172.21.15.57:0/3004056283 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4598 (secure 0 0 0) 0x7f729c0521d0 con 0x7f72a8155e10 2023-10-06T03:02:58.424 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:02:58.424 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":38,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5222,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/879829980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":879829980},{"type":"v1","addr":"172.21.15.105:6833","nonce":879829980}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5225,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/3705921279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":3705921279},{"type":"v1","addr":"172.21.15.105:6835","nonce":3705921279}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/251759282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":251759282},{"type":"v1","addr":"172.21.15.57:6835","nonce":251759282}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:02:39.274111+0000","modified":"2023-10-06T03:02:56.856783+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":54,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5643},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5643":{"gid":5643,"name":"c","rank":0,"incarnation":34,"state":"up:active","state_seq":5,"addr":"172.21.15.57:6837/3347844181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6836","nonce":3347844181},{"type":"v1","addr":"172.21.15.57:6837","nonce":3347844181}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T03:02:58.428 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:58.425+0000 7f72aebc5700 1 -- 172.21.15.57:0/3004056283 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f728c060580 msgr2=0x7f728c062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:58.428 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:58.425+0000 7f72aebc5700 1 --2- 172.21.15.57:0/3004056283 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f728c060580 0x7f728c062a30 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f72a816d320 tx=0x7f7294008040 comp rx=0 tx=0).stop 2023-10-06T03:02:58.428 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:58.425+0000 7f72aebc5700 1 -- 172.21.15.57:0/3004056283 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f72a8155e10 msgr2=0x7f72a81568c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:58.428 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:58.425+0000 7f72aebc5700 1 --2- 172.21.15.57:0/3004056283 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f72a8155e10 0x7f72a81568c0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f729c0090b0 tx=0x7f729c017000 comp rx=0 tx=0).stop 2023-10-06T03:02:58.428 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:58.425+0000 7f72aebc5700 1 -- 172.21.15.57:0/3004056283 shutdown_connections 2023-10-06T03:02:58.428 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:58.425+0000 7f72aebc5700 1 --2- 172.21.15.57:0/3004056283 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f728c060580 0x7f728c062a30 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:58.428 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:58.425+0000 7f72aebc5700 1 --2- 172.21.15.57:0/3004056283 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f72a815a160 0x7f72a8140530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:58.429 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:58.425+0000 7f72aebc5700 1 --2- 172.21.15.57:0/3004056283 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f72a81561e0 0x7f72a80ad0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:58.429 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:58.425+0000 7f72aebc5700 1 --2- 172.21.15.57:0/3004056283 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f72a8155e10 0x7f72a81568c0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:58.429 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:58.425+0000 7f72aebc5700 1 -- 172.21.15.57:0/3004056283 >> 172.21.15.57:0/3004056283 conn(0x7f72a80cbed0 msgr2=0x7f72a80c9aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:58.429 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:58.425+0000 7f72aebc5700 1 -- 172.21.15.57:0/3004056283 shutdown_connections 2023-10-06T03:02:58.429 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:58.425+0000 7f72aebc5700 1 -- 172.21.15.57:0/3004056283 wait complete. 2023-10-06T03:02:58.431 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 38 2023-10-06T03:02:58.851 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 38, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T03:02:39.274111+0000', 'modified': '2023-10-06T03:02:56.856783+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 54, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5643}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5643': {'gid': 5643, 'name': 'c', 'rank': 0, 'incarnation': 34, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.57:6837/3347844181', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6836', 'nonce': 3347844181}, {'type': 'v1', 'addr': '172.21.15.57:6837', 'nonce': 3347844181}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T03:02:58.851 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T03:02:58.851 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-06T03:02:59.019 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.017+0000 7fc9e7878700 1 Processor -- start 2023-10-06T03:02:59.020 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.017+0000 7fc9e7878700 1 -- start start 2023-10-06T03:02:59.022 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.017+0000 7fc9e7878700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc9e00c6510 0x7fc9e006d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:59.022 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.017+0000 7fc9e7878700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fc9e00aec90 0x7fc9e00af0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:59.022 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.017+0000 7fc9e7878700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9e00af5f0 con 0x7fc9e00c0c70 2023-10-06T03:02:59.023 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.017+0000 7fc9e7878700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9e00c14a0 con 0x7fc9e00c6510 2023-10-06T03:02:59.023 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.017+0000 7fc9e7878700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9e00c1780 con 0x7fc9e00aec90 2023-10-06T03:02:59.023 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.021+0000 7fc9e4e13700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fc9e00c0c70 0x7fc9e00c2540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:53416/0 (socket says 172.21.15.57:53416) 2023-10-06T03:02:59.023 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.021+0000 7fc9e4e13700 1 -- 172.21.15.57:0/2076644352 learned_addr learned my addr 172.21.15.57:0/2076644352 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:02:59.023 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.021+0000 7fc9e5614700 1 --2- 172.21.15.57:0/2076644352 >> v2:172.21.15.57:3300/0 conn(0x7fc9e00c6510 0x7fc9e006d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:59.024 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.021+0000 7fc9e5e15700 1 --2- 172.21.15.57:0/2076644352 >> v2:172.21.15.105:3300/0 conn(0x7fc9e00aec90 0x7fc9e00af0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:59.024 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.021+0000 7fc9d7fff700 1 -- 172.21.15.57:0/2076644352 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2186793921 0 0) 0x7fc9d0001110 con 0x7fc9e00c0c70 2023-10-06T03:02:59.024 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.021+0000 7fc9d7fff700 1 -- 172.21.15.57:0/2076644352 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9cc003570 con 0x7fc9e00c0c70 2023-10-06T03:02:59.024 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.021+0000 7fc9e5614700 1 -- 172.21.15.57:0/2076644352 >> v2:172.21.15.105:3300/0 conn(0x7fc9e00aec90 msgr2=0x7fc9e00af0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:59.024 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.021+0000 7fc9e5614700 1 --2- 172.21.15.57:0/2076644352 >> v2:172.21.15.105:3300/0 conn(0x7fc9e00aec90 0x7fc9e00af0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:59.025 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.021+0000 7fc9e5614700 1 -- 172.21.15.57:0/2076644352 >> v1:172.21.15.57:6789/0 conn(0x7fc9e00c0c70 legacy=0x7fc9e00c2540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:59.025 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.021+0000 7fc9e5614700 1 -- 172.21.15.57:0/2076644352 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9e00c1a60 con 0x7fc9e00c6510 2023-10-06T03:02:59.025 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.021+0000 7fc9e5614700 1 --2- 172.21.15.57:0/2076644352 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc9e00c6510 0x7fc9e006d0d0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fc9e006cc80 tx=0x7fc9dc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8838c0d36b164ee9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:59.025 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.021+0000 7fc9d7fff700 1 -- 172.21.15.57:0/2076644352 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9dc011630 con 0x7fc9e00c6510 2023-10-06T03:02:59.025 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.021+0000 7fc9d7fff700 1 -- 172.21.15.57:0/2076644352 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9dc011790 con 0x7fc9e00c6510 2023-10-06T03:02:59.026 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.021+0000 7fc9d7fff700 1 -- 172.21.15.57:0/2076644352 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9dc011b30 con 0x7fc9e00c6510 2023-10-06T03:02:59.027 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.025+0000 7fc9e7878700 1 -- 172.21.15.57:0/2076644352 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc9e00c6510 msgr2=0x7fc9e006d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:59.027 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.025+0000 7fc9e7878700 1 --2- 172.21.15.57:0/2076644352 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc9e00c6510 0x7fc9e006d0d0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fc9e006cc80 tx=0x7fc9dc0091a0 comp rx=0 tx=0).stop 2023-10-06T03:02:59.027 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.025+0000 7fc9e7878700 1 -- 172.21.15.57:0/2076644352 shutdown_connections 2023-10-06T03:02:59.027 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.025+0000 7fc9e7878700 1 --2- 172.21.15.57:0/2076644352 >> v2:172.21.15.105:3300/0 conn(0x7fc9e00aec90 0x7fc9e00af0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:59.028 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.025+0000 7fc9e7878700 1 --2- 172.21.15.57:0/2076644352 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc9e00c6510 0x7fc9e006d0d0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:59.028 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.025+0000 7fc9e7878700 1 -- 172.21.15.57:0/2076644352 >> 172.21.15.57:0/2076644352 conn(0x7fc9e00cbed0 msgr2=0x7fc9e00cc2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:59.028 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.025+0000 7fc9e7878700 1 -- 172.21.15.57:0/2076644352 shutdown_connections 2023-10-06T03:02:59.028 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.025+0000 7fc9e7878700 1 -- 172.21.15.57:0/2076644352 wait complete. 2023-10-06T03:02:59.030 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.025+0000 7fc9e7878700 1 Processor -- start 2023-10-06T03:02:59.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.029+0000 7fc9e7878700 1 -- start start 2023-10-06T03:02:59.033 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.029+0000 7fc9e7878700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc9e00aec90 0x7fc9e013dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:59.033 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.029+0000 7fc9e7878700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc9e00c0c70 0x7fc9e00c48a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:59.033 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.029+0000 7fc9e7878700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc9e00c6510 0x7fc9e015bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:59.033 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.029+0000 7fc9e7878700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9e013e160 con 0x7fc9e00aec90 2023-10-06T03:02:59.033 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.029+0000 7fc9e7878700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9e0157b50 con 0x7fc9e00c0c70 2023-10-06T03:02:59.033 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.029+0000 7fc9e7878700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9e0157e30 con 0x7fc9e00c6510 2023-10-06T03:02:59.033 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.029+0000 7fc9e5614700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc9e00aec90 0x7fc9e013dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:59.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.029+0000 7fc9e5614700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc9e00aec90 0x7fc9e013dc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33922/0 (socket says 172.21.15.57:33922) 2023-10-06T03:02:59.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.029+0000 7fc9e5614700 1 -- 172.21.15.57:0/785544043 learned_addr learned my addr 172.21.15.57:0/785544043 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:02:59.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.029+0000 7fc9e4e13700 1 --2- 172.21.15.57:0/785544043 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc9e00c0c70 0x7fc9e00c48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:59.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.029+0000 7fc9e5e15700 1 --2- 172.21.15.57:0/785544043 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc9e00c6510 0x7fc9e015bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:59.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.029+0000 7fc9e5614700 1 -- 172.21.15.57:0/785544043 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc9e00c6510 msgr2=0x7fc9e015bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:59.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.029+0000 7fc9e5614700 1 --2- 172.21.15.57:0/785544043 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc9e00c6510 0x7fc9e015bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:59.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.029+0000 7fc9e5614700 1 -- 172.21.15.57:0/785544043 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc9e00c0c70 msgr2=0x7fc9e00c48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:59.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.029+0000 7fc9e5614700 1 --2- 172.21.15.57:0/785544043 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc9e00c0c70 0x7fc9e00c48a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:59.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.029+0000 7fc9e5614700 1 -- 172.21.15.57:0/785544043 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9dc0093c0 con 0x7fc9e00aec90 2023-10-06T03:02:59.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.029+0000 7fc9e5614700 1 --2- 172.21.15.57:0/785544043 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc9e00aec90 0x7fc9e013dc20 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc009390 tx=0x7fc9dc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:59.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.029+0000 7fc9d57fa700 1 -- 172.21.15.57:0/785544043 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9dc000cc0 con 0x7fc9e00aec90 2023-10-06T03:02:59.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.033+0000 7fc9d57fa700 1 -- 172.21.15.57:0/785544043 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9dc011900 con 0x7fc9e00aec90 2023-10-06T03:02:59.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.033+0000 7fc9d57fa700 1 -- 172.21.15.57:0/785544043 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9dc026430 con 0x7fc9e00aec90 2023-10-06T03:02:59.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.033+0000 7fc9e7878700 1 -- 172.21.15.57:0/785544043 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9e0158110 con 0x7fc9e00aec90 2023-10-06T03:02:59.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.033+0000 7fc9e7878700 1 -- 172.21.15.57:0/785544043 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9e01586d0 con 0x7fc9e00aec90 2023-10-06T03:02:59.038 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.033+0000 7fc9d57fa700 1 -- 172.21.15.57:0/785544043 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fc9dc023030 con 0x7fc9e00aec90 2023-10-06T03:02:59.040 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.037+0000 7fc9d57fa700 1 --2- 172.21.15.57:0/785544043 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fc9c4060550 0x7fc9c4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:59.040 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.037+0000 7fc9d57fa700 1 -- 172.21.15.57:0/785544043 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6144+0+0 (secure 0 0 0) 0x7fc9dc07e110 con 0x7fc9e00aec90 2023-10-06T03:02:59.040 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.037+0000 7fc9e9b70740 1 Processor -- start 2023-10-06T03:02:59.040 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.037+0000 7fc9e9b70740 1 -- start start 2023-10-06T03:02:59.041 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.037+0000 7fc9e4e13700 1 --2- 172.21.15.57:0/785544043 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fc9c4060550 0x7fc9c4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:59.042 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.037+0000 7fc9e9b70740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x16b4ae0 0x1931e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:59.042 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.037+0000 7fc9e9b70740 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x16b4710 0x1932390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:59.042 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.037+0000 7fc9e9b70740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x16ff790 0x19328d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:59.042 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.037+0000 7fc9e9b70740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x185ff30 con 0x16b4ae0 2023-10-06T03:02:59.042 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.037+0000 7fc9e9b70740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x185bed0 con 0x16ff790 2023-10-06T03:02:59.042 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.037+0000 7fc9e9b70740 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x18220b0 con 0x16b4710 2023-10-06T03:02:59.042 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.037+0000 7fc9e4e13700 1 --2- 172.21.15.57:0/785544043 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fc9c4060550 0x7fc9c4062a00 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fc9e015cb10 tx=0x7fc9d0007bf0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:59.042 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.037+0000 7fc9e5614700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x16b4ae0 0x1931e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:59.042 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.037+0000 7fc9e5614700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x16b4ae0 0x1931e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33924/0 (socket says 172.21.15.57:33924) 2023-10-06T03:02:59.043 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.037+0000 7fc9e5614700 1 -- 172.21.15.57:0/3201674784 learned_addr learned my addr 172.21.15.57:0/3201674784 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:02:59.044 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.037+0000 7fc9e5e15700 1 --2- 172.21.15.57:0/3201674784 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x16ff790 0x19328d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:59.044 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.041+0000 7fc9e4e13700 1 --2- 172.21.15.57:0/3201674784 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x16b4710 0x1932390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:59.044 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.041+0000 7fc9e5614700 1 -- 172.21.15.57:0/3201674784 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x16b4710 msgr2=0x1932390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:59.044 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.041+0000 7fc9e5614700 1 --2- 172.21.15.57:0/3201674784 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x16b4710 0x1932390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:59.044 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.041+0000 7fc9e5614700 1 -- 172.21.15.57:0/3201674784 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x16ff790 msgr2=0x19328d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:59.044 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.041+0000 7fc9e5614700 1 --2- 172.21.15.57:0/3201674784 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x16ff790 0x19328d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:59.044 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.041+0000 7fc9e5614700 1 -- 172.21.15.57:0/3201674784 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x17009e0 con 0x16b4ae0 2023-10-06T03:02:59.044 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.041+0000 7fc9e4e13700 1 --2- 172.21.15.57:0/3201674784 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x16b4710 0x1932390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:02:59.044 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.041+0000 7fc9e5614700 1 --2- 172.21.15.57:0/3201674784 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x16b4ae0 0x1931e50 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc009e90 tx=0x7fc9dc07c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41e9ed9ec2381586 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:59.044 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.041+0000 7fc9ca7fc700 1 -- 172.21.15.57:0/3201674784 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9dc0528d0 con 0x16b4ae0 2023-10-06T03:02:59.044 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.041+0000 7fc9ca7fc700 1 -- 172.21.15.57:0/3201674784 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9dc055420 con 0x16b4ae0 2023-10-06T03:02:59.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.041+0000 7fc9ca7fc700 1 -- 172.21.15.57:0/3201674784 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9dc059170 con 0x16b4ae0 2023-10-06T03:02:59.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.041+0000 7fc9e9b70740 1 -- 172.21.15.57:0/3201674784 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x16b4ae0 msgr2=0x1931e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:59.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.041+0000 7fc9e9b70740 1 --2- 172.21.15.57:0/3201674784 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x16b4ae0 0x1931e50 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc009e90 tx=0x7fc9dc07c360 comp rx=0 tx=0).stop 2023-10-06T03:02:59.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.041+0000 7fc9e9b70740 1 -- 172.21.15.57:0/3201674784 shutdown_connections 2023-10-06T03:02:59.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.041+0000 7fc9e9b70740 1 --2- 172.21.15.57:0/3201674784 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x16ff790 0x19328d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:59.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.041+0000 7fc9e9b70740 1 --2- 172.21.15.57:0/3201674784 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x16b4710 0x1932390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:59.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.041+0000 7fc9e9b70740 1 --2- 172.21.15.57:0/3201674784 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x16b4ae0 0x1931e50 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:59.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.041+0000 7fc9e9b70740 1 -- 172.21.15.57:0/3201674784 >> 172.21.15.57:0/3201674784 conn(0x16b4eb0 msgr2=0x18ee880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:59.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.041+0000 7fc9e9b70740 1 -- 172.21.15.57:0/3201674784 shutdown_connections 2023-10-06T03:02:59.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.041+0000 7fc9e9b70740 1 -- 172.21.15.57:0/3201674784 wait complete. 2023-10-06T03:02:59.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.041+0000 7fc9e9b70740 1 -- start start 2023-10-06T03:02:59.047 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.041+0000 7fc9e9b70740 1 Processor -- start 2023-10-06T03:02:59.047 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.045+0000 7fc9e9b70740 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x16b4710 0x18ee740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:59.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.045+0000 7fc9e9b70740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x16b4ae0 0x1917c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:59.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.045+0000 7fc9e9b70740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x16ff790 0x1918140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:59.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.045+0000 7fc9e9b70740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x1821d50 con 0x16b4ae0 2023-10-06T03:02:59.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.045+0000 7fc9e9b70740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x17fa970 con 0x16ff790 2023-10-06T03:02:59.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.045+0000 7fc9e9b70740 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x1862400 con 0x16b4710 2023-10-06T03:02:59.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.045+0000 7fc9e9b70740 10 client.0 _ll_register_callbacks cb 0x18a5b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:02:59.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.045+0000 7fc9e4e13700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x16b4ae0 0x1917c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:59.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.045+0000 7fc9e4e13700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x16b4ae0 0x1917c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33930/0 (socket says 172.21.15.57:33930) 2023-10-06T03:02:59.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.045+0000 7fc9e4e13700 1 -- 172.21.15.57:0/846008887 learned_addr learned my addr 172.21.15.57:0/846008887 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:02:59.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.045+0000 7fc9e5614700 1 --2- 172.21.15.57:0/846008887 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x16b4710 0x18ee740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:59.049 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.045+0000 7fc9e5e15700 1 --2- 172.21.15.57:0/846008887 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x16ff790 0x1918140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:59.049 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.045+0000 7fc9e4e13700 1 -- 172.21.15.57:0/846008887 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x16b4710 msgr2=0x18ee740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:59.050 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.045+0000 7fc9e4e13700 1 --2- 172.21.15.57:0/846008887 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x16b4710 0x18ee740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:59.050 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.045+0000 7fc9e4e13700 1 -- 172.21.15.57:0/846008887 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x16ff790 msgr2=0x1918140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:59.050 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.045+0000 7fc9e4e13700 1 --2- 172.21.15.57:0/846008887 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x16ff790 0x1918140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:59.050 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.045+0000 7fc9e4e13700 1 -- 172.21.15.57:0/846008887 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9dc057040 con 0x16b4ae0 2023-10-06T03:02:59.050 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.045+0000 7fc9e4e13700 1 --2- 172.21.15.57:0/846008887 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x16b4ae0 0x1917c00 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fc9d0006e10 tx=0x7fc9d0014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99d0741f21b018ed server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:59.050 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.045+0000 7fc9bf7fe700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-10-06T03:02:59.050 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.045+0000 7fc9bf7fe700 1 -- 172.21.15.57:0/846008887 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9d0001740 con 0x16b4ae0 2023-10-06T03:02:59.050 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.045+0000 7fc9bf7fe700 1 -- 172.21.15.57:0/846008887 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(54..54 src has 1..54) v4 ==== 6144+0+0 (secure 0 0 0) 0x7fc9d001b040 con 0x16b4ae0 2023-10-06T03:02:59.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.045+0000 7fc9e9b70740 1 -- 172.21.15.57:0/846008887 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x17facc0 con 0x16b4ae0 2023-10-06T03:02:59.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.045+0000 7fc9bf7fe700 1 -- 172.21.15.57:0/846008887 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc9d0021e70 con 0x16b4ae0 2023-10-06T03:02:59.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.045+0000 7fc9e9b70740 10 client.5703 fetch_fsmap learned FSMap version 38 2023-10-06T03:02:59.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.045+0000 7fc9e9b70740 1 -- 172.21.15.57:0/846008887 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=2+}) v3 -- 0x182a370 con 0x16b4ae0 2023-10-06T03:02:59.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.045+0000 7fc9bf7fe700 1 -- 172.21.15.57:0/846008887 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x17facc0 con 0x16b4ae0 2023-10-06T03:02:59.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.049+0000 7fc9bf7fe700 1 -- 172.21.15.57:0/846008887 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 38) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fc9d00018a0 con 0x16b4ae0 2023-10-06T03:02:59.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.049+0000 7fc9e9b70740 10 client.5703 fetch_fsmap finished waiting for FSMap version 38 2023-10-06T03:02:59.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.049+0000 7fc9e9b70740 10 client.5703 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T03:02:59.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.049+0000 7fc9e9b70740 20 client.5703 populate_metadata read hostname 'smithi057' 2023-10-06T03:02:59.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.049+0000 7fc9e9b70740 1 --2- 172.21.15.57:0/846008887 >> [v2:172.21.15.57:6836/3347844181,v1:172.21.15.57:6837/3347844181] conn(0x193e6b0 0x1940a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:59.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.049+0000 7fc9e9b70740 4 client.5703 mds_command: new command op to 5643 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T03:02:59.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.049+0000 7fc9e9b70740 1 -- 172.21.15.57:0/846008887 --> [v2:172.21.15.57:6836/3347844181,v1:172.21.15.57:6837/3347844181] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x17fe3e0 con 0x193e6b0 2023-10-06T03:02:59.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.049+0000 7fc9e5614700 1 --2- 172.21.15.57:0/846008887 >> [v2:172.21.15.57:6836/3347844181,v1:172.21.15.57:6837/3347844181] conn(0x193e6b0 0x1940a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:59.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.049+0000 7fc9e5614700 1 --2- 172.21.15.57:0/846008887 >> [v2:172.21.15.57:6836/3347844181,v1:172.21.15.57:6837/3347844181] conn(0x193e6b0 0x1940a90 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e14e05f88d9f9c93 server_cookie=9a29caf8f2f480a7 in_seq=0 out_seq=0 2023-10-06T03:02:59.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.049+0000 7fc9bf7fe700 10 client.5703 ms_handle_connect on v2:172.21.15.57:6836/3347844181 2023-10-06T03:02:59.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.049+0000 7fc9bf7fe700 1 -- 172.21.15.57:0/846008887 <== mds.0 v2:172.21.15.57:6836/3347844181 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x17fe3e0 con 0x193e6b0 2023-10-06T03:02:59.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.049+0000 7fc9bf7fe700 10 client.5703 handle_command_reply: tid=0 2023-10-06T03:02:59.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.049+0000 7fc9e9b70740 1 client.5703 shutdown 2023-10-06T03:02:59.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.049+0000 7fc9e9b70740 1 -- 172.21.15.57:0/846008887 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x16b4ae0 msgr2=0x1917c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:59.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.049+0000 7fc9e9b70740 1 --2- 172.21.15.57:0/846008887 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x16b4ae0 0x1917c00 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fc9d0006e10 tx=0x7fc9d0014000 comp rx=0 tx=0).stop 2023-10-06T03:02:59.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.049+0000 7fc9e9b70740 1 -- 172.21.15.57:0/846008887 shutdown_connections 2023-10-06T03:02:59.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.049+0000 7fc9e9b70740 1 --2- 172.21.15.57:0/846008887 >> [v2:172.21.15.57:6836/3347844181,v1:172.21.15.57:6837/3347844181] conn(0x193e6b0 0x1940a90 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:59.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.049+0000 7fc9e9b70740 1 --2- 172.21.15.57:0/846008887 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x16ff790 0x1918140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:59.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.049+0000 7fc9e9b70740 1 --2- 172.21.15.57:0/846008887 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x16b4ae0 0x1917c00 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:59.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.049+0000 7fc9e9b70740 1 --2- 172.21.15.57:0/846008887 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x16b4710 0x18ee740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:59.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.049+0000 7fc9bf7fe700 0 client.5703 ms_handle_reset on v2:172.21.15.57:6836/3347844181 2023-10-06T03:02:59.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.049+0000 7fc9e9b70740 1 -- 172.21.15.57:0/846008887 >> 172.21.15.57:0/846008887 conn(0x16b4eb0 msgr2=0x18e6ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:59.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.049+0000 7fc9e9b70740 1 -- 172.21.15.57:0/846008887 shutdown_connections 2023-10-06T03:02:59.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.053+0000 7fc9e9b70740 1 -- 172.21.15.57:0/846008887 wait complete. 2023-10-06T03:02:59.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.053+0000 7fc9e9b70740 20 client.5703 trim_cache size 0 max 16384 2023-10-06T03:02:59.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.073+0000 7fc9e9b70740 1 Processor -- start 2023-10-06T03:02:59.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.073+0000 7fc9e9b70740 1 -- start start 2023-10-06T03:02:59.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.073+0000 7fc9e9b70740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x16b4710 0x1940a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:59.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.073+0000 7fc9e9b70740 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x16b4ae0 0x1940fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:59.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.073+0000 7fc9e9b70740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x16ff790 0x1941510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:59.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.073+0000 7fc9e9b70740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x182ff40 con 0x16ff790 2023-10-06T03:02:59.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.073+0000 7fc9e9b70740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x1860ef0 con 0x16b4710 2023-10-06T03:02:59.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.073+0000 7fc9e9b70740 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x180ac90 con 0x16b4ae0 2023-10-06T03:02:59.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.073+0000 7fc9e4e13700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x16b4ae0 0x1940fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:59.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.073+0000 7fc9e5e15700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x16ff790 0x1941510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:59.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.073+0000 7fc9e5614700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x16b4710 0x1940a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:59.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.073+0000 7fc9e4e13700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x16b4ae0 0x1940fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.57:49222/0 (socket says 172.21.15.57:49222) 2023-10-06T03:02:59.079 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.073+0000 7fc9e4e13700 1 -- 172.21.15.57:0/660172184 learned_addr learned my addr 172.21.15.57:0/660172184 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:02:59.079 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.077+0000 7fc9e4e13700 1 -- 172.21.15.57:0/660172184 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x16b4710 msgr2=0x1940a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:59.080 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.077+0000 7fc9e4e13700 1 --2- 172.21.15.57:0/660172184 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x16b4710 0x1940a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:59.080 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.077+0000 7fc9e4e13700 1 -- 172.21.15.57:0/660172184 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x16ff790 msgr2=0x1941510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:59.080 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.077+0000 7fc9e4e13700 1 --2- 172.21.15.57:0/660172184 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x16ff790 0x1941510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:59.080 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.077+0000 7fc9e4e13700 1 -- 172.21.15.57:0/660172184 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9e00c5140 con 0x16b4ae0 2023-10-06T03:02:59.080 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.077+0000 7fc9e5614700 1 --2- 172.21.15.57:0/660172184 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x16b4710 0x1940a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:02:59.080 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.077+0000 7fc9e4e13700 1 --2- 172.21.15.57:0/660172184 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x16b4ae0 0x1940fd0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc9d00079b0 tx=0x7fc9d001a000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3ea2beb262a13aa5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:59.080 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.077+0000 7fc9caffd700 1 -- 172.21.15.57:0/660172184 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9d0005900 con 0x16b4ae0 2023-10-06T03:02:59.080 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.077+0000 7fc9caffd700 1 -- 172.21.15.57:0/660172184 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9d0005d70 con 0x16b4ae0 2023-10-06T03:02:59.080 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.077+0000 7fc9caffd700 1 -- 172.21.15.57:0/660172184 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9d0001740 con 0x16b4ae0 2023-10-06T03:02:59.081 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.077+0000 7fc9e9b70740 1 -- 172.21.15.57:0/660172184 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x16b4ae0 msgr2=0x1940fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:59.081 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.077+0000 7fc9e9b70740 1 --2- 172.21.15.57:0/660172184 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x16b4ae0 0x1940fd0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc9d00079b0 tx=0x7fc9d001a000 comp rx=0 tx=0).stop 2023-10-06T03:02:59.081 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.077+0000 7fc9e9b70740 1 -- 172.21.15.57:0/660172184 shutdown_connections 2023-10-06T03:02:59.082 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.077+0000 7fc9e9b70740 1 --2- 172.21.15.57:0/660172184 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x16ff790 0x1941510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:59.082 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.077+0000 7fc9e9b70740 1 --2- 172.21.15.57:0/660172184 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x16b4ae0 0x1940fd0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:59.082 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.077+0000 7fc9e9b70740 1 --2- 172.21.15.57:0/660172184 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x16b4710 0x1940a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:59.082 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.077+0000 7fc9e9b70740 1 -- 172.21.15.57:0/660172184 >> 172.21.15.57:0/660172184 conn(0x16b4eb0 msgr2=0x1916c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:59.082 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.077+0000 7fc9e9b70740 1 -- 172.21.15.57:0/660172184 shutdown_connections 2023-10-06T03:02:59.082 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.077+0000 7fc9e9b70740 1 -- 172.21.15.57:0/660172184 wait complete. 2023-10-06T03:02:59.082 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.077+0000 7fc9e9b70740 1 -- start start 2023-10-06T03:02:59.083 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.077+0000 7fc9e9b70740 1 Processor -- start 2023-10-06T03:02:59.083 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.081+0000 7fc9e9b70740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x16b4710 0x1913900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:59.083 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.081+0000 7fc9e9b70740 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x16b4ae0 0x1913e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:59.083 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.081+0000 7fc9e9b70740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x16ff790 0x1914380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:59.084 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.081+0000 7fc9e9b70740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x193b950 con 0x16ff790 2023-10-06T03:02:59.084 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.081+0000 7fc9e9b70740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x1805510 con 0x16b4710 2023-10-06T03:02:59.084 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.081+0000 7fc9e9b70740 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x18ab8e0 con 0x16b4ae0 2023-10-06T03:02:59.084 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.081+0000 7fc9e9b70740 10 client.0 _ll_register_callbacks cb 0x17780e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:02:59.085 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.081+0000 7fc9e5e15700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x16ff790 0x1914380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:59.085 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.081+0000 7fc9e5e15700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x16ff790 0x1914380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33950/0 (socket says 172.21.15.57:33950) 2023-10-06T03:02:59.085 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.081+0000 7fc9e5e15700 1 -- 172.21.15.57:0/3352894049 learned_addr learned my addr 172.21.15.57:0/3352894049 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:02:59.085 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.081+0000 7fc9e5614700 1 --2- 172.21.15.57:0/3352894049 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x16b4710 0x1913900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:59.085 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.081+0000 7fc9e4e13700 1 --2- 172.21.15.57:0/3352894049 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x16b4ae0 0x1913e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:59.085 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.081+0000 7fc9e5e15700 1 -- 172.21.15.57:0/3352894049 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x16b4ae0 msgr2=0x1913e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:59.085 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.081+0000 7fc9e5e15700 1 --2- 172.21.15.57:0/3352894049 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x16b4ae0 0x1913e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:59.086 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.081+0000 7fc9e5e15700 1 -- 172.21.15.57:0/3352894049 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x16b4710 msgr2=0x1913900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:59.086 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.081+0000 7fc9e5e15700 1 --2- 172.21.15.57:0/3352894049 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x16b4710 0x1913900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:59.086 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.081+0000 7fc9e5e15700 1 -- 172.21.15.57:0/3352894049 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x17009e0 con 0x16ff790 2023-10-06T03:02:59.087 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.081+0000 7fc9e5e15700 1 --2- 172.21.15.57:0/3352894049 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x16ff790 0x1914380 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fc9d8018720 tx=0x7fc9d800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2289d3fc837f870 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:59.087 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.081+0000 7fc9bf7fe700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-10-06T03:02:59.087 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.081+0000 7fc9bf7fe700 1 -- 172.21.15.57:0/3352894049 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9d800e040 con 0x16ff790 2023-10-06T03:02:59.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.081+0000 7fc9e9b70740 1 -- 172.21.15.57:0/3352894049 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc9dc055420 con 0x16ff790 2023-10-06T03:02:59.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.081+0000 7fc9bf7fe700 1 -- 172.21.15.57:0/3352894049 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(54..54 src has 1..54) v4 ==== 6144+0+0 (secure 0 0 0) 0x7fc9d80165b0 con 0x16ff790 2023-10-06T03:02:59.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.081+0000 7fc9bf7fe700 1 -- 172.21.15.57:0/3352894049 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc9d8007590 con 0x16ff790 2023-10-06T03:02:59.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.081+0000 7fc9e9b70740 10 client.5709 fetch_fsmap learned FSMap version 38 2023-10-06T03:02:59.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.081+0000 7fc9e9b70740 1 -- 172.21.15.57:0/3352894049 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=2+}) v3 -- 0x182a370 con 0x16ff790 2023-10-06T03:02:59.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.085+0000 7fc9bf7fe700 1 -- 172.21.15.57:0/3352894049 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9dc055420 con 0x16ff790 2023-10-06T03:02:59.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.085+0000 7fc9bf7fe700 1 -- 172.21.15.57:0/3352894049 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 38) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fc9d8016980 con 0x16ff790 2023-10-06T03:02:59.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.085+0000 7fc9e9b70740 10 client.5709 fetch_fsmap finished waiting for FSMap version 38 2023-10-06T03:02:59.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.085+0000 7fc9e9b70740 10 client.5709 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T03:02:59.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.085+0000 7fc9e9b70740 20 client.5709 populate_metadata read hostname 'smithi057' 2023-10-06T03:02:59.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.085+0000 7fc9e9b70740 1 --2- 172.21.15.57:0/3352894049 >> [v2:172.21.15.57:6836/3347844181,v1:172.21.15.57:6837/3347844181] conn(0x199a300 0x199c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:59.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.085+0000 7fc9e9b70740 4 client.5709 mds_command: new command op to 5643 tid=0[{"prefix": "status"}] 2023-10-06T03:02:59.089 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.085+0000 7fc9e9b70740 1 -- 172.21.15.57:0/3352894049 --> [v2:172.21.15.57:6836/3347844181,v1:172.21.15.57:6837/3347844181] -- command(tid 0: {"prefix": "status"}) v1 -- 0x1830410 con 0x199a300 2023-10-06T03:02:59.089 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.085+0000 7fc9e5614700 1 --2- 172.21.15.57:0/3352894049 >> [v2:172.21.15.57:6836/3347844181,v1:172.21.15.57:6837/3347844181] conn(0x199a300 0x199c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:59.090 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.085+0000 7fc9e5614700 1 --2- 172.21.15.57:0/3352894049 >> [v2:172.21.15.57:6836/3347844181,v1:172.21.15.57:6837/3347844181] conn(0x199a300 0x199c6e0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=67abacced10f51c6 server_cookie=80cac62ffe0a2987 in_seq=0 out_seq=0 2023-10-06T03:02:59.090 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.085+0000 7fc9bf7fe700 10 client.5709 ms_handle_connect on v2:172.21.15.57:6836/3347844181 2023-10-06T03:02:59.090 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.085+0000 7fc9bf7fe700 1 -- 172.21.15.57:0/3352894049 <== mds.0 v2:172.21.15.57:6836/3347844181 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x1830410 con 0x199a300 2023-10-06T03:02:59.090 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.085+0000 7fc9bf7fe700 10 client.5709 handle_command_reply: tid=0 2023-10-06T03:02:59.090 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.085+0000 7fc9e9b70740 1 client.5709 shutdown 2023-10-06T03:02:59.090 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.085+0000 7fc9e9b70740 1 -- 172.21.15.57:0/3352894049 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x16ff790 msgr2=0x1914380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:59.090 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.085+0000 7fc9e9b70740 1 --2- 172.21.15.57:0/3352894049 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x16ff790 0x1914380 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fc9d8018720 tx=0x7fc9d800b040 comp rx=0 tx=0).stop 2023-10-06T03:02:59.091 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.085+0000 7fc9e9b70740 1 -- 172.21.15.57:0/3352894049 shutdown_connections 2023-10-06T03:02:59.091 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.085+0000 7fc9e9b70740 1 --2- 172.21.15.57:0/3352894049 >> [v2:172.21.15.57:6836/3347844181,v1:172.21.15.57:6837/3347844181] conn(0x199a300 0x199c6e0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:59.091 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.085+0000 7fc9e9b70740 1 --2- 172.21.15.57:0/3352894049 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x16ff790 0x1914380 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:59.091 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.085+0000 7fc9e9b70740 1 --2- 172.21.15.57:0/3352894049 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x16b4ae0 0x1913e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:59.091 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.085+0000 7fc9e9b70740 1 --2- 172.21.15.57:0/3352894049 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x16b4710 0x1913900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:59.091 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.085+0000 7fc9bf7fe700 0 client.5709 ms_handle_reset on v2:172.21.15.57:6836/3347844181 2023-10-06T03:02:59.091 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.085+0000 7fc9e9b70740 1 -- 172.21.15.57:0/3352894049 >> 172.21.15.57:0/3352894049 conn(0x16b4eb0 msgr2=0x1917b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:59.091 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.085+0000 7fc9e9b70740 1 -- 172.21.15.57:0/3352894049 shutdown_connections 2023-10-06T03:02:59.091 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.085+0000 7fc9e9b70740 1 -- 172.21.15.57:0/3352894049 wait complete. 2023-10-06T03:02:59.091 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.085+0000 7fc9e9b70740 20 client.5709 trim_cache size 0 max 16384 2023-10-06T03:02:59.092 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-10-06T03:02:59.092 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_fsid": "eb56dc0f-9213-41cb-9aad-8ade6c802e98", 2023-10-06T03:02:59.092 INFO:teuthology.orchestra.run.smithi057.stdout: "whoami": 0, 2023-10-06T03:02:59.092 INFO:teuthology.orchestra.run.smithi057.stdout: "id": 5643, 2023-10-06T03:02:59.092 INFO:teuthology.orchestra.run.smithi057.stdout: "want_state": "up:active", 2023-10-06T03:02:59.092 INFO:teuthology.orchestra.run.smithi057.stdout: "state": "up:active", 2023-10-06T03:02:59.092 INFO:teuthology.orchestra.run.smithi057.stdout: "fs_name": "cephfs", 2023-10-06T03:02:59.092 INFO:teuthology.orchestra.run.smithi057.stdout: "rank_uptime": 6.2555865720000003, 2023-10-06T03:02:59.092 INFO:teuthology.orchestra.run.smithi057.stdout: "mdsmap_epoch": 38, 2023-10-06T03:02:59.092 INFO:teuthology.orchestra.run.smithi057.stdout: "osdmap_epoch": 54, 2023-10-06T03:02:59.093 INFO:teuthology.orchestra.run.smithi057.stdout: "osdmap_epoch_barrier": 54, 2023-10-06T03:02:59.093 INFO:teuthology.orchestra.run.smithi057.stdout: "uptime": 6.6841222929999997 2023-10-06T03:02:59.093 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-10-06T03:02:59.093 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.089+0000 7fc9e7878700 1 -- 172.21.15.57:0/785544043 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fc9c4060550 msgr2=0x7fc9c4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:59.094 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.089+0000 7fc9e7878700 1 --2- 172.21.15.57:0/785544043 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fc9c4060550 0x7fc9c4062a00 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fc9e015cb10 tx=0x7fc9d0007bf0 comp rx=0 tx=0).stop 2023-10-06T03:02:59.094 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.089+0000 7fc9e7878700 1 -- 172.21.15.57:0/785544043 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc9e00aec90 msgr2=0x7fc9e013dc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:59.094 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.089+0000 7fc9e7878700 1 --2- 172.21.15.57:0/785544043 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc9e00aec90 0x7fc9e013dc20 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc009390 tx=0x7fc9dc017000 comp rx=0 tx=0).stop 2023-10-06T03:02:59.094 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.089+0000 7fc9e7878700 1 -- 172.21.15.57:0/785544043 shutdown_connections 2023-10-06T03:02:59.094 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.089+0000 7fc9e7878700 1 --2- 172.21.15.57:0/785544043 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fc9c4060550 0x7fc9c4062a00 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:59.094 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.089+0000 7fc9e7878700 1 --2- 172.21.15.57:0/785544043 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc9e00c6510 0x7fc9e015bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:59.094 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.089+0000 7fc9e7878700 1 --2- 172.21.15.57:0/785544043 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc9e00c0c70 0x7fc9e00c48a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:59.094 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.089+0000 7fc9e7878700 1 --2- 172.21.15.57:0/785544043 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc9e00aec90 0x7fc9e013dc20 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:59.094 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.089+0000 7fc9e7878700 1 -- 172.21.15.57:0/785544043 >> 172.21.15.57:0/785544043 conn(0x7fc9e00cbed0 msgr2=0x7fc9e013e740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:59.094 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.089+0000 7fc9e7878700 1 -- 172.21.15.57:0/785544043 shutdown_connections 2023-10-06T03:02:59.095 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.089+0000 7fc9e7878700 1 -- 172.21.15.57:0/785544043 wait complete. 2023-10-06T03:02:59.113 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:02:59.279 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.277+0000 7f7d9d86b700 1 Processor -- start 2023-10-06T03:02:59.279 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.277+0000 7f7d9d86b700 1 -- start start 2023-10-06T03:02:59.280 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.277+0000 7f7d9d86b700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f7d98068750 0x7f7d980abe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:59.281 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.277+0000 7f7d9d86b700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d98153c30 con 0x7f7d9805ddf0 2023-10-06T03:02:59.281 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.277+0000 7f7d9d86b700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d980ac3a0 con 0x7f7d9815c5f0 2023-10-06T03:02:59.281 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.277+0000 7f7d9d86b700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d9815a350 con 0x7f7d98068750 2023-10-06T03:02:59.281 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.277+0000 7f7d9d06a700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f7d9805ddf0 0x7f7d9815a8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:53424/0 (socket says 172.21.15.57:53424) 2023-10-06T03:02:59.282 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.277+0000 7f7d9d06a700 1 -- 172.21.15.57:0/3286896113 learned_addr learned my addr 172.21.15.57:0/3286896113 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:02:59.282 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.277+0000 7f7d97fff700 1 --2- 172.21.15.57:0/3286896113 >> v2:172.21.15.105:3300/0 conn(0x7f7d98068750 0x7f7d980abe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:59.282 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.277+0000 7f7d977fe700 1 -- 172.21.15.57:0/3286896113 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3161073192 0 0) 0x7f7d98153c30 con 0x7f7d9805ddf0 2023-10-06T03:02:59.282 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.277+0000 7f7d977fe700 1 -- 172.21.15.57:0/3286896113 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d88003570 con 0x7f7d9805ddf0 2023-10-06T03:02:59.284 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.277+0000 7f7d977fe700 1 -- 172.21.15.57:0/3286896113 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3568135949 0 0) 0x7f7d980ac3a0 con 0x7f7d9815c5f0 2023-10-06T03:02:59.284 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.277+0000 7f7d977fe700 1 -- 172.21.15.57:0/3286896113 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d98153c30 con 0x7f7d9815c5f0 2023-10-06T03:02:59.284 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.277+0000 7f7d977fe700 1 -- 172.21.15.57:0/3286896113 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3235345269 0 0) 0x7f7d88003570 con 0x7f7d9805ddf0 2023-10-06T03:02:59.284 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.277+0000 7f7d977fe700 1 -- 172.21.15.57:0/3286896113 >> v2:172.21.15.105:3300/0 conn(0x7f7d98068750 msgr2=0x7f7d980abe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:59.284 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.277+0000 7f7d977fe700 1 --2- 172.21.15.57:0/3286896113 >> v2:172.21.15.105:3300/0 conn(0x7f7d98068750 0x7f7d980abe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:59.284 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.277+0000 7f7d977fe700 1 -- 172.21.15.57:0/3286896113 >> v1:172.21.15.105:6789/0 conn(0x7f7d9815c5f0 legacy=0x7f7d98068040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:59.284 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.277+0000 7f7d977fe700 1 -- 172.21.15.57:0/3286896113 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d98159a20 con 0x7f7d9805ddf0 2023-10-06T03:02:59.284 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.277+0000 7f7d977fe700 1 -- 172.21.15.57:0/3286896113 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2482400018 0 0) 0x7f7d900017f0 con 0x7f7d9805ddf0 2023-10-06T03:02:59.284 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.277+0000 7f7d977fe700 1 -- 172.21.15.57:0/3286896113 >> v1:172.21.15.57:6789/0 conn(0x7f7d9805ddf0 legacy=0x7f7d9815a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:59.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.281+0000 7f7d977fe700 1 --2- 172.21.15.57:0/3286896113 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7d88003c40 0x7f7d88004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:59.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.281+0000 7f7d977fe700 1 --2- 172.21.15.57:0/3286896113 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7d88004810 0x7f7d88004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:59.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.281+0000 7f7d977fe700 1 --2- 172.21.15.57:0/3286896113 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7d88005210 0x7f7d8800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:59.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.281+0000 7f7d977fe700 1 -- 172.21.15.57:0/3286896113 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d9815a350 con 0x7f7d88003c40 2023-10-06T03:02:59.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.281+0000 7f7d977fe700 1 -- 172.21.15.57:0/3286896113 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d8800c130 con 0x7f7d88005210 2023-10-06T03:02:59.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.281+0000 7f7d977fe700 1 -- 172.21.15.57:0/3286896113 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d8800c2c0 con 0x7f7d88004810 2023-10-06T03:02:59.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.281+0000 7f7d9c869700 1 --2- 172.21.15.57:0/3286896113 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7d88003c40 0x7f7d88004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:59.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.281+0000 7f7d97fff700 1 --2- 172.21.15.57:0/3286896113 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7d88004810 0x7f7d88004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:59.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.281+0000 7f7d9d06a700 1 --2- 172.21.15.57:0/3286896113 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7d88005210 0x7f7d8800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:59.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.281+0000 7f7d9c869700 1 -- 172.21.15.57:0/3286896113 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7d88004810 msgr2=0x7f7d88004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:59.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.281+0000 7f7d9c869700 1 --2- 172.21.15.57:0/3286896113 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7d88004810 0x7f7d88004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:59.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.281+0000 7f7d9c869700 1 -- 172.21.15.57:0/3286896113 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7d88005210 msgr2=0x7f7d8800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:02:59.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.281+0000 7f7d9c869700 1 --2- 172.21.15.57:0/3286896113 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7d88005210 0x7f7d8800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:59.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.281+0000 7f7d9c869700 1 -- 172.21.15.57:0/3286896113 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d88003570 con 0x7f7d88003c40 2023-10-06T03:02:59.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.281+0000 7f7d9d06a700 1 --2- 172.21.15.57:0/3286896113 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7d88005210 0x7f7d8800ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:02:59.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.281+0000 7f7d9d06a700 1 -- 172.21.15.57:0/3286896113 reap_dead start 2023-10-06T03:02:59.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.281+0000 7f7d9c869700 1 --2- 172.21.15.57:0/3286896113 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7d88003c40 0x7f7d88004030 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f7d8c001a40 tx=0x7f7d8c007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e8b486e5a543ee5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:59.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.281+0000 7f7d977fe700 1 -- 172.21.15.57:0/3286896113 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d8c00c560 con 0x7f7d88003c40 2023-10-06T03:02:59.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.281+0000 7f7d977fe700 1 -- 172.21.15.57:0/3286896113 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d8c00c6c0 con 0x7f7d88003c40 2023-10-06T03:02:59.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.281+0000 7f7d977fe700 1 -- 172.21.15.57:0/3286896113 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d8c00ca60 con 0x7f7d88003c40 2023-10-06T03:02:59.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.281+0000 7f7d9d86b700 1 -- 172.21.15.57:0/3286896113 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7d88003c40 msgr2=0x7f7d88004030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:59.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.281+0000 7f7d9d86b700 1 --2- 172.21.15.57:0/3286896113 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7d88003c40 0x7f7d88004030 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f7d8c001a40 tx=0x7f7d8c007d30 comp rx=0 tx=0).stop 2023-10-06T03:02:59.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.281+0000 7f7d9d86b700 1 -- 172.21.15.57:0/3286896113 shutdown_connections 2023-10-06T03:02:59.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.281+0000 7f7d9d86b700 1 --2- 172.21.15.57:0/3286896113 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7d88003c40 0x7f7d88004030 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:59.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.281+0000 7f7d9d86b700 1 -- 172.21.15.57:0/3286896113 >> 172.21.15.57:0/3286896113 conn(0x7f7d980cc5a0 msgr2=0x7f7d980cc9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:59.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.281+0000 7f7d9d86b700 1 -- 172.21.15.57:0/3286896113 shutdown_connections 2023-10-06T03:02:59.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.281+0000 7f7d9d86b700 1 -- 172.21.15.57:0/3286896113 wait complete. 2023-10-06T03:02:59.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.285+0000 7f7d9d86b700 1 Processor -- start 2023-10-06T03:02:59.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.285+0000 7f7d9d86b700 1 -- start start 2023-10-06T03:02:59.290 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.285+0000 7f7d9d86b700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7d88003c40 0x7f7d980b1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:59.290 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.285+0000 7f7d9d86b700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7d980af340 0x7f7d9814c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:59.290 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.285+0000 7f7d9d86b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7d9814c9d0 0x7f7d98067030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:59.290 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.285+0000 7f7d9d86b700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d9816b3b0 con 0x7f7d9814c9d0 2023-10-06T03:02:59.290 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.285+0000 7f7d9d86b700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d9816a810 con 0x7f7d88003c40 2023-10-06T03:02:59.291 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.285+0000 7f7d9d86b700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d980b23d0 con 0x7f7d980af340 2023-10-06T03:02:59.291 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.285+0000 7f7d9d06a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7d9814c9d0 0x7f7d98067030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:59.291 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.285+0000 7f7d9d06a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7d9814c9d0 0x7f7d98067030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33968/0 (socket says 172.21.15.57:33968) 2023-10-06T03:02:59.291 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.285+0000 7f7d9d06a700 1 -- 172.21.15.57:0/3689962564 learned_addr learned my addr 172.21.15.57:0/3689962564 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:02:59.291 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.285+0000 7f7d97fff700 1 --2- 172.21.15.57:0/3689962564 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7d980af340 0x7f7d9814c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:59.291 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.285+0000 7f7d9c869700 1 --2- 172.21.15.57:0/3689962564 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7d88003c40 0x7f7d980b1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:59.292 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.285+0000 7f7d9d06a700 1 -- 172.21.15.57:0/3689962564 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7d980af340 msgr2=0x7f7d9814c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:59.292 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.289+0000 7f7d9d06a700 1 --2- 172.21.15.57:0/3689962564 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7d980af340 0x7f7d9814c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:59.292 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.289+0000 7f7d9d06a700 1 -- 172.21.15.57:0/3689962564 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7d88003c40 msgr2=0x7f7d980b1e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:59.292 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.289+0000 7f7d9d06a700 1 --2- 172.21.15.57:0/3689962564 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7d88003c40 0x7f7d980b1e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:59.292 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.289+0000 7f7d9d06a700 1 -- 172.21.15.57:0/3689962564 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d9816aa80 con 0x7f7d9814c9d0 2023-10-06T03:02:59.292 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.289+0000 7f7d9d06a700 1 --2- 172.21.15.57:0/3689962564 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7d9814c9d0 0x7f7d98067030 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f7d9000dd70 tx=0x7f7d90009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:59.293 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.289+0000 7f7d94ff9700 1 -- 172.21.15.57:0/3689962564 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d90004dc0 con 0x7f7d9814c9d0 2023-10-06T03:02:59.293 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.289+0000 7f7d94ff9700 1 -- 172.21.15.57:0/3689962564 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d9000b950 con 0x7f7d9814c9d0 2023-10-06T03:02:59.293 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.289+0000 7f7d9d86b700 1 -- 172.21.15.57:0/3689962564 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d9816ad60 con 0x7f7d9814c9d0 2023-10-06T03:02:59.293 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.289+0000 7f7d94ff9700 1 -- 172.21.15.57:0/3689962564 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d9000bd10 con 0x7f7d9814c9d0 2023-10-06T03:02:59.293 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.289+0000 7f7d9d86b700 1 -- 172.21.15.57:0/3689962564 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d9814b6f0 con 0x7f7d9814c9d0 2023-10-06T03:02:59.293 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.289+0000 7f7d9d86b700 1 -- 172.21.15.57:0/3689962564 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d9816b560 con 0x7f7d9814c9d0 2023-10-06T03:02:59.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.293+0000 7f7d94ff9700 1 -- 172.21.15.57:0/3689962564 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f7d900073a0 con 0x7f7d9814c9d0 2023-10-06T03:02:59.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.293+0000 7f7d94ff9700 1 --2- 172.21.15.57:0/3689962564 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f7d7c060580 0x7f7d7c062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:02:59.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.293+0000 7f7d94ff9700 1 -- 172.21.15.57:0/3689962564 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6144+0+0 (secure 0 0 0) 0x7f7d9007c660 con 0x7f7d9814c9d0 2023-10-06T03:02:59.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.293+0000 7f7d9c869700 1 --2- 172.21.15.57:0/3689962564 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f7d7c060580 0x7f7d7c062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:02:59.298 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.293+0000 7f7d9c869700 1 --2- 172.21.15.57:0/3689962564 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f7d7c060580 0x7f7d7c062a30 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f7d8c0017f0 tx=0x7f7d8c015000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:02:59.301 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.297+0000 7f7d94ff9700 1 -- 172.21.15.57:0/3689962564 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f7d9004abe0 con 0x7f7d9814c9d0 2023-10-06T03:02:59.509 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.505+0000 7f7d9d86b700 1 -- 172.21.15.57:0/3689962564 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7d980645e0 con 0x7f7d9814c9d0 2023-10-06T03:02:59.510 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.505+0000 7f7d94ff9700 1 -- 172.21.15.57:0/3689962564 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4598 (secure 0 0 0) 0x7f7d9816b560 con 0x7f7d9814c9d0 2023-10-06T03:02:59.510 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:02:59.510 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":38,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5222,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/879829980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":879829980},{"type":"v1","addr":"172.21.15.105:6833","nonce":879829980}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5225,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/3705921279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":3705921279},{"type":"v1","addr":"172.21.15.105:6835","nonce":3705921279}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/251759282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":251759282},{"type":"v1","addr":"172.21.15.57:6835","nonce":251759282}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:02:39.274111+0000","modified":"2023-10-06T03:02:56.856783+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":54,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5643},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5643":{"gid":5643,"name":"c","rank":0,"incarnation":34,"state":"up:active","state_seq":5,"addr":"172.21.15.57:6837/3347844181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6836","nonce":3347844181},{"type":"v1","addr":"172.21.15.57:6837","nonce":3347844181}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T03:02:59.513 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.509+0000 7f7d9d86b700 1 -- 172.21.15.57:0/3689962564 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f7d7c060580 msgr2=0x7f7d7c062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:59.513 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.509+0000 7f7d9d86b700 1 --2- 172.21.15.57:0/3689962564 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f7d7c060580 0x7f7d7c062a30 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f7d8c0017f0 tx=0x7f7d8c015000 comp rx=0 tx=0).stop 2023-10-06T03:02:59.514 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.509+0000 7f7d9d86b700 1 -- 172.21.15.57:0/3689962564 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7d9814c9d0 msgr2=0x7f7d98067030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:02:59.514 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.509+0000 7f7d9d86b700 1 --2- 172.21.15.57:0/3689962564 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7d9814c9d0 0x7f7d98067030 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f7d9000dd70 tx=0x7f7d90009040 comp rx=0 tx=0).stop 2023-10-06T03:02:59.514 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.509+0000 7f7d9d86b700 1 -- 172.21.15.57:0/3689962564 shutdown_connections 2023-10-06T03:02:59.514 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.509+0000 7f7d9d86b700 1 --2- 172.21.15.57:0/3689962564 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7d9814c9d0 0x7f7d98067030 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:59.514 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.509+0000 7f7d9d86b700 1 --2- 172.21.15.57:0/3689962564 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f7d7c060580 0x7f7d7c062a30 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:59.514 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.509+0000 7f7d9d86b700 1 --2- 172.21.15.57:0/3689962564 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7d980af340 0x7f7d9814c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:59.514 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.509+0000 7f7d9d86b700 1 --2- 172.21.15.57:0/3689962564 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7d88003c40 0x7f7d980b1e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:02:59.514 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.509+0000 7f7d9d86b700 1 -- 172.21.15.57:0/3689962564 >> 172.21.15.57:0/3689962564 conn(0x7f7d980cc5a0 msgr2=0x7f7d9815a870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:02:59.514 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.509+0000 7f7d9d86b700 1 -- 172.21.15.57:0/3689962564 shutdown_connections 2023-10-06T03:02:59.514 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:02:59.509+0000 7f7d9d86b700 1 -- 172.21.15.57:0/3689962564 wait complete. 2023-10-06T03:02:59.516 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 38 2023-10-06T03:02:59.535 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json perf dump 2023-10-06T03:02:59.702 INFO:teuthology.orchestra.run.smithi057.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":40,"msgr_send_messages":30,"msgr_recv_bytes":103953,"msgr_send_bytes":43349,"msgr_created_connections":10,"msgr_active_connections":3,"msgr_running_total_time":0.018577161,"msgr_running_send_time":0.002853584,"msgr_running_recv_time":0.013539503,"msgr_running_fast_dispatch_time":0.000640407,"msgr_send_messages_queue_lat":{"avgcount":30,"sum":0.006736300,"avgtime":0.000224543},"msgr_handle_ack_lat":{"avgcount":7,"sum":0.000004150,"avgtime":0.000000592}},"AsyncMessenger::Worker-1":{"msgr_recv_messages":19,"msgr_send_messages":23,"msgr_recv_bytes":9441,"msgr_send_bytes":92922,"msgr_created_connections":6,"msgr_active_connections":4,"msgr_running_total_time":0.008162189,"msgr_running_send_time":0.002039595,"msgr_running_recv_time":0.005137008,"msgr_running_fast_dispatch_time":0.000546211,"msgr_send_messages_queue_lat":{"avgcount":21,"sum":0.005368124,"avgtime":0.000255624},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"AsyncMessenger::Worker-2":{"msgr_recv_messages":12,"msgr_send_messages":14,"msgr_recv_bytes":9479,"msgr_send_bytes":4136,"msgr_created_connections":6,"msgr_active_connections":4,"msgr_running_total_time":0.006343631,"msgr_running_send_time":0.000715274,"msgr_running_recv_time":0.004669638,"msgr_running_fast_dispatch_time":0.000589347,"msgr_send_messages_queue_lat":{"avgcount":12,"sum":0.007918033,"avgtime":0.000659836},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":0,"complete_latency":{"avgcount":37,"sum":0.003706369,"avgtime":0.000100172}},"finisher-PurgeQueue":{"queue_len":0,"complete_latency":{"avgcount":4,"sum":0.000177735,"avgtime":0.000044433}},"mds":{"request":2,"reply":0,"reply_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"slow_reply":0,"forward":0,"dir_fetch":12,"dir_commit":0,"dir_split":0,"dir_merge":0,"inodes":10,"inodes_top":7,"inodes_bottom":3,"inodes_pin_tail":0,"inodes_pinned":10,"inodes_expired":0,"inodes_with_caps":1,"caps":1,"subtrees":2,"traverse":1,"traverse_hit":1,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":161,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":0,"root_rbytes":0,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":0,"ceph_cap_op_grant":0,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":0,"handle_client_caps_dirty":0,"handle_client_cap_release":0,"process_request_cap_release":0},"mds_cache":{"num_strays":0,"num_strays_delayed":0,"num_strays_enqueuing":0,"strays_created":0,"strays_enqueued":0,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0},"mds_log":{"evadd":2,"evex":0,"evtrm":0,"ev":4,"evexg":0,"evexd":0,"segadd":0,"segex":0,"segtrm":0,"seg":1,"segexg":0,"segexd":0,"expos":4194304,"wrpos":4196357,"rdpos":4195196,"jlat":{"avgcount":2,"sum":0.007342758,"avgtime":0.003671379},"replayed":2},"mds_mem":{"ino":13,"ino+":13,"ino-":0,"dir":12,"dir+":12,"dir-":0,"dn":10,"dn+":10,"dn-":0,"cap":1,"cap+":1,"cap-":0,"rss":39900,"heap":223456},"mds_server":{"dispatch_client_request":1,"dispatch_server_request":0,"handle_client_request":2,"handle_client_session":0,"handle_peer_request":0,"req_create_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_getattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_readdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"cap_revoke_eviction":0,"cap_acquisition_throttle":0,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":1,"session_add":1,"session_remove":0,"sessions_open":1,"sessions_stale":0,"total_load":0,"average_load":0,"avg_session_uptime":913,"mdthresh_evicted":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_Buffer_bytes":0,"bluestore_Buffer_items":0,"bluestore_Extent_bytes":0,"bluestore_Extent_items":0,"bluestore_Blob_bytes":0,"bluestore_Blob_items":0,"bluestore_SharedBlob_bytes":0,"bluestore_SharedBlob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":226268,"buffer_anon_items":69,"buffer_meta_bytes":0,"buffer_meta_items":0,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":6336,"osdmap_items":93,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":50688,"mds_co_items":189,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":36,"op_send_bytes":1341,"op_resend":0,"op_reply":36,"oplen_avg":{"avgcount":36,"sum":62},"op":36,"op_r":26,"op_w":10,"op_rmw":0,"op_pg":0,"osdop_stat":2,"osdop_create":0,"osdop_read":8,"osdop_write":2,"osdop_writefull":1,"osdop_writesame":0,"osdop_append":0,"osdop_zero":1,"osdop_truncate":0,"osdop_delete":5,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":14,"osdop_setxattr":0,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":0,"map_full":0,"map_inc":0,"osd_sessions":8,"osd_session_open":8,"osd_session_close":0,"osd_laggy":0,"omap_wr":1,"omap_rd":28,"omap_del":0},"oft":{"omap_total_objs":0,"omap_total_kv_pairs":0,"omap_total_updates":0,"omap_total_removes":0},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":0,"pq_executing":0,"pq_executing_high_water":0,"pq_executed":0,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":0,"max":104857600,"get_started":0,"get":67,"get_sum":114355,"get_or_fail_fail":0,"get_or_fail_success":67,"take":0,"take_sum":0,"put":67,"put_sum":114355,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":36,"take_sum":2267,"put":36,"put_sum":2267,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":36,"take_sum":36,"put":36,"put_sum":36,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":0,"take_sum":0,"put":0,"put_sum":0,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x55d33e7a4000":{"val":0,"max":3758096384,"get_started":0,"get":2,"get_sum":903,"get_or_fail_fail":0,"get_or_fail_success":2,"take":0,"take_sum":0,"put":2,"put_sum":903,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}}} 2023-10-06T03:02:59.704 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 3, "msgr_created_connections": 10, "msgr_handle_ack_lat": { "avgcount": 7, "avgtime": 5.92e-07, "sum": 4.15e-06 }, "msgr_recv_bytes": 103953, "msgr_recv_messages": 40, "msgr_running_fast_dispatch_time": 0.000640407, "msgr_running_recv_time": 0.013539503, "msgr_running_send_time": 0.002853584, "msgr_running_total_time": 0.018577161, "msgr_send_bytes": 43349, "msgr_send_messages": 30, "msgr_send_messages_queue_lat": { "avgcount": 30, "avgtime": 0.000224543, "sum": 0.0067363 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 4, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 9441, "msgr_recv_messages": 19, "msgr_running_fast_dispatch_time": 0.000546211, "msgr_running_recv_time": 0.005137008, "msgr_running_send_time": 0.002039595, "msgr_running_total_time": 0.008162189, "msgr_send_bytes": 92922, "msgr_send_messages": 23, "msgr_send_messages_queue_lat": { "avgcount": 21, "avgtime": 0.000255624, "sum": 0.005368124 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 4, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 9479, "msgr_recv_messages": 12, "msgr_running_fast_dispatch_time": 0.000589347, "msgr_running_recv_time": 0.004669638, "msgr_running_send_time": 0.000715274, "msgr_running_total_time": 0.006343631, "msgr_send_bytes": 4136, "msgr_send_messages": 14, "msgr_send_messages_queue_lat": { "avgcount": 12, "avgtime": 0.000659836, "sum": 0.007918033 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 37, "avgtime": 0.000100172, "sum": 0.003706369 }, "queue_len": 0 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 4, "avgtime": 4.4433e-05, "sum": 0.000177735 }, "queue_len": 0 }, "mds": { "caps": 1, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 0, "ceph_cap_op_revoke": 0, "ceph_cap_op_trunc": 0, "dir_commit": 0, "dir_fetch": 12, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 0, "handle_client_caps": 0, "handle_client_caps_dirty": 0, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 10, "inodes_bottom": 3, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 10, "inodes_top": 7, "inodes_with_caps": 1, "load_cent": 161, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 0, "q": 0, "reply": 0, "reply_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "request": 2, "root_rbytes": 0, "root_rfiles": 0, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 1, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 1, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 0, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 0, "strays_enqueued": 0, "strays_migrated": 0, "strays_reintegrated": 0 }, "mds_log": { "ev": 4, "evadd": 2, "evex": 0, "evexd": 0, "evexg": 0, "evtrm": 0, "expos": 4194304, "jlat": { "avgcount": 2, "avgtime": 0.003671379, "sum": 0.007342758 }, "rdpos": 4195196, "replayed": 2, "seg": 1, "segadd": 0, "segex": 0, "segexd": 0, "segexg": 0, "segtrm": 0, "wrpos": 4196357 }, "mds_mem": { "cap": 1, "cap+": 1, "cap-": 0, "dir": 12, "dir+": 12, "dir-": 0, "dn": 10, "dn+": 10, "dn-": 0, "heap": 223456, "ino": 13, "ino+": 13, "ino-": 0, "rss": 39900 }, "mds_server": { "cap_acquisition_throttle": 0, "cap_revoke_eviction": 0, "dispatch_client_request": 1, "dispatch_server_request": 0, "handle_client_request": 2, "handle_client_session": 0, "handle_peer_request": 0, "req_create_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_readdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "mds_sessions": { "average_load": 0, "avg_session_uptime": 913, "mdthresh_evicted": 0, "session_add": 1, "session_count": 1, "session_remove": 0, "sessions_open": 1, "sessions_stale": 0, "total_load": 0 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_Blob_bytes": 0, "bluestore_Blob_items": 0, "bluestore_Buffer_bytes": 0, "bluestore_Buffer_items": 0, "bluestore_Extent_bytes": 0, "bluestore_Extent_items": 0, "bluestore_SharedBlob_bytes": 0, "bluestore_SharedBlob_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 226268, "buffer_anon_items": 69, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "mds_co_bytes": 50688, "mds_co_items": 189, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 6336, "osdmap_items": 93, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "omap_del": 0, "omap_rd": 28, "omap_wr": 1, "op": 36, "op_active": 0, "op_laggy": 0, "op_pg": 0, "op_r": 26, "op_reply": 36, "op_resend": 0, "op_rmw": 0, "op_send": 36, "op_send_bytes": 1341, "op_w": 10, "oplen_avg": { "avgcount": 36, "sum": 62 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 8, "osd_sessions": 8, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 0, "osdop_delete": 5, "osdop_getxattr": 14, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 8, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 0, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 2, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 2, "osdop_writefull": 1, "osdop_writesame": 0, "osdop_zero": 1, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 0, "omap_total_objs": 0, "omap_total_removes": 0, "omap_total_updates": 0 }, "purge_queue": { "pq_executed": 0, "pq_executing": 0, "pq_executing_high_water": 0, "pq_executing_ops": 0, "pq_executing_ops_high_water": 0, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 67, "get_or_fail_fail": 0, "get_or_fail_success": 67, "get_started": 0, "get_sum": 114355, "max": 104857600, "put": 67, "put_sum": 114355, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 36, "put_sum": 2267, "take": 36, "take_sum": 2267, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 36, "put_sum": 36, "take": 36, "take_sum": 36, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 3758096384, "put": 0, "put_sum": 0, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x55d33e7a4000": { "get": 2, "get_or_fail_fail": 0, "get_or_fail_success": 2, "get_started": 0, "get_sum": 903, "max": 3758096384, "put": 2, "put_sum": 903, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } } } 2023-10-06T03:02:59.705 INFO:tasks.cephfs.test_openfiletable:omap_total_updates_0:0 2023-10-06T03:02:59.705 DEBUG:teuthology.orchestra.run.smithi057:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T03:02:59.705 DEBUG:teuthology.orchestra.run.smithi057:> import time 2023-10-06T03:02:59.705 DEBUG:teuthology.orchestra.run.smithi057:> 2023-10-06T03:02:59.705 DEBUG:teuthology.orchestra.run.smithi057:> with open("/home/ubuntu/cephtest/mnt.0/omap_counter_test_file", '"'"'w'"'"') as f: 2023-10-06T03:02:59.705 DEBUG:teuthology.orchestra.run.smithi057:> f.write("content") 2023-10-06T03:02:59.705 DEBUG:teuthology.orchestra.run.smithi057:> f.flush() 2023-10-06T03:02:59.705 DEBUG:teuthology.orchestra.run.smithi057:> while True: 2023-10-06T03:02:59.705 DEBUG:teuthology.orchestra.run.smithi057:> time.sleep(1) 2023-10-06T03:02:59.706 DEBUG:teuthology.orchestra.run.smithi057:> ' 2023-10-06T03:02:59.712 DEBUG:teuthology.orchestra.run.smithi057:> stat --printf=%s /home/ubuntu/cephtest/mnt.0/omap_counter_test_file 2023-10-06T03:02:59.729 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T03:02:59.729 INFO:teuthology.orchestra.run.smithi057.stderr:stat: cannot stat '/home/ubuntu/cephtest/mnt.0/omap_counter_test_file': No such file or directory 2023-10-06T03:03:00.730 DEBUG:teuthology.orchestra.run.smithi057:> stat --printf=%s /home/ubuntu/cephtest/mnt.0/omap_counter_test_file 2023-10-06T03:03:00.749 INFO:teuthology.orchestra.run.smithi057.stdout:7 2023-10-06T03:03:00.749 INFO:tasks.cephfs.mount:File omap_counter_test_file became visible with size 7 from 0 after 1s 2023-10-06T03:03:00.750 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:03:00.954 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:00.949+0000 7f83c5278700 1 Processor -- start 2023-10-06T03:03:00.954 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:00.949+0000 7f83c5278700 1 -- start start 2023-10-06T03:03:00.957 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:00.953+0000 7f83c5278700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f83c0159120 0x7f83c00acc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:00.957 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:00.953+0000 7f83c5278700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f83c01594f0 0x7f83c00d07e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:00.957 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:00.953+0000 7f83c5278700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83c00c5ce0 con 0x7f83c00cdeb0 2023-10-06T03:03:00.957 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:00.953+0000 7f83c5278700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83c00c59b0 con 0x7f83c0159120 2023-10-06T03:03:00.957 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:00.953+0000 7f83c5278700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83c00ceb90 con 0x7f83c01594f0 2023-10-06T03:03:00.958 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:00.953+0000 7f83beffd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f83c0159120 0x7f83c00acc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:00.958 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:00.953+0000 7f83beffd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f83c0159120 0x7f83c00acc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33980/0 (socket says 172.21.15.57:33980) 2023-10-06T03:03:00.958 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:00.953+0000 7f83beffd700 1 -- 172.21.15.57:0/136873956 learned_addr learned my addr 172.21.15.57:0/136873956 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:03:00.958 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:00.953+0000 7f83be7fc700 1 --2- 172.21.15.57:0/136873956 >> v2:172.21.15.105:3300/0 conn(0x7f83c01594f0 0x7f83c00d07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:00.959 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:00.957+0000 7f83beffd700 1 -- 172.21.15.57:0/136873956 >> v2:172.21.15.105:3300/0 conn(0x7f83c01594f0 msgr2=0x7f83c00d07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:03:00.959 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:00.957+0000 7f83beffd700 1 --2- 172.21.15.57:0/136873956 >> v2:172.21.15.105:3300/0 conn(0x7f83c01594f0 0x7f83c00d07e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:00.959 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:00.953+0000 7f83bdffb700 1 -- 172.21.15.57:0/136873956 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4005674504 0 0) 0x7f83c00c5ce0 con 0x7f83c00cdeb0 2023-10-06T03:03:00.959 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:00.957+0000 7f83beffd700 1 -- 172.21.15.57:0/136873956 >> v1:172.21.15.105:6789/0 conn(0x7f83c00cdeb0 legacy=0x7f83c00ce2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:00.959 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:00.957+0000 7f83beffd700 1 -- 172.21.15.57:0/136873956 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83c00cee70 con 0x7f83c0159120 2023-10-06T03:03:00.960 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:00.957+0000 7f83beffd700 1 --2- 172.21.15.57:0/136873956 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f83c0159120 0x7f83c00acc80 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f83c008a550 tx=0x7f83b0009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21a221c4b025f619 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:03:00.960 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:00.957+0000 7f83bdffb700 1 -- 172.21.15.57:0/136873956 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b0005c10 con 0x7f83c0159120 2023-10-06T03:03:00.960 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:00.957+0000 7f83bdffb700 1 -- 172.21.15.57:0/136873956 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83b0005d70 con 0x7f83c0159120 2023-10-06T03:03:00.960 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:00.957+0000 7f83bdffb700 1 -- 172.21.15.57:0/136873956 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b0006260 con 0x7f83c0159120 2023-10-06T03:03:00.961 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:00.957+0000 7f83c5278700 1 -- 172.21.15.57:0/136873956 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f83c0159120 msgr2=0x7f83c00acc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:00.961 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:00.957+0000 7f83c5278700 1 --2- 172.21.15.57:0/136873956 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f83c0159120 0x7f83c00acc80 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f83c008a550 tx=0x7f83b0009220 comp rx=0 tx=0).stop 2023-10-06T03:03:00.961 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:00.957+0000 7f83c5278700 1 -- 172.21.15.57:0/136873956 shutdown_connections 2023-10-06T03:03:00.961 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:00.957+0000 7f83c5278700 1 --2- 172.21.15.57:0/136873956 >> v2:172.21.15.105:3300/0 conn(0x7f83c01594f0 0x7f83c00d07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:00.961 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:00.957+0000 7f83c5278700 1 --2- 172.21.15.57:0/136873956 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f83c0159120 0x7f83c00acc80 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:00.961 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:00.957+0000 7f83c5278700 1 -- 172.21.15.57:0/136873956 >> 172.21.15.57:0/136873956 conn(0x7f83c006ef40 msgr2=0x7f83c00d00d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:03:00.961 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:00.957+0000 7f83c5278700 1 -- 172.21.15.57:0/136873956 shutdown_connections 2023-10-06T03:03:00.962 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:00.957+0000 7f83c5278700 1 -- 172.21.15.57:0/136873956 wait complete. 2023-10-06T03:03:00.968 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:00.961+0000 7f83c5278700 1 Processor -- start 2023-10-06T03:03:00.968 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:00.961+0000 7f83c5278700 1 -- start start 2023-10-06T03:03:00.968 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:00.961+0000 7f83c5278700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f83c00cdeb0 0x7f83c014eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:00.968 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:00.961+0000 7f83c5278700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f83c0159120 0x7f83c00c7180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:00.968 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:00.961+0000 7f83c5278700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f83c01594f0 0x7f83c01583a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:00.968 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:00.961+0000 7f83c5278700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83c016a6a0 con 0x7f83c0159120 2023-10-06T03:03:00.968 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:00.961+0000 7f83c5278700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83c0169a90 con 0x7f83c00cdeb0 2023-10-06T03:03:00.968 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:00.961+0000 7f83c5278700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83c0169d70 con 0x7f83c01594f0 2023-10-06T03:03:00.968 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:00.961+0000 7f83be7fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f83c0159120 0x7f83c00c7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:00.968 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:00.961+0000 7f83be7fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f83c0159120 0x7f83c00c7180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33988/0 (socket says 172.21.15.57:33988) 2023-10-06T03:03:00.968 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:00.961+0000 7f83be7fc700 1 -- 172.21.15.57:0/2388599167 learned_addr learned my addr 172.21.15.57:0/2388599167 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:03:00.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:00.961+0000 7f83beffd700 1 --2- 172.21.15.57:0/2388599167 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f83c00cdeb0 0x7f83c014eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:00.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:00.961+0000 7f83bf7fe700 1 --2- 172.21.15.57:0/2388599167 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f83c01594f0 0x7f83c01583a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:00.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:00.961+0000 7f83be7fc700 1 -- 172.21.15.57:0/2388599167 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f83c01594f0 msgr2=0x7f83c01583a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:00.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:00.961+0000 7f83be7fc700 1 --2- 172.21.15.57:0/2388599167 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f83c01594f0 0x7f83c01583a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:00.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:00.961+0000 7f83be7fc700 1 -- 172.21.15.57:0/2388599167 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f83c00cdeb0 msgr2=0x7f83c014eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:00.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:00.961+0000 7f83be7fc700 1 --2- 172.21.15.57:0/2388599167 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f83c00cdeb0 0x7f83c014eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:00.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:00.965+0000 7f83be7fc700 1 -- 172.21.15.57:0/2388599167 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83b0009480 con 0x7f83c0159120 2023-10-06T03:03:00.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:00.965+0000 7f83bf7fe700 1 --2- 172.21.15.57:0/2388599167 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f83c01594f0 0x7f83c01583a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:03:00.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:00.965+0000 7f83be7fc700 1 --2- 172.21.15.57:0/2388599167 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f83c0159120 0x7f83c00c7180 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f83b400e930 tx=0x7f83b40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:03:00.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:00.965+0000 7f83a6ffd700 1 -- 172.21.15.57:0/2388599167 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b400eed0 con 0x7f83c0159120 2023-10-06T03:03:00.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:00.965+0000 7f83a6ffd700 1 -- 172.21.15.57:0/2388599167 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83b400c850 con 0x7f83c0159120 2023-10-06T03:03:00.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:00.965+0000 7f83c5278700 1 -- 172.21.15.57:0/2388599167 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83c016a050 con 0x7f83c0159120 2023-10-06T03:03:00.970 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:00.965+0000 7f83a6ffd700 1 -- 172.21.15.57:0/2388599167 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b400cbf0 con 0x7f83c0159120 2023-10-06T03:03:00.970 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:00.965+0000 7f83c5278700 1 -- 172.21.15.57:0/2388599167 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83c01588e0 con 0x7f83c0159120 2023-10-06T03:03:00.970 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:00.965+0000 7f83c5278700 1 -- 172.21.15.57:0/2388599167 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83c00645e0 con 0x7f83c0159120 2023-10-06T03:03:00.971 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:00.969+0000 7f83a6ffd700 1 -- 172.21.15.57:0/2388599167 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f83b4013470 con 0x7f83c0159120 2023-10-06T03:03:00.972 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:00.969+0000 7f83a6ffd700 1 --2- 172.21.15.57:0/2388599167 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f83ac060550 0x7f83ac062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:00.972 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:00.969+0000 7f83a6ffd700 1 -- 172.21.15.57:0/2388599167 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6144+0+0 (secure 0 0 0) 0x7f83b407cbd0 con 0x7f83c0159120 2023-10-06T03:03:00.973 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:00.969+0000 7f83beffd700 1 --2- 172.21.15.57:0/2388599167 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f83ac060550 0x7f83ac062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:00.974 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:00.969+0000 7f83beffd700 1 --2- 172.21.15.57:0/2388599167 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f83ac060550 0x7f83ac062a00 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f83b0009260 tx=0x7f83b0016000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:03:00.981 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:00.977+0000 7f83a6ffd700 1 -- 172.21.15.57:0/2388599167 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f83b404cf90 con 0x7f83c0159120 2023-10-06T03:03:01.188 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:01.185+0000 7f83c5278700 1 -- 172.21.15.57:0/2388599167 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f83c00c9130 con 0x7f83c0159120 2023-10-06T03:03:01.189 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:01.185+0000 7f83a6ffd700 1 -- 172.21.15.57:0/2388599167 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4598 (secure 0 0 0) 0x7f83b40505b0 con 0x7f83c0159120 2023-10-06T03:03:01.189 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:03:01.190 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":38,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5222,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/879829980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":879829980},{"type":"v1","addr":"172.21.15.105:6833","nonce":879829980}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5225,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/3705921279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":3705921279},{"type":"v1","addr":"172.21.15.105:6835","nonce":3705921279}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/251759282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":251759282},{"type":"v1","addr":"172.21.15.57:6835","nonce":251759282}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:02:39.274111+0000","modified":"2023-10-06T03:02:56.856783+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":54,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5643},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5643":{"gid":5643,"name":"c","rank":0,"incarnation":34,"state":"up:active","state_seq":5,"addr":"172.21.15.57:6837/3347844181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6836","nonce":3347844181},{"type":"v1","addr":"172.21.15.57:6837","nonce":3347844181}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T03:03:01.193 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:01.189+0000 7f83c5278700 1 -- 172.21.15.57:0/2388599167 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f83ac060550 msgr2=0x7f83ac062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:01.193 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:01.189+0000 7f83c5278700 1 --2- 172.21.15.57:0/2388599167 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f83ac060550 0x7f83ac062a00 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f83b0009260 tx=0x7f83b0016000 comp rx=0 tx=0).stop 2023-10-06T03:03:01.193 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:01.189+0000 7f83c5278700 1 -- 172.21.15.57:0/2388599167 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f83c0159120 msgr2=0x7f83c00c7180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:01.193 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:01.189+0000 7f83c5278700 1 --2- 172.21.15.57:0/2388599167 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f83c0159120 0x7f83c00c7180 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f83b400e930 tx=0x7f83b40091a0 comp rx=0 tx=0).stop 2023-10-06T03:03:01.193 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:01.189+0000 7f83c5278700 1 -- 172.21.15.57:0/2388599167 shutdown_connections 2023-10-06T03:03:01.193 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:01.189+0000 7f83c5278700 1 --2- 172.21.15.57:0/2388599167 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f83ac060550 0x7f83ac062a00 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:01.193 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:01.189+0000 7f83c5278700 1 --2- 172.21.15.57:0/2388599167 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f83c01594f0 0x7f83c01583a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:01.193 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:01.189+0000 7f83c5278700 1 --2- 172.21.15.57:0/2388599167 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f83c0159120 0x7f83c00c7180 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:01.193 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:01.189+0000 7f83c5278700 1 --2- 172.21.15.57:0/2388599167 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f83c00cdeb0 0x7f83c014eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:01.193 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:01.189+0000 7f83c5278700 1 -- 172.21.15.57:0/2388599167 >> 172.21.15.57:0/2388599167 conn(0x7f83c006ef40 msgr2=0x7f83c00b2100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:03:01.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:01.189+0000 7f83c5278700 1 -- 172.21.15.57:0/2388599167 shutdown_connections 2023-10-06T03:03:01.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:01.189+0000 7f83c5278700 1 -- 172.21.15.57:0/2388599167 wait complete. 2023-10-06T03:03:01.195 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 38 2023-10-06T03:03:01.214 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json perf dump 2023-10-06T03:03:01.387 INFO:teuthology.orchestra.run.smithi057.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":44,"msgr_send_messages":33,"msgr_recv_bytes":105257,"msgr_send_bytes":45297,"msgr_created_connections":10,"msgr_active_connections":3,"msgr_running_total_time":0.020036492,"msgr_running_send_time":0.003831812,"msgr_running_recv_time":0.013933213,"msgr_running_fast_dispatch_time":0.000766924,"msgr_send_messages_queue_lat":{"avgcount":33,"sum":0.006969396,"avgtime":0.000211193},"msgr_handle_ack_lat":{"avgcount":9,"sum":0.000007170,"avgtime":0.000000796}},"AsyncMessenger::Worker-1":{"msgr_recv_messages":20,"msgr_send_messages":24,"msgr_recv_bytes":9687,"msgr_send_bytes":94921,"msgr_created_connections":6,"msgr_active_connections":4,"msgr_running_total_time":0.008329844,"msgr_running_send_time":0.002091222,"msgr_running_recv_time":0.005184554,"msgr_running_fast_dispatch_time":0.000602270,"msgr_send_messages_queue_lat":{"avgcount":22,"sum":0.005413638,"avgtime":0.000246074},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"AsyncMessenger::Worker-2":{"msgr_recv_messages":12,"msgr_send_messages":14,"msgr_recv_bytes":9479,"msgr_send_bytes":4136,"msgr_created_connections":6,"msgr_active_connections":4,"msgr_running_total_time":0.006343631,"msgr_running_send_time":0.000715274,"msgr_running_recv_time":0.004669638,"msgr_running_fast_dispatch_time":0.000589347,"msgr_send_messages_queue_lat":{"avgcount":12,"sum":0.007918033,"avgtime":0.000659836},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":0,"complete_latency":{"avgcount":39,"sum":0.004368369,"avgtime":0.000112009}},"finisher-PurgeQueue":{"queue_len":0,"complete_latency":{"avgcount":4,"sum":0.000177735,"avgtime":0.000044433}},"mds":{"request":4,"reply":2,"reply_latency":{"avgcount":2,"sum":0.005332595,"avgtime":0.002666297},"slow_reply":0,"forward":0,"dir_fetch":12,"dir_commit":0,"dir_split":0,"dir_merge":0,"inodes":11,"inodes_top":0,"inodes_bottom":11,"inodes_pin_tail":0,"inodes_pinned":11,"inodes_expired":0,"inodes_with_caps":2,"caps":2,"subtrees":2,"traverse":4,"traverse_hit":4,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":161,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":1,"root_rbytes":0,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":0,"ceph_cap_op_grant":0,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":0,"handle_client_caps_dirty":0,"handle_client_cap_release":0,"process_request_cap_release":1},"mds_cache":{"num_strays":0,"num_strays_delayed":0,"num_strays_enqueuing":0,"strays_created":0,"strays_enqueued":0,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0},"mds_log":{"evadd":3,"evex":0,"evtrm":0,"ev":5,"evexg":0,"evexd":0,"segadd":0,"segex":0,"segtrm":0,"seg":1,"segexg":0,"segexd":0,"expos":4194304,"wrpos":4198045,"rdpos":4195196,"jlat":{"avgcount":3,"sum":0.011016520,"avgtime":0.003672173},"replayed":2},"mds_mem":{"ino":14,"ino+":14,"ino-":0,"dir":12,"dir+":12,"dir-":0,"dn":11,"dn+":11,"dn-":0,"cap":2,"cap+":2,"cap-":0,"rss":40540,"heap":223456},"mds_server":{"dispatch_client_request":3,"dispatch_server_request":0,"handle_client_request":4,"handle_client_session":0,"handle_peer_request":0,"req_create_latency":{"avgcount":1,"sum":0.005055413,"avgtime":0.005055413},"req_getattr_latency":{"avgcount":1,"sum":0.000277182,"avgtime":0.000277182},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_readdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"cap_revoke_eviction":0,"cap_acquisition_throttle":0,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":1,"session_add":1,"session_remove":0,"sessions_open":1,"sessions_stale":0,"total_load":1,"average_load":1,"avg_session_uptime":913,"mdthresh_evicted":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_Buffer_bytes":0,"bluestore_Buffer_items":0,"bluestore_Extent_bytes":0,"bluestore_Extent_items":0,"bluestore_Blob_bytes":0,"bluestore_Blob_items":0,"bluestore_SharedBlob_bytes":0,"bluestore_SharedBlob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":226268,"buffer_anon_items":69,"buffer_meta_bytes":0,"buffer_meta_items":0,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":6336,"osdmap_items":93,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":50688,"mds_co_items":189,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":37,"op_send_bytes":3029,"op_resend":0,"op_reply":37,"oplen_avg":{"avgcount":37,"sum":63},"op":37,"op_r":26,"op_w":11,"op_rmw":0,"op_pg":0,"osdop_stat":2,"osdop_create":0,"osdop_read":8,"osdop_write":3,"osdop_writefull":1,"osdop_writesame":0,"osdop_append":0,"osdop_zero":1,"osdop_truncate":0,"osdop_delete":5,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":14,"osdop_setxattr":0,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":0,"map_full":0,"map_inc":0,"osd_sessions":8,"osd_session_open":8,"osd_session_close":0,"osd_laggy":0,"omap_wr":1,"omap_rd":28,"omap_del":0},"oft":{"omap_total_objs":0,"omap_total_kv_pairs":0,"omap_total_updates":0,"omap_total_removes":0},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":0,"pq_executing":0,"pq_executing_high_water":0,"pq_executed":0,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":0,"max":104857600,"get_started":0,"get":72,"get_sum":115451,"get_or_fail_fail":0,"get_or_fail_success":72,"take":0,"take_sum":0,"put":72,"put_sum":115451,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":37,"take_sum":3955,"put":37,"put_sum":3955,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":37,"take_sum":37,"put":37,"put_sum":37,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":0,"take_sum":0,"put":0,"put_sum":0,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x55d33e7a4000":{"val":0,"max":3758096384,"get_started":0,"get":3,"get_sum":2591,"get_or_fail_fail":0,"get_or_fail_success":3,"take":0,"take_sum":0,"put":3,"put_sum":2591,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}}} 2023-10-06T03:03:01.388 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 3, "msgr_created_connections": 10, "msgr_handle_ack_lat": { "avgcount": 9, "avgtime": 7.96e-07, "sum": 7.17e-06 }, "msgr_recv_bytes": 105257, "msgr_recv_messages": 44, "msgr_running_fast_dispatch_time": 0.000766924, "msgr_running_recv_time": 0.013933213, "msgr_running_send_time": 0.003831812, "msgr_running_total_time": 0.020036492, "msgr_send_bytes": 45297, "msgr_send_messages": 33, "msgr_send_messages_queue_lat": { "avgcount": 33, "avgtime": 0.000211193, "sum": 0.006969396 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 4, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 9687, "msgr_recv_messages": 20, "msgr_running_fast_dispatch_time": 0.00060227, "msgr_running_recv_time": 0.005184554, "msgr_running_send_time": 0.002091222, "msgr_running_total_time": 0.008329844, "msgr_send_bytes": 94921, "msgr_send_messages": 24, "msgr_send_messages_queue_lat": { "avgcount": 22, "avgtime": 0.000246074, "sum": 0.005413638 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 4, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 9479, "msgr_recv_messages": 12, "msgr_running_fast_dispatch_time": 0.000589347, "msgr_running_recv_time": 0.004669638, "msgr_running_send_time": 0.000715274, "msgr_running_total_time": 0.006343631, "msgr_send_bytes": 4136, "msgr_send_messages": 14, "msgr_send_messages_queue_lat": { "avgcount": 12, "avgtime": 0.000659836, "sum": 0.007918033 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 39, "avgtime": 0.000112009, "sum": 0.004368369 }, "queue_len": 0 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 4, "avgtime": 4.4433e-05, "sum": 0.000177735 }, "queue_len": 0 }, "mds": { "caps": 2, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 0, "ceph_cap_op_revoke": 0, "ceph_cap_op_trunc": 0, "dir_commit": 0, "dir_fetch": 12, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 0, "handle_client_caps": 0, "handle_client_caps_dirty": 0, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 11, "inodes_bottom": 11, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 11, "inodes_top": 0, "inodes_with_caps": 2, "load_cent": 161, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 1, "q": 0, "reply": 2, "reply_latency": { "avgcount": 2, "avgtime": 0.002666297, "sum": 0.005332595 }, "request": 4, "root_rbytes": 0, "root_rfiles": 1, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 4, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 4, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 0, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 0, "strays_enqueued": 0, "strays_migrated": 0, "strays_reintegrated": 0 }, "mds_log": { "ev": 5, "evadd": 3, "evex": 0, "evexd": 0, "evexg": 0, "evtrm": 0, "expos": 4194304, "jlat": { "avgcount": 3, "avgtime": 0.003672173, "sum": 0.01101652 }, "rdpos": 4195196, "replayed": 2, "seg": 1, "segadd": 0, "segex": 0, "segexd": 0, "segexg": 0, "segtrm": 0, "wrpos": 4198045 }, "mds_mem": { "cap": 2, "cap+": 2, "cap-": 0, "dir": 12, "dir+": 12, "dir-": 0, "dn": 11, "dn+": 11, "dn-": 0, "heap": 223456, "ino": 14, "ino+": 14, "ino-": 0, "rss": 40540 }, "mds_server": { "cap_acquisition_throttle": 0, "cap_revoke_eviction": 0, "dispatch_client_request": 3, "dispatch_server_request": 0, "handle_client_request": 4, "handle_client_session": 0, "handle_peer_request": 0, "req_create_latency": { "avgcount": 1, "avgtime": 0.005055413, "sum": 0.005055413 }, "req_getattr_latency": { "avgcount": 1, "avgtime": 0.000277182, "sum": 0.000277182 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_readdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "mds_sessions": { "average_load": 1, "avg_session_uptime": 913, "mdthresh_evicted": 0, "session_add": 1, "session_count": 1, "session_remove": 0, "sessions_open": 1, "sessions_stale": 0, "total_load": 1 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_Blob_bytes": 0, "bluestore_Blob_items": 0, "bluestore_Buffer_bytes": 0, "bluestore_Buffer_items": 0, "bluestore_Extent_bytes": 0, "bluestore_Extent_items": 0, "bluestore_SharedBlob_bytes": 0, "bluestore_SharedBlob_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 226268, "buffer_anon_items": 69, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "mds_co_bytes": 50688, "mds_co_items": 189, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 6336, "osdmap_items": 93, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "omap_del": 0, "omap_rd": 28, "omap_wr": 1, "op": 37, "op_active": 0, "op_laggy": 0, "op_pg": 0, "op_r": 26, "op_reply": 37, "op_resend": 0, "op_rmw": 0, "op_send": 37, "op_send_bytes": 3029, "op_w": 11, "oplen_avg": { "avgcount": 37, "sum": 63 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 8, "osd_sessions": 8, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 0, "osdop_delete": 5, "osdop_getxattr": 14, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 8, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 0, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 2, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 3, "osdop_writefull": 1, "osdop_writesame": 0, "osdop_zero": 1, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 0, "omap_total_objs": 0, "omap_total_removes": 0, "omap_total_updates": 0 }, "purge_queue": { "pq_executed": 0, "pq_executing": 0, "pq_executing_high_water": 0, "pq_executing_ops": 0, "pq_executing_ops_high_water": 0, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 72, "get_or_fail_fail": 0, "get_or_fail_success": 72, "get_started": 0, "get_sum": 115451, "max": 104857600, "put": 72, "put_sum": 115451, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 37, "put_sum": 3955, "take": 37, "take_sum": 3955, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 37, "put_sum": 37, "take": 37, "take_sum": 37, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 3758096384, "put": 0, "put_sum": 0, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x55d33e7a4000": { "get": 3, "get_or_fail_fail": 0, "get_or_fail_success": 3, "get_started": 0, "get_sum": 2591, "max": 3758096384, "put": 3, "put_sum": 2591, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } } } 2023-10-06T03:03:01.389 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120 retry_count=0)... 2023-10-06T03:03:06.394 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:03:06.571 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:06.565+0000 7fa540b85700 1 Processor -- start 2023-10-06T03:03:06.571 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:06.569+0000 7fa540b85700 1 -- start start 2023-10-06T03:03:06.573 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:06.569+0000 7fa540b85700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fa53c06d0d0 0x7fa53c0c2540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:06.573 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:06.569+0000 7fa540b85700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa53c0c2a80 0x7fa53c0aec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:06.573 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:06.569+0000 7fa540b85700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa53c0c14a0 con 0x7fa53c0c6510 2023-10-06T03:03:06.573 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:06.569+0000 7fa540b85700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa53c0c1780 con 0x7fa53c06d0d0 2023-10-06T03:03:06.573 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:06.569+0000 7fa540b85700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa53c0c1a60 con 0x7fa53c0c2a80 2023-10-06T03:03:06.574 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:06.569+0000 7fa539d9b700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fa53c06d0d0 0x7fa53c0c2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:06.574 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:06.569+0000 7fa53ad9d700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa53c0c2a80 0x7fa53c0aec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:06.574 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:06.569+0000 7fa539d9b700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fa53c06d0d0 0x7fa53c0c2540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.57:56848/0 (socket says 172.21.15.57:56848) 2023-10-06T03:03:06.574 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:06.569+0000 7fa539d9b700 1 -- 172.21.15.57:0/2789875156 learned_addr learned my addr 172.21.15.57:0/2789875156 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:03:06.574 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:06.569+0000 7fa53a59c700 1 --1- 172.21.15.57:0/2789875156 >> v1:172.21.15.105:6789/0 conn(0x7fa53c0c6510 0x7fa53c0c0c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.57:41628/0 (socket says 172.21.15.57:41628) 2023-10-06T03:03:06.575 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:06.573+0000 7fa539d9b700 1 -- 172.21.15.57:0/2789875156 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa53c0c2a80 msgr2=0x7fa53c0aec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:03:06.575 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:06.573+0000 7fa539d9b700 1 --2- 172.21.15.57:0/2789875156 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa53c0c2a80 0x7fa53c0aec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:06.575 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:06.573+0000 7fa539d9b700 1 -- 172.21.15.57:0/2789875156 >> v1:172.21.15.105:6789/0 conn(0x7fa53c0c6510 legacy=0x7fa53c0c0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:06.575 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:06.573+0000 7fa539d9b700 1 -- 172.21.15.57:0/2789875156 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa53c0c1d40 con 0x7fa53c06d0d0 2023-10-06T03:03:06.575 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:06.573+0000 7fa539d9b700 1 --2- 172.21.15.57:0/2789875156 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa53c06d0d0 0x7fa53c0c2540 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa5300099b0 tx=0x7fa530009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=10918dea45b257ef server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:03:06.576 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:06.573+0000 7fa53959a700 1 -- 172.21.15.57:0/2789875156 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa530009ea0 con 0x7fa53c06d0d0 2023-10-06T03:03:06.576 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:06.573+0000 7fa53959a700 1 -- 172.21.15.57:0/2789875156 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa53000b860 con 0x7fa53c06d0d0 2023-10-06T03:03:06.576 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:06.573+0000 7fa53959a700 1 -- 172.21.15.57:0/2789875156 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa53000bc00 con 0x7fa53c06d0d0 2023-10-06T03:03:06.577 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:06.573+0000 7fa540b85700 1 -- 172.21.15.57:0/2789875156 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa53c06d0d0 msgr2=0x7fa53c0c2540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:06.577 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:06.573+0000 7fa540b85700 1 --2- 172.21.15.57:0/2789875156 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa53c06d0d0 0x7fa53c0c2540 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa5300099b0 tx=0x7fa530009250 comp rx=0 tx=0).stop 2023-10-06T03:03:06.577 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:06.573+0000 7fa540b85700 1 -- 172.21.15.57:0/2789875156 shutdown_connections 2023-10-06T03:03:06.578 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:06.573+0000 7fa540b85700 1 --2- 172.21.15.57:0/2789875156 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa53c0c2a80 0x7fa53c0aec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:06.578 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:06.573+0000 7fa540b85700 1 --2- 172.21.15.57:0/2789875156 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa53c06d0d0 0x7fa53c0c2540 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:06.578 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:06.573+0000 7fa540b85700 1 -- 172.21.15.57:0/2789875156 >> 172.21.15.57:0/2789875156 conn(0x7fa53c0cbed0 msgr2=0x7fa53c0cc2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:03:06.578 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:06.573+0000 7fa540b85700 1 -- 172.21.15.57:0/2789875156 shutdown_connections 2023-10-06T03:03:06.578 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:06.573+0000 7fa540b85700 1 -- 172.21.15.57:0/2789875156 wait complete. 2023-10-06T03:03:06.580 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:06.577+0000 7fa540b85700 1 Processor -- start 2023-10-06T03:03:06.580 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:06.577+0000 7fa540b85700 1 -- start start 2023-10-06T03:03:06.582 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:06.577+0000 7fa540b85700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa53c06d0d0 0x7fa53c0c2f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:06.582 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:06.577+0000 7fa540b85700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa53c0c2a80 0x7fa53c13fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:06.582 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:06.577+0000 7fa540b85700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa53c0c6510 0x7fa53c0cb2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:06.582 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:06.577+0000 7fa540b85700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa53c0c5b00 con 0x7fa53c0c2a80 2023-10-06T03:03:06.582 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:06.577+0000 7fa540b85700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa53c0afbc0 con 0x7fa53c0c6510 2023-10-06T03:03:06.582 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:06.577+0000 7fa540b85700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa53c0afe80 con 0x7fa53c06d0d0 2023-10-06T03:03:06.583 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:06.577+0000 7fa539d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa53c0c2a80 0x7fa53c13fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:06.583 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:06.577+0000 7fa539d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa53c0c2a80 0x7fa53c13fb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:49236/0 (socket says 172.21.15.57:49236) 2023-10-06T03:03:06.583 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:06.577+0000 7fa539d9b700 1 -- 172.21.15.57:0/1812607914 learned_addr learned my addr 172.21.15.57:0/1812607914 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:03:06.583 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:06.581+0000 7fa53a59c700 1 --2- 172.21.15.57:0/1812607914 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa53c06d0d0 0x7fa53c0c2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:06.583 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:06.581+0000 7fa53ad9d700 1 --2- 172.21.15.57:0/1812607914 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa53c0c6510 0x7fa53c0cb2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:06.584 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:06.581+0000 7fa539d9b700 1 -- 172.21.15.57:0/1812607914 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa53c06d0d0 msgr2=0x7fa53c0c2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:06.584 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:06.581+0000 7fa539d9b700 1 --2- 172.21.15.57:0/1812607914 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa53c06d0d0 0x7fa53c0c2f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:06.584 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:06.581+0000 7fa539d9b700 1 -- 172.21.15.57:0/1812607914 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa53c0c6510 msgr2=0x7fa53c0cb2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:06.584 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:06.581+0000 7fa539d9b700 1 --2- 172.21.15.57:0/1812607914 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa53c0c6510 0x7fa53c0cb2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:06.584 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:06.581+0000 7fa539d9b700 1 -- 172.21.15.57:0/1812607914 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5300094f0 con 0x7fa53c0c2a80 2023-10-06T03:03:06.585 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:06.581+0000 7fa539d9b700 1 --2- 172.21.15.57:0/1812607914 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa53c0c2a80 0x7fa53c13fb20 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fa530006fd0 tx=0x7fa530017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:03:06.585 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:06.581+0000 7fa52a7fc700 1 -- 172.21.15.57:0/1812607914 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa53000bbe0 con 0x7fa53c0c2a80 2023-10-06T03:03:06.585 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:06.581+0000 7fa52a7fc700 1 -- 172.21.15.57:0/1812607914 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa530000c90 con 0x7fa53c0c2a80 2023-10-06T03:03:06.585 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:06.581+0000 7fa540b85700 1 -- 172.21.15.57:0/1812607914 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa53c0c5260 con 0x7fa53c0c2a80 2023-10-06T03:03:06.585 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:06.581+0000 7fa52a7fc700 1 -- 172.21.15.57:0/1812607914 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa530011650 con 0x7fa53c0c2a80 2023-10-06T03:03:06.585 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:06.581+0000 7fa540b85700 1 -- 172.21.15.57:0/1812607914 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa53c0c5820 con 0x7fa53c0c2a80 2023-10-06T03:03:06.586 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:06.581+0000 7fa540b85700 1 -- 172.21.15.57:0/1812607914 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa53c0c4fb0 con 0x7fa53c0c2a80 2023-10-06T03:03:06.587 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:06.585+0000 7fa52a7fc700 1 -- 172.21.15.57:0/1812607914 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fa530011a40 con 0x7fa53c0c2a80 2023-10-06T03:03:06.589 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:06.585+0000 7fa52a7fc700 1 --2- 172.21.15.57:0/1812607914 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fa51c060550 0x7fa51c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:06.589 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:06.585+0000 7fa52a7fc700 1 -- 172.21.15.57:0/1812607914 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6144+0+0 (secure 0 0 0) 0x7fa53007e160 con 0x7fa53c0c2a80 2023-10-06T03:03:06.589 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:06.585+0000 7fa53a59c700 1 --2- 172.21.15.57:0/1812607914 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fa51c060550 0x7fa51c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:06.590 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:06.589+0000 7fa53a59c700 1 --2- 172.21.15.57:0/1812607914 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fa51c060550 0x7fa51c062a00 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fa53c140510 tx=0x7fa52c007ea0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:03:06.594 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:06.593+0000 7fa52a7fc700 1 -- 172.21.15.57:0/1812607914 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fa53004e520 con 0x7fa53c0c2a80 2023-10-06T03:03:06.802 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:06.797+0000 7fa540b85700 1 -- 172.21.15.57:0/1812607914 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa53c0c2020 con 0x7fa53c0c2a80 2023-10-06T03:03:06.804 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:06.801+0000 7fa52a7fc700 1 -- 172.21.15.57:0/1812607914 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4598 (secure 0 0 0) 0x7fa530051b40 con 0x7fa53c0c2a80 2023-10-06T03:03:06.804 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:03:06.804 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":38,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5222,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/879829980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":879829980},{"type":"v1","addr":"172.21.15.105:6833","nonce":879829980}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5225,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/3705921279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":3705921279},{"type":"v1","addr":"172.21.15.105:6835","nonce":3705921279}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/251759282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":251759282},{"type":"v1","addr":"172.21.15.57:6835","nonce":251759282}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:02:39.274111+0000","modified":"2023-10-06T03:02:56.856783+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":54,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5643},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5643":{"gid":5643,"name":"c","rank":0,"incarnation":34,"state":"up:active","state_seq":5,"addr":"172.21.15.57:6837/3347844181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6836","nonce":3347844181},{"type":"v1","addr":"172.21.15.57:6837","nonce":3347844181}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T03:03:06.806 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:06.801+0000 7fa540b85700 1 -- 172.21.15.57:0/1812607914 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fa51c060550 msgr2=0x7fa51c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:06.806 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:06.801+0000 7fa540b85700 1 --2- 172.21.15.57:0/1812607914 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fa51c060550 0x7fa51c062a00 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fa53c140510 tx=0x7fa52c007ea0 comp rx=0 tx=0).stop 2023-10-06T03:03:06.806 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:06.801+0000 7fa540b85700 1 -- 172.21.15.57:0/1812607914 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa53c0c2a80 msgr2=0x7fa53c13fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:06.806 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:06.801+0000 7fa540b85700 1 --2- 172.21.15.57:0/1812607914 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa53c0c2a80 0x7fa53c13fb20 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fa530006fd0 tx=0x7fa530017000 comp rx=0 tx=0).stop 2023-10-06T03:03:06.807 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:06.805+0000 7fa540b85700 1 -- 172.21.15.57:0/1812607914 shutdown_connections 2023-10-06T03:03:06.807 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:06.805+0000 7fa540b85700 1 --2- 172.21.15.57:0/1812607914 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa53c0c6510 0x7fa53c0cb2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:06.807 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:06.805+0000 7fa540b85700 1 --2- 172.21.15.57:0/1812607914 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa53c0c2a80 0x7fa53c13fb20 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:06.807 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:06.805+0000 7fa540b85700 1 --2- 172.21.15.57:0/1812607914 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fa51c060550 0x7fa51c062a00 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:06.808 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:06.805+0000 7fa540b85700 1 --2- 172.21.15.57:0/1812607914 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa53c06d0d0 0x7fa53c0c2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:06.808 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:06.805+0000 7fa540b85700 1 -- 172.21.15.57:0/1812607914 >> 172.21.15.57:0/1812607914 conn(0x7fa53c0cbed0 msgr2=0x7fa53c13c890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:03:06.808 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:06.805+0000 7fa540b85700 1 -- 172.21.15.57:0/1812607914 shutdown_connections 2023-10-06T03:03:06.808 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:06.805+0000 7fa540b85700 1 -- 172.21.15.57:0/1812607914 wait complete. 2023-10-06T03:03:06.810 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 38 2023-10-06T03:03:06.828 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json perf dump 2023-10-06T03:03:06.995 INFO:teuthology.orchestra.run.smithi057.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":52,"msgr_send_messages":35,"msgr_recv_bytes":108283,"msgr_send_bytes":46216,"msgr_created_connections":10,"msgr_active_connections":3,"msgr_running_total_time":0.022694594,"msgr_running_send_time":0.005346374,"msgr_running_recv_time":0.014526931,"msgr_running_fast_dispatch_time":0.001264429,"msgr_send_messages_queue_lat":{"avgcount":35,"sum":0.007068394,"avgtime":0.000201954},"msgr_handle_ack_lat":{"avgcount":10,"sum":0.000008507,"avgtime":0.000000850}},"AsyncMessenger::Worker-1":{"msgr_recv_messages":21,"msgr_send_messages":26,"msgr_recv_bytes":9933,"msgr_send_bytes":98637,"msgr_created_connections":6,"msgr_active_connections":4,"msgr_running_total_time":0.008740436,"msgr_running_send_time":0.002375310,"msgr_running_recv_time":0.005214588,"msgr_running_fast_dispatch_time":0.000643523,"msgr_send_messages_queue_lat":{"avgcount":24,"sum":0.005574489,"avgtime":0.000232270},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"AsyncMessenger::Worker-2":{"msgr_recv_messages":16,"msgr_send_messages":18,"msgr_recv_bytes":10773,"msgr_send_bytes":6198,"msgr_created_connections":6,"msgr_active_connections":4,"msgr_running_total_time":0.007012821,"msgr_running_send_time":0.000973107,"msgr_running_recv_time":0.004861993,"msgr_running_fast_dispatch_time":0.000767528,"msgr_send_messages_queue_lat":{"avgcount":16,"sum":0.008215046,"avgtime":0.000513440},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":0,"complete_latency":{"avgcount":43,"sum":0.004722413,"avgtime":0.000109823}},"finisher-PurgeQueue":{"queue_len":0,"complete_latency":{"avgcount":4,"sum":0.000177735,"avgtime":0.000044433}},"mds":{"request":4,"reply":2,"reply_latency":{"avgcount":2,"sum":0.005332595,"avgtime":0.002666297},"slow_reply":0,"forward":0,"dir_fetch":12,"dir_commit":0,"dir_split":0,"dir_merge":0,"inodes":11,"inodes_top":0,"inodes_bottom":11,"inodes_pin_tail":0,"inodes_pinned":11,"inodes_expired":0,"inodes_with_caps":2,"caps":2,"subtrees":2,"traverse":4,"traverse_hit":4,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":161,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":1,"root_rbytes":0,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":0,"ceph_cap_op_grant":0,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":1,"handle_client_caps_dirty":1,"handle_client_cap_release":0,"process_request_cap_release":1},"mds_cache":{"num_strays":0,"num_strays_delayed":0,"num_strays_enqueuing":0,"strays_created":0,"strays_enqueued":0,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0},"mds_log":{"evadd":4,"evex":0,"evtrm":0,"ev":6,"evexg":0,"evexd":0,"segadd":0,"segex":0,"segtrm":0,"seg":1,"segexg":0,"segexd":0,"expos":4194304,"wrpos":4199722,"rdpos":4195196,"jlat":{"avgcount":4,"sum":0.015392207,"avgtime":0.003848051},"replayed":2},"mds_mem":{"ino":14,"ino+":14,"ino-":0,"dir":12,"dir+":12,"dir-":0,"dn":11,"dn+":11,"dn-":0,"cap":2,"cap+":2,"cap-":0,"rss":41052,"heap":223456},"mds_server":{"dispatch_client_request":3,"dispatch_server_request":0,"handle_client_request":4,"handle_client_session":0,"handle_peer_request":0,"req_create_latency":{"avgcount":1,"sum":0.005055413,"avgtime":0.005055413},"req_getattr_latency":{"avgcount":1,"sum":0.000277182,"avgtime":0.000277182},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_readdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"cap_revoke_eviction":0,"cap_acquisition_throttle":0,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":1,"session_add":1,"session_remove":0,"sessions_open":1,"sessions_stale":0,"total_load":1,"average_load":1,"avg_session_uptime":918,"mdthresh_evicted":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_Buffer_bytes":0,"bluestore_Buffer_items":0,"bluestore_Extent_bytes":0,"bluestore_Extent_items":0,"bluestore_Blob_bytes":0,"bluestore_Blob_items":0,"bluestore_SharedBlob_bytes":0,"bluestore_SharedBlob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":225511,"buffer_anon_items":66,"buffer_meta_bytes":0,"buffer_meta_items":0,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":6336,"osdmap_items":93,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":53871,"mds_co_items":229,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":42,"op_send_bytes":5242,"op_resend":0,"op_reply":42,"oplen_avg":{"avgcount":42,"sum":75},"op":42,"op_r":26,"op_w":16,"op_rmw":0,"op_pg":0,"osdop_stat":2,"osdop_create":0,"osdop_read":8,"osdop_write":4,"osdop_writefull":1,"osdop_writesame":0,"osdop_append":0,"osdop_zero":1,"osdop_truncate":0,"osdop_delete":5,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":14,"osdop_setxattr":0,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":0,"map_full":0,"map_inc":0,"osd_sessions":8,"osd_session_open":8,"osd_session_close":0,"osd_laggy":0,"omap_wr":9,"omap_rd":28,"omap_del":3},"oft":{"omap_total_objs":2,"omap_total_kv_pairs":2,"omap_total_updates":2,"omap_total_removes":0},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":0,"pq_executing":0,"pq_executing_high_water":0,"pq_executed":0,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":0,"max":104857600,"get_started":0,"get":85,"get_sum":118907,"get_or_fail_fail":0,"get_or_fail_success":85,"take":0,"take_sum":0,"put":85,"put_sum":118907,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":42,"take_sum":6168,"put":42,"put_sum":6168,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":42,"take_sum":42,"put":42,"put_sum":42,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":0,"take_sum":0,"put":0,"put_sum":0,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x55d33e7a4000":{"val":0,"max":3758096384,"get_started":0,"get":4,"get_sum":4268,"get_or_fail_fail":0,"get_or_fail_success":4,"take":0,"take_sum":0,"put":4,"put_sum":4268,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}}} 2023-10-06T03:03:06.999 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 3, "msgr_created_connections": 10, "msgr_handle_ack_lat": { "avgcount": 10, "avgtime": 8.5e-07, "sum": 8.507e-06 }, "msgr_recv_bytes": 108283, "msgr_recv_messages": 52, "msgr_running_fast_dispatch_time": 0.001264429, "msgr_running_recv_time": 0.014526931, "msgr_running_send_time": 0.005346374, "msgr_running_total_time": 0.022694594, "msgr_send_bytes": 46216, "msgr_send_messages": 35, "msgr_send_messages_queue_lat": { "avgcount": 35, "avgtime": 0.000201954, "sum": 0.007068394 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 4, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 9933, "msgr_recv_messages": 21, "msgr_running_fast_dispatch_time": 0.000643523, "msgr_running_recv_time": 0.005214588, "msgr_running_send_time": 0.00237531, "msgr_running_total_time": 0.008740436, "msgr_send_bytes": 98637, "msgr_send_messages": 26, "msgr_send_messages_queue_lat": { "avgcount": 24, "avgtime": 0.00023227, "sum": 0.005574489 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 4, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 10773, "msgr_recv_messages": 16, "msgr_running_fast_dispatch_time": 0.000767528, "msgr_running_recv_time": 0.004861993, "msgr_running_send_time": 0.000973107, "msgr_running_total_time": 0.007012821, "msgr_send_bytes": 6198, "msgr_send_messages": 18, "msgr_send_messages_queue_lat": { "avgcount": 16, "avgtime": 0.00051344, "sum": 0.008215046 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 43, "avgtime": 0.000109823, "sum": 0.004722413 }, "queue_len": 0 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 4, "avgtime": 4.4433e-05, "sum": 0.000177735 }, "queue_len": 0 }, "mds": { "caps": 2, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 0, "ceph_cap_op_revoke": 0, "ceph_cap_op_trunc": 0, "dir_commit": 0, "dir_fetch": 12, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 0, "handle_client_caps": 1, "handle_client_caps_dirty": 1, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 11, "inodes_bottom": 11, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 11, "inodes_top": 0, "inodes_with_caps": 2, "load_cent": 161, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 1, "q": 0, "reply": 2, "reply_latency": { "avgcount": 2, "avgtime": 0.002666297, "sum": 0.005332595 }, "request": 4, "root_rbytes": 0, "root_rfiles": 1, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 4, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 4, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 0, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 0, "strays_enqueued": 0, "strays_migrated": 0, "strays_reintegrated": 0 }, "mds_log": { "ev": 6, "evadd": 4, "evex": 0, "evexd": 0, "evexg": 0, "evtrm": 0, "expos": 4194304, "jlat": { "avgcount": 4, "avgtime": 0.003848051, "sum": 0.015392207 }, "rdpos": 4195196, "replayed": 2, "seg": 1, "segadd": 0, "segex": 0, "segexd": 0, "segexg": 0, "segtrm": 0, "wrpos": 4199722 }, "mds_mem": { "cap": 2, "cap+": 2, "cap-": 0, "dir": 12, "dir+": 12, "dir-": 0, "dn": 11, "dn+": 11, "dn-": 0, "heap": 223456, "ino": 14, "ino+": 14, "ino-": 0, "rss": 41052 }, "mds_server": { "cap_acquisition_throttle": 0, "cap_revoke_eviction": 0, "dispatch_client_request": 3, "dispatch_server_request": 0, "handle_client_request": 4, "handle_client_session": 0, "handle_peer_request": 0, "req_create_latency": { "avgcount": 1, "avgtime": 0.005055413, "sum": 0.005055413 }, "req_getattr_latency": { "avgcount": 1, "avgtime": 0.000277182, "sum": 0.000277182 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_readdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "mds_sessions": { "average_load": 1, "avg_session_uptime": 918, "mdthresh_evicted": 0, "session_add": 1, "session_count": 1, "session_remove": 0, "sessions_open": 1, "sessions_stale": 0, "total_load": 1 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_Blob_bytes": 0, "bluestore_Blob_items": 0, "bluestore_Buffer_bytes": 0, "bluestore_Buffer_items": 0, "bluestore_Extent_bytes": 0, "bluestore_Extent_items": 0, "bluestore_SharedBlob_bytes": 0, "bluestore_SharedBlob_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 225511, "buffer_anon_items": 66, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "mds_co_bytes": 53871, "mds_co_items": 229, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 6336, "osdmap_items": 93, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "omap_del": 3, "omap_rd": 28, "omap_wr": 9, "op": 42, "op_active": 0, "op_laggy": 0, "op_pg": 0, "op_r": 26, "op_reply": 42, "op_resend": 0, "op_rmw": 0, "op_send": 42, "op_send_bytes": 5242, "op_w": 16, "oplen_avg": { "avgcount": 42, "sum": 75 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 8, "osd_sessions": 8, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 0, "osdop_delete": 5, "osdop_getxattr": 14, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 8, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 0, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 2, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 4, "osdop_writefull": 1, "osdop_writesame": 0, "osdop_zero": 1, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 2, "omap_total_objs": 2, "omap_total_removes": 0, "omap_total_updates": 2 }, "purge_queue": { "pq_executed": 0, "pq_executing": 0, "pq_executing_high_water": 0, "pq_executing_ops": 0, "pq_executing_ops_high_water": 0, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 85, "get_or_fail_fail": 0, "get_or_fail_success": 85, "get_started": 0, "get_sum": 118907, "max": 104857600, "put": 85, "put_sum": 118907, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 42, "put_sum": 6168, "take": 42, "take_sum": 6168, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 42, "put_sum": 42, "take": 42, "take_sum": 42, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 3758096384, "put": 0, "put_sum": 0, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x55d33e7a4000": { "get": 4, "get_or_fail_fail": 0, "get_or_fail_success": 4, "get_started": 0, "get_sum": 4268, "max": 3758096384, "put": 4, "put_sum": 4268, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } } } 2023-10-06T03:03:07.000 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-10-06T03:03:07.000 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:03:07.159 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.157+0000 7fc7ce4cd700 1 Processor -- start 2023-10-06T03:03:07.159 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.157+0000 7fc7ce4cd700 1 -- start start 2023-10-06T03:03:07.161 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.157+0000 7fc7ce4cd700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc7c80aec90 0x7fc7c80af0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:07.161 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.157+0000 7fc7ce4cd700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7c80c14a0 con 0x7fc7c806d0d0 2023-10-06T03:03:07.161 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.157+0000 7fc7ce4cd700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7c80c1780 con 0x7fc7c80c6510 2023-10-06T03:03:07.161 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.157+0000 7fc7ce4cd700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c80af630 con 0x7fc7c80aec90 2023-10-06T03:03:07.161 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.157+0000 7fc7bf7fe700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fc7c806d0d0 0x7fc7c80c2540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:38364/0 (socket says 172.21.15.57:38364) 2023-10-06T03:03:07.161 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.157+0000 7fc7bf7fe700 1 -- 172.21.15.57:0/4022102873 learned_addr learned my addr 172.21.15.57:0/4022102873 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:03:07.162 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.157+0000 7fc7cca6a700 1 --2- 172.21.15.57:0/4022102873 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc7c80aec90 0x7fc7c80af0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:07.162 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.157+0000 7fc7c77fe700 1 -- 172.21.15.57:0/4022102873 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3684162483 0 0) 0x7fc7c80c14a0 con 0x7fc7c806d0d0 2023-10-06T03:03:07.162 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.157+0000 7fc7c77fe700 1 -- 172.21.15.57:0/4022102873 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7b4003570 con 0x7fc7c806d0d0 2023-10-06T03:03:07.163 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.157+0000 7fc7cca6a700 1 -- 172.21.15.57:0/4022102873 >> v1:172.21.15.105:6789/0 conn(0x7fc7c80c6510 legacy=0x7fc7c80c0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:07.163 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.157+0000 7fc7cca6a700 1 -- 172.21.15.57:0/4022102873 >> v1:172.21.15.57:6789/0 conn(0x7fc7c806d0d0 legacy=0x7fc7c80c2540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:07.163 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.157+0000 7fc7cca6a700 1 -- 172.21.15.57:0/4022102873 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7c80c1a60 con 0x7fc7c80aec90 2023-10-06T03:03:07.163 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.161+0000 7fc7cca6a700 1 --2- 172.21.15.57:0/4022102873 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc7c80aec90 0x7fc7c80af0f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc7c0009e90 tx=0x7fc7c0009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3b06a17cf48e64fa server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:03:07.164 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.161+0000 7fc7c77fe700 1 -- 172.21.15.57:0/4022102873 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c000e070 con 0x7fc7c80aec90 2023-10-06T03:03:07.164 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.161+0000 7fc7c77fe700 1 -- 172.21.15.57:0/4022102873 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7c000bc80 con 0x7fc7c80aec90 2023-10-06T03:03:07.164 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.161+0000 7fc7c77fe700 1 -- 172.21.15.57:0/4022102873 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c0012430 con 0x7fc7c80aec90 2023-10-06T03:03:07.165 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.161+0000 7fc7ce4cd700 1 -- 172.21.15.57:0/4022102873 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc7c80aec90 msgr2=0x7fc7c80af0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:07.165 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.161+0000 7fc7ce4cd700 1 --2- 172.21.15.57:0/4022102873 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc7c80aec90 0x7fc7c80af0f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc7c0009e90 tx=0x7fc7c0009780 comp rx=0 tx=0).stop 2023-10-06T03:03:07.165 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.161+0000 7fc7ce4cd700 1 -- 172.21.15.57:0/4022102873 shutdown_connections 2023-10-06T03:03:07.165 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.161+0000 7fc7ce4cd700 1 --2- 172.21.15.57:0/4022102873 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc7c80aec90 0x7fc7c80af0f0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:07.165 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.161+0000 7fc7ce4cd700 1 -- 172.21.15.57:0/4022102873 >> 172.21.15.57:0/4022102873 conn(0x7fc7c80cbed0 msgr2=0x7fc7c80cc2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:03:07.165 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.161+0000 7fc7ce4cd700 1 -- 172.21.15.57:0/4022102873 shutdown_connections 2023-10-06T03:03:07.165 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.161+0000 7fc7ce4cd700 1 -- 172.21.15.57:0/4022102873 wait complete. 2023-10-06T03:03:07.166 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.161+0000 7fc7ce4cd700 1 Processor -- start 2023-10-06T03:03:07.167 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.165+0000 7fc7ce4cd700 1 -- start start 2023-10-06T03:03:07.169 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.165+0000 7fc7ce4cd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7c806d0d0 0x7fc7c813b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:07.169 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.165+0000 7fc7ce4cd700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc7c80aec90 0x7fc7c80c52f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:07.169 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.165+0000 7fc7ce4cd700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc7c80c6510 0x7fc7c80c68e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:07.169 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.165+0000 7fc7ce4cd700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c8169c90 con 0x7fc7c806d0d0 2023-10-06T03:03:07.169 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.165+0000 7fc7ce4cd700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c8169360 con 0x7fc7c80c6510 2023-10-06T03:03:07.170 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.165+0000 7fc7ce4cd700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c8169640 con 0x7fc7c80aec90 2023-10-06T03:03:07.170 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.165+0000 7fc7c7fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7c806d0d0 0x7fc7c813b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:07.170 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.165+0000 7fc7c7fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7c806d0d0 0x7fc7c813b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:49240/0 (socket says 172.21.15.57:49240) 2023-10-06T03:03:07.170 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.165+0000 7fc7c7fff700 1 -- 172.21.15.57:0/2598221641 learned_addr learned my addr 172.21.15.57:0/2598221641 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:03:07.170 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.165+0000 7fc7bf7fe700 1 --2- 172.21.15.57:0/2598221641 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc7c80aec90 0x7fc7c80c52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:07.171 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.165+0000 7fc7cca6a700 1 --2- 172.21.15.57:0/2598221641 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc7c80c6510 0x7fc7c80c68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:07.171 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.165+0000 7fc7c7fff700 1 -- 172.21.15.57:0/2598221641 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc7c80aec90 msgr2=0x7fc7c80c52f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:07.171 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.165+0000 7fc7c7fff700 1 --2- 172.21.15.57:0/2598221641 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc7c80aec90 0x7fc7c80c52f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:07.171 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.165+0000 7fc7c7fff700 1 -- 172.21.15.57:0/2598221641 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc7c80c6510 msgr2=0x7fc7c80c68e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:07.171 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.165+0000 7fc7c7fff700 1 --2- 172.21.15.57:0/2598221641 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc7c80c6510 0x7fc7c80c68e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:07.171 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.165+0000 7fc7c7fff700 1 -- 172.21.15.57:0/2598221641 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7c0009a20 con 0x7fc7c806d0d0 2023-10-06T03:03:07.171 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.169+0000 7fc7c7fff700 1 --2- 172.21.15.57:0/2598221641 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7c806d0d0 0x7fc7c813b9d0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fc7b800c5b0 tx=0x7fc7b8007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:03:07.172 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.169+0000 7fc7c4ff9700 1 -- 172.21.15.57:0/2598221641 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7b8011590 con 0x7fc7c806d0d0 2023-10-06T03:03:07.172 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.169+0000 7fc7c4ff9700 1 -- 172.21.15.57:0/2598221641 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7b80116f0 con 0x7fc7c806d0d0 2023-10-06T03:03:07.172 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.169+0000 7fc7c4ff9700 1 -- 172.21.15.57:0/2598221641 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7b8011af0 con 0x7fc7c806d0d0 2023-10-06T03:03:07.172 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.169+0000 7fc7ce4cd700 1 -- 172.21.15.57:0/2598221641 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7c8169920 con 0x7fc7c806d0d0 2023-10-06T03:03:07.172 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.169+0000 7fc7ce4cd700 1 -- 172.21.15.57:0/2598221641 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7c816a120 con 0x7fc7c806d0d0 2023-10-06T03:03:07.173 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.169+0000 7fc7ce4cd700 1 -- 172.21.15.57:0/2598221641 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7c806b970 con 0x7fc7c806d0d0 2023-10-06T03:03:07.174 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.173+0000 7fc7c4ff9700 1 -- 172.21.15.57:0/2598221641 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fc7b801b3b0 con 0x7fc7c806d0d0 2023-10-06T03:03:07.177 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.173+0000 7fc7c4ff9700 1 --2- 172.21.15.57:0/2598221641 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fc7a8060550 0x7fc7a8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:07.177 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.173+0000 7fc7c4ff9700 1 -- 172.21.15.57:0/2598221641 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6144+0+0 (secure 0 0 0) 0x7fc7b807bd00 con 0x7fc7c806d0d0 2023-10-06T03:03:07.177 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.173+0000 7fc7bf7fe700 1 --2- 172.21.15.57:0/2598221641 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fc7a8060550 0x7fc7a8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:07.178 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.173+0000 7fc7bf7fe700 1 --2- 172.21.15.57:0/2598221641 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fc7a8060550 0x7fc7a8062a00 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fc7c806a4c0 tx=0x7fc7b0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:03:07.183 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.181+0000 7fc7c4ff9700 1 -- 172.21.15.57:0/2598221641 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fc7b804c1f0 con 0x7fc7c806d0d0 2023-10-06T03:03:07.391 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.389+0000 7fc7ce4cd700 1 -- 172.21.15.57:0/2598221641 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc7c80c1d40 con 0x7fc7c806d0d0 2023-10-06T03:03:07.392 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.389+0000 7fc7c4ff9700 1 -- 172.21.15.57:0/2598221641 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4598 (secure 0 0 0) 0x7fc7b8017020 con 0x7fc7c806d0d0 2023-10-06T03:03:07.393 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:03:07.393 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":38,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5222,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/879829980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":879829980},{"type":"v1","addr":"172.21.15.105:6833","nonce":879829980}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5225,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/3705921279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":3705921279},{"type":"v1","addr":"172.21.15.105:6835","nonce":3705921279}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/251759282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":251759282},{"type":"v1","addr":"172.21.15.57:6835","nonce":251759282}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:02:39.274111+0000","modified":"2023-10-06T03:02:56.856783+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":54,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5643},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5643":{"gid":5643,"name":"c","rank":0,"incarnation":34,"state":"up:active","state_seq":5,"addr":"172.21.15.57:6837/3347844181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6836","nonce":3347844181},{"type":"v1","addr":"172.21.15.57:6837","nonce":3347844181}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T03:03:07.396 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.393+0000 7fc7ce4cd700 1 -- 172.21.15.57:0/2598221641 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fc7a8060550 msgr2=0x7fc7a8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:07.396 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.393+0000 7fc7ce4cd700 1 --2- 172.21.15.57:0/2598221641 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fc7a8060550 0x7fc7a8062a00 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fc7c806a4c0 tx=0x7fc7b0009040 comp rx=0 tx=0).stop 2023-10-06T03:03:07.396 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.393+0000 7fc7ce4cd700 1 -- 172.21.15.57:0/2598221641 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7c806d0d0 msgr2=0x7fc7c813b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:07.396 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.393+0000 7fc7ce4cd700 1 --2- 172.21.15.57:0/2598221641 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7c806d0d0 0x7fc7c813b9d0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fc7b800c5b0 tx=0x7fc7b8007f30 comp rx=0 tx=0).stop 2023-10-06T03:03:07.396 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.393+0000 7fc7ce4cd700 1 -- 172.21.15.57:0/2598221641 shutdown_connections 2023-10-06T03:03:07.396 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.393+0000 7fc7ce4cd700 1 --2- 172.21.15.57:0/2598221641 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc7c80c6510 0x7fc7c80c68e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:07.396 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.393+0000 7fc7ce4cd700 1 --2- 172.21.15.57:0/2598221641 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fc7a8060550 0x7fc7a8062a00 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:07.396 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.393+0000 7fc7ce4cd700 1 --2- 172.21.15.57:0/2598221641 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc7c80aec90 0x7fc7c80c52f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:07.396 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.393+0000 7fc7ce4cd700 1 --2- 172.21.15.57:0/2598221641 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7c806d0d0 0x7fc7c813b9d0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:07.396 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.393+0000 7fc7ce4cd700 1 -- 172.21.15.57:0/2598221641 >> 172.21.15.57:0/2598221641 conn(0x7fc7c80cbed0 msgr2=0x7fc7c813ff40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:03:07.397 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.393+0000 7fc7ce4cd700 1 -- 172.21.15.57:0/2598221641 shutdown_connections 2023-10-06T03:03:07.397 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.393+0000 7fc7ce4cd700 1 -- 172.21.15.57:0/2598221641 wait complete. 2023-10-06T03:03:07.398 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 38 2023-10-06T03:03:07.417 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json perf dump 2023-10-06T03:03:07.591 INFO:teuthology.orchestra.run.smithi057.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":54,"msgr_send_messages":36,"msgr_recv_bytes":108787,"msgr_send_bytes":46319,"msgr_created_connections":10,"msgr_active_connections":3,"msgr_running_total_time":0.023380015,"msgr_running_send_time":0.005792890,"msgr_running_recv_time":0.014692963,"msgr_running_fast_dispatch_time":0.001354813,"msgr_send_messages_queue_lat":{"avgcount":36,"sum":0.007146129,"avgtime":0.000198503},"msgr_handle_ack_lat":{"avgcount":10,"sum":0.000008507,"avgtime":0.000000850}},"AsyncMessenger::Worker-1":{"msgr_recv_messages":21,"msgr_send_messages":26,"msgr_recv_bytes":9933,"msgr_send_bytes":98637,"msgr_created_connections":6,"msgr_active_connections":4,"msgr_running_total_time":0.008740436,"msgr_running_send_time":0.002375310,"msgr_running_recv_time":0.005214588,"msgr_running_fast_dispatch_time":0.000643523,"msgr_send_messages_queue_lat":{"avgcount":24,"sum":0.005574489,"avgtime":0.000232270},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"AsyncMessenger::Worker-2":{"msgr_recv_messages":16,"msgr_send_messages":18,"msgr_recv_bytes":10773,"msgr_send_bytes":6198,"msgr_created_connections":6,"msgr_active_connections":4,"msgr_running_total_time":0.007012821,"msgr_running_send_time":0.000973107,"msgr_running_recv_time":0.004861993,"msgr_running_fast_dispatch_time":0.000767528,"msgr_send_messages_queue_lat":{"avgcount":16,"sum":0.008215046,"avgtime":0.000513440},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":0,"complete_latency":{"avgcount":43,"sum":0.004722413,"avgtime":0.000109823}},"finisher-PurgeQueue":{"queue_len":0,"complete_latency":{"avgcount":4,"sum":0.000177735,"avgtime":0.000044433}},"mds":{"request":4,"reply":2,"reply_latency":{"avgcount":2,"sum":0.005332595,"avgtime":0.002666297},"slow_reply":0,"forward":0,"dir_fetch":12,"dir_commit":0,"dir_split":0,"dir_merge":0,"inodes":11,"inodes_top":0,"inodes_bottom":11,"inodes_pin_tail":0,"inodes_pinned":11,"inodes_expired":0,"inodes_with_caps":2,"caps":2,"subtrees":2,"traverse":4,"traverse_hit":4,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":161,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":1,"root_rbytes":7,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":0,"ceph_cap_op_grant":0,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":1,"handle_client_caps_dirty":1,"handle_client_cap_release":0,"process_request_cap_release":1},"mds_cache":{"num_strays":0,"num_strays_delayed":0,"num_strays_enqueuing":0,"strays_created":0,"strays_enqueued":0,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0},"mds_log":{"evadd":4,"evex":0,"evtrm":0,"ev":6,"evexg":0,"evexd":0,"segadd":0,"segex":0,"segtrm":0,"seg":1,"segexg":0,"segexd":0,"expos":4194304,"wrpos":4199722,"rdpos":4195196,"jlat":{"avgcount":4,"sum":0.015392207,"avgtime":0.003848051},"replayed":2},"mds_mem":{"ino":14,"ino+":14,"ino-":0,"dir":12,"dir+":12,"dir-":0,"dn":11,"dn+":11,"dn-":0,"cap":2,"cap+":2,"cap-":0,"rss":41052,"heap":223456},"mds_server":{"dispatch_client_request":3,"dispatch_server_request":0,"handle_client_request":4,"handle_client_session":1,"handle_peer_request":0,"req_create_latency":{"avgcount":1,"sum":0.005055413,"avgtime":0.005055413},"req_getattr_latency":{"avgcount":1,"sum":0.000277182,"avgtime":0.000277182},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_readdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"cap_revoke_eviction":0,"cap_acquisition_throttle":0,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":1,"session_add":1,"session_remove":0,"sessions_open":1,"sessions_stale":0,"total_load":1,"average_load":1,"avg_session_uptime":923,"mdthresh_evicted":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_Buffer_bytes":0,"bluestore_Buffer_items":0,"bluestore_Extent_bytes":0,"bluestore_Extent_items":0,"bluestore_Blob_bytes":0,"bluestore_Blob_items":0,"bluestore_SharedBlob_bytes":0,"bluestore_SharedBlob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":225511,"buffer_anon_items":66,"buffer_meta_bytes":0,"buffer_meta_items":0,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":6336,"osdmap_items":93,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":53911,"mds_co_items":234,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":42,"op_send_bytes":5242,"op_resend":0,"op_reply":42,"oplen_avg":{"avgcount":42,"sum":75},"op":42,"op_r":26,"op_w":16,"op_rmw":0,"op_pg":0,"osdop_stat":2,"osdop_create":0,"osdop_read":8,"osdop_write":4,"osdop_writefull":1,"osdop_writesame":0,"osdop_append":0,"osdop_zero":1,"osdop_truncate":0,"osdop_delete":5,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":14,"osdop_setxattr":0,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":0,"map_full":0,"map_inc":0,"osd_sessions":8,"osd_session_open":8,"osd_session_close":0,"osd_laggy":0,"omap_wr":9,"omap_rd":28,"omap_del":3},"oft":{"omap_total_objs":2,"omap_total_kv_pairs":2,"omap_total_updates":2,"omap_total_removes":0},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":0,"pq_executing":0,"pq_executing_high_water":0,"pq_executed":0,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":0,"max":104857600,"get_started":0,"get":87,"get_sum":119263,"get_or_fail_fail":0,"get_or_fail_success":87,"take":0,"take_sum":0,"put":87,"put_sum":119263,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":42,"take_sum":6168,"put":42,"put_sum":6168,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":42,"take_sum":42,"put":42,"put_sum":42,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":0,"take_sum":0,"put":0,"put_sum":0,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x55d33e7a4000":{"val":0,"max":3758096384,"get_started":0,"get":4,"get_sum":4268,"get_or_fail_fail":0,"get_or_fail_success":4,"take":0,"take_sum":0,"put":4,"put_sum":4268,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}}} 2023-10-06T03:03:07.593 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 3, "msgr_created_connections": 10, "msgr_handle_ack_lat": { "avgcount": 10, "avgtime": 8.5e-07, "sum": 8.507e-06 }, "msgr_recv_bytes": 108787, "msgr_recv_messages": 54, "msgr_running_fast_dispatch_time": 0.001354813, "msgr_running_recv_time": 0.014692963, "msgr_running_send_time": 0.00579289, "msgr_running_total_time": 0.023380015, "msgr_send_bytes": 46319, "msgr_send_messages": 36, "msgr_send_messages_queue_lat": { "avgcount": 36, "avgtime": 0.000198503, "sum": 0.007146129 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 4, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 9933, "msgr_recv_messages": 21, "msgr_running_fast_dispatch_time": 0.000643523, "msgr_running_recv_time": 0.005214588, "msgr_running_send_time": 0.00237531, "msgr_running_total_time": 0.008740436, "msgr_send_bytes": 98637, "msgr_send_messages": 26, "msgr_send_messages_queue_lat": { "avgcount": 24, "avgtime": 0.00023227, "sum": 0.005574489 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 4, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 10773, "msgr_recv_messages": 16, "msgr_running_fast_dispatch_time": 0.000767528, "msgr_running_recv_time": 0.004861993, "msgr_running_send_time": 0.000973107, "msgr_running_total_time": 0.007012821, "msgr_send_bytes": 6198, "msgr_send_messages": 18, "msgr_send_messages_queue_lat": { "avgcount": 16, "avgtime": 0.00051344, "sum": 0.008215046 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 43, "avgtime": 0.000109823, "sum": 0.004722413 }, "queue_len": 0 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 4, "avgtime": 4.4433e-05, "sum": 0.000177735 }, "queue_len": 0 }, "mds": { "caps": 2, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 0, "ceph_cap_op_revoke": 0, "ceph_cap_op_trunc": 0, "dir_commit": 0, "dir_fetch": 12, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 0, "handle_client_caps": 1, "handle_client_caps_dirty": 1, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 11, "inodes_bottom": 11, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 11, "inodes_top": 0, "inodes_with_caps": 2, "load_cent": 161, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 1, "q": 0, "reply": 2, "reply_latency": { "avgcount": 2, "avgtime": 0.002666297, "sum": 0.005332595 }, "request": 4, "root_rbytes": 7, "root_rfiles": 1, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 4, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 4, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 0, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 0, "strays_enqueued": 0, "strays_migrated": 0, "strays_reintegrated": 0 }, "mds_log": { "ev": 6, "evadd": 4, "evex": 0, "evexd": 0, "evexg": 0, "evtrm": 0, "expos": 4194304, "jlat": { "avgcount": 4, "avgtime": 0.003848051, "sum": 0.015392207 }, "rdpos": 4195196, "replayed": 2, "seg": 1, "segadd": 0, "segex": 0, "segexd": 0, "segexg": 0, "segtrm": 0, "wrpos": 4199722 }, "mds_mem": { "cap": 2, "cap+": 2, "cap-": 0, "dir": 12, "dir+": 12, "dir-": 0, "dn": 11, "dn+": 11, "dn-": 0, "heap": 223456, "ino": 14, "ino+": 14, "ino-": 0, "rss": 41052 }, "mds_server": { "cap_acquisition_throttle": 0, "cap_revoke_eviction": 0, "dispatch_client_request": 3, "dispatch_server_request": 0, "handle_client_request": 4, "handle_client_session": 1, "handle_peer_request": 0, "req_create_latency": { "avgcount": 1, "avgtime": 0.005055413, "sum": 0.005055413 }, "req_getattr_latency": { "avgcount": 1, "avgtime": 0.000277182, "sum": 0.000277182 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_readdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "mds_sessions": { "average_load": 1, "avg_session_uptime": 923, "mdthresh_evicted": 0, "session_add": 1, "session_count": 1, "session_remove": 0, "sessions_open": 1, "sessions_stale": 0, "total_load": 1 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_Blob_bytes": 0, "bluestore_Blob_items": 0, "bluestore_Buffer_bytes": 0, "bluestore_Buffer_items": 0, "bluestore_Extent_bytes": 0, "bluestore_Extent_items": 0, "bluestore_SharedBlob_bytes": 0, "bluestore_SharedBlob_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 225511, "buffer_anon_items": 66, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "mds_co_bytes": 53911, "mds_co_items": 234, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 6336, "osdmap_items": 93, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "omap_del": 3, "omap_rd": 28, "omap_wr": 9, "op": 42, "op_active": 0, "op_laggy": 0, "op_pg": 0, "op_r": 26, "op_reply": 42, "op_resend": 0, "op_rmw": 0, "op_send": 42, "op_send_bytes": 5242, "op_w": 16, "oplen_avg": { "avgcount": 42, "sum": 75 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 8, "osd_sessions": 8, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 0, "osdop_delete": 5, "osdop_getxattr": 14, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 8, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 0, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 2, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 4, "osdop_writefull": 1, "osdop_writesame": 0, "osdop_zero": 1, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 2, "omap_total_objs": 2, "omap_total_removes": 0, "omap_total_updates": 2 }, "purge_queue": { "pq_executed": 0, "pq_executing": 0, "pq_executing_high_water": 0, "pq_executing_ops": 0, "pq_executing_ops_high_water": 0, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 87, "get_or_fail_fail": 0, "get_or_fail_success": 87, "get_started": 0, "get_sum": 119263, "max": 104857600, "put": 87, "put_sum": 119263, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 42, "put_sum": 6168, "take": 42, "take_sum": 6168, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 42, "put_sum": 42, "take": 42, "take_sum": 42, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 3758096384, "put": 0, "put_sum": 0, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x55d33e7a4000": { "get": 4, "get_or_fail_fail": 0, "get_or_fail_success": 4, "get_started": 0, "get_sum": 4268, "max": 3758096384, "put": 4, "put_sum": 4268, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } } } 2023-10-06T03:03:07.593 INFO:tasks.cephfs.test_openfiletable:omap_total_updates_1:2 2023-10-06T03:03:07.609 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:03:07.819 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.817+0000 7fb2d560c700 1 Processor -- start 2023-10-06T03:03:07.820 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.817+0000 7fb2d560c700 1 -- start start 2023-10-06T03:03:07.822 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.817+0000 7fb2d560c700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb2d00b10f0 0x7fb2d00d0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:07.822 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.817+0000 7fb2d560c700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2d00afc50 con 0x7fb2d0159910 2023-10-06T03:03:07.822 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.817+0000 7fb2d560c700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2d00af920 con 0x7fb2d015a3f0 2023-10-06T03:03:07.822 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.817+0000 7fb2d560c700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d00b25e0 con 0x7fb2d00b10f0 2023-10-06T03:03:07.823 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.821+0000 7fb2cffff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fb2d0159910 0x7fb2d0159ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:38372/0 (socket says 172.21.15.57:38372) 2023-10-06T03:03:07.823 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.821+0000 7fb2cffff700 1 -- 172.21.15.57:0/1964220018 learned_addr learned my addr 172.21.15.57:0/1964220018 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:03:07.823 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.821+0000 7fb2d4e0b700 1 --2- 172.21.15.57:0/1964220018 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb2d00b10f0 0x7fb2d00d0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:07.824 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.821+0000 7fb2cf7fe700 1 -- 172.21.15.57:0/1964220018 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1366727053 0 0) 0x7fb2d00afc50 con 0x7fb2d0159910 2023-10-06T03:03:07.824 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.821+0000 7fb2cf7fe700 1 -- 172.21.15.57:0/1964220018 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2bc003570 con 0x7fb2d0159910 2023-10-06T03:03:07.824 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.821+0000 7fb2cf7fe700 1 -- 172.21.15.57:0/1964220018 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2654314052 0 0) 0x7fb2d00af920 con 0x7fb2d015a3f0 2023-10-06T03:03:07.824 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.821+0000 7fb2cf7fe700 1 -- 172.21.15.57:0/1964220018 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2d00afc50 con 0x7fb2d015a3f0 2023-10-06T03:03:07.824 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.821+0000 7fb2d4e0b700 1 -- 172.21.15.57:0/1964220018 >> v1:172.21.15.105:6789/0 conn(0x7fb2d015a3f0 legacy=0x7fb2d0160d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:07.825 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.821+0000 7fb2d4e0b700 1 -- 172.21.15.57:0/1964220018 >> v1:172.21.15.57:6789/0 conn(0x7fb2d0159910 legacy=0x7fb2d0159ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:07.825 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.821+0000 7fb2d4e0b700 1 -- 172.21.15.57:0/1964220018 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2d00aee30 con 0x7fb2d00b10f0 2023-10-06T03:03:07.825 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.821+0000 7fb2d4e0b700 1 --2- 172.21.15.57:0/1964220018 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb2d00b10f0 0x7fb2d00d0bf0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb2c8009e90 tx=0x7fb2c8009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2174220718fc10a3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:03:07.826 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.821+0000 7fb2cf7fe700 1 -- 172.21.15.57:0/1964220018 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2c800e070 con 0x7fb2d00b10f0 2023-10-06T03:03:07.826 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.821+0000 7fb2cf7fe700 1 -- 172.21.15.57:0/1964220018 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2c800bb80 con 0x7fb2d00b10f0 2023-10-06T03:03:07.826 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.821+0000 7fb2cf7fe700 1 -- 172.21.15.57:0/1964220018 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2c8012430 con 0x7fb2d00b10f0 2023-10-06T03:03:07.827 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.825+0000 7fb2d560c700 1 -- 172.21.15.57:0/1964220018 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb2d00b10f0 msgr2=0x7fb2d00d0bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:07.827 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.825+0000 7fb2d560c700 1 --2- 172.21.15.57:0/1964220018 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb2d00b10f0 0x7fb2d00d0bf0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb2c8009e90 tx=0x7fb2c8009780 comp rx=0 tx=0).stop 2023-10-06T03:03:07.827 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.825+0000 7fb2d560c700 1 -- 172.21.15.57:0/1964220018 shutdown_connections 2023-10-06T03:03:07.828 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.825+0000 7fb2d560c700 1 --2- 172.21.15.57:0/1964220018 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb2d00b10f0 0x7fb2d00d0bf0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:07.828 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.825+0000 7fb2d560c700 1 -- 172.21.15.57:0/1964220018 >> 172.21.15.57:0/1964220018 conn(0x7fb2d006ef40 msgr2=0x7fb2d00d0080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:03:07.828 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.825+0000 7fb2d560c700 1 -- 172.21.15.57:0/1964220018 shutdown_connections 2023-10-06T03:03:07.828 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.825+0000 7fb2d560c700 1 -- 172.21.15.57:0/1964220018 wait complete. 2023-10-06T03:03:07.831 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.829+0000 7fb2d560c700 1 Processor -- start 2023-10-06T03:03:07.831 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.829+0000 7fb2d560c700 1 -- start start 2023-10-06T03:03:07.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.829+0000 7fb2d560c700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb2d00b10f0 0x7fb2d0169470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:07.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.829+0000 7fb2d560c700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb2d0159910 0x7fb2d01563e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:07.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.829+0000 7fb2d560c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb2d015a3f0 0x7fb2d0151a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:07.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.829+0000 7fb2d560c700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d0099d50 con 0x7fb2d015a3f0 2023-10-06T03:03:07.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.829+0000 7fb2d560c700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d0169de0 con 0x7fb2d0159910 2023-10-06T03:03:07.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.829+0000 7fb2d560c700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d016a0c0 con 0x7fb2d00b10f0 2023-10-06T03:03:07.834 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.829+0000 7fb2d4e0b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb2d015a3f0 0x7fb2d0151a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:07.834 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.829+0000 7fb2d4e0b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb2d015a3f0 0x7fb2d0151a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:49252/0 (socket says 172.21.15.57:49252) 2023-10-06T03:03:07.834 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.829+0000 7fb2d4e0b700 1 -- 172.21.15.57:0/587522986 learned_addr learned my addr 172.21.15.57:0/587522986 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:03:07.834 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.829+0000 7fb2cffff700 1 --2- 172.21.15.57:0/587522986 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb2d00b10f0 0x7fb2d0169470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:07.834 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.829+0000 7fb2c7fff700 1 --2- 172.21.15.57:0/587522986 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb2d0159910 0x7fb2d01563e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:07.834 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.829+0000 7fb2d4e0b700 1 -- 172.21.15.57:0/587522986 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb2d00b10f0 msgr2=0x7fb2d0169470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:07.834 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.829+0000 7fb2d4e0b700 1 --2- 172.21.15.57:0/587522986 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb2d00b10f0 0x7fb2d0169470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:07.834 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.829+0000 7fb2d4e0b700 1 -- 172.21.15.57:0/587522986 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb2d0159910 msgr2=0x7fb2d01563e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:07.835 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.829+0000 7fb2d4e0b700 1 --2- 172.21.15.57:0/587522986 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb2d0159910 0x7fb2d01563e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:07.835 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.829+0000 7fb2d4e0b700 1 -- 172.21.15.57:0/587522986 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2c8009a20 con 0x7fb2d015a3f0 2023-10-06T03:03:07.835 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.829+0000 7fb2d4e0b700 1 --2- 172.21.15.57:0/587522986 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb2d015a3f0 0x7fb2d0151a90 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fb2d0088f90 tx=0x7fb2c8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:03:07.835 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.833+0000 7fb2ccff9700 1 -- 172.21.15.57:0/587522986 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2c801b420 con 0x7fb2d015a3f0 2023-10-06T03:03:07.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.833+0000 7fb2ccff9700 1 -- 172.21.15.57:0/587522986 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2c801b5a0 con 0x7fb2d015a3f0 2023-10-06T03:03:07.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.833+0000 7fb2ccff9700 1 -- 172.21.15.57:0/587522986 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2c801b960 con 0x7fb2d015a3f0 2023-10-06T03:03:07.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.833+0000 7fb2d560c700 1 -- 172.21.15.57:0/587522986 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2d0099ff0 con 0x7fb2d015a3f0 2023-10-06T03:03:07.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.833+0000 7fb2d560c700 1 -- 172.21.15.57:0/587522986 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2d01699b0 con 0x7fb2d015a3f0 2023-10-06T03:03:07.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.833+0000 7fb2d560c700 1 -- 172.21.15.57:0/587522986 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2d00645e0 con 0x7fb2d015a3f0 2023-10-06T03:03:07.838 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.833+0000 7fb2ccff9700 1 -- 172.21.15.57:0/587522986 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fb2c801c400 con 0x7fb2d015a3f0 2023-10-06T03:03:07.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.837+0000 7fb2ccff9700 1 --2- 172.21.15.57:0/587522986 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fb2b0060580 0x7fb2b0062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:07.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.837+0000 7fb2ccff9700 1 -- 172.21.15.57:0/587522986 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6144+0+0 (secure 0 0 0) 0x7fb2c807e5f0 con 0x7fb2d015a3f0 2023-10-06T03:03:07.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.837+0000 7fb2cffff700 1 --2- 172.21.15.57:0/587522986 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fb2b0060580 0x7fb2b0062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:07.841 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.837+0000 7fb2cffff700 1 --2- 172.21.15.57:0/587522986 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fb2b0060580 0x7fb2b0062a30 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fb2d009dcc0 tx=0x7fb2c0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:03:07.845 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:07.841+0000 7fb2ccff9700 1 -- 172.21.15.57:0/587522986 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fb2c804ea30 con 0x7fb2d015a3f0 2023-10-06T03:03:08.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:08.049+0000 7fb2d560c700 1 -- 172.21.15.57:0/587522986 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb2d015a1d0 con 0x7fb2d015a3f0 2023-10-06T03:03:08.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:08.049+0000 7fb2ccff9700 1 -- 172.21.15.57:0/587522986 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4598 (secure 0 0 0) 0x7fb2c8052050 con 0x7fb2d015a3f0 2023-10-06T03:03:08.053 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:03:08.053 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":38,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5222,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/879829980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":879829980},{"type":"v1","addr":"172.21.15.105:6833","nonce":879829980}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5225,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/3705921279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":3705921279},{"type":"v1","addr":"172.21.15.105:6835","nonce":3705921279}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/251759282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":251759282},{"type":"v1","addr":"172.21.15.57:6835","nonce":251759282}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:02:39.274111+0000","modified":"2023-10-06T03:02:56.856783+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":54,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5643},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5643":{"gid":5643,"name":"c","rank":0,"incarnation":34,"state":"up:active","state_seq":5,"addr":"172.21.15.57:6837/3347844181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6836","nonce":3347844181},{"type":"v1","addr":"172.21.15.57:6837","nonce":3347844181}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T03:03:08.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:08.053+0000 7fb2d560c700 1 -- 172.21.15.57:0/587522986 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fb2b0060580 msgr2=0x7fb2b0062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:08.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:08.053+0000 7fb2d560c700 1 --2- 172.21.15.57:0/587522986 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fb2b0060580 0x7fb2b0062a30 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fb2d009dcc0 tx=0x7fb2c0009040 comp rx=0 tx=0).stop 2023-10-06T03:03:08.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:08.053+0000 7fb2d560c700 1 -- 172.21.15.57:0/587522986 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb2d015a3f0 msgr2=0x7fb2d0151a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:08.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:08.053+0000 7fb2d560c700 1 --2- 172.21.15.57:0/587522986 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb2d015a3f0 0x7fb2d0151a90 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fb2d0088f90 tx=0x7fb2c8019000 comp rx=0 tx=0).stop 2023-10-06T03:03:08.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:08.053+0000 7fb2d560c700 1 -- 172.21.15.57:0/587522986 shutdown_connections 2023-10-06T03:03:08.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:08.053+0000 7fb2d560c700 1 --2- 172.21.15.57:0/587522986 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb2d015a3f0 0x7fb2d0151a90 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:08.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:08.053+0000 7fb2d560c700 1 --2- 172.21.15.57:0/587522986 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb2d0159910 0x7fb2d01563e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:08.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:08.053+0000 7fb2d560c700 1 --2- 172.21.15.57:0/587522986 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fb2b0060580 0x7fb2b0062a30 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:08.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:08.053+0000 7fb2d560c700 1 --2- 172.21.15.57:0/587522986 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb2d00b10f0 0x7fb2d0169470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:08.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:08.053+0000 7fb2d560c700 1 -- 172.21.15.57:0/587522986 >> 172.21.15.57:0/587522986 conn(0x7fb2d006ef40 msgr2=0x7fb2d0157bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:03:08.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:08.053+0000 7fb2d560c700 1 -- 172.21.15.57:0/587522986 shutdown_connections 2023-10-06T03:03:08.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:08.053+0000 7fb2d560c700 1 -- 172.21.15.57:0/587522986 wait complete. 2023-10-06T03:03:08.059 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 38 2023-10-06T03:03:08.077 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json perf dump 2023-10-06T03:03:08.245 INFO:teuthology.orchestra.run.smithi057.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":55,"msgr_send_messages":37,"msgr_recv_bytes":109059,"msgr_send_bytes":46911,"msgr_created_connections":10,"msgr_active_connections":3,"msgr_running_total_time":0.023648513,"msgr_running_send_time":0.005909247,"msgr_running_recv_time":0.014777355,"msgr_running_fast_dispatch_time":0.001399383,"msgr_send_messages_queue_lat":{"avgcount":37,"sum":0.007237154,"avgtime":0.000195598},"msgr_handle_ack_lat":{"avgcount":11,"sum":0.000009953,"avgtime":0.000000904}},"AsyncMessenger::Worker-1":{"msgr_recv_messages":21,"msgr_send_messages":27,"msgr_recv_bytes":9933,"msgr_send_bytes":100365,"msgr_created_connections":6,"msgr_active_connections":4,"msgr_running_total_time":0.008855365,"msgr_running_send_time":0.002477176,"msgr_running_recv_time":0.005214588,"msgr_running_fast_dispatch_time":0.000643523,"msgr_send_messages_queue_lat":{"avgcount":25,"sum":0.005612370,"avgtime":0.000224494},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"AsyncMessenger::Worker-2":{"msgr_recv_messages":16,"msgr_send_messages":18,"msgr_recv_bytes":10773,"msgr_send_bytes":6198,"msgr_created_connections":6,"msgr_active_connections":4,"msgr_running_total_time":0.007012821,"msgr_running_send_time":0.000973107,"msgr_running_recv_time":0.004861993,"msgr_running_fast_dispatch_time":0.000767528,"msgr_send_messages_queue_lat":{"avgcount":16,"sum":0.008215046,"avgtime":0.000513440},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":0,"complete_latency":{"avgcount":43,"sum":0.004722413,"avgtime":0.000109823}},"finisher-PurgeQueue":{"queue_len":0,"complete_latency":{"avgcount":4,"sum":0.000177735,"avgtime":0.000044433}},"mds":{"request":4,"reply":2,"reply_latency":{"avgcount":2,"sum":0.005332595,"avgtime":0.002666297},"slow_reply":0,"forward":0,"dir_fetch":12,"dir_commit":0,"dir_split":0,"dir_merge":0,"inodes":11,"inodes_top":0,"inodes_bottom":11,"inodes_pin_tail":0,"inodes_pinned":11,"inodes_expired":0,"inodes_with_caps":2,"caps":2,"subtrees":2,"traverse":4,"traverse_hit":4,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":161,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":1,"root_rbytes":7,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":0,"ceph_cap_op_grant":0,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":1,"handle_client_caps_dirty":1,"handle_client_cap_release":0,"process_request_cap_release":1},"mds_cache":{"num_strays":0,"num_strays_delayed":0,"num_strays_enqueuing":0,"strays_created":0,"strays_enqueued":0,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0},"mds_log":{"evadd":4,"evex":0,"evtrm":0,"ev":6,"evexg":0,"evexd":0,"segadd":0,"segex":0,"segtrm":0,"seg":1,"segexg":0,"segexd":0,"expos":4194304,"wrpos":4199722,"rdpos":4195196,"jlat":{"avgcount":4,"sum":0.015392207,"avgtime":0.003848051},"replayed":2},"mds_mem":{"ino":14,"ino+":14,"ino-":0,"dir":12,"dir+":12,"dir-":0,"dn":11,"dn+":11,"dn-":0,"cap":2,"cap+":2,"cap-":0,"rss":41052,"heap":223456},"mds_server":{"dispatch_client_request":3,"dispatch_server_request":0,"handle_client_request":4,"handle_client_session":1,"handle_peer_request":0,"req_create_latency":{"avgcount":1,"sum":0.005055413,"avgtime":0.005055413},"req_getattr_latency":{"avgcount":1,"sum":0.000277182,"avgtime":0.000277182},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_readdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"cap_revoke_eviction":0,"cap_acquisition_throttle":0,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":1,"session_add":1,"session_remove":0,"sessions_open":1,"sessions_stale":0,"total_load":1,"average_load":1,"avg_session_uptime":923,"mdthresh_evicted":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_Buffer_bytes":0,"bluestore_Buffer_items":0,"bluestore_Extent_bytes":0,"bluestore_Extent_items":0,"bluestore_Blob_bytes":0,"bluestore_Blob_items":0,"bluestore_SharedBlob_bytes":0,"bluestore_SharedBlob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":225511,"buffer_anon_items":66,"buffer_meta_bytes":0,"buffer_meta_items":0,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":6336,"osdmap_items":93,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":53911,"mds_co_items":234,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":42,"op_send_bytes":5242,"op_resend":0,"op_reply":42,"oplen_avg":{"avgcount":42,"sum":75},"op":42,"op_r":26,"op_w":16,"op_rmw":0,"op_pg":0,"osdop_stat":2,"osdop_create":0,"osdop_read":8,"osdop_write":4,"osdop_writefull":1,"osdop_writesame":0,"osdop_append":0,"osdop_zero":1,"osdop_truncate":0,"osdop_delete":5,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":14,"osdop_setxattr":0,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":0,"map_full":0,"map_inc":0,"osd_sessions":8,"osd_session_open":8,"osd_session_close":0,"osd_laggy":0,"omap_wr":9,"omap_rd":28,"omap_del":3},"oft":{"omap_total_objs":2,"omap_total_kv_pairs":2,"omap_total_updates":2,"omap_total_removes":0},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":0,"pq_executing":0,"pq_executing_high_water":0,"pq_executed":0,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":0,"max":104857600,"get_started":0,"get":88,"get_sum":119393,"get_or_fail_fail":0,"get_or_fail_success":88,"take":0,"take_sum":0,"put":88,"put_sum":119393,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":42,"take_sum":6168,"put":42,"put_sum":6168,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":42,"take_sum":42,"put":42,"put_sum":42,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":0,"take_sum":0,"put":0,"put_sum":0,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x55d33e7a4000":{"val":0,"max":3758096384,"get_started":0,"get":4,"get_sum":4268,"get_or_fail_fail":0,"get_or_fail_success":4,"take":0,"take_sum":0,"put":4,"put_sum":4268,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}}} 2023-10-06T03:03:08.247 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 3, "msgr_created_connections": 10, "msgr_handle_ack_lat": { "avgcount": 11, "avgtime": 9.04e-07, "sum": 9.953e-06 }, "msgr_recv_bytes": 109059, "msgr_recv_messages": 55, "msgr_running_fast_dispatch_time": 0.001399383, "msgr_running_recv_time": 0.014777355, "msgr_running_send_time": 0.005909247, "msgr_running_total_time": 0.023648513, "msgr_send_bytes": 46911, "msgr_send_messages": 37, "msgr_send_messages_queue_lat": { "avgcount": 37, "avgtime": 0.000195598, "sum": 0.007237154 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 4, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 9933, "msgr_recv_messages": 21, "msgr_running_fast_dispatch_time": 0.000643523, "msgr_running_recv_time": 0.005214588, "msgr_running_send_time": 0.002477176, "msgr_running_total_time": 0.008855365, "msgr_send_bytes": 100365, "msgr_send_messages": 27, "msgr_send_messages_queue_lat": { "avgcount": 25, "avgtime": 0.000224494, "sum": 0.00561237 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 4, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 10773, "msgr_recv_messages": 16, "msgr_running_fast_dispatch_time": 0.000767528, "msgr_running_recv_time": 0.004861993, "msgr_running_send_time": 0.000973107, "msgr_running_total_time": 0.007012821, "msgr_send_bytes": 6198, "msgr_send_messages": 18, "msgr_send_messages_queue_lat": { "avgcount": 16, "avgtime": 0.00051344, "sum": 0.008215046 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 43, "avgtime": 0.000109823, "sum": 0.004722413 }, "queue_len": 0 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 4, "avgtime": 4.4433e-05, "sum": 0.000177735 }, "queue_len": 0 }, "mds": { "caps": 2, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 0, "ceph_cap_op_revoke": 0, "ceph_cap_op_trunc": 0, "dir_commit": 0, "dir_fetch": 12, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 0, "handle_client_caps": 1, "handle_client_caps_dirty": 1, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 11, "inodes_bottom": 11, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 11, "inodes_top": 0, "inodes_with_caps": 2, "load_cent": 161, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 1, "q": 0, "reply": 2, "reply_latency": { "avgcount": 2, "avgtime": 0.002666297, "sum": 0.005332595 }, "request": 4, "root_rbytes": 7, "root_rfiles": 1, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 4, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 4, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 0, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 0, "strays_enqueued": 0, "strays_migrated": 0, "strays_reintegrated": 0 }, "mds_log": { "ev": 6, "evadd": 4, "evex": 0, "evexd": 0, "evexg": 0, "evtrm": 0, "expos": 4194304, "jlat": { "avgcount": 4, "avgtime": 0.003848051, "sum": 0.015392207 }, "rdpos": 4195196, "replayed": 2, "seg": 1, "segadd": 0, "segex": 0, "segexd": 0, "segexg": 0, "segtrm": 0, "wrpos": 4199722 }, "mds_mem": { "cap": 2, "cap+": 2, "cap-": 0, "dir": 12, "dir+": 12, "dir-": 0, "dn": 11, "dn+": 11, "dn-": 0, "heap": 223456, "ino": 14, "ino+": 14, "ino-": 0, "rss": 41052 }, "mds_server": { "cap_acquisition_throttle": 0, "cap_revoke_eviction": 0, "dispatch_client_request": 3, "dispatch_server_request": 0, "handle_client_request": 4, "handle_client_session": 1, "handle_peer_request": 0, "req_create_latency": { "avgcount": 1, "avgtime": 0.005055413, "sum": 0.005055413 }, "req_getattr_latency": { "avgcount": 1, "avgtime": 0.000277182, "sum": 0.000277182 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_readdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "mds_sessions": { "average_load": 1, "avg_session_uptime": 923, "mdthresh_evicted": 0, "session_add": 1, "session_count": 1, "session_remove": 0, "sessions_open": 1, "sessions_stale": 0, "total_load": 1 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_Blob_bytes": 0, "bluestore_Blob_items": 0, "bluestore_Buffer_bytes": 0, "bluestore_Buffer_items": 0, "bluestore_Extent_bytes": 0, "bluestore_Extent_items": 0, "bluestore_SharedBlob_bytes": 0, "bluestore_SharedBlob_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 225511, "buffer_anon_items": 66, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "mds_co_bytes": 53911, "mds_co_items": 234, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 6336, "osdmap_items": 93, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "omap_del": 3, "omap_rd": 28, "omap_wr": 9, "op": 42, "op_active": 0, "op_laggy": 0, "op_pg": 0, "op_r": 26, "op_reply": 42, "op_resend": 0, "op_rmw": 0, "op_send": 42, "op_send_bytes": 5242, "op_w": 16, "oplen_avg": { "avgcount": 42, "sum": 75 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 8, "osd_sessions": 8, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 0, "osdop_delete": 5, "osdop_getxattr": 14, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 8, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 0, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 2, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 4, "osdop_writefull": 1, "osdop_writesame": 0, "osdop_zero": 1, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 2, "omap_total_objs": 2, "omap_total_removes": 0, "omap_total_updates": 2 }, "purge_queue": { "pq_executed": 0, "pq_executing": 0, "pq_executing_high_water": 0, "pq_executing_ops": 0, "pq_executing_ops_high_water": 0, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 88, "get_or_fail_fail": 0, "get_or_fail_success": 88, "get_started": 0, "get_sum": 119393, "max": 104857600, "put": 88, "put_sum": 119393, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 42, "put_sum": 6168, "take": 42, "take_sum": 6168, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 42, "put_sum": 42, "take": 42, "take_sum": 42, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 3758096384, "put": 0, "put_sum": 0, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x55d33e7a4000": { "get": 4, "get_or_fail_fail": 0, "get_or_fail_success": 4, "get_started": 0, "get_sum": 4268, "max": 3758096384, "put": 4, "put_sum": 4268, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } } } 2023-10-06T03:03:08.248 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120 retry_count=0)... 2023-10-06T03:03:13.251 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:03:13.417 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:13.413+0000 7f08dd878700 1 Processor -- start 2023-10-06T03:03:13.417 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:13.413+0000 7f08dd878700 1 -- start start 2023-10-06T03:03:13.419 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:13.417+0000 7f08dd878700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f08d815d500 0x7f08d80c0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:13.419 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:13.417+0000 7f08dd878700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f08d80c0ac0 0x7f08d806a450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:13.419 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:13.417+0000 7f08dd878700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f08d806a990 0x7f08d806e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:13.419 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:13.417+0000 7f08dd878700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08d80c0f10 con 0x7f08d815d500 2023-10-06T03:03:13.420 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:13.417+0000 7f08dd878700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08d806adf0 con 0x7f08d80c0ac0 2023-10-06T03:03:13.420 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:13.417+0000 7f08dd878700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08d8162020 con 0x7f08d806a990 2023-10-06T03:03:13.420 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:13.417+0000 7f08d6ffd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f08d815d500 0x7f08d80c0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:13.420 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:13.417+0000 7f08d6ffd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f08d815d500 0x7f08d80c0580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:49258/0 (socket says 172.21.15.57:49258) 2023-10-06T03:03:13.420 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:13.417+0000 7f08d6ffd700 1 -- 172.21.15.57:0/4124432546 learned_addr learned my addr 172.21.15.57:0/4124432546 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:03:13.421 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:13.417+0000 7f08d6ffd700 1 -- 172.21.15.57:0/4124432546 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f08d806a990 msgr2=0x7f08d806e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:03:13.421 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:13.417+0000 7f08d6ffd700 1 --2- 172.21.15.57:0/4124432546 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f08d806a990 0x7f08d806e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:13.422 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:13.417+0000 7f08d6ffd700 1 -- 172.21.15.57:0/4124432546 >> v2:172.21.15.105:3300/0 conn(0x7f08d80c0ac0 msgr2=0x7f08d806a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:03:13.422 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:13.417+0000 7f08ce7fc700 1 --2- 172.21.15.57:0/4124432546 >> v2:172.21.15.105:3300/0 conn(0x7f08d80c0ac0 0x7f08d806a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:13.422 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:13.417+0000 7f08d6ffd700 1 --2- 172.21.15.57:0/4124432546 >> v2:172.21.15.105:3300/0 conn(0x7f08d80c0ac0 0x7f08d806a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:13.422 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:13.417+0000 7f08d6ffd700 1 -- 172.21.15.57:0/4124432546 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08d8161170 con 0x7f08d815d500 2023-10-06T03:03:13.422 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:13.417+0000 7f08ce7fc700 1 --2- 172.21.15.57:0/4124432546 >> v2:172.21.15.105:3300/0 conn(0x7f08d80c0ac0 0x7f08d806a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:03:13.422 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:13.417+0000 7f08d6ffd700 1 --2- 172.21.15.57:0/4124432546 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f08d815d500 0x7f08d80c0580 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f08d806f460 tx=0x7f08c8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8765cd763bcedca server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:03:13.422 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:13.417+0000 7f08d67fc700 1 -- 172.21.15.57:0/4124432546 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08c800e070 con 0x7f08d815d500 2023-10-06T03:03:13.422 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:13.417+0000 7f08d67fc700 1 -- 172.21.15.57:0/4124432546 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08c800ba50 con 0x7f08d815d500 2023-10-06T03:03:13.423 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:13.417+0000 7f08d67fc700 1 -- 172.21.15.57:0/4124432546 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08c80092e0 con 0x7f08d815d500 2023-10-06T03:03:13.423 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:13.417+0000 7f08dd878700 1 -- 172.21.15.57:0/4124432546 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f08d815d500 msgr2=0x7f08d80c0580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:13.424 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:13.417+0000 7f08dd878700 1 --2- 172.21.15.57:0/4124432546 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f08d815d500 0x7f08d80c0580 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f08d806f460 tx=0x7f08c8009840 comp rx=0 tx=0).stop 2023-10-06T03:03:13.424 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:13.417+0000 7f08dd878700 1 -- 172.21.15.57:0/4124432546 shutdown_connections 2023-10-06T03:03:13.424 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:13.417+0000 7f08dd878700 1 --2- 172.21.15.57:0/4124432546 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f08d806a990 0x7f08d806e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:13.424 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:13.417+0000 7f08dd878700 1 --2- 172.21.15.57:0/4124432546 >> v2:172.21.15.105:3300/0 conn(0x7f08d80c0ac0 0x7f08d806a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:13.424 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:13.417+0000 7f08dd878700 1 --2- 172.21.15.57:0/4124432546 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f08d815d500 0x7f08d80c0580 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:13.424 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:13.417+0000 7f08dd878700 1 -- 172.21.15.57:0/4124432546 >> 172.21.15.57:0/4124432546 conn(0x7f08d80cd610 msgr2=0x7f08d80cda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:03:13.424 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:13.417+0000 7f08dd878700 1 -- 172.21.15.57:0/4124432546 shutdown_connections 2023-10-06T03:03:13.424 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:13.421+0000 7f08dd878700 1 -- 172.21.15.57:0/4124432546 wait complete. 2023-10-06T03:03:13.425 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:13.421+0000 7f08dd878700 1 Processor -- start 2023-10-06T03:03:13.425 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:13.421+0000 7f08dd878700 1 -- start start 2023-10-06T03:03:13.428 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:13.425+0000 7f08dd878700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f08d806a990 0x7f08d815d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:13.428 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:13.425+0000 7f08dd878700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f08d80c0ac0 0x7f08d815bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:13.428 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:13.425+0000 7f08dd878700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f08d815d500 0x7f08d80c1a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:13.428 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:13.425+0000 7f08dd878700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08d815de10 con 0x7f08d80c0ac0 2023-10-06T03:03:13.428 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:13.425+0000 7f08dd878700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08d815c230 con 0x7f08d815d500 2023-10-06T03:03:13.428 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:13.425+0000 7f08dd878700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08d80c6540 con 0x7f08d806a990 2023-10-06T03:03:13.429 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:13.425+0000 7f08ce7fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f08d80c0ac0 0x7f08d815bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:13.429 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:13.425+0000 7f08ce7fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f08d80c0ac0 0x7f08d815bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:49264/0 (socket says 172.21.15.57:49264) 2023-10-06T03:03:13.429 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:13.425+0000 7f08ce7fc700 1 -- 172.21.15.57:0/3655717358 learned_addr learned my addr 172.21.15.57:0/3655717358 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:03:13.429 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:13.425+0000 7f08d6ffd700 1 --2- 172.21.15.57:0/3655717358 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f08d806a990 0x7f08d815d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:13.429 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:13.425+0000 7f08d7fff700 1 --2- 172.21.15.57:0/3655717358 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f08d815d500 0x7f08d80c1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:13.430 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:13.425+0000 7f08ce7fc700 1 -- 172.21.15.57:0/3655717358 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f08d806a990 msgr2=0x7f08d815d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:13.430 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:13.425+0000 7f08ce7fc700 1 --2- 172.21.15.57:0/3655717358 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f08d806a990 0x7f08d815d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:13.430 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:13.425+0000 7f08ce7fc700 1 -- 172.21.15.57:0/3655717358 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f08d815d500 msgr2=0x7f08d80c1a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:13.431 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:13.425+0000 7f08ce7fc700 1 --2- 172.21.15.57:0/3655717358 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f08d815d500 0x7f08d80c1a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:13.431 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:13.425+0000 7f08ce7fc700 1 -- 172.21.15.57:0/3655717358 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08c8009ae0 con 0x7f08d80c0ac0 2023-10-06T03:03:13.431 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:13.425+0000 7f08d7fff700 1 --2- 172.21.15.57:0/3655717358 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f08d815d500 0x7f08d80c1a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:03:13.431 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:13.425+0000 7f08ce7fc700 1 --2- 172.21.15.57:0/3655717358 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f08d80c0ac0 0x7f08d815bcf0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f08c000c830 tx=0x7f08c0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:03:13.431 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:13.425+0000 7f08cf7fe700 1 -- 172.21.15.57:0/3655717358 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08c0011600 con 0x7f08d80c0ac0 2023-10-06T03:03:13.431 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:13.425+0000 7f08cf7fe700 1 -- 172.21.15.57:0/3655717358 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08c0011760 con 0x7f08d80c0ac0 2023-10-06T03:03:13.431 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:13.425+0000 7f08cf7fe700 1 -- 172.21.15.57:0/3655717358 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08c0011b20 con 0x7f08d80c0ac0 2023-10-06T03:03:13.431 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:13.425+0000 7f08dd878700 1 -- 172.21.15.57:0/3655717358 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08d80c24e0 con 0x7f08d80c0ac0 2023-10-06T03:03:13.431 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:13.425+0000 7f08dd878700 1 -- 172.21.15.57:0/3655717358 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08d80c61d0 con 0x7f08d80c0ac0 2023-10-06T03:03:13.432 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:13.429+0000 7f08dd878700 1 -- 172.21.15.57:0/3655717358 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08d80c66f0 con 0x7f08d80c0ac0 2023-10-06T03:03:13.433 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:13.429+0000 7f08cf7fe700 1 -- 172.21.15.57:0/3655717358 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f08c00193b0 con 0x7f08d80c0ac0 2023-10-06T03:03:13.434 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:13.429+0000 7f08cf7fe700 1 --2- 172.21.15.57:0/3655717358 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f08b8060580 0x7f08b8062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:13.434 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:13.429+0000 7f08cf7fe700 1 -- 172.21.15.57:0/3655717358 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6144+0+0 (secure 0 0 0) 0x7f08c007c9c0 con 0x7f08d80c0ac0 2023-10-06T03:03:13.435 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:13.433+0000 7f08d6ffd700 1 --2- 172.21.15.57:0/3655717358 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f08b8060580 0x7f08b8062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:13.436 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:13.433+0000 7f08d6ffd700 1 --2- 172.21.15.57:0/3655717358 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f08b8060580 0x7f08b8062a30 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f08c8009880 tx=0x7f08c8018000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:03:13.442 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:13.437+0000 7f08cf7fe700 1 -- 172.21.15.57:0/3655717358 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f08c004cd80 con 0x7f08d80c0ac0 2023-10-06T03:03:13.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:13.649+0000 7f08dd878700 1 -- 172.21.15.57:0/3655717358 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f08d8161410 con 0x7f08d80c0ac0 2023-10-06T03:03:13.653 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:13.649+0000 7f08cf7fe700 1 -- 172.21.15.57:0/3655717358 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4598 (secure 0 0 0) 0x7f08c0015090 con 0x7f08d80c0ac0 2023-10-06T03:03:13.653 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:03:13.653 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":38,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5222,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/879829980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":879829980},{"type":"v1","addr":"172.21.15.105:6833","nonce":879829980}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5225,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/3705921279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":3705921279},{"type":"v1","addr":"172.21.15.105:6835","nonce":3705921279}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/251759282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":251759282},{"type":"v1","addr":"172.21.15.57:6835","nonce":251759282}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:02:39.274111+0000","modified":"2023-10-06T03:02:56.856783+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":54,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5643},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5643":{"gid":5643,"name":"c","rank":0,"incarnation":34,"state":"up:active","state_seq":5,"addr":"172.21.15.57:6837/3347844181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6836","nonce":3347844181},{"type":"v1","addr":"172.21.15.57:6837","nonce":3347844181}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T03:03:13.656 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:13.653+0000 7f08dd878700 1 -- 172.21.15.57:0/3655717358 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f08b8060580 msgr2=0x7f08b8062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:13.656 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:13.653+0000 7f08dd878700 1 --2- 172.21.15.57:0/3655717358 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f08b8060580 0x7f08b8062a30 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f08c8009880 tx=0x7f08c8018000 comp rx=0 tx=0).stop 2023-10-06T03:03:13.656 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:13.653+0000 7f08dd878700 1 -- 172.21.15.57:0/3655717358 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f08d80c0ac0 msgr2=0x7f08d815bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:13.656 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:13.653+0000 7f08dd878700 1 --2- 172.21.15.57:0/3655717358 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f08d80c0ac0 0x7f08d815bcf0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f08c000c830 tx=0x7f08c0008040 comp rx=0 tx=0).stop 2023-10-06T03:03:13.656 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:13.653+0000 7f08dd878700 1 -- 172.21.15.57:0/3655717358 shutdown_connections 2023-10-06T03:03:13.656 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:13.653+0000 7f08dd878700 1 --2- 172.21.15.57:0/3655717358 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f08d815d500 0x7f08d80c1a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:13.657 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:13.653+0000 7f08dd878700 1 --2- 172.21.15.57:0/3655717358 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f08d80c0ac0 0x7f08d815bcf0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:13.657 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:13.653+0000 7f08dd878700 1 --2- 172.21.15.57:0/3655717358 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f08b8060580 0x7f08b8062a30 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:13.657 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:13.653+0000 7f08dd878700 1 --2- 172.21.15.57:0/3655717358 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f08d806a990 0x7f08d815d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:13.657 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:13.653+0000 7f08dd878700 1 -- 172.21.15.57:0/3655717358 >> 172.21.15.57:0/3655717358 conn(0x7f08d80cd610 msgr2=0x7f08d815ca50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:03:13.657 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:13.653+0000 7f08dd878700 1 -- 172.21.15.57:0/3655717358 shutdown_connections 2023-10-06T03:03:13.657 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:13.653+0000 7f08dd878700 1 -- 172.21.15.57:0/3655717358 wait complete. 2023-10-06T03:03:13.659 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 38 2023-10-06T03:03:13.677 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json perf dump 2023-10-06T03:03:13.857 INFO:teuthology.orchestra.run.smithi057.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":62,"msgr_send_messages":38,"msgr_recv_bytes":111743,"msgr_send_bytes":47503,"msgr_created_connections":10,"msgr_active_connections":3,"msgr_running_total_time":0.025623661,"msgr_running_send_time":0.006987634,"msgr_running_recv_time":0.015160265,"msgr_running_fast_dispatch_time":0.001844984,"msgr_send_messages_queue_lat":{"avgcount":38,"sum":0.007320454,"avgtime":0.000192643},"msgr_handle_ack_lat":{"avgcount":11,"sum":0.000009953,"avgtime":0.000000904}},"AsyncMessenger::Worker-1":{"msgr_recv_messages":21,"msgr_send_messages":28,"msgr_recv_bytes":9933,"msgr_send_bytes":102093,"msgr_created_connections":6,"msgr_active_connections":4,"msgr_running_total_time":0.009027624,"msgr_running_send_time":0.002625690,"msgr_running_recv_time":0.005214588,"msgr_running_fast_dispatch_time":0.000643523,"msgr_send_messages_queue_lat":{"avgcount":26,"sum":0.005721351,"avgtime":0.000220051},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"AsyncMessenger::Worker-2":{"msgr_recv_messages":16,"msgr_send_messages":18,"msgr_recv_bytes":10773,"msgr_send_bytes":6198,"msgr_created_connections":6,"msgr_active_connections":4,"msgr_running_total_time":0.007012821,"msgr_running_send_time":0.000973107,"msgr_running_recv_time":0.004861993,"msgr_running_fast_dispatch_time":0.000767528,"msgr_send_messages_queue_lat":{"avgcount":16,"sum":0.008215046,"avgtime":0.000513440},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":0,"complete_latency":{"avgcount":43,"sum":0.004722413,"avgtime":0.000109823}},"finisher-PurgeQueue":{"queue_len":0,"complete_latency":{"avgcount":4,"sum":0.000177735,"avgtime":0.000044433}},"mds":{"request":4,"reply":2,"reply_latency":{"avgcount":2,"sum":0.005332595,"avgtime":0.002666297},"slow_reply":0,"forward":0,"dir_fetch":12,"dir_commit":0,"dir_split":0,"dir_merge":0,"inodes":11,"inodes_top":0,"inodes_bottom":11,"inodes_pin_tail":0,"inodes_pinned":11,"inodes_expired":0,"inodes_with_caps":2,"caps":2,"subtrees":2,"traverse":4,"traverse_hit":4,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":139,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":1,"root_rbytes":7,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":0,"ceph_cap_op_grant":0,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":1,"handle_client_caps_dirty":1,"handle_client_cap_release":0,"process_request_cap_release":1},"mds_cache":{"num_strays":0,"num_strays_delayed":0,"num_strays_enqueuing":0,"strays_created":0,"strays_enqueued":0,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0},"mds_log":{"evadd":4,"evex":0,"evtrm":0,"ev":6,"evexg":0,"evexd":0,"segadd":0,"segex":0,"segtrm":0,"seg":1,"segexg":0,"segexd":0,"expos":4194304,"wrpos":4199722,"rdpos":4195196,"jlat":{"avgcount":4,"sum":0.015392207,"avgtime":0.003848051},"replayed":2},"mds_mem":{"ino":14,"ino+":14,"ino-":0,"dir":12,"dir+":12,"dir-":0,"dn":11,"dn+":11,"dn-":0,"cap":2,"cap+":2,"cap-":0,"rss":41052,"heap":223456},"mds_server":{"dispatch_client_request":3,"dispatch_server_request":0,"handle_client_request":4,"handle_client_session":1,"handle_peer_request":0,"req_create_latency":{"avgcount":1,"sum":0.005055413,"avgtime":0.005055413},"req_getattr_latency":{"avgcount":1,"sum":0.000277182,"avgtime":0.000277182},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_readdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"cap_revoke_eviction":0,"cap_acquisition_throttle":0,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":1,"session_add":1,"session_remove":0,"sessions_open":1,"sessions_stale":0,"total_load":1,"average_load":1,"avg_session_uptime":928,"mdthresh_evicted":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_Buffer_bytes":0,"bluestore_Buffer_items":0,"bluestore_Extent_bytes":0,"bluestore_Extent_items":0,"bluestore_Blob_bytes":0,"bluestore_Blob_items":0,"bluestore_SharedBlob_bytes":0,"bluestore_SharedBlob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":225511,"buffer_anon_items":66,"buffer_meta_bytes":0,"buffer_meta_items":0,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":6336,"osdmap_items":93,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":53911,"mds_co_items":234,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":42,"op_send_bytes":5242,"op_resend":0,"op_reply":42,"oplen_avg":{"avgcount":42,"sum":75},"op":42,"op_r":26,"op_w":16,"op_rmw":0,"op_pg":0,"osdop_stat":2,"osdop_create":0,"osdop_read":8,"osdop_write":4,"osdop_writefull":1,"osdop_writesame":0,"osdop_append":0,"osdop_zero":1,"osdop_truncate":0,"osdop_delete":5,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":14,"osdop_setxattr":0,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":0,"map_full":0,"map_inc":0,"osd_sessions":8,"osd_session_open":8,"osd_session_close":0,"osd_laggy":0,"omap_wr":9,"omap_rd":28,"omap_del":3},"oft":{"omap_total_objs":2,"omap_total_kv_pairs":2,"omap_total_updates":2,"omap_total_removes":0},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":0,"pq_executing":0,"pq_executing_high_water":0,"pq_executed":0,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":0,"max":104857600,"get_started":0,"get":95,"get_sum":121491,"get_or_fail_fail":0,"get_or_fail_success":95,"take":0,"take_sum":0,"put":95,"put_sum":121491,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":42,"take_sum":6168,"put":42,"put_sum":6168,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":42,"take_sum":42,"put":42,"put_sum":42,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":0,"take_sum":0,"put":0,"put_sum":0,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x55d33e7a4000":{"val":0,"max":3758096384,"get_started":0,"get":4,"get_sum":4268,"get_or_fail_fail":0,"get_or_fail_success":4,"take":0,"take_sum":0,"put":4,"put_sum":4268,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}}} 2023-10-06T03:03:13.858 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 3, "msgr_created_connections": 10, "msgr_handle_ack_lat": { "avgcount": 11, "avgtime": 9.04e-07, "sum": 9.953e-06 }, "msgr_recv_bytes": 111743, "msgr_recv_messages": 62, "msgr_running_fast_dispatch_time": 0.001844984, "msgr_running_recv_time": 0.015160265, "msgr_running_send_time": 0.006987634, "msgr_running_total_time": 0.025623661, "msgr_send_bytes": 47503, "msgr_send_messages": 38, "msgr_send_messages_queue_lat": { "avgcount": 38, "avgtime": 0.000192643, "sum": 0.007320454 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 4, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 9933, "msgr_recv_messages": 21, "msgr_running_fast_dispatch_time": 0.000643523, "msgr_running_recv_time": 0.005214588, "msgr_running_send_time": 0.00262569, "msgr_running_total_time": 0.009027624, "msgr_send_bytes": 102093, "msgr_send_messages": 28, "msgr_send_messages_queue_lat": { "avgcount": 26, "avgtime": 0.000220051, "sum": 0.005721351 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 4, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 10773, "msgr_recv_messages": 16, "msgr_running_fast_dispatch_time": 0.000767528, "msgr_running_recv_time": 0.004861993, "msgr_running_send_time": 0.000973107, "msgr_running_total_time": 0.007012821, "msgr_send_bytes": 6198, "msgr_send_messages": 18, "msgr_send_messages_queue_lat": { "avgcount": 16, "avgtime": 0.00051344, "sum": 0.008215046 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 43, "avgtime": 0.000109823, "sum": 0.004722413 }, "queue_len": 0 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 4, "avgtime": 4.4433e-05, "sum": 0.000177735 }, "queue_len": 0 }, "mds": { "caps": 2, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 0, "ceph_cap_op_revoke": 0, "ceph_cap_op_trunc": 0, "dir_commit": 0, "dir_fetch": 12, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 0, "handle_client_caps": 1, "handle_client_caps_dirty": 1, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 11, "inodes_bottom": 11, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 11, "inodes_top": 0, "inodes_with_caps": 2, "load_cent": 139, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 1, "q": 0, "reply": 2, "reply_latency": { "avgcount": 2, "avgtime": 0.002666297, "sum": 0.005332595 }, "request": 4, "root_rbytes": 7, "root_rfiles": 1, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 4, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 4, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 0, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 0, "strays_enqueued": 0, "strays_migrated": 0, "strays_reintegrated": 0 }, "mds_log": { "ev": 6, "evadd": 4, "evex": 0, "evexd": 0, "evexg": 0, "evtrm": 0, "expos": 4194304, "jlat": { "avgcount": 4, "avgtime": 0.003848051, "sum": 0.015392207 }, "rdpos": 4195196, "replayed": 2, "seg": 1, "segadd": 0, "segex": 0, "segexd": 0, "segexg": 0, "segtrm": 0, "wrpos": 4199722 }, "mds_mem": { "cap": 2, "cap+": 2, "cap-": 0, "dir": 12, "dir+": 12, "dir-": 0, "dn": 11, "dn+": 11, "dn-": 0, "heap": 223456, "ino": 14, "ino+": 14, "ino-": 0, "rss": 41052 }, "mds_server": { "cap_acquisition_throttle": 0, "cap_revoke_eviction": 0, "dispatch_client_request": 3, "dispatch_server_request": 0, "handle_client_request": 4, "handle_client_session": 1, "handle_peer_request": 0, "req_create_latency": { "avgcount": 1, "avgtime": 0.005055413, "sum": 0.005055413 }, "req_getattr_latency": { "avgcount": 1, "avgtime": 0.000277182, "sum": 0.000277182 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_readdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "mds_sessions": { "average_load": 1, "avg_session_uptime": 928, "mdthresh_evicted": 0, "session_add": 1, "session_count": 1, "session_remove": 0, "sessions_open": 1, "sessions_stale": 0, "total_load": 1 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_Blob_bytes": 0, "bluestore_Blob_items": 0, "bluestore_Buffer_bytes": 0, "bluestore_Buffer_items": 0, "bluestore_Extent_bytes": 0, "bluestore_Extent_items": 0, "bluestore_SharedBlob_bytes": 0, "bluestore_SharedBlob_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 225511, "buffer_anon_items": 66, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "mds_co_bytes": 53911, "mds_co_items": 234, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 6336, "osdmap_items": 93, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "omap_del": 3, "omap_rd": 28, "omap_wr": 9, "op": 42, "op_active": 0, "op_laggy": 0, "op_pg": 0, "op_r": 26, "op_reply": 42, "op_resend": 0, "op_rmw": 0, "op_send": 42, "op_send_bytes": 5242, "op_w": 16, "oplen_avg": { "avgcount": 42, "sum": 75 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 8, "osd_sessions": 8, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 0, "osdop_delete": 5, "osdop_getxattr": 14, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 8, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 0, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 2, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 4, "osdop_writefull": 1, "osdop_writesame": 0, "osdop_zero": 1, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 2, "omap_total_objs": 2, "omap_total_removes": 0, "omap_total_updates": 2 }, "purge_queue": { "pq_executed": 0, "pq_executing": 0, "pq_executing_high_water": 0, "pq_executing_ops": 0, "pq_executing_ops_high_water": 0, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 95, "get_or_fail_fail": 0, "get_or_fail_success": 95, "get_started": 0, "get_sum": 121491, "max": 104857600, "put": 95, "put_sum": 121491, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 42, "put_sum": 6168, "take": 42, "take_sum": 6168, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 42, "put_sum": 42, "take": 42, "take_sum": 42, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 3758096384, "put": 0, "put_sum": 0, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x55d33e7a4000": { "get": 4, "get_or_fail_fail": 0, "get_or_fail_success": 4, "get_started": 0, "get_sum": 4268, "max": 3758096384, "put": 4, "put_sum": 4268, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } } } 2023-10-06T03:03:13.859 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120 retry_count=0)... 2023-10-06T03:03:18.295 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:03:18.303 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:03:18.860 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:03:19.030 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:19.025+0000 7fa7ed06e700 1 Processor -- start 2023-10-06T03:03:19.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:19.025+0000 7fa7ed06e700 1 -- start start 2023-10-06T03:03:19.032 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:19.029+0000 7fa7ed06e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa7e80c6510 0x7fa7e806d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:19.032 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:19.029+0000 7fa7ed06e700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fa7e80aec90 0x7fa7e80af0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:19.032 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:19.029+0000 7fa7ed06e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7e80af5f0 con 0x7fa7e80c0c70 2023-10-06T03:03:19.032 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:19.029+0000 7fa7ed06e700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7e80c14a0 con 0x7fa7e80c6510 2023-10-06T03:03:19.032 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:19.029+0000 7fa7ed06e700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7e80c1780 con 0x7fa7e80aec90 2023-10-06T03:03:19.033 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:19.029+0000 7fa7e6d9d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa7e80c6510 0x7fa7e806d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:19.033 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:19.029+0000 7fa7e6d9d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa7e80c6510 0x7fa7e806d0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41280/0 (socket says 172.21.15.57:41280) 2023-10-06T03:03:19.033 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:19.029+0000 7fa7e659c700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fa7e80c0c70 0x7fa7e80c2540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:59522/0 (socket says 172.21.15.57:59522) 2023-10-06T03:03:19.033 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:19.029+0000 7fa7e6d9d700 1 -- 172.21.15.57:0/3951287909 learned_addr learned my addr 172.21.15.57:0/3951287909 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:03:19.033 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:19.029+0000 7fa7e759e700 1 --2- 172.21.15.57:0/3951287909 >> v2:172.21.15.105:3300/0 conn(0x7fa7e80aec90 0x7fa7e80af0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:19.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:19.029+0000 7fa7e6d9d700 1 -- 172.21.15.57:0/3951287909 >> v2:172.21.15.105:3300/0 conn(0x7fa7e80aec90 msgr2=0x7fa7e80af0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:03:19.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:19.029+0000 7fa7e6d9d700 1 --2- 172.21.15.57:0/3951287909 >> v2:172.21.15.105:3300/0 conn(0x7fa7e80aec90 0x7fa7e80af0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:19.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:19.029+0000 7fa7e6d9d700 1 -- 172.21.15.57:0/3951287909 >> v1:172.21.15.57:6789/0 conn(0x7fa7e80c0c70 legacy=0x7fa7e80c2540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:19.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:19.029+0000 7fa7e6d9d700 1 -- 172.21.15.57:0/3951287909 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7e80c1a60 con 0x7fa7e80c6510 2023-10-06T03:03:19.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:19.029+0000 7fa7e6d9d700 1 --2- 172.21.15.57:0/3951287909 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7e80c6510 0x7fa7e806d0d0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fa7e806cc80 tx=0x7fa7d8009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d6cca0c8cd929b9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:03:19.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:19.033+0000 7fa7e5d9b700 1 -- 172.21.15.57:0/3951287909 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d8005c10 con 0x7fa7e80c6510 2023-10-06T03:03:19.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:19.033+0000 7fa7e5d9b700 1 -- 172.21.15.57:0/3951287909 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7d8005d70 con 0x7fa7e80c6510 2023-10-06T03:03:19.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:19.033+0000 7fa7e5d9b700 1 -- 172.21.15.57:0/3951287909 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d8006260 con 0x7fa7e80c6510 2023-10-06T03:03:19.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:19.033+0000 7fa7ed06e700 1 -- 172.21.15.57:0/3951287909 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7e80c6510 msgr2=0x7fa7e806d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:19.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:19.033+0000 7fa7ed06e700 1 --2- 172.21.15.57:0/3951287909 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7e80c6510 0x7fa7e806d0d0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fa7e806cc80 tx=0x7fa7d8009220 comp rx=0 tx=0).stop 2023-10-06T03:03:19.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:19.033+0000 7fa7ed06e700 1 -- 172.21.15.57:0/3951287909 shutdown_connections 2023-10-06T03:03:19.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:19.033+0000 7fa7ed06e700 1 --2- 172.21.15.57:0/3951287909 >> v2:172.21.15.105:3300/0 conn(0x7fa7e80aec90 0x7fa7e80af0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:19.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:19.033+0000 7fa7ed06e700 1 --2- 172.21.15.57:0/3951287909 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7e80c6510 0x7fa7e806d0d0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:19.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:19.033+0000 7fa7ed06e700 1 -- 172.21.15.57:0/3951287909 >> 172.21.15.57:0/3951287909 conn(0x7fa7e80cbed0 msgr2=0x7fa7e80cc2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:03:19.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:19.033+0000 7fa7ed06e700 1 -- 172.21.15.57:0/3951287909 shutdown_connections 2023-10-06T03:03:19.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:19.033+0000 7fa7ed06e700 1 -- 172.21.15.57:0/3951287909 wait complete. 2023-10-06T03:03:19.038 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:19.033+0000 7fa7ed06e700 1 Processor -- start 2023-10-06T03:03:19.038 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:19.033+0000 7fa7ed06e700 1 -- start start 2023-10-06T03:03:19.040 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:19.037+0000 7fa7ed06e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7e80aec90 0x7fa7e815a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:19.040 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:19.037+0000 7fa7ed06e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa7e80c0c70 0x7fa7e813b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:19.040 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:19.037+0000 7fa7ed06e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa7e80c6510 0x7fa7e80caf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:19.040 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:19.037+0000 7fa7ed06e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e815a060 con 0x7fa7e80aec90 2023-10-06T03:03:19.040 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:19.037+0000 7fa7ed06e700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e8159450 con 0x7fa7e80c6510 2023-10-06T03:03:19.040 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:19.037+0000 7fa7ed06e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e8159730 con 0x7fa7e80c0c70 2023-10-06T03:03:19.040 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:19.037+0000 7fa7e6d9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7e80aec90 0x7fa7e815a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:19.040 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:19.037+0000 7fa7e6d9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7e80aec90 0x7fa7e815a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41294/0 (socket says 172.21.15.57:41294) 2023-10-06T03:03:19.041 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:19.037+0000 7fa7e6d9d700 1 -- 172.21.15.57:0/4266641171 learned_addr learned my addr 172.21.15.57:0/4266641171 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:03:19.041 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:19.037+0000 7fa7e759e700 1 --2- 172.21.15.57:0/4266641171 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa7e80c6510 0x7fa7e80caf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:19.041 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:19.037+0000 7fa7e6d9d700 1 -- 172.21.15.57:0/4266641171 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa7e80c0c70 msgr2=0x7fa7e813b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:19.042 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:19.037+0000 7fa7e659c700 1 --2- 172.21.15.57:0/4266641171 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa7e80c0c70 0x7fa7e813b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:19.042 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:19.037+0000 7fa7e6d9d700 1 --2- 172.21.15.57:0/4266641171 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa7e80c0c70 0x7fa7e813b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:19.042 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:19.037+0000 7fa7e6d9d700 1 -- 172.21.15.57:0/4266641171 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa7e80c6510 msgr2=0x7fa7e80caf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:19.042 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:19.037+0000 7fa7e6d9d700 1 --2- 172.21.15.57:0/4266641171 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa7e80c6510 0x7fa7e80caf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:19.042 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:19.037+0000 7fa7e6d9d700 1 -- 172.21.15.57:0/4266641171 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7d8009480 con 0x7fa7e80aec90 2023-10-06T03:03:19.042 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:19.037+0000 7fa7e759e700 1 --2- 172.21.15.57:0/4266641171 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa7e80c6510 0x7fa7e80caf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:03:19.042 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:19.037+0000 7fa7e659c700 1 --2- 172.21.15.57:0/4266641171 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa7e80c0c70 0x7fa7e813b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:03:19.042 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:19.037+0000 7fa7e6d9d700 1 --2- 172.21.15.57:0/4266641171 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7e80aec90 0x7fa7e815a4f0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fa7d800b0e0 tx=0x7fa7d8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:03:19.043 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:19.037+0000 7fa7ceffd700 1 -- 172.21.15.57:0/4266641171 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d800b900 con 0x7fa7e80aec90 2023-10-06T03:03:19.043 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:19.037+0000 7fa7ceffd700 1 -- 172.21.15.57:0/4266641171 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7d8020070 con 0x7fa7e80aec90 2023-10-06T03:03:19.043 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:19.037+0000 7fa7ed06e700 1 -- 172.21.15.57:0/4266641171 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7e8159a10 con 0x7fa7e80aec90 2023-10-06T03:03:19.043 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:19.037+0000 7fa7ceffd700 1 -- 172.21.15.57:0/4266641171 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d800bc90 con 0x7fa7e80aec90 2023-10-06T03:03:19.043 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:19.037+0000 7fa7ed06e700 1 -- 172.21.15.57:0/4266641171 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7e813be50 con 0x7fa7e80aec90 2023-10-06T03:03:19.043 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:19.041+0000 7fa7ed06e700 1 -- 172.21.15.57:0/4266641171 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7e806b970 con 0x7fa7e80aec90 2023-10-06T03:03:19.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:19.041+0000 7fa7ceffd700 1 -- 172.21.15.57:0/4266641171 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fa7d8022030 con 0x7fa7e80aec90 2023-10-06T03:03:19.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:19.045+0000 7fa7ceffd700 1 --2- 172.21.15.57:0/4266641171 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fa7d4060550 0x7fa7d4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:19.047 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:19.045+0000 7fa7ceffd700 1 -- 172.21.15.57:0/4266641171 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6144+0+0 (secure 0 0 0) 0x7fa7d807e5d0 con 0x7fa7e80aec90 2023-10-06T03:03:19.047 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:19.045+0000 7fa7e659c700 1 --2- 172.21.15.57:0/4266641171 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fa7d4060550 0x7fa7d4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:19.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:19.045+0000 7fa7e659c700 1 --2- 172.21.15.57:0/4266641171 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fa7d4060550 0x7fa7d4062a00 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fa7e806ae00 tx=0x7fa7dc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:03:19.054 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:19.049+0000 7fa7ceffd700 1 -- 172.21.15.57:0/4266641171 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fa7d804e990 con 0x7fa7e80aec90 2023-10-06T03:03:19.263 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:19.261+0000 7fa7ed06e700 1 -- 172.21.15.57:0/4266641171 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa7e804b600 con 0x7fa7e80aec90 2023-10-06T03:03:19.264 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:19.261+0000 7fa7ceffd700 1 -- 172.21.15.57:0/4266641171 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4598 (secure 0 0 0) 0x7fa7d800bdf0 con 0x7fa7e80aec90 2023-10-06T03:03:19.265 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:03:19.265 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":38,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5222,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/879829980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":879829980},{"type":"v1","addr":"172.21.15.105:6833","nonce":879829980}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5225,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/3705921279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":3705921279},{"type":"v1","addr":"172.21.15.105:6835","nonce":3705921279}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/251759282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":251759282},{"type":"v1","addr":"172.21.15.57:6835","nonce":251759282}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:02:39.274111+0000","modified":"2023-10-06T03:02:56.856783+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":54,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5643},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5643":{"gid":5643,"name":"c","rank":0,"incarnation":34,"state":"up:active","state_seq":5,"addr":"172.21.15.57:6837/3347844181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6836","nonce":3347844181},{"type":"v1","addr":"172.21.15.57:6837","nonce":3347844181}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T03:03:19.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:19.265+0000 7fa7ed06e700 1 -- 172.21.15.57:0/4266641171 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fa7d4060550 msgr2=0x7fa7d4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:19.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:19.265+0000 7fa7ed06e700 1 --2- 172.21.15.57:0/4266641171 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fa7d4060550 0x7fa7d4062a00 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fa7e806ae00 tx=0x7fa7dc009040 comp rx=0 tx=0).stop 2023-10-06T03:03:19.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:19.265+0000 7fa7ed06e700 1 -- 172.21.15.57:0/4266641171 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7e80aec90 msgr2=0x7fa7e815a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:19.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:19.265+0000 7fa7ed06e700 1 --2- 172.21.15.57:0/4266641171 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7e80aec90 0x7fa7e815a4f0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fa7d800b0e0 tx=0x7fa7d8016000 comp rx=0 tx=0).stop 2023-10-06T03:03:19.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:19.265+0000 7fa7ed06e700 1 -- 172.21.15.57:0/4266641171 shutdown_connections 2023-10-06T03:03:19.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:19.265+0000 7fa7ed06e700 1 --2- 172.21.15.57:0/4266641171 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa7e80c6510 0x7fa7e80caf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:19.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:19.265+0000 7fa7ed06e700 1 --2- 172.21.15.57:0/4266641171 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fa7d4060550 0x7fa7d4062a00 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:19.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:19.265+0000 7fa7ed06e700 1 --2- 172.21.15.57:0/4266641171 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa7e80c0c70 0x7fa7e813b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:19.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:19.265+0000 7fa7ed06e700 1 --2- 172.21.15.57:0/4266641171 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7e80aec90 0x7fa7e815a4f0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:19.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:19.265+0000 7fa7ed06e700 1 -- 172.21.15.57:0/4266641171 >> 172.21.15.57:0/4266641171 conn(0x7fa7e80cbed0 msgr2=0x7fa7e80cc2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:03:19.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:19.265+0000 7fa7ed06e700 1 -- 172.21.15.57:0/4266641171 shutdown_connections 2023-10-06T03:03:19.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:19.265+0000 7fa7ed06e700 1 -- 172.21.15.57:0/4266641171 wait complete. 2023-10-06T03:03:19.270 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 38 2023-10-06T03:03:19.291 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json perf dump 2023-10-06T03:03:19.465 INFO:teuthology.orchestra.run.smithi057.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":68,"msgr_send_messages":39,"msgr_recv_bytes":114025,"msgr_send_bytes":48095,"msgr_created_connections":10,"msgr_active_connections":3,"msgr_running_total_time":0.027674767,"msgr_running_send_time":0.008112210,"msgr_running_recv_time":0.015573413,"msgr_running_fast_dispatch_time":0.002279065,"msgr_send_messages_queue_lat":{"avgcount":39,"sum":0.007430089,"avgtime":0.000190515},"msgr_handle_ack_lat":{"avgcount":11,"sum":0.000009953,"avgtime":0.000000904}},"AsyncMessenger::Worker-1":{"msgr_recv_messages":21,"msgr_send_messages":29,"msgr_recv_bytes":9933,"msgr_send_bytes":103821,"msgr_created_connections":6,"msgr_active_connections":4,"msgr_running_total_time":0.009180013,"msgr_running_send_time":0.002755673,"msgr_running_recv_time":0.005214588,"msgr_running_fast_dispatch_time":0.000643523,"msgr_send_messages_queue_lat":{"avgcount":27,"sum":0.005788491,"avgtime":0.000214388},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"AsyncMessenger::Worker-2":{"msgr_recv_messages":16,"msgr_send_messages":18,"msgr_recv_bytes":10773,"msgr_send_bytes":6198,"msgr_created_connections":6,"msgr_active_connections":4,"msgr_running_total_time":0.007012821,"msgr_running_send_time":0.000973107,"msgr_running_recv_time":0.004861993,"msgr_running_fast_dispatch_time":0.000767528,"msgr_send_messages_queue_lat":{"avgcount":16,"sum":0.008215046,"avgtime":0.000513440},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":0,"complete_latency":{"avgcount":43,"sum":0.004722413,"avgtime":0.000109823}},"finisher-PurgeQueue":{"queue_len":0,"complete_latency":{"avgcount":4,"sum":0.000177735,"avgtime":0.000044433}},"mds":{"request":4,"reply":2,"reply_latency":{"avgcount":2,"sum":0.005332595,"avgtime":0.002666297},"slow_reply":0,"forward":0,"dir_fetch":12,"dir_commit":0,"dir_split":0,"dir_merge":0,"inodes":11,"inodes_top":0,"inodes_bottom":11,"inodes_pin_tail":0,"inodes_pinned":11,"inodes_expired":0,"inodes_with_caps":2,"caps":2,"subtrees":2,"traverse":4,"traverse_hit":4,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":139,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":1,"root_rbytes":7,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":0,"ceph_cap_op_grant":0,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":1,"handle_client_caps_dirty":1,"handle_client_cap_release":0,"process_request_cap_release":1},"mds_cache":{"num_strays":0,"num_strays_delayed":0,"num_strays_enqueuing":0,"strays_created":0,"strays_enqueued":0,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0},"mds_log":{"evadd":4,"evex":0,"evtrm":0,"ev":6,"evexg":0,"evexd":0,"segadd":0,"segex":0,"segtrm":0,"seg":1,"segexg":0,"segexd":0,"expos":4194304,"wrpos":4199722,"rdpos":4195196,"jlat":{"avgcount":4,"sum":0.015392207,"avgtime":0.003848051},"replayed":2},"mds_mem":{"ino":14,"ino+":14,"ino-":0,"dir":12,"dir+":12,"dir-":0,"dn":11,"dn+":11,"dn-":0,"cap":2,"cap+":2,"cap-":0,"rss":41308,"heap":223456},"mds_server":{"dispatch_client_request":3,"dispatch_server_request":0,"handle_client_request":4,"handle_client_session":1,"handle_peer_request":0,"req_create_latency":{"avgcount":1,"sum":0.005055413,"avgtime":0.005055413},"req_getattr_latency":{"avgcount":1,"sum":0.000277182,"avgtime":0.000277182},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_readdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"cap_revoke_eviction":0,"cap_acquisition_throttle":0,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":1,"session_add":1,"session_remove":0,"sessions_open":1,"sessions_stale":0,"total_load":1,"average_load":1,"avg_session_uptime":933,"mdthresh_evicted":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_Buffer_bytes":0,"bluestore_Buffer_items":0,"bluestore_Extent_bytes":0,"bluestore_Extent_items":0,"bluestore_Blob_bytes":0,"bluestore_Blob_items":0,"bluestore_SharedBlob_bytes":0,"bluestore_SharedBlob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":225511,"buffer_anon_items":66,"buffer_meta_bytes":0,"buffer_meta_items":0,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":6336,"osdmap_items":93,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":53911,"mds_co_items":234,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":42,"op_send_bytes":5242,"op_resend":0,"op_reply":42,"oplen_avg":{"avgcount":42,"sum":75},"op":42,"op_r":26,"op_w":16,"op_rmw":0,"op_pg":0,"osdop_stat":2,"osdop_create":0,"osdop_read":8,"osdop_write":4,"osdop_writefull":1,"osdop_writesame":0,"osdop_append":0,"osdop_zero":1,"osdop_truncate":0,"osdop_delete":5,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":14,"osdop_setxattr":0,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":0,"map_full":0,"map_inc":0,"osd_sessions":8,"osd_session_open":8,"osd_session_close":0,"osd_laggy":0,"omap_wr":9,"omap_rd":28,"omap_del":3},"oft":{"omap_total_objs":2,"omap_total_kv_pairs":2,"omap_total_updates":2,"omap_total_removes":0},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":0,"pq_executing":0,"pq_executing_high_water":0,"pq_executed":0,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":0,"max":104857600,"get_started":0,"get":101,"get_sum":123261,"get_or_fail_fail":0,"get_or_fail_success":101,"take":0,"take_sum":0,"put":101,"put_sum":123261,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":42,"take_sum":6168,"put":42,"put_sum":6168,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":42,"take_sum":42,"put":42,"put_sum":42,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":0,"take_sum":0,"put":0,"put_sum":0,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x55d33e7a4000":{"val":0,"max":3758096384,"get_started":0,"get":4,"get_sum":4268,"get_or_fail_fail":0,"get_or_fail_success":4,"take":0,"take_sum":0,"put":4,"put_sum":4268,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}}} 2023-10-06T03:03:19.467 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 3, "msgr_created_connections": 10, "msgr_handle_ack_lat": { "avgcount": 11, "avgtime": 9.04e-07, "sum": 9.953e-06 }, "msgr_recv_bytes": 114025, "msgr_recv_messages": 68, "msgr_running_fast_dispatch_time": 0.002279065, "msgr_running_recv_time": 0.015573413, "msgr_running_send_time": 0.00811221, "msgr_running_total_time": 0.027674767, "msgr_send_bytes": 48095, "msgr_send_messages": 39, "msgr_send_messages_queue_lat": { "avgcount": 39, "avgtime": 0.000190515, "sum": 0.007430089 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 4, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 9933, "msgr_recv_messages": 21, "msgr_running_fast_dispatch_time": 0.000643523, "msgr_running_recv_time": 0.005214588, "msgr_running_send_time": 0.002755673, "msgr_running_total_time": 0.009180013, "msgr_send_bytes": 103821, "msgr_send_messages": 29, "msgr_send_messages_queue_lat": { "avgcount": 27, "avgtime": 0.000214388, "sum": 0.005788491 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 4, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 10773, "msgr_recv_messages": 16, "msgr_running_fast_dispatch_time": 0.000767528, "msgr_running_recv_time": 0.004861993, "msgr_running_send_time": 0.000973107, "msgr_running_total_time": 0.007012821, "msgr_send_bytes": 6198, "msgr_send_messages": 18, "msgr_send_messages_queue_lat": { "avgcount": 16, "avgtime": 0.00051344, "sum": 0.008215046 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 43, "avgtime": 0.000109823, "sum": 0.004722413 }, "queue_len": 0 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 4, "avgtime": 4.4433e-05, "sum": 0.000177735 }, "queue_len": 0 }, "mds": { "caps": 2, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 0, "ceph_cap_op_revoke": 0, "ceph_cap_op_trunc": 0, "dir_commit": 0, "dir_fetch": 12, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 0, "handle_client_caps": 1, "handle_client_caps_dirty": 1, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 11, "inodes_bottom": 11, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 11, "inodes_top": 0, "inodes_with_caps": 2, "load_cent": 139, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 1, "q": 0, "reply": 2, "reply_latency": { "avgcount": 2, "avgtime": 0.002666297, "sum": 0.005332595 }, "request": 4, "root_rbytes": 7, "root_rfiles": 1, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 4, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 4, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 0, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 0, "strays_enqueued": 0, "strays_migrated": 0, "strays_reintegrated": 0 }, "mds_log": { "ev": 6, "evadd": 4, "evex": 0, "evexd": 0, "evexg": 0, "evtrm": 0, "expos": 4194304, "jlat": { "avgcount": 4, "avgtime": 0.003848051, "sum": 0.015392207 }, "rdpos": 4195196, "replayed": 2, "seg": 1, "segadd": 0, "segex": 0, "segexd": 0, "segexg": 0, "segtrm": 0, "wrpos": 4199722 }, "mds_mem": { "cap": 2, "cap+": 2, "cap-": 0, "dir": 12, "dir+": 12, "dir-": 0, "dn": 11, "dn+": 11, "dn-": 0, "heap": 223456, "ino": 14, "ino+": 14, "ino-": 0, "rss": 41308 }, "mds_server": { "cap_acquisition_throttle": 0, "cap_revoke_eviction": 0, "dispatch_client_request": 3, "dispatch_server_request": 0, "handle_client_request": 4, "handle_client_session": 1, "handle_peer_request": 0, "req_create_latency": { "avgcount": 1, "avgtime": 0.005055413, "sum": 0.005055413 }, "req_getattr_latency": { "avgcount": 1, "avgtime": 0.000277182, "sum": 0.000277182 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_readdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "mds_sessions": { "average_load": 1, "avg_session_uptime": 933, "mdthresh_evicted": 0, "session_add": 1, "session_count": 1, "session_remove": 0, "sessions_open": 1, "sessions_stale": 0, "total_load": 1 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_Blob_bytes": 0, "bluestore_Blob_items": 0, "bluestore_Buffer_bytes": 0, "bluestore_Buffer_items": 0, "bluestore_Extent_bytes": 0, "bluestore_Extent_items": 0, "bluestore_SharedBlob_bytes": 0, "bluestore_SharedBlob_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 225511, "buffer_anon_items": 66, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "mds_co_bytes": 53911, "mds_co_items": 234, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 6336, "osdmap_items": 93, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "omap_del": 3, "omap_rd": 28, "omap_wr": 9, "op": 42, "op_active": 0, "op_laggy": 0, "op_pg": 0, "op_r": 26, "op_reply": 42, "op_resend": 0, "op_rmw": 0, "op_send": 42, "op_send_bytes": 5242, "op_w": 16, "oplen_avg": { "avgcount": 42, "sum": 75 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 8, "osd_sessions": 8, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 0, "osdop_delete": 5, "osdop_getxattr": 14, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 8, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 0, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 2, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 4, "osdop_writefull": 1, "osdop_writesame": 0, "osdop_zero": 1, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 2, "omap_total_objs": 2, "omap_total_removes": 0, "omap_total_updates": 2 }, "purge_queue": { "pq_executed": 0, "pq_executing": 0, "pq_executing_high_water": 0, "pq_executing_ops": 0, "pq_executing_ops_high_water": 0, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 101, "get_or_fail_fail": 0, "get_or_fail_success": 101, "get_started": 0, "get_sum": 123261, "max": 104857600, "put": 101, "put_sum": 123261, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 42, "put_sum": 6168, "take": 42, "take_sum": 6168, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 42, "put_sum": 42, "take": 42, "take_sum": 42, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 3758096384, "put": 0, "put_sum": 0, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x55d33e7a4000": { "get": 4, "get_or_fail_fail": 0, "get_or_fail_success": 4, "get_started": 0, "get_sum": 4268, "max": 3758096384, "put": 4, "put_sum": 4268, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } } } 2023-10-06T03:03:19.467 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120 retry_count=0)... 2023-10-06T03:03:24.469 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:03:24.634 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:24.629+0000 7f357359e700 1 Processor -- start 2023-10-06T03:03:24.635 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:24.633+0000 7f357359e700 1 -- start start 2023-10-06T03:03:24.637 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:24.633+0000 7f357359e700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f3574140650 0x7f35740c8130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:24.637 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:24.633+0000 7f357359e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3574140a20 0x7f357415abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:24.637 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:24.633+0000 7f357359e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f357415b120 0x7f3574069570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:24.637 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:24.633+0000 7f357359e700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f357406e6a0 con 0x7f357415b120 2023-10-06T03:03:24.637 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:24.633+0000 7f357359e700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f357406d210 con 0x7f3574140650 2023-10-06T03:03:24.637 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:24.633+0000 7f357359e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f357415b530 con 0x7f3574140a20 2023-10-06T03:03:24.638 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:24.633+0000 7f3572d9d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f357415b120 0x7f3574069570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:24.638 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:24.633+0000 7f3572d9d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f357415b120 0x7f3574069570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:53352/0 (socket says 172.21.15.57:53352) 2023-10-06T03:03:24.638 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:24.633+0000 7f3572d9d700 1 -- 172.21.15.57:0/2856179956 learned_addr learned my addr 172.21.15.57:0/2856179956 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:03:24.638 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:24.633+0000 7f357259c700 1 --2- 172.21.15.57:0/2856179956 >> v2:172.21.15.105:3300/0 conn(0x7f3574140650 0x7f35740c8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:24.638 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:24.633+0000 7f356bfff700 1 --2- 172.21.15.57:0/2856179956 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3574140a20 0x7f357415abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:24.639 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:24.633+0000 7f3572d9d700 1 -- 172.21.15.57:0/2856179956 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3574140a20 msgr2=0x7f357415abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:03:24.639 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:24.633+0000 7f3572d9d700 1 --2- 172.21.15.57:0/2856179956 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3574140a20 0x7f357415abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:24.639 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:24.633+0000 7f3572d9d700 1 -- 172.21.15.57:0/2856179956 >> v2:172.21.15.105:3300/0 conn(0x7f3574140650 msgr2=0x7f35740c8130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:03:24.639 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:24.633+0000 7f3572d9d700 1 --2- 172.21.15.57:0/2856179956 >> v2:172.21.15.105:3300/0 conn(0x7f3574140650 0x7f35740c8130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:24.639 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:24.637+0000 7f3572d9d700 1 -- 172.21.15.57:0/2856179956 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f357406cc50 con 0x7f357415b120 2023-10-06T03:03:24.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:24.637+0000 7f3572d9d700 1 --2- 172.21.15.57:0/2856179956 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f357415b120 0x7f3574069570 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f357406c5c0 tx=0x7f356c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63361d86dec20a63 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:03:24.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:24.637+0000 7f3571d9b700 1 -- 172.21.15.57:0/2856179956 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f356c00e070 con 0x7f357415b120 2023-10-06T03:03:24.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:24.637+0000 7f3571d9b700 1 -- 172.21.15.57:0/2856179956 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f356c00ba50 con 0x7f357415b120 2023-10-06T03:03:24.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:24.637+0000 7f3571d9b700 1 -- 172.21.15.57:0/2856179956 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f356c0092e0 con 0x7f357415b120 2023-10-06T03:03:24.641 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:24.637+0000 7f357359e700 1 -- 172.21.15.57:0/2856179956 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f357415b120 msgr2=0x7f3574069570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:24.641 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:24.637+0000 7f357359e700 1 --2- 172.21.15.57:0/2856179956 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f357415b120 0x7f3574069570 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f357406c5c0 tx=0x7f356c009840 comp rx=0 tx=0).stop 2023-10-06T03:03:24.641 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:24.637+0000 7f357359e700 1 -- 172.21.15.57:0/2856179956 shutdown_connections 2023-10-06T03:03:24.641 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:24.637+0000 7f357359e700 1 --2- 172.21.15.57:0/2856179956 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f357415b120 0x7f3574069570 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:24.641 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:24.637+0000 7f357359e700 1 --2- 172.21.15.57:0/2856179956 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3574140a20 0x7f357415abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:24.641 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:24.637+0000 7f357359e700 1 --2- 172.21.15.57:0/2856179956 >> v2:172.21.15.105:3300/0 conn(0x7f3574140650 0x7f35740c8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:24.642 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:24.637+0000 7f357359e700 1 -- 172.21.15.57:0/2856179956 >> 172.21.15.57:0/2856179956 conn(0x7f3574067b00 msgr2=0x7f35740cbd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:03:24.642 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:24.637+0000 7f357359e700 1 -- 172.21.15.57:0/2856179956 shutdown_connections 2023-10-06T03:03:24.642 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:24.637+0000 7f357359e700 1 -- 172.21.15.57:0/2856179956 wait complete. 2023-10-06T03:03:24.643 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:24.641+0000 7f357359e700 1 Processor -- start 2023-10-06T03:03:24.643 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:24.641+0000 7f357359e700 1 -- start start 2023-10-06T03:03:24.645 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:24.641+0000 7f357359e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3574140650 0x7f357415a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:24.645 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:24.641+0000 7f357359e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3574140a20 0x7f35740a5430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:24.645 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:24.641+0000 7f357359e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f357415b120 0x7f35740c1c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:24.645 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:24.641+0000 7f357359e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35740a6b00 con 0x7f3574140a20 2023-10-06T03:03:24.645 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:24.641+0000 7f357359e700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35740a5ef0 con 0x7f3574140650 2023-10-06T03:03:24.645 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:24.641+0000 7f357359e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35740a61d0 con 0x7f357415b120 2023-10-06T03:03:24.646 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:24.641+0000 7f356bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3574140a20 0x7f35740a5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:24.646 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:24.641+0000 7f356bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3574140a20 0x7f35740a5430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:53368/0 (socket says 172.21.15.57:53368) 2023-10-06T03:03:24.646 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:24.641+0000 7f356bfff700 1 -- 172.21.15.57:0/2935060170 learned_addr learned my addr 172.21.15.57:0/2935060170 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:03:24.647 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:24.641+0000 7f357259c700 1 --2- 172.21.15.57:0/2935060170 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3574140650 0x7f357415a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:24.647 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:24.641+0000 7f3572d9d700 1 --2- 172.21.15.57:0/2935060170 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f357415b120 0x7f35740c1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:24.647 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:24.641+0000 7f356bfff700 1 -- 172.21.15.57:0/2935060170 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f357415b120 msgr2=0x7f35740c1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:24.647 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:24.641+0000 7f356bfff700 1 --2- 172.21.15.57:0/2935060170 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f357415b120 0x7f35740c1c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:24.647 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:24.641+0000 7f356bfff700 1 -- 172.21.15.57:0/2935060170 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3574140650 msgr2=0x7f357415a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:24.647 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:24.641+0000 7f356bfff700 1 --2- 172.21.15.57:0/2935060170 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3574140650 0x7f357415a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:24.647 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:24.641+0000 7f356bfff700 1 -- 172.21.15.57:0/2935060170 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f356c009ae0 con 0x7f3574140a20 2023-10-06T03:03:24.647 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:24.641+0000 7f3572d9d700 1 --2- 172.21.15.57:0/2935060170 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f357415b120 0x7f35740c1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:03:24.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:24.645+0000 7f356bfff700 1 --2- 172.21.15.57:0/2935060170 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3574140a20 0x7f35740a5430 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f355c00d890 tx=0x7f355c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:03:24.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:24.645+0000 7f356a7fc700 1 -- 172.21.15.57:0/2935060170 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f355c0125f0 con 0x7f3574140a20 2023-10-06T03:03:24.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:24.645+0000 7f356a7fc700 1 -- 172.21.15.57:0/2935060170 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f355c012770 con 0x7f3574140a20 2023-10-06T03:03:24.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:24.645+0000 7f357359e700 1 -- 172.21.15.57:0/2935060170 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35740a64b0 con 0x7f3574140a20 2023-10-06T03:03:24.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:24.645+0000 7f356a7fc700 1 -- 172.21.15.57:0/2935060170 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f355c012b30 con 0x7f3574140a20 2023-10-06T03:03:24.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:24.645+0000 7f357359e700 1 -- 172.21.15.57:0/2935060170 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35740c7370 con 0x7f3574140a20 2023-10-06T03:03:24.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:24.645+0000 7f357359e700 1 -- 172.21.15.57:0/2935060170 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35740a6cb0 con 0x7f3574140a20 2023-10-06T03:03:24.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:24.649+0000 7f356a7fc700 1 -- 172.21.15.57:0/2935060170 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f355c01e460 con 0x7f3574140a20 2023-10-06T03:03:24.652 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:24.649+0000 7f356a7fc700 1 --2- 172.21.15.57:0/2935060170 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f3554060550 0x7f3554062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:24.652 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:24.649+0000 7f356a7fc700 1 -- 172.21.15.57:0/2935060170 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6144+0+0 (secure 0 0 0) 0x7f355c07d070 con 0x7f3574140a20 2023-10-06T03:03:24.653 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:24.649+0000 7f357259c700 1 --2- 172.21.15.57:0/2935060170 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f3554060550 0x7f3554062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:24.654 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:24.649+0000 7f357259c700 1 --2- 172.21.15.57:0/2935060170 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f3554060550 0x7f3554062a00 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f3564006fd0 tx=0x7f3564008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:03:24.659 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:24.657+0000 7f356a7fc700 1 -- 172.21.15.57:0/2935060170 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f355c0acbe0 con 0x7f3574140a20 2023-10-06T03:03:24.866 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:24.861+0000 7f357359e700 1 -- 172.21.15.57:0/2935060170 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f35740af100 con 0x7f3574140a20 2023-10-06T03:03:24.867 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:24.865+0000 7f356a7fc700 1 -- 172.21.15.57:0/2935060170 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4598 (secure 0 0 0) 0x7f35740a6cb0 con 0x7f3574140a20 2023-10-06T03:03:24.867 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:03:24.867 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":38,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5222,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/879829980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":879829980},{"type":"v1","addr":"172.21.15.105:6833","nonce":879829980}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5225,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/3705921279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":3705921279},{"type":"v1","addr":"172.21.15.105:6835","nonce":3705921279}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/251759282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":251759282},{"type":"v1","addr":"172.21.15.57:6835","nonce":251759282}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:02:39.274111+0000","modified":"2023-10-06T03:02:56.856783+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":54,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5643},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5643":{"gid":5643,"name":"c","rank":0,"incarnation":34,"state":"up:active","state_seq":5,"addr":"172.21.15.57:6837/3347844181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6836","nonce":3347844181},{"type":"v1","addr":"172.21.15.57:6837","nonce":3347844181}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T03:03:24.871 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:24.869+0000 7f357359e700 1 -- 172.21.15.57:0/2935060170 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f3554060550 msgr2=0x7f3554062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:24.871 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:24.869+0000 7f357359e700 1 --2- 172.21.15.57:0/2935060170 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f3554060550 0x7f3554062a00 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f3564006fd0 tx=0x7f3564008040 comp rx=0 tx=0).stop 2023-10-06T03:03:24.871 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:24.869+0000 7f357359e700 1 -- 172.21.15.57:0/2935060170 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3574140a20 msgr2=0x7f35740a5430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:24.871 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:24.869+0000 7f357359e700 1 --2- 172.21.15.57:0/2935060170 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3574140a20 0x7f35740a5430 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f355c00d890 tx=0x7f355c008040 comp rx=0 tx=0).stop 2023-10-06T03:03:24.872 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:24.869+0000 7f357359e700 1 -- 172.21.15.57:0/2935060170 shutdown_connections 2023-10-06T03:03:24.872 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:24.869+0000 7f357359e700 1 --2- 172.21.15.57:0/2935060170 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f3554060550 0x7f3554062a00 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:24.872 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:24.869+0000 7f357359e700 1 --2- 172.21.15.57:0/2935060170 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f357415b120 0x7f35740c1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:24.872 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:24.869+0000 7f357359e700 1 --2- 172.21.15.57:0/2935060170 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3574140a20 0x7f35740a5430 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:24.872 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:24.869+0000 7f357359e700 1 --2- 172.21.15.57:0/2935060170 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3574140650 0x7f357415a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:24.872 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:24.869+0000 7f357359e700 1 -- 172.21.15.57:0/2935060170 >> 172.21.15.57:0/2935060170 conn(0x7f3574067b00 msgr2=0x7f35740b1390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:03:24.872 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:24.869+0000 7f357359e700 1 -- 172.21.15.57:0/2935060170 shutdown_connections 2023-10-06T03:03:24.872 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:24.869+0000 7f357359e700 1 -- 172.21.15.57:0/2935060170 wait complete. 2023-10-06T03:03:24.873 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 38 2023-10-06T03:03:24.891 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json perf dump 2023-10-06T03:03:25.061 INFO:teuthology.orchestra.run.smithi057.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":77,"msgr_send_messages":42,"msgr_recv_bytes":117083,"msgr_send_bytes":49382,"msgr_created_connections":10,"msgr_active_connections":3,"msgr_running_total_time":0.030393224,"msgr_running_send_time":0.009616699,"msgr_running_recv_time":0.016146265,"msgr_running_fast_dispatch_time":0.002868854,"msgr_send_messages_queue_lat":{"avgcount":42,"sum":0.007679393,"avgtime":0.000182842},"msgr_handle_ack_lat":{"avgcount":12,"sum":0.000011113,"avgtime":0.000000926}},"AsyncMessenger::Worker-1":{"msgr_recv_messages":21,"msgr_send_messages":30,"msgr_recv_bytes":9933,"msgr_send_bytes":105549,"msgr_created_connections":6,"msgr_active_connections":4,"msgr_running_total_time":0.009331538,"msgr_running_send_time":0.002883199,"msgr_running_recv_time":0.005214588,"msgr_running_fast_dispatch_time":0.000643523,"msgr_send_messages_queue_lat":{"avgcount":28,"sum":0.005899318,"avgtime":0.000210689},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"AsyncMessenger::Worker-2":{"msgr_recv_messages":16,"msgr_send_messages":18,"msgr_recv_bytes":10773,"msgr_send_bytes":6198,"msgr_created_connections":6,"msgr_active_connections":4,"msgr_running_total_time":0.007012821,"msgr_running_send_time":0.000973107,"msgr_running_recv_time":0.004861993,"msgr_running_fast_dispatch_time":0.000767528,"msgr_send_messages_queue_lat":{"avgcount":16,"sum":0.008215046,"avgtime":0.000513440},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":0,"complete_latency":{"avgcount":43,"sum":0.004722413,"avgtime":0.000109823}},"finisher-PurgeQueue":{"queue_len":0,"complete_latency":{"avgcount":4,"sum":0.000177735,"avgtime":0.000044433}},"mds":{"request":4,"reply":2,"reply_latency":{"avgcount":2,"sum":0.005332595,"avgtime":0.002666297},"slow_reply":0,"forward":0,"dir_fetch":12,"dir_commit":0,"dir_split":0,"dir_merge":0,"inodes":11,"inodes_top":0,"inodes_bottom":11,"inodes_pin_tail":0,"inodes_pinned":11,"inodes_expired":0,"inodes_with_caps":2,"caps":2,"subtrees":2,"traverse":4,"traverse_hit":4,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":139,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":1,"root_rbytes":7,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":0,"ceph_cap_op_grant":0,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":1,"handle_client_caps_dirty":1,"handle_client_cap_release":0,"process_request_cap_release":1},"mds_cache":{"num_strays":0,"num_strays_delayed":0,"num_strays_enqueuing":0,"strays_created":0,"strays_enqueued":0,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0},"mds_log":{"evadd":4,"evex":0,"evtrm":0,"ev":6,"evexg":0,"evexd":0,"segadd":0,"segex":0,"segtrm":0,"seg":1,"segexg":0,"segexd":0,"expos":4194304,"wrpos":4199722,"rdpos":4195196,"jlat":{"avgcount":4,"sum":0.015392207,"avgtime":0.003848051},"replayed":2},"mds_mem":{"ino":14,"ino+":14,"ino-":0,"dir":12,"dir+":12,"dir-":0,"dn":11,"dn+":11,"dn-":0,"cap":2,"cap+":2,"cap-":0,"rss":41692,"heap":223456},"mds_server":{"dispatch_client_request":3,"dispatch_server_request":0,"handle_client_request":4,"handle_client_session":2,"handle_peer_request":0,"req_create_latency":{"avgcount":1,"sum":0.005055413,"avgtime":0.005055413},"req_getattr_latency":{"avgcount":1,"sum":0.000277182,"avgtime":0.000277182},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_readdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"cap_revoke_eviction":0,"cap_acquisition_throttle":0,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":1,"session_add":1,"session_remove":0,"sessions_open":1,"sessions_stale":0,"total_load":1,"average_load":1,"avg_session_uptime":938,"mdthresh_evicted":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_Buffer_bytes":0,"bluestore_Buffer_items":0,"bluestore_Extent_bytes":0,"bluestore_Extent_items":0,"bluestore_Blob_bytes":0,"bluestore_Blob_items":0,"bluestore_SharedBlob_bytes":0,"bluestore_SharedBlob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":225511,"buffer_anon_items":66,"buffer_meta_bytes":0,"buffer_meta_items":0,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":6336,"osdmap_items":93,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":53911,"mds_co_items":234,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":42,"op_send_bytes":5242,"op_resend":0,"op_reply":42,"oplen_avg":{"avgcount":42,"sum":75},"op":42,"op_r":26,"op_w":16,"op_rmw":0,"op_pg":0,"osdop_stat":2,"osdop_create":0,"osdop_read":8,"osdop_write":4,"osdop_writefull":1,"osdop_writesame":0,"osdop_append":0,"osdop_zero":1,"osdop_truncate":0,"osdop_delete":5,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":14,"osdop_setxattr":0,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":0,"map_full":0,"map_inc":0,"osd_sessions":8,"osd_session_open":8,"osd_session_close":0,"osd_laggy":0,"omap_wr":9,"omap_rd":28,"omap_del":3},"oft":{"omap_total_objs":2,"omap_total_kv_pairs":2,"omap_total_updates":2,"omap_total_removes":0},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":0,"pq_executing":0,"pq_executing_high_water":0,"pq_executed":0,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":0,"max":104857600,"get_started":0,"get":110,"get_sum":125517,"get_or_fail_fail":0,"get_or_fail_success":110,"take":0,"take_sum":0,"put":110,"put_sum":125517,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":42,"take_sum":6168,"put":42,"put_sum":6168,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":42,"take_sum":42,"put":42,"put_sum":42,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":0,"take_sum":0,"put":0,"put_sum":0,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x55d33e7a4000":{"val":0,"max":3758096384,"get_started":0,"get":4,"get_sum":4268,"get_or_fail_fail":0,"get_or_fail_success":4,"take":0,"take_sum":0,"put":4,"put_sum":4268,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}}} 2023-10-06T03:03:25.063 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 3, "msgr_created_connections": 10, "msgr_handle_ack_lat": { "avgcount": 12, "avgtime": 9.26e-07, "sum": 1.1113e-05 }, "msgr_recv_bytes": 117083, "msgr_recv_messages": 77, "msgr_running_fast_dispatch_time": 0.002868854, "msgr_running_recv_time": 0.016146265, "msgr_running_send_time": 0.009616699, "msgr_running_total_time": 0.030393224, "msgr_send_bytes": 49382, "msgr_send_messages": 42, "msgr_send_messages_queue_lat": { "avgcount": 42, "avgtime": 0.000182842, "sum": 0.007679393 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 4, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 9933, "msgr_recv_messages": 21, "msgr_running_fast_dispatch_time": 0.000643523, "msgr_running_recv_time": 0.005214588, "msgr_running_send_time": 0.002883199, "msgr_running_total_time": 0.009331538, "msgr_send_bytes": 105549, "msgr_send_messages": 30, "msgr_send_messages_queue_lat": { "avgcount": 28, "avgtime": 0.000210689, "sum": 0.005899318 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 4, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 10773, "msgr_recv_messages": 16, "msgr_running_fast_dispatch_time": 0.000767528, "msgr_running_recv_time": 0.004861993, "msgr_running_send_time": 0.000973107, "msgr_running_total_time": 0.007012821, "msgr_send_bytes": 6198, "msgr_send_messages": 18, "msgr_send_messages_queue_lat": { "avgcount": 16, "avgtime": 0.00051344, "sum": 0.008215046 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 43, "avgtime": 0.000109823, "sum": 0.004722413 }, "queue_len": 0 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 4, "avgtime": 4.4433e-05, "sum": 0.000177735 }, "queue_len": 0 }, "mds": { "caps": 2, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 0, "ceph_cap_op_revoke": 0, "ceph_cap_op_trunc": 0, "dir_commit": 0, "dir_fetch": 12, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 0, "handle_client_caps": 1, "handle_client_caps_dirty": 1, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 11, "inodes_bottom": 11, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 11, "inodes_top": 0, "inodes_with_caps": 2, "load_cent": 139, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 1, "q": 0, "reply": 2, "reply_latency": { "avgcount": 2, "avgtime": 0.002666297, "sum": 0.005332595 }, "request": 4, "root_rbytes": 7, "root_rfiles": 1, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 4, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 4, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 0, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 0, "strays_enqueued": 0, "strays_migrated": 0, "strays_reintegrated": 0 }, "mds_log": { "ev": 6, "evadd": 4, "evex": 0, "evexd": 0, "evexg": 0, "evtrm": 0, "expos": 4194304, "jlat": { "avgcount": 4, "avgtime": 0.003848051, "sum": 0.015392207 }, "rdpos": 4195196, "replayed": 2, "seg": 1, "segadd": 0, "segex": 0, "segexd": 0, "segexg": 0, "segtrm": 0, "wrpos": 4199722 }, "mds_mem": { "cap": 2, "cap+": 2, "cap-": 0, "dir": 12, "dir+": 12, "dir-": 0, "dn": 11, "dn+": 11, "dn-": 0, "heap": 223456, "ino": 14, "ino+": 14, "ino-": 0, "rss": 41692 }, "mds_server": { "cap_acquisition_throttle": 0, "cap_revoke_eviction": 0, "dispatch_client_request": 3, "dispatch_server_request": 0, "handle_client_request": 4, "handle_client_session": 2, "handle_peer_request": 0, "req_create_latency": { "avgcount": 1, "avgtime": 0.005055413, "sum": 0.005055413 }, "req_getattr_latency": { "avgcount": 1, "avgtime": 0.000277182, "sum": 0.000277182 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_readdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "mds_sessions": { "average_load": 1, "avg_session_uptime": 938, "mdthresh_evicted": 0, "session_add": 1, "session_count": 1, "session_remove": 0, "sessions_open": 1, "sessions_stale": 0, "total_load": 1 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_Blob_bytes": 0, "bluestore_Blob_items": 0, "bluestore_Buffer_bytes": 0, "bluestore_Buffer_items": 0, "bluestore_Extent_bytes": 0, "bluestore_Extent_items": 0, "bluestore_SharedBlob_bytes": 0, "bluestore_SharedBlob_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 225511, "buffer_anon_items": 66, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "mds_co_bytes": 53911, "mds_co_items": 234, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 6336, "osdmap_items": 93, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "omap_del": 3, "omap_rd": 28, "omap_wr": 9, "op": 42, "op_active": 0, "op_laggy": 0, "op_pg": 0, "op_r": 26, "op_reply": 42, "op_resend": 0, "op_rmw": 0, "op_send": 42, "op_send_bytes": 5242, "op_w": 16, "oplen_avg": { "avgcount": 42, "sum": 75 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 8, "osd_sessions": 8, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 0, "osdop_delete": 5, "osdop_getxattr": 14, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 8, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 0, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 2, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 4, "osdop_writefull": 1, "osdop_writesame": 0, "osdop_zero": 1, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 2, "omap_total_objs": 2, "omap_total_removes": 0, "omap_total_updates": 2 }, "purge_queue": { "pq_executed": 0, "pq_executing": 0, "pq_executing_high_water": 0, "pq_executing_ops": 0, "pq_executing_ops_high_water": 0, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 110, "get_or_fail_fail": 0, "get_or_fail_success": 110, "get_started": 0, "get_sum": 125517, "max": 104857600, "put": 110, "put_sum": 125517, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 42, "put_sum": 6168, "take": 42, "take_sum": 6168, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 42, "put_sum": 42, "take": 42, "take_sum": 42, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 3758096384, "put": 0, "put_sum": 0, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x55d33e7a4000": { "get": 4, "get_or_fail_fail": 0, "get_or_fail_success": 4, "get_started": 0, "get_sum": 4268, "max": 3758096384, "put": 4, "put_sum": 4268, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } } } 2023-10-06T03:03:25.064 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120 retry_count=0)... 2023-10-06T03:03:30.065 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:03:30.231 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:30.229+0000 7f01188f0700 1 Processor -- start 2023-10-06T03:03:30.231 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:30.229+0000 7f01188f0700 1 -- start start 2023-10-06T03:03:30.234 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:30.229+0000 7f01188f0700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f01140c9fb0 0x7f01140c1530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:30.234 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:30.229+0000 7f01188f0700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01140cb0a0 con 0x7f011415d6a0 2023-10-06T03:03:30.234 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:30.229+0000 7f01188f0700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01140ca490 con 0x7f01140c6c20 2023-10-06T03:03:30.234 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:30.229+0000 7f01188f0700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01140ca770 con 0x7f01140c9fb0 2023-10-06T03:03:30.235 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:30.233+0000 7f011259c700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f011415d6a0 0x7f01140c6510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:35164/0 (socket says 172.21.15.57:35164) 2023-10-06T03:03:30.235 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:30.233+0000 7f011259c700 1 -- 172.21.15.57:0/3783930804 learned_addr learned my addr 172.21.15.57:0/3783930804 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:03:30.235 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:30.233+0000 7f0112d9d700 1 --2- 172.21.15.57:0/3783930804 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f01140c9fb0 0x7f01140c1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:30.235 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:30.233+0000 7f011159a700 1 -- 172.21.15.57:0/3783930804 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3341742546 0 0) 0x7f01140cb0a0 con 0x7f011415d6a0 2023-10-06T03:03:30.236 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:30.233+0000 7f011159a700 1 -- 172.21.15.57:0/3783930804 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00fc003570 con 0x7f011415d6a0 2023-10-06T03:03:30.237 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:30.233+0000 7f011159a700 1 -- 172.21.15.57:0/3783930804 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2256787020 0 0) 0x7f00fc003570 con 0x7f011415d6a0 2023-10-06T03:03:30.237 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:30.233+0000 7f011159a700 1 -- 172.21.15.57:0/3783930804 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f01140c9fb0 msgr2=0x7f01140c1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:03:30.237 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:30.233+0000 7f011159a700 1 --2- 172.21.15.57:0/3783930804 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f01140c9fb0 0x7f01140c1530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:30.237 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:30.233+0000 7f011159a700 1 -- 172.21.15.57:0/3783930804 >> v1:172.21.15.105:6789/0 conn(0x7f01140c6c20 legacy=0x7f01140c0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:30.237 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:30.233+0000 7f011159a700 1 -- 172.21.15.57:0/3783930804 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01140caa50 con 0x7f011415d6a0 2023-10-06T03:03:30.237 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:30.233+0000 7f011159a700 1 -- 172.21.15.57:0/3783930804 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2482400018 0 0) 0x7f01040015f0 con 0x7f011415d6a0 2023-10-06T03:03:30.238 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:30.233+0000 7f011159a700 1 -- 172.21.15.57:0/3783930804 >> v1:172.21.15.57:6789/0 conn(0x7f011415d6a0 legacy=0x7f01140c6510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:30.238 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:30.233+0000 7f011159a700 1 --2- 172.21.15.57:0/3783930804 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f00fc003a90 0x7f00fc003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:30.238 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:30.233+0000 7f011159a700 1 --2- 172.21.15.57:0/3783930804 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f01140c9fb0 0x7f00fc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:30.238 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:30.233+0000 7f011159a700 1 --2- 172.21.15.57:0/3783930804 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00fc004d50 0x7f00fc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:30.238 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:30.233+0000 7f011159a700 1 -- 172.21.15.57:0/3783930804 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01140ca770 con 0x7f00fc004d50 2023-10-06T03:03:30.238 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:30.233+0000 7f011159a700 1 -- 172.21.15.57:0/3783930804 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00fc00bb10 con 0x7f00fc003a90 2023-10-06T03:03:30.238 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:30.233+0000 7f011159a700 1 -- 172.21.15.57:0/3783930804 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00fc00bcd0 con 0x7f01140c9fb0 2023-10-06T03:03:30.238 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:30.233+0000 7f0112d9d700 1 --2- 172.21.15.57:0/3783930804 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00fc004d50 0x7f00fc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:30.238 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:30.233+0000 7f0111d9b700 1 --2- 172.21.15.57:0/3783930804 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f01140c9fb0 0x7f00fc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:30.238 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:30.233+0000 7f011259c700 1 --2- 172.21.15.57:0/3783930804 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f00fc003a90 0x7f00fc003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:30.239 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:30.233+0000 7f0111d9b700 1 -- 172.21.15.57:0/3783930804 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f00fc003a90 msgr2=0x7f00fc003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:03:30.240 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:30.233+0000 7f0111d9b700 1 --2- 172.21.15.57:0/3783930804 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f00fc003a90 0x7f00fc003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:30.240 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:30.233+0000 7f0111d9b700 1 -- 172.21.15.57:0/3783930804 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00fc004d50 msgr2=0x7f00fc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:03:30.240 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:30.233+0000 7f0111d9b700 1 --2- 172.21.15.57:0/3783930804 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00fc004d50 0x7f00fc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:30.240 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:30.233+0000 7f0111d9b700 1 -- 172.21.15.57:0/3783930804 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00fc003570 con 0x7f01140c9fb0 2023-10-06T03:03:30.240 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:30.233+0000 7f0112d9d700 1 --2- 172.21.15.57:0/3783930804 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00fc004d50 0x7f00fc0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:03:30.240 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:30.237+0000 7f0111d9b700 1 --2- 172.21.15.57:0/3783930804 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f01140c9fb0 0x7f00fc004810 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f01080019a0 tx=0x7f0108007d10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b4dd9e4b30132b0a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:03:30.240 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:30.237+0000 7f011159a700 1 -- 172.21.15.57:0/3783930804 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f010800c5d0 con 0x7f01140c9fb0 2023-10-06T03:03:30.240 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:30.237+0000 7f011159a700 1 -- 172.21.15.57:0/3783930804 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f010800c750 con 0x7f01140c9fb0 2023-10-06T03:03:30.240 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:30.237+0000 7f011159a700 1 -- 172.21.15.57:0/3783930804 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f010800cb10 con 0x7f01140c9fb0 2023-10-06T03:03:30.241 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:30.237+0000 7f01188f0700 1 -- 172.21.15.57:0/3783930804 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f01140c9fb0 msgr2=0x7f00fc004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:30.241 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:30.237+0000 7f01188f0700 1 --2- 172.21.15.57:0/3783930804 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f01140c9fb0 0x7f00fc004810 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f01080019a0 tx=0x7f0108007d10 comp rx=0 tx=0).stop 2023-10-06T03:03:30.241 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:30.237+0000 7f0112d9d700 1 -- 172.21.15.57:0/3783930804 reap_dead start 2023-10-06T03:03:30.241 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:30.237+0000 7f01188f0700 1 -- 172.21.15.57:0/3783930804 shutdown_connections 2023-10-06T03:03:30.242 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:30.237+0000 7f01188f0700 1 -- 172.21.15.57:0/3783930804 >> 172.21.15.57:0/3783930804 conn(0x7f01140cbed0 msgr2=0x7f01140cc2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:03:30.242 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:30.237+0000 7f01188f0700 1 -- 172.21.15.57:0/3783930804 shutdown_connections 2023-10-06T03:03:30.242 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:30.237+0000 7f01188f0700 1 -- 172.21.15.57:0/3783930804 wait complete. 2023-10-06T03:03:30.243 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:30.241+0000 7f01188f0700 1 Processor -- start 2023-10-06T03:03:30.243 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:30.241+0000 7f01188f0700 1 -- start start 2023-10-06T03:03:30.246 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:30.241+0000 7f01188f0700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01140c9fb0 0x7f011416e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:30.246 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:30.241+0000 7f01188f0700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f01140aec90 0x7f011415cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:30.246 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:30.241+0000 7f01188f0700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f01140b0f20 0x7f01140b1380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:30.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:30.241+0000 7f01188f0700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f011416ead0 con 0x7f01140c9fb0 2023-10-06T03:03:30.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:30.241+0000 7f01188f0700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01140b18c0 con 0x7f01140aec90 2023-10-06T03:03:30.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:30.241+0000 7f01188f0700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01140afd80 con 0x7f01140b0f20 2023-10-06T03:03:30.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:30.241+0000 7f011259c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01140c9fb0 0x7f011416e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:30.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:30.241+0000 7f011259c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01140c9fb0 0x7f011416e590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:53388/0 (socket says 172.21.15.57:53388) 2023-10-06T03:03:30.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:30.241+0000 7f011259c700 1 -- 172.21.15.57:0/2786810652 learned_addr learned my addr 172.21.15.57:0/2786810652 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:03:30.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:30.241+0000 7f0112d9d700 1 --2- 172.21.15.57:0/2786810652 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f01140b0f20 0x7f01140b1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:30.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:30.241+0000 7f0111d9b700 1 --2- 172.21.15.57:0/2786810652 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f01140aec90 0x7f011415cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:30.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:30.241+0000 7f011259c700 1 -- 172.21.15.57:0/2786810652 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f01140b0f20 msgr2=0x7f01140b1380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:30.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:30.241+0000 7f011259c700 1 --2- 172.21.15.57:0/2786810652 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f01140b0f20 0x7f01140b1380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:30.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:30.241+0000 7f011259c700 1 -- 172.21.15.57:0/2786810652 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f01140aec90 msgr2=0x7f011415cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:30.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:30.241+0000 7f011259c700 1 --2- 172.21.15.57:0/2786810652 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f01140aec90 0x7f011415cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:30.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:30.241+0000 7f011259c700 1 -- 172.21.15.57:0/2786810652 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f011415d0b0 con 0x7f01140c9fb0 2023-10-06T03:03:30.248 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:30.245+0000 7f011259c700 1 --2- 172.21.15.57:0/2786810652 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01140c9fb0 0x7f011416e590 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f010400fbe0 tx=0x7f0104009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:03:30.248 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:30.245+0000 7f01027fc700 1 -- 172.21.15.57:0/2786810652 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01040072e0 con 0x7f01140c9fb0 2023-10-06T03:03:30.248 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:30.245+0000 7f01027fc700 1 -- 172.21.15.57:0/2786810652 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0104007460 con 0x7f01140c9fb0 2023-10-06T03:03:30.248 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:30.245+0000 7f01188f0700 1 -- 172.21.15.57:0/2786810652 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01140b0210 con 0x7f01140c9fb0 2023-10-06T03:03:30.249 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:30.245+0000 7f01027fc700 1 -- 172.21.15.57:0/2786810652 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01040057f0 con 0x7f01140c9fb0 2023-10-06T03:03:30.249 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:30.245+0000 7f01188f0700 1 -- 172.21.15.57:0/2786810652 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01140af170 con 0x7f01140c9fb0 2023-10-06T03:03:30.249 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:30.245+0000 7f01188f0700 1 -- 172.21.15.57:0/2786810652 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f011406b970 con 0x7f01140c9fb0 2023-10-06T03:03:30.250 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:30.245+0000 7f01027fc700 1 -- 172.21.15.57:0/2786810652 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f0104005b60 con 0x7f01140c9fb0 2023-10-06T03:03:30.252 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:30.249+0000 7f01027fc700 1 --2- 172.21.15.57:0/2786810652 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f00f4060550 0x7f00f4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:30.253 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:30.249+0000 7f01027fc700 1 -- 172.21.15.57:0/2786810652 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6144+0+0 (secure 0 0 0) 0x7f010407cb60 con 0x7f01140c9fb0 2023-10-06T03:03:30.253 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:30.249+0000 7f0111d9b700 1 --2- 172.21.15.57:0/2786810652 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f00f4060550 0x7f00f4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:30.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:30.249+0000 7f0111d9b700 1 --2- 172.21.15.57:0/2786810652 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f00f4060550 0x7f00f4062a00 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f01140af0a0 tx=0x7f0108015000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:03:30.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:30.257+0000 7f01027fc700 1 -- 172.21.15.57:0/2786810652 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f010404cf20 con 0x7f01140c9fb0 2023-10-06T03:03:30.468 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:30.465+0000 7f01188f0700 1 -- 172.21.15.57:0/2786810652 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f01140cad30 con 0x7f01140c9fb0 2023-10-06T03:03:30.469 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:30.465+0000 7f01027fc700 1 -- 172.21.15.57:0/2786810652 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4598 (secure 0 0 0) 0x7f0104050540 con 0x7f01140c9fb0 2023-10-06T03:03:30.469 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:03:30.469 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":38,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5222,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/879829980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":879829980},{"type":"v1","addr":"172.21.15.105:6833","nonce":879829980}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5225,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/3705921279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":3705921279},{"type":"v1","addr":"172.21.15.105:6835","nonce":3705921279}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/251759282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":251759282},{"type":"v1","addr":"172.21.15.57:6835","nonce":251759282}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:02:39.274111+0000","modified":"2023-10-06T03:02:56.856783+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":54,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5643},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5643":{"gid":5643,"name":"c","rank":0,"incarnation":34,"state":"up:active","state_seq":5,"addr":"172.21.15.57:6837/3347844181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6836","nonce":3347844181},{"type":"v1","addr":"172.21.15.57:6837","nonce":3347844181}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T03:03:30.471 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:30.469+0000 7f01188f0700 1 -- 172.21.15.57:0/2786810652 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f00f4060550 msgr2=0x7f00f4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:30.471 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:30.469+0000 7f01188f0700 1 --2- 172.21.15.57:0/2786810652 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f00f4060550 0x7f00f4062a00 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f01140af0a0 tx=0x7f0108015000 comp rx=0 tx=0).stop 2023-10-06T03:03:30.471 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:30.469+0000 7f01188f0700 1 -- 172.21.15.57:0/2786810652 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01140c9fb0 msgr2=0x7f011416e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:30.472 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:30.469+0000 7f01188f0700 1 --2- 172.21.15.57:0/2786810652 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01140c9fb0 0x7f011416e590 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f010400fbe0 tx=0x7f0104009040 comp rx=0 tx=0).stop 2023-10-06T03:03:30.472 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:30.469+0000 7f01188f0700 1 -- 172.21.15.57:0/2786810652 shutdown_connections 2023-10-06T03:03:30.472 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:30.469+0000 7f01188f0700 1 --2- 172.21.15.57:0/2786810652 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f00f4060550 0x7f00f4062a00 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:30.473 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:30.469+0000 7f01188f0700 1 --2- 172.21.15.57:0/2786810652 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f01140b0f20 0x7f01140b1380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:30.473 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:30.469+0000 7f01188f0700 1 --2- 172.21.15.57:0/2786810652 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f01140aec90 0x7f011415cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:30.473 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:30.469+0000 7f01188f0700 1 --2- 172.21.15.57:0/2786810652 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01140c9fb0 0x7f011416e590 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:30.473 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:30.469+0000 7f01188f0700 1 -- 172.21.15.57:0/2786810652 >> 172.21.15.57:0/2786810652 conn(0x7f01140cbed0 msgr2=0x7f011406a5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:03:30.473 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:30.469+0000 7f01188f0700 1 -- 172.21.15.57:0/2786810652 shutdown_connections 2023-10-06T03:03:30.473 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:30.469+0000 7f01188f0700 1 -- 172.21.15.57:0/2786810652 wait complete. 2023-10-06T03:03:30.474 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 38 2023-10-06T03:03:30.494 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json perf dump 2023-10-06T03:03:30.671 INFO:teuthology.orchestra.run.smithi057.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":84,"msgr_send_messages":43,"msgr_recv_bytes":119767,"msgr_send_bytes":49974,"msgr_created_connections":10,"msgr_active_connections":3,"msgr_running_total_time":0.032580189,"msgr_running_send_time":0.010771910,"msgr_running_recv_time":0.016598378,"msgr_running_fast_dispatch_time":0.003367111,"msgr_send_messages_queue_lat":{"avgcount":43,"sum":0.007729250,"avgtime":0.000179750},"msgr_handle_ack_lat":{"avgcount":12,"sum":0.000011113,"avgtime":0.000000926}},"AsyncMessenger::Worker-1":{"msgr_recv_messages":21,"msgr_send_messages":31,"msgr_recv_bytes":9933,"msgr_send_bytes":107277,"msgr_created_connections":6,"msgr_active_connections":4,"msgr_running_total_time":0.009486206,"msgr_running_send_time":0.003013514,"msgr_running_recv_time":0.005214588,"msgr_running_fast_dispatch_time":0.000643523,"msgr_send_messages_queue_lat":{"avgcount":29,"sum":0.006007761,"avgtime":0.000207164},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"AsyncMessenger::Worker-2":{"msgr_recv_messages":16,"msgr_send_messages":18,"msgr_recv_bytes":10773,"msgr_send_bytes":6198,"msgr_created_connections":6,"msgr_active_connections":4,"msgr_running_total_time":0.007012821,"msgr_running_send_time":0.000973107,"msgr_running_recv_time":0.004861993,"msgr_running_fast_dispatch_time":0.000767528,"msgr_send_messages_queue_lat":{"avgcount":16,"sum":0.008215046,"avgtime":0.000513440},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":0,"complete_latency":{"avgcount":43,"sum":0.004722413,"avgtime":0.000109823}},"finisher-PurgeQueue":{"queue_len":0,"complete_latency":{"avgcount":4,"sum":0.000177735,"avgtime":0.000044433}},"mds":{"request":4,"reply":2,"reply_latency":{"avgcount":2,"sum":0.005332595,"avgtime":0.002666297},"slow_reply":0,"forward":0,"dir_fetch":12,"dir_commit":0,"dir_split":0,"dir_merge":0,"inodes":11,"inodes_top":0,"inodes_bottom":11,"inodes_pin_tail":0,"inodes_pinned":11,"inodes_expired":0,"inodes_with_caps":2,"caps":2,"subtrees":2,"traverse":4,"traverse_hit":4,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":15,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":1,"root_rbytes":7,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":0,"ceph_cap_op_grant":0,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":1,"handle_client_caps_dirty":1,"handle_client_cap_release":0,"process_request_cap_release":1},"mds_cache":{"num_strays":0,"num_strays_delayed":0,"num_strays_enqueuing":0,"strays_created":0,"strays_enqueued":0,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0},"mds_log":{"evadd":4,"evex":0,"evtrm":0,"ev":6,"evexg":0,"evexd":0,"segadd":0,"segex":0,"segtrm":0,"seg":1,"segexg":0,"segexd":0,"expos":4194304,"wrpos":4199722,"rdpos":4195196,"jlat":{"avgcount":4,"sum":0.015392207,"avgtime":0.003848051},"replayed":2},"mds_mem":{"ino":14,"ino+":14,"ino-":0,"dir":12,"dir+":12,"dir-":0,"dn":11,"dn+":11,"dn-":0,"cap":2,"cap+":2,"cap-":0,"rss":41948,"heap":223456},"mds_server":{"dispatch_client_request":3,"dispatch_server_request":0,"handle_client_request":4,"handle_client_session":2,"handle_peer_request":0,"req_create_latency":{"avgcount":1,"sum":0.005055413,"avgtime":0.005055413},"req_getattr_latency":{"avgcount":1,"sum":0.000277182,"avgtime":0.000277182},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_readdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"cap_revoke_eviction":0,"cap_acquisition_throttle":0,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":1,"session_add":1,"session_remove":0,"sessions_open":1,"sessions_stale":0,"total_load":1,"average_load":1,"avg_session_uptime":943,"mdthresh_evicted":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_Buffer_bytes":0,"bluestore_Buffer_items":0,"bluestore_Extent_bytes":0,"bluestore_Extent_items":0,"bluestore_Blob_bytes":0,"bluestore_Blob_items":0,"bluestore_SharedBlob_bytes":0,"bluestore_SharedBlob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":225511,"buffer_anon_items":66,"buffer_meta_bytes":0,"buffer_meta_items":0,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":6336,"osdmap_items":93,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":53911,"mds_co_items":234,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":42,"op_send_bytes":5242,"op_resend":0,"op_reply":42,"oplen_avg":{"avgcount":42,"sum":75},"op":42,"op_r":26,"op_w":16,"op_rmw":0,"op_pg":0,"osdop_stat":2,"osdop_create":0,"osdop_read":8,"osdop_write":4,"osdop_writefull":1,"osdop_writesame":0,"osdop_append":0,"osdop_zero":1,"osdop_truncate":0,"osdop_delete":5,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":14,"osdop_setxattr":0,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":0,"map_full":0,"map_inc":0,"osd_sessions":8,"osd_session_open":8,"osd_session_close":0,"osd_laggy":0,"omap_wr":9,"omap_rd":28,"omap_del":3},"oft":{"omap_total_objs":2,"omap_total_kv_pairs":2,"omap_total_updates":2,"omap_total_removes":0},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":0,"pq_executing":0,"pq_executing_high_water":0,"pq_executed":0,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":0,"max":104857600,"get_started":0,"get":117,"get_sum":127615,"get_or_fail_fail":0,"get_or_fail_success":117,"take":0,"take_sum":0,"put":117,"put_sum":127615,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":42,"take_sum":6168,"put":42,"put_sum":6168,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":42,"take_sum":42,"put":42,"put_sum":42,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":0,"take_sum":0,"put":0,"put_sum":0,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x55d33e7a4000":{"val":0,"max":3758096384,"get_started":0,"get":4,"get_sum":4268,"get_or_fail_fail":0,"get_or_fail_success":4,"take":0,"take_sum":0,"put":4,"put_sum":4268,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}}} 2023-10-06T03:03:30.672 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 3, "msgr_created_connections": 10, "msgr_handle_ack_lat": { "avgcount": 12, "avgtime": 9.26e-07, "sum": 1.1113e-05 }, "msgr_recv_bytes": 119767, "msgr_recv_messages": 84, "msgr_running_fast_dispatch_time": 0.003367111, "msgr_running_recv_time": 0.016598378, "msgr_running_send_time": 0.01077191, "msgr_running_total_time": 0.032580189, "msgr_send_bytes": 49974, "msgr_send_messages": 43, "msgr_send_messages_queue_lat": { "avgcount": 43, "avgtime": 0.00017975, "sum": 0.00772925 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 4, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 9933, "msgr_recv_messages": 21, "msgr_running_fast_dispatch_time": 0.000643523, "msgr_running_recv_time": 0.005214588, "msgr_running_send_time": 0.003013514, "msgr_running_total_time": 0.009486206, "msgr_send_bytes": 107277, "msgr_send_messages": 31, "msgr_send_messages_queue_lat": { "avgcount": 29, "avgtime": 0.000207164, "sum": 0.006007761 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 4, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 10773, "msgr_recv_messages": 16, "msgr_running_fast_dispatch_time": 0.000767528, "msgr_running_recv_time": 0.004861993, "msgr_running_send_time": 0.000973107, "msgr_running_total_time": 0.007012821, "msgr_send_bytes": 6198, "msgr_send_messages": 18, "msgr_send_messages_queue_lat": { "avgcount": 16, "avgtime": 0.00051344, "sum": 0.008215046 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 43, "avgtime": 0.000109823, "sum": 0.004722413 }, "queue_len": 0 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 4, "avgtime": 4.4433e-05, "sum": 0.000177735 }, "queue_len": 0 }, "mds": { "caps": 2, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 0, "ceph_cap_op_revoke": 0, "ceph_cap_op_trunc": 0, "dir_commit": 0, "dir_fetch": 12, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 0, "handle_client_caps": 1, "handle_client_caps_dirty": 1, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 11, "inodes_bottom": 11, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 11, "inodes_top": 0, "inodes_with_caps": 2, "load_cent": 15, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 1, "q": 0, "reply": 2, "reply_latency": { "avgcount": 2, "avgtime": 0.002666297, "sum": 0.005332595 }, "request": 4, "root_rbytes": 7, "root_rfiles": 1, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 4, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 4, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 0, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 0, "strays_enqueued": 0, "strays_migrated": 0, "strays_reintegrated": 0 }, "mds_log": { "ev": 6, "evadd": 4, "evex": 0, "evexd": 0, "evexg": 0, "evtrm": 0, "expos": 4194304, "jlat": { "avgcount": 4, "avgtime": 0.003848051, "sum": 0.015392207 }, "rdpos": 4195196, "replayed": 2, "seg": 1, "segadd": 0, "segex": 0, "segexd": 0, "segexg": 0, "segtrm": 0, "wrpos": 4199722 }, "mds_mem": { "cap": 2, "cap+": 2, "cap-": 0, "dir": 12, "dir+": 12, "dir-": 0, "dn": 11, "dn+": 11, "dn-": 0, "heap": 223456, "ino": 14, "ino+": 14, "ino-": 0, "rss": 41948 }, "mds_server": { "cap_acquisition_throttle": 0, "cap_revoke_eviction": 0, "dispatch_client_request": 3, "dispatch_server_request": 0, "handle_client_request": 4, "handle_client_session": 2, "handle_peer_request": 0, "req_create_latency": { "avgcount": 1, "avgtime": 0.005055413, "sum": 0.005055413 }, "req_getattr_latency": { "avgcount": 1, "avgtime": 0.000277182, "sum": 0.000277182 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_readdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "mds_sessions": { "average_load": 1, "avg_session_uptime": 943, "mdthresh_evicted": 0, "session_add": 1, "session_count": 1, "session_remove": 0, "sessions_open": 1, "sessions_stale": 0, "total_load": 1 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_Blob_bytes": 0, "bluestore_Blob_items": 0, "bluestore_Buffer_bytes": 0, "bluestore_Buffer_items": 0, "bluestore_Extent_bytes": 0, "bluestore_Extent_items": 0, "bluestore_SharedBlob_bytes": 0, "bluestore_SharedBlob_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 225511, "buffer_anon_items": 66, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "mds_co_bytes": 53911, "mds_co_items": 234, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 6336, "osdmap_items": 93, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "omap_del": 3, "omap_rd": 28, "omap_wr": 9, "op": 42, "op_active": 0, "op_laggy": 0, "op_pg": 0, "op_r": 26, "op_reply": 42, "op_resend": 0, "op_rmw": 0, "op_send": 42, "op_send_bytes": 5242, "op_w": 16, "oplen_avg": { "avgcount": 42, "sum": 75 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 8, "osd_sessions": 8, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 0, "osdop_delete": 5, "osdop_getxattr": 14, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 8, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 0, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 2, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 4, "osdop_writefull": 1, "osdop_writesame": 0, "osdop_zero": 1, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 2, "omap_total_objs": 2, "omap_total_removes": 0, "omap_total_updates": 2 }, "purge_queue": { "pq_executed": 0, "pq_executing": 0, "pq_executing_high_water": 0, "pq_executing_ops": 0, "pq_executing_ops_high_water": 0, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 117, "get_or_fail_fail": 0, "get_or_fail_success": 117, "get_started": 0, "get_sum": 127615, "max": 104857600, "put": 117, "put_sum": 127615, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 42, "put_sum": 6168, "take": 42, "take_sum": 6168, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 42, "put_sum": 42, "take": 42, "take_sum": 42, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 3758096384, "put": 0, "put_sum": 0, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x55d33e7a4000": { "get": 4, "get_or_fail_fail": 0, "get_or_fail_success": 4, "get_started": 0, "get_sum": 4268, "max": 3758096384, "put": 4, "put_sum": 4268, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } } } 2023-10-06T03:03:30.673 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120 retry_count=0)... 2023-10-06T03:03:35.674 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:03:35.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:35.833+0000 7f341759e700 1 Processor -- start 2023-10-06T03:03:35.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:35.833+0000 7f341759e700 1 -- start start 2023-10-06T03:03:35.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:35.837+0000 7f341759e700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f3418153890 0x7f34180c7100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:35.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:35.837+0000 7f341759e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f34180c7a20 0x7f34180c7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:35.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:35.837+0000 7f341759e700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34180c6c70 con 0x7f34181534c0 2023-10-06T03:03:35.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:35.837+0000 7f341759e700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34180c7640 con 0x7f3418153890 2023-10-06T03:03:35.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:35.837+0000 7f341759e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34180c83e0 con 0x7f34180c7a20 2023-10-06T03:03:35.841 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:35.837+0000 7f3415d9b700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f3418153890 0x7f34180c7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:35.841 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:35.837+0000 7f3415d9b700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f3418153890 0x7f34180c7100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.57:35516/0 (socket says 172.21.15.57:35516) 2023-10-06T03:03:35.841 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:35.837+0000 7f3415d9b700 1 -- 172.21.15.57:0/1813336646 learned_addr learned my addr 172.21.15.57:0/1813336646 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:03:35.841 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:35.837+0000 7f3416d9d700 1 --2- 172.21.15.57:0/1813336646 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f34180c7a20 0x7f34180c7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:35.841 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:35.837+0000 7f3416d9d700 1 -- 172.21.15.57:0/1813336646 >> v2:172.21.15.105:3300/0 conn(0x7f3418153890 msgr2=0x7f34180c7100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:03:35.841 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:35.837+0000 7f3416d9d700 1 --2- 172.21.15.57:0/1813336646 >> v2:172.21.15.105:3300/0 conn(0x7f3418153890 0x7f34180c7100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:35.841 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:35.837+0000 7f3416d9d700 1 -- 172.21.15.57:0/1813336646 >> v1:172.21.15.105:6789/0 conn(0x7f34181534c0 legacy=0x7f34180c9ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:35.842 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:35.837+0000 7f3416d9d700 1 -- 172.21.15.57:0/1813336646 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f341815a740 con 0x7f34180c7a20 2023-10-06T03:03:35.842 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:35.837+0000 7f3416d9d700 1 --2- 172.21.15.57:0/1813336646 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f34180c7a20 0x7f34180c7ea0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3410009e60 tx=0x7f3410009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f7b64f5965518c99 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:03:35.842 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:35.837+0000 7f341559a700 1 -- 172.21.15.57:0/1813336646 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f341000e070 con 0x7f34180c7a20 2023-10-06T03:03:35.843 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:35.841+0000 7f341559a700 1 -- 172.21.15.57:0/1813336646 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f341000bb60 con 0x7f34180c7a20 2023-10-06T03:03:35.843 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:35.841+0000 7f341559a700 1 -- 172.21.15.57:0/1813336646 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3410012430 con 0x7f34180c7a20 2023-10-06T03:03:35.843 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:35.841+0000 7f341759e700 1 -- 172.21.15.57:0/1813336646 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f34180c7a20 msgr2=0x7f34180c7ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:35.843 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:35.841+0000 7f341759e700 1 --2- 172.21.15.57:0/1813336646 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f34180c7a20 0x7f34180c7ea0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3410009e60 tx=0x7f3410009780 comp rx=0 tx=0).stop 2023-10-06T03:03:35.844 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:35.841+0000 7f341759e700 1 -- 172.21.15.57:0/1813336646 shutdown_connections 2023-10-06T03:03:35.844 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:35.841+0000 7f341759e700 1 --2- 172.21.15.57:0/1813336646 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f34180c7a20 0x7f34180c7ea0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:35.844 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:35.841+0000 7f341759e700 1 --2- 172.21.15.57:0/1813336646 >> v2:172.21.15.105:3300/0 conn(0x7f3418153890 0x7f34180c7100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:35.844 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:35.841+0000 7f341759e700 1 -- 172.21.15.57:0/1813336646 >> 172.21.15.57:0/1813336646 conn(0x7f3418067b00 msgr2=0x7f34180cbd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:03:35.844 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:35.841+0000 7f341759e700 1 -- 172.21.15.57:0/1813336646 shutdown_connections 2023-10-06T03:03:35.844 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:35.841+0000 7f341759e700 1 -- 172.21.15.57:0/1813336646 wait complete. 2023-10-06T03:03:35.846 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:35.841+0000 7f341759e700 1 Processor -- start 2023-10-06T03:03:35.846 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:35.841+0000 7f341759e700 1 -- start start 2023-10-06T03:03:35.847 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:35.845+0000 7f341759e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f34180c7a20 0x7f3418143fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:35.847 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:35.845+0000 7f341759e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f34181534c0 0x7f34180aeaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:35.847 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:35.845+0000 7f341759e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3418153890 0x7f34180aefe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:35.848 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:35.845+0000 7f341759e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34180c3580 con 0x7f34181534c0 2023-10-06T03:03:35.848 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:35.845+0000 7f341759e700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34180c4100 con 0x7f3418153890 2023-10-06T03:03:35.848 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:35.845+0000 7f341759e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34180c37d0 con 0x7f34180c7a20 2023-10-06T03:03:35.850 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:35.845+0000 7f3415d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f34181534c0 0x7f34180aeaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:35.851 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:35.845+0000 7f3415d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f34181534c0 0x7f34180aeaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:50754/0 (socket says 172.21.15.57:50754) 2023-10-06T03:03:35.851 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:35.845+0000 7f3415d9b700 1 -- 172.21.15.57:0/2298701729 learned_addr learned my addr 172.21.15.57:0/2298701729 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:03:35.851 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:35.845+0000 7f3416d9d700 1 --2- 172.21.15.57:0/2298701729 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3418153890 0x7f34180aefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:35.851 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:35.845+0000 7f341659c700 1 --2- 172.21.15.57:0/2298701729 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f34180c7a20 0x7f3418143fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:35.851 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:35.845+0000 7f3415d9b700 1 -- 172.21.15.57:0/2298701729 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f34180c7a20 msgr2=0x7f3418143fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:35.851 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:35.845+0000 7f3415d9b700 1 --2- 172.21.15.57:0/2298701729 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f34180c7a20 0x7f3418143fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:35.851 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:35.845+0000 7f3415d9b700 1 -- 172.21.15.57:0/2298701729 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3418153890 msgr2=0x7f34180aefe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:35.852 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:35.845+0000 7f3415d9b700 1 --2- 172.21.15.57:0/2298701729 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3418153890 0x7f34180aefe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:35.852 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:35.845+0000 7f3415d9b700 1 -- 172.21.15.57:0/2298701729 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3410009a20 con 0x7f34181534c0 2023-10-06T03:03:35.852 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:35.845+0000 7f3416d9d700 1 --2- 172.21.15.57:0/2298701729 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3418153890 0x7f34180aefe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:03:35.852 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:35.845+0000 7f3415d9b700 1 --2- 172.21.15.57:0/2298701729 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f34181534c0 0x7f34180aeaa0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f340c00ea80 tx=0x7f340c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:03:35.852 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:35.845+0000 7f34067fc700 1 -- 172.21.15.57:0/2298701729 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f340c00c850 con 0x7f34181534c0 2023-10-06T03:03:35.852 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:35.845+0000 7f34067fc700 1 -- 172.21.15.57:0/2298701729 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f340c00c9b0 con 0x7f34181534c0 2023-10-06T03:03:35.852 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:35.845+0000 7f34067fc700 1 -- 172.21.15.57:0/2298701729 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f340c00cd30 con 0x7f34181534c0 2023-10-06T03:03:35.852 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:35.845+0000 7f341759e700 1 -- 172.21.15.57:0/2298701729 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34180c3ab0 con 0x7f34181534c0 2023-10-06T03:03:35.853 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:35.845+0000 7f341759e700 1 -- 172.21.15.57:0/2298701729 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34181444e0 con 0x7f34181534c0 2023-10-06T03:03:35.853 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:35.849+0000 7f341759e700 1 -- 172.21.15.57:0/2298701729 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34180c4290 con 0x7f34181534c0 2023-10-06T03:03:35.853 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:35.849+0000 7f34067fc700 1 -- 172.21.15.57:0/2298701729 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f340c013680 con 0x7f34181534c0 2023-10-06T03:03:35.855 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:35.853+0000 7f34067fc700 1 --2- 172.21.15.57:0/2298701729 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f33f8060550 0x7f33f8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:35.855 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:35.853+0000 7f34067fc700 1 -- 172.21.15.57:0/2298701729 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6144+0+0 (secure 0 0 0) 0x7f340c07cca0 con 0x7f34181534c0 2023-10-06T03:03:35.855 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:35.853+0000 7f341659c700 1 --2- 172.21.15.57:0/2298701729 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f33f8060550 0x7f33f8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:35.856 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:35.853+0000 7f341659c700 1 --2- 172.21.15.57:0/2298701729 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f33f8060550 0x7f33f8062a00 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f3408003860 tx=0x7f3408009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:03:35.861 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:35.857+0000 7f34067fc700 1 -- 172.21.15.57:0/2298701729 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f340c04d060 con 0x7f34181534c0 2023-10-06T03:03:36.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:36.069+0000 7f341759e700 1 -- 172.21.15.57:0/2298701729 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f34180c3f30 con 0x7f34181534c0 2023-10-06T03:03:36.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:36.069+0000 7f34067fc700 1 -- 172.21.15.57:0/2298701729 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4598 (secure 0 0 0) 0x7f340c050680 con 0x7f34181534c0 2023-10-06T03:03:36.074 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:03:36.074 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":38,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5222,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/879829980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":879829980},{"type":"v1","addr":"172.21.15.105:6833","nonce":879829980}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5225,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/3705921279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":3705921279},{"type":"v1","addr":"172.21.15.105:6835","nonce":3705921279}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/251759282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":251759282},{"type":"v1","addr":"172.21.15.57:6835","nonce":251759282}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:02:39.274111+0000","modified":"2023-10-06T03:02:56.856783+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":54,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5643},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5643":{"gid":5643,"name":"c","rank":0,"incarnation":34,"state":"up:active","state_seq":5,"addr":"172.21.15.57:6837/3347844181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6836","nonce":3347844181},{"type":"v1","addr":"172.21.15.57:6837","nonce":3347844181}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T03:03:36.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:36.073+0000 7f341759e700 1 -- 172.21.15.57:0/2298701729 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f33f8060550 msgr2=0x7f33f8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:36.079 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:36.073+0000 7f341759e700 1 --2- 172.21.15.57:0/2298701729 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f33f8060550 0x7f33f8062a00 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f3408003860 tx=0x7f3408009040 comp rx=0 tx=0).stop 2023-10-06T03:03:36.079 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:36.073+0000 7f341759e700 1 -- 172.21.15.57:0/2298701729 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f34181534c0 msgr2=0x7f34180aeaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:36.079 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:36.073+0000 7f341759e700 1 --2- 172.21.15.57:0/2298701729 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f34181534c0 0x7f34180aeaa0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f340c00ea80 tx=0x7f340c009250 comp rx=0 tx=0).stop 2023-10-06T03:03:36.079 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:36.073+0000 7f341759e700 1 -- 172.21.15.57:0/2298701729 shutdown_connections 2023-10-06T03:03:36.079 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:36.073+0000 7f341759e700 1 --2- 172.21.15.57:0/2298701729 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3418153890 0x7f34180aefe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:36.079 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:36.073+0000 7f341759e700 1 --2- 172.21.15.57:0/2298701729 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f34181534c0 0x7f34180aeaa0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:36.079 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:36.073+0000 7f341759e700 1 --2- 172.21.15.57:0/2298701729 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f33f8060550 0x7f33f8062a00 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:36.080 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:36.073+0000 7f341759e700 1 --2- 172.21.15.57:0/2298701729 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f34180c7a20 0x7f3418143fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:36.080 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:36.073+0000 7f341759e700 1 -- 172.21.15.57:0/2298701729 >> 172.21.15.57:0/2298701729 conn(0x7f3418067b00 msgr2=0x7f3418069b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:03:36.080 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:36.073+0000 7f341759e700 1 -- 172.21.15.57:0/2298701729 shutdown_connections 2023-10-06T03:03:36.080 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:36.077+0000 7f341759e700 1 -- 172.21.15.57:0/2298701729 wait complete. 2023-10-06T03:03:36.081 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 38 2023-10-06T03:03:36.097 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json perf dump 2023-10-06T03:03:36.268 INFO:teuthology.orchestra.run.smithi057.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":91,"msgr_send_messages":45,"msgr_recv_bytes":122321,"msgr_send_bytes":51158,"msgr_created_connections":10,"msgr_active_connections":3,"msgr_running_total_time":0.034845199,"msgr_running_send_time":0.011969154,"msgr_running_recv_time":0.017083565,"msgr_running_fast_dispatch_time":0.003850759,"msgr_send_messages_queue_lat":{"avgcount":45,"sum":0.007879871,"avgtime":0.000175108},"msgr_handle_ack_lat":{"avgcount":12,"sum":0.000011113,"avgtime":0.000000926}},"AsyncMessenger::Worker-1":{"msgr_recv_messages":21,"msgr_send_messages":32,"msgr_recv_bytes":9933,"msgr_send_bytes":109005,"msgr_created_connections":6,"msgr_active_connections":4,"msgr_running_total_time":0.009643744,"msgr_running_send_time":0.003147039,"msgr_running_recv_time":0.005214588,"msgr_running_fast_dispatch_time":0.000643523,"msgr_send_messages_queue_lat":{"avgcount":30,"sum":0.006124117,"avgtime":0.000204137},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"AsyncMessenger::Worker-2":{"msgr_recv_messages":16,"msgr_send_messages":18,"msgr_recv_bytes":10773,"msgr_send_bytes":6198,"msgr_created_connections":6,"msgr_active_connections":4,"msgr_running_total_time":0.007013147,"msgr_running_send_time":0.000973107,"msgr_running_recv_time":0.004861993,"msgr_running_fast_dispatch_time":0.000767528,"msgr_send_messages_queue_lat":{"avgcount":16,"sum":0.008215046,"avgtime":0.000513440},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":0,"complete_latency":{"avgcount":43,"sum":0.004722413,"avgtime":0.000109823}},"finisher-PurgeQueue":{"queue_len":0,"complete_latency":{"avgcount":4,"sum":0.000177735,"avgtime":0.000044433}},"mds":{"request":4,"reply":2,"reply_latency":{"avgcount":2,"sum":0.005332595,"avgtime":0.002666297},"slow_reply":0,"forward":0,"dir_fetch":12,"dir_commit":0,"dir_split":0,"dir_merge":0,"inodes":11,"inodes_top":0,"inodes_bottom":11,"inodes_pin_tail":0,"inodes_pinned":11,"inodes_expired":0,"inodes_with_caps":2,"caps":2,"subtrees":2,"traverse":4,"traverse_hit":4,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":15,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":1,"root_rbytes":7,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":0,"ceph_cap_op_grant":0,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":1,"handle_client_caps_dirty":1,"handle_client_cap_release":0,"process_request_cap_release":1},"mds_cache":{"num_strays":0,"num_strays_delayed":0,"num_strays_enqueuing":0,"strays_created":0,"strays_enqueued":0,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0},"mds_log":{"evadd":4,"evex":0,"evtrm":0,"ev":6,"evexg":0,"evexd":0,"segadd":0,"segex":0,"segtrm":0,"seg":1,"segexg":0,"segexd":0,"expos":4194304,"wrpos":4199722,"rdpos":4195196,"jlat":{"avgcount":4,"sum":0.015392207,"avgtime":0.003848051},"replayed":2},"mds_mem":{"ino":14,"ino+":14,"ino-":0,"dir":12,"dir+":12,"dir-":0,"dn":11,"dn+":11,"dn-":0,"cap":2,"cap+":2,"cap-":0,"rss":42204,"heap":223456},"mds_server":{"dispatch_client_request":3,"dispatch_server_request":0,"handle_client_request":4,"handle_client_session":2,"handle_peer_request":0,"req_create_latency":{"avgcount":1,"sum":0.005055413,"avgtime":0.005055413},"req_getattr_latency":{"avgcount":1,"sum":0.000277182,"avgtime":0.000277182},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_readdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"cap_revoke_eviction":0,"cap_acquisition_throttle":0,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":1,"session_add":1,"session_remove":0,"sessions_open":1,"sessions_stale":0,"total_load":1,"average_load":1,"avg_session_uptime":948,"mdthresh_evicted":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_Buffer_bytes":0,"bluestore_Buffer_items":0,"bluestore_Extent_bytes":0,"bluestore_Extent_items":0,"bluestore_Blob_bytes":0,"bluestore_Blob_items":0,"bluestore_SharedBlob_bytes":0,"bluestore_SharedBlob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":225511,"buffer_anon_items":66,"buffer_meta_bytes":0,"buffer_meta_items":0,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":6336,"osdmap_items":93,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":53863,"mds_co_items":233,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":42,"op_send_bytes":5242,"op_resend":0,"op_reply":42,"oplen_avg":{"avgcount":42,"sum":75},"op":42,"op_r":26,"op_w":16,"op_rmw":0,"op_pg":0,"osdop_stat":2,"osdop_create":0,"osdop_read":8,"osdop_write":4,"osdop_writefull":1,"osdop_writesame":0,"osdop_append":0,"osdop_zero":1,"osdop_truncate":0,"osdop_delete":5,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":14,"osdop_setxattr":0,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":0,"map_full":0,"map_inc":0,"osd_sessions":8,"osd_session_open":8,"osd_session_close":0,"osd_laggy":0,"omap_wr":9,"omap_rd":28,"omap_del":3},"oft":{"omap_total_objs":2,"omap_total_kv_pairs":2,"omap_total_updates":2,"omap_total_removes":0},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":0,"pq_executing":0,"pq_executing_high_water":0,"pq_executed":0,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":0,"max":104857600,"get_started":0,"get":124,"get_sum":129515,"get_or_fail_fail":0,"get_or_fail_success":124,"take":0,"take_sum":0,"put":124,"put_sum":129515,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":42,"take_sum":6168,"put":42,"put_sum":6168,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":42,"take_sum":42,"put":42,"put_sum":42,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":0,"take_sum":0,"put":0,"put_sum":0,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x55d33e7a4000":{"val":0,"max":3758096384,"get_started":0,"get":4,"get_sum":4268,"get_or_fail_fail":0,"get_or_fail_success":4,"take":0,"take_sum":0,"put":4,"put_sum":4268,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}}} 2023-10-06T03:03:36.269 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 3, "msgr_created_connections": 10, "msgr_handle_ack_lat": { "avgcount": 12, "avgtime": 9.26e-07, "sum": 1.1113e-05 }, "msgr_recv_bytes": 122321, "msgr_recv_messages": 91, "msgr_running_fast_dispatch_time": 0.003850759, "msgr_running_recv_time": 0.017083565, "msgr_running_send_time": 0.011969154, "msgr_running_total_time": 0.034845199, "msgr_send_bytes": 51158, "msgr_send_messages": 45, "msgr_send_messages_queue_lat": { "avgcount": 45, "avgtime": 0.000175108, "sum": 0.007879871 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 4, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 9933, "msgr_recv_messages": 21, "msgr_running_fast_dispatch_time": 0.000643523, "msgr_running_recv_time": 0.005214588, "msgr_running_send_time": 0.003147039, "msgr_running_total_time": 0.009643744, "msgr_send_bytes": 109005, "msgr_send_messages": 32, "msgr_send_messages_queue_lat": { "avgcount": 30, "avgtime": 0.000204137, "sum": 0.006124117 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 4, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 10773, "msgr_recv_messages": 16, "msgr_running_fast_dispatch_time": 0.000767528, "msgr_running_recv_time": 0.004861993, "msgr_running_send_time": 0.000973107, "msgr_running_total_time": 0.007013147, "msgr_send_bytes": 6198, "msgr_send_messages": 18, "msgr_send_messages_queue_lat": { "avgcount": 16, "avgtime": 0.00051344, "sum": 0.008215046 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 43, "avgtime": 0.000109823, "sum": 0.004722413 }, "queue_len": 0 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 4, "avgtime": 4.4433e-05, "sum": 0.000177735 }, "queue_len": 0 }, "mds": { "caps": 2, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 0, "ceph_cap_op_revoke": 0, "ceph_cap_op_trunc": 0, "dir_commit": 0, "dir_fetch": 12, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 0, "handle_client_caps": 1, "handle_client_caps_dirty": 1, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 11, "inodes_bottom": 11, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 11, "inodes_top": 0, "inodes_with_caps": 2, "load_cent": 15, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 1, "q": 0, "reply": 2, "reply_latency": { "avgcount": 2, "avgtime": 0.002666297, "sum": 0.005332595 }, "request": 4, "root_rbytes": 7, "root_rfiles": 1, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 4, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 4, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 0, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 0, "strays_enqueued": 0, "strays_migrated": 0, "strays_reintegrated": 0 }, "mds_log": { "ev": 6, "evadd": 4, "evex": 0, "evexd": 0, "evexg": 0, "evtrm": 0, "expos": 4194304, "jlat": { "avgcount": 4, "avgtime": 0.003848051, "sum": 0.015392207 }, "rdpos": 4195196, "replayed": 2, "seg": 1, "segadd": 0, "segex": 0, "segexd": 0, "segexg": 0, "segtrm": 0, "wrpos": 4199722 }, "mds_mem": { "cap": 2, "cap+": 2, "cap-": 0, "dir": 12, "dir+": 12, "dir-": 0, "dn": 11, "dn+": 11, "dn-": 0, "heap": 223456, "ino": 14, "ino+": 14, "ino-": 0, "rss": 42204 }, "mds_server": { "cap_acquisition_throttle": 0, "cap_revoke_eviction": 0, "dispatch_client_request": 3, "dispatch_server_request": 0, "handle_client_request": 4, "handle_client_session": 2, "handle_peer_request": 0, "req_create_latency": { "avgcount": 1, "avgtime": 0.005055413, "sum": 0.005055413 }, "req_getattr_latency": { "avgcount": 1, "avgtime": 0.000277182, "sum": 0.000277182 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_readdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "mds_sessions": { "average_load": 1, "avg_session_uptime": 948, "mdthresh_evicted": 0, "session_add": 1, "session_count": 1, "session_remove": 0, "sessions_open": 1, "sessions_stale": 0, "total_load": 1 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_Blob_bytes": 0, "bluestore_Blob_items": 0, "bluestore_Buffer_bytes": 0, "bluestore_Buffer_items": 0, "bluestore_Extent_bytes": 0, "bluestore_Extent_items": 0, "bluestore_SharedBlob_bytes": 0, "bluestore_SharedBlob_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 225511, "buffer_anon_items": 66, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "mds_co_bytes": 53863, "mds_co_items": 233, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 6336, "osdmap_items": 93, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "omap_del": 3, "omap_rd": 28, "omap_wr": 9, "op": 42, "op_active": 0, "op_laggy": 0, "op_pg": 0, "op_r": 26, "op_reply": 42, "op_resend": 0, "op_rmw": 0, "op_send": 42, "op_send_bytes": 5242, "op_w": 16, "oplen_avg": { "avgcount": 42, "sum": 75 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 8, "osd_sessions": 8, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 0, "osdop_delete": 5, "osdop_getxattr": 14, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 8, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 0, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 2, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 4, "osdop_writefull": 1, "osdop_writesame": 0, "osdop_zero": 1, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 2, "omap_total_objs": 2, "omap_total_removes": 0, "omap_total_updates": 2 }, "purge_queue": { "pq_executed": 0, "pq_executing": 0, "pq_executing_high_water": 0, "pq_executing_ops": 0, "pq_executing_ops_high_water": 0, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 124, "get_or_fail_fail": 0, "get_or_fail_success": 124, "get_started": 0, "get_sum": 129515, "max": 104857600, "put": 124, "put_sum": 129515, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 42, "put_sum": 6168, "take": 42, "take_sum": 6168, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 42, "put_sum": 42, "take": 42, "take_sum": 42, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 3758096384, "put": 0, "put_sum": 0, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x55d33e7a4000": { "get": 4, "get_or_fail_fail": 0, "get_or_fail_success": 4, "get_started": 0, "get_sum": 4268, "max": 3758096384, "put": 4, "put_sum": 4268, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } } } 2023-10-06T03:03:36.270 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120 retry_count=0)... 2023-10-06T03:03:41.270 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:03:41.439 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:41.437+0000 7f858eae3700 1 Processor -- start 2023-10-06T03:03:41.439 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:41.437+0000 7f858eae3700 1 -- start start 2023-10-06T03:03:41.441 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:41.437+0000 7f858eae3700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f85880c9b00 0x7f85880c8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:41.441 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:41.437+0000 7f858eae3700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f8588161180 0x7f8588161600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:41.441 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:41.437+0000 7f858eae3700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85880cadb0 con 0x7f85880c9ed0 2023-10-06T03:03:41.441 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:41.437+0000 7f858eae3700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85880c6b00 con 0x7f8588161180 2023-10-06T03:03:41.441 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:41.437+0000 7f858eae3700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8588161b40 con 0x7f85880c9b00 2023-10-06T03:03:41.442 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:41.437+0000 7f858e2e2700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f8588161180 0x7f8588161600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:41.442 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:41.437+0000 7f858dae1700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f85880c9b00 0x7f85880c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:41.442 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:41.437+0000 7f858e2e2700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f8588161180 0x7f8588161600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.57:35548/0 (socket says 172.21.15.57:35548) 2023-10-06T03:03:41.442 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:41.437+0000 7f858e2e2700 1 -- 172.21.15.57:0/1081646999 learned_addr learned my addr 172.21.15.57:0/1081646999 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:03:41.442 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:41.437+0000 7f858dae1700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f85880c9b00 0x7f85880c8120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.57:53434/0 (socket says 172.21.15.57:53434) 2023-10-06T03:03:41.443 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:41.441+0000 7f858cadf700 1 -- 172.21.15.57:0/1081646999 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 111539222 0 0) 0x7f85880cadb0 con 0x7f85880c9ed0 2023-10-06T03:03:41.443 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:41.441+0000 7f858cadf700 1 -- 172.21.15.57:0/1081646999 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8574003570 con 0x7f85880c9ed0 2023-10-06T03:03:41.443 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:41.441+0000 7f858dae1700 1 -- 172.21.15.57:0/1081646999 >> v2:172.21.15.105:3300/0 conn(0x7f8588161180 msgr2=0x7f8588161600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:03:41.443 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:41.441+0000 7f858dae1700 1 --2- 172.21.15.57:0/1081646999 >> v2:172.21.15.105:3300/0 conn(0x7f8588161180 0x7f8588161600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:41.443 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:41.441+0000 7f858dae1700 1 -- 172.21.15.57:0/1081646999 >> v1:172.21.15.105:6789/0 conn(0x7f85880c9ed0 legacy=0x7f85880c6340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:41.443 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:41.441+0000 7f858dae1700 1 -- 172.21.15.57:0/1081646999 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85880ca480 con 0x7f85880c9b00 2023-10-06T03:03:41.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:41.441+0000 7f858dae1700 1 --2- 172.21.15.57:0/1081646999 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f85880c9b00 0x7f85880c8120 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f85840098e0 tx=0x7f85840091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bcbf8f2195a094a1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:03:41.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:41.441+0000 7f858cadf700 1 -- 172.21.15.57:0/1081646999 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8584011630 con 0x7f85880c9b00 2023-10-06T03:03:41.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:41.441+0000 7f858cadf700 1 -- 172.21.15.57:0/1081646999 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8584011790 con 0x7f85880c9b00 2023-10-06T03:03:41.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:41.441+0000 7f858cadf700 1 -- 172.21.15.57:0/1081646999 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8584011b30 con 0x7f85880c9b00 2023-10-06T03:03:41.446 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:41.441+0000 7f858eae3700 1 -- 172.21.15.57:0/1081646999 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f85880c9b00 msgr2=0x7f85880c8120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:41.446 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:41.441+0000 7f858eae3700 1 --2- 172.21.15.57:0/1081646999 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f85880c9b00 0x7f85880c8120 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f85840098e0 tx=0x7f85840091a0 comp rx=0 tx=0).stop 2023-10-06T03:03:41.446 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:41.441+0000 7f858eae3700 1 -- 172.21.15.57:0/1081646999 shutdown_connections 2023-10-06T03:03:41.446 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:41.441+0000 7f858eae3700 1 --2- 172.21.15.57:0/1081646999 >> v2:172.21.15.105:3300/0 conn(0x7f8588161180 0x7f8588161600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:41.446 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:41.441+0000 7f858eae3700 1 --2- 172.21.15.57:0/1081646999 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f85880c9b00 0x7f85880c8120 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:41.446 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:41.441+0000 7f858eae3700 1 -- 172.21.15.57:0/1081646999 >> 172.21.15.57:0/1081646999 conn(0x7f8588067b00 msgr2=0x7f85880cbd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:03:41.446 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:41.441+0000 7f858eae3700 1 -- 172.21.15.57:0/1081646999 shutdown_connections 2023-10-06T03:03:41.446 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:41.441+0000 7f858eae3700 1 -- 172.21.15.57:0/1081646999 wait complete. 2023-10-06T03:03:41.447 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:41.445+0000 7f858eae3700 1 Processor -- start 2023-10-06T03:03:41.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:41.445+0000 7f858eae3700 1 -- start start 2023-10-06T03:03:41.449 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:41.445+0000 7f858eae3700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f85880c9b00 0x7f85881481e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:41.449 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:41.445+0000 7f858eae3700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f85880c9ed0 0x7f8588171350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:41.450 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:41.445+0000 7f858eae3700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8588161180 0x7f8588145030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:41.450 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:41.445+0000 7f858eae3700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8588145d90 con 0x7f85880c9b00 2023-10-06T03:03:41.450 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:41.445+0000 7f858eae3700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8588146070 con 0x7f85880c9ed0 2023-10-06T03:03:41.450 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:41.445+0000 7f858eae3700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8588146350 con 0x7f8588161180 2023-10-06T03:03:41.451 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:41.445+0000 7f858dae1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f85880c9b00 0x7f85881481e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:41.451 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:41.445+0000 7f858dae1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f85880c9b00 0x7f85881481e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:50764/0 (socket says 172.21.15.57:50764) 2023-10-06T03:03:41.451 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:41.445+0000 7f858dae1700 1 -- 172.21.15.57:0/1341388216 learned_addr learned my addr 172.21.15.57:0/1341388216 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:03:41.451 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:41.445+0000 7f858e2e2700 1 --2- 172.21.15.57:0/1341388216 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8588161180 0x7f8588145030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:41.451 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:41.445+0000 7f858d2e0700 1 --2- 172.21.15.57:0/1341388216 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f85880c9ed0 0x7f8588171350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:41.451 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:41.449+0000 7f858dae1700 1 -- 172.21.15.57:0/1341388216 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8588161180 msgr2=0x7f8588145030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:41.451 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:41.449+0000 7f858dae1700 1 --2- 172.21.15.57:0/1341388216 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8588161180 0x7f8588145030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:41.451 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:41.449+0000 7f858dae1700 1 -- 172.21.15.57:0/1341388216 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f85880c9ed0 msgr2=0x7f8588171350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:41.452 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:41.449+0000 7f858dae1700 1 --2- 172.21.15.57:0/1341388216 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f85880c9ed0 0x7f8588171350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:41.452 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:41.449+0000 7f858dae1700 1 -- 172.21.15.57:0/1341388216 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8584009420 con 0x7f85880c9b00 2023-10-06T03:03:41.452 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:41.449+0000 7f858e2e2700 1 --2- 172.21.15.57:0/1341388216 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8588161180 0x7f8588145030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:03:41.453 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:41.449+0000 7f858dae1700 1 --2- 172.21.15.57:0/1341388216 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f85880c9b00 0x7f85881481e0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f85840091e0 tx=0x7f8584017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:03:41.453 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:41.449+0000 7f857dffb700 1 -- 172.21.15.57:0/1341388216 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8584000d10 con 0x7f85880c9b00 2023-10-06T03:03:41.453 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:41.449+0000 7f857dffb700 1 -- 172.21.15.57:0/1341388216 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8584011900 con 0x7f85880c9b00 2023-10-06T03:03:41.453 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:41.449+0000 7f857dffb700 1 -- 172.21.15.57:0/1341388216 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8584025420 con 0x7f85880c9b00 2023-10-06T03:03:41.453 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:41.449+0000 7f858eae3700 1 -- 172.21.15.57:0/1341388216 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8588146630 con 0x7f85880c9b00 2023-10-06T03:03:41.453 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:41.449+0000 7f858eae3700 1 -- 172.21.15.57:0/1341388216 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8588171890 con 0x7f85880c9b00 2023-10-06T03:03:41.455 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:41.453+0000 7f858eae3700 1 -- 172.21.15.57:0/1341388216 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85880645e0 con 0x7f85880c9b00 2023-10-06T03:03:41.456 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:41.453+0000 7f857dffb700 1 -- 172.21.15.57:0/1341388216 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f8584023070 con 0x7f85880c9b00 2023-10-06T03:03:41.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:41.453+0000 7f857dffb700 1 --2- 172.21.15.57:0/1341388216 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f856c060550 0x7f856c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:41.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:41.453+0000 7f857dffb700 1 -- 172.21.15.57:0/1341388216 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6202+0+0 (secure 0 0 0) 0x7f858407ddc0 con 0x7f85880c9b00 2023-10-06T03:03:41.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:41.453+0000 7f858d2e0700 1 --2- 172.21.15.57:0/1341388216 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f856c060550 0x7f856c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:41.459 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:41.457+0000 7f858d2e0700 1 --2- 172.21.15.57:0/1341388216 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f856c060550 0x7f856c062a00 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f8588160680 tx=0x7f8578009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:03:41.465 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:41.461+0000 7f857dffb700 1 -- 172.21.15.57:0/1341388216 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f858404e160 con 0x7f85880c9b00 2023-10-06T03:03:41.671 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:41.669+0000 7f858eae3700 1 -- 172.21.15.57:0/1341388216 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8588067f00 con 0x7f85880c9b00 2023-10-06T03:03:41.672 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:41.669+0000 7f857dffb700 1 -- 172.21.15.57:0/1341388216 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4598 (secure 0 0 0) 0x7f8584051740 con 0x7f85880c9b00 2023-10-06T03:03:41.673 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:03:41.673 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":38,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5222,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/879829980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":879829980},{"type":"v1","addr":"172.21.15.105:6833","nonce":879829980}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5225,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/3705921279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":3705921279},{"type":"v1","addr":"172.21.15.105:6835","nonce":3705921279}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/251759282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":251759282},{"type":"v1","addr":"172.21.15.57:6835","nonce":251759282}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:02:39.274111+0000","modified":"2023-10-06T03:02:56.856783+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":54,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5643},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5643":{"gid":5643,"name":"c","rank":0,"incarnation":34,"state":"up:active","state_seq":5,"addr":"172.21.15.57:6837/3347844181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6836","nonce":3347844181},{"type":"v1","addr":"172.21.15.57:6837","nonce":3347844181}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T03:03:41.677 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:41.673+0000 7f858eae3700 1 -- 172.21.15.57:0/1341388216 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f856c060550 msgr2=0x7f856c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:41.677 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:41.673+0000 7f858eae3700 1 --2- 172.21.15.57:0/1341388216 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f856c060550 0x7f856c062a00 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f8588160680 tx=0x7f8578009040 comp rx=0 tx=0).stop 2023-10-06T03:03:41.677 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:41.673+0000 7f858eae3700 1 -- 172.21.15.57:0/1341388216 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f85880c9b00 msgr2=0x7f85881481e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:41.678 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:41.673+0000 7f858eae3700 1 --2- 172.21.15.57:0/1341388216 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f85880c9b00 0x7f85881481e0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f85840091e0 tx=0x7f8584017000 comp rx=0 tx=0).stop 2023-10-06T03:03:41.678 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:41.673+0000 7f858eae3700 1 -- 172.21.15.57:0/1341388216 shutdown_connections 2023-10-06T03:03:41.678 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:41.673+0000 7f858eae3700 1 --2- 172.21.15.57:0/1341388216 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f856c060550 0x7f856c062a00 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:41.679 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:41.673+0000 7f858eae3700 1 --2- 172.21.15.57:0/1341388216 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8588161180 0x7f8588145030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:41.679 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:41.673+0000 7f858eae3700 1 --2- 172.21.15.57:0/1341388216 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f85880c9ed0 0x7f8588171350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:41.679 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:41.673+0000 7f858eae3700 1 --2- 172.21.15.57:0/1341388216 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f85880c9b00 0x7f85881481e0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:41.679 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:41.673+0000 7f858eae3700 1 -- 172.21.15.57:0/1341388216 >> 172.21.15.57:0/1341388216 conn(0x7f8588067b00 msgr2=0x7f8588069a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:03:41.679 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:41.673+0000 7f858eae3700 1 -- 172.21.15.57:0/1341388216 shutdown_connections 2023-10-06T03:03:41.679 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:41.673+0000 7f858eae3700 1 -- 172.21.15.57:0/1341388216 wait complete. 2023-10-06T03:03:41.680 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 38 2023-10-06T03:03:41.699 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json perf dump 2023-10-06T03:03:41.870 INFO:teuthology.orchestra.run.smithi057.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":101,"msgr_send_messages":48,"msgr_recv_bytes":126007,"msgr_send_bytes":52102,"msgr_created_connections":10,"msgr_active_connections":3,"msgr_running_total_time":0.037540058,"msgr_running_send_time":0.013370749,"msgr_running_recv_time":0.017933946,"msgr_running_fast_dispatch_time":0.004387817,"msgr_send_messages_queue_lat":{"avgcount":48,"sum":0.008108092,"avgtime":0.000168918},"msgr_handle_ack_lat":{"avgcount":12,"sum":0.000011113,"avgtime":0.000000926}},"AsyncMessenger::Worker-1":{"msgr_recv_messages":21,"msgr_send_messages":33,"msgr_recv_bytes":9933,"msgr_send_bytes":110733,"msgr_created_connections":6,"msgr_active_connections":4,"msgr_running_total_time":0.009733081,"msgr_running_send_time":0.003222998,"msgr_running_recv_time":0.005214588,"msgr_running_fast_dispatch_time":0.000643523,"msgr_send_messages_queue_lat":{"avgcount":31,"sum":0.006168523,"avgtime":0.000198984},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"AsyncMessenger::Worker-2":{"msgr_recv_messages":16,"msgr_send_messages":18,"msgr_recv_bytes":10773,"msgr_send_bytes":6198,"msgr_created_connections":6,"msgr_active_connections":4,"msgr_running_total_time":0.007013147,"msgr_running_send_time":0.000973107,"msgr_running_recv_time":0.004861993,"msgr_running_fast_dispatch_time":0.000767528,"msgr_send_messages_queue_lat":{"avgcount":16,"sum":0.008215046,"avgtime":0.000513440},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":0,"complete_latency":{"avgcount":43,"sum":0.004722413,"avgtime":0.000109823}},"finisher-PurgeQueue":{"queue_len":0,"complete_latency":{"avgcount":4,"sum":0.000177735,"avgtime":0.000044433}},"mds":{"request":4,"reply":2,"reply_latency":{"avgcount":2,"sum":0.005332595,"avgtime":0.002666297},"slow_reply":0,"forward":0,"dir_fetch":12,"dir_commit":0,"dir_split":0,"dir_merge":0,"inodes":11,"inodes_top":0,"inodes_bottom":11,"inodes_pin_tail":0,"inodes_pinned":11,"inodes_expired":0,"inodes_with_caps":2,"caps":2,"subtrees":2,"traverse":4,"traverse_hit":4,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":15,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":1,"root_rbytes":7,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":0,"ceph_cap_op_grant":0,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":1,"handle_client_caps_dirty":1,"handle_client_cap_release":1,"process_request_cap_release":1},"mds_cache":{"num_strays":0,"num_strays_delayed":0,"num_strays_enqueuing":0,"strays_created":0,"strays_enqueued":0,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0},"mds_log":{"evadd":5,"evex":0,"evtrm":0,"ev":7,"evexg":0,"evexd":0,"segadd":0,"segex":0,"segtrm":0,"seg":1,"segexg":0,"segexd":0,"expos":4194304,"wrpos":4201859,"rdpos":4195196,"jlat":{"avgcount":4,"sum":0.015392207,"avgtime":0.003848051},"replayed":2},"mds_mem":{"ino":14,"ino+":14,"ino-":0,"dir":12,"dir+":12,"dir-":0,"dn":11,"dn+":11,"dn-":0,"cap":1,"cap+":2,"cap-":1,"rss":42460,"heap":223456},"mds_server":{"dispatch_client_request":3,"dispatch_server_request":0,"handle_client_request":4,"handle_client_session":2,"handle_peer_request":0,"req_create_latency":{"avgcount":1,"sum":0.005055413,"avgtime":0.005055413},"req_getattr_latency":{"avgcount":1,"sum":0.000277182,"avgtime":0.000277182},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_readdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"cap_revoke_eviction":0,"cap_acquisition_throttle":0,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":1,"session_add":1,"session_remove":0,"sessions_open":1,"sessions_stale":0,"total_load":1,"average_load":1,"avg_session_uptime":953,"mdthresh_evicted":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_Buffer_bytes":0,"bluestore_Buffer_items":0,"bluestore_Extent_bytes":0,"bluestore_Extent_items":0,"bluestore_Blob_bytes":0,"bluestore_Blob_items":0,"bluestore_SharedBlob_bytes":0,"bluestore_SharedBlob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":225511,"buffer_anon_items":66,"buffer_meta_bytes":0,"buffer_meta_items":0,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":6336,"osdmap_items":93,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":53863,"mds_co_items":233,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":42,"op_send_bytes":5242,"op_resend":0,"op_reply":42,"oplen_avg":{"avgcount":42,"sum":75},"op":42,"op_r":26,"op_w":16,"op_rmw":0,"op_pg":0,"osdop_stat":2,"osdop_create":0,"osdop_read":8,"osdop_write":4,"osdop_writefull":1,"osdop_writesame":0,"osdop_append":0,"osdop_zero":1,"osdop_truncate":0,"osdop_delete":5,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":14,"osdop_setxattr":0,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":56,"map_full":0,"map_inc":2,"osd_sessions":8,"osd_session_open":8,"osd_session_close":0,"osd_laggy":0,"omap_wr":9,"omap_rd":28,"omap_del":3},"oft":{"omap_total_objs":2,"omap_total_kv_pairs":2,"omap_total_updates":2,"omap_total_removes":0},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":0,"pq_executing":0,"pq_executing_high_water":0,"pq_executed":0,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":0,"max":104857600,"get_started":0,"get":134,"get_sum":132271,"get_or_fail_fail":0,"get_or_fail_success":134,"take":0,"take_sum":0,"put":134,"put_sum":132271,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":42,"take_sum":6168,"put":42,"put_sum":6168,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":42,"take_sum":42,"put":42,"put_sum":42,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":0,"take_sum":0,"put":0,"put_sum":0,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x55d33e7a4000":{"val":2137,"max":3758096384,"get_started":0,"get":5,"get_sum":6405,"get_or_fail_fail":0,"get_or_fail_success":5,"take":0,"take_sum":0,"put":4,"put_sum":4268,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}}} 2023-10-06T03:03:41.873 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 3, "msgr_created_connections": 10, "msgr_handle_ack_lat": { "avgcount": 12, "avgtime": 9.26e-07, "sum": 1.1113e-05 }, "msgr_recv_bytes": 126007, "msgr_recv_messages": 101, "msgr_running_fast_dispatch_time": 0.004387817, "msgr_running_recv_time": 0.017933946, "msgr_running_send_time": 0.013370749, "msgr_running_total_time": 0.037540058, "msgr_send_bytes": 52102, "msgr_send_messages": 48, "msgr_send_messages_queue_lat": { "avgcount": 48, "avgtime": 0.000168918, "sum": 0.008108092 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 4, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 9933, "msgr_recv_messages": 21, "msgr_running_fast_dispatch_time": 0.000643523, "msgr_running_recv_time": 0.005214588, "msgr_running_send_time": 0.003222998, "msgr_running_total_time": 0.009733081, "msgr_send_bytes": 110733, "msgr_send_messages": 33, "msgr_send_messages_queue_lat": { "avgcount": 31, "avgtime": 0.000198984, "sum": 0.006168523 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 4, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 10773, "msgr_recv_messages": 16, "msgr_running_fast_dispatch_time": 0.000767528, "msgr_running_recv_time": 0.004861993, "msgr_running_send_time": 0.000973107, "msgr_running_total_time": 0.007013147, "msgr_send_bytes": 6198, "msgr_send_messages": 18, "msgr_send_messages_queue_lat": { "avgcount": 16, "avgtime": 0.00051344, "sum": 0.008215046 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 43, "avgtime": 0.000109823, "sum": 0.004722413 }, "queue_len": 0 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 4, "avgtime": 4.4433e-05, "sum": 0.000177735 }, "queue_len": 0 }, "mds": { "caps": 2, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 0, "ceph_cap_op_revoke": 0, "ceph_cap_op_trunc": 0, "dir_commit": 0, "dir_fetch": 12, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 1, "handle_client_caps": 1, "handle_client_caps_dirty": 1, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 11, "inodes_bottom": 11, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 11, "inodes_top": 0, "inodes_with_caps": 2, "load_cent": 15, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 1, "q": 0, "reply": 2, "reply_latency": { "avgcount": 2, "avgtime": 0.002666297, "sum": 0.005332595 }, "request": 4, "root_rbytes": 7, "root_rfiles": 1, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 4, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 4, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 0, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 0, "strays_enqueued": 0, "strays_migrated": 0, "strays_reintegrated": 0 }, "mds_log": { "ev": 7, "evadd": 5, "evex": 0, "evexd": 0, "evexg": 0, "evtrm": 0, "expos": 4194304, "jlat": { "avgcount": 4, "avgtime": 0.003848051, "sum": 0.015392207 }, "rdpos": 4195196, "replayed": 2, "seg": 1, "segadd": 0, "segex": 0, "segexd": 0, "segexg": 0, "segtrm": 0, "wrpos": 4201859 }, "mds_mem": { "cap": 1, "cap+": 2, "cap-": 1, "dir": 12, "dir+": 12, "dir-": 0, "dn": 11, "dn+": 11, "dn-": 0, "heap": 223456, "ino": 14, "ino+": 14, "ino-": 0, "rss": 42460 }, "mds_server": { "cap_acquisition_throttle": 0, "cap_revoke_eviction": 0, "dispatch_client_request": 3, "dispatch_server_request": 0, "handle_client_request": 4, "handle_client_session": 2, "handle_peer_request": 0, "req_create_latency": { "avgcount": 1, "avgtime": 0.005055413, "sum": 0.005055413 }, "req_getattr_latency": { "avgcount": 1, "avgtime": 0.000277182, "sum": 0.000277182 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_readdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "mds_sessions": { "average_load": 1, "avg_session_uptime": 953, "mdthresh_evicted": 0, "session_add": 1, "session_count": 1, "session_remove": 0, "sessions_open": 1, "sessions_stale": 0, "total_load": 1 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_Blob_bytes": 0, "bluestore_Blob_items": 0, "bluestore_Buffer_bytes": 0, "bluestore_Buffer_items": 0, "bluestore_Extent_bytes": 0, "bluestore_Extent_items": 0, "bluestore_SharedBlob_bytes": 0, "bluestore_SharedBlob_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 225511, "buffer_anon_items": 66, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "mds_co_bytes": 53863, "mds_co_items": 233, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 6336, "osdmap_items": 93, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 56, "map_full": 0, "map_inc": 2, "omap_del": 3, "omap_rd": 28, "omap_wr": 9, "op": 42, "op_active": 0, "op_laggy": 0, "op_pg": 0, "op_r": 26, "op_reply": 42, "op_resend": 0, "op_rmw": 0, "op_send": 42, "op_send_bytes": 5242, "op_w": 16, "oplen_avg": { "avgcount": 42, "sum": 75 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 8, "osd_sessions": 8, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 0, "osdop_delete": 5, "osdop_getxattr": 14, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 8, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 0, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 2, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 4, "osdop_writefull": 1, "osdop_writesame": 0, "osdop_zero": 1, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 2, "omap_total_objs": 2, "omap_total_removes": 0, "omap_total_updates": 2 }, "purge_queue": { "pq_executed": 0, "pq_executing": 0, "pq_executing_high_water": 0, "pq_executing_ops": 0, "pq_executing_ops_high_water": 0, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 134, "get_or_fail_fail": 0, "get_or_fail_success": 134, "get_started": 0, "get_sum": 132271, "max": 104857600, "put": 134, "put_sum": 132271, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 42, "put_sum": 6168, "take": 42, "take_sum": 6168, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 42, "put_sum": 42, "take": 42, "take_sum": 42, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 3758096384, "put": 0, "put_sum": 0, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x55d33e7a4000": { "get": 5, "get_or_fail_fail": 0, "get_or_fail_success": 5, "get_started": 0, "get_sum": 6405, "max": 3758096384, "put": 4, "put_sum": 4268, "take": 0, "take_sum": 0, "val": 2137, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } } } 2023-10-06T03:03:41.874 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120 retry_count=0)... 2023-10-06T03:03:46.875 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:03:47.040 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.037+0000 7fb4583c5700 1 Processor -- start 2023-10-06T03:03:47.040 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.037+0000 7fb4583c5700 1 -- start start 2023-10-06T03:03:47.044 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.041+0000 7fb4583c5700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb450064070 0x7fb4500aba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:47.044 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.041+0000 7fb4583c5700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb4500ae280 0x7fb450155290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:47.044 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.041+0000 7fb4583c5700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fb4500c6990 0x7fb4500ad2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:47.044 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.041+0000 7fb4583c5700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4500ace10 con 0x7fb4500ae280 2023-10-06T03:03:47.044 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.041+0000 7fb4583c5700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4500abf60 con 0x7fb4500c6990 2023-10-06T03:03:47.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.041+0000 7fb4583c5700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4501557d0 con 0x7fb450064070 2023-10-06T03:03:47.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.041+0000 7fb455960700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb4500ae280 0x7fb450155290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:47.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.041+0000 7fb455960700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb4500ae280 0x7fb450155290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:49900/0 (socket says 172.21.15.57:49900) 2023-10-06T03:03:47.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.041+0000 7fb455960700 1 -- 172.21.15.57:0/4134914316 learned_addr learned my addr 172.21.15.57:0/4134914316 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:03:47.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.041+0000 7fb456161700 1 --2- 172.21.15.57:0/4134914316 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb450064070 0x7fb4500aba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:47.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.041+0000 7fb456962700 1 --2- 172.21.15.57:0/4134914316 >> v2:172.21.15.105:3300/0 conn(0x7fb4500c6990 0x7fb4500ad2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:47.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.041+0000 7fb455960700 1 -- 172.21.15.57:0/4134914316 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb450064070 msgr2=0x7fb4500aba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:03:47.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.041+0000 7fb455960700 1 --2- 172.21.15.57:0/4134914316 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb450064070 0x7fb4500aba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:47.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.041+0000 7fb455960700 1 -- 172.21.15.57:0/4134914316 >> v2:172.21.15.105:3300/0 conn(0x7fb4500c6990 msgr2=0x7fb4500ad2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:03:47.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.041+0000 7fb455960700 1 --2- 172.21.15.57:0/4134914316 >> v2:172.21.15.105:3300/0 conn(0x7fb4500c6990 0x7fb4500ad2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:47.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.041+0000 7fb455960700 1 -- 172.21.15.57:0/4134914316 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4500ac200 con 0x7fb4500ae280 2023-10-06T03:03:47.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.041+0000 7fb456161700 1 --2- 172.21.15.57:0/4134914316 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb450064070 0x7fb4500aba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:03:47.047 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.041+0000 7fb455960700 1 --2- 172.21.15.57:0/4134914316 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb4500ae280 0x7fb450155290 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fb450070b20 tx=0x7fb440009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=547c0b8265c0787b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:03:47.047 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.045+0000 7fb45515f700 1 -- 172.21.15.57:0/4134914316 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb44000b860 con 0x7fb4500ae280 2023-10-06T03:03:47.047 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.045+0000 7fb45515f700 1 -- 172.21.15.57:0/4134914316 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb44000b9c0 con 0x7fb4500ae280 2023-10-06T03:03:47.047 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.045+0000 7fb45515f700 1 -- 172.21.15.57:0/4134914316 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb44000bd60 con 0x7fb4500ae280 2023-10-06T03:03:47.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.045+0000 7fb4583c5700 1 -- 172.21.15.57:0/4134914316 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb4500ae280 msgr2=0x7fb450155290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:47.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.045+0000 7fb4583c5700 1 --2- 172.21.15.57:0/4134914316 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb4500ae280 0x7fb450155290 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fb450070b20 tx=0x7fb440009250 comp rx=0 tx=0).stop 2023-10-06T03:03:47.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.045+0000 7fb4583c5700 1 -- 172.21.15.57:0/4134914316 shutdown_connections 2023-10-06T03:03:47.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.045+0000 7fb4583c5700 1 --2- 172.21.15.57:0/4134914316 >> v2:172.21.15.105:3300/0 conn(0x7fb4500c6990 0x7fb4500ad2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:47.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.045+0000 7fb4583c5700 1 --2- 172.21.15.57:0/4134914316 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb4500ae280 0x7fb450155290 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:47.049 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.045+0000 7fb4583c5700 1 --2- 172.21.15.57:0/4134914316 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb450064070 0x7fb4500aba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:47.049 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.045+0000 7fb4583c5700 1 -- 172.21.15.57:0/4134914316 >> 172.21.15.57:0/4134914316 conn(0x7fb450067030 msgr2=0x7fb450067430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:03:47.049 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.045+0000 7fb4583c5700 1 -- 172.21.15.57:0/4134914316 shutdown_connections 2023-10-06T03:03:47.049 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.045+0000 7fb4583c5700 1 -- 172.21.15.57:0/4134914316 wait complete. 2023-10-06T03:03:47.050 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.045+0000 7fb4583c5700 1 Processor -- start 2023-10-06T03:03:47.050 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.049+0000 7fb4583c5700 1 -- start start 2023-10-06T03:03:47.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.049+0000 7fb4583c5700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb450064070 0x7fb4500c3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:47.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.049+0000 7fb4583c5700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb4500ae280 0x7fb450152740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:47.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.049+0000 7fb4583c5700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb4500c6990 0x7fb4500aa210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:47.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.049+0000 7fb4583c5700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4500c95a0 con 0x7fb450064070 2023-10-06T03:03:47.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.049+0000 7fb4583c5700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4500c3b50 con 0x7fb4500ae280 2023-10-06T03:03:47.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.049+0000 7fb4583c5700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4500bfa60 con 0x7fb4500c6990 2023-10-06T03:03:47.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.049+0000 7fb456161700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb450064070 0x7fb4500c3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:47.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.049+0000 7fb456161700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb450064070 0x7fb4500c3610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:49908/0 (socket says 172.21.15.57:49908) 2023-10-06T03:03:47.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.049+0000 7fb456161700 1 -- 172.21.15.57:0/1504952638 learned_addr learned my addr 172.21.15.57:0/1504952638 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:03:47.054 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.049+0000 7fb455960700 1 --2- 172.21.15.57:0/1504952638 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb4500ae280 0x7fb450152740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:47.054 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.049+0000 7fb456962700 1 --2- 172.21.15.57:0/1504952638 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb4500c6990 0x7fb4500aa210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:47.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.049+0000 7fb456161700 1 -- 172.21.15.57:0/1504952638 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb4500c6990 msgr2=0x7fb4500aa210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:47.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.049+0000 7fb456161700 1 --2- 172.21.15.57:0/1504952638 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb4500c6990 0x7fb4500aa210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:47.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.049+0000 7fb456161700 1 -- 172.21.15.57:0/1504952638 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb4500ae280 msgr2=0x7fb450152740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:47.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.049+0000 7fb456161700 1 --2- 172.21.15.57:0/1504952638 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb4500ae280 0x7fb450152740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:47.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.049+0000 7fb456161700 1 -- 172.21.15.57:0/1504952638 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4400094f0 con 0x7fb450064070 2023-10-06T03:03:47.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.049+0000 7fb456962700 1 --2- 172.21.15.57:0/1504952638 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb4500c6990 0x7fb4500aa210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:03:47.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.049+0000 7fb456161700 1 --2- 172.21.15.57:0/1504952638 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb450064070 0x7fb4500c3610 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fb44c00d890 tx=0x7fb44c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:03:47.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.049+0000 7fb4467fc700 1 -- 172.21.15.57:0/1504952638 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb44c005a00 con 0x7fb450064070 2023-10-06T03:03:47.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.049+0000 7fb4467fc700 1 -- 172.21.15.57:0/1504952638 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb44c005b60 con 0x7fb450064070 2023-10-06T03:03:47.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.049+0000 7fb4583c5700 1 -- 172.21.15.57:0/1504952638 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4500bfd40 con 0x7fb450064070 2023-10-06T03:03:47.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.049+0000 7fb4467fc700 1 -- 172.21.15.57:0/1504952638 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb44c0125f0 con 0x7fb450064070 2023-10-06T03:03:47.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.049+0000 7fb4583c5700 1 -- 172.21.15.57:0/1504952638 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4500c0300 con 0x7fb450064070 2023-10-06T03:03:47.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.053+0000 7fb4583c5700 1 -- 172.21.15.57:0/1504952638 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb45006c230 con 0x7fb450064070 2023-10-06T03:03:47.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.053+0000 7fb4467fc700 1 -- 172.21.15.57:0/1504952638 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fb44c0129a0 con 0x7fb450064070 2023-10-06T03:03:47.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.053+0000 7fb4467fc700 1 --2- 172.21.15.57:0/1504952638 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fb434060550 0x7fb434062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:47.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.053+0000 7fb4467fc700 1 -- 172.21.15.57:0/1504952638 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6202+0+0 (secure 0 0 0) 0x7fb44c07c800 con 0x7fb450064070 2023-10-06T03:03:47.061 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.057+0000 7fb455960700 1 --2- 172.21.15.57:0/1504952638 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fb434060550 0x7fb434062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:47.061 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.057+0000 7fb455960700 1 --2- 172.21.15.57:0/1504952638 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fb434060550 0x7fb434062a00 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fb450070b20 tx=0x7fb440017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:03:47.065 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.061+0000 7fb4467fc700 1 -- 172.21.15.57:0/1504952638 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fb44c04cb60 con 0x7fb450064070 2023-10-06T03:03:47.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.265+0000 7fb4583c5700 1 -- 172.21.15.57:0/1504952638 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb4500ac4e0 con 0x7fb450064070 2023-10-06T03:03:47.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.265+0000 7fb4467fc700 1 -- 172.21.15.57:0/1504952638 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4598 (secure 0 0 0) 0x7fb44c050180 con 0x7fb450064070 2023-10-06T03:03:47.269 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:03:47.269 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":38,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5222,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/879829980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":879829980},{"type":"v1","addr":"172.21.15.105:6833","nonce":879829980}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5225,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/3705921279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":3705921279},{"type":"v1","addr":"172.21.15.105:6835","nonce":3705921279}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/251759282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":251759282},{"type":"v1","addr":"172.21.15.57:6835","nonce":251759282}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:02:39.274111+0000","modified":"2023-10-06T03:02:56.856783+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":54,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5643},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5643":{"gid":5643,"name":"c","rank":0,"incarnation":34,"state":"up:active","state_seq":5,"addr":"172.21.15.57:6837/3347844181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6836","nonce":3347844181},{"type":"v1","addr":"172.21.15.57:6837","nonce":3347844181}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T03:03:47.271 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.269+0000 7fb4583c5700 1 -- 172.21.15.57:0/1504952638 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fb434060550 msgr2=0x7fb434062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:47.272 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.269+0000 7fb4583c5700 1 --2- 172.21.15.57:0/1504952638 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fb434060550 0x7fb434062a00 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fb450070b20 tx=0x7fb440017000 comp rx=0 tx=0).stop 2023-10-06T03:03:47.272 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.269+0000 7fb4583c5700 1 -- 172.21.15.57:0/1504952638 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb450064070 msgr2=0x7fb4500c3610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:47.272 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.269+0000 7fb4583c5700 1 --2- 172.21.15.57:0/1504952638 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb450064070 0x7fb4500c3610 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fb44c00d890 tx=0x7fb44c008040 comp rx=0 tx=0).stop 2023-10-06T03:03:47.272 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.269+0000 7fb4583c5700 1 -- 172.21.15.57:0/1504952638 shutdown_connections 2023-10-06T03:03:47.272 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.269+0000 7fb4583c5700 1 --2- 172.21.15.57:0/1504952638 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fb434060550 0x7fb434062a00 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:47.272 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.269+0000 7fb4583c5700 1 --2- 172.21.15.57:0/1504952638 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb4500c6990 0x7fb4500aa210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:47.272 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.269+0000 7fb4583c5700 1 --2- 172.21.15.57:0/1504952638 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb4500ae280 0x7fb450152740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:47.272 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.269+0000 7fb4583c5700 1 --2- 172.21.15.57:0/1504952638 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb450064070 0x7fb4500c3610 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:47.272 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.269+0000 7fb4583c5700 1 -- 172.21.15.57:0/1504952638 >> 172.21.15.57:0/1504952638 conn(0x7fb450067030 msgr2=0x7fb4500ad1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:03:47.273 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.269+0000 7fb4583c5700 1 -- 172.21.15.57:0/1504952638 shutdown_connections 2023-10-06T03:03:47.273 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.269+0000 7fb4583c5700 1 -- 172.21.15.57:0/1504952638 wait complete. 2023-10-06T03:03:47.274 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 38 2023-10-06T03:03:47.294 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json perf dump 2023-10-06T03:03:47.462 INFO:teuthology.orchestra.run.smithi057.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":108,"msgr_send_messages":50,"msgr_recv_bytes":128391,"msgr_send_bytes":52797,"msgr_created_connections":10,"msgr_active_connections":3,"msgr_running_total_time":0.039879807,"msgr_running_send_time":0.014642148,"msgr_running_recv_time":0.018423067,"msgr_running_fast_dispatch_time":0.004902471,"msgr_send_messages_queue_lat":{"avgcount":50,"sum":0.008248185,"avgtime":0.000164963},"msgr_handle_ack_lat":{"avgcount":13,"sum":0.000012183,"avgtime":0.000000937}},"AsyncMessenger::Worker-1":{"msgr_recv_messages":23,"msgr_send_messages":36,"msgr_recv_bytes":10425,"msgr_send_bytes":115310,"msgr_created_connections":6,"msgr_active_connections":4,"msgr_running_total_time":0.010268255,"msgr_running_send_time":0.003554357,"msgr_running_recv_time":0.005299229,"msgr_running_fast_dispatch_time":0.000710141,"msgr_send_messages_queue_lat":{"avgcount":34,"sum":0.006462681,"avgtime":0.000190078},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"AsyncMessenger::Worker-2":{"msgr_recv_messages":20,"msgr_send_messages":22,"msgr_recv_bytes":11983,"msgr_send_bytes":8050,"msgr_created_connections":6,"msgr_active_connections":4,"msgr_running_total_time":0.007636747,"msgr_running_send_time":0.001239964,"msgr_running_recv_time":0.005039416,"msgr_running_fast_dispatch_time":0.000906217,"msgr_send_messages_queue_lat":{"avgcount":20,"sum":0.008468163,"avgtime":0.000423408},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":0,"complete_latency":{"avgcount":48,"sum":0.005510279,"avgtime":0.000114797}},"finisher-PurgeQueue":{"queue_len":0,"complete_latency":{"avgcount":4,"sum":0.000177735,"avgtime":0.000044433}},"mds":{"request":4,"reply":2,"reply_latency":{"avgcount":2,"sum":0.005332595,"avgtime":0.002666297},"slow_reply":0,"forward":0,"dir_fetch":12,"dir_commit":0,"dir_split":0,"dir_merge":0,"inodes":11,"inodes_top":0,"inodes_bottom":11,"inodes_pin_tail":0,"inodes_pinned":11,"inodes_expired":0,"inodes_with_caps":1,"caps":1,"subtrees":2,"traverse":4,"traverse_hit":4,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":0,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":1,"root_rbytes":7,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":0,"ceph_cap_op_grant":0,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":1,"handle_client_caps_dirty":1,"handle_client_cap_release":1,"process_request_cap_release":1},"mds_cache":{"num_strays":0,"num_strays_delayed":0,"num_strays_enqueuing":0,"strays_created":0,"strays_enqueued":0,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0},"mds_log":{"evadd":5,"evex":0,"evtrm":0,"ev":7,"evexg":0,"evexd":0,"segadd":0,"segex":0,"segtrm":0,"seg":1,"segexg":0,"segexd":0,"expos":4194304,"wrpos":4201859,"rdpos":4195196,"jlat":{"avgcount":5,"sum":0.020214289,"avgtime":0.004042857},"replayed":2},"mds_mem":{"ino":14,"ino+":14,"ino-":0,"dir":12,"dir+":12,"dir-":0,"dn":11,"dn+":11,"dn-":0,"cap":1,"cap+":2,"cap-":1,"rss":42972,"heap":223456},"mds_server":{"dispatch_client_request":3,"dispatch_server_request":0,"handle_client_request":4,"handle_client_session":3,"handle_peer_request":0,"req_create_latency":{"avgcount":1,"sum":0.005055413,"avgtime":0.005055413},"req_getattr_latency":{"avgcount":1,"sum":0.000277182,"avgtime":0.000277182},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_readdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"cap_revoke_eviction":0,"cap_acquisition_throttle":0,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":1,"session_add":1,"session_remove":0,"sessions_open":1,"sessions_stale":0,"total_load":1,"average_load":1,"avg_session_uptime":963,"mdthresh_evicted":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_Buffer_bytes":0,"bluestore_Buffer_items":0,"bluestore_Extent_bytes":0,"bluestore_Extent_items":0,"bluestore_Blob_bytes":0,"bluestore_Blob_items":0,"bluestore_SharedBlob_bytes":0,"bluestore_SharedBlob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":225511,"buffer_anon_items":66,"buffer_meta_bytes":0,"buffer_meta_items":0,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":6528,"osdmap_items":97,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":53439,"mds_co_items":231,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":48,"op_send_bytes":7871,"op_resend":0,"op_reply":48,"oplen_avg":{"avgcount":48,"sum":86},"op":48,"op_r":26,"op_w":22,"op_rmw":0,"op_pg":0,"osdop_stat":2,"osdop_create":0,"osdop_read":8,"osdop_write":5,"osdop_writefull":2,"osdop_writesame":0,"osdop_append":0,"osdop_zero":1,"osdop_truncate":0,"osdop_delete":5,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":14,"osdop_setxattr":0,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":56,"map_full":0,"map_inc":2,"osd_sessions":8,"osd_session_open":8,"osd_session_close":0,"osd_laggy":0,"omap_wr":16,"omap_rd":28,"omap_del":5},"oft":{"omap_total_objs":1,"omap_total_kv_pairs":1,"omap_total_updates":3,"omap_total_removes":1},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":0,"pq_executing":0,"pq_executing_high_water":0,"pq_executed":0,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":0,"max":104857600,"get_started":0,"get":147,"get_sum":135231,"get_or_fail_fail":0,"get_or_fail_success":147,"take":0,"take_sum":0,"put":147,"put_sum":135231,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":48,"take_sum":8797,"put":48,"put_sum":8797,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":48,"take_sum":48,"put":48,"put_sum":48,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":0,"take_sum":0,"put":0,"put_sum":0,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x55d33e7a4000":{"val":0,"max":3758096384,"get_started":0,"get":5,"get_sum":6405,"get_or_fail_fail":0,"get_or_fail_success":5,"take":0,"take_sum":0,"put":5,"put_sum":6405,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}}} 2023-10-06T03:03:47.463 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 3, "msgr_created_connections": 10, "msgr_handle_ack_lat": { "avgcount": 13, "avgtime": 9.37e-07, "sum": 1.2183e-05 }, "msgr_recv_bytes": 128391, "msgr_recv_messages": 108, "msgr_running_fast_dispatch_time": 0.004902471, "msgr_running_recv_time": 0.018423067, "msgr_running_send_time": 0.014642148, "msgr_running_total_time": 0.039879807, "msgr_send_bytes": 52797, "msgr_send_messages": 50, "msgr_send_messages_queue_lat": { "avgcount": 50, "avgtime": 0.000164963, "sum": 0.008248185 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 4, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 10425, "msgr_recv_messages": 23, "msgr_running_fast_dispatch_time": 0.000710141, "msgr_running_recv_time": 0.005299229, "msgr_running_send_time": 0.003554357, "msgr_running_total_time": 0.010268255, "msgr_send_bytes": 115310, "msgr_send_messages": 36, "msgr_send_messages_queue_lat": { "avgcount": 34, "avgtime": 0.000190078, "sum": 0.006462681 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 4, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 11983, "msgr_recv_messages": 20, "msgr_running_fast_dispatch_time": 0.000906217, "msgr_running_recv_time": 0.005039416, "msgr_running_send_time": 0.001239964, "msgr_running_total_time": 0.007636747, "msgr_send_bytes": 8050, "msgr_send_messages": 22, "msgr_send_messages_queue_lat": { "avgcount": 20, "avgtime": 0.000423408, "sum": 0.008468163 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 48, "avgtime": 0.000114797, "sum": 0.005510279 }, "queue_len": 0 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 4, "avgtime": 4.4433e-05, "sum": 0.000177735 }, "queue_len": 0 }, "mds": { "caps": 1, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 0, "ceph_cap_op_revoke": 0, "ceph_cap_op_trunc": 0, "dir_commit": 0, "dir_fetch": 12, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 1, "handle_client_caps": 1, "handle_client_caps_dirty": 1, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 11, "inodes_bottom": 11, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 11, "inodes_top": 0, "inodes_with_caps": 1, "load_cent": 0, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 1, "q": 0, "reply": 2, "reply_latency": { "avgcount": 2, "avgtime": 0.002666297, "sum": 0.005332595 }, "request": 4, "root_rbytes": 7, "root_rfiles": 1, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 4, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 4, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 0, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 0, "strays_enqueued": 0, "strays_migrated": 0, "strays_reintegrated": 0 }, "mds_log": { "ev": 7, "evadd": 5, "evex": 0, "evexd": 0, "evexg": 0, "evtrm": 0, "expos": 4194304, "jlat": { "avgcount": 5, "avgtime": 0.004042857, "sum": 0.020214289 }, "rdpos": 4195196, "replayed": 2, "seg": 1, "segadd": 0, "segex": 0, "segexd": 0, "segexg": 0, "segtrm": 0, "wrpos": 4201859 }, "mds_mem": { "cap": 1, "cap+": 2, "cap-": 1, "dir": 12, "dir+": 12, "dir-": 0, "dn": 11, "dn+": 11, "dn-": 0, "heap": 223456, "ino": 14, "ino+": 14, "ino-": 0, "rss": 42972 }, "mds_server": { "cap_acquisition_throttle": 0, "cap_revoke_eviction": 0, "dispatch_client_request": 3, "dispatch_server_request": 0, "handle_client_request": 4, "handle_client_session": 3, "handle_peer_request": 0, "req_create_latency": { "avgcount": 1, "avgtime": 0.005055413, "sum": 0.005055413 }, "req_getattr_latency": { "avgcount": 1, "avgtime": 0.000277182, "sum": 0.000277182 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_readdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "mds_sessions": { "average_load": 1, "avg_session_uptime": 963, "mdthresh_evicted": 0, "session_add": 1, "session_count": 1, "session_remove": 0, "sessions_open": 1, "sessions_stale": 0, "total_load": 1 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_Blob_bytes": 0, "bluestore_Blob_items": 0, "bluestore_Buffer_bytes": 0, "bluestore_Buffer_items": 0, "bluestore_Extent_bytes": 0, "bluestore_Extent_items": 0, "bluestore_SharedBlob_bytes": 0, "bluestore_SharedBlob_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 225511, "buffer_anon_items": 66, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "mds_co_bytes": 53439, "mds_co_items": 231, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 6528, "osdmap_items": 97, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 56, "map_full": 0, "map_inc": 2, "omap_del": 5, "omap_rd": 28, "omap_wr": 16, "op": 48, "op_active": 0, "op_laggy": 0, "op_pg": 0, "op_r": 26, "op_reply": 48, "op_resend": 0, "op_rmw": 0, "op_send": 48, "op_send_bytes": 7871, "op_w": 22, "oplen_avg": { "avgcount": 48, "sum": 86 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 8, "osd_sessions": 8, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 0, "osdop_delete": 5, "osdop_getxattr": 14, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 8, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 0, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 2, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 5, "osdop_writefull": 2, "osdop_writesame": 0, "osdop_zero": 1, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 1, "omap_total_objs": 1, "omap_total_removes": 1, "omap_total_updates": 3 }, "purge_queue": { "pq_executed": 0, "pq_executing": 0, "pq_executing_high_water": 0, "pq_executing_ops": 0, "pq_executing_ops_high_water": 0, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 147, "get_or_fail_fail": 0, "get_or_fail_success": 147, "get_started": 0, "get_sum": 135231, "max": 104857600, "put": 147, "put_sum": 135231, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 48, "put_sum": 8797, "take": 48, "take_sum": 8797, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 48, "put_sum": 48, "take": 48, "take_sum": 48, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 3758096384, "put": 0, "put_sum": 0, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x55d33e7a4000": { "get": 5, "get_or_fail_fail": 0, "get_or_fail_success": 5, "get_started": 0, "get_sum": 6405, "max": 3758096384, "put": 5, "put_sum": 6405, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } } } 2023-10-06T03:03:47.464 DEBUG:tasks.ceph_test_case:wait_until_true: success in 35s and 0 retries 2023-10-06T03:03:47.465 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:03:47.626 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.621+0000 7f2251065700 1 Processor -- start 2023-10-06T03:03:47.626 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.625+0000 7f2251065700 1 -- start start 2023-10-06T03:03:47.629 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.625+0000 7f2251065700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f224c155e10 0x7f224c0c0c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:47.629 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.625+0000 7f2251065700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f224c15a330 0x7f224c0c9b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:47.629 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.625+0000 7f2251065700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f224c0c7e70 con 0x7f224c1561e0 2023-10-06T03:03:47.629 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.625+0000 7f2251065700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f224c0c11b0 con 0x7f224c15a330 2023-10-06T03:03:47.629 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.625+0000 7f2251065700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f224c0c7260 con 0x7f224c155e10 2023-10-06T03:03:47.630 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.625+0000 7f224b59e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f224c15a330 0x7f224c0c9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:47.630 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.625+0000 7f224ad9d700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f224c155e10 0x7f224c0c0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:47.630 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.625+0000 7f224ad9d700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f224c155e10 0x7f224c0c0c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.57:35896/0 (socket says 172.21.15.57:35896) 2023-10-06T03:03:47.630 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.625+0000 7f224ad9d700 1 -- 172.21.15.57:0/2172495779 learned_addr learned my addr 172.21.15.57:0/2172495779 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:03:47.630 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.625+0000 7f224b59e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f224c15a330 0x7f224c0c9b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:49918/0 (socket says 172.21.15.57:49918) 2023-10-06T03:03:47.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.629+0000 7f224b59e700 1 -- 172.21.15.57:0/2172495779 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f224c155e10 msgr2=0x7f224c0c0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:03:47.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.629+0000 7f224b59e700 1 --2- 172.21.15.57:0/2172495779 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f224c155e10 0x7f224c0c0c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:47.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.629+0000 7f224b59e700 1 -- 172.21.15.57:0/2172495779 >> v1:172.21.15.105:6789/0 conn(0x7f224c1561e0 legacy=0x7f224c159c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:47.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.629+0000 7f224a59c700 1 -- 172.21.15.57:0/2172495779 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2526947377 0 0) 0x7f224c0c7e70 con 0x7f224c1561e0 2023-10-06T03:03:47.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.629+0000 7f224b59e700 1 -- 172.21.15.57:0/2172495779 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f224c0c7540 con 0x7f224c15a330 2023-10-06T03:03:47.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.629+0000 7f224ad9d700 1 --2- 172.21.15.57:0/2172495779 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f224c155e10 0x7f224c0c0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:03:47.632 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.629+0000 7f224b59e700 1 --2- 172.21.15.57:0/2172495779 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f224c15a330 0x7f224c0c9b80 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f2244009e60 tx=0x7f2244009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9dc411e8f00cddd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:03:47.632 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.629+0000 7f224a59c700 1 -- 172.21.15.57:0/2172495779 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f224400e070 con 0x7f224c15a330 2023-10-06T03:03:47.632 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.629+0000 7f224a59c700 1 -- 172.21.15.57:0/2172495779 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f224400bb60 con 0x7f224c15a330 2023-10-06T03:03:47.632 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.629+0000 7f224a59c700 1 -- 172.21.15.57:0/2172495779 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2244012430 con 0x7f224c15a330 2023-10-06T03:03:47.633 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.629+0000 7f2251065700 1 -- 172.21.15.57:0/2172495779 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f224c15a330 msgr2=0x7f224c0c9b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:47.633 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.629+0000 7f2251065700 1 --2- 172.21.15.57:0/2172495779 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f224c15a330 0x7f224c0c9b80 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f2244009e60 tx=0x7f2244009780 comp rx=0 tx=0).stop 2023-10-06T03:03:47.633 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.629+0000 7f2251065700 1 -- 172.21.15.57:0/2172495779 shutdown_connections 2023-10-06T03:03:47.633 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.629+0000 7f2251065700 1 --2- 172.21.15.57:0/2172495779 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f224c15a330 0x7f224c0c9b80 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:47.633 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.629+0000 7f2251065700 1 --2- 172.21.15.57:0/2172495779 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f224c155e10 0x7f224c0c0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:47.634 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.629+0000 7f2251065700 1 -- 172.21.15.57:0/2172495779 >> 172.21.15.57:0/2172495779 conn(0x7f224c0cbed0 msgr2=0x7f224c0cc2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:03:47.634 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.629+0000 7f2251065700 1 -- 172.21.15.57:0/2172495779 shutdown_connections 2023-10-06T03:03:47.634 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.629+0000 7f2251065700 1 -- 172.21.15.57:0/2172495779 wait complete. 2023-10-06T03:03:47.635 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.633+0000 7f2251065700 1 Processor -- start 2023-10-06T03:03:47.635 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.633+0000 7f2251065700 1 -- start start 2023-10-06T03:03:47.637 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.633+0000 7f2251065700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f224c155e10 0x7f224c13d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:47.637 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.633+0000 7f2251065700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f224c1561e0 0x7f224c156650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:47.637 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.633+0000 7f2251065700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f224c15a330 0x7f224c156b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:47.637 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.633+0000 7f2251065700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f224c13d570 con 0x7f224c15a330 2023-10-06T03:03:47.637 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.633+0000 7f2251065700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f224c159390 con 0x7f224c1561e0 2023-10-06T03:03:47.638 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.633+0000 7f2251065700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f224c0ac670 con 0x7f224c155e10 2023-10-06T03:03:47.638 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.633+0000 7f224b59e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f224c15a330 0x7f224c156b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:47.638 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.633+0000 7f224ad9d700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f224c155e10 0x7f224c13d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:47.638 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.633+0000 7f224b59e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f224c15a330 0x7f224c156b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:49926/0 (socket says 172.21.15.57:49926) 2023-10-06T03:03:47.638 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.633+0000 7f224b59e700 1 -- 172.21.15.57:0/3799773565 learned_addr learned my addr 172.21.15.57:0/3799773565 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:03:47.639 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.633+0000 7f2243fff700 1 --2- 172.21.15.57:0/3799773565 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f224c1561e0 0x7f224c156650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:47.639 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.633+0000 7f224b59e700 1 -- 172.21.15.57:0/3799773565 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f224c155e10 msgr2=0x7f224c13d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:47.639 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.633+0000 7f224b59e700 1 --2- 172.21.15.57:0/3799773565 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f224c155e10 0x7f224c13d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:47.639 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.633+0000 7f224b59e700 1 -- 172.21.15.57:0/3799773565 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f224c1561e0 msgr2=0x7f224c156650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:47.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.633+0000 7f224b59e700 1 --2- 172.21.15.57:0/3799773565 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f224c1561e0 0x7f224c156650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:47.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.633+0000 7f224b59e700 1 -- 172.21.15.57:0/3799773565 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f223c009480 con 0x7f224c15a330 2023-10-06T03:03:47.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.637+0000 7f224b59e700 1 --2- 172.21.15.57:0/3799773565 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f224c15a330 0x7f224c156b90 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f224c06c590 tx=0x7f2244019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:03:47.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.637+0000 7f2242ffd700 1 -- 172.21.15.57:0/3799773565 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2244027470 con 0x7f224c15a330 2023-10-06T03:03:47.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.637+0000 7f2242ffd700 1 -- 172.21.15.57:0/3799773565 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2244027610 con 0x7f224c15a330 2023-10-06T03:03:47.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.637+0000 7f2251065700 1 -- 172.21.15.57:0/3799773565 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2244009a20 con 0x7f224c15a330 2023-10-06T03:03:47.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.637+0000 7f2242ffd700 1 -- 172.21.15.57:0/3799773565 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22440279d0 con 0x7f224c15a330 2023-10-06T03:03:47.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.637+0000 7f2251065700 1 -- 172.21.15.57:0/3799773565 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f224c0acc30 con 0x7f224c15a330 2023-10-06T03:03:47.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.637+0000 7f2251065700 1 -- 172.21.15.57:0/3799773565 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f224c06b970 con 0x7f224c15a330 2023-10-06T03:03:47.641 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.637+0000 7f2242ffd700 1 -- 172.21.15.57:0/3799773565 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f2244024070 con 0x7f224c15a330 2023-10-06T03:03:47.643 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.641+0000 7f2242ffd700 1 --2- 172.21.15.57:0/3799773565 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f222c060550 0x7f222c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:47.643 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.641+0000 7f2242ffd700 1 -- 172.21.15.57:0/3799773565 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6202+0+0 (secure 0 0 0) 0x7f224407f440 con 0x7f224c15a330 2023-10-06T03:03:47.643 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.641+0000 7f224ad9d700 1 --2- 172.21.15.57:0/3799773565 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f222c060550 0x7f222c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:47.644 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.641+0000 7f224ad9d700 1 --2- 172.21.15.57:0/3799773565 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f222c060550 0x7f222c062a00 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f224c0c2620 tx=0x7f223c009220 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:03:47.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.645+0000 7f2242ffd700 1 -- 172.21.15.57:0/3799773565 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f224404f850 con 0x7f224c15a330 2023-10-06T03:03:47.856 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.853+0000 7f2251065700 1 -- 172.21.15.57:0/3799773565 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f224c0c77f0 con 0x7f224c15a330 2023-10-06T03:03:47.857 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.853+0000 7f2242ffd700 1 -- 172.21.15.57:0/3799773565 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4598 (secure 0 0 0) 0x7f2244052e70 con 0x7f224c15a330 2023-10-06T03:03:47.858 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:03:47.858 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":38,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5222,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/879829980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":879829980},{"type":"v1","addr":"172.21.15.105:6833","nonce":879829980}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5225,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/3705921279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":3705921279},{"type":"v1","addr":"172.21.15.105:6835","nonce":3705921279}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/251759282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":251759282},{"type":"v1","addr":"172.21.15.57:6835","nonce":251759282}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:02:39.274111+0000","modified":"2023-10-06T03:02:56.856783+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":54,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5643},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5643":{"gid":5643,"name":"c","rank":0,"incarnation":34,"state":"up:active","state_seq":5,"addr":"172.21.15.57:6837/3347844181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6836","nonce":3347844181},{"type":"v1","addr":"172.21.15.57:6837","nonce":3347844181}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T03:03:47.860 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.857+0000 7f2251065700 1 -- 172.21.15.57:0/3799773565 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f222c060550 msgr2=0x7f222c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:47.860 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.857+0000 7f2251065700 1 --2- 172.21.15.57:0/3799773565 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f222c060550 0x7f222c062a00 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f224c0c2620 tx=0x7f223c009220 comp rx=0 tx=0).stop 2023-10-06T03:03:47.860 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.857+0000 7f2251065700 1 -- 172.21.15.57:0/3799773565 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f224c15a330 msgr2=0x7f224c156b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:47.860 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.857+0000 7f2251065700 1 --2- 172.21.15.57:0/3799773565 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f224c15a330 0x7f224c156b90 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f224c06c590 tx=0x7f2244019000 comp rx=0 tx=0).stop 2023-10-06T03:03:47.861 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.857+0000 7f2251065700 1 -- 172.21.15.57:0/3799773565 shutdown_connections 2023-10-06T03:03:47.861 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.857+0000 7f2251065700 1 --2- 172.21.15.57:0/3799773565 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f224c15a330 0x7f224c156b90 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:47.861 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.857+0000 7f2251065700 1 --2- 172.21.15.57:0/3799773565 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f224c1561e0 0x7f224c156650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:47.861 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.857+0000 7f2251065700 1 --2- 172.21.15.57:0/3799773565 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f222c060550 0x7f222c062a00 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:47.861 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.857+0000 7f2251065700 1 --2- 172.21.15.57:0/3799773565 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f224c155e10 0x7f224c13d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:47.862 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.857+0000 7f2251065700 1 -- 172.21.15.57:0/3799773565 >> 172.21.15.57:0/3799773565 conn(0x7f224c0cbed0 msgr2=0x7f224c1516c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:03:47.862 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.857+0000 7f2251065700 1 -- 172.21.15.57:0/3799773565 shutdown_connections 2023-10-06T03:03:47.862 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:47.857+0000 7f2251065700 1 -- 172.21.15.57:0/3799773565 wait complete. 2023-10-06T03:03:47.863 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 38 2023-10-06T03:03:47.884 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json perf dump 2023-10-06T03:03:48.053 INFO:teuthology.orchestra.run.smithi057.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":110,"msgr_send_messages":51,"msgr_recv_bytes":129065,"msgr_send_bytes":53389,"msgr_created_connections":10,"msgr_active_connections":3,"msgr_running_total_time":0.040361744,"msgr_running_send_time":0.014850607,"msgr_running_recv_time":0.018574472,"msgr_running_fast_dispatch_time":0.005007536,"msgr_send_messages_queue_lat":{"avgcount":51,"sum":0.008307583,"avgtime":0.000162893},"msgr_handle_ack_lat":{"avgcount":13,"sum":0.000012183,"avgtime":0.000000937}},"AsyncMessenger::Worker-1":{"msgr_recv_messages":23,"msgr_send_messages":37,"msgr_recv_bytes":10425,"msgr_send_bytes":117038,"msgr_created_connections":6,"msgr_active_connections":4,"msgr_running_total_time":0.010365326,"msgr_running_send_time":0.003636954,"msgr_running_recv_time":0.005299229,"msgr_running_fast_dispatch_time":0.000710141,"msgr_send_messages_queue_lat":{"avgcount":35,"sum":0.006551288,"avgtime":0.000187179},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"AsyncMessenger::Worker-2":{"msgr_recv_messages":20,"msgr_send_messages":22,"msgr_recv_bytes":11983,"msgr_send_bytes":8050,"msgr_created_connections":6,"msgr_active_connections":4,"msgr_running_total_time":0.007636747,"msgr_running_send_time":0.001239964,"msgr_running_recv_time":0.005039416,"msgr_running_fast_dispatch_time":0.000906217,"msgr_send_messages_queue_lat":{"avgcount":20,"sum":0.008468163,"avgtime":0.000423408},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":0,"complete_latency":{"avgcount":48,"sum":0.005510279,"avgtime":0.000114797}},"finisher-PurgeQueue":{"queue_len":0,"complete_latency":{"avgcount":4,"sum":0.000177735,"avgtime":0.000044433}},"mds":{"request":4,"reply":2,"reply_latency":{"avgcount":2,"sum":0.005332595,"avgtime":0.002666297},"slow_reply":0,"forward":0,"dir_fetch":12,"dir_commit":0,"dir_split":0,"dir_merge":0,"inodes":11,"inodes_top":0,"inodes_bottom":11,"inodes_pin_tail":0,"inodes_pinned":11,"inodes_expired":0,"inodes_with_caps":1,"caps":1,"subtrees":2,"traverse":4,"traverse_hit":4,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":0,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":1,"root_rbytes":7,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":0,"ceph_cap_op_grant":0,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":1,"handle_client_caps_dirty":1,"handle_client_cap_release":1,"process_request_cap_release":1},"mds_cache":{"num_strays":0,"num_strays_delayed":0,"num_strays_enqueuing":0,"strays_created":0,"strays_enqueued":0,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0},"mds_log":{"evadd":5,"evex":0,"evtrm":0,"ev":7,"evexg":0,"evexd":0,"segadd":0,"segex":0,"segtrm":0,"seg":1,"segexg":0,"segexd":0,"expos":4194304,"wrpos":4201859,"rdpos":4195196,"jlat":{"avgcount":5,"sum":0.020214289,"avgtime":0.004042857},"replayed":2},"mds_mem":{"ino":14,"ino+":14,"ino-":0,"dir":12,"dir+":12,"dir-":0,"dn":11,"dn+":11,"dn-":0,"cap":1,"cap+":2,"cap-":1,"rss":42972,"heap":223456},"mds_server":{"dispatch_client_request":3,"dispatch_server_request":0,"handle_client_request":4,"handle_client_session":3,"handle_peer_request":0,"req_create_latency":{"avgcount":1,"sum":0.005055413,"avgtime":0.005055413},"req_getattr_latency":{"avgcount":1,"sum":0.000277182,"avgtime":0.000277182},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_readdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"cap_revoke_eviction":0,"cap_acquisition_throttle":0,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":1,"session_add":1,"session_remove":0,"sessions_open":1,"sessions_stale":0,"total_load":1,"average_load":1,"avg_session_uptime":963,"mdthresh_evicted":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_Buffer_bytes":0,"bluestore_Buffer_items":0,"bluestore_Extent_bytes":0,"bluestore_Extent_items":0,"bluestore_Blob_bytes":0,"bluestore_Blob_items":0,"bluestore_SharedBlob_bytes":0,"bluestore_SharedBlob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":225511,"buffer_anon_items":66,"buffer_meta_bytes":0,"buffer_meta_items":0,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":6528,"osdmap_items":97,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":53439,"mds_co_items":231,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":48,"op_send_bytes":7871,"op_resend":0,"op_reply":48,"oplen_avg":{"avgcount":48,"sum":86},"op":48,"op_r":26,"op_w":22,"op_rmw":0,"op_pg":0,"osdop_stat":2,"osdop_create":0,"osdop_read":8,"osdop_write":5,"osdop_writefull":2,"osdop_writesame":0,"osdop_append":0,"osdop_zero":1,"osdop_truncate":0,"osdop_delete":5,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":14,"osdop_setxattr":0,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":56,"map_full":0,"map_inc":2,"osd_sessions":8,"osd_session_open":8,"osd_session_close":0,"osd_laggy":0,"omap_wr":16,"omap_rd":28,"omap_del":5},"oft":{"omap_total_objs":1,"omap_total_kv_pairs":1,"omap_total_updates":3,"omap_total_removes":1},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":0,"pq_executing":0,"pq_executing_high_water":0,"pq_executed":0,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":0,"max":104857600,"get_started":0,"get":149,"get_sum":135689,"get_or_fail_fail":0,"get_or_fail_success":149,"take":0,"take_sum":0,"put":149,"put_sum":135689,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":48,"take_sum":8797,"put":48,"put_sum":8797,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":48,"take_sum":48,"put":48,"put_sum":48,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":0,"take_sum":0,"put":0,"put_sum":0,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x55d33e7a4000":{"val":0,"max":3758096384,"get_started":0,"get":5,"get_sum":6405,"get_or_fail_fail":0,"get_or_fail_success":5,"take":0,"take_sum":0,"put":5,"put_sum":6405,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}}} 2023-10-06T03:03:48.055 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 3, "msgr_created_connections": 10, "msgr_handle_ack_lat": { "avgcount": 13, "avgtime": 9.37e-07, "sum": 1.2183e-05 }, "msgr_recv_bytes": 129065, "msgr_recv_messages": 110, "msgr_running_fast_dispatch_time": 0.005007536, "msgr_running_recv_time": 0.018574472, "msgr_running_send_time": 0.014850607, "msgr_running_total_time": 0.040361744, "msgr_send_bytes": 53389, "msgr_send_messages": 51, "msgr_send_messages_queue_lat": { "avgcount": 51, "avgtime": 0.000162893, "sum": 0.008307583 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 4, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 10425, "msgr_recv_messages": 23, "msgr_running_fast_dispatch_time": 0.000710141, "msgr_running_recv_time": 0.005299229, "msgr_running_send_time": 0.003636954, "msgr_running_total_time": 0.010365326, "msgr_send_bytes": 117038, "msgr_send_messages": 37, "msgr_send_messages_queue_lat": { "avgcount": 35, "avgtime": 0.000187179, "sum": 0.006551288 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 4, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 11983, "msgr_recv_messages": 20, "msgr_running_fast_dispatch_time": 0.000906217, "msgr_running_recv_time": 0.005039416, "msgr_running_send_time": 0.001239964, "msgr_running_total_time": 0.007636747, "msgr_send_bytes": 8050, "msgr_send_messages": 22, "msgr_send_messages_queue_lat": { "avgcount": 20, "avgtime": 0.000423408, "sum": 0.008468163 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 48, "avgtime": 0.000114797, "sum": 0.005510279 }, "queue_len": 0 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 4, "avgtime": 4.4433e-05, "sum": 0.000177735 }, "queue_len": 0 }, "mds": { "caps": 1, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 0, "ceph_cap_op_revoke": 0, "ceph_cap_op_trunc": 0, "dir_commit": 0, "dir_fetch": 12, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 1, "handle_client_caps": 1, "handle_client_caps_dirty": 1, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 11, "inodes_bottom": 11, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 11, "inodes_top": 0, "inodes_with_caps": 1, "load_cent": 0, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 1, "q": 0, "reply": 2, "reply_latency": { "avgcount": 2, "avgtime": 0.002666297, "sum": 0.005332595 }, "request": 4, "root_rbytes": 7, "root_rfiles": 1, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 4, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 4, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 0, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 0, "strays_enqueued": 0, "strays_migrated": 0, "strays_reintegrated": 0 }, "mds_log": { "ev": 7, "evadd": 5, "evex": 0, "evexd": 0, "evexg": 0, "evtrm": 0, "expos": 4194304, "jlat": { "avgcount": 5, "avgtime": 0.004042857, "sum": 0.020214289 }, "rdpos": 4195196, "replayed": 2, "seg": 1, "segadd": 0, "segex": 0, "segexd": 0, "segexg": 0, "segtrm": 0, "wrpos": 4201859 }, "mds_mem": { "cap": 1, "cap+": 2, "cap-": 1, "dir": 12, "dir+": 12, "dir-": 0, "dn": 11, "dn+": 11, "dn-": 0, "heap": 223456, "ino": 14, "ino+": 14, "ino-": 0, "rss": 42972 }, "mds_server": { "cap_acquisition_throttle": 0, "cap_revoke_eviction": 0, "dispatch_client_request": 3, "dispatch_server_request": 0, "handle_client_request": 4, "handle_client_session": 3, "handle_peer_request": 0, "req_create_latency": { "avgcount": 1, "avgtime": 0.005055413, "sum": 0.005055413 }, "req_getattr_latency": { "avgcount": 1, "avgtime": 0.000277182, "sum": 0.000277182 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_readdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "mds_sessions": { "average_load": 1, "avg_session_uptime": 963, "mdthresh_evicted": 0, "session_add": 1, "session_count": 1, "session_remove": 0, "sessions_open": 1, "sessions_stale": 0, "total_load": 1 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_Blob_bytes": 0, "bluestore_Blob_items": 0, "bluestore_Buffer_bytes": 0, "bluestore_Buffer_items": 0, "bluestore_Extent_bytes": 0, "bluestore_Extent_items": 0, "bluestore_SharedBlob_bytes": 0, "bluestore_SharedBlob_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 225511, "buffer_anon_items": 66, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "mds_co_bytes": 53439, "mds_co_items": 231, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 6528, "osdmap_items": 97, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 56, "map_full": 0, "map_inc": 2, "omap_del": 5, "omap_rd": 28, "omap_wr": 16, "op": 48, "op_active": 0, "op_laggy": 0, "op_pg": 0, "op_r": 26, "op_reply": 48, "op_resend": 0, "op_rmw": 0, "op_send": 48, "op_send_bytes": 7871, "op_w": 22, "oplen_avg": { "avgcount": 48, "sum": 86 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 8, "osd_sessions": 8, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 0, "osdop_delete": 5, "osdop_getxattr": 14, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 8, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 0, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 2, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 5, "osdop_writefull": 2, "osdop_writesame": 0, "osdop_zero": 1, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 1, "omap_total_objs": 1, "omap_total_removes": 1, "omap_total_updates": 3 }, "purge_queue": { "pq_executed": 0, "pq_executing": 0, "pq_executing_high_water": 0, "pq_executing_ops": 0, "pq_executing_ops_high_water": 0, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 149, "get_or_fail_fail": 0, "get_or_fail_success": 149, "get_started": 0, "get_sum": 135689, "max": 104857600, "put": 149, "put_sum": 135689, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 48, "put_sum": 8797, "take": 48, "take_sum": 8797, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 48, "put_sum": 48, "take": 48, "take_sum": 48, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 3758096384, "put": 0, "put_sum": 0, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x55d33e7a4000": { "get": 5, "get_or_fail_fail": 0, "get_or_fail_success": 5, "get_started": 0, "get_sum": 6405, "max": 3758096384, "put": 5, "put_sum": 6405, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } } } 2023-10-06T03:03:48.056 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-06T03:03:48.056 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:03:48.216 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:48.213+0000 7f36bcf85700 1 Processor -- start 2023-10-06T03:03:48.216 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:48.213+0000 7f36bcf85700 1 -- start start 2023-10-06T03:03:48.218 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:48.213+0000 7f36bcf85700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f36b815d6a0 0x7f36b80c6510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:48.218 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:48.213+0000 7f36bcf85700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f36b80c1e30 0x7f36b80c6a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:48.218 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:48.213+0000 7f36bcf85700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36b80cb0a0 con 0x7f36b80c9fb0 2023-10-06T03:03:48.218 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:48.213+0000 7f36bcf85700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36b80ca490 con 0x7f36b815d6a0 2023-10-06T03:03:48.219 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:48.213+0000 7f36bcf85700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36b80ca770 con 0x7f36b80c1e30 2023-10-06T03:03:48.219 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:48.217+0000 7f36b659c700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f36b815d6a0 0x7f36b80c6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:48.219 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:48.217+0000 7f36b659c700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f36b815d6a0 0x7f36b80c6510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.57:39524/0 (socket says 172.21.15.57:39524) 2023-10-06T03:03:48.219 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:48.217+0000 7f36b659c700 1 -- 172.21.15.57:0/1758294415 learned_addr learned my addr 172.21.15.57:0/1758294415 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:03:48.219 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:48.217+0000 7f36b6d9d700 1 --2- 172.21.15.57:0/1758294415 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f36b80c1e30 0x7f36b80c6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:48.220 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:48.217+0000 7f36b659c700 1 -- 172.21.15.57:0/1758294415 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f36b80c1e30 msgr2=0x7f36b80c6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:03:48.220 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:48.217+0000 7f36b659c700 1 --2- 172.21.15.57:0/1758294415 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f36b80c1e30 0x7f36b80c6a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:48.220 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:48.217+0000 7f36b659c700 1 -- 172.21.15.57:0/1758294415 >> v1:172.21.15.105:6789/0 conn(0x7f36b80c9fb0 legacy=0x7f36b815da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:48.220 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:48.217+0000 7f36b659c700 1 -- 172.21.15.57:0/1758294415 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36b80caa50 con 0x7f36b815d6a0 2023-10-06T03:03:48.221 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:48.217+0000 7f36b659c700 1 --2- 172.21.15.57:0/1758294415 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f36b815d6a0 0x7f36b80c6510 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f36a8009990 tx=0x7f36a8009220 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dacd8af16d872f3c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:03:48.221 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:48.217+0000 7f36b5d9b700 1 -- 172.21.15.57:0/1758294415 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a8009e20 con 0x7f36b815d6a0 2023-10-06T03:03:48.221 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:48.217+0000 7f36b5d9b700 1 -- 172.21.15.57:0/1758294415 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36a800b760 con 0x7f36b815d6a0 2023-10-06T03:03:48.221 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:48.217+0000 7f36b5d9b700 1 -- 172.21.15.57:0/1758294415 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a800bb00 con 0x7f36b815d6a0 2023-10-06T03:03:48.222 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:48.217+0000 7f36bcf85700 1 -- 172.21.15.57:0/1758294415 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f36b815d6a0 msgr2=0x7f36b80c6510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:48.222 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:48.217+0000 7f36bcf85700 1 --2- 172.21.15.57:0/1758294415 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f36b815d6a0 0x7f36b80c6510 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f36a8009990 tx=0x7f36a8009220 comp rx=0 tx=0).stop 2023-10-06T03:03:48.223 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:48.221+0000 7f36bcf85700 1 -- 172.21.15.57:0/1758294415 shutdown_connections 2023-10-06T03:03:48.223 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:48.221+0000 7f36bcf85700 1 --2- 172.21.15.57:0/1758294415 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f36b80c1e30 0x7f36b80c6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:48.223 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:48.221+0000 7f36bcf85700 1 --2- 172.21.15.57:0/1758294415 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f36b815d6a0 0x7f36b80c6510 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:48.223 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:48.221+0000 7f36bcf85700 1 -- 172.21.15.57:0/1758294415 >> 172.21.15.57:0/1758294415 conn(0x7f36b80cbed0 msgr2=0x7f36b80cc2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:03:48.223 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:48.221+0000 7f36bcf85700 1 -- 172.21.15.57:0/1758294415 shutdown_connections 2023-10-06T03:03:48.223 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:48.221+0000 7f36bcf85700 1 -- 172.21.15.57:0/1758294415 wait complete. 2023-10-06T03:03:48.226 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:48.221+0000 7f36bcf85700 1 Processor -- start 2023-10-06T03:03:48.226 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:48.221+0000 7f36bcf85700 1 -- start start 2023-10-06T03:03:48.228 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:48.225+0000 7f36bcf85700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f36b80c1e30 0x7f36b8157ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:48.228 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:48.225+0000 7f36bcf85700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f36b80c9fb0 0x7f36b815a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:48.228 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:48.225+0000 7f36bcf85700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f36b815d6a0 0x7f36b80c3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:48.228 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:48.225+0000 7f36bcf85700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36b81580e0 con 0x7f36b815d6a0 2023-10-06T03:03:48.228 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:48.225+0000 7f36bcf85700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36b80af6b0 con 0x7f36b80c1e30 2023-10-06T03:03:48.228 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:48.225+0000 7f36bcf85700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36b80c44e0 con 0x7f36b80c9fb0 2023-10-06T03:03:48.229 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:48.225+0000 7f36b6d9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f36b815d6a0 0x7f36b80c3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:48.229 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:48.225+0000 7f36b6d9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f36b815d6a0 0x7f36b80c3940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:49938/0 (socket says 172.21.15.57:49938) 2023-10-06T03:03:48.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:48.225+0000 7f36b6d9d700 1 -- 172.21.15.57:0/3014528557 learned_addr learned my addr 172.21.15.57:0/3014528557 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:03:48.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:48.225+0000 7f36b659c700 1 --2- 172.21.15.57:0/3014528557 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f36b80c1e30 0x7f36b8157ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:48.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:48.225+0000 7f36affff700 1 --2- 172.21.15.57:0/3014528557 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f36b80c9fb0 0x7f36b815a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:48.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:48.225+0000 7f36b6d9d700 1 -- 172.21.15.57:0/3014528557 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f36b80c9fb0 msgr2=0x7f36b815a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:48.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:48.225+0000 7f36b6d9d700 1 --2- 172.21.15.57:0/3014528557 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f36b80c9fb0 0x7f36b815a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:48.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:48.225+0000 7f36b6d9d700 1 -- 172.21.15.57:0/3014528557 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f36b80c1e30 msgr2=0x7f36b8157ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:48.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:48.225+0000 7f36b6d9d700 1 --2- 172.21.15.57:0/3014528557 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f36b80c1e30 0x7f36b8157ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:48.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:48.225+0000 7f36b6d9d700 1 -- 172.21.15.57:0/3014528557 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36a8009480 con 0x7f36b815d6a0 2023-10-06T03:03:48.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:48.225+0000 7f36affff700 1 --2- 172.21.15.57:0/3014528557 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f36b80c9fb0 0x7f36b815a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:03:48.231 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:48.225+0000 7f36b6d9d700 1 --2- 172.21.15.57:0/3014528557 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f36b815d6a0 0x7f36b80c3940 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f36b0009df0 tx=0x7f36b000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:03:48.231 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:48.229+0000 7f36ae7fc700 1 -- 172.21.15.57:0/3014528557 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36b000cb50 con 0x7f36b815d6a0 2023-10-06T03:03:48.231 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:48.229+0000 7f36ae7fc700 1 -- 172.21.15.57:0/3014528557 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36b000f040 con 0x7f36b815d6a0 2023-10-06T03:03:48.231 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:48.229+0000 7f36bcf85700 1 -- 172.21.15.57:0/3014528557 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36b80b18f0 con 0x7f36b815d6a0 2023-10-06T03:03:48.231 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:48.229+0000 7f36ae7fc700 1 -- 172.21.15.57:0/3014528557 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36b0014480 con 0x7f36b815d6a0 2023-10-06T03:03:48.231 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:48.229+0000 7f36bcf85700 1 -- 172.21.15.57:0/3014528557 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36b80af060 con 0x7f36b815d6a0 2023-10-06T03:03:48.233 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:48.229+0000 7f36bcf85700 1 -- 172.21.15.57:0/3014528557 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36b80af840 con 0x7f36b815d6a0 2023-10-06T03:03:48.234 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:48.233+0000 7f36ae7fc700 1 -- 172.21.15.57:0/3014528557 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f36b00147f0 con 0x7f36b815d6a0 2023-10-06T03:03:48.237 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:48.233+0000 7f36ae7fc700 1 --2- 172.21.15.57:0/3014528557 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f3698060550 0x7f3698062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:48.237 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:48.233+0000 7f36ae7fc700 1 -- 172.21.15.57:0/3014528557 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6202+0+0 (secure 0 0 0) 0x7f36b007d610 con 0x7f36b815d6a0 2023-10-06T03:03:48.237 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:48.233+0000 7f36b659c700 1 --2- 172.21.15.57:0/3014528557 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f3698060550 0x7f3698062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:48.238 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:48.237+0000 7f36b659c700 1 --2- 172.21.15.57:0/3014528557 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f3698060550 0x7f3698062a00 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f36a8009260 tx=0x7f36a8016000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:03:48.243 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:48.241+0000 7f36ae7fc700 1 -- 172.21.15.57:0/3014528557 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f36b004d970 con 0x7f36b815d6a0 2023-10-06T03:03:48.391 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:03:48.398 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:03:48.453 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:48.449+0000 7f36bcf85700 1 -- 172.21.15.57:0/3014528557 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f36b80cad30 con 0x7f36b815d6a0 2023-10-06T03:03:48.454 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:48.449+0000 7f36ae7fc700 1 -- 172.21.15.57:0/3014528557 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4598 (secure 0 0 0) 0x7f36b0050f90 con 0x7f36b815d6a0 2023-10-06T03:03:48.454 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:03:48.454 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":38,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5222,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/879829980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":879829980},{"type":"v1","addr":"172.21.15.105:6833","nonce":879829980}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5225,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/3705921279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":3705921279},{"type":"v1","addr":"172.21.15.105:6835","nonce":3705921279}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/251759282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":251759282},{"type":"v1","addr":"172.21.15.57:6835","nonce":251759282}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:02:39.274111+0000","modified":"2023-10-06T03:02:56.856783+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":54,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5643},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5643":{"gid":5643,"name":"c","rank":0,"incarnation":34,"state":"up:active","state_seq":5,"addr":"172.21.15.57:6837/3347844181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6836","nonce":3347844181},{"type":"v1","addr":"172.21.15.57:6837","nonce":3347844181}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T03:03:48.457 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:48.453+0000 7f36bcf85700 1 -- 172.21.15.57:0/3014528557 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f3698060550 msgr2=0x7f3698062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:48.457 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:48.453+0000 7f36bcf85700 1 --2- 172.21.15.57:0/3014528557 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f3698060550 0x7f3698062a00 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f36a8009260 tx=0x7f36a8016000 comp rx=0 tx=0).stop 2023-10-06T03:03:48.457 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:48.453+0000 7f36bcf85700 1 -- 172.21.15.57:0/3014528557 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f36b815d6a0 msgr2=0x7f36b80c3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:48.457 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:48.453+0000 7f36bcf85700 1 --2- 172.21.15.57:0/3014528557 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f36b815d6a0 0x7f36b80c3940 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f36b0009df0 tx=0x7f36b000b040 comp rx=0 tx=0).stop 2023-10-06T03:03:48.457 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:48.453+0000 7f36bcf85700 1 -- 172.21.15.57:0/3014528557 shutdown_connections 2023-10-06T03:03:48.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:48.453+0000 7f36bcf85700 1 --2- 172.21.15.57:0/3014528557 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f36b815d6a0 0x7f36b80c3940 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:48.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:48.453+0000 7f36bcf85700 1 --2- 172.21.15.57:0/3014528557 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f3698060550 0x7f3698062a00 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:48.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:48.453+0000 7f36bcf85700 1 --2- 172.21.15.57:0/3014528557 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f36b80c9fb0 0x7f36b815a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:48.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:48.453+0000 7f36bcf85700 1 --2- 172.21.15.57:0/3014528557 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f36b80c1e30 0x7f36b8157ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:48.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:48.453+0000 7f36bcf85700 1 -- 172.21.15.57:0/3014528557 >> 172.21.15.57:0/3014528557 conn(0x7f36b80cbed0 msgr2=0x7f36b806a100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:03:48.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:48.453+0000 7f36bcf85700 1 -- 172.21.15.57:0/3014528557 shutdown_connections 2023-10-06T03:03:48.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:48.453+0000 7f36bcf85700 1 -- 172.21.15.57:0/3014528557 wait complete. 2023-10-06T03:03:48.459 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 38 2023-10-06T03:03:48.476 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json perf dump 2023-10-06T03:03:48.697 INFO:teuthology.orchestra.run.smithi057.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":111,"msgr_send_messages":51,"msgr_recv_bytes":129467,"msgr_send_bytes":53389,"msgr_created_connections":10,"msgr_active_connections":3,"msgr_running_total_time":0.040546239,"msgr_running_send_time":0.014930913,"msgr_running_recv_time":0.018608606,"msgr_running_fast_dispatch_time":0.005074474,"msgr_send_messages_queue_lat":{"avgcount":51,"sum":0.008307583,"avgtime":0.000162893},"msgr_handle_ack_lat":{"avgcount":13,"sum":0.000012183,"avgtime":0.000000937}},"AsyncMessenger::Worker-1":{"msgr_recv_messages":23,"msgr_send_messages":37,"msgr_recv_bytes":10425,"msgr_send_bytes":117038,"msgr_created_connections":6,"msgr_active_connections":4,"msgr_running_total_time":0.010365326,"msgr_running_send_time":0.003636954,"msgr_running_recv_time":0.005299229,"msgr_running_fast_dispatch_time":0.000710141,"msgr_send_messages_queue_lat":{"avgcount":35,"sum":0.006551288,"avgtime":0.000187179},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"AsyncMessenger::Worker-2":{"msgr_recv_messages":20,"msgr_send_messages":22,"msgr_recv_bytes":11983,"msgr_send_bytes":8050,"msgr_created_connections":6,"msgr_active_connections":4,"msgr_running_total_time":0.007636747,"msgr_running_send_time":0.001239964,"msgr_running_recv_time":0.005039416,"msgr_running_fast_dispatch_time":0.000906217,"msgr_send_messages_queue_lat":{"avgcount":20,"sum":0.008468163,"avgtime":0.000423408},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":0,"complete_latency":{"avgcount":48,"sum":0.005510279,"avgtime":0.000114797}},"finisher-PurgeQueue":{"queue_len":0,"complete_latency":{"avgcount":4,"sum":0.000177735,"avgtime":0.000044433}},"mds":{"request":4,"reply":2,"reply_latency":{"avgcount":2,"sum":0.005332595,"avgtime":0.002666297},"slow_reply":0,"forward":0,"dir_fetch":12,"dir_commit":0,"dir_split":0,"dir_merge":0,"inodes":11,"inodes_top":0,"inodes_bottom":11,"inodes_pin_tail":0,"inodes_pinned":11,"inodes_expired":0,"inodes_with_caps":1,"caps":1,"subtrees":2,"traverse":4,"traverse_hit":4,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":0,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":1,"root_rbytes":7,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":0,"ceph_cap_op_grant":0,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":1,"handle_client_caps_dirty":1,"handle_client_cap_release":1,"process_request_cap_release":1},"mds_cache":{"num_strays":0,"num_strays_delayed":0,"num_strays_enqueuing":0,"strays_created":0,"strays_enqueued":0,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0},"mds_log":{"evadd":5,"evex":0,"evtrm":0,"ev":7,"evexg":0,"evexd":0,"segadd":0,"segex":0,"segtrm":0,"seg":1,"segexg":0,"segexd":0,"expos":4194304,"wrpos":4201859,"rdpos":4195196,"jlat":{"avgcount":5,"sum":0.020214289,"avgtime":0.004042857},"replayed":2},"mds_mem":{"ino":14,"ino+":14,"ino-":0,"dir":12,"dir+":12,"dir-":0,"dn":11,"dn+":11,"dn-":0,"cap":1,"cap+":2,"cap-":1,"rss":42972,"heap":223456},"mds_server":{"dispatch_client_request":3,"dispatch_server_request":0,"handle_client_request":4,"handle_client_session":3,"handle_peer_request":0,"req_create_latency":{"avgcount":1,"sum":0.005055413,"avgtime":0.005055413},"req_getattr_latency":{"avgcount":1,"sum":0.000277182,"avgtime":0.000277182},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_readdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"cap_revoke_eviction":0,"cap_acquisition_throttle":0,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":1,"session_add":1,"session_remove":0,"sessions_open":1,"sessions_stale":0,"total_load":1,"average_load":1,"avg_session_uptime":963,"mdthresh_evicted":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_Buffer_bytes":0,"bluestore_Buffer_items":0,"bluestore_Extent_bytes":0,"bluestore_Extent_items":0,"bluestore_Blob_bytes":0,"bluestore_Blob_items":0,"bluestore_SharedBlob_bytes":0,"bluestore_SharedBlob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":225511,"buffer_anon_items":66,"buffer_meta_bytes":0,"buffer_meta_items":0,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":6528,"osdmap_items":97,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":53439,"mds_co_items":231,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":48,"op_send_bytes":7871,"op_resend":0,"op_reply":48,"oplen_avg":{"avgcount":48,"sum":86},"op":48,"op_r":26,"op_w":22,"op_rmw":0,"op_pg":0,"osdop_stat":2,"osdop_create":0,"osdop_read":8,"osdop_write":5,"osdop_writefull":2,"osdop_writesame":0,"osdop_append":0,"osdop_zero":1,"osdop_truncate":0,"osdop_delete":5,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":14,"osdop_setxattr":0,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":56,"map_full":0,"map_inc":2,"osd_sessions":8,"osd_session_open":8,"osd_session_close":0,"osd_laggy":0,"omap_wr":16,"omap_rd":28,"omap_del":5},"oft":{"omap_total_objs":1,"omap_total_kv_pairs":1,"omap_total_updates":3,"omap_total_removes":1},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":0,"pq_executing":0,"pq_executing_high_water":0,"pq_executed":0,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":0,"max":104857600,"get_started":0,"get":150,"get_sum":136017,"get_or_fail_fail":0,"get_or_fail_success":150,"take":0,"take_sum":0,"put":150,"put_sum":136017,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":48,"take_sum":8797,"put":48,"put_sum":8797,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":48,"take_sum":48,"put":48,"put_sum":48,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":0,"take_sum":0,"put":0,"put_sum":0,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x55d33e7a4000":{"val":0,"max":3758096384,"get_started":0,"get":5,"get_sum":6405,"get_or_fail_fail":0,"get_or_fail_success":5,"take":0,"take_sum":0,"put":5,"put_sum":6405,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}}} 2023-10-06T03:03:48.699 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 3, "msgr_created_connections": 10, "msgr_handle_ack_lat": { "avgcount": 13, "avgtime": 9.37e-07, "sum": 1.2183e-05 }, "msgr_recv_bytes": 129467, "msgr_recv_messages": 111, "msgr_running_fast_dispatch_time": 0.005074474, "msgr_running_recv_time": 0.018608606, "msgr_running_send_time": 0.014930913, "msgr_running_total_time": 0.040546239, "msgr_send_bytes": 53389, "msgr_send_messages": 51, "msgr_send_messages_queue_lat": { "avgcount": 51, "avgtime": 0.000162893, "sum": 0.008307583 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 4, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 10425, "msgr_recv_messages": 23, "msgr_running_fast_dispatch_time": 0.000710141, "msgr_running_recv_time": 0.005299229, "msgr_running_send_time": 0.003636954, "msgr_running_total_time": 0.010365326, "msgr_send_bytes": 117038, "msgr_send_messages": 37, "msgr_send_messages_queue_lat": { "avgcount": 35, "avgtime": 0.000187179, "sum": 0.006551288 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 4, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 11983, "msgr_recv_messages": 20, "msgr_running_fast_dispatch_time": 0.000906217, "msgr_running_recv_time": 0.005039416, "msgr_running_send_time": 0.001239964, "msgr_running_total_time": 0.007636747, "msgr_send_bytes": 8050, "msgr_send_messages": 22, "msgr_send_messages_queue_lat": { "avgcount": 20, "avgtime": 0.000423408, "sum": 0.008468163 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 48, "avgtime": 0.000114797, "sum": 0.005510279 }, "queue_len": 0 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 4, "avgtime": 4.4433e-05, "sum": 0.000177735 }, "queue_len": 0 }, "mds": { "caps": 1, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 0, "ceph_cap_op_revoke": 0, "ceph_cap_op_trunc": 0, "dir_commit": 0, "dir_fetch": 12, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 1, "handle_client_caps": 1, "handle_client_caps_dirty": 1, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 11, "inodes_bottom": 11, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 11, "inodes_top": 0, "inodes_with_caps": 1, "load_cent": 0, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 1, "q": 0, "reply": 2, "reply_latency": { "avgcount": 2, "avgtime": 0.002666297, "sum": 0.005332595 }, "request": 4, "root_rbytes": 7, "root_rfiles": 1, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 4, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 4, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 0, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 0, "strays_enqueued": 0, "strays_migrated": 0, "strays_reintegrated": 0 }, "mds_log": { "ev": 7, "evadd": 5, "evex": 0, "evexd": 0, "evexg": 0, "evtrm": 0, "expos": 4194304, "jlat": { "avgcount": 5, "avgtime": 0.004042857, "sum": 0.020214289 }, "rdpos": 4195196, "replayed": 2, "seg": 1, "segadd": 0, "segex": 0, "segexd": 0, "segexg": 0, "segtrm": 0, "wrpos": 4201859 }, "mds_mem": { "cap": 1, "cap+": 2, "cap-": 1, "dir": 12, "dir+": 12, "dir-": 0, "dn": 11, "dn+": 11, "dn-": 0, "heap": 223456, "ino": 14, "ino+": 14, "ino-": 0, "rss": 42972 }, "mds_server": { "cap_acquisition_throttle": 0, "cap_revoke_eviction": 0, "dispatch_client_request": 3, "dispatch_server_request": 0, "handle_client_request": 4, "handle_client_session": 3, "handle_peer_request": 0, "req_create_latency": { "avgcount": 1, "avgtime": 0.005055413, "sum": 0.005055413 }, "req_getattr_latency": { "avgcount": 1, "avgtime": 0.000277182, "sum": 0.000277182 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_readdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "mds_sessions": { "average_load": 1, "avg_session_uptime": 963, "mdthresh_evicted": 0, "session_add": 1, "session_count": 1, "session_remove": 0, "sessions_open": 1, "sessions_stale": 0, "total_load": 1 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_Blob_bytes": 0, "bluestore_Blob_items": 0, "bluestore_Buffer_bytes": 0, "bluestore_Buffer_items": 0, "bluestore_Extent_bytes": 0, "bluestore_Extent_items": 0, "bluestore_SharedBlob_bytes": 0, "bluestore_SharedBlob_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 225511, "buffer_anon_items": 66, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "mds_co_bytes": 53439, "mds_co_items": 231, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 6528, "osdmap_items": 97, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 56, "map_full": 0, "map_inc": 2, "omap_del": 5, "omap_rd": 28, "omap_wr": 16, "op": 48, "op_active": 0, "op_laggy": 0, "op_pg": 0, "op_r": 26, "op_reply": 48, "op_resend": 0, "op_rmw": 0, "op_send": 48, "op_send_bytes": 7871, "op_w": 22, "oplen_avg": { "avgcount": 48, "sum": 86 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 8, "osd_sessions": 8, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 0, "osdop_delete": 5, "osdop_getxattr": 14, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 8, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 0, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 2, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 5, "osdop_writefull": 2, "osdop_writesame": 0, "osdop_zero": 1, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 1, "omap_total_objs": 1, "omap_total_removes": 1, "omap_total_updates": 3 }, "purge_queue": { "pq_executed": 0, "pq_executing": 0, "pq_executing_high_water": 0, "pq_executing_ops": 0, "pq_executing_ops_high_water": 0, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 150, "get_or_fail_fail": 0, "get_or_fail_success": 150, "get_started": 0, "get_sum": 136017, "max": 104857600, "put": 150, "put_sum": 136017, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 48, "put_sum": 8797, "take": 48, "take_sum": 8797, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 48, "put_sum": 48, "take": 48, "take_sum": 48, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 3758096384, "put": 0, "put_sum": 0, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x55d33e7a4000": { "get": 5, "get_or_fail_fail": 0, "get_or_fail_success": 5, "get_started": 0, "get_sum": 6405, "max": 3758096384, "put": 5, "put_sum": 6405, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } } } 2023-10-06T03:03:48.699 INFO:tasks.cephfs.test_openfiletable:omap_total_removes:1 2023-10-06T03:03:48.700 INFO:tasks.cephfs.test_openfiletable:omap_total_kv_pairs:1 2023-10-06T03:03:48.700 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T03:03:48.700 DEBUG:teuthology.orchestra.run.smithi057:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T03:03:48.742 DEBUG:teuthology.orchestra.run.smithi105:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T03:03:48.781 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T03:03:48.781 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-06T03:03:48.781 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:03:48.781 DEBUG:teuthology.orchestra.run.smithi057:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-06T03:03:48.865 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi057.front.sepia.ceph.com 2023-10-06T03:03:48.865 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:03:48.865 DEBUG:teuthology.orchestra.run.smithi057:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T03:03:48.889 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:03:49.105 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.101+0000 7f33f5ccd700 1 Processor -- start 2023-10-06T03:03:49.105 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.101+0000 7f33f5ccd700 1 -- start start 2023-10-06T03:03:49.107 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.105+0000 7f33f5ccd700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f33f015d6a0 0x7f33f00c6510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:49.107 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.105+0000 7f33f5ccd700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f33f00c9fb0 0x7f33f00c6a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:49.107 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.105+0000 7f33f5ccd700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33f00cb0a0 con 0x7f33f0161320 2023-10-06T03:03:49.107 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.105+0000 7f33f5ccd700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33f00ca490 con 0x7f33f00c9fb0 2023-10-06T03:03:49.107 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.105+0000 7f33f5ccd700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33f00ca770 con 0x7f33f015d6a0 2023-10-06T03:03:49.112 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.105+0000 7f33e6ffd700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f33f00c9fb0 0x7f33f00c6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:49.112 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.105+0000 7f33ef7fe700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f33f015d6a0 0x7f33f00c6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:49.112 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.105+0000 7f33e6ffd700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f33f00c9fb0 0x7f33f00c6a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.57:39530/0 (socket says 172.21.15.57:39530) 2023-10-06T03:03:49.112 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.105+0000 7f33e6ffd700 1 -- 172.21.15.57:0/435436653 learned_addr learned my addr 172.21.15.57:0/435436653 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:03:49.112 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.105+0000 7f33e6ffd700 1 -- 172.21.15.57:0/435436653 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f33f015d6a0 msgr2=0x7f33f00c6510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:03:49.112 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.105+0000 7f33e6ffd700 1 --2- 172.21.15.57:0/435436653 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f33f015d6a0 0x7f33f00c6510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:49.112 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.105+0000 7f33e6ffd700 1 -- 172.21.15.57:0/435436653 >> v1:172.21.15.105:6789/0 conn(0x7f33f0161320 legacy=0x7f33f015da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:49.112 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.105+0000 7f33e6ffd700 1 -- 172.21.15.57:0/435436653 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33f00caa50 con 0x7f33f00c9fb0 2023-10-06T03:03:49.113 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.105+0000 7f33e6ffd700 1 --2- 172.21.15.57:0/435436653 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f33f00c9fb0 0x7f33f00c6a50 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f33d80099b0 tx=0x7f33d8009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4581bca97b0c9364 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:03:49.113 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.105+0000 7f33eeffd700 1 -- 172.21.15.57:0/435436653 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d8009ea0 con 0x7f33f00c9fb0 2023-10-06T03:03:49.113 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.105+0000 7f33eeffd700 1 -- 172.21.15.57:0/435436653 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33d800b860 con 0x7f33f00c9fb0 2023-10-06T03:03:49.113 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.105+0000 7f33eeffd700 1 -- 172.21.15.57:0/435436653 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d800bc00 con 0x7f33f00c9fb0 2023-10-06T03:03:49.113 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.109+0000 7f33f5ccd700 1 -- 172.21.15.57:0/435436653 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f33f00c9fb0 msgr2=0x7f33f00c6a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:49.113 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.109+0000 7f33f5ccd700 1 --2- 172.21.15.57:0/435436653 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f33f00c9fb0 0x7f33f00c6a50 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f33d80099b0 tx=0x7f33d8009250 comp rx=0 tx=0).stop 2023-10-06T03:03:49.113 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.109+0000 7f33f5ccd700 1 -- 172.21.15.57:0/435436653 shutdown_connections 2023-10-06T03:03:49.113 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.109+0000 7f33f5ccd700 1 --2- 172.21.15.57:0/435436653 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f33f00c9fb0 0x7f33f00c6a50 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:49.113 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.109+0000 7f33f5ccd700 1 --2- 172.21.15.57:0/435436653 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f33f015d6a0 0x7f33f00c6510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:49.113 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.109+0000 7f33f5ccd700 1 -- 172.21.15.57:0/435436653 >> 172.21.15.57:0/435436653 conn(0x7f33f00cbed0 msgr2=0x7f33f00cc2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:03:49.113 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.109+0000 7f33f5ccd700 1 -- 172.21.15.57:0/435436653 shutdown_connections 2023-10-06T03:03:49.113 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.109+0000 7f33f5ccd700 1 -- 172.21.15.57:0/435436653 wait complete. 2023-10-06T03:03:49.114 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.113+0000 7f33f5ccd700 1 Processor -- start 2023-10-06T03:03:49.115 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.113+0000 7f33f5ccd700 1 -- start start 2023-10-06T03:03:49.116 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.113+0000 7f33f5ccd700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f33f00c9fb0 0x7f33f01621c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:49.116 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.113+0000 7f33f5ccd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f33f015d6a0 0x7f33f015aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:49.116 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.113+0000 7f33f5ccd700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f33f0161320 0x7f33f015afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:49.117 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.113+0000 7f33f5ccd700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33f00ae610 con 0x7f33f015d6a0 2023-10-06T03:03:49.117 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.113+0000 7f33f5ccd700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33f0159330 con 0x7f33f0161320 2023-10-06T03:03:49.117 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.113+0000 7f33f5ccd700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33f01641a0 con 0x7f33f00c9fb0 2023-10-06T03:03:49.118 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.113+0000 7f33e6ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f33f015d6a0 0x7f33f015aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:49.118 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.113+0000 7f33e6ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f33f015d6a0 0x7f33f015aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:49954/0 (socket says 172.21.15.57:49954) 2023-10-06T03:03:49.118 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.113+0000 7f33e6ffd700 1 -- 172.21.15.57:0/1519484858 learned_addr learned my addr 172.21.15.57:0/1519484858 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:03:49.118 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.113+0000 7f33ef7fe700 1 --2- 172.21.15.57:0/1519484858 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f33f00c9fb0 0x7f33f01621c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:49.118 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.113+0000 7f33effff700 1 --2- 172.21.15.57:0/1519484858 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f33f0161320 0x7f33f015afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:49.118 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.113+0000 7f33e6ffd700 1 -- 172.21.15.57:0/1519484858 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f33f00c9fb0 msgr2=0x7f33f01621c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:49.118 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.113+0000 7f33e6ffd700 1 --2- 172.21.15.57:0/1519484858 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f33f00c9fb0 0x7f33f01621c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:49.118 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.113+0000 7f33e6ffd700 1 -- 172.21.15.57:0/1519484858 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f33f0161320 msgr2=0x7f33f015afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:49.119 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.113+0000 7f33e6ffd700 1 --2- 172.21.15.57:0/1519484858 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f33f0161320 0x7f33f015afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:49.119 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.113+0000 7f33e6ffd700 1 -- 172.21.15.57:0/1519484858 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33d80094f0 con 0x7f33f015d6a0 2023-10-06T03:03:49.119 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.117+0000 7f33e6ffd700 1 --2- 172.21.15.57:0/1519484858 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f33f015d6a0 0x7f33f015aa60 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f33d8006fd0 tx=0x7f33d8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:03:49.120 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.117+0000 7f33e7fff700 1 -- 172.21.15.57:0/1519484858 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d8000d10 con 0x7f33f015d6a0 2023-10-06T03:03:49.120 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.117+0000 7f33e7fff700 1 -- 172.21.15.57:0/1519484858 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33d800bbe0 con 0x7f33f015d6a0 2023-10-06T03:03:49.120 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.117+0000 7f33e7fff700 1 -- 172.21.15.57:0/1519484858 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d8011670 con 0x7f33f015d6a0 2023-10-06T03:03:49.120 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.117+0000 7f33f5ccd700 1 -- 172.21.15.57:0/1519484858 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33f0164480 con 0x7f33f015d6a0 2023-10-06T03:03:49.120 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.117+0000 7f33f5ccd700 1 -- 172.21.15.57:0/1519484858 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33f00ac890 con 0x7f33f015d6a0 2023-10-06T03:03:49.121 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.117+0000 7f33f5ccd700 1 -- 172.21.15.57:0/1519484858 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33f00ac410 con 0x7f33f015d6a0 2023-10-06T03:03:49.123 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.121+0000 7f33e7fff700 1 -- 172.21.15.57:0/1519484858 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f33d8011aa0 con 0x7f33f015d6a0 2023-10-06T03:03:49.124 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.121+0000 7f33e7fff700 1 --2- 172.21.15.57:0/1519484858 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f33d0060580 0x7f33d0062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:49.124 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.121+0000 7f33e7fff700 1 -- 172.21.15.57:0/1519484858 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6202+0+0 (secure 0 0 0) 0x7f33d807e200 con 0x7f33f015d6a0 2023-10-06T03:03:49.125 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.121+0000 7f33ef7fe700 1 --2- 172.21.15.57:0/1519484858 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f33d0060580 0x7f33d0062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:49.126 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.121+0000 7f33ef7fe700 1 --2- 172.21.15.57:0/1519484858 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f33d0060580 0x7f33d0062a30 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f33e000f510 tx=0x7f33e000b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:03:49.131 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.129+0000 7f33e7fff700 1 -- 172.21.15.57:0/1519484858 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f33f00ac410 con 0x7f33f015d6a0 2023-10-06T03:03:49.340 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.337+0000 7f33f5ccd700 1 -- 172.21.15.57:0/1519484858 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f33f00ac410 con 0x7f33f015d6a0 2023-10-06T03:03:49.341 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.337+0000 7f33e7fff700 1 -- 172.21.15.57:0/1519484858 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4598 (secure 0 0 0) 0x7f33f00ac410 con 0x7f33f015d6a0 2023-10-06T03:03:49.341 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:03:49.341 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":38,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5222,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/879829980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":879829980},{"type":"v1","addr":"172.21.15.105:6833","nonce":879829980}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5225,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/3705921279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":3705921279},{"type":"v1","addr":"172.21.15.105:6835","nonce":3705921279}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/251759282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":251759282},{"type":"v1","addr":"172.21.15.57:6835","nonce":251759282}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:02:39.274111+0000","modified":"2023-10-06T03:02:56.856783+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":54,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5643},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5643":{"gid":5643,"name":"c","rank":0,"incarnation":34,"state":"up:active","state_seq":5,"addr":"172.21.15.57:6837/3347844181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6836","nonce":3347844181},{"type":"v1","addr":"172.21.15.57:6837","nonce":3347844181}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T03:03:49.344 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.341+0000 7f33f5ccd700 1 -- 172.21.15.57:0/1519484858 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f33d0060580 msgr2=0x7f33d0062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:49.344 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.341+0000 7f33f5ccd700 1 --2- 172.21.15.57:0/1519484858 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f33d0060580 0x7f33d0062a30 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f33e000f510 tx=0x7f33e000b040 comp rx=0 tx=0).stop 2023-10-06T03:03:49.344 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.341+0000 7f33f5ccd700 1 -- 172.21.15.57:0/1519484858 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f33f015d6a0 msgr2=0x7f33f015aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:49.345 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.341+0000 7f33f5ccd700 1 --2- 172.21.15.57:0/1519484858 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f33f015d6a0 0x7f33f015aa60 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f33d8006fd0 tx=0x7f33d8017000 comp rx=0 tx=0).stop 2023-10-06T03:03:49.345 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.341+0000 7f33f5ccd700 1 -- 172.21.15.57:0/1519484858 shutdown_connections 2023-10-06T03:03:49.345 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.341+0000 7f33f5ccd700 1 --2- 172.21.15.57:0/1519484858 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f33f0161320 0x7f33f015afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:49.345 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.341+0000 7f33f5ccd700 1 --2- 172.21.15.57:0/1519484858 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f33f015d6a0 0x7f33f015aa60 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:49.345 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.341+0000 7f33f5ccd700 1 --2- 172.21.15.57:0/1519484858 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f33d0060580 0x7f33d0062a30 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:49.345 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.341+0000 7f33f5ccd700 1 --2- 172.21.15.57:0/1519484858 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f33f00c9fb0 0x7f33f01621c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:49.345 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.341+0000 7f33f5ccd700 1 -- 172.21.15.57:0/1519484858 >> 172.21.15.57:0/1519484858 conn(0x7f33f00cbed0 msgr2=0x7f33f006a050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:03:49.345 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.341+0000 7f33f5ccd700 1 -- 172.21.15.57:0/1519484858 shutdown_connections 2023-10-06T03:03:49.346 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.341+0000 7f33f5ccd700 1 -- 172.21.15.57:0/1519484858 wait complete. 2023-10-06T03:03:49.347 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 38 2023-10-06T03:03:49.364 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:03:49.524 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.521+0000 7f860f59e700 1 Processor -- start 2023-10-06T03:03:49.524 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.521+0000 7f860f59e700 1 -- start start 2023-10-06T03:03:49.527 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.525+0000 7f860f59e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8610159910 0x7f86100d0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:49.528 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.525+0000 7f860f59e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86100afc50 con 0x7f861015a3f0 2023-10-06T03:03:49.528 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.525+0000 7f860f59e700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86100af920 con 0x7f86100adbc0 2023-10-06T03:03:49.528 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.525+0000 7f860f59e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86100b25e0 con 0x7f8610159910 2023-10-06T03:03:49.529 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.525+0000 7f860ed9d700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f861015a3f0 0x7f8610162d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:59370/0 (socket says 172.21.15.57:59370) 2023-10-06T03:03:49.529 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.525+0000 7f860ed9d700 1 -- 172.21.15.57:0/2055046602 learned_addr learned my addr 172.21.15.57:0/2055046602 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:03:49.529 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.525+0000 7f860e59c700 1 --2- 172.21.15.57:0/2055046602 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8610159910 0x7f86100d0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:49.530 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.525+0000 7f860dd9b700 1 -- 172.21.15.57:0/2055046602 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2337216193 0 0) 0x7f86100afc50 con 0x7f861015a3f0 2023-10-06T03:03:49.530 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.525+0000 7f860dd9b700 1 -- 172.21.15.57:0/2055046602 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85fc003570 con 0x7f861015a3f0 2023-10-06T03:03:49.530 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.525+0000 7f860dd9b700 1 -- 172.21.15.57:0/2055046602 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1786425200 0 0) 0x7f86100af920 con 0x7f86100adbc0 2023-10-06T03:03:49.530 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.525+0000 7f860dd9b700 1 -- 172.21.15.57:0/2055046602 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86100afc50 con 0x7f86100adbc0 2023-10-06T03:03:49.530 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.525+0000 7f860e59c700 1 -- 172.21.15.57:0/2055046602 >> v1:172.21.15.105:6789/0 conn(0x7f86100adbc0 legacy=0x7f8610159ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:49.530 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.525+0000 7f860e59c700 1 -- 172.21.15.57:0/2055046602 >> v1:172.21.15.57:6789/0 conn(0x7f861015a3f0 legacy=0x7f8610162d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:49.530 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.525+0000 7f860dd9b700 1 -- 172.21.15.57:0/2055046602 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1697386575 0 0) 0x7f85fc003570 con 0x7f861015a3f0 2023-10-06T03:03:49.531 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.525+0000 7f860e59c700 1 -- 172.21.15.57:0/2055046602 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86100aee30 con 0x7f8610159910 2023-10-06T03:03:49.531 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.529+0000 7f860e59c700 1 --2- 172.21.15.57:0/2055046602 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8610159910 0x7f86100d0bf0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8600009900 tx=0x7f8600009120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=36ecef031ece68c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:03:49.531 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.529+0000 7f860dd9b700 1 -- 172.21.15.57:0/2055046602 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86080017f0 con 0x7f8610159910 2023-10-06T03:03:49.531 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.529+0000 7f860dd9b700 1 -- 172.21.15.57:0/2055046602 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8600011420 con 0x7f8610159910 2023-10-06T03:03:49.532 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.529+0000 7f860dd9b700 1 -- 172.21.15.57:0/2055046602 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86000117c0 con 0x7f8610159910 2023-10-06T03:03:49.532 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.529+0000 7f860f59e700 1 -- 172.21.15.57:0/2055046602 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8610159910 msgr2=0x7f86100d0bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:49.533 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.529+0000 7f860f59e700 1 --2- 172.21.15.57:0/2055046602 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8610159910 0x7f86100d0bf0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8600009900 tx=0x7f8600009120 comp rx=0 tx=0).stop 2023-10-06T03:03:49.533 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.529+0000 7f860f59e700 1 -- 172.21.15.57:0/2055046602 shutdown_connections 2023-10-06T03:03:49.533 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.529+0000 7f860f59e700 1 --2- 172.21.15.57:0/2055046602 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8610159910 0x7f86100d0bf0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:49.533 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.529+0000 7f860f59e700 1 -- 172.21.15.57:0/2055046602 >> 172.21.15.57:0/2055046602 conn(0x7f861006ef40 msgr2=0x7f86100d0080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:03:49.533 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.529+0000 7f860f59e700 1 -- 172.21.15.57:0/2055046602 shutdown_connections 2023-10-06T03:03:49.533 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.529+0000 7f860f59e700 1 -- 172.21.15.57:0/2055046602 wait complete. 2023-10-06T03:03:49.534 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.529+0000 7f860f59e700 1 Processor -- start 2023-10-06T03:03:49.534 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.529+0000 7f860f59e700 1 -- start start 2023-10-06T03:03:49.536 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.533+0000 7f860f59e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f86100adbc0 0x7f861016ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:49.536 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.533+0000 7f860f59e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8610159910 0x7f86100cf450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:49.536 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.533+0000 7f860f59e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f861015a3f0 0x7f86101676a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:49.536 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.533+0000 7f860f59e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f861016c020 con 0x7f861015a3f0 2023-10-06T03:03:49.536 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.533+0000 7f860f59e700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f861016b170 con 0x7f8610159910 2023-10-06T03:03:49.536 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.533+0000 7f860f59e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f861016b410 con 0x7f86100adbc0 2023-10-06T03:03:49.537 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.533+0000 7f860ed9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f861015a3f0 0x7f86101676a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:49.537 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.533+0000 7f860ed9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f861015a3f0 0x7f86101676a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:49968/0 (socket says 172.21.15.57:49968) 2023-10-06T03:03:49.537 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.533+0000 7f860ed9d700 1 -- 172.21.15.57:0/636484699 learned_addr learned my addr 172.21.15.57:0/636484699 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:03:49.537 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.533+0000 7f860e59c700 1 --2- 172.21.15.57:0/636484699 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f86100adbc0 0x7f861016ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:49.537 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.533+0000 7f8607fff700 1 --2- 172.21.15.57:0/636484699 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8610159910 0x7f86100cf450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:49.538 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.533+0000 7f860ed9d700 1 -- 172.21.15.57:0/636484699 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f86100adbc0 msgr2=0x7f861016ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:49.538 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.533+0000 7f860ed9d700 1 --2- 172.21.15.57:0/636484699 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f86100adbc0 0x7f861016ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:49.538 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.533+0000 7f860ed9d700 1 -- 172.21.15.57:0/636484699 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8610159910 msgr2=0x7f86100cf450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:49.539 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.533+0000 7f860ed9d700 1 --2- 172.21.15.57:0/636484699 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8610159910 0x7f86100cf450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:49.539 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.533+0000 7f860ed9d700 1 -- 172.21.15.57:0/636484699 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86000093c0 con 0x7f861015a3f0 2023-10-06T03:03:49.539 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.533+0000 7f860ed9d700 1 --2- 172.21.15.57:0/636484699 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f861015a3f0 0x7f86101676a0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f860800cb60 tx=0x7f86080018e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:03:49.539 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.533+0000 7f86067fc700 1 -- 172.21.15.57:0/636484699 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8608004dc0 con 0x7f861015a3f0 2023-10-06T03:03:49.539 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.533+0000 7f86067fc700 1 -- 172.21.15.57:0/636484699 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8608007150 con 0x7f861015a3f0 2023-10-06T03:03:49.539 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.533+0000 7f86067fc700 1 -- 172.21.15.57:0/636484699 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8608007510 con 0x7f861015a3f0 2023-10-06T03:03:49.539 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.533+0000 7f860f59e700 1 -- 172.21.15.57:0/636484699 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f861016b6f0 con 0x7f861015a3f0 2023-10-06T03:03:49.539 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.533+0000 7f860f59e700 1 -- 172.21.15.57:0/636484699 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f861016bcb0 con 0x7f861015a3f0 2023-10-06T03:03:49.540 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.537+0000 7f860f59e700 1 -- 172.21.15.57:0/636484699 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86100645e0 con 0x7f861015a3f0 2023-10-06T03:03:49.541 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.537+0000 7f86067fc700 1 -- 172.21.15.57:0/636484699 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f86080078c0 con 0x7f861015a3f0 2023-10-06T03:03:49.542 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.541+0000 7f86067fc700 1 --2- 172.21.15.57:0/636484699 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f85f0060550 0x7f85f0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:49.543 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.541+0000 7f86067fc700 1 -- 172.21.15.57:0/636484699 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6202+0+0 (secure 0 0 0) 0x7f860807bf90 con 0x7f861015a3f0 2023-10-06T03:03:49.543 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.541+0000 7f860e59c700 1 --2- 172.21.15.57:0/636484699 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f85f0060550 0x7f85f0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:49.544 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.541+0000 7f860e59c700 1 --2- 172.21.15.57:0/636484699 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f85f0060550 0x7f85f0062a00 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f8600009160 tx=0x7f8600016000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:03:49.549 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.545+0000 7f86067fc700 1 -- 172.21.15.57:0/636484699 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f860804c370 con 0x7f861015a3f0 2023-10-06T03:03:49.724 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.721+0000 7f860f59e700 1 -- 172.21.15.57:0/636484699 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f86100675b0 con 0x7f861015a3f0 2023-10-06T03:03:49.726 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.721+0000 7f86067fc700 1 -- 172.21.15.57:0/636484699 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) v1 ==== 74+0+17091 (secure 0 0 0) 0x7f8608018090 con 0x7f861015a3f0 2023-10-06T03:03:49.727 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:03:49.727 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":56,"fsid":"eb56dc0f-9213-41cb-9aad-8ade6c802e98","created":"2023-10-06T03:00:30.806197+0000","modified":"2023-10-06T03:03:38.834241+0000","last_up_change":"2023-10-06T03:00:43.607454+0000","last_in_change":"2023-10-06T03:00:33.943513+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T03:00:44.360651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T03:00:50.466601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:02:37.240020+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-10-06T03:02:38.287494+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"58cf6c90-d704-43e0-b2db-dffe526d5e8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":33053},{"type":"v1","addr":"172.21.15.57:6801","nonce":33053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":33053},{"type":"v1","addr":"172.21.15.57:6803","nonce":33053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":33053},{"type":"v1","addr":"172.21.15.57:6807","nonce":33053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":33053},{"type":"v1","addr":"172.21.15.57:6805","nonce":33053}]},"public_addr":"172.21.15.57:6801/33053","cluster_addr":"172.21.15.57:6803/33053","heartbeat_back_addr":"172.21.15.57:6807/33053","heartbeat_front_addr":"172.21.15.57:6805/33053","state":["exists","up"]},{"osd":1,"uuid":"16afbe70-7f9e-4568-9c92-763e6e348119","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6809","nonce":33052},{"type":"v1","addr":"172.21.15.57:6810","nonce":33052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":33052},{"type":"v1","addr":"172.21.15.57:6813","nonce":33052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":33052},{"type":"v1","addr":"172.21.15.57:6822","nonce":33052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6815","nonce":33052},{"type":"v1","addr":"172.21.15.57:6818","nonce":33052}]},"public_addr":"172.21.15.57:6810/33052","cluster_addr":"172.21.15.57:6813/33052","heartbeat_back_addr":"172.21.15.57:6822/33052","heartbeat_front_addr":"172.21.15.57:6818/33052","state":["exists","up"]},{"osd":2,"uuid":"7255c62e-f92f-470f-a5ce-30228920d9f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":33058},{"type":"v1","addr":"172.21.15.57:6825","nonce":33058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":33058},{"type":"v1","addr":"172.21.15.57:6827","nonce":33058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":33058},{"type":"v1","addr":"172.21.15.57:6831","nonce":33058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":33058},{"type":"v1","addr":"172.21.15.57:6829","nonce":33058}]},"public_addr":"172.21.15.57:6825/33058","cluster_addr":"172.21.15.57:6827/33058","heartbeat_back_addr":"172.21.15.57:6831/33058","heartbeat_front_addr":"172.21.15.57:6829/33058","state":["exists","up"]},{"osd":3,"uuid":"152a236d-f799-4888-8544-74865508d5a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":33057},{"type":"v1","addr":"172.21.15.57:6811","nonce":33057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":33057},{"type":"v1","addr":"172.21.15.57:6816","nonce":33057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6821","nonce":33057},{"type":"v1","addr":"172.21.15.57:6823","nonce":33057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6817","nonce":33057},{"type":"v1","addr":"172.21.15.57:6819","nonce":33057}]},"public_addr":"172.21.15.57:6811/33057","cluster_addr":"172.21.15.57:6816/33057","heartbeat_back_addr":"172.21.15.57:6823/33057","heartbeat_front_addr":"172.21.15.57:6819/33057","state":["exists","up"]},{"osd":4,"uuid":"37db2a65-3566-41d0-9d60-e66c49e1e68e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":33368},{"type":"v1","addr":"172.21.15.105:6801","nonce":33368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":33368},{"type":"v1","addr":"172.21.15.105:6803","nonce":33368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":33368},{"type":"v1","addr":"172.21.15.105:6807","nonce":33368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":33368},{"type":"v1","addr":"172.21.15.105:6805","nonce":33368}]},"public_addr":"172.21.15.105:6801/33368","cluster_addr":"172.21.15.105:6803/33368","heartbeat_back_addr":"172.21.15.105:6807/33368","heartbeat_front_addr":"172.21.15.105:6805/33368","state":["exists","up"]},{"osd":5,"uuid":"35e77918-1bb4-42ca-9b20-f3c14eaa0c04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":33379},{"type":"v1","addr":"172.21.15.105:6818","nonce":33379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":33379},{"type":"v1","addr":"172.21.15.105:6823","nonce":33379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":33379},{"type":"v1","addr":"172.21.15.105:6831","nonce":33379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":33379},{"type":"v1","addr":"172.21.15.105:6827","nonce":33379}]},"public_addr":"172.21.15.105:6818/33379","cluster_addr":"172.21.15.105:6823/33379","heartbeat_back_addr":"172.21.15.105:6831/33379","heartbeat_front_addr":"172.21.15.105:6827/33379","state":["exists","up"]},{"osd":6,"uuid":"b4d9d510-7a45-4173-8287-c6c8d6547f2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":33369},{"type":"v1","addr":"172.21.15.105:6819","nonce":33369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":33369},{"type":"v1","addr":"172.21.15.105:6822","nonce":33369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":33369},{"type":"v1","addr":"172.21.15.105:6830","nonce":33369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":33369},{"type":"v1","addr":"172.21.15.105:6826","nonce":33369}]},"public_addr":"172.21.15.105:6819/33369","cluster_addr":"172.21.15.105:6822/33369","heartbeat_back_addr":"172.21.15.105:6830/33369","heartbeat_front_addr":"172.21.15.105:6826/33369","state":["exists","up"]},{"osd":7,"uuid":"74266fb0-cd84-463f-8bf0-092652a71dc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":33370},{"type":"v1","addr":"172.21.15.105:6809","nonce":33370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":33370},{"type":"v1","addr":"172.21.15.105:6811","nonce":33370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":33370},{"type":"v1","addr":"172.21.15.105:6815","nonce":33370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":33370},{"type":"v1","addr":"172.21.15.105:6813","nonce":33370}]},"public_addr":"172.21.15.105:6809/33370","cluster_addr":"172.21.15.105:6811/33370","heartbeat_back_addr":"172.21.15.105:6815/33370","heartbeat_front_addr":"172.21.15.105:6813/33370","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.596864+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.633851+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.636993+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.529681+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.608601+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.659752+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.661717+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.642221+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.1d","mappings":[{"from":0,"to":6}]},{"pgid":"8.27","mappings":[{"from":0,"to":6}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.57:6837/4147766471":"2023-10-07T03:02:52.815979+0000","172.21.15.57:6835/4147766471":"2023-10-07T03:02:52.815979+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:03:49.729 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.725+0000 7f860f59e700 1 -- 172.21.15.57:0/636484699 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f85f0060550 msgr2=0x7f85f0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:49.729 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.725+0000 7f860f59e700 1 --2- 172.21.15.57:0/636484699 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f85f0060550 0x7f85f0062a00 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f8600009160 tx=0x7f8600016000 comp rx=0 tx=0).stop 2023-10-06T03:03:49.729 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.725+0000 7f860f59e700 1 -- 172.21.15.57:0/636484699 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f861015a3f0 msgr2=0x7f86101676a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:49.729 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.725+0000 7f860f59e700 1 --2- 172.21.15.57:0/636484699 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f861015a3f0 0x7f86101676a0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f860800cb60 tx=0x7f86080018e0 comp rx=0 tx=0).stop 2023-10-06T03:03:49.729 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.725+0000 7f860f59e700 1 -- 172.21.15.57:0/636484699 shutdown_connections 2023-10-06T03:03:49.729 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.725+0000 7f860f59e700 1 --2- 172.21.15.57:0/636484699 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f861015a3f0 0x7f86101676a0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:49.729 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.725+0000 7f860f59e700 1 --2- 172.21.15.57:0/636484699 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8610159910 0x7f86100cf450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:49.729 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.725+0000 7f860f59e700 1 --2- 172.21.15.57:0/636484699 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f85f0060550 0x7f85f0062a00 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:49.729 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.725+0000 7f860f59e700 1 --2- 172.21.15.57:0/636484699 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f86100adbc0 0x7f861016ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:49.730 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.725+0000 7f860f59e700 1 -- 172.21.15.57:0/636484699 >> 172.21.15.57:0/636484699 conn(0x7f861006ef40 msgr2=0x7f8610159ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:03:49.730 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.725+0000 7f860f59e700 1 -- 172.21.15.57:0/636484699 shutdown_connections 2023-10-06T03:03:49.730 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.725+0000 7f860f59e700 1 -- 172.21.15.57:0/636484699 wait complete. 2023-10-06T03:03:49.749 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T03:00:44.360651+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T03:00:50.466601+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T03:02:37.240020+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '49', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T03:02:38.287494+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '50', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T03:03:49.750 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T03:03:49.918 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.913+0000 7f6047945700 1 Processor -- start 2023-10-06T03:03:49.918 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.913+0000 7f6047945700 1 -- start start 2023-10-06T03:03:49.921 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.917+0000 7f6047945700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f6040067740 0x7f60400acdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:49.921 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.917+0000 7f6047945700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f604006a860 con 0x7f6040140c60 2023-10-06T03:03:49.922 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.917+0000 7f6047945700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60400c9640 con 0x7f6040140890 2023-10-06T03:03:49.922 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.917+0000 7f6047945700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60400c7520 con 0x7f6040067740 2023-10-06T03:03:49.922 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.917+0000 7f6044ee0700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f6040140c60 0x7f60400ac6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:59384/0 (socket says 172.21.15.57:59384) 2023-10-06T03:03:49.922 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.917+0000 7f6044ee0700 1 -- 172.21.15.57:0/1330084543 learned_addr learned my addr 172.21.15.57:0/1330084543 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:03:49.923 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.917+0000 7f6045ee2700 1 --2- 172.21.15.57:0/1330084543 >> v2:172.21.15.105:3300/0 conn(0x7f6040067740 0x7f60400acdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:49.923 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.921+0000 7f6045ee2700 1 -- 172.21.15.57:0/1330084543 >> v1:172.21.15.105:6789/0 conn(0x7f6040140890 legacy=0x7f6040067030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:49.923 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.921+0000 7f6045ee2700 1 -- 172.21.15.57:0/1330084543 >> v1:172.21.15.57:6789/0 conn(0x7f6040140c60 legacy=0x7f60400ac6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:49.923 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.921+0000 7f6045ee2700 1 -- 172.21.15.57:0/1330084543 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60400c7800 con 0x7f6040067740 2023-10-06T03:03:49.926 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.921+0000 7f6045ee2700 1 --2- 172.21.15.57:0/1330084543 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6040067740 0x7f60400acdc0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f6038009e60 tx=0x7f6038009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f2a3f7f80b5f128 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:03:49.926 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.921+0000 7f6037fff700 1 -- 172.21.15.57:0/1330084543 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f603800e070 con 0x7f6040067740 2023-10-06T03:03:49.926 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.921+0000 7f6037fff700 1 -- 172.21.15.57:0/1330084543 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f603800bc30 con 0x7f6040067740 2023-10-06T03:03:49.926 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.921+0000 7f6037fff700 1 -- 172.21.15.57:0/1330084543 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6038012430 con 0x7f6040067740 2023-10-06T03:03:49.926 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.921+0000 7f6047945700 1 -- 172.21.15.57:0/1330084543 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6040067740 msgr2=0x7f60400acdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:49.926 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.921+0000 7f6047945700 1 --2- 172.21.15.57:0/1330084543 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6040067740 0x7f60400acdc0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f6038009e60 tx=0x7f6038009780 comp rx=0 tx=0).stop 2023-10-06T03:03:49.926 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.921+0000 7f6047945700 1 -- 172.21.15.57:0/1330084543 shutdown_connections 2023-10-06T03:03:49.927 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.921+0000 7f6047945700 1 --2- 172.21.15.57:0/1330084543 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6040067740 0x7f60400acdc0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:49.927 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.921+0000 7f6047945700 1 -- 172.21.15.57:0/1330084543 >> 172.21.15.57:0/1330084543 conn(0x7f60400ccee0 msgr2=0x7f60400cd2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:03:49.927 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.921+0000 7f6047945700 1 -- 172.21.15.57:0/1330084543 shutdown_connections 2023-10-06T03:03:49.927 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.921+0000 7f6047945700 1 -- 172.21.15.57:0/1330084543 wait complete. 2023-10-06T03:03:49.927 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.925+0000 7f6047945700 1 Processor -- start 2023-10-06T03:03:49.927 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.925+0000 7f6047945700 1 -- start start 2023-10-06T03:03:49.929 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.925+0000 7f6047945700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6040067740 0x7f60400c2de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:49.929 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.925+0000 7f6047945700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6040140890 0x7f6040158e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:49.929 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.925+0000 7f6047945700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6040140c60 0x7f6040156750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:49.929 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.925+0000 7f6047945700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f604015a4e0 con 0x7f6040067740 2023-10-06T03:03:49.929 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.925+0000 7f6047945700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60401598d0 con 0x7f6040140890 2023-10-06T03:03:49.930 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.925+0000 7f6047945700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6040159bb0 con 0x7f6040140c60 2023-10-06T03:03:49.931 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.925+0000 7f60456e1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6040067740 0x7f60400c2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:49.931 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.925+0000 7f60456e1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6040067740 0x7f60400c2de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:49974/0 (socket says 172.21.15.57:49974) 2023-10-06T03:03:49.931 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.925+0000 7f60456e1700 1 -- 172.21.15.57:0/2419175973 learned_addr learned my addr 172.21.15.57:0/2419175973 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:03:49.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.925+0000 7f6045ee2700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6040140c60 0x7f6040156750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:49.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.925+0000 7f6044ee0700 1 --2- 172.21.15.57:0/2419175973 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6040140890 0x7f6040158e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:49.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.925+0000 7f60456e1700 1 -- 172.21.15.57:0/2419175973 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6040140c60 msgr2=0x7f6040156750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:49.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.925+0000 7f60456e1700 1 --2- 172.21.15.57:0/2419175973 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6040140c60 0x7f6040156750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:49.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.925+0000 7f60456e1700 1 -- 172.21.15.57:0/2419175973 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6040140890 msgr2=0x7f6040158e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:49.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.925+0000 7f60456e1700 1 --2- 172.21.15.57:0/2419175973 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6040140890 0x7f6040158e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:49.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.925+0000 7f60456e1700 1 -- 172.21.15.57:0/2419175973 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6038009a20 con 0x7f6040067740 2023-10-06T03:03:49.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.925+0000 7f6044ee0700 1 --2- 172.21.15.57:0/2419175973 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6040140890 0x7f6040158e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:03:49.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.929+0000 7f60456e1700 1 --2- 172.21.15.57:0/2419175973 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6040067740 0x7f60400c2de0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f603c00c590 tx=0x7f603c00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:03:49.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.929+0000 7f60357fa700 1 -- 172.21.15.57:0/2419175973 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f603c011590 con 0x7f6040067740 2023-10-06T03:03:49.933 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.929+0000 7f60357fa700 1 -- 172.21.15.57:0/2419175973 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f603c011710 con 0x7f6040067740 2023-10-06T03:03:49.933 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.929+0000 7f60357fa700 1 -- 172.21.15.57:0/2419175973 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f603c011ad0 con 0x7f6040067740 2023-10-06T03:03:49.933 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.929+0000 7f6047945700 1 -- 172.21.15.57:0/2419175973 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6040159e90 con 0x7f6040067740 2023-10-06T03:03:49.933 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.929+0000 7f6047945700 1 -- 172.21.15.57:0/2419175973 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60400aef60 con 0x7f6040067740 2023-10-06T03:03:49.933 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.929+0000 7f6047945700 1 -- 172.21.15.57:0/2419175973 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60400af180 con 0x7f6040067740 2023-10-06T03:03:49.934 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.929+0000 7f60357fa700 1 -- 172.21.15.57:0/2419175973 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f603c01b3b0 con 0x7f6040067740 2023-10-06T03:03:49.935 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.933+0000 7f60357fa700 1 --2- 172.21.15.57:0/2419175973 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f6024060550 0x7f6024062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:49.936 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.933+0000 7f60357fa700 1 -- 172.21.15.57:0/2419175973 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6202+0+0 (secure 0 0 0) 0x7f603c07be80 con 0x7f6040067740 2023-10-06T03:03:49.936 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.933+0000 7f6044ee0700 1 --2- 172.21.15.57:0/2419175973 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f6024060550 0x7f6024062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:49.937 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.933+0000 7f6044ee0700 1 --2- 172.21.15.57:0/2419175973 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f6024060550 0x7f6024062a00 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f60400ac1e0 tx=0x7f6030009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:03:49.941 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:49.937+0000 7f60357fa700 1 -- 172.21.15.57:0/2419175973 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f603c04c280 con 0x7f6040067740 2023-10-06T03:03:50.109 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.105+0000 7f6047945700 1 -- 172.21.15.57:0/2419175973 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6040067da0 con 0x7f6040067740 2023-10-06T03:03:50.110 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.105+0000 7f60357fa700 1 -- 172.21.15.57:0/2419175973 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v56) v1 ==== 93+0+10 (secure 0 0 0) 0x7f603c017020 con 0x7f6040067740 2023-10-06T03:03:50.110 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2023-10-06T03:03:50.116 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.113+0000 7f6047945700 1 -- 172.21.15.57:0/2419175973 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f6024060550 msgr2=0x7f6024062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:50.116 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.113+0000 7f6047945700 1 --2- 172.21.15.57:0/2419175973 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f6024060550 0x7f6024062a00 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f60400ac1e0 tx=0x7f6030009040 comp rx=0 tx=0).stop 2023-10-06T03:03:50.116 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.113+0000 7f6047945700 1 -- 172.21.15.57:0/2419175973 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6040067740 msgr2=0x7f60400c2de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:50.116 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.113+0000 7f6047945700 1 --2- 172.21.15.57:0/2419175973 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6040067740 0x7f60400c2de0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f603c00c590 tx=0x7f603c00c8a0 comp rx=0 tx=0).stop 2023-10-06T03:03:50.117 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.113+0000 7f6047945700 1 -- 172.21.15.57:0/2419175973 shutdown_connections 2023-10-06T03:03:50.117 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.113+0000 7f6047945700 1 --2- 172.21.15.57:0/2419175973 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f6024060550 0x7f6024062a00 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:50.117 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.113+0000 7f6047945700 1 --2- 172.21.15.57:0/2419175973 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6040140c60 0x7f6040156750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:50.117 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.113+0000 7f6047945700 1 --2- 172.21.15.57:0/2419175973 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6040140890 0x7f6040158e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:50.117 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.113+0000 7f6047945700 1 --2- 172.21.15.57:0/2419175973 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6040067740 0x7f60400c2de0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:50.117 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.113+0000 7f6047945700 1 -- 172.21.15.57:0/2419175973 >> 172.21.15.57:0/2419175973 conn(0x7f60400ccee0 msgr2=0x7f604013f4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:03:50.117 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.113+0000 7f6047945700 1 -- 172.21.15.57:0/2419175973 shutdown_connections 2023-10-06T03:03:50.117 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.113+0000 7f6047945700 1 -- 172.21.15.57:0/2419175973 wait complete. 2023-10-06T03:03:50.135 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T03:03:50.307 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.305+0000 7ff09046e700 1 Processor -- start 2023-10-06T03:03:50.307 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.305+0000 7ff09046e700 1 -- start start 2023-10-06T03:03:50.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.305+0000 7ff09046e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff088157180 0x7ff0880add80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:50.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.305+0000 7ff09046e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff08806e3a0 0x7ff08806e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:50.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.305+0000 7ff09046e700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff08806ed40 con 0x7ff0880aec80 2023-10-06T03:03:50.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.305+0000 7ff09046e700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0880ae2c0 con 0x7ff088157180 2023-10-06T03:03:50.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.305+0000 7ff09046e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff088157550 con 0x7ff08806e3a0 2023-10-06T03:03:50.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.305+0000 7ff08e20a700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff088157180 0x7ff0880add80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:50.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.309+0000 7ff08e20a700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff088157180 0x7ff0880add80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:49976/0 (socket says 172.21.15.57:49976) 2023-10-06T03:03:50.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.309+0000 7ff08e20a700 1 -- 172.21.15.57:0/2497710903 learned_addr learned my addr 172.21.15.57:0/2497710903 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:03:50.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.309+0000 7ff08ea0b700 1 --2- 172.21.15.57:0/2497710903 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff08806e3a0 0x7ff08806e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:50.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.309+0000 7ff08e20a700 1 -- 172.21.15.57:0/2497710903 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff08806e3a0 msgr2=0x7ff08806e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:03:50.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.309+0000 7ff08e20a700 1 --2- 172.21.15.57:0/2497710903 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff08806e3a0 0x7ff08806e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:50.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.309+0000 7ff08e20a700 1 -- 172.21.15.57:0/2497710903 >> v1:172.21.15.105:6789/0 conn(0x7ff0880aec80 legacy=0x7ff0880ab8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:03:50.312 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.309+0000 7ff08e20a700 1 -- 172.21.15.57:0/2497710903 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff088068e00 con 0x7ff088157180 2023-10-06T03:03:50.312 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.309+0000 7ff08e20a700 1 --2- 172.21.15.57:0/2497710903 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff088157180 0x7ff0880add80 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7ff084009f70 tx=0x7ff084009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6acd795a047fd7d0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:03:50.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.309+0000 7ff08d208700 1 -- 172.21.15.57:0/2497710903 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff08400e070 con 0x7ff088157180 2023-10-06T03:03:50.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.309+0000 7ff08d208700 1 -- 172.21.15.57:0/2497710903 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff08400bad0 con 0x7ff088157180 2023-10-06T03:03:50.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.309+0000 7ff08d208700 1 -- 172.21.15.57:0/2497710903 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0840092e0 con 0x7ff088157180 2023-10-06T03:03:50.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.309+0000 7ff09046e700 1 -- 172.21.15.57:0/2497710903 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff088157180 msgr2=0x7ff0880add80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:50.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.309+0000 7ff09046e700 1 --2- 172.21.15.57:0/2497710903 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff088157180 0x7ff0880add80 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7ff084009f70 tx=0x7ff084009840 comp rx=0 tx=0).stop 2023-10-06T03:03:50.314 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.309+0000 7ff09046e700 1 -- 172.21.15.57:0/2497710903 shutdown_connections 2023-10-06T03:03:50.314 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.309+0000 7ff09046e700 1 --2- 172.21.15.57:0/2497710903 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff08806e3a0 0x7ff08806e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:50.314 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.309+0000 7ff09046e700 1 --2- 172.21.15.57:0/2497710903 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff088157180 0x7ff0880add80 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:50.314 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.309+0000 7ff09046e700 1 -- 172.21.15.57:0/2497710903 >> 172.21.15.57:0/2497710903 conn(0x7ff088067b00 msgr2=0x7ff0880cbeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:03:50.314 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.309+0000 7ff09046e700 1 -- 172.21.15.57:0/2497710903 shutdown_connections 2023-10-06T03:03:50.314 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.309+0000 7ff09046e700 1 -- 172.21.15.57:0/2497710903 wait complete. 2023-10-06T03:03:50.317 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.313+0000 7ff09046e700 1 Processor -- start 2023-10-06T03:03:50.317 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.313+0000 7ff09046e700 1 -- start start 2023-10-06T03:03:50.318 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.313+0000 7ff09046e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff08806e3a0 0x7ff0880bd710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:50.319 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.313+0000 7ff09046e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff0880aec80 0x7ff0881599e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:50.319 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.313+0000 7ff09046e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff088157180 0x7ff0880bb000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:50.319 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.313+0000 7ff09046e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0880c1120 con 0x7ff08806e3a0 2023-10-06T03:03:50.319 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.313+0000 7ff09046e700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0880c1720 con 0x7ff0880aec80 2023-10-06T03:03:50.319 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.313+0000 7ff09046e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0880bdc50 con 0x7ff088157180 2023-10-06T03:03:50.319 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.317+0000 7ff08e20a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff08806e3a0 0x7ff0880bd710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:50.319 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.317+0000 7ff08e20a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff08806e3a0 0x7ff0880bd710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:49992/0 (socket says 172.21.15.57:49992) 2023-10-06T03:03:50.319 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.317+0000 7ff08e20a700 1 -- 172.21.15.57:0/2830151944 learned_addr learned my addr 172.21.15.57:0/2830151944 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:03:50.320 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.317+0000 7ff08ea0b700 1 --2- 172.21.15.57:0/2830151944 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff088157180 0x7ff0880bb000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:50.320 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.317+0000 7ff08da09700 1 --2- 172.21.15.57:0/2830151944 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff0880aec80 0x7ff0881599e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:50.321 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.317+0000 7ff08e20a700 1 -- 172.21.15.57:0/2830151944 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff088157180 msgr2=0x7ff0880bb000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:50.321 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.317+0000 7ff08e20a700 1 --2- 172.21.15.57:0/2830151944 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff088157180 0x7ff0880bb000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:50.321 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.317+0000 7ff08e20a700 1 -- 172.21.15.57:0/2830151944 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff0880aec80 msgr2=0x7ff0881599e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:50.321 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.317+0000 7ff08e20a700 1 --2- 172.21.15.57:0/2830151944 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff0880aec80 0x7ff0881599e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:50.321 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.317+0000 7ff08e20a700 1 -- 172.21.15.57:0/2830151944 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff084009ae0 con 0x7ff08806e3a0 2023-10-06T03:03:50.321 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.317+0000 7ff08ea0b700 1 --2- 172.21.15.57:0/2830151944 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff088157180 0x7ff0880bb000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:03:50.321 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.317+0000 7ff08e20a700 1 --2- 172.21.15.57:0/2830151944 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff08806e3a0 0x7ff0880bd710 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7ff088068010 tx=0x7ff084018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:03:50.321 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.317+0000 7ff07e7fc700 1 -- 172.21.15.57:0/2830151944 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff084007170 con 0x7ff08806e3a0 2023-10-06T03:03:50.321 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.317+0000 7ff07e7fc700 1 -- 172.21.15.57:0/2830151944 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff084008b30 con 0x7ff08806e3a0 2023-10-06T03:03:50.321 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.317+0000 7ff09046e700 1 -- 172.21.15.57:0/2830151944 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0880bc1a0 con 0x7ff08806e3a0 2023-10-06T03:03:50.321 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.317+0000 7ff07e7fc700 1 -- 172.21.15.57:0/2830151944 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff084025460 con 0x7ff08806e3a0 2023-10-06T03:03:50.321 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.317+0000 7ff09046e700 1 -- 172.21.15.57:0/2830151944 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0880bbec0 con 0x7ff08806e3a0 2023-10-06T03:03:50.322 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.317+0000 7ff09046e700 1 -- 172.21.15.57:0/2830151944 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff08806bc30 con 0x7ff08806e3a0 2023-10-06T03:03:50.323 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.321+0000 7ff07e7fc700 1 -- 172.21.15.57:0/2830151944 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7ff084003040 con 0x7ff08806e3a0 2023-10-06T03:03:50.325 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.321+0000 7ff07e7fc700 1 --2- 172.21.15.57:0/2830151944 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7ff06c060550 0x7ff06c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:50.325 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.321+0000 7ff07e7fc700 1 -- 172.21.15.57:0/2830151944 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6202+0+0 (secure 0 0 0) 0x7ff08407dfb0 con 0x7ff08806e3a0 2023-10-06T03:03:50.325 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.321+0000 7ff08da09700 1 --2- 172.21.15.57:0/2830151944 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7ff06c060550 0x7ff06c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:50.326 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.321+0000 7ff08da09700 1 --2- 172.21.15.57:0/2830151944 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7ff06c060550 0x7ff06c062a00 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7ff0880c0d70 tx=0x7ff078009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:03:50.331 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.329+0000 7ff07e7fc700 1 -- 172.21.15.57:0/2830151944 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7ff08404e310 con 0x7ff08806e3a0 2023-10-06T03:03:50.501 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.497+0000 7ff09046e700 1 -- 172.21.15.57:0/2830151944 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff0881566e0 con 0x7ff08806e3a0 2023-10-06T03:03:50.502 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.497+0000 7ff07e7fc700 1 -- 172.21.15.57:0/2830151944 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v56) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff084051930 con 0x7ff08806e3a0 2023-10-06T03:03:50.502 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2023-10-06T03:03:50.505 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.501+0000 7ff09046e700 1 -- 172.21.15.57:0/2830151944 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7ff06c060550 msgr2=0x7ff06c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:50.505 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.501+0000 7ff09046e700 1 --2- 172.21.15.57:0/2830151944 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7ff06c060550 0x7ff06c062a00 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7ff0880c0d70 tx=0x7ff078009040 comp rx=0 tx=0).stop 2023-10-06T03:03:50.505 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.501+0000 7ff09046e700 1 -- 172.21.15.57:0/2830151944 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff08806e3a0 msgr2=0x7ff0880bd710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:50.505 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.501+0000 7ff09046e700 1 --2- 172.21.15.57:0/2830151944 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff08806e3a0 0x7ff0880bd710 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7ff088068010 tx=0x7ff084018000 comp rx=0 tx=0).stop 2023-10-06T03:03:50.505 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.501+0000 7ff09046e700 1 -- 172.21.15.57:0/2830151944 shutdown_connections 2023-10-06T03:03:50.505 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.501+0000 7ff09046e700 1 --2- 172.21.15.57:0/2830151944 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7ff06c060550 0x7ff06c062a00 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:50.505 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.501+0000 7ff09046e700 1 --2- 172.21.15.57:0/2830151944 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff088157180 0x7ff0880bb000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:50.505 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.501+0000 7ff09046e700 1 --2- 172.21.15.57:0/2830151944 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff0880aec80 0x7ff0881599e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:50.506 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.501+0000 7ff09046e700 1 --2- 172.21.15.57:0/2830151944 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff08806e3a0 0x7ff0880bd710 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:50.506 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.501+0000 7ff09046e700 1 -- 172.21.15.57:0/2830151944 >> 172.21.15.57:0/2830151944 conn(0x7ff088067b00 msgr2=0x7ff0880b1430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:03:50.506 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.501+0000 7ff09046e700 1 -- 172.21.15.57:0/2830151944 shutdown_connections 2023-10-06T03:03:50.506 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.501+0000 7ff09046e700 1 -- 172.21.15.57:0/2830151944 wait complete. 2023-10-06T03:03:50.526 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T03:03:50.691 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.689+0000 7f2dc842e700 1 Processor -- start 2023-10-06T03:03:50.691 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.689+0000 7f2dc842e700 1 -- start start 2023-10-06T03:03:50.694 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.689+0000 7f2dc842e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2dc015d560 0x7f2dc015d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:50.694 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.689+0000 7f2dc842e700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f2dc006e990 0x7f2dc01613a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:50.694 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.689+0000 7f2dc842e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2dc01618e0 0x7f2dc00c6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:50.694 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.689+0000 7f2dc842e700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2dc01622a0 con 0x7f2dc015d560 2023-10-06T03:03:50.694 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.689+0000 7f2dc842e700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2dc0161d60 con 0x7f2dc006e990 2023-10-06T03:03:50.694 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.689+0000 7f2dc842e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dc00c6450 con 0x7f2dc01618e0 2023-10-06T03:03:50.695 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.689+0000 7f2dc61ca700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2dc015d560 0x7f2dc015d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:50.695 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.693+0000 7f2dc59c9700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f2dc006e990 0x7f2dc01613a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:50.695 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.693+0000 7f2dc61ca700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2dc015d560 0x7f2dc015d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:50006/0 (socket says 172.21.15.57:50006) 2023-10-06T03:03:50.696 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.693+0000 7f2dc61ca700 1 -- 172.21.15.57:0/2838472375 learned_addr learned my addr 172.21.15.57:0/2838472375 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:03:50.696 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.693+0000 7f2dc69cb700 1 --2- 172.21.15.57:0/2838472375 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2dc01618e0 0x7f2dc00c6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:50.696 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.693+0000 7f2dc61ca700 1 -- 172.21.15.57:0/2838472375 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2dc01618e0 msgr2=0x7f2dc00c6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:03:50.696 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.693+0000 7f2dc61ca700 1 --2- 172.21.15.57:0/2838472375 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2dc01618e0 0x7f2dc00c6ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:50.696 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.693+0000 7f2dc61ca700 1 -- 172.21.15.57:0/2838472375 >> v2:172.21.15.105:3300/0 conn(0x7f2dc006e990 msgr2=0x7f2dc01613a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:03:50.696 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.693+0000 7f2dc61ca700 1 --2- 172.21.15.57:0/2838472375 >> v2:172.21.15.105:3300/0 conn(0x7f2dc006e990 0x7f2dc01613a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:50.696 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.693+0000 7f2dc61ca700 1 -- 172.21.15.57:0/2838472375 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dc00c6a10 con 0x7f2dc015d560 2023-10-06T03:03:50.697 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.693+0000 7f2dc61ca700 1 --2- 172.21.15.57:0/2838472375 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2dc015d560 0x7f2dc015d930 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f2dc0161300 tx=0x7f2db4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a49f7b83b250b490 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:03:50.697 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.693+0000 7f2dc51c8700 1 -- 172.21.15.57:0/2838472375 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2db4011630 con 0x7f2dc015d560 2023-10-06T03:03:50.697 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.693+0000 7f2dc51c8700 1 -- 172.21.15.57:0/2838472375 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2db4011790 con 0x7f2dc015d560 2023-10-06T03:03:50.697 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.693+0000 7f2dc51c8700 1 -- 172.21.15.57:0/2838472375 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2db4011b50 con 0x7f2dc015d560 2023-10-06T03:03:50.697 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.693+0000 7f2dc842e700 1 -- 172.21.15.57:0/2838472375 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2dc015d560 msgr2=0x7f2dc015d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:50.697 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.693+0000 7f2dc842e700 1 --2- 172.21.15.57:0/2838472375 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2dc015d560 0x7f2dc015d930 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f2dc0161300 tx=0x7f2db4009250 comp rx=0 tx=0).stop 2023-10-06T03:03:50.698 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.693+0000 7f2dc842e700 1 -- 172.21.15.57:0/2838472375 shutdown_connections 2023-10-06T03:03:50.698 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.693+0000 7f2dc842e700 1 --2- 172.21.15.57:0/2838472375 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2dc01618e0 0x7f2dc00c6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:50.698 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.693+0000 7f2dc842e700 1 --2- 172.21.15.57:0/2838472375 >> v2:172.21.15.105:3300/0 conn(0x7f2dc006e990 0x7f2dc01613a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:50.698 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.693+0000 7f2dc842e700 1 --2- 172.21.15.57:0/2838472375 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2dc015d560 0x7f2dc015d930 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:50.698 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.693+0000 7f2dc842e700 1 -- 172.21.15.57:0/2838472375 >> 172.21.15.57:0/2838472375 conn(0x7f2dc0067b00 msgr2=0x7f2dc00cbeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:03:50.698 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.693+0000 7f2dc842e700 1 -- 172.21.15.57:0/2838472375 shutdown_connections 2023-10-06T03:03:50.699 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.693+0000 7f2dc842e700 1 -- 172.21.15.57:0/2838472375 wait complete. 2023-10-06T03:03:50.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.697+0000 7f2dc842e700 1 Processor -- start 2023-10-06T03:03:50.702 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.697+0000 7f2dc842e700 1 -- start start 2023-10-06T03:03:50.704 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.701+0000 7f2dc842e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2dc006e990 0x7f2dc016da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:50.704 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.701+0000 7f2dc842e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2dc015d560 0x7f2dc0157f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:50.704 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.701+0000 7f2dc842e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2dc01618e0 0x7f2dc0158450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:50.704 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.701+0000 7f2dc842e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dc00b0f60 con 0x7f2dc015d560 2023-10-06T03:03:50.704 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.701+0000 7f2dc842e700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dc016df40 con 0x7f2dc006e990 2023-10-06T03:03:50.704 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.701+0000 7f2dc842e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dc015f520 con 0x7f2dc01618e0 2023-10-06T03:03:50.705 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.701+0000 7f2dc59c9700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2dc015d560 0x7f2dc0157f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:50.705 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.701+0000 7f2dc59c9700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2dc015d560 0x7f2dc0157f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:50016/0 (socket says 172.21.15.57:50016) 2023-10-06T03:03:50.705 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.701+0000 7f2dc59c9700 1 -- 172.21.15.57:0/4026750169 learned_addr learned my addr 172.21.15.57:0/4026750169 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:03:50.706 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.701+0000 7f2dc61ca700 1 --2- 172.21.15.57:0/4026750169 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2dc006e990 0x7f2dc016da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:50.706 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.701+0000 7f2dc69cb700 1 --2- 172.21.15.57:0/4026750169 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2dc01618e0 0x7f2dc0158450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:50.706 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.701+0000 7f2dc59c9700 1 -- 172.21.15.57:0/4026750169 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2dc01618e0 msgr2=0x7f2dc0158450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:50.706 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.701+0000 7f2dc59c9700 1 --2- 172.21.15.57:0/4026750169 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2dc01618e0 0x7f2dc0158450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:50.706 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.701+0000 7f2dc59c9700 1 -- 172.21.15.57:0/4026750169 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2dc006e990 msgr2=0x7f2dc016da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:50.706 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.701+0000 7f2dc59c9700 1 --2- 172.21.15.57:0/4026750169 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2dc006e990 0x7f2dc016da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:50.706 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.701+0000 7f2dc59c9700 1 -- 172.21.15.57:0/4026750169 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2db4009490 con 0x7f2dc015d560 2023-10-06T03:03:50.706 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.701+0000 7f2dc69cb700 1 --2- 172.21.15.57:0/4026750169 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2dc01618e0 0x7f2dc0158450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:03:50.707 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.701+0000 7f2dc59c9700 1 --2- 172.21.15.57:0/4026750169 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2dc015d560 0x7f2dc0157f10 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f2dbc00ec80 tx=0x7f2dbc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:03:50.707 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.705+0000 7f2db27fc700 1 -- 172.21.15.57:0/4026750169 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dbc00c850 con 0x7f2dc015d560 2023-10-06T03:03:50.707 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.705+0000 7f2db27fc700 1 -- 172.21.15.57:0/4026750169 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dbc00c9b0 con 0x7f2dc015d560 2023-10-06T03:03:50.707 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.705+0000 7f2dc842e700 1 -- 172.21.15.57:0/4026750169 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dc015f800 con 0x7f2dc015d560 2023-10-06T03:03:50.707 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.705+0000 7f2db27fc700 1 -- 172.21.15.57:0/4026750169 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dbc00cd50 con 0x7f2dc015d560 2023-10-06T03:03:50.707 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.705+0000 7f2dc842e700 1 -- 172.21.15.57:0/4026750169 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dc015fdc0 con 0x7f2dc015d560 2023-10-06T03:03:50.708 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.705+0000 7f2dc842e700 1 -- 172.21.15.57:0/4026750169 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2dc006bc30 con 0x7f2dc015d560 2023-10-06T03:03:50.710 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.709+0000 7f2db27fc700 1 -- 172.21.15.57:0/4026750169 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f2dbc013680 con 0x7f2dc015d560 2023-10-06T03:03:50.712 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.709+0000 7f2db27fc700 1 --2- 172.21.15.57:0/4026750169 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f2da4060550 0x7f2da4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:50.712 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.709+0000 7f2db27fc700 1 -- 172.21.15.57:0/4026750169 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6202+0+0 (secure 0 0 0) 0x7f2dbc07cff0 con 0x7f2dc015d560 2023-10-06T03:03:50.712 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.709+0000 7f2dc61ca700 1 --2- 172.21.15.57:0/4026750169 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f2da4060550 0x7f2da4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:50.714 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.709+0000 7f2dc61ca700 1 --2- 172.21.15.57:0/4026750169 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f2da4060550 0x7f2da4062a00 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f2dc0161300 tx=0x7f2db4017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:03:50.720 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.717+0000 7f2db27fc700 1 -- 172.21.15.57:0/4026750169 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f2dbc04d350 con 0x7f2dc015d560 2023-10-06T03:03:50.893 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.889+0000 7f2dc842e700 1 -- 172.21.15.57:0/4026750169 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2dc004b600 con 0x7f2dc015d560 2023-10-06T03:03:50.893 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.889+0000 7f2db27fc700 1 -- 172.21.15.57:0/4026750169 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v56) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2dbc050970 con 0x7f2dc015d560 2023-10-06T03:03:50.894 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2023-10-06T03:03:50.898 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.893+0000 7f2dc842e700 1 -- 172.21.15.57:0/4026750169 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f2da4060550 msgr2=0x7f2da4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:50.898 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.893+0000 7f2dc842e700 1 --2- 172.21.15.57:0/4026750169 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f2da4060550 0x7f2da4062a00 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f2dc0161300 tx=0x7f2db4017000 comp rx=0 tx=0).stop 2023-10-06T03:03:50.898 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.893+0000 7f2dc842e700 1 -- 172.21.15.57:0/4026750169 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2dc015d560 msgr2=0x7f2dc0157f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:50.898 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.893+0000 7f2dc842e700 1 --2- 172.21.15.57:0/4026750169 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2dc015d560 0x7f2dc0157f10 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f2dbc00ec80 tx=0x7f2dbc0091a0 comp rx=0 tx=0).stop 2023-10-06T03:03:50.898 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.893+0000 7f2dc842e700 1 -- 172.21.15.57:0/4026750169 shutdown_connections 2023-10-06T03:03:50.898 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.893+0000 7f2dc842e700 1 --2- 172.21.15.57:0/4026750169 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f2da4060550 0x7f2da4062a00 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:50.898 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.893+0000 7f2dc842e700 1 --2- 172.21.15.57:0/4026750169 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2dc01618e0 0x7f2dc0158450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:50.898 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.893+0000 7f2dc842e700 1 --2- 172.21.15.57:0/4026750169 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2dc015d560 0x7f2dc0157f10 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:50.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.893+0000 7f2dc842e700 1 --2- 172.21.15.57:0/4026750169 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2dc006e990 0x7f2dc016da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:50.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.893+0000 7f2dc842e700 1 -- 172.21.15.57:0/4026750169 >> 172.21.15.57:0/4026750169 conn(0x7f2dc0067b00 msgr2=0x7f2dc0159510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:03:50.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.893+0000 7f2dc842e700 1 -- 172.21.15.57:0/4026750169 shutdown_connections 2023-10-06T03:03:50.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:50.893+0000 7f2dc842e700 1 -- 172.21.15.57:0/4026750169 wait complete. 2023-10-06T03:03:50.918 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T03:03:51.085 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.081+0000 7f7806f85700 1 Processor -- start 2023-10-06T03:03:51.086 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.081+0000 7f7806f85700 1 -- start start 2023-10-06T03:03:51.090 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.085+0000 7f7806f85700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f780015d3b0 0x7f780015d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:51.090 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.085+0000 7f7806f85700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7800159510 0x7f7800159990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:51.090 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.085+0000 7f7806f85700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78000cc3d0 con 0x7f780015cfe0 2023-10-06T03:03:51.090 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.085+0000 7f7806f85700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78000cf900 con 0x7f780015d3b0 2023-10-06T03:03:51.090 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.085+0000 7f7806f85700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78000caf70 con 0x7f7800159510 2023-10-06T03:03:51.091 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.085+0000 7f77fffff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f780015d3b0 0x7f780015d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:51.091 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.085+0000 7f77fffff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f780015d3b0 0x7f780015d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:50026/0 (socket says 172.21.15.57:50026) 2023-10-06T03:03:51.092 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.085+0000 7f77fffff700 1 -- 172.21.15.57:0/1453816172 learned_addr learned my addr 172.21.15.57:0/1453816172 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:03:51.092 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.089+0000 7f7805522700 1 --2- 172.21.15.57:0/1453816172 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7800159510 0x7f7800159990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:51.092 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.089+0000 7f77fffff700 1 -- 172.21.15.57:0/1453816172 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7800159510 msgr2=0x7f7800159990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:03:51.092 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.089+0000 7f77fffff700 1 --2- 172.21.15.57:0/1453816172 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7800159510 0x7f7800159990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:51.092 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.089+0000 7f77fffff700 1 -- 172.21.15.57:0/1453816172 >> v1:172.21.15.105:6789/0 conn(0x7f780015cfe0 legacy=0x7f78000ce020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:51.092 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.089+0000 7f77fffff700 1 -- 172.21.15.57:0/1453816172 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78000ce870 con 0x7f780015d3b0 2023-10-06T03:03:51.094 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.089+0000 7f77fffff700 1 --2- 172.21.15.57:0/1453816172 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f780015d3b0 0x7f780015d7e0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f77ec0099b0 tx=0x7f77ec009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8140b3f178caa6c9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:03:51.094 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.089+0000 7f77ff7fe700 1 -- 172.21.15.57:0/1453816172 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77ec009ea0 con 0x7f780015d3b0 2023-10-06T03:03:51.094 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.089+0000 7f77ff7fe700 1 -- 172.21.15.57:0/1453816172 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77ec00b860 con 0x7f780015d3b0 2023-10-06T03:03:51.094 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.089+0000 7f77ff7fe700 1 -- 172.21.15.57:0/1453816172 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77ec00bc00 con 0x7f780015d3b0 2023-10-06T03:03:51.094 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.089+0000 7f7806f85700 1 -- 172.21.15.57:0/1453816172 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f780015d3b0 msgr2=0x7f780015d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:51.095 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.089+0000 7f7806f85700 1 --2- 172.21.15.57:0/1453816172 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f780015d3b0 0x7f780015d7e0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f77ec0099b0 tx=0x7f77ec009250 comp rx=0 tx=0).stop 2023-10-06T03:03:51.095 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.089+0000 7f7806f85700 1 -- 172.21.15.57:0/1453816172 shutdown_connections 2023-10-06T03:03:51.095 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.089+0000 7f7806f85700 1 --2- 172.21.15.57:0/1453816172 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7800159510 0x7f7800159990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:51.095 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.089+0000 7f7806f85700 1 --2- 172.21.15.57:0/1453816172 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f780015d3b0 0x7f780015d7e0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:51.095 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.089+0000 7f7806f85700 1 -- 172.21.15.57:0/1453816172 >> 172.21.15.57:0/1453816172 conn(0x7f780006ef40 msgr2=0x7f78000d0240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:03:51.095 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.089+0000 7f7806f85700 1 -- 172.21.15.57:0/1453816172 shutdown_connections 2023-10-06T03:03:51.096 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.089+0000 7f7806f85700 1 -- 172.21.15.57:0/1453816172 wait complete. 2023-10-06T03:03:51.096 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.093+0000 7f7806f85700 1 Processor -- start 2023-10-06T03:03:51.097 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.093+0000 7f7806f85700 1 -- start start 2023-10-06T03:03:51.099 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.097+0000 7f7806f85700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7800159510 0x7f78000b3d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:51.099 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.097+0000 7f7806f85700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f780015cfe0 0x7f780015d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:51.099 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.097+0000 7f7806f85700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f780015d3b0 0x7f78001438b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:51.099 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.097+0000 7f7806f85700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78000b5040 con 0x7f7800159510 2023-10-06T03:03:51.099 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.097+0000 7f7806f85700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78000b4430 con 0x7f780015d3b0 2023-10-06T03:03:51.099 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.097+0000 7f7806f85700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78000b4710 con 0x7f780015cfe0 2023-10-06T03:03:51.100 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.097+0000 7f7804d21700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7800159510 0x7f78000b3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:51.100 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.097+0000 7f7804d21700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7800159510 0x7f78000b3d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:50032/0 (socket says 172.21.15.57:50032) 2023-10-06T03:03:51.100 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.097+0000 7f7804d21700 1 -- 172.21.15.57:0/3843123594 learned_addr learned my addr 172.21.15.57:0/3843123594 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:03:51.101 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.097+0000 7f7805522700 1 --2- 172.21.15.57:0/3843123594 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f780015d3b0 0x7f78001438b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:51.101 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.097+0000 7f77fffff700 1 --2- 172.21.15.57:0/3843123594 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f780015cfe0 0x7f780015d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:51.101 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.097+0000 7f7804d21700 1 -- 172.21.15.57:0/3843123594 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f780015cfe0 msgr2=0x7f780015d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:51.101 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.097+0000 7f7804d21700 1 --2- 172.21.15.57:0/3843123594 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f780015cfe0 0x7f780015d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:51.101 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.097+0000 7f7804d21700 1 -- 172.21.15.57:0/3843123594 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f780015d3b0 msgr2=0x7f78001438b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:51.101 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.097+0000 7f7804d21700 1 --2- 172.21.15.57:0/3843123594 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f780015d3b0 0x7f78001438b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:51.101 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.097+0000 7f7804d21700 1 -- 172.21.15.57:0/3843123594 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77ec0094f0 con 0x7f7800159510 2023-10-06T03:03:51.102 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.097+0000 7f7804d21700 1 --2- 172.21.15.57:0/3843123594 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7800159510 0x7f78000b3d80 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f77f400c540 tx=0x7f77f4001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:03:51.102 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.097+0000 7f77fcff9700 1 -- 172.21.15.57:0/3843123594 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f4011590 con 0x7f7800159510 2023-10-06T03:03:51.102 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.097+0000 7f77fcff9700 1 -- 172.21.15.57:0/3843123594 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77f40116f0 con 0x7f7800159510 2023-10-06T03:03:51.102 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.097+0000 7f77fcff9700 1 -- 172.21.15.57:0/3843123594 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f4011ab0 con 0x7f7800159510 2023-10-06T03:03:51.102 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.097+0000 7f7806f85700 1 -- 172.21.15.57:0/3843123594 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78000b49f0 con 0x7f7800159510 2023-10-06T03:03:51.102 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.097+0000 7f7806f85700 1 -- 172.21.15.57:0/3843123594 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f780015def0 con 0x7f7800159510 2023-10-06T03:03:51.103 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.101+0000 7f7806f85700 1 -- 172.21.15.57:0/3843123594 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7800069de0 con 0x7f7800159510 2023-10-06T03:03:51.104 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.101+0000 7f77fcff9700 1 -- 172.21.15.57:0/3843123594 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f77f401b3b0 con 0x7f7800159510 2023-10-06T03:03:51.106 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.101+0000 7f77fcff9700 1 --2- 172.21.15.57:0/3843123594 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f77e4060580 0x7f77e4062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:51.106 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.101+0000 7f77fcff9700 1 -- 172.21.15.57:0/3843123594 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6202+0+0 (secure 0 0 0) 0x7f77f407be00 con 0x7f7800159510 2023-10-06T03:03:51.106 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.101+0000 7f77fffff700 1 --2- 172.21.15.57:0/3843123594 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f77e4060580 0x7f77e4062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:51.107 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.105+0000 7f77fffff700 1 --2- 172.21.15.57:0/3843123594 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f77e4060580 0x7f77e4062a30 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f77ec0099b0 tx=0x7f77ec017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:03:51.112 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.109+0000 7f77fcff9700 1 -- 172.21.15.57:0/3843123594 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f77f404c2b0 con 0x7f7800159510 2023-10-06T03:03:51.281 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.277+0000 7f7806f85700 1 -- 172.21.15.57:0/3843123594 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f78000ceb50 con 0x7f7800159510 2023-10-06T03:03:51.282 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.277+0000 7f77fcff9700 1 -- 172.21.15.57:0/3843123594 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v56) v1 ==== 100+0+11 (secure 0 0 0) 0x7f77f4017020 con 0x7f7800159510 2023-10-06T03:03:51.282 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 64 2023-10-06T03:03:51.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.285+0000 7f7806f85700 1 -- 172.21.15.57:0/3843123594 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f77e4060580 msgr2=0x7f77e4062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:51.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.285+0000 7f7806f85700 1 --2- 172.21.15.57:0/3843123594 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f77e4060580 0x7f77e4062a30 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f77ec0099b0 tx=0x7f77ec017000 comp rx=0 tx=0).stop 2023-10-06T03:03:51.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.285+0000 7f7806f85700 1 -- 172.21.15.57:0/3843123594 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7800159510 msgr2=0x7f78000b3d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:51.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.285+0000 7f7806f85700 1 --2- 172.21.15.57:0/3843123594 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7800159510 0x7f78000b3d80 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f77f400c540 tx=0x7f77f4001070 comp rx=0 tx=0).stop 2023-10-06T03:03:51.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.285+0000 7f7806f85700 1 -- 172.21.15.57:0/3843123594 shutdown_connections 2023-10-06T03:03:51.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.285+0000 7f7806f85700 1 --2- 172.21.15.57:0/3843123594 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f780015d3b0 0x7f78001438b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:51.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.285+0000 7f7806f85700 1 --2- 172.21.15.57:0/3843123594 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f77e4060580 0x7f77e4062a30 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:51.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.285+0000 7f7806f85700 1 --2- 172.21.15.57:0/3843123594 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f780015cfe0 0x7f780015d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:51.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.285+0000 7f7806f85700 1 --2- 172.21.15.57:0/3843123594 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7800159510 0x7f78000b3d80 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:51.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.285+0000 7f7806f85700 1 -- 172.21.15.57:0/3843123594 >> 172.21.15.57:0/3843123594 conn(0x7f780006ef40 msgr2=0x7f7800157e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:03:51.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.285+0000 7f7806f85700 1 -- 172.21.15.57:0/3843123594 shutdown_connections 2023-10-06T03:03:51.289 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.285+0000 7f7806f85700 1 -- 172.21.15.57:0/3843123594 wait complete. 2023-10-06T03:03:51.307 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:03:51.466 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.461+0000 7f0a4a416700 1 Processor -- start 2023-10-06T03:03:51.467 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.465+0000 7f0a4a416700 1 -- start start 2023-10-06T03:03:51.470 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.465+0000 7f0a4a416700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0a4406def0 0x7f0a4406e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:51.470 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.465+0000 7f0a4a416700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f0a4415a5e0 0x7f0a4406ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:51.470 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.465+0000 7f0a4a416700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0a440ca9e0 0x7f0a440cae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:51.470 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.465+0000 7f0a4a416700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a4406b670 con 0x7f0a4406def0 2023-10-06T03:03:51.470 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.465+0000 7f0a4a416700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a4406b950 con 0x7f0a4415a5e0 2023-10-06T03:03:51.470 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.465+0000 7f0a4a416700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a4406bc30 con 0x7f0a440ca9e0 2023-10-06T03:03:51.471 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.465+0000 7f0a49414700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0a4406def0 0x7f0a4406e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:51.471 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.465+0000 7f0a49414700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0a4406def0 0x7f0a4406e2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:50040/0 (socket says 172.21.15.57:50040) 2023-10-06T03:03:51.472 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.469+0000 7f0a49414700 1 -- 172.21.15.57:0/2655647772 learned_addr learned my addr 172.21.15.57:0/2655647772 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:03:51.472 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.469+0000 7f0a48c13700 1 --2- 172.21.15.57:0/2655647772 >> v2:172.21.15.105:3300/0 conn(0x7f0a4415a5e0 0x7f0a4406ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:51.472 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.469+0000 7f0a49c15700 1 --2- 172.21.15.57:0/2655647772 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0a440ca9e0 0x7f0a440cae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:51.472 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.469+0000 7f0a49414700 1 -- 172.21.15.57:0/2655647772 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0a440ca9e0 msgr2=0x7f0a440cae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:03:51.472 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.469+0000 7f0a49414700 1 --2- 172.21.15.57:0/2655647772 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0a440ca9e0 0x7f0a440cae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:51.472 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.469+0000 7f0a49414700 1 -- 172.21.15.57:0/2655647772 >> v2:172.21.15.105:3300/0 conn(0x7f0a4415a5e0 msgr2=0x7f0a4406ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:03:51.472 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.469+0000 7f0a49414700 1 --2- 172.21.15.57:0/2655647772 >> v2:172.21.15.105:3300/0 conn(0x7f0a4415a5e0 0x7f0a4406ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:51.472 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.469+0000 7f0a49414700 1 -- 172.21.15.57:0/2655647772 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a4406bf10 con 0x7f0a4406def0 2023-10-06T03:03:51.473 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.469+0000 7f0a49414700 1 --2- 172.21.15.57:0/2655647772 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0a4406def0 0x7f0a4406e2c0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f0a4406a620 tx=0x7f0a40009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7877bd1c1863c1e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:03:51.473 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.469+0000 7f0a3bfff700 1 -- 172.21.15.57:0/2655647772 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a4000b860 con 0x7f0a4406def0 2023-10-06T03:03:51.473 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.469+0000 7f0a3bfff700 1 -- 172.21.15.57:0/2655647772 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a4000b9c0 con 0x7f0a4406def0 2023-10-06T03:03:51.473 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.469+0000 7f0a3bfff700 1 -- 172.21.15.57:0/2655647772 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a4000bd60 con 0x7f0a4406def0 2023-10-06T03:03:51.474 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.469+0000 7f0a4a416700 1 -- 172.21.15.57:0/2655647772 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0a4406def0 msgr2=0x7f0a4406e2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:51.474 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.469+0000 7f0a4a416700 1 --2- 172.21.15.57:0/2655647772 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0a4406def0 0x7f0a4406e2c0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f0a4406a620 tx=0x7f0a40009250 comp rx=0 tx=0).stop 2023-10-06T03:03:51.474 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.469+0000 7f0a4a416700 1 -- 172.21.15.57:0/2655647772 shutdown_connections 2023-10-06T03:03:51.474 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.469+0000 7f0a4a416700 1 --2- 172.21.15.57:0/2655647772 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0a440ca9e0 0x7f0a440cae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:51.474 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.469+0000 7f0a4a416700 1 --2- 172.21.15.57:0/2655647772 >> v2:172.21.15.105:3300/0 conn(0x7f0a4415a5e0 0x7f0a4406ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:51.474 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.469+0000 7f0a4a416700 1 --2- 172.21.15.57:0/2655647772 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0a4406def0 0x7f0a4406e2c0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:51.475 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.469+0000 7f0a4a416700 1 -- 172.21.15.57:0/2655647772 >> 172.21.15.57:0/2655647772 conn(0x7f0a440cce10 msgr2=0x7f0a440cd210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:03:51.475 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.469+0000 7f0a4a416700 1 -- 172.21.15.57:0/2655647772 shutdown_connections 2023-10-06T03:03:51.475 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.469+0000 7f0a4a416700 1 -- 172.21.15.57:0/2655647772 wait complete. 2023-10-06T03:03:51.476 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.473+0000 7f0a4a416700 1 Processor -- start 2023-10-06T03:03:51.476 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.473+0000 7f0a4a416700 1 -- start start 2023-10-06T03:03:51.478 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.473+0000 7f0a4a416700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0a4406def0 0x7f0a4415f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:51.478 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.473+0000 7f0a4a416700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0a440ca9e0 0x7f0a4415d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:51.478 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.473+0000 7f0a4a416700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0a4415a5e0 0x7f0a440c8500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:51.478 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.473+0000 7f0a4a416700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a44169750 con 0x7f0a4406def0 2023-10-06T03:03:51.478 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.473+0000 7f0a4a416700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a4415d980 con 0x7f0a440ca9e0 2023-10-06T03:03:51.478 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.473+0000 7f0a4a416700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a4415dc60 con 0x7f0a4415a5e0 2023-10-06T03:03:51.479 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.477+0000 7f0a49414700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0a4406def0 0x7f0a4415f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:51.480 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.477+0000 7f0a49414700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0a4406def0 0x7f0a4415f990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:50044/0 (socket says 172.21.15.57:50044) 2023-10-06T03:03:51.480 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.477+0000 7f0a49414700 1 -- 172.21.15.57:0/1809317083 learned_addr learned my addr 172.21.15.57:0/1809317083 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:03:51.480 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.477+0000 7f0a48c13700 1 --2- 172.21.15.57:0/1809317083 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0a440ca9e0 0x7f0a4415d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:51.480 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.477+0000 7f0a49c15700 1 --2- 172.21.15.57:0/1809317083 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0a4415a5e0 0x7f0a440c8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:51.480 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.477+0000 7f0a49414700 1 -- 172.21.15.57:0/1809317083 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0a4415a5e0 msgr2=0x7f0a440c8500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:51.480 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.477+0000 7f0a49414700 1 --2- 172.21.15.57:0/1809317083 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0a4415a5e0 0x7f0a440c8500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:51.480 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.477+0000 7f0a49414700 1 -- 172.21.15.57:0/1809317083 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0a440ca9e0 msgr2=0x7f0a4415d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:51.480 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.477+0000 7f0a49414700 1 --2- 172.21.15.57:0/1809317083 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0a440ca9e0 0x7f0a4415d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:51.480 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.477+0000 7f0a49414700 1 -- 172.21.15.57:0/1809317083 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a400094f0 con 0x7f0a4406def0 2023-10-06T03:03:51.480 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.477+0000 7f0a48c13700 1 --2- 172.21.15.57:0/1809317083 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0a440ca9e0 0x7f0a4415d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:03:51.480 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.477+0000 7f0a49414700 1 --2- 172.21.15.57:0/1809317083 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0a4406def0 0x7f0a4415f990 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f0a440c3c60 tx=0x7f0a40017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:03:51.481 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.477+0000 7f0a397fa700 1 -- 172.21.15.57:0/1809317083 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a40024440 con 0x7f0a4406def0 2023-10-06T03:03:51.481 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.477+0000 7f0a397fa700 1 -- 172.21.15.57:0/1809317083 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a400245a0 con 0x7f0a4406def0 2023-10-06T03:03:51.481 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.477+0000 7f0a4a416700 1 -- 172.21.15.57:0/1809317083 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a4415df40 con 0x7f0a4406def0 2023-10-06T03:03:51.481 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.477+0000 7f0a397fa700 1 -- 172.21.15.57:0/1809317083 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a40024960 con 0x7f0a4406def0 2023-10-06T03:03:51.482 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.477+0000 7f0a4a416700 1 -- 172.21.15.57:0/1809317083 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a4415e220 con 0x7f0a4406def0 2023-10-06T03:03:51.482 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.477+0000 7f0a4a416700 1 -- 172.21.15.57:0/1809317083 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a440645e0 con 0x7f0a4406def0 2023-10-06T03:03:51.483 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.481+0000 7f0a397fa700 1 -- 172.21.15.57:0/1809317083 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f0a4001a420 con 0x7f0a4406def0 2023-10-06T03:03:51.484 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.481+0000 7f0a397fa700 1 --2- 172.21.15.57:0/1809317083 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f0a28060550 0x7f0a28062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:51.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.481+0000 7f0a397fa700 1 -- 172.21.15.57:0/1809317083 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6202+0+0 (secure 0 0 0) 0x7f0a4007e880 con 0x7f0a4406def0 2023-10-06T03:03:51.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.481+0000 7f0a48c13700 1 --2- 172.21.15.57:0/1809317083 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f0a28060550 0x7f0a28062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:51.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.481+0000 7f0a48c13700 1 --2- 172.21.15.57:0/1809317083 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f0a28060550 0x7f0a28062a00 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f0a44160380 tx=0x7f0a34008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:03:51.491 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.489+0000 7f0a397fa700 1 -- 172.21.15.57:0/1809317083 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f0a4004ebe0 con 0x7f0a4406def0 2023-10-06T03:03:51.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.697+0000 7f0a4a416700 1 -- 172.21.15.57:0/1809317083 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0a440cbac0 con 0x7f0a4406def0 2023-10-06T03:03:51.702 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.697+0000 7f0a397fa700 1 -- 172.21.15.57:0/1809317083 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4598 (secure 0 0 0) 0x7f0a40052200 con 0x7f0a4406def0 2023-10-06T03:03:51.702 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:03:51.702 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":38,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5222,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/879829980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":879829980},{"type":"v1","addr":"172.21.15.105:6833","nonce":879829980}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5225,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/3705921279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":3705921279},{"type":"v1","addr":"172.21.15.105:6835","nonce":3705921279}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/251759282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":251759282},{"type":"v1","addr":"172.21.15.57:6835","nonce":251759282}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:02:39.274111+0000","modified":"2023-10-06T03:02:56.856783+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":54,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5643},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5643":{"gid":5643,"name":"c","rank":0,"incarnation":34,"state":"up:active","state_seq":5,"addr":"172.21.15.57:6837/3347844181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6836","nonce":3347844181},{"type":"v1","addr":"172.21.15.57:6837","nonce":3347844181}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T03:03:51.705 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.701+0000 7f0a4a416700 1 -- 172.21.15.57:0/1809317083 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f0a28060550 msgr2=0x7f0a28062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:51.705 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.701+0000 7f0a4a416700 1 --2- 172.21.15.57:0/1809317083 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f0a28060550 0x7f0a28062a00 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f0a44160380 tx=0x7f0a34008040 comp rx=0 tx=0).stop 2023-10-06T03:03:51.705 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.701+0000 7f0a4a416700 1 -- 172.21.15.57:0/1809317083 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0a4406def0 msgr2=0x7f0a4415f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:51.706 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.701+0000 7f0a4a416700 1 --2- 172.21.15.57:0/1809317083 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0a4406def0 0x7f0a4415f990 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f0a440c3c60 tx=0x7f0a40017000 comp rx=0 tx=0).stop 2023-10-06T03:03:51.706 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.701+0000 7f0a4a416700 1 -- 172.21.15.57:0/1809317083 shutdown_connections 2023-10-06T03:03:51.706 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.701+0000 7f0a4a416700 1 --2- 172.21.15.57:0/1809317083 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f0a28060550 0x7f0a28062a00 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:51.706 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.701+0000 7f0a4a416700 1 --2- 172.21.15.57:0/1809317083 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0a4415a5e0 0x7f0a440c8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:51.706 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.701+0000 7f0a4a416700 1 --2- 172.21.15.57:0/1809317083 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0a440ca9e0 0x7f0a4415d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:51.706 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.701+0000 7f0a4a416700 1 --2- 172.21.15.57:0/1809317083 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0a4406def0 0x7f0a4415f990 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:51.706 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.701+0000 7f0a4a416700 1 -- 172.21.15.57:0/1809317083 >> 172.21.15.57:0/1809317083 conn(0x7f0a440cce10 msgr2=0x7f0a440c1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:03:51.707 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.701+0000 7f0a4a416700 1 -- 172.21.15.57:0/1809317083 shutdown_connections 2023-10-06T03:03:51.707 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.701+0000 7f0a4a416700 1 -- 172.21.15.57:0/1809317083 wait complete. 2023-10-06T03:03:51.707 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 38 2023-10-06T03:03:51.727 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:03:51.889 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.885+0000 7fd499d23700 1 Processor -- start 2023-10-06T03:03:51.889 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.885+0000 7fd499d23700 1 -- start start 2023-10-06T03:03:51.891 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.889+0000 7fd499d23700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fd49415c730 0x7fd4940d0770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:51.891 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.889+0000 7fd499d23700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd4940b3250 0x7fd49415d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:51.891 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.889+0000 7fd499d23700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd4940b0c40 0x7fd4940b10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:51.891 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.889+0000 7fd499d23700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4940d1030 con 0x7fd4940b0c40 2023-10-06T03:03:51.891 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.889+0000 7fd499d23700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4940b15e0 con 0x7fd49415c730 2023-10-06T03:03:51.892 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.889+0000 7fd499d23700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4940ae390 con 0x7fd4940b3250 2023-10-06T03:03:51.892 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.889+0000 7fd499522700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd4940b0c40 0x7fd4940b10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:51.892 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.889+0000 7fd499522700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd4940b0c40 0x7fd4940b10a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:50054/0 (socket says 172.21.15.57:50054) 2023-10-06T03:03:51.893 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.889+0000 7fd499522700 1 -- 172.21.15.57:0/825794027 learned_addr learned my addr 172.21.15.57:0/825794027 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:03:51.893 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.889+0000 7fd498d21700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fd49415c730 0x7fd4940d0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:51.893 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.889+0000 7fd493fff700 1 --2- 172.21.15.57:0/825794027 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd4940b3250 0x7fd49415d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:51.893 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.889+0000 7fd499522700 1 -- 172.21.15.57:0/825794027 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd4940b3250 msgr2=0x7fd49415d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:03:51.893 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.889+0000 7fd499522700 1 --2- 172.21.15.57:0/825794027 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd4940b3250 0x7fd49415d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:51.893 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.889+0000 7fd499522700 1 -- 172.21.15.57:0/825794027 >> v2:172.21.15.105:3300/0 conn(0x7fd49415c730 msgr2=0x7fd4940d0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:03:51.893 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.889+0000 7fd499522700 1 --2- 172.21.15.57:0/825794027 >> v2:172.21.15.105:3300/0 conn(0x7fd49415c730 0x7fd4940d0770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:51.893 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.889+0000 7fd499522700 1 -- 172.21.15.57:0/825794027 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4940b36a0 con 0x7fd4940b0c40 2023-10-06T03:03:51.893 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.889+0000 7fd499522700 1 --2- 172.21.15.57:0/825794027 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd4940b0c40 0x7fd4940b10a0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fd4940b3830 tx=0x7fd48c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d9f22c1becb1b2e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:03:51.894 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.889+0000 7fd4937fe700 1 -- 172.21.15.57:0/825794027 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd48c00e070 con 0x7fd4940b0c40 2023-10-06T03:03:51.894 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.889+0000 7fd4937fe700 1 -- 172.21.15.57:0/825794027 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd48c00b940 con 0x7fd4940b0c40 2023-10-06T03:03:51.894 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.889+0000 7fd4937fe700 1 -- 172.21.15.57:0/825794027 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd48c00bd00 con 0x7fd4940b0c40 2023-10-06T03:03:51.895 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.889+0000 7fd499d23700 1 -- 172.21.15.57:0/825794027 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd4940b0c40 msgr2=0x7fd4940b10a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:51.895 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.889+0000 7fd499d23700 1 --2- 172.21.15.57:0/825794027 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd4940b0c40 0x7fd4940b10a0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fd4940b3830 tx=0x7fd48c009840 comp rx=0 tx=0).stop 2023-10-06T03:03:51.895 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.889+0000 7fd499d23700 1 -- 172.21.15.57:0/825794027 shutdown_connections 2023-10-06T03:03:51.895 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.889+0000 7fd499d23700 1 --2- 172.21.15.57:0/825794027 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd4940b0c40 0x7fd4940b10a0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:51.895 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.889+0000 7fd499d23700 1 --2- 172.21.15.57:0/825794027 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd4940b3250 0x7fd49415d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:51.895 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.889+0000 7fd499d23700 1 --2- 172.21.15.57:0/825794027 >> v2:172.21.15.105:3300/0 conn(0x7fd49415c730 0x7fd4940d0770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:51.895 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.889+0000 7fd499d23700 1 -- 172.21.15.57:0/825794027 >> 172.21.15.57:0/825794027 conn(0x7fd49406ef40 msgr2=0x7fd4940d0060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:03:51.895 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.893+0000 7fd499d23700 1 -- 172.21.15.57:0/825794027 shutdown_connections 2023-10-06T03:03:51.895 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.893+0000 7fd499d23700 1 -- 172.21.15.57:0/825794027 wait complete. 2023-10-06T03:03:51.896 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.893+0000 7fd499d23700 1 Processor -- start 2023-10-06T03:03:51.897 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.893+0000 7fd499d23700 1 -- start start 2023-10-06T03:03:51.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.897+0000 7fd499d23700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd4940b0c40 0x7fd4941592d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:51.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.897+0000 7fd499d23700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd4940b3250 0x7fd494099c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:51.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.897+0000 7fd499d23700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd49415c730 0x7fd49414b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:51.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.897+0000 7fd499d23700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd494158490 con 0x7fd49415c730 2023-10-06T03:03:51.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.897+0000 7fd499d23700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd494170d30 con 0x7fd4940b0c40 2023-10-06T03:03:51.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.897+0000 7fd499d23700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd494171010 con 0x7fd4940b3250 2023-10-06T03:03:51.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.897+0000 7fd498d21700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd4940b0c40 0x7fd4941592d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:51.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.897+0000 7fd499522700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd49415c730 0x7fd49414b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:51.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.897+0000 7fd498d21700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd4940b0c40 0x7fd4941592d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.57:39652/0 (socket says 172.21.15.57:39652) 2023-10-06T03:03:51.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.897+0000 7fd499522700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd49415c730 0x7fd49414b5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:50068/0 (socket says 172.21.15.57:50068) 2023-10-06T03:03:51.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.897+0000 7fd498d21700 1 -- 172.21.15.57:0/2849406563 learned_addr learned my addr 172.21.15.57:0/2849406563 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:03:51.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.897+0000 7fd493fff700 1 --2- 172.21.15.57:0/2849406563 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd4940b3250 0x7fd494099c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:51.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.897+0000 7fd498d21700 1 -- 172.21.15.57:0/2849406563 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd4940b3250 msgr2=0x7fd494099c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:51.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.897+0000 7fd498d21700 1 --2- 172.21.15.57:0/2849406563 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd4940b3250 0x7fd494099c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:51.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.897+0000 7fd498d21700 1 -- 172.21.15.57:0/2849406563 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd49415c730 msgr2=0x7fd49414b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:51.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.897+0000 7fd498d21700 1 --2- 172.21.15.57:0/2849406563 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd49415c730 0x7fd49414b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:51.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.897+0000 7fd498d21700 1 -- 172.21.15.57:0/2849406563 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd48c009ae0 con 0x7fd4940b0c40 2023-10-06T03:03:51.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.897+0000 7fd499522700 1 --2- 172.21.15.57:0/2849406563 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd49415c730 0x7fd49414b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:03:51.902 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.897+0000 7fd498d21700 1 --2- 172.21.15.57:0/2849406563 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd4940b0c40 0x7fd4941592d0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fd48800e930 tx=0x7fd4880091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:03:51.902 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.897+0000 7fd490ff9700 1 -- 172.21.15.57:0/2849406563 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd488013680 con 0x7fd4940b0c40 2023-10-06T03:03:51.902 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.897+0000 7fd490ff9700 1 -- 172.21.15.57:0/2849406563 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4880137e0 con 0x7fd4940b0c40 2023-10-06T03:03:51.902 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.897+0000 7fd499d23700 1 -- 172.21.15.57:0/2849406563 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4941712f0 con 0x7fd4940b0c40 2023-10-06T03:03:51.903 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.897+0000 7fd490ff9700 1 -- 172.21.15.57:0/2849406563 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd488013b80 con 0x7fd4940b0c40 2023-10-06T03:03:51.903 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.897+0000 7fd499d23700 1 -- 172.21.15.57:0/2849406563 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4941718b0 con 0x7fd4940b0c40 2023-10-06T03:03:51.903 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.901+0000 7fd499d23700 1 -- 172.21.15.57:0/2849406563 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4940645e0 con 0x7fd4940b0c40 2023-10-06T03:03:51.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.901+0000 7fd490ff9700 1 -- 172.21.15.57:0/2849406563 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fd48800c3e0 con 0x7fd4940b0c40 2023-10-06T03:03:51.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.905+0000 7fd490ff9700 1 --2- 172.21.15.57:0/2849406563 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fd478060550 0x7fd478062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:51.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.905+0000 7fd490ff9700 1 -- 172.21.15.57:0/2849406563 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6202+0+0 (secure 0 0 0) 0x7fd48807ca50 con 0x7fd4940b0c40 2023-10-06T03:03:51.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.905+0000 7fd493fff700 1 --2- 172.21.15.57:0/2849406563 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fd478060550 0x7fd478062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:51.908 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.905+0000 7fd493fff700 1 --2- 172.21.15.57:0/2849406563 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fd478060550 0x7fd478062a00 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fd494170b10 tx=0x7fd4800091a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:03:51.915 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:51.913+0000 7fd490ff9700 1 -- 172.21.15.57:0/2849406563 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fd48804ce50 con 0x7fd4940b0c40 2023-10-06T03:03:52.086 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.081+0000 7fd499d23700 1 -- 172.21.15.57:0/2849406563 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd494159d60 con 0x7fd4940b0c40 2023-10-06T03:03:52.089 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.085+0000 7fd490ff9700 1 -- 172.21.15.57:0/2849406563 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) v1 ==== 74+0+17091 (secure 0 0 0) 0x7fd488017090 con 0x7fd4940b0c40 2023-10-06T03:03:52.090 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:03:52.090 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":56,"fsid":"eb56dc0f-9213-41cb-9aad-8ade6c802e98","created":"2023-10-06T03:00:30.806197+0000","modified":"2023-10-06T03:03:38.834241+0000","last_up_change":"2023-10-06T03:00:43.607454+0000","last_in_change":"2023-10-06T03:00:33.943513+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T03:00:44.360651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T03:00:50.466601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:02:37.240020+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-10-06T03:02:38.287494+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"58cf6c90-d704-43e0-b2db-dffe526d5e8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":33053},{"type":"v1","addr":"172.21.15.57:6801","nonce":33053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":33053},{"type":"v1","addr":"172.21.15.57:6803","nonce":33053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":33053},{"type":"v1","addr":"172.21.15.57:6807","nonce":33053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":33053},{"type":"v1","addr":"172.21.15.57:6805","nonce":33053}]},"public_addr":"172.21.15.57:6801/33053","cluster_addr":"172.21.15.57:6803/33053","heartbeat_back_addr":"172.21.15.57:6807/33053","heartbeat_front_addr":"172.21.15.57:6805/33053","state":["exists","up"]},{"osd":1,"uuid":"16afbe70-7f9e-4568-9c92-763e6e348119","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6809","nonce":33052},{"type":"v1","addr":"172.21.15.57:6810","nonce":33052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":33052},{"type":"v1","addr":"172.21.15.57:6813","nonce":33052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":33052},{"type":"v1","addr":"172.21.15.57:6822","nonce":33052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6815","nonce":33052},{"type":"v1","addr":"172.21.15.57:6818","nonce":33052}]},"public_addr":"172.21.15.57:6810/33052","cluster_addr":"172.21.15.57:6813/33052","heartbeat_back_addr":"172.21.15.57:6822/33052","heartbeat_front_addr":"172.21.15.57:6818/33052","state":["exists","up"]},{"osd":2,"uuid":"7255c62e-f92f-470f-a5ce-30228920d9f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":33058},{"type":"v1","addr":"172.21.15.57:6825","nonce":33058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":33058},{"type":"v1","addr":"172.21.15.57:6827","nonce":33058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":33058},{"type":"v1","addr":"172.21.15.57:6831","nonce":33058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":33058},{"type":"v1","addr":"172.21.15.57:6829","nonce":33058}]},"public_addr":"172.21.15.57:6825/33058","cluster_addr":"172.21.15.57:6827/33058","heartbeat_back_addr":"172.21.15.57:6831/33058","heartbeat_front_addr":"172.21.15.57:6829/33058","state":["exists","up"]},{"osd":3,"uuid":"152a236d-f799-4888-8544-74865508d5a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":33057},{"type":"v1","addr":"172.21.15.57:6811","nonce":33057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":33057},{"type":"v1","addr":"172.21.15.57:6816","nonce":33057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6821","nonce":33057},{"type":"v1","addr":"172.21.15.57:6823","nonce":33057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6817","nonce":33057},{"type":"v1","addr":"172.21.15.57:6819","nonce":33057}]},"public_addr":"172.21.15.57:6811/33057","cluster_addr":"172.21.15.57:6816/33057","heartbeat_back_addr":"172.21.15.57:6823/33057","heartbeat_front_addr":"172.21.15.57:6819/33057","state":["exists","up"]},{"osd":4,"uuid":"37db2a65-3566-41d0-9d60-e66c49e1e68e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":33368},{"type":"v1","addr":"172.21.15.105:6801","nonce":33368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":33368},{"type":"v1","addr":"172.21.15.105:6803","nonce":33368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":33368},{"type":"v1","addr":"172.21.15.105:6807","nonce":33368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":33368},{"type":"v1","addr":"172.21.15.105:6805","nonce":33368}]},"public_addr":"172.21.15.105:6801/33368","cluster_addr":"172.21.15.105:6803/33368","heartbeat_back_addr":"172.21.15.105:6807/33368","heartbeat_front_addr":"172.21.15.105:6805/33368","state":["exists","up"]},{"osd":5,"uuid":"35e77918-1bb4-42ca-9b20-f3c14eaa0c04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":33379},{"type":"v1","addr":"172.21.15.105:6818","nonce":33379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":33379},{"type":"v1","addr":"172.21.15.105:6823","nonce":33379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":33379},{"type":"v1","addr":"172.21.15.105:6831","nonce":33379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":33379},{"type":"v1","addr":"172.21.15.105:6827","nonce":33379}]},"public_addr":"172.21.15.105:6818/33379","cluster_addr":"172.21.15.105:6823/33379","heartbeat_back_addr":"172.21.15.105:6831/33379","heartbeat_front_addr":"172.21.15.105:6827/33379","state":["exists","up"]},{"osd":6,"uuid":"b4d9d510-7a45-4173-8287-c6c8d6547f2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":33369},{"type":"v1","addr":"172.21.15.105:6819","nonce":33369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":33369},{"type":"v1","addr":"172.21.15.105:6822","nonce":33369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":33369},{"type":"v1","addr":"172.21.15.105:6830","nonce":33369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":33369},{"type":"v1","addr":"172.21.15.105:6826","nonce":33369}]},"public_addr":"172.21.15.105:6819/33369","cluster_addr":"172.21.15.105:6822/33369","heartbeat_back_addr":"172.21.15.105:6830/33369","heartbeat_front_addr":"172.21.15.105:6826/33369","state":["exists","up"]},{"osd":7,"uuid":"74266fb0-cd84-463f-8bf0-092652a71dc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":33370},{"type":"v1","addr":"172.21.15.105:6809","nonce":33370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":33370},{"type":"v1","addr":"172.21.15.105:6811","nonce":33370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":33370},{"type":"v1","addr":"172.21.15.105:6815","nonce":33370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":33370},{"type":"v1","addr":"172.21.15.105:6813","nonce":33370}]},"public_addr":"172.21.15.105:6809/33370","cluster_addr":"172.21.15.105:6811/33370","heartbeat_back_addr":"172.21.15.105:6815/33370","heartbeat_front_addr":"172.21.15.105:6813/33370","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.596864+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.633851+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.636993+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.529681+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.608601+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.659752+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.661717+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.642221+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.1d","mappings":[{"from":0,"to":6}]},{"pgid":"8.27","mappings":[{"from":0,"to":6}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.57:6837/4147766471":"2023-10-07T03:02:52.815979+0000","172.21.15.57:6835/4147766471":"2023-10-07T03:02:52.815979+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:03:52.092 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.089+0000 7fd499d23700 1 -- 172.21.15.57:0/2849406563 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fd478060550 msgr2=0x7fd478062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:52.092 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.089+0000 7fd499d23700 1 --2- 172.21.15.57:0/2849406563 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fd478060550 0x7fd478062a00 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fd494170b10 tx=0x7fd4800091a0 comp rx=0 tx=0).stop 2023-10-06T03:03:52.092 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.089+0000 7fd499d23700 1 -- 172.21.15.57:0/2849406563 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd4940b0c40 msgr2=0x7fd4941592d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:52.092 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.089+0000 7fd499d23700 1 --2- 172.21.15.57:0/2849406563 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd4940b0c40 0x7fd4941592d0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fd48800e930 tx=0x7fd4880091a0 comp rx=0 tx=0).stop 2023-10-06T03:03:52.092 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.089+0000 7fd499d23700 1 -- 172.21.15.57:0/2849406563 shutdown_connections 2023-10-06T03:03:52.092 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.089+0000 7fd499d23700 1 --2- 172.21.15.57:0/2849406563 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd49415c730 0x7fd49414b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:52.092 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.089+0000 7fd499d23700 1 --2- 172.21.15.57:0/2849406563 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fd478060550 0x7fd478062a00 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:52.092 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.089+0000 7fd499d23700 1 --2- 172.21.15.57:0/2849406563 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd4940b3250 0x7fd494099c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:52.093 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.089+0000 7fd499d23700 1 --2- 172.21.15.57:0/2849406563 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd4940b0c40 0x7fd4941592d0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:52.093 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.089+0000 7fd499d23700 1 -- 172.21.15.57:0/2849406563 >> 172.21.15.57:0/2849406563 conn(0x7fd49406ef40 msgr2=0x7fd4940ae820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:03:52.093 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.089+0000 7fd499d23700 1 -- 172.21.15.57:0/2849406563 shutdown_connections 2023-10-06T03:03:52.093 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.089+0000 7fd499d23700 1 -- 172.21.15.57:0/2849406563 wait complete. 2023-10-06T03:03:52.114 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T03:03:52.114 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:03:52.274 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.269+0000 7f7953cf0700 1 Processor -- start 2023-10-06T03:03:52.274 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.269+0000 7f7953cf0700 1 -- start start 2023-10-06T03:03:52.276 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.273+0000 7f7953cf0700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f794c15d6a0 0x7f794c0c6510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:52.276 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.273+0000 7f7953cf0700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f794c0c1e30 0x7f794c0c6a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:52.276 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.273+0000 7f7953cf0700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f794c0cb0a0 con 0x7f794c0c9fb0 2023-10-06T03:03:52.276 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.273+0000 7f7953cf0700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f794c0ca490 con 0x7f794c15d6a0 2023-10-06T03:03:52.276 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.273+0000 7f7953cf0700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f794c0ca770 con 0x7f794c0c1e30 2023-10-06T03:03:52.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.273+0000 7f7951a8c700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f794c15d6a0 0x7f794c0c6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:52.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.273+0000 7f795228d700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f794c0c1e30 0x7f794c0c6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:52.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.273+0000 7f7951a8c700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f794c15d6a0 0x7f794c0c6510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.57:39662/0 (socket says 172.21.15.57:39662) 2023-10-06T03:03:52.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.273+0000 7f7951a8c700 1 -- 172.21.15.57:0/2536728372 learned_addr learned my addr 172.21.15.57:0/2536728372 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:03:52.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.273+0000 7f7951a8c700 1 -- 172.21.15.57:0/2536728372 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f794c0c1e30 msgr2=0x7f794c0c6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:03:52.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.273+0000 7f7951a8c700 1 --2- 172.21.15.57:0/2536728372 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f794c0c1e30 0x7f794c0c6a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:52.278 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.273+0000 7f7951a8c700 1 -- 172.21.15.57:0/2536728372 >> v1:172.21.15.105:6789/0 conn(0x7f794c0c9fb0 legacy=0x7f794c15da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:52.278 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.273+0000 7f7951a8c700 1 -- 172.21.15.57:0/2536728372 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f794c0caa50 con 0x7f794c15d6a0 2023-10-06T03:03:52.278 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.273+0000 7f7951a8c700 1 --2- 172.21.15.57:0/2536728372 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f794c15d6a0 0x7f794c0c6510 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f7948009990 tx=0x7f7948009220 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b8f4cd593bdaf348 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:03:52.278 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.273+0000 7f7950a8a700 1 -- 172.21.15.57:0/2536728372 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7948009e80 con 0x7f794c15d6a0 2023-10-06T03:03:52.278 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.277+0000 7f7950a8a700 1 -- 172.21.15.57:0/2536728372 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7948005c10 con 0x7f794c15d6a0 2023-10-06T03:03:52.279 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.277+0000 7f7950a8a700 1 -- 172.21.15.57:0/2536728372 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f794800b650 con 0x7f794c15d6a0 2023-10-06T03:03:52.279 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.277+0000 7f7953cf0700 1 -- 172.21.15.57:0/2536728372 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f794c15d6a0 msgr2=0x7f794c0c6510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:52.279 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.277+0000 7f7953cf0700 1 --2- 172.21.15.57:0/2536728372 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f794c15d6a0 0x7f794c0c6510 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f7948009990 tx=0x7f7948009220 comp rx=0 tx=0).stop 2023-10-06T03:03:52.279 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.277+0000 7f7953cf0700 1 -- 172.21.15.57:0/2536728372 shutdown_connections 2023-10-06T03:03:52.279 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.277+0000 7f7953cf0700 1 --2- 172.21.15.57:0/2536728372 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f794c0c1e30 0x7f794c0c6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:52.280 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.277+0000 7f7953cf0700 1 --2- 172.21.15.57:0/2536728372 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f794c15d6a0 0x7f794c0c6510 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:52.280 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.277+0000 7f7953cf0700 1 -- 172.21.15.57:0/2536728372 >> 172.21.15.57:0/2536728372 conn(0x7f794c0cbed0 msgr2=0x7f794c0cc2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:03:52.280 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.277+0000 7f7953cf0700 1 -- 172.21.15.57:0/2536728372 shutdown_connections 2023-10-06T03:03:52.280 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.277+0000 7f7953cf0700 1 -- 172.21.15.57:0/2536728372 wait complete. 2023-10-06T03:03:52.284 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.281+0000 7f7953cf0700 1 Processor -- start 2023-10-06T03:03:52.284 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.281+0000 7f7953cf0700 1 -- start start 2023-10-06T03:03:52.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.281+0000 7f7953cf0700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f794c0c1e30 0x7f794c0c5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:52.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.281+0000 7f7953cf0700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f794c0c9fb0 0x7f794c06e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:52.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.281+0000 7f7953cf0700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f794c15d6a0 0x7f794c06e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:52.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.281+0000 7f7953cf0700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f794c0afc60 con 0x7f794c15d6a0 2023-10-06T03:03:52.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.281+0000 7f7953cf0700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f794c16ea30 con 0x7f794c0c9fb0 2023-10-06T03:03:52.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.281+0000 7f7953cf0700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f794c0afeb0 con 0x7f794c0c1e30 2023-10-06T03:03:52.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.281+0000 7f795228d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f794c15d6a0 0x7f794c06e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:52.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.281+0000 7f7951a8c700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f794c0c1e30 0x7f794c0c5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:52.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.281+0000 7f795228d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f794c15d6a0 0x7f794c06e9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:50072/0 (socket says 172.21.15.57:50072) 2023-10-06T03:03:52.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.281+0000 7f795228d700 1 -- 172.21.15.57:0/3868690786 learned_addr learned my addr 172.21.15.57:0/3868690786 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:03:52.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.281+0000 7f795128b700 1 --2- 172.21.15.57:0/3868690786 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f794c0c9fb0 0x7f794c06e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:52.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.281+0000 7f7951a8c700 1 -- 172.21.15.57:0/3868690786 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f794c0c9fb0 msgr2=0x7f794c06e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:52.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.281+0000 7f7951a8c700 1 --2- 172.21.15.57:0/3868690786 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f794c0c9fb0 0x7f794c06e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:52.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.281+0000 7f7951a8c700 1 -- 172.21.15.57:0/3868690786 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f794c15d6a0 msgr2=0x7f794c06e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:52.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.281+0000 7f7951a8c700 1 --2- 172.21.15.57:0/3868690786 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f794c15d6a0 0x7f794c06e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:52.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.281+0000 7f7951a8c700 1 -- 172.21.15.57:0/3868690786 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7948009480 con 0x7f794c0c1e30 2023-10-06T03:03:52.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.285+0000 7f7951a8c700 1 --2- 172.21.15.57:0/3868690786 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f794c0c1e30 0x7f794c0c5710 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7948015000 tx=0x7f7948016000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:03:52.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.285+0000 7f7941ffb700 1 -- 172.21.15.57:0/3868690786 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7948011950 con 0x7f794c0c1e30 2023-10-06T03:03:52.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.285+0000 7f7941ffb700 1 -- 172.21.15.57:0/3868690786 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7948020070 con 0x7f794c0c1e30 2023-10-06T03:03:52.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.285+0000 7f7953cf0700 1 -- 172.21.15.57:0/3868690786 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f794c0b0190 con 0x7f794c0c1e30 2023-10-06T03:03:52.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.285+0000 7f7941ffb700 1 -- 172.21.15.57:0/3868690786 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7948011ce0 con 0x7f794c0c1e30 2023-10-06T03:03:52.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.285+0000 7f7953cf0700 1 -- 172.21.15.57:0/3868690786 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f794c0b0990 con 0x7f794c0c1e30 2023-10-06T03:03:52.289 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.285+0000 7f7953cf0700 1 -- 172.21.15.57:0/3868690786 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f794c0b0690 con 0x7f794c0c1e30 2023-10-06T03:03:52.291 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.289+0000 7f7941ffb700 1 -- 172.21.15.57:0/3868690786 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f7948022030 con 0x7f794c0c1e30 2023-10-06T03:03:52.293 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.289+0000 7f7941ffb700 1 --2- 172.21.15.57:0/3868690786 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f7930060620 0x7f7930062ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:52.293 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.289+0000 7f7941ffb700 1 -- 172.21.15.57:0/3868690786 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6202+0+0 (secure 0 0 0) 0x7f794807e4d0 con 0x7f794c0c1e30 2023-10-06T03:03:52.293 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.289+0000 7f795128b700 1 --2- 172.21.15.57:0/3868690786 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f7930060620 0x7f7930062ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:52.294 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.293+0000 7f795128b700 1 --2- 172.21.15.57:0/3868690786 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f7930060620 0x7f7930062ad0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f794c15a470 tx=0x7f793c007ec0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:03:52.300 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.297+0000 7f7941ffb700 1 -- 172.21.15.57:0/3868690786 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f794804e930 con 0x7f794c0c1e30 2023-10-06T03:03:52.505 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.501+0000 7f7953cf0700 1 -- 172.21.15.57:0/3868690786 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f794c0afff0 con 0x7f794c0c1e30 2023-10-06T03:03:52.507 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.505+0000 7f7941ffb700 1 -- 172.21.15.57:0/3868690786 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4598 (secure 0 0 0) 0x7f794c0afff0 con 0x7f794c0c1e30 2023-10-06T03:03:52.507 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:03:52.507 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":38,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5222,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/879829980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":879829980},{"type":"v1","addr":"172.21.15.105:6833","nonce":879829980}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5225,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/3705921279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":3705921279},{"type":"v1","addr":"172.21.15.105:6835","nonce":3705921279}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/251759282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":251759282},{"type":"v1","addr":"172.21.15.57:6835","nonce":251759282}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:02:39.274111+0000","modified":"2023-10-06T03:02:56.856783+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":54,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5643},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5643":{"gid":5643,"name":"c","rank":0,"incarnation":34,"state":"up:active","state_seq":5,"addr":"172.21.15.57:6837/3347844181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6836","nonce":3347844181},{"type":"v1","addr":"172.21.15.57:6837","nonce":3347844181}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T03:03:52.511 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.505+0000 7f7953cf0700 1 -- 172.21.15.57:0/3868690786 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f7930060620 msgr2=0x7f7930062ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:52.512 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.505+0000 7f7953cf0700 1 --2- 172.21.15.57:0/3868690786 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f7930060620 0x7f7930062ad0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f794c15a470 tx=0x7f793c007ec0 comp rx=0 tx=0).stop 2023-10-06T03:03:52.512 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.505+0000 7f7953cf0700 1 -- 172.21.15.57:0/3868690786 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f794c0c1e30 msgr2=0x7f794c0c5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:52.512 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.505+0000 7f7953cf0700 1 --2- 172.21.15.57:0/3868690786 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f794c0c1e30 0x7f794c0c5710 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7948015000 tx=0x7f7948016000 comp rx=0 tx=0).stop 2023-10-06T03:03:52.512 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.505+0000 7f7953cf0700 1 -- 172.21.15.57:0/3868690786 shutdown_connections 2023-10-06T03:03:52.512 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.505+0000 7f7953cf0700 1 --2- 172.21.15.57:0/3868690786 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f794c15d6a0 0x7f794c06e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:52.512 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.505+0000 7f7953cf0700 1 --2- 172.21.15.57:0/3868690786 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f794c0c9fb0 0x7f794c06e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:52.512 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.505+0000 7f7953cf0700 1 --2- 172.21.15.57:0/3868690786 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f7930060620 0x7f7930062ad0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:52.512 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.505+0000 7f7953cf0700 1 --2- 172.21.15.57:0/3868690786 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f794c0c1e30 0x7f794c0c5710 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:52.512 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.505+0000 7f7953cf0700 1 -- 172.21.15.57:0/3868690786 >> 172.21.15.57:0/3868690786 conn(0x7f794c0cbed0 msgr2=0x7f794c068d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:03:52.512 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.505+0000 7f7953cf0700 1 -- 172.21.15.57:0/3868690786 shutdown_connections 2023-10-06T03:03:52.512 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.505+0000 7f7953cf0700 1 -- 172.21.15.57:0/3868690786 wait complete. 2023-10-06T03:03:52.513 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 38 2023-10-06T03:03:52.531 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:03:52.696 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.693+0000 7f9df42f0700 1 Processor -- start 2023-10-06T03:03:52.697 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.693+0000 7f9df42f0700 1 -- start start 2023-10-06T03:03:52.699 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.697+0000 7f9df42f0700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f9dec155e10 0x7f9dec0c0c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:52.699 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.697+0000 7f9df42f0700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dec0c7e70 con 0x7f9dec1561e0 2023-10-06T03:03:52.700 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.697+0000 7f9df42f0700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dec0c7260 con 0x7f9dec15a330 2023-10-06T03:03:52.700 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.697+0000 7f9df42f0700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dec0c11b0 con 0x7f9dec155e10 2023-10-06T03:03:52.700 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.697+0000 7f9df188b700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f9dec1561e0 0x7f9dec159c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:59386/0 (socket says 172.21.15.57:59386) 2023-10-06T03:03:52.700 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.697+0000 7f9df188b700 1 -- 172.21.15.57:0/3119497268 learned_addr learned my addr 172.21.15.57:0/3119497268 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:03:52.700 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.697+0000 7f9df208c700 1 --2- 172.21.15.57:0/3119497268 >> v2:172.21.15.105:3300/0 conn(0x7f9dec155e10 0x7f9dec0c0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:52.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.697+0000 7f9df108a700 1 -- 172.21.15.57:0/3119497268 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3942936929 0 0) 0x7f9dec0c7e70 con 0x7f9dec1561e0 2023-10-06T03:03:52.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.697+0000 7f9df108a700 1 -- 172.21.15.57:0/3119497268 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9dd8003570 con 0x7f9dec1561e0 2023-10-06T03:03:52.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.697+0000 7f9df108a700 1 -- 172.21.15.57:0/3119497268 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 106924814 0 0) 0x7f9dec0c7260 con 0x7f9dec15a330 2023-10-06T03:03:52.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.697+0000 7f9df108a700 1 -- 172.21.15.57:0/3119497268 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9dec0c7e70 con 0x7f9dec15a330 2023-10-06T03:03:52.702 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.697+0000 7f9df208c700 1 -- 172.21.15.57:0/3119497268 >> v1:172.21.15.105:6789/0 conn(0x7f9dec15a330 legacy=0x7f9dec0c9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:52.702 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.697+0000 7f9df208c700 1 -- 172.21.15.57:0/3119497268 >> v1:172.21.15.57:6789/0 conn(0x7f9dec1561e0 legacy=0x7f9dec159c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:52.702 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.697+0000 7f9df208c700 1 -- 172.21.15.57:0/3119497268 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dec0c7540 con 0x7f9dec155e10 2023-10-06T03:03:52.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.697+0000 7f9df208c700 1 --2- 172.21.15.57:0/3119497268 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9dec155e10 0x7f9dec0c0c70 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f9de80098d0 tx=0x7f9de8009120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cf28cbe642250777 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:03:52.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.701+0000 7f9df108a700 1 -- 172.21.15.57:0/3119497268 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9de8005c10 con 0x7f9dec155e10 2023-10-06T03:03:52.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.701+0000 7f9df108a700 1 -- 172.21.15.57:0/3119497268 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9de8005d70 con 0x7f9dec155e10 2023-10-06T03:03:52.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.701+0000 7f9df108a700 1 -- 172.21.15.57:0/3119497268 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9de8006280 con 0x7f9dec155e10 2023-10-06T03:03:52.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.701+0000 7f9df42f0700 1 -- 172.21.15.57:0/3119497268 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9dec155e10 msgr2=0x7f9dec0c0c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:52.704 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.701+0000 7f9df42f0700 1 --2- 172.21.15.57:0/3119497268 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9dec155e10 0x7f9dec0c0c70 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f9de80098d0 tx=0x7f9de8009120 comp rx=0 tx=0).stop 2023-10-06T03:03:52.704 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.701+0000 7f9df42f0700 1 -- 172.21.15.57:0/3119497268 shutdown_connections 2023-10-06T03:03:52.704 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.701+0000 7f9df42f0700 1 --2- 172.21.15.57:0/3119497268 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9dec155e10 0x7f9dec0c0c70 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:52.704 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.701+0000 7f9df42f0700 1 -- 172.21.15.57:0/3119497268 >> 172.21.15.57:0/3119497268 conn(0x7f9dec0cbed0 msgr2=0x7f9dec0cc2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:03:52.704 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.701+0000 7f9df42f0700 1 -- 172.21.15.57:0/3119497268 shutdown_connections 2023-10-06T03:03:52.705 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.701+0000 7f9df42f0700 1 -- 172.21.15.57:0/3119497268 wait complete. 2023-10-06T03:03:52.706 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.701+0000 7f9df42f0700 1 Processor -- start 2023-10-06T03:03:52.706 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.701+0000 7f9df42f0700 1 -- start start 2023-10-06T03:03:52.708 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.705+0000 7f9df42f0700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9dec155e10 0x7f9dec0ae100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:52.708 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.705+0000 7f9df42f0700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9dec1561e0 0x7f9dec14ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:52.708 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.705+0000 7f9df42f0700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9dec15a330 0x7f9dec1587c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:52.708 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.705+0000 7f9df42f0700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dec0abc40 con 0x7f9dec15a330 2023-10-06T03:03:52.708 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.705+0000 7f9df42f0700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dec14efc0 con 0x7f9dec1561e0 2023-10-06T03:03:52.708 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.705+0000 7f9df42f0700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dec158d00 con 0x7f9dec155e10 2023-10-06T03:03:52.708 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.705+0000 7f9df288d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9dec15a330 0x7f9dec1587c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:52.708 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.705+0000 7f9df288d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9dec15a330 0x7f9dec1587c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:50082/0 (socket says 172.21.15.57:50082) 2023-10-06T03:03:52.708 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.705+0000 7f9df288d700 1 -- 172.21.15.57:0/4165229406 learned_addr learned my addr 172.21.15.57:0/4165229406 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:03:52.708 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.705+0000 7f9df208c700 1 --2- 172.21.15.57:0/4165229406 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9dec155e10 0x7f9dec0ae100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:52.708 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.705+0000 7f9df188b700 1 --2- 172.21.15.57:0/4165229406 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9dec1561e0 0x7f9dec14ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:52.710 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.705+0000 7f9df288d700 1 -- 172.21.15.57:0/4165229406 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9dec155e10 msgr2=0x7f9dec0ae100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:52.710 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.705+0000 7f9df288d700 1 --2- 172.21.15.57:0/4165229406 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9dec155e10 0x7f9dec0ae100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:52.710 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.705+0000 7f9df288d700 1 -- 172.21.15.57:0/4165229406 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9dec1561e0 msgr2=0x7f9dec14ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:52.710 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.705+0000 7f9df288d700 1 --2- 172.21.15.57:0/4165229406 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9dec1561e0 0x7f9dec14ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:52.710 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.705+0000 7f9df288d700 1 -- 172.21.15.57:0/4165229406 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9de80093c0 con 0x7f9dec15a330 2023-10-06T03:03:52.710 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.705+0000 7f9df288d700 1 --2- 172.21.15.57:0/4165229406 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9dec15a330 0x7f9dec1587c0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f9de400c860 tx=0x7f9de4002700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:03:52.710 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.705+0000 7f9de27fc700 1 -- 172.21.15.57:0/4165229406 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9de4002030 con 0x7f9dec15a330 2023-10-06T03:03:52.710 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.705+0000 7f9de27fc700 1 -- 172.21.15.57:0/4165229406 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9de40021b0 con 0x7f9dec15a330 2023-10-06T03:03:52.710 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.705+0000 7f9df42f0700 1 -- 172.21.15.57:0/4165229406 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dec158fd0 con 0x7f9dec15a330 2023-10-06T03:03:52.710 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.705+0000 7f9de27fc700 1 -- 172.21.15.57:0/4165229406 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9de4012630 con 0x7f9dec15a330 2023-10-06T03:03:52.710 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.705+0000 7f9df42f0700 1 -- 172.21.15.57:0/4165229406 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dec0ab8d0 con 0x7f9dec15a330 2023-10-06T03:03:52.711 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.709+0000 7f9df42f0700 1 -- 172.21.15.57:0/4165229406 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dec0ab730 con 0x7f9dec15a330 2023-10-06T03:03:52.712 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.709+0000 7f9de27fc700 1 -- 172.21.15.57:0/4165229406 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f9de4012a20 con 0x7f9dec15a330 2023-10-06T03:03:52.714 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.709+0000 7f9de27fc700 1 --2- 172.21.15.57:0/4165229406 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f9dd0060550 0x7f9dd0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:52.714 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.713+0000 7f9de27fc700 1 -- 172.21.15.57:0/4165229406 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6202+0+0 (secure 0 0 0) 0x7f9de407c900 con 0x7f9dec15a330 2023-10-06T03:03:52.715 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.713+0000 7f9df208c700 1 --2- 172.21.15.57:0/4165229406 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f9dd0060550 0x7f9dd0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:52.716 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.713+0000 7f9df208c700 1 --2- 172.21.15.57:0/4165229406 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f9dd0060550 0x7f9dd0062a00 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f9de8009390 tx=0x7f9de8016000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:03:52.720 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.717+0000 7f9de27fc700 1 -- 172.21.15.57:0/4165229406 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f9dec0ab730 con 0x7f9dec15a330 2023-10-06T03:03:52.925 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.921+0000 7f9df42f0700 1 -- 172.21.15.57:0/4165229406 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9dec0ab730 con 0x7f9dec15a330 2023-10-06T03:03:52.926 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.921+0000 7f9de27fc700 1 -- 172.21.15.57:0/4165229406 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4598 (secure 0 0 0) 0x7f9dec0ab730 con 0x7f9dec15a330 2023-10-06T03:03:52.926 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:03:52.926 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":38,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5222,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/879829980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":879829980},{"type":"v1","addr":"172.21.15.105:6833","nonce":879829980}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5225,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/3705921279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":3705921279},{"type":"v1","addr":"172.21.15.105:6835","nonce":3705921279}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/251759282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":251759282},{"type":"v1","addr":"172.21.15.57:6835","nonce":251759282}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:02:39.274111+0000","modified":"2023-10-06T03:02:56.856783+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":54,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5643},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5643":{"gid":5643,"name":"c","rank":0,"incarnation":34,"state":"up:active","state_seq":5,"addr":"172.21.15.57:6837/3347844181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6836","nonce":3347844181},{"type":"v1","addr":"172.21.15.57:6837","nonce":3347844181}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T03:03:52.929 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.925+0000 7f9df42f0700 1 -- 172.21.15.57:0/4165229406 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f9dd0060550 msgr2=0x7f9dd0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:52.929 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.925+0000 7f9df42f0700 1 --2- 172.21.15.57:0/4165229406 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f9dd0060550 0x7f9dd0062a00 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f9de8009390 tx=0x7f9de8016000 comp rx=0 tx=0).stop 2023-10-06T03:03:52.929 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.925+0000 7f9df42f0700 1 -- 172.21.15.57:0/4165229406 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9dec15a330 msgr2=0x7f9dec1587c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:52.929 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.925+0000 7f9df42f0700 1 --2- 172.21.15.57:0/4165229406 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9dec15a330 0x7f9dec1587c0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f9de400c860 tx=0x7f9de4002700 comp rx=0 tx=0).stop 2023-10-06T03:03:52.930 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.925+0000 7f9df42f0700 1 -- 172.21.15.57:0/4165229406 shutdown_connections 2023-10-06T03:03:52.930 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.925+0000 7f9df42f0700 1 --2- 172.21.15.57:0/4165229406 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9dec15a330 0x7f9dec1587c0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:52.930 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.925+0000 7f9df42f0700 1 --2- 172.21.15.57:0/4165229406 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9dec1561e0 0x7f9dec14ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:52.930 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.925+0000 7f9df42f0700 1 --2- 172.21.15.57:0/4165229406 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f9dd0060550 0x7f9dd0062a00 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:52.930 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.925+0000 7f9df42f0700 1 --2- 172.21.15.57:0/4165229406 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9dec155e10 0x7f9dec0ae100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:52.930 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.925+0000 7f9df42f0700 1 -- 172.21.15.57:0/4165229406 >> 172.21.15.57:0/4165229406 conn(0x7f9dec0cbed0 msgr2=0x7f9dec0caf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:03:52.930 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.925+0000 7f9df42f0700 1 -- 172.21.15.57:0/4165229406 shutdown_connections 2023-10-06T03:03:52.930 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:52.925+0000 7f9df42f0700 1 -- 172.21.15.57:0/4165229406 wait complete. 2023-10-06T03:03:52.932 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 38 2023-10-06T03:03:52.950 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:03:53.110 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.105+0000 7fa9adfcc700 1 Processor -- start 2023-10-06T03:03:53.111 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.109+0000 7fa9adfcc700 1 -- start start 2023-10-06T03:03:53.113 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.109+0000 7fa9adfcc700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fa9a8140650 0x7fa9a80c8130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:53.113 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.109+0000 7fa9adfcc700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa9a815b2f0 0x7fa9a80c6340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:53.113 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.109+0000 7fa9adfcc700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9a806d210 con 0x7fa9a8140a20 2023-10-06T03:03:53.113 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.109+0000 7fa9adfcc700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9a806e6a0 con 0x7fa9a815b2f0 2023-10-06T03:03:53.113 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.109+0000 7fa9adfcc700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9a806cc50 con 0x7fa9a8140650 2023-10-06T03:03:53.114 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.109+0000 7fa9ad7cb700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa9a815b2f0 0x7fa9a80c6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:53.114 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.109+0000 7fa99ffff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fa9a8140a20 0x7fa9a815abe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:59394/0 (socket says 172.21.15.57:59394) 2023-10-06T03:03:53.114 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.109+0000 7fa99ffff700 1 -- 172.21.15.57:0/1006603050 learned_addr learned my addr 172.21.15.57:0/1006603050 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:03:53.114 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.109+0000 7fa9acfca700 1 --2- 172.21.15.57:0/1006603050 >> v2:172.21.15.105:3300/0 conn(0x7fa9a8140650 0x7fa9a80c8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:53.115 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.109+0000 7fa99f7fe700 1 -- 172.21.15.57:0/1006603050 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 167147628 0 0) 0x7fa9a806d210 con 0x7fa9a8140a20 2023-10-06T03:03:53.115 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.113+0000 7fa99f7fe700 1 -- 172.21.15.57:0/1006603050 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa990003570 con 0x7fa9a8140a20 2023-10-06T03:03:53.115 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.113+0000 7fa9ad7cb700 1 -- 172.21.15.57:0/1006603050 >> v2:172.21.15.105:3300/0 conn(0x7fa9a8140650 msgr2=0x7fa9a80c8130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:03:53.115 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.113+0000 7fa9ad7cb700 1 --2- 172.21.15.57:0/1006603050 >> v2:172.21.15.105:3300/0 conn(0x7fa9a8140650 0x7fa9a80c8130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:53.115 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.113+0000 7fa9ad7cb700 1 -- 172.21.15.57:0/1006603050 >> v1:172.21.15.57:6789/0 conn(0x7fa9a8140a20 legacy=0x7fa9a815abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:53.115 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.113+0000 7fa9ad7cb700 1 -- 172.21.15.57:0/1006603050 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9a806cf30 con 0x7fa9a815b2f0 2023-10-06T03:03:53.116 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.113+0000 7fa9ad7cb700 1 --2- 172.21.15.57:0/1006603050 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa9a815b2f0 0x7fa9a80c6340 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fa9a806c5c0 tx=0x7fa9a00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b49944a4a2a4db server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:03:53.116 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.113+0000 7fa99f7fe700 1 -- 172.21.15.57:0/1006603050 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9a0011630 con 0x7fa9a815b2f0 2023-10-06T03:03:53.116 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.113+0000 7fa99f7fe700 1 -- 172.21.15.57:0/1006603050 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9a00117b0 con 0x7fa9a815b2f0 2023-10-06T03:03:53.116 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.113+0000 7fa99f7fe700 1 -- 172.21.15.57:0/1006603050 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9a0011b70 con 0x7fa9a815b2f0 2023-10-06T03:03:53.117 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.113+0000 7fa9adfcc700 1 -- 172.21.15.57:0/1006603050 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa9a815b2f0 msgr2=0x7fa9a80c6340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:53.117 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.113+0000 7fa9adfcc700 1 --2- 172.21.15.57:0/1006603050 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa9a815b2f0 0x7fa9a80c6340 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fa9a806c5c0 tx=0x7fa9a00091a0 comp rx=0 tx=0).stop 2023-10-06T03:03:53.117 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.113+0000 7fa9adfcc700 1 -- 172.21.15.57:0/1006603050 shutdown_connections 2023-10-06T03:03:53.117 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.113+0000 7fa9adfcc700 1 --2- 172.21.15.57:0/1006603050 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa9a815b2f0 0x7fa9a80c6340 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:53.117 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.113+0000 7fa9adfcc700 1 --2- 172.21.15.57:0/1006603050 >> v2:172.21.15.105:3300/0 conn(0x7fa9a8140650 0x7fa9a80c8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:53.117 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.113+0000 7fa9adfcc700 1 -- 172.21.15.57:0/1006603050 >> 172.21.15.57:0/1006603050 conn(0x7fa9a8067b00 msgr2=0x7fa9a80cbd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:03:53.118 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.113+0000 7fa9adfcc700 1 -- 172.21.15.57:0/1006603050 shutdown_connections 2023-10-06T03:03:53.118 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.113+0000 7fa9adfcc700 1 -- 172.21.15.57:0/1006603050 wait complete. 2023-10-06T03:03:53.119 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.117+0000 7fa9adfcc700 1 Processor -- start 2023-10-06T03:03:53.119 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.117+0000 7fa9adfcc700 1 -- start start 2023-10-06T03:03:53.120 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.117+0000 7fa9adfcc700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa9a8140650 0x7fa9a80c6e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:53.120 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.117+0000 7fa9adfcc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa9a8140a20 0x7fa9a81694f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:53.120 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.117+0000 7fa9adfcc700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa9a815b2f0 0x7fa9a8169a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:53.120 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.117+0000 7fa9adfcc700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a80c23f0 con 0x7fa9a8140a20 2023-10-06T03:03:53.121 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.117+0000 7fa9adfcc700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a80c9a00 con 0x7fa9a8140650 2023-10-06T03:03:53.121 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.117+0000 7fa9adfcc700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a80c5ab0 con 0x7fa9a815b2f0 2023-10-06T03:03:53.124 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.117+0000 7fa99ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa9a8140a20 0x7fa9a81694f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:53.124 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.117+0000 7fa99ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa9a8140a20 0x7fa9a81694f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:50108/0 (socket says 172.21.15.57:50108) 2023-10-06T03:03:53.124 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.117+0000 7fa99ffff700 1 -- 172.21.15.57:0/251911093 learned_addr learned my addr 172.21.15.57:0/251911093 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:03:53.124 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.117+0000 7fa9acfca700 1 --2- 172.21.15.57:0/251911093 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa9a8140650 0x7fa9a80c6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:53.124 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.117+0000 7fa9ad7cb700 1 --2- 172.21.15.57:0/251911093 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa9a815b2f0 0x7fa9a8169a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:53.124 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.117+0000 7fa99ffff700 1 -- 172.21.15.57:0/251911093 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa9a815b2f0 msgr2=0x7fa9a8169a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:53.124 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.117+0000 7fa99ffff700 1 --2- 172.21.15.57:0/251911093 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa9a815b2f0 0x7fa9a8169a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:53.124 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.117+0000 7fa99ffff700 1 -- 172.21.15.57:0/251911093 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa9a8140650 msgr2=0x7fa9a80c6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:53.125 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.117+0000 7fa99ffff700 1 --2- 172.21.15.57:0/251911093 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa9a8140650 0x7fa9a80c6e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:53.125 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.117+0000 7fa99ffff700 1 -- 172.21.15.57:0/251911093 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9a0009420 con 0x7fa9a8140a20 2023-10-06T03:03:53.125 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.117+0000 7fa9ad7cb700 1 --2- 172.21.15.57:0/251911093 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa9a815b2f0 0x7fa9a8169a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:03:53.125 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.117+0000 7fa99ffff700 1 --2- 172.21.15.57:0/251911093 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa9a8140a20 0x7fa9a81694f0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fa99800c7c0 tx=0x7fa998007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:03:53.125 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.121+0000 7fa99cff9700 1 -- 172.21.15.57:0/251911093 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa998005b30 con 0x7fa9a8140a20 2023-10-06T03:03:53.125 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.121+0000 7fa99cff9700 1 -- 172.21.15.57:0/251911093 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa998005cb0 con 0x7fa9a8140a20 2023-10-06T03:03:53.125 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.121+0000 7fa9adfcc700 1 -- 172.21.15.57:0/251911093 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9a80c5d90 con 0x7fa9a8140a20 2023-10-06T03:03:53.125 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.121+0000 7fa99cff9700 1 -- 172.21.15.57:0/251911093 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa998007320 con 0x7fa9a8140a20 2023-10-06T03:03:53.125 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.121+0000 7fa9adfcc700 1 -- 172.21.15.57:0/251911093 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9a80c6350 con 0x7fa9a8140a20 2023-10-06T03:03:53.126 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.121+0000 7fa9adfcc700 1 -- 172.21.15.57:0/251911093 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9a815a180 con 0x7fa9a8140a20 2023-10-06T03:03:53.126 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.121+0000 7fa99cff9700 1 -- 172.21.15.57:0/251911093 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fa99801b3b0 con 0x7fa9a8140a20 2023-10-06T03:03:53.127 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.125+0000 7fa99cff9700 1 --2- 172.21.15.57:0/251911093 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fa994060580 0x7fa994062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:53.128 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.125+0000 7fa99cff9700 1 -- 172.21.15.57:0/251911093 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6202+0+0 (secure 0 0 0) 0x7fa99807bf60 con 0x7fa9a8140a20 2023-10-06T03:03:53.128 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.125+0000 7fa9acfca700 1 --2- 172.21.15.57:0/251911093 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fa994060580 0x7fa994062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:53.129 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.125+0000 7fa9acfca700 1 --2- 172.21.15.57:0/251911093 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fa994060580 0x7fa994062a30 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fa9a400f570 tx=0x7fa9a400b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:03:53.135 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.133+0000 7fa99cff9700 1 -- 172.21.15.57:0/251911093 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fa99804c2c0 con 0x7fa9a8140a20 2023-10-06T03:03:53.306 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.301+0000 7fa9adfcc700 1 -- 172.21.15.57:0/251911093 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa9a80c9b40 con 0x7fa9a8140a20 2023-10-06T03:03:53.308 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.305+0000 7fa99cff9700 1 -- 172.21.15.57:0/251911093 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) v1 ==== 74+0+17091 (secure 0 0 0) 0x7fa998017090 con 0x7fa9a8140a20 2023-10-06T03:03:53.309 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:03:53.309 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":56,"fsid":"eb56dc0f-9213-41cb-9aad-8ade6c802e98","created":"2023-10-06T03:00:30.806197+0000","modified":"2023-10-06T03:03:38.834241+0000","last_up_change":"2023-10-06T03:00:43.607454+0000","last_in_change":"2023-10-06T03:00:33.943513+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T03:00:44.360651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T03:00:50.466601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:02:37.240020+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-10-06T03:02:38.287494+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"58cf6c90-d704-43e0-b2db-dffe526d5e8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":33053},{"type":"v1","addr":"172.21.15.57:6801","nonce":33053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":33053},{"type":"v1","addr":"172.21.15.57:6803","nonce":33053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":33053},{"type":"v1","addr":"172.21.15.57:6807","nonce":33053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":33053},{"type":"v1","addr":"172.21.15.57:6805","nonce":33053}]},"public_addr":"172.21.15.57:6801/33053","cluster_addr":"172.21.15.57:6803/33053","heartbeat_back_addr":"172.21.15.57:6807/33053","heartbeat_front_addr":"172.21.15.57:6805/33053","state":["exists","up"]},{"osd":1,"uuid":"16afbe70-7f9e-4568-9c92-763e6e348119","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6809","nonce":33052},{"type":"v1","addr":"172.21.15.57:6810","nonce":33052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":33052},{"type":"v1","addr":"172.21.15.57:6813","nonce":33052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":33052},{"type":"v1","addr":"172.21.15.57:6822","nonce":33052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6815","nonce":33052},{"type":"v1","addr":"172.21.15.57:6818","nonce":33052}]},"public_addr":"172.21.15.57:6810/33052","cluster_addr":"172.21.15.57:6813/33052","heartbeat_back_addr":"172.21.15.57:6822/33052","heartbeat_front_addr":"172.21.15.57:6818/33052","state":["exists","up"]},{"osd":2,"uuid":"7255c62e-f92f-470f-a5ce-30228920d9f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":33058},{"type":"v1","addr":"172.21.15.57:6825","nonce":33058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":33058},{"type":"v1","addr":"172.21.15.57:6827","nonce":33058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":33058},{"type":"v1","addr":"172.21.15.57:6831","nonce":33058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":33058},{"type":"v1","addr":"172.21.15.57:6829","nonce":33058}]},"public_addr":"172.21.15.57:6825/33058","cluster_addr":"172.21.15.57:6827/33058","heartbeat_back_addr":"172.21.15.57:6831/33058","heartbeat_front_addr":"172.21.15.57:6829/33058","state":["exists","up"]},{"osd":3,"uuid":"152a236d-f799-4888-8544-74865508d5a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":33057},{"type":"v1","addr":"172.21.15.57:6811","nonce":33057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":33057},{"type":"v1","addr":"172.21.15.57:6816","nonce":33057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6821","nonce":33057},{"type":"v1","addr":"172.21.15.57:6823","nonce":33057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6817","nonce":33057},{"type":"v1","addr":"172.21.15.57:6819","nonce":33057}]},"public_addr":"172.21.15.57:6811/33057","cluster_addr":"172.21.15.57:6816/33057","heartbeat_back_addr":"172.21.15.57:6823/33057","heartbeat_front_addr":"172.21.15.57:6819/33057","state":["exists","up"]},{"osd":4,"uuid":"37db2a65-3566-41d0-9d60-e66c49e1e68e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":33368},{"type":"v1","addr":"172.21.15.105:6801","nonce":33368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":33368},{"type":"v1","addr":"172.21.15.105:6803","nonce":33368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":33368},{"type":"v1","addr":"172.21.15.105:6807","nonce":33368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":33368},{"type":"v1","addr":"172.21.15.105:6805","nonce":33368}]},"public_addr":"172.21.15.105:6801/33368","cluster_addr":"172.21.15.105:6803/33368","heartbeat_back_addr":"172.21.15.105:6807/33368","heartbeat_front_addr":"172.21.15.105:6805/33368","state":["exists","up"]},{"osd":5,"uuid":"35e77918-1bb4-42ca-9b20-f3c14eaa0c04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":33379},{"type":"v1","addr":"172.21.15.105:6818","nonce":33379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":33379},{"type":"v1","addr":"172.21.15.105:6823","nonce":33379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":33379},{"type":"v1","addr":"172.21.15.105:6831","nonce":33379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":33379},{"type":"v1","addr":"172.21.15.105:6827","nonce":33379}]},"public_addr":"172.21.15.105:6818/33379","cluster_addr":"172.21.15.105:6823/33379","heartbeat_back_addr":"172.21.15.105:6831/33379","heartbeat_front_addr":"172.21.15.105:6827/33379","state":["exists","up"]},{"osd":6,"uuid":"b4d9d510-7a45-4173-8287-c6c8d6547f2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":33369},{"type":"v1","addr":"172.21.15.105:6819","nonce":33369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":33369},{"type":"v1","addr":"172.21.15.105:6822","nonce":33369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":33369},{"type":"v1","addr":"172.21.15.105:6830","nonce":33369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":33369},{"type":"v1","addr":"172.21.15.105:6826","nonce":33369}]},"public_addr":"172.21.15.105:6819/33369","cluster_addr":"172.21.15.105:6822/33369","heartbeat_back_addr":"172.21.15.105:6830/33369","heartbeat_front_addr":"172.21.15.105:6826/33369","state":["exists","up"]},{"osd":7,"uuid":"74266fb0-cd84-463f-8bf0-092652a71dc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":33370},{"type":"v1","addr":"172.21.15.105:6809","nonce":33370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":33370},{"type":"v1","addr":"172.21.15.105:6811","nonce":33370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":33370},{"type":"v1","addr":"172.21.15.105:6815","nonce":33370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":33370},{"type":"v1","addr":"172.21.15.105:6813","nonce":33370}]},"public_addr":"172.21.15.105:6809/33370","cluster_addr":"172.21.15.105:6811/33370","heartbeat_back_addr":"172.21.15.105:6815/33370","heartbeat_front_addr":"172.21.15.105:6813/33370","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.596864+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.633851+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.636993+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.529681+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.608601+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.659752+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.661717+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.642221+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.1d","mappings":[{"from":0,"to":6}]},{"pgid":"8.27","mappings":[{"from":0,"to":6}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.57:6837/4147766471":"2023-10-07T03:02:52.815979+0000","172.21.15.57:6835/4147766471":"2023-10-07T03:02:52.815979+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:03:53.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.309+0000 7fa9adfcc700 1 -- 172.21.15.57:0/251911093 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fa994060580 msgr2=0x7fa994062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:53.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.309+0000 7fa9adfcc700 1 --2- 172.21.15.57:0/251911093 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fa994060580 0x7fa994062a30 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fa9a400f570 tx=0x7fa9a400b040 comp rx=0 tx=0).stop 2023-10-06T03:03:53.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.309+0000 7fa9adfcc700 1 -- 172.21.15.57:0/251911093 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa9a8140a20 msgr2=0x7fa9a81694f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:53.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.309+0000 7fa9adfcc700 1 --2- 172.21.15.57:0/251911093 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa9a8140a20 0x7fa9a81694f0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fa99800c7c0 tx=0x7fa998007e00 comp rx=0 tx=0).stop 2023-10-06T03:03:53.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.309+0000 7fa9adfcc700 1 -- 172.21.15.57:0/251911093 shutdown_connections 2023-10-06T03:03:53.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.309+0000 7fa9adfcc700 1 --2- 172.21.15.57:0/251911093 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fa994060580 0x7fa994062a30 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:53.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.309+0000 7fa9adfcc700 1 --2- 172.21.15.57:0/251911093 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa9a815b2f0 0x7fa9a8169a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:53.312 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.309+0000 7fa9adfcc700 1 --2- 172.21.15.57:0/251911093 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa9a8140a20 0x7fa9a81694f0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:53.312 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.309+0000 7fa9adfcc700 1 --2- 172.21.15.57:0/251911093 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa9a8140650 0x7fa9a80c6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:53.312 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.309+0000 7fa9adfcc700 1 -- 172.21.15.57:0/251911093 >> 172.21.15.57:0/251911093 conn(0x7fa9a8067b00 msgr2=0x7fa9a813e210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:03:53.312 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.309+0000 7fa9adfcc700 1 -- 172.21.15.57:0/251911093 shutdown_connections 2023-10-06T03:03:53.312 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.309+0000 7fa9adfcc700 1 -- 172.21.15.57:0/251911093 wait complete. 2023-10-06T03:03:53.334 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T03:03:53.495 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.493+0000 7f00fed85700 1 Processor -- start 2023-10-06T03:03:53.495 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.493+0000 7f00fed85700 1 -- start start 2023-10-06T03:03:53.496 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.493+0000 7f00fed85700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00f81590a0 0x7f00f80a9840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:53.497 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.493+0000 7f00fed85700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f00f8159470 0x7f00f80c7c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:53.497 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.493+0000 7f00fed85700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00f80ca920 con 0x7f00f80c7540 2023-10-06T03:03:53.497 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.493+0000 7f00fed85700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00f80ca450 con 0x7f00f8159470 2023-10-06T03:03:53.497 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.493+0000 7f00fed85700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00f80c0e20 con 0x7f00f81590a0 2023-10-06T03:03:53.497 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.493+0000 7f00fcb21700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00f81590a0 0x7f00f80a9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:53.498 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.493+0000 7f00fcb21700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00f81590a0 0x7f00f80a9840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.57:36118/0 (socket says 172.21.15.57:36118) 2023-10-06T03:03:53.498 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.493+0000 7f00fcb21700 1 -- 172.21.15.57:0/1144768801 learned_addr learned my addr 172.21.15.57:0/1144768801 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:03:53.498 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.493+0000 7f00fd322700 1 --2- 172.21.15.57:0/1144768801 >> v2:172.21.15.105:3300/0 conn(0x7f00f8159470 0x7f00f80c7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:53.498 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.493+0000 7f00fcb21700 1 -- 172.21.15.57:0/1144768801 >> v2:172.21.15.105:3300/0 conn(0x7f00f8159470 msgr2=0x7f00f80c7c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:03:53.498 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.493+0000 7f00fcb21700 1 --2- 172.21.15.57:0/1144768801 >> v2:172.21.15.105:3300/0 conn(0x7f00f8159470 0x7f00f80c7c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:53.499 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.493+0000 7f00fcb21700 1 -- 172.21.15.57:0/1144768801 >> v1:172.21.15.105:6789/0 conn(0x7f00f80c7540 legacy=0x7f00f80c9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:53.499 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.493+0000 7f00fcb21700 1 -- 172.21.15.57:0/1144768801 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00f80ca640 con 0x7f00f81590a0 2023-10-06T03:03:53.499 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.497+0000 7f00fcb21700 1 --2- 172.21.15.57:0/1144768801 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00f81590a0 0x7f00f80a9840 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f00ec009990 tx=0x7f00ec009220 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2552a954168b97dd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:03:53.500 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.497+0000 7f00f77fe700 1 -- 172.21.15.57:0/1144768801 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00ec009e80 con 0x7f00f81590a0 2023-10-06T03:03:53.500 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.497+0000 7f00f77fe700 1 -- 172.21.15.57:0/1144768801 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00ec005c10 con 0x7f00f81590a0 2023-10-06T03:03:53.500 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.497+0000 7f00f77fe700 1 -- 172.21.15.57:0/1144768801 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00ec00b650 con 0x7f00f81590a0 2023-10-06T03:03:53.501 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.497+0000 7f00fed85700 1 -- 172.21.15.57:0/1144768801 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00f81590a0 msgr2=0x7f00f80a9840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:53.501 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.497+0000 7f00fed85700 1 --2- 172.21.15.57:0/1144768801 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00f81590a0 0x7f00f80a9840 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f00ec009990 tx=0x7f00ec009220 comp rx=0 tx=0).stop 2023-10-06T03:03:53.502 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.497+0000 7f00fed85700 1 -- 172.21.15.57:0/1144768801 shutdown_connections 2023-10-06T03:03:53.502 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.497+0000 7f00fed85700 1 --2- 172.21.15.57:0/1144768801 >> v2:172.21.15.105:3300/0 conn(0x7f00f8159470 0x7f00f80c7c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:53.502 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.497+0000 7f00fed85700 1 --2- 172.21.15.57:0/1144768801 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00f81590a0 0x7f00f80a9840 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:53.502 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.497+0000 7f00fed85700 1 -- 172.21.15.57:0/1144768801 >> 172.21.15.57:0/1144768801 conn(0x7f00f80cbed0 msgr2=0x7f00f80cc2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:03:53.502 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.497+0000 7f00fed85700 1 -- 172.21.15.57:0/1144768801 shutdown_connections 2023-10-06T03:03:53.502 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.497+0000 7f00fed85700 1 -- 172.21.15.57:0/1144768801 wait complete. 2023-10-06T03:03:53.504 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.501+0000 7f00fed85700 1 Processor -- start 2023-10-06T03:03:53.505 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.501+0000 7f00fed85700 1 -- start start 2023-10-06T03:03:53.507 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.505+0000 7f00fed85700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00f80c7540 0x7f00f81449d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:53.507 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.505+0000 7f00fed85700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f00f81590a0 0x7f00f80ab2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:53.507 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.505+0000 7f00fed85700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00f8159470 0x7f00f80c5460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:53.507 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.505+0000 7f00fed85700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f814fc10 con 0x7f00f8159470 2023-10-06T03:03:53.507 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.505+0000 7f00fed85700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f8144f10 con 0x7f00f81590a0 2023-10-06T03:03:53.507 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.505+0000 7f00fed85700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00f80ac910 con 0x7f00f80c7540 2023-10-06T03:03:53.508 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.505+0000 7f00fd322700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00f8159470 0x7f00f80c5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:53.508 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.505+0000 7f00fd322700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00f8159470 0x7f00f80c5460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:50120/0 (socket says 172.21.15.57:50120) 2023-10-06T03:03:53.508 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.505+0000 7f00fd322700 1 -- 172.21.15.57:0/4070679146 learned_addr learned my addr 172.21.15.57:0/4070679146 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:03:53.508 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.505+0000 7f00fcb21700 1 --2- 172.21.15.57:0/4070679146 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00f80c7540 0x7f00f81449d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:53.508 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.505+0000 7f00f7fff700 1 --2- 172.21.15.57:0/4070679146 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f00f81590a0 0x7f00f80ab2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:53.509 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.505+0000 7f00fd322700 1 -- 172.21.15.57:0/4070679146 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00f80c7540 msgr2=0x7f00f81449d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:53.509 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.505+0000 7f00fd322700 1 --2- 172.21.15.57:0/4070679146 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00f80c7540 0x7f00f81449d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:53.509 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.505+0000 7f00fd322700 1 -- 172.21.15.57:0/4070679146 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f00f81590a0 msgr2=0x7f00f80ab2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:53.509 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.505+0000 7f00fd322700 1 --2- 172.21.15.57:0/4070679146 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f00f81590a0 0x7f00f80ab2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:53.509 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.505+0000 7f00fd322700 1 -- 172.21.15.57:0/4070679146 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00ec009480 con 0x7f00f8159470 2023-10-06T03:03:53.509 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.505+0000 7f00f7fff700 1 --2- 172.21.15.57:0/4070679146 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f00f81590a0 0x7f00f80ab2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:03:53.510 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.505+0000 7f00fd322700 1 --2- 172.21.15.57:0/4070679146 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00f8159470 0x7f00f80c5460 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f00f0009e90 tx=0x7f00f000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:03:53.510 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.505+0000 7f00f4ff9700 1 -- 172.21.15.57:0/4070679146 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f000cc20 con 0x7f00f8159470 2023-10-06T03:03:53.510 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.505+0000 7f00f4ff9700 1 -- 172.21.15.57:0/4070679146 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00f000f040 con 0x7f00f8159470 2023-10-06T03:03:53.510 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.505+0000 7f00f4ff9700 1 -- 172.21.15.57:0/4070679146 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f0014480 con 0x7f00f8159470 2023-10-06T03:03:53.510 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.505+0000 7f00fed85700 1 -- 172.21.15.57:0/4070679146 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00f80abd00 con 0x7f00f8159470 2023-10-06T03:03:53.510 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.505+0000 7f00fed85700 1 -- 172.21.15.57:0/4070679146 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00f80ac2c0 con 0x7f00f8159470 2023-10-06T03:03:53.511 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.509+0000 7f00fed85700 1 -- 172.21.15.57:0/4070679146 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00f806b970 con 0x7f00f8159470 2023-10-06T03:03:53.512 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.509+0000 7f00f4ff9700 1 -- 172.21.15.57:0/4070679146 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f00f0014830 con 0x7f00f8159470 2023-10-06T03:03:53.515 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.513+0000 7f00f4ff9700 1 --2- 172.21.15.57:0/4070679146 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f00dc060580 0x7f00dc062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:53.515 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.513+0000 7f00f4ff9700 1 -- 172.21.15.57:0/4070679146 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6202+0+0 (secure 0 0 0) 0x7f00f007d460 con 0x7f00f8159470 2023-10-06T03:03:53.515 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.513+0000 7f00fcb21700 1 --2- 172.21.15.57:0/4070679146 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f00dc060580 0x7f00dc062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:53.516 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.513+0000 7f00fcb21700 1 --2- 172.21.15.57:0/4070679146 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f00dc060580 0x7f00dc062a30 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f00ec009260 tx=0x7f00ec016000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:03:53.521 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.517+0000 7f00f4ff9700 1 -- 172.21.15.57:0/4070679146 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f00f0051250 con 0x7f00f8159470 2023-10-06T03:03:53.729 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.725+0000 7f00fed85700 1 -- 172.21.15.57:0/4070679146 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f00f804b600 con 0x7f00f8159470 2023-10-06T03:03:53.730 INFO:tasks.ceph.mon.a.smithi057.stderr:2023-10-06T03:03:53.729+0000 7f3ec61a3700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T03:03:53.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.737+0000 7f00f4ff9700 1 -- 172.21.15.57:0/4070679146 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v39) v1 ==== 161+0+0 (secure 0 0 0) 0x7f00f0050de0 con 0x7f00f8159470 2023-10-06T03:03:53.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.741+0000 7f00fed85700 1 -- 172.21.15.57:0/4070679146 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f00dc060580 msgr2=0x7f00dc062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:53.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.741+0000 7f00fed85700 1 --2- 172.21.15.57:0/4070679146 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f00dc060580 0x7f00dc062a30 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f00ec009260 tx=0x7f00ec016000 comp rx=0 tx=0).stop 2023-10-06T03:03:53.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.741+0000 7f00fed85700 1 -- 172.21.15.57:0/4070679146 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00f8159470 msgr2=0x7f00f80c5460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:53.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.741+0000 7f00fed85700 1 --2- 172.21.15.57:0/4070679146 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00f8159470 0x7f00f80c5460 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f00f0009e90 tx=0x7f00f000b040 comp rx=0 tx=0).stop 2023-10-06T03:03:53.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.741+0000 7f00fed85700 1 -- 172.21.15.57:0/4070679146 shutdown_connections 2023-10-06T03:03:53.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.741+0000 7f00fed85700 1 --2- 172.21.15.57:0/4070679146 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00f8159470 0x7f00f80c5460 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:53.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.741+0000 7f00fed85700 1 --2- 172.21.15.57:0/4070679146 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f00f81590a0 0x7f00f80ab2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:53.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.741+0000 7f00fed85700 1 --2- 172.21.15.57:0/4070679146 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f00dc060580 0x7f00dc062a30 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:53.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.741+0000 7f00fed85700 1 --2- 172.21.15.57:0/4070679146 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00f80c7540 0x7f00f81449d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:53.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.741+0000 7f00fed85700 1 -- 172.21.15.57:0/4070679146 >> 172.21.15.57:0/4070679146 conn(0x7f00f80cbed0 msgr2=0x7f00f806cca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:03:53.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.741+0000 7f00fed85700 1 -- 172.21.15.57:0/4070679146 shutdown_connections 2023-10-06T03:03:53.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.741+0000 7f00fed85700 1 -- 172.21.15.57:0/4070679146 wait complete. 2023-10-06T03:03:53.747 INFO:teuthology.orchestra.run.smithi057.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T03:03:53.750 INFO:tasks.ceph.mds.c.smithi057.stderr: -2672> 2023-10-06T03:02:57.833+0000 7f4ba9df1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T03:03:53.763 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-06T03:03:53.801 INFO:tasks.ceph.mds.c.smithi057.stdout:starting mds.c at 2023-10-06T03:03:53.925 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.921+0000 7fbb0ca8e700 1 Processor -- start 2023-10-06T03:03:53.926 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.921+0000 7fbb0ca8e700 1 -- start start 2023-10-06T03:03:53.928 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.925+0000 7fbb0ca8e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbb08159110 0x7fbb080afcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:53.928 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.925+0000 7fbb0ca8e700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fbb080cc830 0x7fbb080cccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:53.928 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.925+0000 7fbb0ca8e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb08159540 con 0x7fbb08158d40 2023-10-06T03:03:53.928 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.925+0000 7fbb0ca8e700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb080b01f0 con 0x7fbb080cc830 2023-10-06T03:03:53.929 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.925+0000 7fbb0ca8e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb080cd1f0 con 0x7fbb08159110 2023-10-06T03:03:53.929 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.925+0000 7fbb077fe700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fbb08158d40 0x7fbb0815d5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:59396/0 (socket says 172.21.15.57:59396) 2023-10-06T03:03:53.929 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.925+0000 7fbb077fe700 1 -- 172.21.15.57:0/3629860711 learned_addr learned my addr 172.21.15.57:0/3629860711 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:03:53.929 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.925+0000 7fbb07fff700 1 --2- 172.21.15.57:0/3629860711 >> v2:172.21.15.105:3300/0 conn(0x7fbb080cc830 0x7fbb080cccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:53.929 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.925+0000 7fbb06ffd700 1 --2- 172.21.15.57:0/3629860711 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbb08159110 0x7fbb080afcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:53.930 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.925+0000 7fbb067fc700 1 -- 172.21.15.57:0/3629860711 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2152888446 0 0) 0x7fbb08159540 con 0x7fbb08158d40 2023-10-06T03:03:53.930 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.925+0000 7fbb07fff700 1 -- 172.21.15.57:0/3629860711 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbb08159110 msgr2=0x7fbb080afcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:03:53.930 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.925+0000 7fbb07fff700 1 --2- 172.21.15.57:0/3629860711 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbb08159110 0x7fbb080afcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:53.930 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.925+0000 7fbb07fff700 1 -- 172.21.15.57:0/3629860711 >> v1:172.21.15.57:6789/0 conn(0x7fbb08158d40 legacy=0x7fbb0815d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:53.930 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.925+0000 7fbb07fff700 1 -- 172.21.15.57:0/3629860711 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb080caa50 con 0x7fbb080cc830 2023-10-06T03:03:53.931 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.929+0000 7fbb07fff700 1 --2- 172.21.15.57:0/3629860711 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbb080cc830 0x7fbb080cccb0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fbb00009e90 tx=0x7fbb00009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=800a74d0dccec4a6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:03:53.931 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.929+0000 7fbb067fc700 1 -- 172.21.15.57:0/3629860711 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb0000e070 con 0x7fbb080cc830 2023-10-06T03:03:53.931 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.929+0000 7fbb067fc700 1 -- 172.21.15.57:0/3629860711 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb0000bbf0 con 0x7fbb080cc830 2023-10-06T03:03:53.931 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.929+0000 7fbb067fc700 1 -- 172.21.15.57:0/3629860711 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb00012430 con 0x7fbb080cc830 2023-10-06T03:03:53.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.929+0000 7fbb0ca8e700 1 -- 172.21.15.57:0/3629860711 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbb080cc830 msgr2=0x7fbb080cccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:53.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.929+0000 7fbb0ca8e700 1 --2- 172.21.15.57:0/3629860711 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbb080cc830 0x7fbb080cccb0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fbb00009e90 tx=0x7fbb00009780 comp rx=0 tx=0).stop 2023-10-06T03:03:53.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.929+0000 7fbb0ca8e700 1 -- 172.21.15.57:0/3629860711 shutdown_connections 2023-10-06T03:03:53.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.929+0000 7fbb0ca8e700 1 --2- 172.21.15.57:0/3629860711 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbb080cc830 0x7fbb080cccb0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:53.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.929+0000 7fbb0ca8e700 1 --2- 172.21.15.57:0/3629860711 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbb08159110 0x7fbb080afcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:53.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.929+0000 7fbb0ca8e700 1 -- 172.21.15.57:0/3629860711 >> 172.21.15.57:0/3629860711 conn(0x7fbb08067940 msgr2=0x7fbb08067d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:03:53.933 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.929+0000 7fbb0ca8e700 1 -- 172.21.15.57:0/3629860711 shutdown_connections 2023-10-06T03:03:53.933 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.929+0000 7fbb0ca8e700 1 -- 172.21.15.57:0/3629860711 wait complete. 2023-10-06T03:03:53.934 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.929+0000 7fbb0ca8e700 1 Processor -- start 2023-10-06T03:03:53.934 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.933+0000 7fbb0ca8e700 1 -- start start 2023-10-06T03:03:53.936 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.933+0000 7fbb0ca8e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbb080cc830 0x7fbb08150dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:53.936 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.933+0000 7fbb0ca8e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbb08158d40 0x7fbb080c7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:53.936 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.933+0000 7fbb0ca8e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbb08159110 0x7fbb080c9090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:53.936 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.933+0000 7fbb0ca8e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb080b5750 con 0x7fbb080cc830 2023-10-06T03:03:53.936 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.933+0000 7fbb0ca8e700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb080c7690 con 0x7fbb08159110 2023-10-06T03:03:53.936 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.933+0000 7fbb0ca8e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb080c9ab0 con 0x7fbb08158d40 2023-10-06T03:03:53.936 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.933+0000 7fbb077fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbb080cc830 0x7fbb08150dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:53.936 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.933+0000 7fbb077fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbb080cc830 0x7fbb08150dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:50158/0 (socket says 172.21.15.57:50158) 2023-10-06T03:03:53.936 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.933+0000 7fbb077fe700 1 -- 172.21.15.57:0/3750770998 learned_addr learned my addr 172.21.15.57:0/3750770998 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:03:53.938 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.933+0000 7fbb07fff700 1 --2- 172.21.15.57:0/3750770998 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbb08159110 0x7fbb080c9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:53.938 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.933+0000 7fbb077fe700 1 -- 172.21.15.57:0/3750770998 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbb08158d40 msgr2=0x7fbb080c7150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:53.938 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.933+0000 7fbb077fe700 1 --2- 172.21.15.57:0/3750770998 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbb08158d40 0x7fbb080c7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:53.938 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.933+0000 7fbb077fe700 1 -- 172.21.15.57:0/3750770998 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbb08159110 msgr2=0x7fbb080c9090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:53.938 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.933+0000 7fbb077fe700 1 --2- 172.21.15.57:0/3750770998 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbb08159110 0x7fbb080c9090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:53.938 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.933+0000 7fbb077fe700 1 -- 172.21.15.57:0/3750770998 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb00009a20 con 0x7fbb080cc830 2023-10-06T03:03:53.938 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.933+0000 7fbb07fff700 1 --2- 172.21.15.57:0/3750770998 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbb08159110 0x7fbb080c9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:03:53.938 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.933+0000 7fbb077fe700 1 --2- 172.21.15.57:0/3750770998 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbb080cc830 0x7fbb08150dd0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fbaf800c810 tx=0x7fbaf8007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:03:53.938 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.933+0000 7fbaef7fe700 1 -- 172.21.15.57:0/3750770998 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaf8005b30 con 0x7fbb080cc830 2023-10-06T03:03:53.939 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.933+0000 7fbaef7fe700 1 -- 172.21.15.57:0/3750770998 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaf8005c90 con 0x7fbb080cc830 2023-10-06T03:03:53.939 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.933+0000 7fbaef7fe700 1 -- 172.21.15.57:0/3750770998 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaf8007300 con 0x7fbb080cc830 2023-10-06T03:03:53.939 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.933+0000 7fbb0ca8e700 1 -- 172.21.15.57:0/3750770998 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb080c9d90 con 0x7fbb080cc830 2023-10-06T03:03:53.939 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.933+0000 7fbb0ca8e700 1 -- 172.21.15.57:0/3750770998 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb080b5be0 con 0x7fbb080cc830 2023-10-06T03:03:53.939 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.937+0000 7fbb0ca8e700 1 -- 172.21.15.57:0/3750770998 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb080645e0 con 0x7fbb080cc830 2023-10-06T03:03:53.940 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.937+0000 7fbaef7fe700 1 -- 172.21.15.57:0/3750770998 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fbaf801b400 con 0x7fbb080cc830 2023-10-06T03:03:53.942 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.937+0000 7fbaef7fe700 1 --2- 172.21.15.57:0/3750770998 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fbaf4060550 0x7fbaf4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:53.942 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.937+0000 7fbaef7fe700 1 -- 172.21.15.57:0/3750770998 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6288+0+0 (secure 0 0 0) 0x7fbaf807c5c0 con 0x7fbb080cc830 2023-10-06T03:03:53.942 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.941+0000 7fbb06ffd700 1 --2- 172.21.15.57:0/3750770998 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fbaf4060550 0x7fbaf4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:53.943 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.941+0000 7fbb06ffd700 1 --2- 172.21.15.57:0/3750770998 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fbaf4060550 0x7fbaf4062a00 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fbb081582d0 tx=0x7fbafc0091a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:03:53.949 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:53.945+0000 7fbaef7fe700 1 -- 172.21.15.57:0/3750770998 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fbaf804c970 con 0x7fbb080cc830 2023-10-06T03:03:54.157 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:54.153+0000 7fbb0ca8e700 1 -- 172.21.15.57:0/3750770998 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fbb080b5580 con 0x7fbb080cc830 2023-10-06T03:03:54.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:54.741+0000 7fbaef7fe700 1 -- 172.21.15.57:0/3750770998 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v40) v1 ==== 104+0+0 (secure 0 0 0) 0x7fbaf804ff90 con 0x7fbb080cc830 2023-10-06T03:03:54.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:54.745+0000 7fbb0ca8e700 1 -- 172.21.15.57:0/3750770998 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fbaf4060550 msgr2=0x7fbaf4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:54.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:54.745+0000 7fbb0ca8e700 1 --2- 172.21.15.57:0/3750770998 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fbaf4060550 0x7fbaf4062a00 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fbb081582d0 tx=0x7fbafc0091a0 comp rx=0 tx=0).stop 2023-10-06T03:03:54.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:54.745+0000 7fbb0ca8e700 1 -- 172.21.15.57:0/3750770998 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbb080cc830 msgr2=0x7fbb08150dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:54.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:54.745+0000 7fbb0ca8e700 1 --2- 172.21.15.57:0/3750770998 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbb080cc830 0x7fbb08150dd0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fbaf800c810 tx=0x7fbaf8007df0 comp rx=0 tx=0).stop 2023-10-06T03:03:54.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:54.745+0000 7fbb0ca8e700 1 -- 172.21.15.57:0/3750770998 shutdown_connections 2023-10-06T03:03:54.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:54.745+0000 7fbb0ca8e700 1 --2- 172.21.15.57:0/3750770998 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbb08159110 0x7fbb080c9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:54.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:54.745+0000 7fbb0ca8e700 1 --2- 172.21.15.57:0/3750770998 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fbaf4060550 0x7fbaf4062a00 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:54.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:54.745+0000 7fbb0ca8e700 1 --2- 172.21.15.57:0/3750770998 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbb08158d40 0x7fbb080c7150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:54.751 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:54.745+0000 7fbb0ca8e700 1 --2- 172.21.15.57:0/3750770998 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbb080cc830 0x7fbb08150dd0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:54.751 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:54.745+0000 7fbb0ca8e700 1 -- 172.21.15.57:0/3750770998 >> 172.21.15.57:0/3750770998 conn(0x7fbb08067940 msgr2=0x7fbb080ce3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:03:54.751 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:54.745+0000 7fbb0ca8e700 1 -- 172.21.15.57:0/3750770998 shutdown_connections 2023-10-06T03:03:54.751 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:54.745+0000 7fbb0ca8e700 1 -- 172.21.15.57:0/3750770998 wait complete. 2023-10-06T03:03:54.775 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-06T03:03:54.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:54.985+0000 7f1cbdf45700 1 Processor -- start 2023-10-06T03:03:54.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:54.985+0000 7f1cbdf45700 1 -- start start 2023-10-06T03:03:54.992 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:54.989+0000 7f1cbdf45700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f1cb815b9f0 0x7f1cb80cc460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:54.992 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:54.989+0000 7f1cbdf45700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1cb80b06e0 0x7f1cb80cc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:54.992 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:54.989+0000 7f1cbdf45700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cb80c94d0 con 0x7f1cb80b0310 2023-10-06T03:03:54.992 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:54.989+0000 7f1cbdf45700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cb80c97a0 con 0x7f1cb815b9f0 2023-10-06T03:03:54.992 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:54.989+0000 7f1cbdf45700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cb80c9a80 con 0x7f1cb80b06e0 2023-10-06T03:03:54.993 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:54.989+0000 7f1cb77fe700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f1cb80b0310 0x7f1cb80c8dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:54292/0 (socket says 172.21.15.57:54292) 2023-10-06T03:03:54.993 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:54.989+0000 7f1cb77fe700 1 -- 172.21.15.57:0/1483383593 learned_addr learned my addr 172.21.15.57:0/1483383593 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:03:54.993 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:54.989+0000 7f1cb6ffd700 1 --2- 172.21.15.57:0/1483383593 >> v2:172.21.15.105:3300/0 conn(0x7f1cb815b9f0 0x7f1cb80cc460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:54.993 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:54.989+0000 7f1cb7fff700 1 --2- 172.21.15.57:0/1483383593 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1cb80b06e0 0x7f1cb80cc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:54.994 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:54.989+0000 7f1cb7fff700 1 -- 172.21.15.57:0/1483383593 >> v2:172.21.15.105:3300/0 conn(0x7f1cb815b9f0 msgr2=0x7f1cb80cc460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:03:54.994 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:54.989+0000 7f1cb7fff700 1 --2- 172.21.15.57:0/1483383593 >> v2:172.21.15.105:3300/0 conn(0x7f1cb815b9f0 0x7f1cb80cc460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:54.994 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:54.989+0000 7f1cb7fff700 1 -- 172.21.15.57:0/1483383593 >> v1:172.21.15.57:6789/0 conn(0x7f1cb80b0310 legacy=0x7f1cb80c8dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:54.994 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:54.989+0000 7f1cb7fff700 1 -- 172.21.15.57:0/1483383593 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cb80c9d60 con 0x7f1cb80b06e0 2023-10-06T03:03:54.995 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:54.989+0000 7f1cb67fc700 1 -- 172.21.15.57:0/1483383593 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4066922466 0 0) 0x7f1cb80c94d0 con 0x7f1cb80b0310 2023-10-06T03:03:54.995 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:54.989+0000 7f1cb7fff700 1 --2- 172.21.15.57:0/1483383593 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1cb80b06e0 0x7f1cb80cc9a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1cb0009e60 tx=0x7f1cb0009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3c15dd3d0e88eb90 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:03:54.996 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:54.993+0000 7f1cb67fc700 1 -- 172.21.15.57:0/1483383593 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb000e070 con 0x7f1cb80b06e0 2023-10-06T03:03:54.996 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:54.993+0000 7f1cb67fc700 1 -- 172.21.15.57:0/1483383593 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cb000bb60 con 0x7f1cb80b06e0 2023-10-06T03:03:54.996 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:54.993+0000 7f1cb67fc700 1 -- 172.21.15.57:0/1483383593 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb0012430 con 0x7f1cb80b06e0 2023-10-06T03:03:54.996 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:54.993+0000 7f1cbdf45700 1 -- 172.21.15.57:0/1483383593 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1cb80b06e0 msgr2=0x7f1cb80cc9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:54.996 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:54.993+0000 7f1cbdf45700 1 --2- 172.21.15.57:0/1483383593 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1cb80b06e0 0x7f1cb80cc9a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1cb0009e60 tx=0x7f1cb0009780 comp rx=0 tx=0).stop 2023-10-06T03:03:54.996 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:54.993+0000 7f1cbdf45700 1 -- 172.21.15.57:0/1483383593 shutdown_connections 2023-10-06T03:03:54.996 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:54.993+0000 7f1cbdf45700 1 --2- 172.21.15.57:0/1483383593 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1cb80b06e0 0x7f1cb80cc9a0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:54.997 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:54.993+0000 7f1cbdf45700 1 --2- 172.21.15.57:0/1483383593 >> v2:172.21.15.105:3300/0 conn(0x7f1cb815b9f0 0x7f1cb80cc460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:54.997 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:54.993+0000 7f1cbdf45700 1 -- 172.21.15.57:0/1483383593 >> 172.21.15.57:0/1483383593 conn(0x7f1cb8087f60 msgr2=0x7f1cb80972c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:03:54.997 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:54.993+0000 7f1cbdf45700 1 -- 172.21.15.57:0/1483383593 shutdown_connections 2023-10-06T03:03:54.997 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:54.993+0000 7f1cbdf45700 1 -- 172.21.15.57:0/1483383593 wait complete. 2023-10-06T03:03:54.998 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:54.993+0000 7f1cbdf45700 1 Processor -- start 2023-10-06T03:03:54.998 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:54.993+0000 7f1cbdf45700 1 -- start start 2023-10-06T03:03:54.999 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:54.997+0000 7f1cbdf45700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1cb80b0310 0x7f1cb8151ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:54.999 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:54.997+0000 7f1cbdf45700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1cb80b06e0 0x7f1cb80af040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:54.999 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:54.997+0000 7f1cbdf45700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1cb815b9f0 0x7f1cb80af580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:54.999 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:54.997+0000 7f1cbdf45700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cb8069070 con 0x7f1cb815b9f0 2023-10-06T03:03:55.000 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:54.997+0000 7f1cbdf45700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cb8069350 con 0x7f1cb80b06e0 2023-10-06T03:03:55.000 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:54.997+0000 7f1cbdf45700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cb8069630 con 0x7f1cb80b0310 2023-10-06T03:03:55.000 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:54.997+0000 7f1cb7fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1cb815b9f0 0x7f1cb80af580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:55.001 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:54.997+0000 7f1cb77fe700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1cb80b0310 0x7f1cb8151ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:55.001 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:54.997+0000 7f1cb7fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1cb815b9f0 0x7f1cb80af580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:52116/0 (socket says 172.21.15.57:52116) 2023-10-06T03:03:55.001 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:54.997+0000 7f1cb7fff700 1 -- 172.21.15.57:0/872750842 learned_addr learned my addr 172.21.15.57:0/872750842 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:03:55.001 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:54.997+0000 7f1cb6ffd700 1 --2- 172.21.15.57:0/872750842 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1cb80b06e0 0x7f1cb80af040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:55.001 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:54.997+0000 7f1cb7fff700 1 -- 172.21.15.57:0/872750842 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1cb80b0310 msgr2=0x7f1cb8151ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:55.001 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:54.997+0000 7f1cb7fff700 1 --2- 172.21.15.57:0/872750842 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1cb80b0310 0x7f1cb8151ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:55.001 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:54.997+0000 7f1cb7fff700 1 -- 172.21.15.57:0/872750842 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1cb80b06e0 msgr2=0x7f1cb80af040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:55.001 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:54.997+0000 7f1cb7fff700 1 --2- 172.21.15.57:0/872750842 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1cb80b06e0 0x7f1cb80af040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:55.001 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:54.997+0000 7f1cb7fff700 1 -- 172.21.15.57:0/872750842 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cb0009a20 con 0x7f1cb815b9f0 2023-10-06T03:03:55.002 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:54.997+0000 7f1cb7fff700 1 --2- 172.21.15.57:0/872750842 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1cb815b9f0 0x7f1cb80af580 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f1cb80c9bc0 tx=0x7f1cb0019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:03:55.002 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:54.997+0000 7f1c9f7fe700 1 -- 172.21.15.57:0/872750842 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb0012ea0 con 0x7f1cb815b9f0 2023-10-06T03:03:55.002 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:54.997+0000 7f1c9f7fe700 1 -- 172.21.15.57:0/872750842 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cb0027470 con 0x7f1cb815b9f0 2023-10-06T03:03:55.003 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:54.997+0000 7f1c9f7fe700 1 -- 172.21.15.57:0/872750842 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb0027830 con 0x7f1cb815b9f0 2023-10-06T03:03:55.003 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:54.997+0000 7f1cbdf45700 1 -- 172.21.15.57:0/872750842 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cb8069910 con 0x7f1cb815b9f0 2023-10-06T03:03:55.003 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:54.997+0000 7f1cbdf45700 1 -- 172.21.15.57:0/872750842 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cb8068380 con 0x7f1cb815b9f0 2023-10-06T03:03:55.004 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:55.001+0000 7f1cbdf45700 1 -- 172.21.15.57:0/872750842 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cb8088360 con 0x7f1cb815b9f0 2023-10-06T03:03:55.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:55.001+0000 7f1c9f7fe700 1 -- 172.21.15.57:0/872750842 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f1cb0024070 con 0x7f1cb815b9f0 2023-10-06T03:03:55.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:55.005+0000 7f1c9f7fe700 1 --2- 172.21.15.57:0/872750842 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f1ca4060550 0x7f1ca4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:55.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:55.005+0000 7f1c9f7fe700 1 -- 172.21.15.57:0/872750842 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6288+0+0 (secure 0 0 0) 0x7f1cb007f060 con 0x7f1cb815b9f0 2023-10-06T03:03:55.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:55.005+0000 7f1cb77fe700 1 --2- 172.21.15.57:0/872750842 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f1ca4060550 0x7f1ca4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:55.008 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:55.005+0000 7f1cb77fe700 1 --2- 172.21.15.57:0/872750842 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f1ca4060550 0x7f1ca4062a00 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f1ca8007fd0 tx=0x7f1ca8007d30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:03:55.016 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:55.013+0000 7f1c9f7fe700 1 -- 172.21.15.57:0/872750842 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f1cb00aebe0 con 0x7f1cb815b9f0 2023-10-06T03:03:55.191 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:55.189+0000 7f1cbdf45700 1 -- 172.21.15.57:0/872750842 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f1cb804b600 con 0x7f1cb815b9f0 2023-10-06T03:03:55.983 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:55.981+0000 7f1c9f7fe700 1 -- 172.21.15.57:0/872750842 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v58) v1 ==== 181+0+0 (secure 0 0 0) 0x7f1cb002c0d0 con 0x7f1cb815b9f0 2023-10-06T03:03:55.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:55.985+0000 7f1cbdf45700 1 -- 172.21.15.57:0/872750842 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f1ca4060550 msgr2=0x7f1ca4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:55.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:55.985+0000 7f1cbdf45700 1 --2- 172.21.15.57:0/872750842 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f1ca4060550 0x7f1ca4062a00 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f1ca8007fd0 tx=0x7f1ca8007d30 comp rx=0 tx=0).stop 2023-10-06T03:03:55.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:55.985+0000 7f1cbdf45700 1 -- 172.21.15.57:0/872750842 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1cb815b9f0 msgr2=0x7f1cb80af580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:55.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:55.985+0000 7f1cbdf45700 1 --2- 172.21.15.57:0/872750842 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1cb815b9f0 0x7f1cb80af580 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f1cb80c9bc0 tx=0x7f1cb0019000 comp rx=0 tx=0).stop 2023-10-06T03:03:55.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:55.985+0000 7f1cbdf45700 1 -- 172.21.15.57:0/872750842 shutdown_connections 2023-10-06T03:03:55.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:55.985+0000 7f1cbdf45700 1 --2- 172.21.15.57:0/872750842 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1cb815b9f0 0x7f1cb80af580 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:55.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:55.985+0000 7f1cbdf45700 1 --2- 172.21.15.57:0/872750842 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1cb80b06e0 0x7f1cb80af040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:55.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:55.985+0000 7f1cbdf45700 1 --2- 172.21.15.57:0/872750842 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f1ca4060550 0x7f1ca4062a00 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:55.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:55.985+0000 7f1cbdf45700 1 --2- 172.21.15.57:0/872750842 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1cb80b0310 0x7f1cb8151ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:55.989 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:55.985+0000 7f1cbdf45700 1 -- 172.21.15.57:0/872750842 >> 172.21.15.57:0/872750842 conn(0x7f1cb8087f60 msgr2=0x7f1cb81550e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:03:55.989 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:55.985+0000 7f1cbdf45700 1 -- 172.21.15.57:0/872750842 shutdown_connections 2023-10-06T03:03:55.989 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:55.985+0000 7f1cbdf45700 1 -- 172.21.15.57:0/872750842 wait complete. 2023-10-06T03:03:55.990 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_metadata' removed 2023-10-06T03:03:56.008 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-06T03:03:56.176 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:56.173+0000 7f1ffb59e700 1 Processor -- start 2023-10-06T03:03:56.176 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:56.173+0000 7f1ffb59e700 1 -- start start 2023-10-06T03:03:56.179 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:56.177+0000 7f1ffb59e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1ffc0692a0 0x7f1ffc069670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:56.179 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:56.177+0000 7f1ffb59e700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f1ffc0cfb20 0x7f1ffc0cdd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:56.179 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:56.177+0000 7f1ffb59e700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ffc0cea80 con 0x7f1ffc0ce290 2023-10-06T03:03:56.179 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:56.177+0000 7f1ffb59e700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ffc0cff50 con 0x7f1ffc0cfb20 2023-10-06T03:03:56.179 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:56.177+0000 7f1ffb59e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ffc0ced60 con 0x7f1ffc0692a0 2023-10-06T03:03:56.180 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:56.177+0000 7f1ff9d9b700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f1ffc0cfb20 0x7f1ffc0cdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:56.180 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:56.177+0000 7f1ff9d9b700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f1ffc0cfb20 0x7f1ffc0cdd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.57:41054/0 (socket says 172.21.15.57:41054) 2023-10-06T03:03:56.180 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:56.177+0000 7f1ff9d9b700 1 -- 172.21.15.57:0/1516711713 learned_addr learned my addr 172.21.15.57:0/1516711713 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:03:56.180 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:56.177+0000 7f1ffa59c700 1 --2- 172.21.15.57:0/1516711713 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1ffc0692a0 0x7f1ffc069670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:56.180 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:56.177+0000 7f1ff9d9b700 1 -- 172.21.15.57:0/1516711713 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1ffc0692a0 msgr2=0x7f1ffc069670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:03:56.180 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:56.177+0000 7f1ff9d9b700 1 --2- 172.21.15.57:0/1516711713 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1ffc0692a0 0x7f1ffc069670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:56.180 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:56.177+0000 7f1ff9d9b700 1 -- 172.21.15.57:0/1516711713 >> v1:172.21.15.105:6789/0 conn(0x7f1ffc0ce290 legacy=0x7f1ffc15cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:56.181 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:56.177+0000 7f1ff9d9b700 1 -- 172.21.15.57:0/1516711713 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ffc0cf040 con 0x7f1ffc0cfb20 2023-10-06T03:03:56.181 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:56.177+0000 7f1ff9d9b700 1 --2- 172.21.15.57:0/1516711713 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1ffc0cfb20 0x7f1ffc0cdd50 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f1ff00099b0 tx=0x7f1ff0009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=12c74dadea5cd336 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:03:56.181 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:56.177+0000 7f1ff959a700 1 -- 172.21.15.57:0/1516711713 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ff0009ea0 con 0x7f1ffc0cfb20 2023-10-06T03:03:56.181 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:56.177+0000 7f1ff959a700 1 -- 172.21.15.57:0/1516711713 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ff000b8f0 con 0x7f1ffc0cfb20 2023-10-06T03:03:56.181 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:56.177+0000 7f1ff959a700 1 -- 172.21.15.57:0/1516711713 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ff000bc90 con 0x7f1ffc0cfb20 2023-10-06T03:03:56.182 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:56.177+0000 7f1ffb59e700 1 -- 172.21.15.57:0/1516711713 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1ffc0cfb20 msgr2=0x7f1ffc0cdd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:56.182 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:56.177+0000 7f1ffb59e700 1 --2- 172.21.15.57:0/1516711713 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1ffc0cfb20 0x7f1ffc0cdd50 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f1ff00099b0 tx=0x7f1ff0009250 comp rx=0 tx=0).stop 2023-10-06T03:03:56.183 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:56.181+0000 7f1ffb59e700 1 -- 172.21.15.57:0/1516711713 shutdown_connections 2023-10-06T03:03:56.183 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:56.181+0000 7f1ffb59e700 1 --2- 172.21.15.57:0/1516711713 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1ffc0cfb20 0x7f1ffc0cdd50 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:56.183 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:56.181+0000 7f1ffb59e700 1 --2- 172.21.15.57:0/1516711713 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1ffc0692a0 0x7f1ffc069670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:56.183 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:56.181+0000 7f1ffb59e700 1 -- 172.21.15.57:0/1516711713 >> 172.21.15.57:0/1516711713 conn(0x7f1ffc0683d0 msgr2=0x7f1ffc0d00a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:03:56.183 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:56.181+0000 7f1ffb59e700 1 -- 172.21.15.57:0/1516711713 shutdown_connections 2023-10-06T03:03:56.183 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:56.181+0000 7f1ffb59e700 1 -- 172.21.15.57:0/1516711713 wait complete. 2023-10-06T03:03:56.185 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:56.181+0000 7f1ffb59e700 1 Processor -- start 2023-10-06T03:03:56.186 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:56.181+0000 7f1ffb59e700 1 -- start start 2023-10-06T03:03:56.188 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:56.185+0000 7f1ffb59e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1ffc0692a0 0x7f1ffc15c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:56.188 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:56.185+0000 7f1ffb59e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1ffc0ce290 0x7f1ffc14b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:56.188 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:56.185+0000 7f1ffb59e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1ffc0cfb20 0x7f1ffc154f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:56.188 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:56.185+0000 7f1ffb59e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ffc15ca80 con 0x7f1ffc0ce290 2023-10-06T03:03:56.188 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:56.185+0000 7f1ffb59e700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ffc14c120 con 0x7f1ffc0cfb20 2023-10-06T03:03:56.188 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:56.185+0000 7f1ffb59e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ffc0b39d0 con 0x7f1ffc0692a0 2023-10-06T03:03:56.189 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:56.185+0000 7f1ff9d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1ffc0ce290 0x7f1ffc14b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:56.189 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:56.185+0000 7f1ff9d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1ffc0ce290 0x7f1ffc14b1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:52120/0 (socket says 172.21.15.57:52120) 2023-10-06T03:03:56.189 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:56.185+0000 7f1ff9d9b700 1 -- 172.21.15.57:0/2816488803 learned_addr learned my addr 172.21.15.57:0/2816488803 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:03:56.189 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:56.185+0000 7f1ffa59c700 1 --2- 172.21.15.57:0/2816488803 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1ffc0692a0 0x7f1ffc15c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:56.190 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:56.185+0000 7f1ffad9d700 1 --2- 172.21.15.57:0/2816488803 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1ffc0cfb20 0x7f1ffc154f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:56.190 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:56.185+0000 7f1ff9d9b700 1 -- 172.21.15.57:0/2816488803 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1ffc0692a0 msgr2=0x7f1ffc15c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:56.190 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:56.185+0000 7f1ff9d9b700 1 --2- 172.21.15.57:0/2816488803 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1ffc0692a0 0x7f1ffc15c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:56.190 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:56.185+0000 7f1ff9d9b700 1 -- 172.21.15.57:0/2816488803 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1ffc0cfb20 msgr2=0x7f1ffc154f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:56.190 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:56.185+0000 7f1ff9d9b700 1 --2- 172.21.15.57:0/2816488803 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1ffc0cfb20 0x7f1ffc154f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:56.190 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:56.185+0000 7f1ff9d9b700 1 -- 172.21.15.57:0/2816488803 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ff00094f0 con 0x7f1ffc0ce290 2023-10-06T03:03:56.190 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:56.185+0000 7f1ffad9d700 1 --2- 172.21.15.57:0/2816488803 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1ffc0cfb20 0x7f1ffc154f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:03:56.190 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:56.185+0000 7f1ff9d9b700 1 --2- 172.21.15.57:0/2816488803 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1ffc0ce290 0x7f1ffc14b1b0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f1ffc064b30 tx=0x7f1ff0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:03:56.191 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:56.185+0000 7f1fea7fc700 1 -- 172.21.15.57:0/2816488803 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ff000bc70 con 0x7f1ffc0ce290 2023-10-06T03:03:56.191 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:56.185+0000 7f1fea7fc700 1 -- 172.21.15.57:0/2816488803 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ff0025440 con 0x7f1ffc0ce290 2023-10-06T03:03:56.191 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:56.185+0000 7f1fea7fc700 1 -- 172.21.15.57:0/2816488803 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ff0025800 con 0x7f1ffc0ce290 2023-10-06T03:03:56.191 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:56.185+0000 7f1ffb59e700 1 -- 172.21.15.57:0/2816488803 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ffc0b3c90 con 0x7f1ffc0ce290 2023-10-06T03:03:56.191 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:56.185+0000 7f1ffb59e700 1 -- 172.21.15.57:0/2816488803 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ffc0b4250 con 0x7f1ffc0ce290 2023-10-06T03:03:56.191 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:56.189+0000 7f1ffb59e700 1 -- 172.21.15.57:0/2816488803 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ffc0645e0 con 0x7f1ffc0ce290 2023-10-06T03:03:56.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:56.189+0000 7f1fea7fc700 1 -- 172.21.15.57:0/2816488803 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f1ff002e440 con 0x7f1ffc0ce290 2023-10-06T03:03:56.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:56.193+0000 7f1fea7fc700 1 --2- 172.21.15.57:0/2816488803 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f1fdc060550 0x7f1fdc062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:56.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:56.193+0000 7f1fea7fc700 1 -- 172.21.15.57:0/2816488803 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5850+0+0 (secure 0 0 0) 0x7f1ff007e5d0 con 0x7f1ffc0ce290 2023-10-06T03:03:56.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:56.193+0000 7f1ffa59c700 1 --2- 172.21.15.57:0/2816488803 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f1fdc060550 0x7f1fdc062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:56.196 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:56.193+0000 7f1ffa59c700 1 --2- 172.21.15.57:0/2816488803 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f1fdc060550 0x7f1fdc062a00 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f1fec009db0 tx=0x7f1fec0091a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:03:56.203 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:56.201+0000 7f1fea7fc700 1 -- 172.21.15.57:0/2816488803 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f1ff004eb10 con 0x7f1ffc0ce290 2023-10-06T03:03:56.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:56.373+0000 7f1ffb59e700 1 -- 172.21.15.57:0/2816488803 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f1ffc0cf320 con 0x7f1ffc0ce290 2023-10-06T03:03:56.990 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:56.985+0000 7f1fea7fc700 1 -- 172.21.15.57:0/2816488803 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v59) v1 ==== 169+0+0 (secure 0 0 0) 0x7f1ff0052130 con 0x7f1ffc0ce290 2023-10-06T03:03:56.996 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:56.993+0000 7f1ffb59e700 1 -- 172.21.15.57:0/2816488803 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f1fdc060550 msgr2=0x7f1fdc062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:56.996 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:56.993+0000 7f1ffb59e700 1 --2- 172.21.15.57:0/2816488803 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f1fdc060550 0x7f1fdc062a00 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f1fec009db0 tx=0x7f1fec0091a0 comp rx=0 tx=0).stop 2023-10-06T03:03:56.996 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:56.993+0000 7f1ffb59e700 1 -- 172.21.15.57:0/2816488803 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1ffc0ce290 msgr2=0x7f1ffc14b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:56.996 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:56.993+0000 7f1ffb59e700 1 --2- 172.21.15.57:0/2816488803 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1ffc0ce290 0x7f1ffc14b1b0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f1ffc064b30 tx=0x7f1ff0017000 comp rx=0 tx=0).stop 2023-10-06T03:03:56.997 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:56.993+0000 7f1ffb59e700 1 -- 172.21.15.57:0/2816488803 shutdown_connections 2023-10-06T03:03:56.997 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:56.993+0000 7f1ffb59e700 1 --2- 172.21.15.57:0/2816488803 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1ffc0cfb20 0x7f1ffc154f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:56.997 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:56.993+0000 7f1ffb59e700 1 --2- 172.21.15.57:0/2816488803 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1ffc0ce290 0x7f1ffc14b1b0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:56.997 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:56.993+0000 7f1ffb59e700 1 --2- 172.21.15.57:0/2816488803 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f1fdc060550 0x7f1fdc062a00 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:56.998 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:56.993+0000 7f1ffb59e700 1 --2- 172.21.15.57:0/2816488803 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1ffc0692a0 0x7f1ffc15c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:56.998 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:56.993+0000 7f1ffb59e700 1 -- 172.21.15.57:0/2816488803 >> 172.21.15.57:0/2816488803 conn(0x7f1ffc0683d0 msgr2=0x7f1ffc0c4ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:03:56.998 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:56.993+0000 7f1ffb59e700 1 -- 172.21.15.57:0/2816488803 shutdown_connections 2023-10-06T03:03:56.998 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:56.993+0000 7f1ffb59e700 1 -- 172.21.15.57:0/2816488803 wait complete. 2023-10-06T03:03:56.999 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_data' removed 2023-10-06T03:03:57.021 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-06T03:03:57.027 DEBUG:teuthology.orchestra.run.smithi105:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-06T03:03:57.102 INFO:teuthology.orchestra.run.smithi057.stdout:[global] 2023-10-06T03:03:57.103 INFO:teuthology.orchestra.run.smithi057.stdout: chdir = "" 2023-10-06T03:03:57.103 INFO:teuthology.orchestra.run.smithi057.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-06T03:03:57.103 INFO:teuthology.orchestra.run.smithi057.stdout: auth supported = cephx 2023-10-06T03:03:57.103 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:03:57.103 INFO:teuthology.orchestra.run.smithi057.stdout: filestore xattr use omap = true 2023-10-06T03:03:57.103 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:03:57.103 INFO:teuthology.orchestra.run.smithi057.stdout: mon clock drift allowed = 1.000 2023-10-06T03:03:57.103 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:03:57.104 INFO:teuthology.orchestra.run.smithi057.stdout: osd crush chooseleaf type = 0 2023-10-06T03:03:57.104 INFO:teuthology.orchestra.run.smithi057.stdout: auth debug = true 2023-10-06T03:03:57.104 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:03:57.104 INFO:teuthology.orchestra.run.smithi057.stdout: ms die on old message = true 2023-10-06T03:03:57.104 INFO:teuthology.orchestra.run.smithi057.stdout: ms die on bug = true 2023-10-06T03:03:57.104 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:03:57.104 INFO:teuthology.orchestra.run.smithi057.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-06T03:03:57.104 INFO:teuthology.orchestra.run.smithi057.stdout: mon pg warn max object skew = 0 2023-10-06T03:03:57.104 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:03:57.104 INFO:teuthology.orchestra.run.smithi057.stdout: # disable pg_autoscaler by default for new pools 2023-10-06T03:03:57.105 INFO:teuthology.orchestra.run.smithi057.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-06T03:03:57.105 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:03:57.105 INFO:teuthology.orchestra.run.smithi057.stdout: osd pool default size = 2 2023-10-06T03:03:57.105 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:03:57.105 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd allow primary affinity = true 2023-10-06T03:03:57.105 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd allow pg remap = true 2023-10-06T03:03:57.105 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on legacy crush tunables = false 2023-10-06T03:03:57.105 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on crush straw calc version zero = false 2023-10-06T03:03:57.105 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on no sortbitwise = false 2023-10-06T03:03:57.105 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on osd down out interval zero = false 2023-10-06T03:03:57.105 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on too few osds = false 2023-10-06T03:03:57.105 INFO:teuthology.orchestra.run.smithi057.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-06T03:03:57.106 INFO:teuthology.orchestra.run.smithi057.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-06T03:03:57.106 INFO:teuthology.orchestra.run.smithi057.stdout: mon_allow_pool_size_one = true 2023-10-06T03:03:57.106 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:03:57.106 INFO:teuthology.orchestra.run.smithi057.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-06T03:03:57.106 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:03:57.106 INFO:teuthology.orchestra.run.smithi057.stdout: osd default data pool replay window = 5 2023-10-06T03:03:57.106 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:03:57.106 INFO:teuthology.orchestra.run.smithi057.stdout: mon allow pool delete = true 2023-10-06T03:03:57.106 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:03:57.106 INFO:teuthology.orchestra.run.smithi057.stdout: mon cluster log file level = debug 2023-10-06T03:03:57.106 INFO:teuthology.orchestra.run.smithi057.stdout: debug asserts on shutdown = true 2023-10-06T03:03:57.106 INFO:teuthology.orchestra.run.smithi057.stdout: mon health detail to clog = false 2023-10-06T03:03:57.107 INFO:teuthology.orchestra.run.smithi057.stdout: mon host = "172.21.15.57,172.21.15.105,[v2:172.21.15.105:3301,v1:172.21.15.105:6790]" 2023-10-06T03:03:57.107 INFO:teuthology.orchestra.run.smithi057.stdout: ms die on skipped message = False 2023-10-06T03:03:57.107 INFO:teuthology.orchestra.run.smithi057.stdout: fsid = eb56dc0f-9213-41cb-9aad-8ade6c802e98 2023-10-06T03:03:57.107 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:03:57.107 INFO:teuthology.orchestra.run.smithi057.stdout:[osd] 2023-10-06T03:03:57.107 INFO:teuthology.orchestra.run.smithi057.stdout: osd journal size = 100 2023-10-06T03:03:57.107 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:03:57.107 INFO:teuthology.orchestra.run.smithi057.stdout: osd scrub load threshold = 5.0 2023-10-06T03:03:57.107 INFO:teuthology.orchestra.run.smithi057.stdout: osd scrub max interval = 600 2023-10-06T03:03:57.107 INFO:teuthology.orchestra.run.smithi057.stdout: osd mclock profile = high_recovery_ops 2023-10-06T03:03:57.107 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:03:57.107 INFO:teuthology.orchestra.run.smithi057.stdout: osd recover clone overlap = true 2023-10-06T03:03:57.108 INFO:teuthology.orchestra.run.smithi057.stdout: osd recovery max chunk = 1048576 2023-10-06T03:03:57.108 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:03:57.108 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug shutdown = true 2023-10-06T03:03:57.108 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug op order = true 2023-10-06T03:03:57.108 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug verify stray on activate = true 2023-10-06T03:03:57.108 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:03:57.108 INFO:teuthology.orchestra.run.smithi057.stdout: osd open classes on start = true 2023-10-06T03:03:57.108 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug pg log writeout = true 2023-10-06T03:03:57.108 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:03:57.108 INFO:teuthology.orchestra.run.smithi057.stdout: osd deep scrub update digest min age = 30 2023-10-06T03:03:57.108 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:03:57.108 INFO:teuthology.orchestra.run.smithi057.stdout: osd map max advance = 10 2023-10-06T03:03:57.109 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:03:57.109 INFO:teuthology.orchestra.run.smithi057.stdout: journal zero on create = true 2023-10-06T03:03:57.109 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:03:57.109 INFO:teuthology.orchestra.run.smithi057.stdout: filestore ondisk finisher threads = 3 2023-10-06T03:03:57.109 INFO:teuthology.orchestra.run.smithi057.stdout: filestore apply finisher threads = 3 2023-10-06T03:03:57.109 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:03:57.109 INFO:teuthology.orchestra.run.smithi057.stdout: bdev debug aio = true 2023-10-06T03:03:57.109 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug misdirected ops = true 2023-10-06T03:03:57.109 INFO:teuthology.orchestra.run.smithi057.stdout: bdev async discard = True 2023-10-06T03:03:57.109 INFO:teuthology.orchestra.run.smithi057.stdout: bdev enable discard = True 2023-10-06T03:03:57.109 INFO:teuthology.orchestra.run.smithi057.stdout: bluestore allocator = bitmap 2023-10-06T03:03:57.109 INFO:teuthology.orchestra.run.smithi057.stdout: bluestore block size = 96636764160 2023-10-06T03:03:57.109 INFO:teuthology.orchestra.run.smithi057.stdout: bluestore fsck on mount = True 2023-10-06T03:03:57.110 INFO:teuthology.orchestra.run.smithi057.stdout: debug bluefs = 1/20 2023-10-06T03:03:57.110 INFO:teuthology.orchestra.run.smithi057.stdout: debug bluestore = 1/20 2023-10-06T03:03:57.110 INFO:teuthology.orchestra.run.smithi057.stdout: debug ms = 1 2023-10-06T03:03:57.110 INFO:teuthology.orchestra.run.smithi057.stdout: debug osd = 20 2023-10-06T03:03:57.110 INFO:teuthology.orchestra.run.smithi057.stdout: debug rocksdb = 4/10 2023-10-06T03:03:57.110 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd backfillfull_ratio = 0.85 2023-10-06T03:03:57.110 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd full ratio = 0.9 2023-10-06T03:03:57.110 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd nearfull ratio = 0.8 2023-10-06T03:03:57.110 INFO:teuthology.orchestra.run.smithi057.stdout: osd failsafe full ratio = 0.95 2023-10-06T03:03:57.110 INFO:teuthology.orchestra.run.smithi057.stdout: osd objectstore = bluestore 2023-10-06T03:03:57.110 INFO:teuthology.orchestra.run.smithi057.stdout: osd op complaint time = 180 2023-10-06T03:03:57.110 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:03:57.111 INFO:teuthology.orchestra.run.smithi057.stdout:[mgr] 2023-10-06T03:03:57.111 INFO:teuthology.orchestra.run.smithi057.stdout: debug ms = 1 2023-10-06T03:03:57.111 INFO:teuthology.orchestra.run.smithi057.stdout: debug mgr = 20 2023-10-06T03:03:57.111 INFO:teuthology.orchestra.run.smithi057.stdout: debug mon = 20 2023-10-06T03:03:57.111 INFO:teuthology.orchestra.run.smithi057.stdout: debug auth = 20 2023-10-06T03:03:57.111 INFO:teuthology.orchestra.run.smithi057.stdout: mon reweight min pgs per osd = 4 2023-10-06T03:03:57.111 INFO:teuthology.orchestra.run.smithi057.stdout: mon reweight min bytes per osd = 10 2023-10-06T03:03:57.111 INFO:teuthology.orchestra.run.smithi057.stdout: mgr/telemetry/nag = false 2023-10-06T03:03:57.111 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:03:57.111 INFO:teuthology.orchestra.run.smithi057.stdout:[mon] 2023-10-06T03:03:57.111 INFO:teuthology.orchestra.run.smithi057.stdout: debug ms = 1 2023-10-06T03:03:57.111 INFO:teuthology.orchestra.run.smithi057.stdout: debug mon = 20 2023-10-06T03:03:57.112 INFO:teuthology.orchestra.run.smithi057.stdout: debug paxos = 20 2023-10-06T03:03:57.112 INFO:teuthology.orchestra.run.smithi057.stdout: debug auth = 20 2023-10-06T03:03:57.112 INFO:teuthology.orchestra.run.smithi057.stdout: mon data avail warn = 5 2023-10-06T03:03:57.112 INFO:teuthology.orchestra.run.smithi057.stdout: mon mgr mkfs grace = 240 2023-10-06T03:03:57.112 INFO:teuthology.orchestra.run.smithi057.stdout: mon reweight min pgs per osd = 4 2023-10-06T03:03:57.112 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd reporter subtree level = osd 2023-10-06T03:03:57.112 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd prime pg temp = true 2023-10-06T03:03:57.112 INFO:teuthology.orchestra.run.smithi057.stdout: mon reweight min bytes per osd = 10 2023-10-06T03:03:57.112 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:03:57.112 INFO:teuthology.orchestra.run.smithi057.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-06T03:03:57.112 INFO:teuthology.orchestra.run.smithi057.stdout: auth mon ticket ttl = 660 # 11m 2023-10-06T03:03:57.112 INFO:teuthology.orchestra.run.smithi057.stdout: auth service ticket ttl = 240 # 4m 2023-10-06T03:03:57.112 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:03:57.113 INFO:teuthology.orchestra.run.smithi057.stdout: # don't complain about insecure global_id in the test suite 2023-10-06T03:03:57.113 INFO:teuthology.orchestra.run.smithi057.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-06T03:03:57.113 INFO:teuthology.orchestra.run.smithi057.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-06T03:03:57.113 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:03:57.113 INFO:teuthology.orchestra.run.smithi057.stdout: # 1m isn't quite enough 2023-10-06T03:03:57.113 INFO:teuthology.orchestra.run.smithi057.stdout: mon_down_mkfs_grace = 2m 2023-10-06T03:03:57.113 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:03:57.113 INFO:teuthology.orchestra.run.smithi057.stdout: mon_warn_on_filestore_osds = false 2023-10-06T03:03:57.113 INFO:teuthology.orchestra.run.smithi057.stdout: mon op complaint time = 120 2023-10-06T03:03:57.113 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:03:57.113 INFO:teuthology.orchestra.run.smithi057.stdout:[client] 2023-10-06T03:03:57.113 INFO:teuthology.orchestra.run.smithi057.stdout: rgw cache enabled = true 2023-10-06T03:03:57.114 INFO:teuthology.orchestra.run.smithi057.stdout: rgw enable ops log = true 2023-10-06T03:03:57.114 INFO:teuthology.orchestra.run.smithi057.stdout: rgw enable usage log = true 2023-10-06T03:03:57.114 INFO:teuthology.orchestra.run.smithi057.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-06T03:03:57.114 INFO:teuthology.orchestra.run.smithi057.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-06T03:03:57.114 INFO:teuthology.orchestra.run.smithi057.stdout: client mount timeout = 600 2023-10-06T03:03:57.114 INFO:teuthology.orchestra.run.smithi057.stdout: debug client = 20 2023-10-06T03:03:57.114 INFO:teuthology.orchestra.run.smithi057.stdout: debug ms = 1 2023-10-06T03:03:57.114 INFO:teuthology.orchestra.run.smithi057.stdout: pid file = "" 2023-10-06T03:03:57.114 INFO:teuthology.orchestra.run.smithi057.stdout: rados mon op timeout = 900 2023-10-06T03:03:57.114 INFO:teuthology.orchestra.run.smithi057.stdout: rados osd op timeout = 900 2023-10-06T03:03:57.114 INFO:teuthology.orchestra.run.smithi057.stdout:[mon.a] 2023-10-06T03:03:57.114 INFO:teuthology.orchestra.run.smithi057.stdout:[mon.b] 2023-10-06T03:03:57.115 INFO:teuthology.orchestra.run.smithi057.stdout:[mon.c] 2023-10-06T03:03:57.115 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.a] 2023-10-06T03:03:57.115 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.c] 2023-10-06T03:03:57.115 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.b] 2023-10-06T03:03:57.115 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.d] 2023-10-06T03:03:57.115 INFO:teuthology.orchestra.run.smithi057.stdout:[mds] 2023-10-06T03:03:57.115 INFO:teuthology.orchestra.run.smithi057.stdout: debug mds = 20 2023-10-06T03:03:57.115 INFO:teuthology.orchestra.run.smithi057.stdout: debug ms = 1 2023-10-06T03:03:57.115 INFO:teuthology.orchestra.run.smithi057.stdout: mds debug frag = True 2023-10-06T03:03:57.115 INFO:teuthology.orchestra.run.smithi057.stdout: mds debug scatterstat = True 2023-10-06T03:03:57.115 INFO:teuthology.orchestra.run.smithi057.stdout: mds op complaint time = 180 2023-10-06T03:03:57.115 INFO:teuthology.orchestra.run.smithi057.stdout: mds verify scatter = True 2023-10-06T03:03:57.116 INFO:teuthology.orchestra.run.smithi057.stdout: osd op complaint time = 180 2023-10-06T03:03:57.116 INFO:teuthology.orchestra.run.smithi057.stdout: rados mon op timeout = 900 2023-10-06T03:03:57.116 INFO:teuthology.orchestra.run.smithi057.stdout: rados osd op timeout = 900 2023-10-06T03:03:57.116 INFO:teuthology.orchestra.run.smithi105.stdout:[global] 2023-10-06T03:03:57.116 INFO:teuthology.orchestra.run.smithi105.stdout: chdir = "" 2023-10-06T03:03:57.116 INFO:teuthology.orchestra.run.smithi105.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-06T03:03:57.116 INFO:teuthology.orchestra.run.smithi105.stdout: auth supported = cephx 2023-10-06T03:03:57.117 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:03:57.117 INFO:teuthology.orchestra.run.smithi105.stdout: filestore xattr use omap = true 2023-10-06T03:03:57.117 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:03:57.117 INFO:teuthology.orchestra.run.smithi105.stdout: mon clock drift allowed = 1.000 2023-10-06T03:03:57.117 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:03:57.117 INFO:teuthology.orchestra.run.smithi105.stdout: osd crush chooseleaf type = 0 2023-10-06T03:03:57.117 INFO:teuthology.orchestra.run.smithi105.stdout: auth debug = true 2023-10-06T03:03:57.117 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:03:57.117 INFO:teuthology.orchestra.run.smithi105.stdout: ms die on old message = true 2023-10-06T03:03:57.117 INFO:teuthology.orchestra.run.smithi105.stdout: ms die on bug = true 2023-10-06T03:03:57.117 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:03:57.117 INFO:teuthology.orchestra.run.smithi105.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-06T03:03:57.117 INFO:teuthology.orchestra.run.smithi105.stdout: mon pg warn max object skew = 0 2023-10-06T03:03:57.118 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:03:57.118 INFO:teuthology.orchestra.run.smithi105.stdout: # disable pg_autoscaler by default for new pools 2023-10-06T03:03:57.118 INFO:teuthology.orchestra.run.smithi105.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-06T03:03:57.118 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:03:57.118 INFO:teuthology.orchestra.run.smithi105.stdout: osd pool default size = 2 2023-10-06T03:03:57.118 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:03:57.118 INFO:teuthology.orchestra.run.smithi105.stdout: mon osd allow primary affinity = true 2023-10-06T03:03:57.118 INFO:teuthology.orchestra.run.smithi105.stdout: mon osd allow pg remap = true 2023-10-06T03:03:57.118 INFO:teuthology.orchestra.run.smithi105.stdout: mon warn on legacy crush tunables = false 2023-10-06T03:03:57.118 INFO:teuthology.orchestra.run.smithi105.stdout: mon warn on crush straw calc version zero = false 2023-10-06T03:03:57.118 INFO:teuthology.orchestra.run.smithi105.stdout: mon warn on no sortbitwise = false 2023-10-06T03:03:57.119 INFO:teuthology.orchestra.run.smithi105.stdout: mon warn on osd down out interval zero = false 2023-10-06T03:03:57.119 INFO:teuthology.orchestra.run.smithi105.stdout: mon warn on too few osds = false 2023-10-06T03:03:57.119 INFO:teuthology.orchestra.run.smithi105.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-06T03:03:57.119 INFO:teuthology.orchestra.run.smithi105.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-06T03:03:57.119 INFO:teuthology.orchestra.run.smithi105.stdout: mon_allow_pool_size_one = true 2023-10-06T03:03:57.119 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:03:57.119 INFO:teuthology.orchestra.run.smithi105.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-06T03:03:57.119 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:03:57.119 INFO:teuthology.orchestra.run.smithi105.stdout: osd default data pool replay window = 5 2023-10-06T03:03:57.119 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:03:57.119 INFO:teuthology.orchestra.run.smithi105.stdout: mon allow pool delete = true 2023-10-06T03:03:57.119 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:03:57.120 INFO:teuthology.orchestra.run.smithi105.stdout: mon cluster log file level = debug 2023-10-06T03:03:57.120 INFO:teuthology.orchestra.run.smithi105.stdout: debug asserts on shutdown = true 2023-10-06T03:03:57.120 INFO:teuthology.orchestra.run.smithi105.stdout: mon health detail to clog = false 2023-10-06T03:03:57.120 INFO:teuthology.orchestra.run.smithi105.stdout: mon host = "172.21.15.57,172.21.15.105,[v2:172.21.15.105:3301,v1:172.21.15.105:6790]" 2023-10-06T03:03:57.120 INFO:teuthology.orchestra.run.smithi105.stdout: ms die on skipped message = False 2023-10-06T03:03:57.120 INFO:teuthology.orchestra.run.smithi105.stdout: fsid = eb56dc0f-9213-41cb-9aad-8ade6c802e98 2023-10-06T03:03:57.120 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:03:57.120 INFO:teuthology.orchestra.run.smithi105.stdout:[osd] 2023-10-06T03:03:57.120 INFO:teuthology.orchestra.run.smithi105.stdout: osd journal size = 100 2023-10-06T03:03:57.120 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:03:57.120 INFO:teuthology.orchestra.run.smithi105.stdout: osd scrub load threshold = 5.0 2023-10-06T03:03:57.121 INFO:teuthology.orchestra.run.smithi105.stdout: osd scrub max interval = 600 2023-10-06T03:03:57.121 INFO:teuthology.orchestra.run.smithi105.stdout: osd mclock profile = high_recovery_ops 2023-10-06T03:03:57.121 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:03:57.121 INFO:teuthology.orchestra.run.smithi105.stdout: osd recover clone overlap = true 2023-10-06T03:03:57.121 INFO:teuthology.orchestra.run.smithi105.stdout: osd recovery max chunk = 1048576 2023-10-06T03:03:57.121 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:03:57.121 INFO:teuthology.orchestra.run.smithi105.stdout: osd debug shutdown = true 2023-10-06T03:03:57.121 INFO:teuthology.orchestra.run.smithi105.stdout: osd debug op order = true 2023-10-06T03:03:57.121 INFO:teuthology.orchestra.run.smithi105.stdout: osd debug verify stray on activate = true 2023-10-06T03:03:57.121 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:03:57.121 INFO:teuthology.orchestra.run.smithi105.stdout: osd open classes on start = true 2023-10-06T03:03:57.122 INFO:teuthology.orchestra.run.smithi105.stdout: osd debug pg log writeout = true 2023-10-06T03:03:57.122 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:03:57.122 INFO:teuthology.orchestra.run.smithi105.stdout: osd deep scrub update digest min age = 30 2023-10-06T03:03:57.122 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:03:57.122 INFO:teuthology.orchestra.run.smithi105.stdout: osd map max advance = 10 2023-10-06T03:03:57.122 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:03:57.122 INFO:teuthology.orchestra.run.smithi105.stdout: journal zero on create = true 2023-10-06T03:03:57.122 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:03:57.122 INFO:teuthology.orchestra.run.smithi105.stdout: filestore ondisk finisher threads = 3 2023-10-06T03:03:57.122 INFO:teuthology.orchestra.run.smithi105.stdout: filestore apply finisher threads = 3 2023-10-06T03:03:57.122 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:03:57.122 INFO:teuthology.orchestra.run.smithi105.stdout: bdev debug aio = true 2023-10-06T03:03:57.123 INFO:teuthology.orchestra.run.smithi105.stdout: osd debug misdirected ops = true 2023-10-06T03:03:57.123 INFO:teuthology.orchestra.run.smithi105.stdout: bdev async discard = True 2023-10-06T03:03:57.123 INFO:teuthology.orchestra.run.smithi105.stdout: bdev enable discard = True 2023-10-06T03:03:57.123 INFO:teuthology.orchestra.run.smithi105.stdout: bluestore allocator = bitmap 2023-10-06T03:03:57.123 INFO:teuthology.orchestra.run.smithi105.stdout: bluestore block size = 96636764160 2023-10-06T03:03:57.123 INFO:teuthology.orchestra.run.smithi105.stdout: bluestore fsck on mount = True 2023-10-06T03:03:57.123 INFO:teuthology.orchestra.run.smithi105.stdout: debug bluefs = 1/20 2023-10-06T03:03:57.123 INFO:teuthology.orchestra.run.smithi105.stdout: debug bluestore = 1/20 2023-10-06T03:03:57.123 INFO:teuthology.orchestra.run.smithi105.stdout: debug ms = 1 2023-10-06T03:03:57.123 INFO:teuthology.orchestra.run.smithi105.stdout: debug osd = 20 2023-10-06T03:03:57.123 INFO:teuthology.orchestra.run.smithi105.stdout: debug rocksdb = 4/10 2023-10-06T03:03:57.124 INFO:teuthology.orchestra.run.smithi105.stdout: mon osd backfillfull_ratio = 0.85 2023-10-06T03:03:57.124 INFO:teuthology.orchestra.run.smithi105.stdout: mon osd full ratio = 0.9 2023-10-06T03:03:57.124 INFO:teuthology.orchestra.run.smithi105.stdout: mon osd nearfull ratio = 0.8 2023-10-06T03:03:57.124 INFO:teuthology.orchestra.run.smithi105.stdout: osd failsafe full ratio = 0.95 2023-10-06T03:03:57.124 INFO:teuthology.orchestra.run.smithi105.stdout: osd objectstore = bluestore 2023-10-06T03:03:57.124 INFO:teuthology.orchestra.run.smithi105.stdout: osd op complaint time = 180 2023-10-06T03:03:57.124 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:03:57.124 INFO:teuthology.orchestra.run.smithi105.stdout:[mgr] 2023-10-06T03:03:57.124 INFO:teuthology.orchestra.run.smithi105.stdout: debug ms = 1 2023-10-06T03:03:57.124 INFO:teuthology.orchestra.run.smithi105.stdout: debug mgr = 20 2023-10-06T03:03:57.124 INFO:teuthology.orchestra.run.smithi105.stdout: debug mon = 20 2023-10-06T03:03:57.124 INFO:teuthology.orchestra.run.smithi105.stdout: debug auth = 20 2023-10-06T03:03:57.124 INFO:teuthology.orchestra.run.smithi105.stdout: mon reweight min pgs per osd = 4 2023-10-06T03:03:57.125 INFO:teuthology.orchestra.run.smithi105.stdout: mon reweight min bytes per osd = 10 2023-10-06T03:03:57.125 INFO:teuthology.orchestra.run.smithi105.stdout: mgr/telemetry/nag = false 2023-10-06T03:03:57.125 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:03:57.125 INFO:teuthology.orchestra.run.smithi105.stdout:[mon] 2023-10-06T03:03:57.125 INFO:teuthology.orchestra.run.smithi105.stdout: debug ms = 1 2023-10-06T03:03:57.125 INFO:teuthology.orchestra.run.smithi105.stdout: debug mon = 20 2023-10-06T03:03:57.125 INFO:teuthology.orchestra.run.smithi105.stdout: debug paxos = 20 2023-10-06T03:03:57.125 INFO:teuthology.orchestra.run.smithi105.stdout: debug auth = 20 2023-10-06T03:03:57.125 INFO:teuthology.orchestra.run.smithi105.stdout: mon data avail warn = 5 2023-10-06T03:03:57.125 INFO:teuthology.orchestra.run.smithi105.stdout: mon mgr mkfs grace = 240 2023-10-06T03:03:57.125 INFO:teuthology.orchestra.run.smithi105.stdout: mon reweight min pgs per osd = 4 2023-10-06T03:03:57.126 INFO:teuthology.orchestra.run.smithi105.stdout: mon osd reporter subtree level = osd 2023-10-06T03:03:57.126 INFO:teuthology.orchestra.run.smithi105.stdout: mon osd prime pg temp = true 2023-10-06T03:03:57.126 INFO:teuthology.orchestra.run.smithi105.stdout: mon reweight min bytes per osd = 10 2023-10-06T03:03:57.126 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:03:57.126 INFO:teuthology.orchestra.run.smithi105.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-06T03:03:57.126 INFO:teuthology.orchestra.run.smithi105.stdout: auth mon ticket ttl = 660 # 11m 2023-10-06T03:03:57.126 INFO:teuthology.orchestra.run.smithi105.stdout: auth service ticket ttl = 240 # 4m 2023-10-06T03:03:57.126 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:03:57.126 INFO:teuthology.orchestra.run.smithi105.stdout: # don't complain about insecure global_id in the test suite 2023-10-06T03:03:57.126 INFO:teuthology.orchestra.run.smithi105.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-06T03:03:57.126 INFO:teuthology.orchestra.run.smithi105.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-06T03:03:57.127 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:03:57.127 INFO:teuthology.orchestra.run.smithi105.stdout: # 1m isn't quite enough 2023-10-06T03:03:57.127 INFO:teuthology.orchestra.run.smithi105.stdout: mon_down_mkfs_grace = 2m 2023-10-06T03:03:57.127 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:03:57.127 INFO:teuthology.orchestra.run.smithi105.stdout: mon_warn_on_filestore_osds = false 2023-10-06T03:03:57.127 INFO:teuthology.orchestra.run.smithi105.stdout: mon op complaint time = 120 2023-10-06T03:03:57.127 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:03:57.127 INFO:teuthology.orchestra.run.smithi105.stdout:[client] 2023-10-06T03:03:57.127 INFO:teuthology.orchestra.run.smithi105.stdout: rgw cache enabled = true 2023-10-06T03:03:57.127 INFO:teuthology.orchestra.run.smithi105.stdout: rgw enable ops log = true 2023-10-06T03:03:57.127 INFO:teuthology.orchestra.run.smithi105.stdout: rgw enable usage log = true 2023-10-06T03:03:57.127 INFO:teuthology.orchestra.run.smithi105.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-06T03:03:57.128 INFO:teuthology.orchestra.run.smithi105.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-06T03:03:57.128 INFO:teuthology.orchestra.run.smithi105.stdout: client mount timeout = 600 2023-10-06T03:03:57.128 INFO:teuthology.orchestra.run.smithi105.stdout: debug client = 20 2023-10-06T03:03:57.128 INFO:teuthology.orchestra.run.smithi105.stdout: debug ms = 1 2023-10-06T03:03:57.128 INFO:teuthology.orchestra.run.smithi105.stdout: pid file = "" 2023-10-06T03:03:57.128 INFO:teuthology.orchestra.run.smithi105.stdout: rados mon op timeout = 900 2023-10-06T03:03:57.128 INFO:teuthology.orchestra.run.smithi105.stdout: rados osd op timeout = 900 2023-10-06T03:03:57.128 INFO:teuthology.orchestra.run.smithi105.stdout:[mon.a] 2023-10-06T03:03:57.128 INFO:teuthology.orchestra.run.smithi105.stdout:[mon.b] 2023-10-06T03:03:57.128 INFO:teuthology.orchestra.run.smithi105.stdout:[mon.c] 2023-10-06T03:03:57.128 INFO:teuthology.orchestra.run.smithi105.stdout:[mds.a] 2023-10-06T03:03:57.128 INFO:teuthology.orchestra.run.smithi105.stdout:[mds.c] 2023-10-06T03:03:57.129 INFO:teuthology.orchestra.run.smithi105.stdout:[mds.b] 2023-10-06T03:03:57.129 INFO:teuthology.orchestra.run.smithi105.stdout:[mds.d] 2023-10-06T03:03:57.129 INFO:teuthology.orchestra.run.smithi105.stdout:[mds] 2023-10-06T03:03:57.129 INFO:teuthology.orchestra.run.smithi105.stdout: debug mds = 20 2023-10-06T03:03:57.129 INFO:teuthology.orchestra.run.smithi105.stdout: debug ms = 1 2023-10-06T03:03:57.129 INFO:teuthology.orchestra.run.smithi105.stdout: mds debug frag = True 2023-10-06T03:03:57.129 INFO:teuthology.orchestra.run.smithi105.stdout: mds debug scatterstat = True 2023-10-06T03:03:57.129 INFO:teuthology.orchestra.run.smithi105.stdout: mds op complaint time = 180 2023-10-06T03:03:57.129 INFO:teuthology.orchestra.run.smithi105.stdout: mds verify scatter = True 2023-10-06T03:03:57.129 INFO:teuthology.orchestra.run.smithi105.stdout: osd op complaint time = 180 2023-10-06T03:03:57.129 INFO:teuthology.orchestra.run.smithi105.stdout: rados mon op timeout = 900 2023-10-06T03:03:57.129 INFO:teuthology.orchestra.run.smithi105.stdout: rados osd op timeout = 900 2023-10-06T03:03:57.131 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-06T03:03:57.308 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.305+0000 7f0c7b59e700 1 Processor -- start 2023-10-06T03:03:57.308 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.305+0000 7f0c7b59e700 1 -- start start 2023-10-06T03:03:57.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.309+0000 7f0c7b59e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0c7c156b60 0x7f0c7c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:57.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.309+0000 7f0c7b59e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c7c0b3250 con 0x7f0c7c15a380 2023-10-06T03:03:57.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.309+0000 7f0c7b59e700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c7c06d270 con 0x7f0c7c06afc0 2023-10-06T03:03:57.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.309+0000 7f0c7b59e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c7c06d550 con 0x7f0c7c156b60 2023-10-06T03:03:57.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.309+0000 7f0c79d9b700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f0c7c15a380 0x7f0c7c06a8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:54298/0 (socket says 172.21.15.57:54298) 2023-10-06T03:03:57.312 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.309+0000 7f0c79d9b700 1 -- 172.21.15.57:0/1213724656 learned_addr learned my addr 172.21.15.57:0/1213724656 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:03:57.312 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.309+0000 7f0c7a59c700 1 --2- 172.21.15.57:0/1213724656 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0c7c156b60 0x7f0c7c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:57.312 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.309+0000 7f0c7959a700 1 -- 172.21.15.57:0/1213724656 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 417887262 0 0) 0x7f0c7c0b3250 con 0x7f0c7c15a380 2023-10-06T03:03:57.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.309+0000 7f0c7959a700 1 -- 172.21.15.57:0/1213724656 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c64003570 con 0x7f0c7c15a380 2023-10-06T03:03:57.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.309+0000 7f0c7a59c700 1 -- 172.21.15.57:0/1213724656 >> v1:172.21.15.105:6789/0 conn(0x7f0c7c06afc0 legacy=0x7f0c7c0b36e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:57.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.309+0000 7f0c7a59c700 1 -- 172.21.15.57:0/1213724656 >> v1:172.21.15.57:6789/0 conn(0x7f0c7c15a380 legacy=0x7f0c7c06a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:57.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.309+0000 7f0c7959a700 1 -- 172.21.15.57:0/1213724656 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3726227927 0 0) 0x7f0c64003570 con 0x7f0c7c15a380 2023-10-06T03:03:57.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.309+0000 7f0c7a59c700 1 -- 172.21.15.57:0/1213724656 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c7c06d830 con 0x7f0c7c156b60 2023-10-06T03:03:57.314 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.309+0000 7f0c7a59c700 1 --2- 172.21.15.57:0/1213724656 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0c7c156b60 0x7f0c7c06c920 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c009910 tx=0x7f0c6c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b52d7ceb261523f6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:03:57.314 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.309+0000 7f0c7959a700 1 -- 172.21.15.57:0/1213724656 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c70001470 con 0x7f0c7c156b60 2023-10-06T03:03:57.314 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.309+0000 7f0c7959a700 1 -- 172.21.15.57:0/1213724656 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c6c011420 con 0x7f0c7c156b60 2023-10-06T03:03:57.314 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.309+0000 7f0c7959a700 1 -- 172.21.15.57:0/1213724656 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c6c0117a0 con 0x7f0c7c156b60 2023-10-06T03:03:57.315 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.309+0000 7f0c7b59e700 1 -- 172.21.15.57:0/1213724656 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0c7c156b60 msgr2=0x7f0c7c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:57.316 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.309+0000 7f0c7b59e700 1 --2- 172.21.15.57:0/1213724656 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0c7c156b60 0x7f0c7c06c920 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c009910 tx=0x7f0c6c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:03:57.316 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.313+0000 7f0c7b59e700 1 -- 172.21.15.57:0/1213724656 shutdown_connections 2023-10-06T03:03:57.316 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.313+0000 7f0c7b59e700 1 --2- 172.21.15.57:0/1213724656 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0c7c156b60 0x7f0c7c06c920 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:57.316 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.313+0000 7f0c7b59e700 1 -- 172.21.15.57:0/1213724656 >> 172.21.15.57:0/1213724656 conn(0x7f0c7c067050 msgr2=0x7f0c7c0b1ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:03:57.316 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.313+0000 7f0c7b59e700 1 -- 172.21.15.57:0/1213724656 shutdown_connections 2023-10-06T03:03:57.316 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.313+0000 7f0c7b59e700 1 -- 172.21.15.57:0/1213724656 wait complete. 2023-10-06T03:03:57.318 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.313+0000 7f0c7b59e700 1 Processor -- start 2023-10-06T03:03:57.318 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.317+0000 7f0c7b59e700 1 -- start start 2023-10-06T03:03:57.321 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.317+0000 7f0c7b59e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0c7c06afc0 0x7f0c7c1591e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:57.321 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.317+0000 7f0c7b59e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0c7c156b60 0x7f0c7c147b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:57.321 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.317+0000 7f0c7b59e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0c7c15a380 0x7f0c7c14c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:57.321 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.317+0000 7f0c7b59e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c7c159720 con 0x7f0c7c156b60 2023-10-06T03:03:57.321 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.317+0000 7f0c7b59e700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c7c16cdf0 con 0x7f0c7c15a380 2023-10-06T03:03:57.321 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.317+0000 7f0c7b59e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c7c149480 con 0x7f0c7c06afc0 2023-10-06T03:03:57.322 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.317+0000 7f0c79d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0c7c156b60 0x7f0c7c147b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:57.322 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.317+0000 7f0c79d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0c7c156b60 0x7f0c7c147b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:52128/0 (socket says 172.21.15.57:52128) 2023-10-06T03:03:57.323 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.317+0000 7f0c79d9b700 1 -- 172.21.15.57:0/64813929 learned_addr learned my addr 172.21.15.57:0/64813929 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:03:57.323 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.317+0000 7f0c7a59c700 1 --2- 172.21.15.57:0/64813929 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0c7c06afc0 0x7f0c7c1591e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:57.323 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.317+0000 7f0c7ad9d700 1 --2- 172.21.15.57:0/64813929 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0c7c15a380 0x7f0c7c14c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:57.323 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.317+0000 7f0c79d9b700 1 -- 172.21.15.57:0/64813929 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0c7c06afc0 msgr2=0x7f0c7c1591e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:57.323 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.317+0000 7f0c79d9b700 1 --2- 172.21.15.57:0/64813929 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0c7c06afc0 0x7f0c7c1591e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:57.323 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.317+0000 7f0c79d9b700 1 -- 172.21.15.57:0/64813929 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0c7c15a380 msgr2=0x7f0c7c14c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:57.323 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.317+0000 7f0c79d9b700 1 --2- 172.21.15.57:0/64813929 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0c7c15a380 0x7f0c7c14c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:57.323 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.317+0000 7f0c79d9b700 1 -- 172.21.15.57:0/64813929 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c6c009420 con 0x7f0c7c156b60 2023-10-06T03:03:57.323 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.317+0000 7f0c7ad9d700 1 --2- 172.21.15.57:0/64813929 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0c7c15a380 0x7f0c7c14c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:03:57.323 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.317+0000 7f0c79d9b700 1 --2- 172.21.15.57:0/64813929 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0c7c156b60 0x7f0c7c147b10 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f0c7000c7f0 tx=0x7f0c70001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:03:57.324 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.321+0000 7f0c6a7fc700 1 -- 172.21.15.57:0/64813929 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c70007360 con 0x7f0c7c156b60 2023-10-06T03:03:57.324 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.321+0000 7f0c6a7fc700 1 -- 172.21.15.57:0/64813929 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c700074e0 con 0x7f0c7c156b60 2023-10-06T03:03:57.324 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.321+0000 7f0c6a7fc700 1 -- 172.21.15.57:0/64813929 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c70004830 con 0x7f0c7c156b60 2023-10-06T03:03:57.324 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.321+0000 7f0c7b59e700 1 -- 172.21.15.57:0/64813929 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c7c149760 con 0x7f0c7c156b60 2023-10-06T03:03:57.325 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.321+0000 7f0c7b59e700 1 -- 172.21.15.57:0/64813929 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c7c149d20 con 0x7f0c7c156b60 2023-10-06T03:03:57.325 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.321+0000 7f0c7b59e700 1 -- 172.21.15.57:0/64813929 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c7c16cfa0 con 0x7f0c7c156b60 2023-10-06T03:03:57.326 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.325+0000 7f0c6a7fc700 1 -- 172.21.15.57:0/64813929 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f0c70004ba0 con 0x7f0c7c156b60 2023-10-06T03:03:57.328 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.325+0000 7f0c6a7fc700 1 --2- 172.21.15.57:0/64813929 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f0c5c060580 0x7f0c5c062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:57.328 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.325+0000 7f0c6a7fc700 1 -- 172.21.15.57:0/64813929 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5378+0+0 (secure 0 0 0) 0x7f0c7007b940 con 0x7f0c7c156b60 2023-10-06T03:03:57.328 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.325+0000 7f0c7a59c700 1 --2- 172.21.15.57:0/64813929 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f0c5c060580 0x7f0c5c062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:57.330 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.325+0000 7f0c7a59c700 1 --2- 172.21.15.57:0/64813929 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f0c5c060580 0x7f0c5c062a30 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c0091e0 tx=0x7f0c6c016000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:03:57.335 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.333+0000 7f0c6a7fc700 1 -- 172.21.15.57:0/64813929 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f0c7c16cfa0 con 0x7f0c7c156b60 2023-10-06T03:03:57.514 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.509+0000 7f0c7b59e700 1 -- 172.21.15.57:0/64813929 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f0c7c16cf60 con 0x7f0c7c156b60 2023-10-06T03:03:57.524 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.521+0000 7f0c6a7fc700 1 -- 172.21.15.57:0/64813929 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7f0c7004c050 con 0x7f0c7c156b60 2023-10-06T03:03:57.528 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.525+0000 7f0c7b59e700 1 -- 172.21.15.57:0/64813929 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f0c5c060580 msgr2=0x7f0c5c062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:57.528 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.525+0000 7f0c7b59e700 1 --2- 172.21.15.57:0/64813929 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f0c5c060580 0x7f0c5c062a30 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c0091e0 tx=0x7f0c6c016000 comp rx=0 tx=0).stop 2023-10-06T03:03:57.528 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.525+0000 7f0c7b59e700 1 -- 172.21.15.57:0/64813929 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0c7c156b60 msgr2=0x7f0c7c147b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:57.528 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.525+0000 7f0c7b59e700 1 --2- 172.21.15.57:0/64813929 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0c7c156b60 0x7f0c7c147b10 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f0c7000c7f0 tx=0x7f0c70001a00 comp rx=0 tx=0).stop 2023-10-06T03:03:57.528 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.525+0000 7f0c7b59e700 1 -- 172.21.15.57:0/64813929 shutdown_connections 2023-10-06T03:03:57.529 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.525+0000 7f0c7b59e700 1 --2- 172.21.15.57:0/64813929 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0c7c15a380 0x7f0c7c14c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:57.529 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.525+0000 7f0c7b59e700 1 --2- 172.21.15.57:0/64813929 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0c7c156b60 0x7f0c7c147b10 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:57.529 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.525+0000 7f0c7b59e700 1 --2- 172.21.15.57:0/64813929 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f0c5c060580 0x7f0c5c062a30 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:57.529 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.525+0000 7f0c7b59e700 1 --2- 172.21.15.57:0/64813929 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0c7c06afc0 0x7f0c7c1591e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:57.529 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.525+0000 7f0c7b59e700 1 -- 172.21.15.57:0/64813929 >> 172.21.15.57:0/64813929 conn(0x7f0c7c067050 msgr2=0x7f0c7c15bf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:03:57.529 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.525+0000 7f0c7b59e700 1 -- 172.21.15.57:0/64813929 shutdown_connections 2023-10-06T03:03:57.529 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.525+0000 7f0c7b59e700 1 -- 172.21.15.57:0/64813929 wait complete. 2023-10-06T03:03:57.549 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_openfiletable.OpenFileTable.test_perf_counters' 2023-10-06T03:03:57.711 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.709+0000 7f0d5e4a5700 1 Processor -- start 2023-10-06T03:03:57.711 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.709+0000 7f0d5e4a5700 1 -- start start 2023-10-06T03:03:57.713 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.709+0000 7f0d5e4a5700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0d580b10c0 0x7f0d5815b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:57.714 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.709+0000 7f0d5e4a5700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0d580b1490 0x7f0d58154680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:57.714 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.709+0000 7f0d5e4a5700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f0d58154bc0 0x7f0d581575d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:57.714 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.709+0000 7f0d5e4a5700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d5806bb10 con 0x7f0d580b1490 2023-10-06T03:03:57.714 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.709+0000 7f0d5e4a5700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d580b18e0 con 0x7f0d58154bc0 2023-10-06T03:03:57.714 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.709+0000 7f0d5e4a5700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d58155000 con 0x7f0d580b10c0 2023-10-06T03:03:57.715 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.709+0000 7f0d4ffff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0d580b1490 0x7f0d58154680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:57.715 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.709+0000 7f0d57fff700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0d580b10c0 0x7f0d5815b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:57.715 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.713+0000 7f0d5ca42700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f0d58154bc0 0x7f0d581575d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:57.715 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.713+0000 7f0d57fff700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0d580b10c0 0x7f0d5815b750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.57:44566/0 (socket says 172.21.15.57:44566) 2023-10-06T03:03:57.715 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.713+0000 7f0d57fff700 1 -- 172.21.15.57:0/4237145617 learned_addr learned my addr 172.21.15.57:0/4237145617 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:03:57.716 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.713+0000 7f0d4ffff700 1 -- 172.21.15.57:0/4237145617 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0d580b10c0 msgr2=0x7f0d5815b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:03:57.716 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.713+0000 7f0d4ffff700 1 --2- 172.21.15.57:0/4237145617 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0d580b10c0 0x7f0d5815b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:57.716 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.713+0000 7f0d4ffff700 1 -- 172.21.15.57:0/4237145617 >> v2:172.21.15.105:3300/0 conn(0x7f0d58154bc0 msgr2=0x7f0d581575d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:03:57.716 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.713+0000 7f0d4ffff700 1 --2- 172.21.15.57:0/4237145617 >> v2:172.21.15.105:3300/0 conn(0x7f0d58154bc0 0x7f0d581575d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:57.716 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.713+0000 7f0d4ffff700 1 -- 172.21.15.57:0/4237145617 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d58158530 con 0x7f0d580b1490 2023-10-06T03:03:57.716 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.713+0000 7f0d57fff700 1 --2- 172.21.15.57:0/4237145617 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0d580b10c0 0x7f0d5815b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:03:57.717 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.713+0000 7f0d4ffff700 1 --2- 172.21.15.57:0/4237145617 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0d580b1490 0x7f0d58154680 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f0d5806bf40 tx=0x7f0d400091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2701276eddaff9f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:03:57.717 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.713+0000 7f0d577fe700 1 -- 172.21.15.57:0/4237145617 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d40011630 con 0x7f0d580b1490 2023-10-06T03:03:57.717 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.713+0000 7f0d577fe700 1 -- 172.21.15.57:0/4237145617 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d40011790 con 0x7f0d580b1490 2023-10-06T03:03:57.717 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.713+0000 7f0d577fe700 1 -- 172.21.15.57:0/4237145617 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d40011b30 con 0x7f0d580b1490 2023-10-06T03:03:57.718 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.713+0000 7f0d5e4a5700 1 -- 172.21.15.57:0/4237145617 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0d580b1490 msgr2=0x7f0d58154680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:57.718 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.713+0000 7f0d5e4a5700 1 --2- 172.21.15.57:0/4237145617 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0d580b1490 0x7f0d58154680 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f0d5806bf40 tx=0x7f0d400091a0 comp rx=0 tx=0).stop 2023-10-06T03:03:57.718 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.713+0000 7f0d5e4a5700 1 -- 172.21.15.57:0/4237145617 shutdown_connections 2023-10-06T03:03:57.718 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.713+0000 7f0d5e4a5700 1 --2- 172.21.15.57:0/4237145617 >> v2:172.21.15.105:3300/0 conn(0x7f0d58154bc0 0x7f0d581575d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:57.718 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.713+0000 7f0d5e4a5700 1 --2- 172.21.15.57:0/4237145617 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0d580b1490 0x7f0d58154680 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:57.718 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.713+0000 7f0d5e4a5700 1 --2- 172.21.15.57:0/4237145617 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0d580b10c0 0x7f0d5815b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:57.718 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.713+0000 7f0d5e4a5700 1 -- 172.21.15.57:0/4237145617 >> 172.21.15.57:0/4237145617 conn(0x7f0d580cbdd0 msgr2=0x7f0d580cc1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:03:57.719 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.713+0000 7f0d5e4a5700 1 -- 172.21.15.57:0/4237145617 shutdown_connections 2023-10-06T03:03:57.719 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.713+0000 7f0d5e4a5700 1 -- 172.21.15.57:0/4237145617 wait complete. 2023-10-06T03:03:57.725 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.717+0000 7f0d5e4a5700 1 Processor -- start 2023-10-06T03:03:57.725 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.717+0000 7f0d5e4a5700 1 -- start start 2023-10-06T03:03:57.726 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.717+0000 7f0d5e4a5700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0d580b10c0 0x7f0d580aae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:57.726 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.717+0000 7f0d5e4a5700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0d580b1490 0x7f0d58150df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:57.726 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.717+0000 7f0d5e4a5700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0d58154bc0 0x7f0d580a9220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:57.726 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.717+0000 7f0d5e4a5700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d580ab350 con 0x7f0d580b1490 2023-10-06T03:03:57.726 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.717+0000 7f0d5e4a5700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d580a9d70 con 0x7f0d580b10c0 2023-10-06T03:03:57.727 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.717+0000 7f0d5e4a5700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d580aa050 con 0x7f0d58154bc0 2023-10-06T03:03:57.727 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.717+0000 7f0d4ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0d580b1490 0x7f0d58150df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:57.727 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.717+0000 7f0d4ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0d580b1490 0x7f0d58150df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:52156/0 (socket says 172.21.15.57:52156) 2023-10-06T03:03:57.727 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.717+0000 7f0d4ffff700 1 -- 172.21.15.57:0/3760463534 learned_addr learned my addr 172.21.15.57:0/3760463534 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:03:57.727 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.717+0000 7f0d57fff700 1 --2- 172.21.15.57:0/3760463534 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0d580b10c0 0x7f0d580aae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:57.728 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.717+0000 7f0d5ca42700 1 --2- 172.21.15.57:0/3760463534 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0d58154bc0 0x7f0d580a9220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:57.728 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.721+0000 7f0d4ffff700 1 -- 172.21.15.57:0/3760463534 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0d58154bc0 msgr2=0x7f0d580a9220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:57.728 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.721+0000 7f0d4ffff700 1 --2- 172.21.15.57:0/3760463534 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0d58154bc0 0x7f0d580a9220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:57.728 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.721+0000 7f0d4ffff700 1 -- 172.21.15.57:0/3760463534 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0d580b10c0 msgr2=0x7f0d580aae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:57.728 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.721+0000 7f0d4ffff700 1 --2- 172.21.15.57:0/3760463534 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0d580b10c0 0x7f0d580aae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:57.729 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.721+0000 7f0d4ffff700 1 -- 172.21.15.57:0/3760463534 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d480094f0 con 0x7f0d580b1490 2023-10-06T03:03:57.729 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.721+0000 7f0d57fff700 1 --2- 172.21.15.57:0/3760463534 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0d580b10c0 0x7f0d580aae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:03:57.729 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.721+0000 7f0d5ca42700 1 --2- 172.21.15.57:0/3760463534 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0d58154bc0 0x7f0d580a9220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:03:57.729 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.721+0000 7f0d4ffff700 1 --2- 172.21.15.57:0/3760463534 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0d580b1490 0x7f0d58150df0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f0d40009ed0 tx=0x7f0d40017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:03:57.729 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.721+0000 7f0d54ff9700 1 -- 172.21.15.57:0/3760463534 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d40011900 con 0x7f0d580b1490 2023-10-06T03:03:57.730 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.721+0000 7f0d54ff9700 1 -- 172.21.15.57:0/3760463534 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d40011a60 con 0x7f0d580b1490 2023-10-06T03:03:57.730 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.721+0000 7f0d54ff9700 1 -- 172.21.15.57:0/3760463534 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d40026640 con 0x7f0d580b1490 2023-10-06T03:03:57.730 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.721+0000 7f0d5e4a5700 1 -- 172.21.15.57:0/3760463534 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d40009420 con 0x7f0d580b1490 2023-10-06T03:03:57.730 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.721+0000 7f0d5e4a5700 1 -- 172.21.15.57:0/3760463534 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d580aa610 con 0x7f0d580b1490 2023-10-06T03:03:57.732 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.721+0000 7f0d5e4a5700 1 -- 172.21.15.57:0/3760463534 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d580712e0 con 0x7f0d580b1490 2023-10-06T03:03:57.732 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.725+0000 7f0d54ff9700 1 -- 172.21.15.57:0/3760463534 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f0d40023030 con 0x7f0d580b1490 2023-10-06T03:03:57.732 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.725+0000 7f0d54ff9700 1 --2- 172.21.15.57:0/3760463534 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f0d38060550 0x7f0d38062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:57.732 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.725+0000 7f0d54ff9700 1 -- 172.21.15.57:0/3760463534 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5378+0+0 (secure 0 0 0) 0x7f0d4007df20 con 0x7f0d580b1490 2023-10-06T03:03:57.733 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.725+0000 7f0d57fff700 1 --2- 172.21.15.57:0/3760463534 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f0d38060550 0x7f0d38062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:57.733 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.725+0000 7f0d57fff700 1 --2- 172.21.15.57:0/3760463534 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f0d38060550 0x7f0d38062a00 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f0d480094c0 tx=0x7f0d48008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:03:57.734 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.729+0000 7f0d54ff9700 1 -- 172.21.15.57:0/3760463534 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f0d4004e630 con 0x7f0d580b1490 2023-10-06T03:03:57.967 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:57.965+0000 7f0d5e4a5700 1 -- 172.21.15.57:0/3760463534 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_openfiletable.OpenFileTable.test_perf_counters"]} v 0) v1 -- 0x7f0d581582e0 con 0x7f0d580b1490 2023-10-06T03:03:58.010 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:58.005+0000 7f0d54ff9700 1 -- 172.21.15.57:0/3760463534 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_openfiletable.OpenFileTable.test_perf_counters"]}]=0 v171) v1 ==== 143+0+0 (secure 0 0 0) 0x7f0d40051c50 con 0x7f0d580b1490 2023-10-06T03:03:58.014 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:58.009+0000 7f0d5e4a5700 1 -- 172.21.15.57:0/3760463534 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f0d38060550 msgr2=0x7f0d38062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:58.014 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:58.009+0000 7f0d5e4a5700 1 --2- 172.21.15.57:0/3760463534 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f0d38060550 0x7f0d38062a00 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f0d480094c0 tx=0x7f0d48008040 comp rx=0 tx=0).stop 2023-10-06T03:03:58.014 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:58.009+0000 7f0d5e4a5700 1 -- 172.21.15.57:0/3760463534 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0d580b1490 msgr2=0x7f0d58150df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:58.014 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:58.009+0000 7f0d5e4a5700 1 --2- 172.21.15.57:0/3760463534 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0d580b1490 0x7f0d58150df0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f0d40009ed0 tx=0x7f0d40017000 comp rx=0 tx=0).stop 2023-10-06T03:03:58.014 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:58.009+0000 7f0d5e4a5700 1 -- 172.21.15.57:0/3760463534 shutdown_connections 2023-10-06T03:03:58.014 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:58.009+0000 7f0d5e4a5700 1 --2- 172.21.15.57:0/3760463534 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f0d38060550 0x7f0d38062a00 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:58.014 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:58.009+0000 7f0d5e4a5700 1 --2- 172.21.15.57:0/3760463534 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0d58154bc0 0x7f0d580a9220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:58.014 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:58.009+0000 7f0d5e4a5700 1 --2- 172.21.15.57:0/3760463534 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0d580b1490 0x7f0d58150df0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:58.014 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:58.009+0000 7f0d5e4a5700 1 --2- 172.21.15.57:0/3760463534 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0d580b10c0 0x7f0d580aae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:58.014 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:58.009+0000 7f0d5e4a5700 1 -- 172.21.15.57:0/3760463534 >> 172.21.15.57:0/3760463534 conn(0x7f0d580cbdd0 msgr2=0x7f0d58158750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:03:58.015 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:58.009+0000 7f0d5e4a5700 1 -- 172.21.15.57:0/3760463534 shutdown_connections 2023-10-06T03:03:58.015 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:58.009+0000 7f0d5e4a5700 1 -- 172.21.15.57:0/3760463534 wait complete. 2023-10-06T03:03:58.035 INFO:tasks.cephfs_test_runner:Opening a file should increment omap_total_updates by 1. ... ok 2023-10-06T03:03:58.035 INFO:tasks.cephfs_test_runner: 2023-10-06T03:03:58.035 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-06T03:03:58.035 INFO:tasks.cephfs_test_runner:Ran 2 tests in 148.705s 2023-10-06T03:03:58.035 INFO:tasks.cephfs_test_runner: 2023-10-06T03:03:58.035 INFO:tasks.cephfs_test_runner:OK 2023-10-06T03:03:58.036 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-10-06T03:03:58.047 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-10-06T03:03:58.084 INFO:tasks.kclient:Unmounting kernel clients... 2023-10-06T03:03:58.084 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:03:58.084 DEBUG:teuthology.orchestra.run.smithi057:> ip netns list 2023-10-06T03:03:58.106 INFO:teuthology.orchestra.run.smithi057.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T03:03:58.106 INFO:teuthology.orchestra.run.smithi057.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T03:03:58.106 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:03:58.107 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T03:03:58.183 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:03:58.183 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T03:03:58.297 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:03:58.297 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip link delete ceph-brx 2023-10-06T03:03:58.470 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:03:58.470 DEBUG:teuthology.orchestra.run.smithi057:> ip netns list 2023-10-06T03:03:58.486 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:03:58.486 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip link delete ceph-brx 2023-10-06T03:03:58.577 INFO:teuthology.orchestra.run.smithi057.stderr:Cannot find device "ceph-brx" 2023-10-06T03:03:58.581 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T03:03:58.582 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:03:58.582 DEBUG:teuthology.orchestra.run.smithi105:> ip netns list 2023-10-06T03:03:58.602 INFO:teuthology.orchestra.run.smithi105.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-06T03:03:58.602 INFO:teuthology.orchestra.run.smithi105.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-06T03:03:58.603 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:03:58.603 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-06T03:03:58.682 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:03:58.683 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-06T03:03:58.787 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:03:58.787 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip link delete ceph-brx 2023-10-06T03:03:58.941 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:03:58.941 DEBUG:teuthology.orchestra.run.smithi105:> ip netns list 2023-10-06T03:03:58.960 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:03:58.960 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip link delete ceph-brx 2023-10-06T03:03:59.041 INFO:teuthology.orchestra.run.smithi105.stderr:Cannot find device "ceph-brx" 2023-10-06T03:03:59.044 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T03:03:59.045 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-10-06T03:03:59.053 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2023-10-06T03:03:59.054 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:03:59.222 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.217+0000 7fea034ae700 1 Processor -- start 2023-10-06T03:03:59.223 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.221+0000 7fea034ae700 1 -- start start 2023-10-06T03:03:59.226 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.221+0000 7fea034ae700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe9fc0671f0 0x7fe9fc0675c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:59.226 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.221+0000 7fea034ae700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fe9fc15cee0 0x7fe9fc15d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:59.226 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.221+0000 7fea034ae700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9fc06da20 con 0x7fe9fc06deb0 2023-10-06T03:03:59.226 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.221+0000 7fea034ae700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9fc0b0650 con 0x7fe9fc15cee0 2023-10-06T03:03:59.226 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.221+0000 7fea034ae700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9fc06ce10 con 0x7fe9fc0671f0 2023-10-06T03:03:59.227 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.225+0000 7fea0124a700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe9fc0671f0 0x7fe9fc0675c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:59.227 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.225+0000 7fea01a4b700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fe9fc15cee0 0x7fe9fc15d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:59.227 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.225+0000 7fea0124a700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe9fc0671f0 0x7fe9fc0675c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.57:44574/0 (socket says 172.21.15.57:44574) 2023-10-06T03:03:59.228 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.225+0000 7fea0124a700 1 -- 172.21.15.57:0/1787961731 learned_addr learned my addr 172.21.15.57:0/1787961731 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:03:59.228 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.225+0000 7fea00a49700 1 --1- 172.21.15.57:0/1787961731 >> v1:172.21.15.105:6789/0 conn(0x7fe9fc06deb0 0x7fe9fc0aff40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.57:44988/0 (socket says 172.21.15.57:44988) 2023-10-06T03:03:59.228 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.225+0000 7fea0124a700 1 -- 172.21.15.57:0/1787961731 >> v2:172.21.15.105:3300/0 conn(0x7fe9fc15cee0 msgr2=0x7fe9fc15d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:03:59.228 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.225+0000 7fea0124a700 1 --2- 172.21.15.57:0/1787961731 >> v2:172.21.15.105:3300/0 conn(0x7fe9fc15cee0 0x7fe9fc15d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:59.229 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.225+0000 7fea0124a700 1 -- 172.21.15.57:0/1787961731 >> v1:172.21.15.105:6789/0 conn(0x7fe9fc06deb0 legacy=0x7fe9fc0aff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:59.229 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.225+0000 7fea0124a700 1 -- 172.21.15.57:0/1787961731 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9fc06d0f0 con 0x7fe9fc0671f0 2023-10-06T03:03:59.229 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.225+0000 7fea0124a700 1 --2- 172.21.15.57:0/1787961731 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe9fc0671f0 0x7fe9fc0675c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe9f80099b0 tx=0x7fe9f8009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cfb5ecc7a2c3edb7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:03:59.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.225+0000 7fe9f3fff700 1 -- 172.21.15.57:0/1787961731 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9f8009ea0 con 0x7fe9fc0671f0 2023-10-06T03:03:59.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.225+0000 7fe9f3fff700 1 -- 172.21.15.57:0/1787961731 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9f800b860 con 0x7fe9fc0671f0 2023-10-06T03:03:59.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.225+0000 7fe9f3fff700 1 -- 172.21.15.57:0/1787961731 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9f800bc00 con 0x7fe9fc0671f0 2023-10-06T03:03:59.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.225+0000 7fea034ae700 1 -- 172.21.15.57:0/1787961731 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe9fc0671f0 msgr2=0x7fe9fc0675c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:59.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.225+0000 7fea034ae700 1 --2- 172.21.15.57:0/1787961731 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe9fc0671f0 0x7fe9fc0675c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe9f80099b0 tx=0x7fe9f8009250 comp rx=0 tx=0).stop 2023-10-06T03:03:59.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.225+0000 7fea034ae700 1 -- 172.21.15.57:0/1787961731 shutdown_connections 2023-10-06T03:03:59.231 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.225+0000 7fea034ae700 1 --2- 172.21.15.57:0/1787961731 >> v2:172.21.15.105:3300/0 conn(0x7fe9fc15cee0 0x7fe9fc15d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:59.231 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.225+0000 7fea034ae700 1 --2- 172.21.15.57:0/1787961731 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe9fc0671f0 0x7fe9fc0675c0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:59.231 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.225+0000 7fea034ae700 1 -- 172.21.15.57:0/1787961731 >> 172.21.15.57:0/1787961731 conn(0x7fe9fc0cbdd0 msgr2=0x7fe9fc0cc1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:03:59.231 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.225+0000 7fea034ae700 1 -- 172.21.15.57:0/1787961731 shutdown_connections 2023-10-06T03:03:59.231 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.225+0000 7fea034ae700 1 -- 172.21.15.57:0/1787961731 wait complete. 2023-10-06T03:03:59.232 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.229+0000 7fea034ae700 1 Processor -- start 2023-10-06T03:03:59.232 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.229+0000 7fea034ae700 1 -- start start 2023-10-06T03:03:59.234 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.229+0000 7fea034ae700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe9fc0671f0 0x7fe9fc16db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:59.234 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.229+0000 7fea034ae700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe9fc06deb0 0x7fe9fc170a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:59.234 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.229+0000 7fea034ae700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe9fc15cee0 0x7fe9fc15fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:59.234 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.229+0000 7fea034ae700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9fc13f7e0 con 0x7fe9fc15cee0 2023-10-06T03:03:59.234 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.229+0000 7fea034ae700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9fc15e130 con 0x7fe9fc06deb0 2023-10-06T03:03:59.235 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.229+0000 7fea034ae700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9fc15d520 con 0x7fe9fc0671f0 2023-10-06T03:03:59.236 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.233+0000 7fea01a4b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe9fc15cee0 0x7fe9fc15fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:59.236 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.233+0000 7fea01a4b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe9fc15cee0 0x7fe9fc15fe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:52168/0 (socket says 172.21.15.57:52168) 2023-10-06T03:03:59.236 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.233+0000 7fea01a4b700 1 -- 172.21.15.57:0/2151295734 learned_addr learned my addr 172.21.15.57:0/2151295734 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:03:59.236 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.233+0000 7fea0124a700 1 --2- 172.21.15.57:0/2151295734 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe9fc0671f0 0x7fe9fc16db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:59.236 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.233+0000 7fea00a49700 1 --2- 172.21.15.57:0/2151295734 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe9fc06deb0 0x7fe9fc170a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:59.237 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.233+0000 7fea01a4b700 1 -- 172.21.15.57:0/2151295734 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe9fc0671f0 msgr2=0x7fe9fc16db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:59.237 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.233+0000 7fea01a4b700 1 --2- 172.21.15.57:0/2151295734 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe9fc0671f0 0x7fe9fc16db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:59.237 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.233+0000 7fea01a4b700 1 -- 172.21.15.57:0/2151295734 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe9fc06deb0 msgr2=0x7fe9fc170a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:59.237 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.233+0000 7fea01a4b700 1 --2- 172.21.15.57:0/2151295734 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe9fc06deb0 0x7fe9fc170a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:59.237 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.233+0000 7fea01a4b700 1 -- 172.21.15.57:0/2151295734 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9f80094f0 con 0x7fe9fc15cee0 2023-10-06T03:03:59.237 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.233+0000 7fea00a49700 1 --2- 172.21.15.57:0/2151295734 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe9fc06deb0 0x7fe9fc170a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:03:59.237 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.233+0000 7fea01a4b700 1 --2- 172.21.15.57:0/2151295734 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe9fc15cee0 0x7fe9fc15fe10 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fe9f4009e90 tx=0x7fe9f400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:03:59.238 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.233+0000 7fe9f17fa700 1 -- 172.21.15.57:0/2151295734 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9f400cc20 con 0x7fe9fc15cee0 2023-10-06T03:03:59.239 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.233+0000 7fe9f17fa700 1 -- 172.21.15.57:0/2151295734 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9f400f040 con 0x7fe9fc15cee0 2023-10-06T03:03:59.239 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.233+0000 7fe9f17fa700 1 -- 172.21.15.57:0/2151295734 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9f4014480 con 0x7fe9fc15cee0 2023-10-06T03:03:59.239 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.233+0000 7fea034ae700 1 -- 172.21.15.57:0/2151295734 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9fc15d800 con 0x7fe9fc15cee0 2023-10-06T03:03:59.239 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.233+0000 7fea034ae700 1 -- 172.21.15.57:0/2151295734 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9fc15ddc0 con 0x7fe9fc15cee0 2023-10-06T03:03:59.239 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.237+0000 7fea034ae700 1 -- 172.21.15.57:0/2151295734 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9fc15e2e0 con 0x7fe9fc15cee0 2023-10-06T03:03:59.240 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.237+0000 7fe9f17fa700 1 -- 172.21.15.57:0/2151295734 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fe9f4014830 con 0x7fe9fc15cee0 2023-10-06T03:03:59.241 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.237+0000 7fe9f17fa700 1 --2- 172.21.15.57:0/2151295734 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fe9e0060550 0x7fe9e0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:59.241 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.237+0000 7fe9f17fa700 1 -- 172.21.15.57:0/2151295734 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5378+0+0 (secure 0 0 0) 0x7fe9f407d3c0 con 0x7fe9fc15cee0 2023-10-06T03:03:59.241 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.237+0000 7fea0124a700 1 --2- 172.21.15.57:0/2151295734 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fe9e0060550 0x7fe9e0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:59.242 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.237+0000 7fea0124a700 1 --2- 172.21.15.57:0/2151295734 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fe9e0060550 0x7fe9e0062a00 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fe9f80099b0 tx=0x7fe9f8017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:03:59.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.245+0000 7fe9f17fa700 1 -- 172.21.15.57:0/2151295734 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fe9fc15e2e0 con 0x7fe9fc15cee0 2023-10-06T03:03:59.424 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.421+0000 7fea034ae700 1 -- 172.21.15.57:0/2151295734 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe9fc15e2a0 con 0x7fe9fc15cee0 2023-10-06T03:03:59.426 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.421+0000 7fe9f17fa700 1 -- 172.21.15.57:0/2151295734 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v59) v1 ==== 74+0+13909 (secure 0 0 0) 0x7fe9f4051580 con 0x7fe9fc15cee0 2023-10-06T03:03:59.426 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:03:59.426 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":59,"fsid":"eb56dc0f-9213-41cb-9aad-8ade6c802e98","created":"2023-10-06T03:00:30.806197+0000","modified":"2023-10-06T03:03:56.979824+0000","last_up_change":"2023-10-06T03:00:43.607454+0000","last_in_change":"2023-10-06T03:00:33.943513+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T03:00:44.360651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T03:00:50.466601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"58cf6c90-d704-43e0-b2db-dffe526d5e8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":33053},{"type":"v1","addr":"172.21.15.57:6801","nonce":33053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":33053},{"type":"v1","addr":"172.21.15.57:6803","nonce":33053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":33053},{"type":"v1","addr":"172.21.15.57:6807","nonce":33053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":33053},{"type":"v1","addr":"172.21.15.57:6805","nonce":33053}]},"public_addr":"172.21.15.57:6801/33053","cluster_addr":"172.21.15.57:6803/33053","heartbeat_back_addr":"172.21.15.57:6807/33053","heartbeat_front_addr":"172.21.15.57:6805/33053","state":["exists","up"]},{"osd":1,"uuid":"16afbe70-7f9e-4568-9c92-763e6e348119","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6809","nonce":33052},{"type":"v1","addr":"172.21.15.57:6810","nonce":33052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":33052},{"type":"v1","addr":"172.21.15.57:6813","nonce":33052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":33052},{"type":"v1","addr":"172.21.15.57:6822","nonce":33052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6815","nonce":33052},{"type":"v1","addr":"172.21.15.57:6818","nonce":33052}]},"public_addr":"172.21.15.57:6810/33052","cluster_addr":"172.21.15.57:6813/33052","heartbeat_back_addr":"172.21.15.57:6822/33052","heartbeat_front_addr":"172.21.15.57:6818/33052","state":["exists","up"]},{"osd":2,"uuid":"7255c62e-f92f-470f-a5ce-30228920d9f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":33058},{"type":"v1","addr":"172.21.15.57:6825","nonce":33058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":33058},{"type":"v1","addr":"172.21.15.57:6827","nonce":33058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":33058},{"type":"v1","addr":"172.21.15.57:6831","nonce":33058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":33058},{"type":"v1","addr":"172.21.15.57:6829","nonce":33058}]},"public_addr":"172.21.15.57:6825/33058","cluster_addr":"172.21.15.57:6827/33058","heartbeat_back_addr":"172.21.15.57:6831/33058","heartbeat_front_addr":"172.21.15.57:6829/33058","state":["exists","up"]},{"osd":3,"uuid":"152a236d-f799-4888-8544-74865508d5a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":33057},{"type":"v1","addr":"172.21.15.57:6811","nonce":33057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":33057},{"type":"v1","addr":"172.21.15.57:6816","nonce":33057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6821","nonce":33057},{"type":"v1","addr":"172.21.15.57:6823","nonce":33057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6817","nonce":33057},{"type":"v1","addr":"172.21.15.57:6819","nonce":33057}]},"public_addr":"172.21.15.57:6811/33057","cluster_addr":"172.21.15.57:6816/33057","heartbeat_back_addr":"172.21.15.57:6823/33057","heartbeat_front_addr":"172.21.15.57:6819/33057","state":["exists","up"]},{"osd":4,"uuid":"37db2a65-3566-41d0-9d60-e66c49e1e68e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":33368},{"type":"v1","addr":"172.21.15.105:6801","nonce":33368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":33368},{"type":"v1","addr":"172.21.15.105:6803","nonce":33368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":33368},{"type":"v1","addr":"172.21.15.105:6807","nonce":33368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":33368},{"type":"v1","addr":"172.21.15.105:6805","nonce":33368}]},"public_addr":"172.21.15.105:6801/33368","cluster_addr":"172.21.15.105:6803/33368","heartbeat_back_addr":"172.21.15.105:6807/33368","heartbeat_front_addr":"172.21.15.105:6805/33368","state":["exists","up"]},{"osd":5,"uuid":"35e77918-1bb4-42ca-9b20-f3c14eaa0c04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":33379},{"type":"v1","addr":"172.21.15.105:6818","nonce":33379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":33379},{"type":"v1","addr":"172.21.15.105:6823","nonce":33379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":33379},{"type":"v1","addr":"172.21.15.105:6831","nonce":33379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":33379},{"type":"v1","addr":"172.21.15.105:6827","nonce":33379}]},"public_addr":"172.21.15.105:6818/33379","cluster_addr":"172.21.15.105:6823/33379","heartbeat_back_addr":"172.21.15.105:6831/33379","heartbeat_front_addr":"172.21.15.105:6827/33379","state":["exists","up"]},{"osd":6,"uuid":"b4d9d510-7a45-4173-8287-c6c8d6547f2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":33369},{"type":"v1","addr":"172.21.15.105:6819","nonce":33369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":33369},{"type":"v1","addr":"172.21.15.105:6822","nonce":33369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":33369},{"type":"v1","addr":"172.21.15.105:6830","nonce":33369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":33369},{"type":"v1","addr":"172.21.15.105:6826","nonce":33369}]},"public_addr":"172.21.15.105:6819/33369","cluster_addr":"172.21.15.105:6822/33369","heartbeat_back_addr":"172.21.15.105:6830/33369","heartbeat_front_addr":"172.21.15.105:6826/33369","state":["exists","up"]},{"osd":7,"uuid":"74266fb0-cd84-463f-8bf0-092652a71dc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":33370},{"type":"v1","addr":"172.21.15.105:6809","nonce":33370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":33370},{"type":"v1","addr":"172.21.15.105:6811","nonce":33370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":33370},{"type":"v1","addr":"172.21.15.105:6815","nonce":33370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":33370},{"type":"v1","addr":"172.21.15.105:6813","nonce":33370}]},"public_addr":"172.21.15.105:6809/33370","cluster_addr":"172.21.15.105:6811/33370","heartbeat_back_addr":"172.21.15.105:6815/33370","heartbeat_front_addr":"172.21.15.105:6813/33370","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.596864+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.633851+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.636993+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.529681+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.608601+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.659752+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.661717+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.642221+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.57:6837/3347844181":"2023-10-07T03:03:53.729423+0000","172.21.15.57:6836/3347844181":"2023-10-07T03:03:53.729423+0000","172.21.15.57:6837/4147766471":"2023-10-07T03:02:52.815979+0000","172.21.15.57:6835/4147766471":"2023-10-07T03:02:52.815979+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:03:59.428 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.425+0000 7fea034ae700 1 -- 172.21.15.57:0/2151295734 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fe9e0060550 msgr2=0x7fe9e0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:59.428 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.425+0000 7fea034ae700 1 --2- 172.21.15.57:0/2151295734 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fe9e0060550 0x7fe9e0062a00 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fe9f80099b0 tx=0x7fe9f8017000 comp rx=0 tx=0).stop 2023-10-06T03:03:59.428 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.425+0000 7fea034ae700 1 -- 172.21.15.57:0/2151295734 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe9fc15cee0 msgr2=0x7fe9fc15fe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:59.429 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.425+0000 7fea034ae700 1 --2- 172.21.15.57:0/2151295734 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe9fc15cee0 0x7fe9fc15fe10 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fe9f4009e90 tx=0x7fe9f400b040 comp rx=0 tx=0).stop 2023-10-06T03:03:59.429 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.425+0000 7fea034ae700 1 -- 172.21.15.57:0/2151295734 shutdown_connections 2023-10-06T03:03:59.429 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.425+0000 7fea034ae700 1 --2- 172.21.15.57:0/2151295734 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe9fc15cee0 0x7fe9fc15fe10 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:59.429 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.425+0000 7fea034ae700 1 --2- 172.21.15.57:0/2151295734 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe9fc06deb0 0x7fe9fc170a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:59.430 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.425+0000 7fea034ae700 1 --2- 172.21.15.57:0/2151295734 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fe9e0060550 0x7fe9e0062a00 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:59.430 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.425+0000 7fea034ae700 1 --2- 172.21.15.57:0/2151295734 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe9fc0671f0 0x7fe9fc16db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:59.430 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.425+0000 7fea034ae700 1 -- 172.21.15.57:0/2151295734 >> 172.21.15.57:0/2151295734 conn(0x7fe9fc0cbdd0 msgr2=0x7fe9fc1594e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:03:59.430 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.425+0000 7fea034ae700 1 -- 172.21.15.57:0/2151295734 shutdown_connections 2023-10-06T03:03:59.430 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.425+0000 7fea034ae700 1 -- 172.21.15.57:0/2151295734 wait complete. 2023-10-06T03:03:59.449 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-06T03:03:59.449 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:03:59.623 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.620+0000 7f6cae665700 1 Processor -- start 2023-10-06T03:03:59.623 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.620+0000 7f6cae665700 1 -- start start 2023-10-06T03:03:59.625 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.620+0000 7f6cae665700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ca8159340 0x7f6ca80cb2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:59.625 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.620+0000 7f6cae665700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6ca80b01c0 0x7f6ca806dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:59.626 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.620+0000 7f6cae665700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ca80b0660 con 0x7f6ca8158f70 2023-10-06T03:03:59.626 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.620+0000 7f6cae665700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ca80cb900 con 0x7f6ca80b01c0 2023-10-06T03:03:59.626 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.620+0000 7f6cae665700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca80cbbe0 con 0x7f6ca8159340 2023-10-06T03:03:59.627 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.620+0000 7f6ca7fff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f6ca8158f70 0x7f6ca806d4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:54304/0 (socket says 172.21.15.57:54304) 2023-10-06T03:03:59.627 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.620+0000 7f6ca7fff700 1 -- 172.21.15.57:0/201205255 learned_addr learned my addr 172.21.15.57:0/201205255 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:03:59.627 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.620+0000 7f6ca77fe700 1 --2- 172.21.15.57:0/201205255 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ca8159340 0x7f6ca80cb2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:59.627 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.624+0000 7f6cacc02700 1 --2- 172.21.15.57:0/201205255 >> v2:172.21.15.57:3300/0 conn(0x7f6ca80b01c0 0x7f6ca806dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:59.627 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.624+0000 7f6ca6ffd700 1 -- 172.21.15.57:0/201205255 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4235546239 0 0) 0x7f6ca80b0660 con 0x7f6ca8158f70 2023-10-06T03:03:59.627 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.624+0000 7f6ca6ffd700 1 -- 172.21.15.57:0/201205255 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c90003570 con 0x7f6ca8158f70 2023-10-06T03:03:59.627 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.624+0000 7f6ca77fe700 1 -- 172.21.15.57:0/201205255 >> v2:172.21.15.57:3300/0 conn(0x7f6ca80b01c0 msgr2=0x7f6ca806dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:03:59.627 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.624+0000 7f6ca77fe700 1 --2- 172.21.15.57:0/201205255 >> v2:172.21.15.57:3300/0 conn(0x7f6ca80b01c0 0x7f6ca806dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:59.628 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.624+0000 7f6ca77fe700 1 -- 172.21.15.57:0/201205255 >> v1:172.21.15.57:6789/0 conn(0x7f6ca8158f70 legacy=0x7f6ca806d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:59.628 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.624+0000 7f6ca77fe700 1 -- 172.21.15.57:0/201205255 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ca806c9c0 con 0x7f6ca8159340 2023-10-06T03:03:59.628 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.624+0000 7f6cacc02700 1 --2- 172.21.15.57:0/201205255 >> v2:172.21.15.57:3300/0 conn(0x7f6ca80b01c0 0x7f6ca806dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:03:59.628 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.624+0000 7f6ca77fe700 1 --2- 172.21.15.57:0/201205255 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ca8159340 0x7f6ca80cb2f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6c9c0098e0 tx=0x7f6c9c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a71f6ea764b86b89 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:03:59.628 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.624+0000 7f6ca6ffd700 1 -- 172.21.15.57:0/201205255 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c9c00b640 con 0x7f6ca8159340 2023-10-06T03:03:59.628 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.624+0000 7f6ca6ffd700 1 -- 172.21.15.57:0/201205255 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c9c00b7a0 con 0x7f6ca8159340 2023-10-06T03:03:59.629 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.624+0000 7f6ca6ffd700 1 -- 172.21.15.57:0/201205255 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c9c00bb40 con 0x7f6ca8159340 2023-10-06T03:03:59.629 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.624+0000 7f6cae665700 1 -- 172.21.15.57:0/201205255 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ca8159340 msgr2=0x7f6ca80cb2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:59.629 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.624+0000 7f6cae665700 1 --2- 172.21.15.57:0/201205255 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ca8159340 0x7f6ca80cb2f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6c9c0098e0 tx=0x7f6c9c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:03:59.630 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.624+0000 7f6cae665700 1 -- 172.21.15.57:0/201205255 shutdown_connections 2023-10-06T03:03:59.630 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.624+0000 7f6cae665700 1 --2- 172.21.15.57:0/201205255 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ca8159340 0x7f6ca80cb2f0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:59.630 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.624+0000 7f6cae665700 1 --2- 172.21.15.57:0/201205255 >> v2:172.21.15.57:3300/0 conn(0x7f6ca80b01c0 0x7f6ca806dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:59.630 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.624+0000 7f6cae665700 1 -- 172.21.15.57:0/201205255 >> 172.21.15.57:0/201205255 conn(0x7f6ca80ccbf0 msgr2=0x7f6ca80ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:03:59.630 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.624+0000 7f6cae665700 1 -- 172.21.15.57:0/201205255 shutdown_connections 2023-10-06T03:03:59.630 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.624+0000 7f6cae665700 1 -- 172.21.15.57:0/201205255 wait complete. 2023-10-06T03:03:59.632 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.628+0000 7f6cae665700 1 Processor -- start 2023-10-06T03:03:59.632 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.628+0000 7f6cae665700 1 -- start start 2023-10-06T03:03:59.634 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.632+0000 7f6cae665700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6ca80b01c0 0x7f6ca815c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:59.635 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.632+0000 7f6cae665700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ca8158f70 0x7f6ca816cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:59.635 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.632+0000 7f6cae665700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6ca8159340 0x7f6ca80ca130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:59.635 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.632+0000 7f6cae665700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca80c7b60 con 0x7f6ca80b01c0 2023-10-06T03:03:59.635 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.632+0000 7f6cae665700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca815ceb0 con 0x7f6ca8159340 2023-10-06T03:03:59.635 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.632+0000 7f6cae665700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca8156540 con 0x7f6ca8158f70 2023-10-06T03:03:59.636 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.632+0000 7f6ca7fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6ca80b01c0 0x7f6ca815c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:59.636 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.632+0000 7f6ca7fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6ca80b01c0 0x7f6ca815c970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:52184/0 (socket says 172.21.15.57:52184) 2023-10-06T03:03:59.636 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.632+0000 7f6ca7fff700 1 -- 172.21.15.57:0/1570156131 learned_addr learned my addr 172.21.15.57:0/1570156131 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:03:59.636 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.632+0000 7f6cacc02700 1 --2- 172.21.15.57:0/1570156131 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6ca8159340 0x7f6ca80ca130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:59.637 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.632+0000 7f6ca77fe700 1 --2- 172.21.15.57:0/1570156131 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ca8158f70 0x7f6ca816cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:59.637 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.632+0000 7f6ca7fff700 1 -- 172.21.15.57:0/1570156131 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ca8158f70 msgr2=0x7f6ca816cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:59.637 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.632+0000 7f6ca7fff700 1 --2- 172.21.15.57:0/1570156131 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ca8158f70 0x7f6ca816cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:59.637 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.632+0000 7f6ca7fff700 1 -- 172.21.15.57:0/1570156131 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6ca8159340 msgr2=0x7f6ca80ca130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:59.637 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.632+0000 7f6ca7fff700 1 --2- 172.21.15.57:0/1570156131 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6ca8159340 0x7f6ca80ca130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:59.637 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.632+0000 7f6ca7fff700 1 -- 172.21.15.57:0/1570156131 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c9c009420 con 0x7f6ca80b01c0 2023-10-06T03:03:59.637 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.632+0000 7f6ca7fff700 1 --2- 172.21.15.57:0/1570156131 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6ca80b01c0 0x7f6ca815c970 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f6c9800c7c0 tx=0x7f6c98007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:03:59.638 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.632+0000 7f6c8ffff700 1 -- 172.21.15.57:0/1570156131 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c98005cd0 con 0x7f6ca80b01c0 2023-10-06T03:03:59.638 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.632+0000 7f6c8ffff700 1 -- 172.21.15.57:0/1570156131 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c98005e30 con 0x7f6ca80b01c0 2023-10-06T03:03:59.638 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.632+0000 7f6c8ffff700 1 -- 172.21.15.57:0/1570156131 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c98007320 con 0x7f6ca80b01c0 2023-10-06T03:03:59.638 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.632+0000 7f6cae665700 1 -- 172.21.15.57:0/1570156131 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ca80c7230 con 0x7f6ca80b01c0 2023-10-06T03:03:59.638 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.632+0000 7f6cae665700 1 -- 172.21.15.57:0/1570156131 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ca80cacd0 con 0x7f6ca80b01c0 2023-10-06T03:03:59.639 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.636+0000 7f6cae665700 1 -- 172.21.15.57:0/1570156131 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ca80712e0 con 0x7f6ca80b01c0 2023-10-06T03:03:59.641 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.636+0000 7f6c8ffff700 1 -- 172.21.15.57:0/1570156131 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f6c9801b3b0 con 0x7f6ca80b01c0 2023-10-06T03:03:59.643 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.640+0000 7f6c8ffff700 1 --2- 172.21.15.57:0/1570156131 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f6c94060550 0x7f6c94062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:03:59.643 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.640+0000 7f6c8ffff700 1 -- 172.21.15.57:0/1570156131 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5378+0+0 (secure 0 0 0) 0x7f6c9807bdc0 con 0x7f6ca80b01c0 2023-10-06T03:03:59.643 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.640+0000 7f6ca77fe700 1 --2- 172.21.15.57:0/1570156131 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f6c94060550 0x7f6c94062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:03:59.644 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.640+0000 7f6ca77fe700 1 --2- 172.21.15.57:0/1570156131 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f6c94060550 0x7f6c94062a00 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f6c9c0098e0 tx=0x7f6c9c017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:03:59.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.644+0000 7f6c8ffff700 1 -- 172.21.15.57:0/1570156131 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f6c9804c450 con 0x7f6ca80b01c0 2023-10-06T03:03:59.818 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.812+0000 7f6cae665700 1 -- 172.21.15.57:0/1570156131 --> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6ca80c7990 con 0x7f6c94060550 2023-10-06T03:03:59.827 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.824+0000 7f6c8ffff700 1 -- 172.21.15.57:0/1570156131 <== mgr.4103 v2:172.21.15.57:6832/32947 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+70179 (secure 0 0 0) 0x7f6c9c006c50 con 0x7f6c94060550 2023-10-06T03:03:59.828 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:03:59.831 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.828+0000 7f6cae665700 1 -- 172.21.15.57:0/1570156131 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f6c94060550 msgr2=0x7f6c94062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:59.831 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.828+0000 7f6cae665700 1 --2- 172.21.15.57:0/1570156131 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f6c94060550 0x7f6c94062a00 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f6c9c0098e0 tx=0x7f6c9c017000 comp rx=0 tx=0).stop 2023-10-06T03:03:59.831 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.828+0000 7f6cae665700 1 -- 172.21.15.57:0/1570156131 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6ca80b01c0 msgr2=0x7f6ca815c970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:03:59.831 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.828+0000 7f6cae665700 1 --2- 172.21.15.57:0/1570156131 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6ca80b01c0 0x7f6ca815c970 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f6c9800c7c0 tx=0x7f6c98007e00 comp rx=0 tx=0).stop 2023-10-06T03:03:59.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.828+0000 7f6cae665700 1 -- 172.21.15.57:0/1570156131 shutdown_connections 2023-10-06T03:03:59.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.828+0000 7f6cae665700 1 --2- 172.21.15.57:0/1570156131 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6ca8159340 0x7f6ca80ca130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:59.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.828+0000 7f6cae665700 1 --2- 172.21.15.57:0/1570156131 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f6c94060550 0x7f6c94062a00 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:59.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.828+0000 7f6cae665700 1 --2- 172.21.15.57:0/1570156131 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ca8158f70 0x7f6ca816cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:59.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.828+0000 7f6cae665700 1 --2- 172.21.15.57:0/1570156131 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6ca80b01c0 0x7f6ca815c970 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:03:59.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.828+0000 7f6cae665700 1 -- 172.21.15.57:0/1570156131 >> 172.21.15.57:0/1570156131 conn(0x7f6ca80ccbf0 msgr2=0x7f6ca8158100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:03:59.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.828+0000 7f6cae665700 1 -- 172.21.15.57:0/1570156131 shutdown_connections 2023-10-06T03:03:59.832 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:03:59.828+0000 7f6cae665700 1 -- 172.21.15.57:0/1570156131 wait complete. 2023-10-06T03:03:59.834 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2023-10-06T03:03:59.853 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":149,"stamp":"2023-10-06T03:03:58.334772+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2409328,"kb_used_data":6448,"kb_used_omap":0,"kb_used_meta":2402816,"kb_avail":752565392,"statfs":{"total":773094113280,"available":770626961408,"internally_reserved":0,"allocated":6602752,"data_stored":3561966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2460483584},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-9133,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-49,"num_read_kb":-52,"num_write":-75,"num_write_kb":-34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002181"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":190,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T03:03:37.839944+0000","last_change":"2023-10-06T03:00:45.709165+0000","last_active":"2023-10-06T03:03:37.839944+0000","last_peered":"2023-10-06T03:03:37.839944+0000","last_clean":"2023-10-06T03:03:37.839944+0000","last_became_active":"2023-10-06T03:00:45.707771+0000","last_became_peered":"2023-10-06T03:00:45.707771+0000","last_unstale":"2023-10-06T03:03:37.839944+0000","last_undegraded":"2023-10-06T03:03:37.839944+0000","last_fullsized":"2023-10-06T03:03:37.839944+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:44.625353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:44.625353+0000","last_clean_scrub_stamp":"2023-10-06T03:00:44.625353+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:31:31.774239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":39,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:03:39.439309+0000","last_change":"2023-10-06T03:00:51.905381+0000","last_active":"2023-10-06T03:03:39.439309+0000","last_peered":"2023-10-06T03:03:39.439309+0000","last_clean":"2023-10-06T03:03:39.439309+0000","last_became_active":"2023-10-06T03:00:51.904974+0000","last_became_peered":"2023-10-06T03:00:51.904974+0000","last_unstale":"2023-10-06T03:03:39.439309+0000","last_undegraded":"2023-10-06T03:03:39.439309+0000","last_fullsized":"2023-10-06T03:03:39.439309+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:15:19.182956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":37,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T03:03:37.839781+0000","last_change":"2023-10-06T03:00:51.906480+0000","last_active":"2023-10-06T03:03:37.839781+0000","last_peered":"2023-10-06T03:03:37.839781+0000","last_clean":"2023-10-06T03:03:37.839781+0000","last_became_active":"2023-10-06T03:00:51.905956+0000","last_became_peered":"2023-10-06T03:00:51.905956+0000","last_unstale":"2023-10-06T03:03:37.839781+0000","last_undegraded":"2023-10-06T03:03:37.839781+0000","last_fullsized":"2023-10-06T03:03:37.839781+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:15:19.182956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":39,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:03:38.847307+0000","last_change":"2023-10-06T03:00:51.902453+0000","last_active":"2023-10-06T03:03:38.847307+0000","last_peered":"2023-10-06T03:03:38.847307+0000","last_clean":"2023-10-06T03:03:38.847307+0000","last_became_active":"2023-10-06T03:00:51.901948+0000","last_became_peered":"2023-10-06T03:00:51.901948+0000","last_unstale":"2023-10-06T03:03:38.847307+0000","last_undegraded":"2023-10-06T03:03:38.847307+0000","last_fullsized":"2023-10-06T03:03:38.847307+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:13:30.721650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":39,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:03:39.439120+0000","last_change":"2023-10-06T03:00:51.904148+0000","last_active":"2023-10-06T03:03:39.439120+0000","last_peered":"2023-10-06T03:03:39.439120+0000","last_clean":"2023-10-06T03:03:39.439120+0000","last_became_active":"2023-10-06T03:00:51.903729+0000","last_became_peered":"2023-10-06T03:00:51.903729+0000","last_unstale":"2023-10-06T03:03:39.439120+0000","last_undegraded":"2023-10-06T03:03:39.439120+0000","last_fullsized":"2023-10-06T03:03:39.439120+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:17:25.070478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":37,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:03:39.353694+0000","last_change":"2023-10-06T03:00:52.484317+0000","last_active":"2023-10-06T03:03:39.353694+0000","last_peered":"2023-10-06T03:03:39.353694+0000","last_clean":"2023-10-06T03:03:39.353694+0000","last_became_active":"2023-10-06T03:00:52.483818+0000","last_became_peered":"2023-10-06T03:00:52.483818+0000","last_unstale":"2023-10-06T03:03:39.353694+0000","last_undegraded":"2023-10-06T03:03:39.353694+0000","last_fullsized":"2023-10-06T03:03:39.353694+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:17:24.136459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":37,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T03:03:37.840551+0000","last_change":"2023-10-06T03:00:52.485186+0000","last_active":"2023-10-06T03:03:37.840551+0000","last_peered":"2023-10-06T03:03:37.840551+0000","last_clean":"2023-10-06T03:03:37.840551+0000","last_became_active":"2023-10-06T03:00:52.484615+0000","last_became_peered":"2023-10-06T03:00:52.484615+0000","last_unstale":"2023-10-06T03:03:37.840551+0000","last_undegraded":"2023-10-06T03:03:37.840551+0000","last_fullsized":"2023-10-06T03:03:37.840551+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:17:25.070478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":37,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:03:39.353730+0000","last_change":"2023-10-06T03:00:51.903388+0000","last_active":"2023-10-06T03:03:39.353730+0000","last_peered":"2023-10-06T03:03:39.353730+0000","last_clean":"2023-10-06T03:03:39.353730+0000","last_became_active":"2023-10-06T03:00:51.902959+0000","last_became_peered":"2023-10-06T03:00:51.902959+0000","last_unstale":"2023-10-06T03:03:39.353730+0000","last_undegraded":"2023-10-06T03:03:39.353730+0000","last_fullsized":"2023-10-06T03:03:39.353730+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:30:16.907470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":36,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T03:03:37.846139+0000","last_change":"2023-10-06T03:00:51.903242+0000","last_active":"2023-10-06T03:03:37.846139+0000","last_peered":"2023-10-06T03:03:37.846139+0000","last_clean":"2023-10-06T03:03:37.846139+0000","last_became_active":"2023-10-06T03:00:51.902929+0000","last_became_peered":"2023-10-06T03:00:51.902929+0000","last_unstale":"2023-10-06T03:03:37.846139+0000","last_undegraded":"2023-10-06T03:03:37.846139+0000","last_fullsized":"2023-10-06T03:03:37.846139+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:34:12.274158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574889,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302620,"kb_used_data":1236,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069220,"statfs":{"total":96636764160,"available":96326881280,"internally_reserved":0,"allocated":1265664,"data_stored":884221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:03:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.2270000000000001,"15min":1.3009999999999999},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.415,"5min":4.7930000000000001,"15min":4.7930000000000001},"last":0.74199999999999999},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.4099999999999999,"15min":1.522},"min":{"1min":0.86399999999999999,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.476,"5min":9.9689999999999994,"15min":9.9689999999999994},"last":0.80000000000000004}]},{"osd":1,"last update":"Fri Oct 6 03:03:45 2023","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.3680000000000001,"15min":1.4710000000000001},"min":{"1min":0.95799999999999996,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.454,"5min":10.867000000000001,"15min":10.867000000000001},"last":0.95199999999999996},{"interface":"front","average":{"1min":1.3049999999999999,"5min":1.5169999999999999,"15min":1.6240000000000001},"min":{"1min":0.89100000000000001,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":1.599,"5min":10.255000000000001,"15min":10.255000000000001},"last":1.1459999999999999}]},{"osd":2,"last update":"Fri Oct 6 03:03:45 2023","interfaces":[{"interface":"back","average":{"1min":1.3300000000000001,"5min":1.5149999999999999,"15min":1.625},"min":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"max":{"1min":1.6830000000000001,"5min":7.9939999999999998,"15min":7.9939999999999998},"last":1.2490000000000001},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.552,"15min":1.6479999999999999},"min":{"1min":1.133,"5min":0.84899999999999998,"15min":0.84899999999999998},"max":{"1min":1.673,"5min":10.098000000000001,"15min":10.098000000000001},"last":1.089}]},{"osd":3,"last update":"Fri Oct 6 03:03:45 2023","interfaces":[{"interface":"back","average":{"1min":1.4099999999999999,"5min":1.4419999999999999,"15min":1.49},"min":{"1min":1.018,"5min":0.754,"15min":0.754},"max":{"1min":2.069,"5min":4.3090000000000002,"15min":4.3090000000000002},"last":1.3560000000000001},{"interface":"front","average":{"1min":1.4179999999999999,"5min":1.542,"15min":1.6080000000000001},"min":{"1min":1.1160000000000001,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":1.7589999999999999,"5min":8.3770000000000007,"15min":8.3770000000000007},"last":0.85099999999999998}]},{"osd":4,"last update":"Fri Oct 6 03:03:45 2023","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":1.5389999999999999,"15min":1.7050000000000001},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.8460000000000001,"5min":11.391999999999999,"15min":11.391999999999999},"last":1.2110000000000001},{"interface":"front","average":{"1min":1.268,"5min":1.399,"15min":1.456},"min":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"max":{"1min":1.857,"5min":3.9220000000000002,"15min":3.9220000000000002},"last":1.4450000000000001}]},{"osd":5,"last update":"Fri Oct 6 03:03:45 2023","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.581,"15min":1.724},"min":{"1min":0.91200000000000003,"5min":0.89400000000000002,"15min":0.89400000000000002},"max":{"1min":2.004,"5min":11.951000000000001,"15min":11.951000000000001},"last":1.179},{"interface":"front","average":{"1min":1.359,"5min":1.6890000000000001,"15min":1.847},"min":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"max":{"1min":1.764,"5min":10.994999999999999,"15min":10.994999999999999},"last":1.385}]},{"osd":6,"last update":"Fri Oct 6 03:03:45 2023","interfaces":[{"interface":"back","average":{"1min":1.5009999999999999,"5min":1.7729999999999999,"15min":1.917},"min":{"1min":1.143,"5min":0.91300000000000003,"15min":0.91300000000000003},"max":{"1min":1.9510000000000001,"5min":11.513,"15min":11.513},"last":1.474},{"interface":"front","average":{"1min":1.448,"5min":1.7290000000000001,"15min":1.881},"min":{"1min":1.024,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":2.1819999999999999,"5min":10.714,"15min":10.714},"last":1.4990000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574889,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297944,"kb_used_data":656,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073896,"statfs":{"total":96636764160,"available":96331669504,"internally_reserved":0,"allocated":671744,"data_stored":294353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:03:45 2023","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.1890000000000001,"15min":1.1930000000000001},"min":{"1min":0.78400000000000003,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.704,"5min":1.704,"15min":1.704},"last":1.1359999999999999},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.345,"15min":1.361},"min":{"1min":1.0449999999999999,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.7270000000000001,"5min":2.1419999999999999,"15min":2.1419999999999999},"last":1.27}]},{"osd":1,"last update":"Fri Oct 6 03:03:45 2023","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.2829999999999999,"15min":1.3049999999999999},"min":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.671,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":1.252},{"interface":"front","average":{"1min":1.2669999999999999,"5min":1.2509999999999999,"15min":1.254},"min":{"1min":0.90400000000000003,"5min":0.746,"15min":0.746},"max":{"1min":1.756,"5min":1.774,"15min":1.774},"last":1.3420000000000001}]},{"osd":2,"last update":"Fri Oct 6 03:03:45 2023","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.169,"15min":1.167},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.8220000000000001,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":1.538},{"interface":"front","average":{"1min":1.198,"5min":1.2150000000000001,"15min":1.2290000000000001},"min":{"1min":0.93999999999999995,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.595,"5min":1.78,"15min":1.78},"last":1.0289999999999999}]},{"osd":3,"last update":"Fri Oct 6 03:03:45 2023","interfaces":[{"interface":"back","average":{"1min":1.2749999999999999,"5min":1.274,"15min":1.28},"min":{"1min":1.004,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.488,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":1.167},{"interface":"front","average":{"1min":1.3580000000000001,"5min":1.3220000000000001,"15min":1.3360000000000001},"min":{"1min":1.111,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.5700000000000001,"5min":2.2200000000000002,"15min":2.2200000000000002},"last":1.4750000000000001}]},{"osd":4,"last update":"Fri Oct 6 03:03:45 2023","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":1.248,"15min":1.2729999999999999},"min":{"1min":0.77700000000000002,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.5840000000000001,"5min":2.0960000000000001,"15min":2.0960000000000001},"last":1.23},{"interface":"front","average":{"1min":1.175,"5min":1.3500000000000001,"15min":1.399},"min":{"1min":0.89200000000000002,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.4370000000000001,"5min":2.2610000000000001,"15min":2.2610000000000001},"last":1.383}]},{"osd":5,"last update":"Fri Oct 6 03:03:45 2023","interfaces":[{"interface":"back","average":{"1min":1.306,"5min":1.333,"15min":1.359},"min":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":1.7829999999999999,"5min":1.994,"15min":1.994},"last":1.4179999999999999},{"interface":"front","average":{"1min":1.294,"5min":1.3380000000000001,"15min":1.3720000000000001},"min":{"1min":0.89200000000000002,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.609,"5min":2.0129999999999999,"15min":2.0129999999999999},"last":1.4450000000000001}]},{"osd":7,"last update":"Fri Oct 6 03:03:45 2023","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.425,"15min":1.4590000000000001},"min":{"1min":1.085,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.661,"5min":2.0920000000000001,"15min":2.0920000000000001},"last":1.587},{"interface":"front","average":{"1min":1.448,"5min":1.492,"15min":1.528},"min":{"1min":0.93100000000000005,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":1.8720000000000001,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":1.3260000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574889,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297936,"kb_used_data":648,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073904,"statfs":{"total":96636764160,"available":96331677696,"internally_reserved":0,"allocated":663552,"data_stored":293729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:03:50 2023","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.0169999999999999,"15min":0.97299999999999998},"min":{"1min":0.82299999999999995,"5min":0.62,"15min":0.62},"max":{"1min":1.391,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":0.92700000000000005},{"interface":"front","average":{"1min":1.153,"5min":1.0680000000000001,"15min":1.046},"min":{"1min":0.78500000000000003,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.5189999999999999,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":0.996}]},{"osd":1,"last update":"Fri Oct 6 03:03:50 2023","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.222,"15min":1.212},"min":{"1min":0.89400000000000002,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":1.6879999999999999,"5min":1.984,"15min":1.984},"last":1.502},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.169,"15min":1.161},"min":{"1min":0.83999999999999997,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":2.0899999999999999,"5min":2.0899999999999999,"15min":2.0899999999999999},"last":1.306}]},{"osd":2,"last update":"Fri Oct 6 03:03:50 2023","interfaces":[{"interface":"back","average":{"1min":1.3,"5min":1.3640000000000001,"15min":1.3839999999999999},"min":{"1min":0.94799999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":1.7350000000000001,"5min":1.78,"15min":1.78},"last":1.47},{"interface":"front","average":{"1min":1.286,"5min":1.306,"15min":1.3049999999999999},"min":{"1min":1.0049999999999999,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":1.5489999999999999,"5min":2.8319999999999999,"15min":2.8319999999999999},"last":1.3520000000000001}]},{"osd":3,"last update":"Fri Oct 6 03:03:50 2023","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2589999999999999},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.589,"5min":3.1789999999999998,"15min":3.1789999999999998},"last":1.399},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.296,"15min":1.28},"min":{"1min":0.90300000000000002,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":2.2549999999999999,"5min":2.2549999999999999,"15min":2.2549999999999999},"last":1.5449999999999999}]},{"osd":4,"last update":"Fri Oct 6 03:03:50 2023","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.2370000000000001,"15min":1.28},"min":{"1min":0.81100000000000005,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.4570000000000001,"5min":2.5899999999999999,"15min":2.5899999999999999},"last":1.224},{"interface":"front","average":{"1min":1.369,"5min":1.4570000000000001,"15min":1.496},"min":{"1min":0.96899999999999997,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.764,"5min":4.5419999999999998,"15min":4.5419999999999998},"last":1.6459999999999999}]},{"osd":6,"last update":"Fri Oct 6 03:03:50 2023","interfaces":[{"interface":"back","average":{"1min":1.208,"5min":1.3380000000000001,"15min":1.3720000000000001},"min":{"1min":0.82399999999999995,"5min":0.754,"15min":0.754},"max":{"1min":1.5980000000000001,"5min":1.847,"15min":1.847},"last":1.593},{"interface":"front","average":{"1min":1.319,"5min":1.3620000000000001,"15min":1.3759999999999999},"min":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"max":{"1min":1.599,"5min":2.9239999999999999,"15min":2.9239999999999999},"last":1.4410000000000001}]},{"osd":7,"last update":"Fri Oct 6 03:03:50 2023","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.3700000000000001,"15min":1.3979999999999999},"min":{"1min":1.0169999999999999,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.8080000000000001,"5min":4.4489999999999998,"15min":4.4489999999999998},"last":1.2629999999999999},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.387,"15min":1.419},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.7130000000000001,"5min":1.98,"15min":1.98},"last":1.1719999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574888,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302052,"kb_used_data":668,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069788,"statfs":{"total":96636764160,"available":96327462912,"internally_reserved":0,"allocated":684032,"data_stored":300856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:03:51 2023","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.093,"15min":1.089},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.5509999999999999,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":1.29},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.093,"15min":1.079},"min":{"1min":0.80600000000000005,"5min":0.625,"15min":0.625},"max":{"1min":1.4359999999999999,"5min":1.585,"15min":1.585},"last":1.107}]},{"osd":1,"last update":"Fri Oct 6 03:03:51 2023","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":1.0740000000000001,"15min":1.0569999999999999},"min":{"1min":0.75600000000000001,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.3999999999999999,"5min":1.621,"15min":1.621},"last":0.98099999999999998},{"interface":"front","average":{"1min":1.133,"5min":1.1759999999999999,"15min":1.171},"min":{"1min":0.80200000000000005,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.411,"5min":1.73,"15min":1.73},"last":1.407}]},{"osd":2,"last update":"Fri Oct 6 03:03:51 2023","interfaces":[{"interface":"back","average":{"1min":1.296,"5min":1.2889999999999999,"15min":1.2849999999999999},"min":{"1min":0.95299999999999996,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.5589999999999999,"5min":1.696,"15min":1.696},"last":1.51},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.329,"15min":1.3360000000000001},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.571,"5min":1.788,"15min":1.788},"last":1.4950000000000001}]},{"osd":3,"last update":"Fri Oct 6 03:03:51 2023","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.222,"15min":1.2390000000000001},"min":{"1min":0.76500000000000001,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.407,"5min":1.706,"15min":1.706},"last":1.383},{"interface":"front","average":{"1min":1.1890000000000001,"5min":1.2370000000000001,"15min":1.2330000000000001},"min":{"1min":0.96999999999999997,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.3799999999999999,"5min":2.1960000000000002,"15min":2.1960000000000002},"last":1.444}]},{"osd":5,"last update":"Fri Oct 6 03:03:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.2110000000000001,"15min":1.202},"min":{"1min":0.86299999999999999,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.496,"5min":1.71,"15min":1.71},"last":1.1559999999999999},{"interface":"front","average":{"1min":1.206,"5min":1.302,"15min":1.343},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.4990000000000001,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":0.91500000000000004}]},{"osd":6,"last update":"Fri Oct 6 03:03:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2609999999999999,"5min":1.327,"15min":1.371},"min":{"1min":0.63500000000000001,"5min":0.629,"15min":0.629},"max":{"1min":1.7949999999999999,"5min":2.9100000000000001,"15min":2.9100000000000001},"last":1.2490000000000001},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.429,"15min":1.4610000000000001},"min":{"1min":1.0329999999999999,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.605,"5min":3.282,"15min":3.282},"last":1.026}]},{"osd":7,"last update":"Fri Oct 6 03:03:51 2023","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":1.4490000000000001,"15min":1.512},"min":{"1min":0.91900000000000004,"5min":0.88700000000000001,"15min":0.88700000000000001},"max":{"1min":1.591,"5min":2.145,"15min":2.145},"last":1.3169999999999999},{"interface":"front","average":{"1min":1.411,"5min":1.4330000000000001,"15min":1.4350000000000001},"min":{"1min":0.874,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.7350000000000001,"5min":1.927,"15min":1.927},"last":1.347}]}]},{"osd":3,"up_from":13,"seq":55834574888,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302052,"kb_used_data":668,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069788,"statfs":{"total":96636764160,"available":96327462912,"internally_reserved":0,"allocated":684032,"data_stored":302107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:03:49 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.95799999999999996,"15min":0.99399999999999999},"min":{"1min":0.67100000000000004,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.3919999999999999,"5min":2.298,"15min":2.298},"last":0.92800000000000005},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.01,"15min":1.002},"min":{"1min":0.752,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.339,"5min":2.1850000000000001,"15min":2.1850000000000001},"last":1.1990000000000001}]},{"osd":1,"last update":"Fri Oct 6 03:03:49 2023","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.97399999999999998,"15min":0.98599999999999999},"min":{"1min":0.65800000000000003,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.3480000000000001,"5min":1.974,"15min":1.974},"last":1.1659999999999999},{"interface":"front","average":{"1min":1.127,"5min":1.1240000000000001,"15min":1.1319999999999999},"min":{"1min":0.86899999999999999,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.4710000000000001,"5min":1.71,"15min":1.71},"last":1.119}]},{"osd":2,"last update":"Fri Oct 6 03:03:49 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":1.034,"15min":1.054},"min":{"1min":0.67600000000000005,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.4099999999999999,"5min":2.8849999999999998,"15min":2.8849999999999998},"last":0.81799999999999995},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.0860000000000001,"15min":1.0920000000000001},"min":{"1min":0.84199999999999997,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.5780000000000001,"5min":2.8220000000000001,"15min":2.8220000000000001},"last":1.452}]},{"osd":4,"last update":"Fri Oct 6 03:03:49 2023","interfaces":[{"interface":"back","average":{"1min":1.2849999999999999,"5min":1.393,"15min":1.4350000000000001},"min":{"1min":0.95299999999999996,"5min":0.751,"15min":0.751},"max":{"1min":1.7130000000000001,"5min":3.6560000000000001,"15min":3.6560000000000001},"last":1.518},{"interface":"front","average":{"1min":1.335,"5min":1.401,"15min":1.444},"min":{"1min":1.0820000000000001,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.796,"5min":3.7749999999999999,"15min":3.7749999999999999},"last":1.349}]},{"osd":5,"last update":"Fri Oct 6 03:03:49 2023","interfaces":[{"interface":"back","average":{"1min":1.4119999999999999,"5min":1.478,"15min":1.5149999999999999},"min":{"1min":1.1679999999999999,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":1.8460000000000001,"5min":3.4910000000000001,"15min":3.4910000000000001},"last":0.97999999999999998},{"interface":"front","average":{"1min":1.377,"5min":1.4370000000000001,"15min":1.4750000000000001},"min":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"max":{"1min":1.6519999999999999,"5min":2.6240000000000001,"15min":2.6240000000000001},"last":1.3819999999999999}]},{"osd":6,"last update":"Fri Oct 6 03:03:49 2023","interfaces":[{"interface":"back","average":{"1min":1.359,"5min":1.4870000000000001,"15min":1.5469999999999999},"min":{"1min":1.0349999999999999,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":1.7549999999999999,"5min":3.7050000000000001,"15min":3.7050000000000001},"last":1.4219999999999999},{"interface":"front","average":{"1min":1.3540000000000001,"5min":1.4990000000000001,"15min":1.5549999999999999},"min":{"1min":0.97699999999999998,"5min":0.80900000000000005,"15min":0.80900000000000005},"max":{"1min":1.901,"5min":3.9300000000000002,"15min":3.9300000000000002},"last":1.575}]},{"osd":7,"last update":"Fri Oct 6 03:03:49 2023","interfaces":[{"interface":"back","average":{"1min":1.4299999999999999,"5min":1.5449999999999999,"15min":1.605},"min":{"1min":1.073,"5min":1.0369999999999999,"15min":1.0369999999999999},"max":{"1min":1.9330000000000001,"5min":2.96,"15min":2.96},"last":1.4890000000000001},{"interface":"front","average":{"1min":1.4950000000000001,"5min":1.6579999999999999,"15min":1.734},"min":{"1min":1.1419999999999999,"5min":0.90600000000000003,"15min":0.90600000000000003},"max":{"1min":1.9810000000000001,"5min":3.8559999999999999,"15min":3.8559999999999999},"last":1.6080000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574888,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302060,"kb_used_data":676,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069780,"statfs":{"total":96636764160,"available":96327454720,"internally_reserved":0,"allocated":692224,"data_stored":308651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:03:50 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.86099999999999999,"15min":0.86799999999999999},"min":{"1min":0.54500000000000004,"5min":0.496,"15min":0.496},"max":{"1min":1.2290000000000001,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.91700000000000004,"15min":0.93799999999999994},"min":{"1min":0.61799999999999999,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.3340000000000001,"5min":1.502,"15min":1.502},"last":0.94399999999999995}]},{"osd":1,"last update":"Fri Oct 6 03:03:50 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.075,"15min":1.087},"min":{"1min":0.64700000000000002,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":1.4079999999999999},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.1899999999999999,"15min":1.218},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.484,"5min":2.1800000000000002,"15min":2.1800000000000002},"last":1.3680000000000001}]},{"osd":3,"last update":"Fri Oct 6 03:03:50 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.94599999999999995,"15min":0.96199999999999997},"min":{"1min":0.63100000000000001,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.2430000000000001,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":1.125,"5min":1.147,"15min":1.1719999999999999},"min":{"1min":0.73699999999999999,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.5289999999999999,"5min":2.806,"15min":2.806},"last":0.89600000000000002}]},{"osd":4,"last update":"Fri Oct 6 03:03:50 2023","interfaces":[{"interface":"back","average":{"1min":1.266,"5min":1.339,"15min":1.3720000000000001},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.7090000000000001,"5min":2.1739999999999999,"15min":2.1739999999999999},"last":1.6120000000000001},{"interface":"front","average":{"1min":1.242,"5min":1.3779999999999999,"15min":1.431},"min":{"1min":0.996,"5min":0.83699999999999997,"15min":0.83699999999999997},"max":{"1min":1.5429999999999999,"5min":3.028,"15min":3.028},"last":1.4419999999999999}]},{"osd":5,"last update":"Fri Oct 6 03:03:50 2023","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.4650000000000001,"15min":1.5209999999999999},"min":{"1min":1.1000000000000001,"5min":0.90100000000000002,"15min":0.90100000000000002},"max":{"1min":1.5469999999999999,"5min":3.1499999999999999,"15min":3.1499999999999999},"last":1.2230000000000001},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.4259999999999999,"15min":1.4830000000000001},"min":{"1min":0.95599999999999996,"5min":0.85899999999999999,"15min":0.85899999999999999},"max":{"1min":1.704,"5min":2.8580000000000001,"15min":2.8580000000000001},"last":1.5800000000000001}]},{"osd":6,"last update":"Fri Oct 6 03:03:50 2023","interfaces":[{"interface":"back","average":{"1min":1.2789999999999999,"5min":1.397,"15min":1.45},"min":{"1min":0.91900000000000004,"5min":0.86299999999999999,"15min":0.86299999999999999},"max":{"1min":1.829,"5min":2.6659999999999999,"15min":2.6659999999999999},"last":1.526},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.4490000000000001,"15min":1.4970000000000001},"min":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"max":{"1min":1.6759999999999999,"5min":2.411,"15min":2.411},"last":1.2729999999999999}]},{"osd":7,"last update":"Fri Oct 6 03:03:50 2023","interfaces":[{"interface":"back","average":{"1min":1.3759999999999999,"5min":1.544,"15min":1.6040000000000001},"min":{"1min":1.0880000000000001,"5min":1.01,"15min":1.01},"max":{"1min":1.579,"5min":3.2160000000000002,"15min":3.2160000000000002},"last":1.502},{"interface":"front","average":{"1min":1.3979999999999999,"5min":1.5369999999999999,"15min":1.599},"min":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"max":{"1min":1.8879999999999999,"5min":3.1059999999999999,"15min":3.1059999999999999},"last":1.46}]}]},{"osd":1,"up_from":13,"seq":55834574889,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302044,"kb_used_data":660,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069796,"statfs":{"total":96636764160,"available":96327471104,"internally_reserved":0,"allocated":675840,"data_stored":293896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:03:48 2023","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":0.93700000000000006,"15min":0.94899999999999995},"min":{"1min":0.57799999999999996,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.3759999999999999,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":0.81200000000000006},{"interface":"front","average":{"1min":1.113,"5min":1.0860000000000001,"15min":1.091},"min":{"1min":0.71499999999999997,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.4690000000000001,"5min":2.3260000000000001,"15min":2.3260000000000001},"last":0.61199999999999999}]},{"osd":2,"last update":"Fri Oct 6 03:03:48 2023","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.98099999999999998,"15min":0.995},"min":{"1min":0.77500000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.27,"5min":3.5459999999999998,"15min":3.5459999999999998},"last":0.57399999999999995},{"interface":"front","average":{"1min":1.165,"5min":1.042,"15min":1.03},"min":{"1min":0.76400000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.5820000000000001,"5min":1.706,"15min":1.706},"last":0.90200000000000002}]},{"osd":3,"last update":"Fri Oct 6 03:03:48 2023","interfaces":[{"interface":"back","average":{"1min":1.218,"5min":1.1539999999999999,"15min":1.1459999999999999},"min":{"1min":0.71299999999999997,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.5760000000000001,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":0.68600000000000005},{"interface":"front","average":{"1min":1.151,"5min":1.167,"15min":1.1859999999999999},"min":{"1min":0.93300000000000005,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.4730000000000001,"5min":3.331,"15min":3.331},"last":0.76800000000000002}]},{"osd":4,"last update":"Fri Oct 6 03:03:48 2023","interfaces":[{"interface":"back","average":{"1min":1.3080000000000001,"5min":1.3089999999999999,"15min":1.329},"min":{"1min":1.048,"5min":0.85899999999999999,"15min":0.85899999999999999},"max":{"1min":1.5640000000000001,"5min":2.0169999999999999,"15min":2.0169999999999999},"last":1.127},{"interface":"front","average":{"1min":1.238,"5min":1.298,"15min":1.3180000000000001},"min":{"1min":0.90900000000000003,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.639,"5min":3.2250000000000001,"15min":3.2250000000000001},"last":1.024}]},{"osd":5,"last update":"Fri Oct 6 03:03:48 2023","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":1.389,"15min":1.421},"min":{"1min":0.96599999999999997,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":1.704,"5min":2.8439999999999999,"15min":2.8439999999999999},"last":0.97599999999999998},{"interface":"front","average":{"1min":1.4470000000000001,"5min":1.4510000000000001,"15min":1.4730000000000001},"min":{"1min":1.0980000000000001,"5min":0.89800000000000002,"15min":0.89800000000000002},"max":{"1min":1.7390000000000001,"5min":2.4590000000000001,"15min":2.4590000000000001},"last":0.995}]},{"osd":6,"last update":"Fri Oct 6 03:03:48 2023","interfaces":[{"interface":"back","average":{"1min":1.3500000000000001,"5min":1.427,"15min":1.4530000000000001},"min":{"1min":0.89400000000000002,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.76,"5min":2.96,"15min":2.96},"last":1.0700000000000001},{"interface":"front","average":{"1min":1.472,"5min":1.474,"15min":1.494},"min":{"1min":1.0149999999999999,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.8080000000000001,"5min":2.5859999999999999,"15min":2.5859999999999999},"last":0.94999999999999996}]},{"osd":7,"last update":"Fri Oct 6 03:03:48 2023","interfaces":[{"interface":"back","average":{"1min":1.415,"5min":1.512,"15min":1.573},"min":{"1min":1.1459999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":2.1299999999999999,"5min":3.4460000000000002,"15min":3.4460000000000002},"last":0.92900000000000005},{"interface":"front","average":{"1min":1.458,"5min":1.5,"15min":1.5249999999999999},"min":{"1min":1.212,"5min":0.94099999999999995,"15min":0.94099999999999995},"max":{"1min":1.734,"5min":3.113,"15min":3.113},"last":1.111}]}]},{"osd":0,"up_from":13,"seq":55834574888,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302620,"kb_used_data":1236,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069220,"statfs":{"total":96636764160,"available":96326881280,"internally_reserved":0,"allocated":1265664,"data_stored":884153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 03:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.85099999999999998,"15min":0.82399999999999995},"min":{"1min":0.66700000000000004,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.2490000000000001,"5min":1.583,"15min":1.583},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.97799999999999998,"15min":0.99199999999999999},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.571,"5min":1.571,"15min":1.571},"last":0.74199999999999999}]},{"osd":2,"last update":"Fri Oct 6 03:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.98599999999999999,"15min":0.98399999999999999},"min":{"1min":0.71799999999999997,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.3220000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":1.093},{"interface":"front","average":{"1min":0.998,"5min":1.089,"15min":1.1120000000000001},"min":{"1min":0.76100000000000001,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.2949999999999999,"5min":1.794,"15min":1.794},"last":1.139}]},{"osd":3,"last update":"Fri Oct 6 03:03:46 2023","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":1.0349999999999999,"15min":1.018},"min":{"1min":0.70799999999999996,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.554,"5min":1.554,"15min":1.554},"last":0.63600000000000001},{"interface":"front","average":{"1min":1.298,"5min":1.226,"15min":1.2030000000000001},"min":{"1min":1.004,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.569,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.90000000000000002}]},{"osd":4,"last update":"Fri Oct 6 03:03:46 2023","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.244,"15min":1.2310000000000001},"min":{"1min":0.88400000000000001,"5min":0.86699999999999999,"15min":0.86699999999999999},"max":{"1min":1.5669999999999999,"5min":2.0680000000000001,"15min":2.0680000000000001},"last":0.99199999999999999},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.3300000000000001,"15min":1.3360000000000001},"min":{"1min":1.0409999999999999,"5min":0.93400000000000005,"15min":0.93400000000000005},"max":{"1min":1.5800000000000001,"5min":1.647,"15min":1.647},"last":1.415}]},{"osd":5,"last update":"Fri Oct 6 03:03:46 2023","interfaces":[{"interface":"back","average":{"1min":1.256,"5min":1.379,"15min":1.4019999999999999},"min":{"1min":0.92500000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":1.728,"5min":1.8959999999999999,"15min":1.8959999999999999},"last":1.4890000000000001},{"interface":"front","average":{"1min":1.359,"5min":1.2909999999999999,"15min":1.2729999999999999},"min":{"1min":1.0449999999999999,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":1.6160000000000001,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":1.1930000000000001}]},{"osd":6,"last update":"Fri Oct 6 03:03:46 2023","interfaces":[{"interface":"back","average":{"1min":1.373,"5min":1.4199999999999999,"15min":1.4199999999999999},"min":{"1min":1.1459999999999999,"5min":0.89400000000000002,"15min":0.89400000000000002},"max":{"1min":1.7090000000000001,"5min":1.96,"15min":1.96},"last":1.53},{"interface":"front","average":{"1min":1.389,"5min":1.4930000000000001,"15min":1.532},"min":{"1min":1.117,"5min":0.89800000000000002,"15min":0.89800000000000002},"max":{"1min":1.859,"5min":2.0539999999999998,"15min":2.0539999999999998},"last":1.5780000000000001}]},{"osd":7,"last update":"Fri Oct 6 03:03:46 2023","interfaces":[{"interface":"back","average":{"1min":1.4039999999999999,"5min":1.5569999999999999,"15min":1.607},"min":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"max":{"1min":1.7989999999999999,"5min":2.1019999999999999,"15min":2.1019999999999999},"last":1.375},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.413,"15min":1.425},"min":{"1min":1.091,"5min":0.875,"15min":0.875},"max":{"1min":1.681,"5min":2.1499999999999999,"15min":2.1499999999999999},"last":1.452}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:03:59.855 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:04:00.021 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.016+0000 7fec87416700 1 Processor -- start 2023-10-06T03:04:00.021 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.016+0000 7fec87416700 1 -- start start 2023-10-06T03:04:00.023 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.020+0000 7fec87416700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fec80158dc0 0x7fec800cc660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:00.024 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.020+0000 7fec87416700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec8006b020 con 0x7fec8006b4b0 2023-10-06T03:04:00.024 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.020+0000 7fec87416700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec8006a6f0 con 0x7fec80159190 2023-10-06T03:04:00.024 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.020+0000 7fec87416700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec8006a9d0 con 0x7fec80158dc0 2023-10-06T03:04:00.024 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.020+0000 7fec85c13700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fec8006b4b0 0x7fec8015ccb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:54318/0 (socket says 172.21.15.57:54318) 2023-10-06T03:04:00.024 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.020+0000 7fec85c13700 1 -- 172.21.15.57:0/692717159 learned_addr learned my addr 172.21.15.57:0/692717159 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:04:00.024 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.020+0000 7fec86414700 1 --2- 172.21.15.57:0/692717159 >> v2:172.21.15.57:3300/0 conn(0x7fec80158dc0 0x7fec800cc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:00.026 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.020+0000 7fec85412700 1 -- 172.21.15.57:0/692717159 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1461746862 0 0) 0x7fec8006b020 con 0x7fec8006b4b0 2023-10-06T03:04:00.026 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.020+0000 7fec85412700 1 -- 172.21.15.57:0/692717159 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec6c003570 con 0x7fec8006b4b0 2023-10-06T03:04:00.026 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.020+0000 7fec86414700 1 -- 172.21.15.57:0/692717159 >> v1:172.21.15.105:6789/0 conn(0x7fec80159190 legacy=0x7fec800ca4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:00.026 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.020+0000 7fec86414700 1 -- 172.21.15.57:0/692717159 >> v1:172.21.15.57:6789/0 conn(0x7fec8006b4b0 legacy=0x7fec8015ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:00.026 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.020+0000 7fec85412700 1 -- 172.21.15.57:0/692717159 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2577586044 0 0) 0x7fec6c003570 con 0x7fec8006b4b0 2023-10-06T03:04:00.026 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.020+0000 7fec86414700 1 -- 172.21.15.57:0/692717159 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec8006acb0 con 0x7fec80158dc0 2023-10-06T03:04:00.026 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.020+0000 7fec86414700 1 --2- 172.21.15.57:0/692717159 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fec80158dc0 0x7fec800cc660 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fec7c009e60 tx=0x7fec7c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=428471480041e1a4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:00.026 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.020+0000 7fec85412700 1 -- 172.21.15.57:0/692717159 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec7c00e070 con 0x7fec80158dc0 2023-10-06T03:04:00.027 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.020+0000 7fec85412700 1 -- 172.21.15.57:0/692717159 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec7c00b850 con 0x7fec80158dc0 2023-10-06T03:04:00.027 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.020+0000 7fec85412700 1 -- 172.21.15.57:0/692717159 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec70001470 con 0x7fec80158dc0 2023-10-06T03:04:00.027 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.024+0000 7fec87416700 1 -- 172.21.15.57:0/692717159 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fec80158dc0 msgr2=0x7fec800cc660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:00.028 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.024+0000 7fec87416700 1 --2- 172.21.15.57:0/692717159 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fec80158dc0 0x7fec800cc660 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fec7c009e60 tx=0x7fec7c009780 comp rx=0 tx=0).stop 2023-10-06T03:04:00.028 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.024+0000 7fec87416700 1 -- 172.21.15.57:0/692717159 shutdown_connections 2023-10-06T03:04:00.028 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.024+0000 7fec87416700 1 --2- 172.21.15.57:0/692717159 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fec80158dc0 0x7fec800cc660 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:00.028 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.024+0000 7fec87416700 1 -- 172.21.15.57:0/692717159 >> 172.21.15.57:0/692717159 conn(0x7fec80067050 msgr2=0x7fec80067450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:00.028 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.024+0000 7fec87416700 1 -- 172.21.15.57:0/692717159 shutdown_connections 2023-10-06T03:04:00.028 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.024+0000 7fec87416700 1 -- 172.21.15.57:0/692717159 wait complete. 2023-10-06T03:04:00.030 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.024+0000 7fec87416700 1 Processor -- start 2023-10-06T03:04:00.030 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.024+0000 7fec87416700 1 -- start start 2023-10-06T03:04:00.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.028+0000 7fec87416700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fec8006b4b0 0x7fec80157270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:00.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.028+0000 7fec87416700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fec80158dc0 0x7fec800c9490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:00.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.028+0000 7fec87416700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fec80159190 0x7fec800c99d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:00.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.028+0000 7fec87416700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec800c7e80 con 0x7fec80159190 2023-10-06T03:04:00.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.028+0000 7fec87416700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec800c8160 con 0x7fec80158dc0 2023-10-06T03:04:00.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.028+0000 7fec87416700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec800c8440 con 0x7fec8006b4b0 2023-10-06T03:04:00.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.028+0000 7fec86c15700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fec80159190 0x7fec800c99d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:00.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.028+0000 7fec86c15700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fec80159190 0x7fec800c99d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:52212/0 (socket says 172.21.15.57:52212) 2023-10-06T03:04:00.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.028+0000 7fec86c15700 1 -- 172.21.15.57:0/1824087860 learned_addr learned my addr 172.21.15.57:0/1824087860 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:04:00.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.028+0000 7fec86414700 1 --2- 172.21.15.57:0/1824087860 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fec8006b4b0 0x7fec80157270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:00.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.028+0000 7fec85c13700 1 --2- 172.21.15.57:0/1824087860 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fec80158dc0 0x7fec800c9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:00.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.028+0000 7fec86c15700 1 -- 172.21.15.57:0/1824087860 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fec8006b4b0 msgr2=0x7fec80157270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:00.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.028+0000 7fec86c15700 1 --2- 172.21.15.57:0/1824087860 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fec8006b4b0 0x7fec80157270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:00.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.028+0000 7fec86c15700 1 -- 172.21.15.57:0/1824087860 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fec80158dc0 msgr2=0x7fec800c9490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:00.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.028+0000 7fec86c15700 1 --2- 172.21.15.57:0/1824087860 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fec80158dc0 0x7fec800c9490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:00.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.028+0000 7fec86c15700 1 -- 172.21.15.57:0/1824087860 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec7c009a20 con 0x7fec80159190 2023-10-06T03:04:00.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.028+0000 7fec86c15700 1 --2- 172.21.15.57:0/1824087860 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fec80159190 0x7fec800c99d0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fec7800c4c0 tx=0x7fec78007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:00.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.028+0000 7fec767fc700 1 -- 172.21.15.57:0/1824087860 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec78011590 con 0x7fec80159190 2023-10-06T03:04:00.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.028+0000 7fec767fc700 1 -- 172.21.15.57:0/1824087860 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec78011710 con 0x7fec80159190 2023-10-06T03:04:00.038 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.028+0000 7fec767fc700 1 -- 172.21.15.57:0/1824087860 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec78011ad0 con 0x7fec80159190 2023-10-06T03:04:00.038 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.028+0000 7fec87416700 1 -- 172.21.15.57:0/1824087860 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec800c8720 con 0x7fec80159190 2023-10-06T03:04:00.038 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.028+0000 7fec87416700 1 -- 172.21.15.57:0/1824087860 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec800c7110 con 0x7fec80159190 2023-10-06T03:04:00.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.032+0000 7fec87416700 1 -- 172.21.15.57:0/1824087860 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec8004be40 con 0x7fec80159190 2023-10-06T03:04:00.040 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.032+0000 7fec767fc700 1 -- 172.21.15.57:0/1824087860 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fec7801b3b0 con 0x7fec80159190 2023-10-06T03:04:00.040 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.036+0000 7fec767fc700 1 --2- 172.21.15.57:0/1824087860 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fec64060550 0x7fec64062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:00.040 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.036+0000 7fec767fc700 1 -- 172.21.15.57:0/1824087860 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5378+0+0 (secure 0 0 0) 0x7fec7807ba90 con 0x7fec80159190 2023-10-06T03:04:00.040 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.036+0000 7fec86414700 1 --2- 172.21.15.57:0/1824087860 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fec64060550 0x7fec64062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:00.041 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.036+0000 7fec86414700 1 --2- 172.21.15.57:0/1824087860 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fec64060550 0x7fec64062a00 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fec7c0099f0 tx=0x7fec7c017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:00.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.040+0000 7fec767fc700 1 -- 172.21.15.57:0/1824087860 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fec7804c120 con 0x7fec80159190 2023-10-06T03:04:00.212 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.208+0000 7fec87416700 1 -- 172.21.15.57:0/1824087860 --> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fec8015da20 con 0x7fec64060550 2023-10-06T03:04:00.215 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.212+0000 7fec767fc700 1 -- 172.21.15.57:0/1824087860 <== mgr.4103 v2:172.21.15.57:6832/32947 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+70179 (secure 0 0 0) 0x7fec8015da20 con 0x7fec64060550 2023-10-06T03:04:00.216 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:04:00.221 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.216+0000 7fec87416700 1 -- 172.21.15.57:0/1824087860 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fec64060550 msgr2=0x7fec64062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:00.222 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.216+0000 7fec87416700 1 --2- 172.21.15.57:0/1824087860 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fec64060550 0x7fec64062a00 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fec7c0099f0 tx=0x7fec7c017000 comp rx=0 tx=0).stop 2023-10-06T03:04:00.222 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.216+0000 7fec87416700 1 -- 172.21.15.57:0/1824087860 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fec80159190 msgr2=0x7fec800c99d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:00.222 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.216+0000 7fec87416700 1 --2- 172.21.15.57:0/1824087860 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fec80159190 0x7fec800c99d0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fec7800c4c0 tx=0x7fec78007f50 comp rx=0 tx=0).stop 2023-10-06T03:04:00.222 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.216+0000 7fec87416700 1 -- 172.21.15.57:0/1824087860 shutdown_connections 2023-10-06T03:04:00.222 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.216+0000 7fec87416700 1 --2- 172.21.15.57:0/1824087860 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fec80159190 0x7fec800c99d0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:00.222 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.216+0000 7fec87416700 1 --2- 172.21.15.57:0/1824087860 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fec80158dc0 0x7fec800c9490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:00.222 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.216+0000 7fec87416700 1 --2- 172.21.15.57:0/1824087860 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fec64060550 0x7fec64062a00 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:00.222 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.216+0000 7fec87416700 1 --2- 172.21.15.57:0/1824087860 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fec8006b4b0 0x7fec80157270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:00.222 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.216+0000 7fec87416700 1 -- 172.21.15.57:0/1824087860 >> 172.21.15.57:0/1824087860 conn(0x7fec80067050 msgr2=0x7fec800b1530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:00.223 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.216+0000 7fec87416700 1 -- 172.21.15.57:0/1824087860 shutdown_connections 2023-10-06T03:04:00.223 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.216+0000 7fec87416700 1 -- 172.21.15.57:0/1824087860 wait complete. 2023-10-06T03:04:00.223 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2023-10-06T03:04:00.240 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":149,"stamp":"2023-10-06T03:03:58.334772+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2409328,"kb_used_data":6448,"kb_used_omap":0,"kb_used_meta":2402816,"kb_avail":752565392,"statfs":{"total":773094113280,"available":770626961408,"internally_reserved":0,"allocated":6602752,"data_stored":3561966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2460483584},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-9133,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-49,"num_read_kb":-52,"num_write":-75,"num_write_kb":-34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002181"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":190,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T03:03:37.839944+0000","last_change":"2023-10-06T03:00:45.709165+0000","last_active":"2023-10-06T03:03:37.839944+0000","last_peered":"2023-10-06T03:03:37.839944+0000","last_clean":"2023-10-06T03:03:37.839944+0000","last_became_active":"2023-10-06T03:00:45.707771+0000","last_became_peered":"2023-10-06T03:00:45.707771+0000","last_unstale":"2023-10-06T03:03:37.839944+0000","last_undegraded":"2023-10-06T03:03:37.839944+0000","last_fullsized":"2023-10-06T03:03:37.839944+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:44.625353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:44.625353+0000","last_clean_scrub_stamp":"2023-10-06T03:00:44.625353+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:31:31.774239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":39,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:03:39.439309+0000","last_change":"2023-10-06T03:00:51.905381+0000","last_active":"2023-10-06T03:03:39.439309+0000","last_peered":"2023-10-06T03:03:39.439309+0000","last_clean":"2023-10-06T03:03:39.439309+0000","last_became_active":"2023-10-06T03:00:51.904974+0000","last_became_peered":"2023-10-06T03:00:51.904974+0000","last_unstale":"2023-10-06T03:03:39.439309+0000","last_undegraded":"2023-10-06T03:03:39.439309+0000","last_fullsized":"2023-10-06T03:03:39.439309+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:15:19.182956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":37,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T03:03:37.839781+0000","last_change":"2023-10-06T03:00:51.906480+0000","last_active":"2023-10-06T03:03:37.839781+0000","last_peered":"2023-10-06T03:03:37.839781+0000","last_clean":"2023-10-06T03:03:37.839781+0000","last_became_active":"2023-10-06T03:00:51.905956+0000","last_became_peered":"2023-10-06T03:00:51.905956+0000","last_unstale":"2023-10-06T03:03:37.839781+0000","last_undegraded":"2023-10-06T03:03:37.839781+0000","last_fullsized":"2023-10-06T03:03:37.839781+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:15:19.182956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":39,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:03:38.847307+0000","last_change":"2023-10-06T03:00:51.902453+0000","last_active":"2023-10-06T03:03:38.847307+0000","last_peered":"2023-10-06T03:03:38.847307+0000","last_clean":"2023-10-06T03:03:38.847307+0000","last_became_active":"2023-10-06T03:00:51.901948+0000","last_became_peered":"2023-10-06T03:00:51.901948+0000","last_unstale":"2023-10-06T03:03:38.847307+0000","last_undegraded":"2023-10-06T03:03:38.847307+0000","last_fullsized":"2023-10-06T03:03:38.847307+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:13:30.721650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":39,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:03:39.439120+0000","last_change":"2023-10-06T03:00:51.904148+0000","last_active":"2023-10-06T03:03:39.439120+0000","last_peered":"2023-10-06T03:03:39.439120+0000","last_clean":"2023-10-06T03:03:39.439120+0000","last_became_active":"2023-10-06T03:00:51.903729+0000","last_became_peered":"2023-10-06T03:00:51.903729+0000","last_unstale":"2023-10-06T03:03:39.439120+0000","last_undegraded":"2023-10-06T03:03:39.439120+0000","last_fullsized":"2023-10-06T03:03:39.439120+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:17:25.070478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":37,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:03:39.353694+0000","last_change":"2023-10-06T03:00:52.484317+0000","last_active":"2023-10-06T03:03:39.353694+0000","last_peered":"2023-10-06T03:03:39.353694+0000","last_clean":"2023-10-06T03:03:39.353694+0000","last_became_active":"2023-10-06T03:00:52.483818+0000","last_became_peered":"2023-10-06T03:00:52.483818+0000","last_unstale":"2023-10-06T03:03:39.353694+0000","last_undegraded":"2023-10-06T03:03:39.353694+0000","last_fullsized":"2023-10-06T03:03:39.353694+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:17:24.136459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":37,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T03:03:37.840551+0000","last_change":"2023-10-06T03:00:52.485186+0000","last_active":"2023-10-06T03:03:37.840551+0000","last_peered":"2023-10-06T03:03:37.840551+0000","last_clean":"2023-10-06T03:03:37.840551+0000","last_became_active":"2023-10-06T03:00:52.484615+0000","last_became_peered":"2023-10-06T03:00:52.484615+0000","last_unstale":"2023-10-06T03:03:37.840551+0000","last_undegraded":"2023-10-06T03:03:37.840551+0000","last_fullsized":"2023-10-06T03:03:37.840551+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:17:25.070478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":37,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:03:39.353730+0000","last_change":"2023-10-06T03:00:51.903388+0000","last_active":"2023-10-06T03:03:39.353730+0000","last_peered":"2023-10-06T03:03:39.353730+0000","last_clean":"2023-10-06T03:03:39.353730+0000","last_became_active":"2023-10-06T03:00:51.902959+0000","last_became_peered":"2023-10-06T03:00:51.902959+0000","last_unstale":"2023-10-06T03:03:39.353730+0000","last_undegraded":"2023-10-06T03:03:39.353730+0000","last_fullsized":"2023-10-06T03:03:39.353730+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:30:16.907470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":36,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T03:03:37.846139+0000","last_change":"2023-10-06T03:00:51.903242+0000","last_active":"2023-10-06T03:03:37.846139+0000","last_peered":"2023-10-06T03:03:37.846139+0000","last_clean":"2023-10-06T03:03:37.846139+0000","last_became_active":"2023-10-06T03:00:51.902929+0000","last_became_peered":"2023-10-06T03:00:51.902929+0000","last_unstale":"2023-10-06T03:03:37.846139+0000","last_undegraded":"2023-10-06T03:03:37.846139+0000","last_fullsized":"2023-10-06T03:03:37.846139+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:34:12.274158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574889,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302620,"kb_used_data":1236,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069220,"statfs":{"total":96636764160,"available":96326881280,"internally_reserved":0,"allocated":1265664,"data_stored":884221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:03:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.2270000000000001,"15min":1.3009999999999999},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.415,"5min":4.7930000000000001,"15min":4.7930000000000001},"last":0.74199999999999999},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.4099999999999999,"15min":1.522},"min":{"1min":0.86399999999999999,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.476,"5min":9.9689999999999994,"15min":9.9689999999999994},"last":0.80000000000000004}]},{"osd":1,"last update":"Fri Oct 6 03:03:45 2023","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.3680000000000001,"15min":1.4710000000000001},"min":{"1min":0.95799999999999996,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.454,"5min":10.867000000000001,"15min":10.867000000000001},"last":0.95199999999999996},{"interface":"front","average":{"1min":1.3049999999999999,"5min":1.5169999999999999,"15min":1.6240000000000001},"min":{"1min":0.89100000000000001,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":1.599,"5min":10.255000000000001,"15min":10.255000000000001},"last":1.1459999999999999}]},{"osd":2,"last update":"Fri Oct 6 03:03:45 2023","interfaces":[{"interface":"back","average":{"1min":1.3300000000000001,"5min":1.5149999999999999,"15min":1.625},"min":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"max":{"1min":1.6830000000000001,"5min":7.9939999999999998,"15min":7.9939999999999998},"last":1.2490000000000001},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.552,"15min":1.6479999999999999},"min":{"1min":1.133,"5min":0.84899999999999998,"15min":0.84899999999999998},"max":{"1min":1.673,"5min":10.098000000000001,"15min":10.098000000000001},"last":1.089}]},{"osd":3,"last update":"Fri Oct 6 03:03:45 2023","interfaces":[{"interface":"back","average":{"1min":1.4099999999999999,"5min":1.4419999999999999,"15min":1.49},"min":{"1min":1.018,"5min":0.754,"15min":0.754},"max":{"1min":2.069,"5min":4.3090000000000002,"15min":4.3090000000000002},"last":1.3560000000000001},{"interface":"front","average":{"1min":1.4179999999999999,"5min":1.542,"15min":1.6080000000000001},"min":{"1min":1.1160000000000001,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":1.7589999999999999,"5min":8.3770000000000007,"15min":8.3770000000000007},"last":0.85099999999999998}]},{"osd":4,"last update":"Fri Oct 6 03:03:45 2023","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":1.5389999999999999,"15min":1.7050000000000001},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.8460000000000001,"5min":11.391999999999999,"15min":11.391999999999999},"last":1.2110000000000001},{"interface":"front","average":{"1min":1.268,"5min":1.399,"15min":1.456},"min":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"max":{"1min":1.857,"5min":3.9220000000000002,"15min":3.9220000000000002},"last":1.4450000000000001}]},{"osd":5,"last update":"Fri Oct 6 03:03:45 2023","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.581,"15min":1.724},"min":{"1min":0.91200000000000003,"5min":0.89400000000000002,"15min":0.89400000000000002},"max":{"1min":2.004,"5min":11.951000000000001,"15min":11.951000000000001},"last":1.179},{"interface":"front","average":{"1min":1.359,"5min":1.6890000000000001,"15min":1.847},"min":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"max":{"1min":1.764,"5min":10.994999999999999,"15min":10.994999999999999},"last":1.385}]},{"osd":6,"last update":"Fri Oct 6 03:03:45 2023","interfaces":[{"interface":"back","average":{"1min":1.5009999999999999,"5min":1.7729999999999999,"15min":1.917},"min":{"1min":1.143,"5min":0.91300000000000003,"15min":0.91300000000000003},"max":{"1min":1.9510000000000001,"5min":11.513,"15min":11.513},"last":1.474},{"interface":"front","average":{"1min":1.448,"5min":1.7290000000000001,"15min":1.881},"min":{"1min":1.024,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":2.1819999999999999,"5min":10.714,"15min":10.714},"last":1.4990000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574889,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297944,"kb_used_data":656,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073896,"statfs":{"total":96636764160,"available":96331669504,"internally_reserved":0,"allocated":671744,"data_stored":294353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:03:45 2023","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.1890000000000001,"15min":1.1930000000000001},"min":{"1min":0.78400000000000003,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.704,"5min":1.704,"15min":1.704},"last":1.1359999999999999},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.345,"15min":1.361},"min":{"1min":1.0449999999999999,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.7270000000000001,"5min":2.1419999999999999,"15min":2.1419999999999999},"last":1.27}]},{"osd":1,"last update":"Fri Oct 6 03:03:45 2023","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.2829999999999999,"15min":1.3049999999999999},"min":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.671,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":1.252},{"interface":"front","average":{"1min":1.2669999999999999,"5min":1.2509999999999999,"15min":1.254},"min":{"1min":0.90400000000000003,"5min":0.746,"15min":0.746},"max":{"1min":1.756,"5min":1.774,"15min":1.774},"last":1.3420000000000001}]},{"osd":2,"last update":"Fri Oct 6 03:03:45 2023","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.169,"15min":1.167},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.8220000000000001,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":1.538},{"interface":"front","average":{"1min":1.198,"5min":1.2150000000000001,"15min":1.2290000000000001},"min":{"1min":0.93999999999999995,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.595,"5min":1.78,"15min":1.78},"last":1.0289999999999999}]},{"osd":3,"last update":"Fri Oct 6 03:03:45 2023","interfaces":[{"interface":"back","average":{"1min":1.2749999999999999,"5min":1.274,"15min":1.28},"min":{"1min":1.004,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.488,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":1.167},{"interface":"front","average":{"1min":1.3580000000000001,"5min":1.3220000000000001,"15min":1.3360000000000001},"min":{"1min":1.111,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.5700000000000001,"5min":2.2200000000000002,"15min":2.2200000000000002},"last":1.4750000000000001}]},{"osd":4,"last update":"Fri Oct 6 03:03:45 2023","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":1.248,"15min":1.2729999999999999},"min":{"1min":0.77700000000000002,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.5840000000000001,"5min":2.0960000000000001,"15min":2.0960000000000001},"last":1.23},{"interface":"front","average":{"1min":1.175,"5min":1.3500000000000001,"15min":1.399},"min":{"1min":0.89200000000000002,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.4370000000000001,"5min":2.2610000000000001,"15min":2.2610000000000001},"last":1.383}]},{"osd":5,"last update":"Fri Oct 6 03:03:45 2023","interfaces":[{"interface":"back","average":{"1min":1.306,"5min":1.333,"15min":1.359},"min":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":1.7829999999999999,"5min":1.994,"15min":1.994},"last":1.4179999999999999},{"interface":"front","average":{"1min":1.294,"5min":1.3380000000000001,"15min":1.3720000000000001},"min":{"1min":0.89200000000000002,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.609,"5min":2.0129999999999999,"15min":2.0129999999999999},"last":1.4450000000000001}]},{"osd":7,"last update":"Fri Oct 6 03:03:45 2023","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.425,"15min":1.4590000000000001},"min":{"1min":1.085,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.661,"5min":2.0920000000000001,"15min":2.0920000000000001},"last":1.587},{"interface":"front","average":{"1min":1.448,"5min":1.492,"15min":1.528},"min":{"1min":0.93100000000000005,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":1.8720000000000001,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":1.3260000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574889,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297936,"kb_used_data":648,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073904,"statfs":{"total":96636764160,"available":96331677696,"internally_reserved":0,"allocated":663552,"data_stored":293729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:03:50 2023","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.0169999999999999,"15min":0.97299999999999998},"min":{"1min":0.82299999999999995,"5min":0.62,"15min":0.62},"max":{"1min":1.391,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":0.92700000000000005},{"interface":"front","average":{"1min":1.153,"5min":1.0680000000000001,"15min":1.046},"min":{"1min":0.78500000000000003,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.5189999999999999,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":0.996}]},{"osd":1,"last update":"Fri Oct 6 03:03:50 2023","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.222,"15min":1.212},"min":{"1min":0.89400000000000002,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":1.6879999999999999,"5min":1.984,"15min":1.984},"last":1.502},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.169,"15min":1.161},"min":{"1min":0.83999999999999997,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":2.0899999999999999,"5min":2.0899999999999999,"15min":2.0899999999999999},"last":1.306}]},{"osd":2,"last update":"Fri Oct 6 03:03:50 2023","interfaces":[{"interface":"back","average":{"1min":1.3,"5min":1.3640000000000001,"15min":1.3839999999999999},"min":{"1min":0.94799999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":1.7350000000000001,"5min":1.78,"15min":1.78},"last":1.47},{"interface":"front","average":{"1min":1.286,"5min":1.306,"15min":1.3049999999999999},"min":{"1min":1.0049999999999999,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":1.5489999999999999,"5min":2.8319999999999999,"15min":2.8319999999999999},"last":1.3520000000000001}]},{"osd":3,"last update":"Fri Oct 6 03:03:50 2023","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2589999999999999},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.589,"5min":3.1789999999999998,"15min":3.1789999999999998},"last":1.399},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.296,"15min":1.28},"min":{"1min":0.90300000000000002,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":2.2549999999999999,"5min":2.2549999999999999,"15min":2.2549999999999999},"last":1.5449999999999999}]},{"osd":4,"last update":"Fri Oct 6 03:03:50 2023","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.2370000000000001,"15min":1.28},"min":{"1min":0.81100000000000005,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.4570000000000001,"5min":2.5899999999999999,"15min":2.5899999999999999},"last":1.224},{"interface":"front","average":{"1min":1.369,"5min":1.4570000000000001,"15min":1.496},"min":{"1min":0.96899999999999997,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.764,"5min":4.5419999999999998,"15min":4.5419999999999998},"last":1.6459999999999999}]},{"osd":6,"last update":"Fri Oct 6 03:03:50 2023","interfaces":[{"interface":"back","average":{"1min":1.208,"5min":1.3380000000000001,"15min":1.3720000000000001},"min":{"1min":0.82399999999999995,"5min":0.754,"15min":0.754},"max":{"1min":1.5980000000000001,"5min":1.847,"15min":1.847},"last":1.593},{"interface":"front","average":{"1min":1.319,"5min":1.3620000000000001,"15min":1.3759999999999999},"min":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"max":{"1min":1.599,"5min":2.9239999999999999,"15min":2.9239999999999999},"last":1.4410000000000001}]},{"osd":7,"last update":"Fri Oct 6 03:03:50 2023","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.3700000000000001,"15min":1.3979999999999999},"min":{"1min":1.0169999999999999,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.8080000000000001,"5min":4.4489999999999998,"15min":4.4489999999999998},"last":1.2629999999999999},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.387,"15min":1.419},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.7130000000000001,"5min":1.98,"15min":1.98},"last":1.1719999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574888,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302052,"kb_used_data":668,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069788,"statfs":{"total":96636764160,"available":96327462912,"internally_reserved":0,"allocated":684032,"data_stored":300856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:03:51 2023","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.093,"15min":1.089},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.5509999999999999,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":1.29},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.093,"15min":1.079},"min":{"1min":0.80600000000000005,"5min":0.625,"15min":0.625},"max":{"1min":1.4359999999999999,"5min":1.585,"15min":1.585},"last":1.107}]},{"osd":1,"last update":"Fri Oct 6 03:03:51 2023","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":1.0740000000000001,"15min":1.0569999999999999},"min":{"1min":0.75600000000000001,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.3999999999999999,"5min":1.621,"15min":1.621},"last":0.98099999999999998},{"interface":"front","average":{"1min":1.133,"5min":1.1759999999999999,"15min":1.171},"min":{"1min":0.80200000000000005,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.411,"5min":1.73,"15min":1.73},"last":1.407}]},{"osd":2,"last update":"Fri Oct 6 03:03:51 2023","interfaces":[{"interface":"back","average":{"1min":1.296,"5min":1.2889999999999999,"15min":1.2849999999999999},"min":{"1min":0.95299999999999996,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.5589999999999999,"5min":1.696,"15min":1.696},"last":1.51},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.329,"15min":1.3360000000000001},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.571,"5min":1.788,"15min":1.788},"last":1.4950000000000001}]},{"osd":3,"last update":"Fri Oct 6 03:03:51 2023","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.222,"15min":1.2390000000000001},"min":{"1min":0.76500000000000001,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.407,"5min":1.706,"15min":1.706},"last":1.383},{"interface":"front","average":{"1min":1.1890000000000001,"5min":1.2370000000000001,"15min":1.2330000000000001},"min":{"1min":0.96999999999999997,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.3799999999999999,"5min":2.1960000000000002,"15min":2.1960000000000002},"last":1.444}]},{"osd":5,"last update":"Fri Oct 6 03:03:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.2110000000000001,"15min":1.202},"min":{"1min":0.86299999999999999,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.496,"5min":1.71,"15min":1.71},"last":1.1559999999999999},{"interface":"front","average":{"1min":1.206,"5min":1.302,"15min":1.343},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.4990000000000001,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":0.91500000000000004}]},{"osd":6,"last update":"Fri Oct 6 03:03:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2609999999999999,"5min":1.327,"15min":1.371},"min":{"1min":0.63500000000000001,"5min":0.629,"15min":0.629},"max":{"1min":1.7949999999999999,"5min":2.9100000000000001,"15min":2.9100000000000001},"last":1.2490000000000001},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.429,"15min":1.4610000000000001},"min":{"1min":1.0329999999999999,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.605,"5min":3.282,"15min":3.282},"last":1.026}]},{"osd":7,"last update":"Fri Oct 6 03:03:51 2023","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":1.4490000000000001,"15min":1.512},"min":{"1min":0.91900000000000004,"5min":0.88700000000000001,"15min":0.88700000000000001},"max":{"1min":1.591,"5min":2.145,"15min":2.145},"last":1.3169999999999999},{"interface":"front","average":{"1min":1.411,"5min":1.4330000000000001,"15min":1.4350000000000001},"min":{"1min":0.874,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.7350000000000001,"5min":1.927,"15min":1.927},"last":1.347}]}]},{"osd":3,"up_from":13,"seq":55834574888,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302052,"kb_used_data":668,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069788,"statfs":{"total":96636764160,"available":96327462912,"internally_reserved":0,"allocated":684032,"data_stored":302107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:03:49 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.95799999999999996,"15min":0.99399999999999999},"min":{"1min":0.67100000000000004,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.3919999999999999,"5min":2.298,"15min":2.298},"last":0.92800000000000005},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.01,"15min":1.002},"min":{"1min":0.752,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.339,"5min":2.1850000000000001,"15min":2.1850000000000001},"last":1.1990000000000001}]},{"osd":1,"last update":"Fri Oct 6 03:03:49 2023","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.97399999999999998,"15min":0.98599999999999999},"min":{"1min":0.65800000000000003,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.3480000000000001,"5min":1.974,"15min":1.974},"last":1.1659999999999999},{"interface":"front","average":{"1min":1.127,"5min":1.1240000000000001,"15min":1.1319999999999999},"min":{"1min":0.86899999999999999,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.4710000000000001,"5min":1.71,"15min":1.71},"last":1.119}]},{"osd":2,"last update":"Fri Oct 6 03:03:49 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":1.034,"15min":1.054},"min":{"1min":0.67600000000000005,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.4099999999999999,"5min":2.8849999999999998,"15min":2.8849999999999998},"last":0.81799999999999995},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.0860000000000001,"15min":1.0920000000000001},"min":{"1min":0.84199999999999997,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.5780000000000001,"5min":2.8220000000000001,"15min":2.8220000000000001},"last":1.452}]},{"osd":4,"last update":"Fri Oct 6 03:03:49 2023","interfaces":[{"interface":"back","average":{"1min":1.2849999999999999,"5min":1.393,"15min":1.4350000000000001},"min":{"1min":0.95299999999999996,"5min":0.751,"15min":0.751},"max":{"1min":1.7130000000000001,"5min":3.6560000000000001,"15min":3.6560000000000001},"last":1.518},{"interface":"front","average":{"1min":1.335,"5min":1.401,"15min":1.444},"min":{"1min":1.0820000000000001,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.796,"5min":3.7749999999999999,"15min":3.7749999999999999},"last":1.349}]},{"osd":5,"last update":"Fri Oct 6 03:03:49 2023","interfaces":[{"interface":"back","average":{"1min":1.4119999999999999,"5min":1.478,"15min":1.5149999999999999},"min":{"1min":1.1679999999999999,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":1.8460000000000001,"5min":3.4910000000000001,"15min":3.4910000000000001},"last":0.97999999999999998},{"interface":"front","average":{"1min":1.377,"5min":1.4370000000000001,"15min":1.4750000000000001},"min":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"max":{"1min":1.6519999999999999,"5min":2.6240000000000001,"15min":2.6240000000000001},"last":1.3819999999999999}]},{"osd":6,"last update":"Fri Oct 6 03:03:49 2023","interfaces":[{"interface":"back","average":{"1min":1.359,"5min":1.4870000000000001,"15min":1.5469999999999999},"min":{"1min":1.0349999999999999,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":1.7549999999999999,"5min":3.7050000000000001,"15min":3.7050000000000001},"last":1.4219999999999999},{"interface":"front","average":{"1min":1.3540000000000001,"5min":1.4990000000000001,"15min":1.5549999999999999},"min":{"1min":0.97699999999999998,"5min":0.80900000000000005,"15min":0.80900000000000005},"max":{"1min":1.901,"5min":3.9300000000000002,"15min":3.9300000000000002},"last":1.575}]},{"osd":7,"last update":"Fri Oct 6 03:03:49 2023","interfaces":[{"interface":"back","average":{"1min":1.4299999999999999,"5min":1.5449999999999999,"15min":1.605},"min":{"1min":1.073,"5min":1.0369999999999999,"15min":1.0369999999999999},"max":{"1min":1.9330000000000001,"5min":2.96,"15min":2.96},"last":1.4890000000000001},{"interface":"front","average":{"1min":1.4950000000000001,"5min":1.6579999999999999,"15min":1.734},"min":{"1min":1.1419999999999999,"5min":0.90600000000000003,"15min":0.90600000000000003},"max":{"1min":1.9810000000000001,"5min":3.8559999999999999,"15min":3.8559999999999999},"last":1.6080000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574888,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302060,"kb_used_data":676,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069780,"statfs":{"total":96636764160,"available":96327454720,"internally_reserved":0,"allocated":692224,"data_stored":308651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:03:50 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.86099999999999999,"15min":0.86799999999999999},"min":{"1min":0.54500000000000004,"5min":0.496,"15min":0.496},"max":{"1min":1.2290000000000001,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.91700000000000004,"15min":0.93799999999999994},"min":{"1min":0.61799999999999999,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.3340000000000001,"5min":1.502,"15min":1.502},"last":0.94399999999999995}]},{"osd":1,"last update":"Fri Oct 6 03:03:50 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.075,"15min":1.087},"min":{"1min":0.64700000000000002,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":1.4079999999999999},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.1899999999999999,"15min":1.218},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.484,"5min":2.1800000000000002,"15min":2.1800000000000002},"last":1.3680000000000001}]},{"osd":3,"last update":"Fri Oct 6 03:03:50 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.94599999999999995,"15min":0.96199999999999997},"min":{"1min":0.63100000000000001,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.2430000000000001,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":1.125,"5min":1.147,"15min":1.1719999999999999},"min":{"1min":0.73699999999999999,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.5289999999999999,"5min":2.806,"15min":2.806},"last":0.89600000000000002}]},{"osd":4,"last update":"Fri Oct 6 03:03:50 2023","interfaces":[{"interface":"back","average":{"1min":1.266,"5min":1.339,"15min":1.3720000000000001},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.7090000000000001,"5min":2.1739999999999999,"15min":2.1739999999999999},"last":1.6120000000000001},{"interface":"front","average":{"1min":1.242,"5min":1.3779999999999999,"15min":1.431},"min":{"1min":0.996,"5min":0.83699999999999997,"15min":0.83699999999999997},"max":{"1min":1.5429999999999999,"5min":3.028,"15min":3.028},"last":1.4419999999999999}]},{"osd":5,"last update":"Fri Oct 6 03:03:50 2023","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.4650000000000001,"15min":1.5209999999999999},"min":{"1min":1.1000000000000001,"5min":0.90100000000000002,"15min":0.90100000000000002},"max":{"1min":1.5469999999999999,"5min":3.1499999999999999,"15min":3.1499999999999999},"last":1.2230000000000001},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.4259999999999999,"15min":1.4830000000000001},"min":{"1min":0.95599999999999996,"5min":0.85899999999999999,"15min":0.85899999999999999},"max":{"1min":1.704,"5min":2.8580000000000001,"15min":2.8580000000000001},"last":1.5800000000000001}]},{"osd":6,"last update":"Fri Oct 6 03:03:50 2023","interfaces":[{"interface":"back","average":{"1min":1.2789999999999999,"5min":1.397,"15min":1.45},"min":{"1min":0.91900000000000004,"5min":0.86299999999999999,"15min":0.86299999999999999},"max":{"1min":1.829,"5min":2.6659999999999999,"15min":2.6659999999999999},"last":1.526},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.4490000000000001,"15min":1.4970000000000001},"min":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"max":{"1min":1.6759999999999999,"5min":2.411,"15min":2.411},"last":1.2729999999999999}]},{"osd":7,"last update":"Fri Oct 6 03:03:50 2023","interfaces":[{"interface":"back","average":{"1min":1.3759999999999999,"5min":1.544,"15min":1.6040000000000001},"min":{"1min":1.0880000000000001,"5min":1.01,"15min":1.01},"max":{"1min":1.579,"5min":3.2160000000000002,"15min":3.2160000000000002},"last":1.502},{"interface":"front","average":{"1min":1.3979999999999999,"5min":1.5369999999999999,"15min":1.599},"min":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"max":{"1min":1.8879999999999999,"5min":3.1059999999999999,"15min":3.1059999999999999},"last":1.46}]}]},{"osd":1,"up_from":13,"seq":55834574889,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302044,"kb_used_data":660,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069796,"statfs":{"total":96636764160,"available":96327471104,"internally_reserved":0,"allocated":675840,"data_stored":293896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:03:48 2023","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":0.93700000000000006,"15min":0.94899999999999995},"min":{"1min":0.57799999999999996,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.3759999999999999,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":0.81200000000000006},{"interface":"front","average":{"1min":1.113,"5min":1.0860000000000001,"15min":1.091},"min":{"1min":0.71499999999999997,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.4690000000000001,"5min":2.3260000000000001,"15min":2.3260000000000001},"last":0.61199999999999999}]},{"osd":2,"last update":"Fri Oct 6 03:03:48 2023","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.98099999999999998,"15min":0.995},"min":{"1min":0.77500000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.27,"5min":3.5459999999999998,"15min":3.5459999999999998},"last":0.57399999999999995},{"interface":"front","average":{"1min":1.165,"5min":1.042,"15min":1.03},"min":{"1min":0.76400000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.5820000000000001,"5min":1.706,"15min":1.706},"last":0.90200000000000002}]},{"osd":3,"last update":"Fri Oct 6 03:03:48 2023","interfaces":[{"interface":"back","average":{"1min":1.218,"5min":1.1539999999999999,"15min":1.1459999999999999},"min":{"1min":0.71299999999999997,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.5760000000000001,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":0.68600000000000005},{"interface":"front","average":{"1min":1.151,"5min":1.167,"15min":1.1859999999999999},"min":{"1min":0.93300000000000005,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.4730000000000001,"5min":3.331,"15min":3.331},"last":0.76800000000000002}]},{"osd":4,"last update":"Fri Oct 6 03:03:48 2023","interfaces":[{"interface":"back","average":{"1min":1.3080000000000001,"5min":1.3089999999999999,"15min":1.329},"min":{"1min":1.048,"5min":0.85899999999999999,"15min":0.85899999999999999},"max":{"1min":1.5640000000000001,"5min":2.0169999999999999,"15min":2.0169999999999999},"last":1.127},{"interface":"front","average":{"1min":1.238,"5min":1.298,"15min":1.3180000000000001},"min":{"1min":0.90900000000000003,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.639,"5min":3.2250000000000001,"15min":3.2250000000000001},"last":1.024}]},{"osd":5,"last update":"Fri Oct 6 03:03:48 2023","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":1.389,"15min":1.421},"min":{"1min":0.96599999999999997,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":1.704,"5min":2.8439999999999999,"15min":2.8439999999999999},"last":0.97599999999999998},{"interface":"front","average":{"1min":1.4470000000000001,"5min":1.4510000000000001,"15min":1.4730000000000001},"min":{"1min":1.0980000000000001,"5min":0.89800000000000002,"15min":0.89800000000000002},"max":{"1min":1.7390000000000001,"5min":2.4590000000000001,"15min":2.4590000000000001},"last":0.995}]},{"osd":6,"last update":"Fri Oct 6 03:03:48 2023","interfaces":[{"interface":"back","average":{"1min":1.3500000000000001,"5min":1.427,"15min":1.4530000000000001},"min":{"1min":0.89400000000000002,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.76,"5min":2.96,"15min":2.96},"last":1.0700000000000001},{"interface":"front","average":{"1min":1.472,"5min":1.474,"15min":1.494},"min":{"1min":1.0149999999999999,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.8080000000000001,"5min":2.5859999999999999,"15min":2.5859999999999999},"last":0.94999999999999996}]},{"osd":7,"last update":"Fri Oct 6 03:03:48 2023","interfaces":[{"interface":"back","average":{"1min":1.415,"5min":1.512,"15min":1.573},"min":{"1min":1.1459999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":2.1299999999999999,"5min":3.4460000000000002,"15min":3.4460000000000002},"last":0.92900000000000005},{"interface":"front","average":{"1min":1.458,"5min":1.5,"15min":1.5249999999999999},"min":{"1min":1.212,"5min":0.94099999999999995,"15min":0.94099999999999995},"max":{"1min":1.734,"5min":3.113,"15min":3.113},"last":1.111}]}]},{"osd":0,"up_from":13,"seq":55834574888,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302620,"kb_used_data":1236,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069220,"statfs":{"total":96636764160,"available":96326881280,"internally_reserved":0,"allocated":1265664,"data_stored":884153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 03:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.85099999999999998,"15min":0.82399999999999995},"min":{"1min":0.66700000000000004,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.2490000000000001,"5min":1.583,"15min":1.583},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.97799999999999998,"15min":0.99199999999999999},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.571,"5min":1.571,"15min":1.571},"last":0.74199999999999999}]},{"osd":2,"last update":"Fri Oct 6 03:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.98599999999999999,"15min":0.98399999999999999},"min":{"1min":0.71799999999999997,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.3220000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":1.093},{"interface":"front","average":{"1min":0.998,"5min":1.089,"15min":1.1120000000000001},"min":{"1min":0.76100000000000001,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.2949999999999999,"5min":1.794,"15min":1.794},"last":1.139}]},{"osd":3,"last update":"Fri Oct 6 03:03:46 2023","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":1.0349999999999999,"15min":1.018},"min":{"1min":0.70799999999999996,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.554,"5min":1.554,"15min":1.554},"last":0.63600000000000001},{"interface":"front","average":{"1min":1.298,"5min":1.226,"15min":1.2030000000000001},"min":{"1min":1.004,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.569,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.90000000000000002}]},{"osd":4,"last update":"Fri Oct 6 03:03:46 2023","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.244,"15min":1.2310000000000001},"min":{"1min":0.88400000000000001,"5min":0.86699999999999999,"15min":0.86699999999999999},"max":{"1min":1.5669999999999999,"5min":2.0680000000000001,"15min":2.0680000000000001},"last":0.99199999999999999},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.3300000000000001,"15min":1.3360000000000001},"min":{"1min":1.0409999999999999,"5min":0.93400000000000005,"15min":0.93400000000000005},"max":{"1min":1.5800000000000001,"5min":1.647,"15min":1.647},"last":1.415}]},{"osd":5,"last update":"Fri Oct 6 03:03:46 2023","interfaces":[{"interface":"back","average":{"1min":1.256,"5min":1.379,"15min":1.4019999999999999},"min":{"1min":0.92500000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":1.728,"5min":1.8959999999999999,"15min":1.8959999999999999},"last":1.4890000000000001},{"interface":"front","average":{"1min":1.359,"5min":1.2909999999999999,"15min":1.2729999999999999},"min":{"1min":1.0449999999999999,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":1.6160000000000001,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":1.1930000000000001}]},{"osd":6,"last update":"Fri Oct 6 03:03:46 2023","interfaces":[{"interface":"back","average":{"1min":1.373,"5min":1.4199999999999999,"15min":1.4199999999999999},"min":{"1min":1.1459999999999999,"5min":0.89400000000000002,"15min":0.89400000000000002},"max":{"1min":1.7090000000000001,"5min":1.96,"15min":1.96},"last":1.53},{"interface":"front","average":{"1min":1.389,"5min":1.4930000000000001,"15min":1.532},"min":{"1min":1.117,"5min":0.89800000000000002,"15min":0.89800000000000002},"max":{"1min":1.859,"5min":2.0539999999999998,"15min":2.0539999999999998},"last":1.5780000000000001}]},{"osd":7,"last update":"Fri Oct 6 03:03:46 2023","interfaces":[{"interface":"back","average":{"1min":1.4039999999999999,"5min":1.5569999999999999,"15min":1.607},"min":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"max":{"1min":1.7989999999999999,"5min":2.1019999999999999,"15min":2.1019999999999999},"last":1.375},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.413,"15min":1.425},"min":{"1min":1.091,"5min":0.875,"15min":0.875},"max":{"1min":1.681,"5min":2.1499999999999999,"15min":2.1499999999999999},"last":1.452}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:04:00.243 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-06T03:04:00.243 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:04:00.394 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.388+0000 7fbff1ef0700 1 Processor -- start 2023-10-06T03:04:00.394 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.388+0000 7fbff1ef0700 1 -- start start 2023-10-06T03:04:00.397 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.392+0000 7fbff1ef0700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbfec157190 0x7fbfec0c86a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:00.397 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.392+0000 7fbff1ef0700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfec06de40 con 0x7fbfec0c8be0 2023-10-06T03:04:00.397 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.392+0000 7fbff1ef0700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfec0c90f0 con 0x7fbfec069450 2023-10-06T03:04:00.397 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.392+0000 7fbff1ef0700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfec153f70 con 0x7fbfec157190 2023-10-06T03:04:00.397 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.392+0000 7fbfeaffd700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fbfec0c8be0 0x7fbfec06e2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:54324/0 (socket says 172.21.15.57:54324) 2023-10-06T03:04:00.397 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.392+0000 7fbfeaffd700 1 -- 172.21.15.57:0/122773776 learned_addr learned my addr 172.21.15.57:0/122773776 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:04:00.398 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.392+0000 7fbfeb7fe700 1 --2- 172.21.15.57:0/122773776 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbfec157190 0x7fbfec0c86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:00.398 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.392+0000 7fbfea7fc700 1 -- 172.21.15.57:0/122773776 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1952098083 0 0) 0x7fbfec06de40 con 0x7fbfec0c8be0 2023-10-06T03:04:00.398 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.392+0000 7fbfea7fc700 1 -- 172.21.15.57:0/122773776 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbfd4003570 con 0x7fbfec0c8be0 2023-10-06T03:04:00.398 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.392+0000 7fbfeb7fe700 1 -- 172.21.15.57:0/122773776 >> v1:172.21.15.105:6789/0 conn(0x7fbfec069450 legacy=0x7fbfec0adf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:00.399 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.392+0000 7fbfeb7fe700 1 -- 172.21.15.57:0/122773776 >> v1:172.21.15.57:6789/0 conn(0x7fbfec0c8be0 legacy=0x7fbfec06e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:00.399 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.392+0000 7fbfeb7fe700 1 -- 172.21.15.57:0/122773776 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfec0c93d0 con 0x7fbfec157190 2023-10-06T03:04:00.399 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.396+0000 7fbfeb7fe700 1 --2- 172.21.15.57:0/122773776 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbfec157190 0x7fbfec0c86a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc009900 tx=0x7fbfdc009120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=75d3a3955be48ad2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:00.399 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.396+0000 7fbfea7fc700 1 -- 172.21.15.57:0/122773776 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfdc005c10 con 0x7fbfec157190 2023-10-06T03:04:00.399 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.396+0000 7fbfea7fc700 1 -- 172.21.15.57:0/122773776 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfdc005d70 con 0x7fbfec157190 2023-10-06T03:04:00.400 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.396+0000 7fbfea7fc700 1 -- 172.21.15.57:0/122773776 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfdc006260 con 0x7fbfec157190 2023-10-06T03:04:00.400 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.396+0000 7fbff1ef0700 1 -- 172.21.15.57:0/122773776 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbfec157190 msgr2=0x7fbfec0c86a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:00.400 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.396+0000 7fbff1ef0700 1 --2- 172.21.15.57:0/122773776 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbfec157190 0x7fbfec0c86a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc009900 tx=0x7fbfdc009120 comp rx=0 tx=0).stop 2023-10-06T03:04:00.400 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.396+0000 7fbff1ef0700 1 -- 172.21.15.57:0/122773776 shutdown_connections 2023-10-06T03:04:00.401 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.396+0000 7fbff1ef0700 1 --2- 172.21.15.57:0/122773776 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbfec157190 0x7fbfec0c86a0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:00.401 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.396+0000 7fbff1ef0700 1 -- 172.21.15.57:0/122773776 >> 172.21.15.57:0/122773776 conn(0x7fbfec0c9950 msgr2=0x7fbfec0c9d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:00.401 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.396+0000 7fbff1ef0700 1 -- 172.21.15.57:0/122773776 shutdown_connections 2023-10-06T03:04:00.401 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.396+0000 7fbff1ef0700 1 -- 172.21.15.57:0/122773776 wait complete. 2023-10-06T03:04:00.402 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.396+0000 7fbff1ef0700 1 Processor -- start 2023-10-06T03:04:00.402 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.396+0000 7fbff1ef0700 1 -- start start 2023-10-06T03:04:00.403 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.400+0000 7fbff1ef0700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbfec069450 0x7fbfec1525e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:00.404 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.400+0000 7fbff1ef0700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbfec0c8be0 0x7fbfec0c1820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:00.404 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.400+0000 7fbff1ef0700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbfec157190 0x7fbfec158620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:00.404 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.400+0000 7fbff1ef0700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfec0c3490 con 0x7fbfec0c8be0 2023-10-06T03:04:00.404 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.400+0000 7fbff1ef0700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfec0c2880 con 0x7fbfec157190 2023-10-06T03:04:00.404 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.400+0000 7fbff1ef0700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfec0c2b60 con 0x7fbfec069450 2023-10-06T03:04:00.404 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.400+0000 7fbfeaffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbfec0c8be0 0x7fbfec0c1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:00.404 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.400+0000 7fbfeaffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbfec0c8be0 0x7fbfec0c1820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:52224/0 (socket says 172.21.15.57:52224) 2023-10-06T03:04:00.404 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.400+0000 7fbfeaffd700 1 -- 172.21.15.57:0/578912339 learned_addr learned my addr 172.21.15.57:0/578912339 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:04:00.405 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.400+0000 7fbfeb7fe700 1 --2- 172.21.15.57:0/578912339 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbfec069450 0x7fbfec1525e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:00.405 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.400+0000 7fbfeaffd700 1 -- 172.21.15.57:0/578912339 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbfec069450 msgr2=0x7fbfec1525e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:00.405 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.400+0000 7fbfeaffd700 1 --2- 172.21.15.57:0/578912339 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbfec069450 0x7fbfec1525e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:00.405 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.400+0000 7fbfeaffd700 1 -- 172.21.15.57:0/578912339 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbfec157190 msgr2=0x7fbfec158620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:00.405 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.400+0000 7fbfeaffd700 1 --2- 172.21.15.57:0/578912339 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbfec157190 0x7fbfec158620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:00.405 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.400+0000 7fbfeaffd700 1 -- 172.21.15.57:0/578912339 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfdc0093c0 con 0x7fbfec0c8be0 2023-10-06T03:04:00.406 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.400+0000 7fbfeaffd700 1 --2- 172.21.15.57:0/578912339 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbfec0c8be0 0x7fbfec0c1820 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fbfe000c7c0 tx=0x7fbfe0007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:00.406 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.400+0000 7fbfd37fe700 1 -- 172.21.15.57:0/578912339 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe0005b30 con 0x7fbfec0c8be0 2023-10-06T03:04:00.406 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.400+0000 7fbfd37fe700 1 -- 172.21.15.57:0/578912339 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfe0005c90 con 0x7fbfec0c8be0 2023-10-06T03:04:00.406 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.400+0000 7fbff1ef0700 1 -- 172.21.15.57:0/578912339 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfec0c2e40 con 0x7fbfec0c8be0 2023-10-06T03:04:00.406 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.400+0000 7fbfd37fe700 1 -- 172.21.15.57:0/578912339 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe0007340 con 0x7fbfec0c8be0 2023-10-06T03:04:00.406 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.400+0000 7fbff1ef0700 1 -- 172.21.15.57:0/578912339 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfec152b20 con 0x7fbfec0c8be0 2023-10-06T03:04:00.406 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.400+0000 7fbff1ef0700 1 -- 172.21.15.57:0/578912339 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfec0c3640 con 0x7fbfec0c8be0 2023-10-06T03:04:00.407 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.404+0000 7fbfd37fe700 1 -- 172.21.15.57:0/578912339 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fbfe001b400 con 0x7fbfec0c8be0 2023-10-06T03:04:00.409 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.404+0000 7fbfd37fe700 1 --2- 172.21.15.57:0/578912339 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fbfd8060550 0x7fbfd8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:00.409 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.404+0000 7fbfd37fe700 1 -- 172.21.15.57:0/578912339 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5378+0+0 (secure 0 0 0) 0x7fbfe007c1f0 con 0x7fbfec0c8be0 2023-10-06T03:04:00.409 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.404+0000 7fbfeb7fe700 1 --2- 172.21.15.57:0/578912339 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fbfd8060550 0x7fbfd8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:00.410 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.408+0000 7fbfeb7fe700 1 --2- 172.21.15.57:0/578912339 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fbfd8060550 0x7fbfd8062a00 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc009160 tx=0x7fbfdc016000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:00.415 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.412+0000 7fbfd37fe700 1 -- 172.21.15.57:0/578912339 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fbfec0c3640 con 0x7fbfec0c8be0 2023-10-06T03:04:00.582 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.580+0000 7fbff1ef0700 1 -- 172.21.15.57:0/578912339 --> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbfec0712e0 con 0x7fbfd8060550 2023-10-06T03:04:00.590 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.588+0000 7fbfd37fe700 1 -- 172.21.15.57:0/578912339 <== mgr.4103 v2:172.21.15.57:6832/32947 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+70245 (secure 0 0 0) 0x7fbfec0712e0 con 0x7fbfd8060550 2023-10-06T03:04:00.592 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:04:00.595 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.588+0000 7fbff1ef0700 1 -- 172.21.15.57:0/578912339 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fbfd8060550 msgr2=0x7fbfd8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:00.595 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.588+0000 7fbff1ef0700 1 --2- 172.21.15.57:0/578912339 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fbfd8060550 0x7fbfd8062a00 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc009160 tx=0x7fbfdc016000 comp rx=0 tx=0).stop 2023-10-06T03:04:00.595 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.588+0000 7fbff1ef0700 1 -- 172.21.15.57:0/578912339 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbfec0c8be0 msgr2=0x7fbfec0c1820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:00.595 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.588+0000 7fbff1ef0700 1 --2- 172.21.15.57:0/578912339 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbfec0c8be0 0x7fbfec0c1820 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fbfe000c7c0 tx=0x7fbfe0007e00 comp rx=0 tx=0).stop 2023-10-06T03:04:00.595 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.588+0000 7fbff1ef0700 1 -- 172.21.15.57:0/578912339 shutdown_connections 2023-10-06T03:04:00.595 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.588+0000 7fbff1ef0700 1 --2- 172.21.15.57:0/578912339 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbfec157190 0x7fbfec158620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:00.595 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.588+0000 7fbff1ef0700 1 --2- 172.21.15.57:0/578912339 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbfec0c8be0 0x7fbfec0c1820 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:00.595 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.588+0000 7fbff1ef0700 1 --2- 172.21.15.57:0/578912339 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fbfd8060550 0x7fbfd8062a00 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:00.595 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.588+0000 7fbff1ef0700 1 --2- 172.21.15.57:0/578912339 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbfec069450 0x7fbfec1525e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:00.595 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.588+0000 7fbff1ef0700 1 -- 172.21.15.57:0/578912339 >> 172.21.15.57:0/578912339 conn(0x7fbfec0c9950 msgr2=0x7fbfec153450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:00.595 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.592+0000 7fbff1ef0700 1 -- 172.21.15.57:0/578912339 shutdown_connections 2023-10-06T03:04:00.596 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.592+0000 7fbff1ef0700 1 -- 172.21.15.57:0/578912339 wait complete. 2023-10-06T03:04:00.597 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2023-10-06T03:04:00.614 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":150,"stamp":"2023-10-06T03:04:00.335265+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":85,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2409576,"kb_used_data":6696,"kb_used_omap":0,"kb_used_meta":2402816,"kb_avail":752565144,"statfs":{"total":773094113280,"available":770626707456,"internally_reserved":0,"allocated":6856704,"data_stored":3683208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2460483584},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-9133,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-49,"num_read_kb":-52,"num_write":-75,"num_write_kb":-34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.596760"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":193,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T03:03:55.987614+0000","last_change":"2023-10-06T03:00:45.709165+0000","last_active":"2023-10-06T03:03:55.987614+0000","last_peered":"2023-10-06T03:03:55.987614+0000","last_clean":"2023-10-06T03:03:55.987614+0000","last_became_active":"2023-10-06T03:00:45.707771+0000","last_became_peered":"2023-10-06T03:00:45.707771+0000","last_unstale":"2023-10-06T03:03:55.987614+0000","last_undegraded":"2023-10-06T03:03:55.987614+0000","last_fullsized":"2023-10-06T03:03:55.987614+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:44.625353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:44.625353+0000","last_clean_scrub_stamp":"2023-10-06T03:00:44.625353+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:31:31.774239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":41,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T03:03:56.147622+0000","last_change":"2023-10-06T03:00:51.905381+0000","last_active":"2023-10-06T03:03:56.147622+0000","last_peered":"2023-10-06T03:03:56.147622+0000","last_clean":"2023-10-06T03:03:56.147622+0000","last_became_active":"2023-10-06T03:00:51.904974+0000","last_became_peered":"2023-10-06T03:00:51.904974+0000","last_unstale":"2023-10-06T03:03:56.147622+0000","last_undegraded":"2023-10-06T03:03:56.147622+0000","last_fullsized":"2023-10-06T03:03:56.147622+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:15:19.182956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":40,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T03:03:55.987505+0000","last_change":"2023-10-06T03:00:51.906480+0000","last_active":"2023-10-06T03:03:55.987505+0000","last_peered":"2023-10-06T03:03:55.987505+0000","last_clean":"2023-10-06T03:03:55.987505+0000","last_became_active":"2023-10-06T03:00:51.905956+0000","last_became_peered":"2023-10-06T03:00:51.905956+0000","last_unstale":"2023-10-06T03:03:55.987505+0000","last_undegraded":"2023-10-06T03:03:55.987505+0000","last_fullsized":"2023-10-06T03:03:55.987505+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:15:19.182956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":41,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T03:03:56.122455+0000","last_change":"2023-10-06T03:00:51.902453+0000","last_active":"2023-10-06T03:03:56.122455+0000","last_peered":"2023-10-06T03:03:56.122455+0000","last_clean":"2023-10-06T03:03:56.122455+0000","last_became_active":"2023-10-06T03:00:51.901948+0000","last_became_peered":"2023-10-06T03:00:51.901948+0000","last_unstale":"2023-10-06T03:03:56.122455+0000","last_undegraded":"2023-10-06T03:03:56.122455+0000","last_fullsized":"2023-10-06T03:03:56.122455+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:13:30.721650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":41,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T03:03:56.146616+0000","last_change":"2023-10-06T03:00:51.904148+0000","last_active":"2023-10-06T03:03:56.146616+0000","last_peered":"2023-10-06T03:03:56.146616+0000","last_clean":"2023-10-06T03:03:56.146616+0000","last_became_active":"2023-10-06T03:00:51.903729+0000","last_became_peered":"2023-10-06T03:00:51.903729+0000","last_unstale":"2023-10-06T03:03:56.146616+0000","last_undegraded":"2023-10-06T03:03:56.146616+0000","last_fullsized":"2023-10-06T03:03:56.146616+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:17:25.070478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":39,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T03:03:56.147703+0000","last_change":"2023-10-06T03:00:52.484317+0000","last_active":"2023-10-06T03:03:56.147703+0000","last_peered":"2023-10-06T03:03:56.147703+0000","last_clean":"2023-10-06T03:03:56.147703+0000","last_became_active":"2023-10-06T03:00:52.483818+0000","last_became_peered":"2023-10-06T03:00:52.483818+0000","last_unstale":"2023-10-06T03:03:56.147703+0000","last_undegraded":"2023-10-06T03:03:56.147703+0000","last_fullsized":"2023-10-06T03:03:56.147703+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:17:24.136459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":40,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T03:03:55.989895+0000","last_change":"2023-10-06T03:00:52.485186+0000","last_active":"2023-10-06T03:03:55.989895+0000","last_peered":"2023-10-06T03:03:55.989895+0000","last_clean":"2023-10-06T03:03:55.989895+0000","last_became_active":"2023-10-06T03:00:52.484615+0000","last_became_peered":"2023-10-06T03:00:52.484615+0000","last_unstale":"2023-10-06T03:03:55.989895+0000","last_undegraded":"2023-10-06T03:03:55.989895+0000","last_fullsized":"2023-10-06T03:03:55.989895+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:17:25.070478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":39,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T03:03:56.145942+0000","last_change":"2023-10-06T03:00:51.903388+0000","last_active":"2023-10-06T03:03:56.145942+0000","last_peered":"2023-10-06T03:03:56.145942+0000","last_clean":"2023-10-06T03:03:56.145942+0000","last_became_active":"2023-10-06T03:00:51.902959+0000","last_became_peered":"2023-10-06T03:00:51.902959+0000","last_unstale":"2023-10-06T03:03:56.145942+0000","last_undegraded":"2023-10-06T03:03:56.145942+0000","last_fullsized":"2023-10-06T03:03:56.145942+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:30:16.907470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":39,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T03:03:55.987243+0000","last_change":"2023-10-06T03:00:51.903242+0000","last_active":"2023-10-06T03:03:55.987243+0000","last_peered":"2023-10-06T03:03:55.987243+0000","last_clean":"2023-10-06T03:03:55.987243+0000","last_became_active":"2023-10-06T03:00:51.902929+0000","last_became_peered":"2023-10-06T03:00:51.902929+0000","last_unstale":"2023-10-06T03:03:55.987243+0000","last_undegraded":"2023-10-06T03:03:55.987243+0000","last_fullsized":"2023-10-06T03:03:55.987243+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:34:12.274158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574890,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302656,"kb_used_data":1272,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069184,"statfs":{"total":96636764160,"available":96326844416,"internally_reserved":0,"allocated":1302528,"data_stored":903177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:03:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.2270000000000001,"15min":1.3009999999999999},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.415,"5min":4.7930000000000001,"15min":4.7930000000000001},"last":1.0980000000000001},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.4099999999999999,"15min":1.522},"min":{"1min":0.86399999999999999,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.476,"5min":9.9689999999999994,"15min":9.9689999999999994},"last":1.3779999999999999}]},{"osd":1,"last update":"Fri Oct 6 03:03:45 2023","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.3680000000000001,"15min":1.4710000000000001},"min":{"1min":0.95799999999999996,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.454,"5min":10.867000000000001,"15min":10.867000000000001},"last":1.4730000000000001},{"interface":"front","average":{"1min":1.3049999999999999,"5min":1.5169999999999999,"15min":1.6240000000000001},"min":{"1min":0.89100000000000001,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":1.599,"5min":10.255000000000001,"15min":10.255000000000001},"last":0.92100000000000004}]},{"osd":2,"last update":"Fri Oct 6 03:03:45 2023","interfaces":[{"interface":"back","average":{"1min":1.3300000000000001,"5min":1.5149999999999999,"15min":1.625},"min":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"max":{"1min":1.6830000000000001,"5min":7.9939999999999998,"15min":7.9939999999999998},"last":1.3080000000000001},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.552,"15min":1.6479999999999999},"min":{"1min":1.133,"5min":0.84899999999999998,"15min":0.84899999999999998},"max":{"1min":1.673,"5min":10.098000000000001,"15min":10.098000000000001},"last":1.5800000000000001}]},{"osd":3,"last update":"Fri Oct 6 03:03:45 2023","interfaces":[{"interface":"back","average":{"1min":1.4099999999999999,"5min":1.4419999999999999,"15min":1.49},"min":{"1min":1.018,"5min":0.754,"15min":0.754},"max":{"1min":2.069,"5min":4.3090000000000002,"15min":4.3090000000000002},"last":1.417},{"interface":"front","average":{"1min":1.4179999999999999,"5min":1.542,"15min":1.6080000000000001},"min":{"1min":1.1160000000000001,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":1.7589999999999999,"5min":8.3770000000000007,"15min":8.3770000000000007},"last":1.6619999999999999}]},{"osd":4,"last update":"Fri Oct 6 03:03:45 2023","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":1.5389999999999999,"15min":1.7050000000000001},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.8460000000000001,"5min":11.391999999999999,"15min":11.391999999999999},"last":1.2709999999999999},{"interface":"front","average":{"1min":1.268,"5min":1.399,"15min":1.456},"min":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"max":{"1min":1.857,"5min":3.9220000000000002,"15min":3.9220000000000002},"last":1.518}]},{"osd":5,"last update":"Fri Oct 6 03:03:45 2023","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.581,"15min":1.724},"min":{"1min":0.91200000000000003,"5min":0.89400000000000002,"15min":0.89400000000000002},"max":{"1min":2.004,"5min":11.951000000000001,"15min":11.951000000000001},"last":1.173},{"interface":"front","average":{"1min":1.359,"5min":1.6890000000000001,"15min":1.847},"min":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"max":{"1min":1.764,"5min":10.994999999999999,"15min":10.994999999999999},"last":1.044}]},{"osd":6,"last update":"Fri Oct 6 03:03:45 2023","interfaces":[{"interface":"back","average":{"1min":1.5009999999999999,"5min":1.7729999999999999,"15min":1.917},"min":{"1min":1.143,"5min":0.91300000000000003,"15min":0.91300000000000003},"max":{"1min":1.9510000000000001,"5min":11.513,"15min":11.513},"last":1.149},{"interface":"front","average":{"1min":1.448,"5min":1.7290000000000001,"15min":1.881},"min":{"1min":1.024,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":2.1819999999999999,"5min":10.714,"15min":10.714},"last":1.2210000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574890,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297980,"kb_used_data":692,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073860,"statfs":{"total":96636764160,"available":96331632640,"internally_reserved":0,"allocated":708608,"data_stored":312809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:03:45 2023","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.1890000000000001,"15min":1.1930000000000001},"min":{"1min":0.78400000000000003,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.704,"5min":1.704,"15min":1.704},"last":0.94299999999999995},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.345,"15min":1.361},"min":{"1min":1.0449999999999999,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.7270000000000001,"5min":2.1419999999999999,"15min":2.1419999999999999},"last":1.2130000000000001}]},{"osd":1,"last update":"Fri Oct 6 03:03:45 2023","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.2829999999999999,"15min":1.3049999999999999},"min":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.671,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":1.375},{"interface":"front","average":{"1min":1.2669999999999999,"5min":1.2509999999999999,"15min":1.254},"min":{"1min":0.90400000000000003,"5min":0.746,"15min":0.746},"max":{"1min":1.756,"5min":1.774,"15min":1.774},"last":1.0780000000000001}]},{"osd":2,"last update":"Fri Oct 6 03:03:45 2023","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.169,"15min":1.167},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.8220000000000001,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":1.46},{"interface":"front","average":{"1min":1.198,"5min":1.2150000000000001,"15min":1.2290000000000001},"min":{"1min":0.93999999999999995,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.595,"5min":1.78,"15min":1.78},"last":1.1759999999999999}]},{"osd":3,"last update":"Fri Oct 6 03:03:45 2023","interfaces":[{"interface":"back","average":{"1min":1.2749999999999999,"5min":1.274,"15min":1.28},"min":{"1min":1.004,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.488,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":1.2989999999999999},{"interface":"front","average":{"1min":1.3580000000000001,"5min":1.3220000000000001,"15min":1.3360000000000001},"min":{"1min":1.111,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.5700000000000001,"5min":2.2200000000000002,"15min":2.2200000000000002},"last":1.1259999999999999}]},{"osd":4,"last update":"Fri Oct 6 03:03:45 2023","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":1.248,"15min":1.2729999999999999},"min":{"1min":0.77700000000000002,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.5840000000000001,"5min":2.0960000000000001,"15min":2.0960000000000001},"last":1.2569999999999999},{"interface":"front","average":{"1min":1.175,"5min":1.3500000000000001,"15min":1.399},"min":{"1min":0.89200000000000002,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.4370000000000001,"5min":2.2610000000000001,"15min":2.2610000000000001},"last":1.5189999999999999}]},{"osd":5,"last update":"Fri Oct 6 03:03:45 2023","interfaces":[{"interface":"back","average":{"1min":1.306,"5min":1.333,"15min":1.359},"min":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":1.7829999999999999,"5min":1.994,"15min":1.994},"last":1.4850000000000001},{"interface":"front","average":{"1min":1.294,"5min":1.3380000000000001,"15min":1.3720000000000001},"min":{"1min":0.89200000000000002,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.609,"5min":2.0129999999999999,"15min":2.0129999999999999},"last":1.3999999999999999}]},{"osd":7,"last update":"Fri Oct 6 03:03:45 2023","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.425,"15min":1.4590000000000001},"min":{"1min":1.085,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.661,"5min":2.0920000000000001,"15min":2.0920000000000001},"last":1.345},{"interface":"front","average":{"1min":1.448,"5min":1.492,"15min":1.528},"min":{"1min":0.93100000000000005,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":1.8720000000000001,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":1.4350000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574890,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297980,"kb_used_data":692,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073860,"statfs":{"total":96636764160,"available":96331632640,"internally_reserved":0,"allocated":708608,"data_stored":312809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:03:50 2023","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.0169999999999999,"15min":0.97299999999999998},"min":{"1min":0.82299999999999995,"5min":0.62,"15min":0.62},"max":{"1min":1.391,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":0.92700000000000005},{"interface":"front","average":{"1min":1.153,"5min":1.0680000000000001,"15min":1.046},"min":{"1min":0.78500000000000003,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.5189999999999999,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":0.996}]},{"osd":1,"last update":"Fri Oct 6 03:03:50 2023","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.222,"15min":1.212},"min":{"1min":0.89400000000000002,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":1.6879999999999999,"5min":1.984,"15min":1.984},"last":1.502},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.169,"15min":1.161},"min":{"1min":0.83999999999999997,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":2.0899999999999999,"5min":2.0899999999999999,"15min":2.0899999999999999},"last":1.306}]},{"osd":2,"last update":"Fri Oct 6 03:03:50 2023","interfaces":[{"interface":"back","average":{"1min":1.3,"5min":1.3640000000000001,"15min":1.3839999999999999},"min":{"1min":0.94799999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":1.7350000000000001,"5min":1.78,"15min":1.78},"last":1.47},{"interface":"front","average":{"1min":1.286,"5min":1.306,"15min":1.3049999999999999},"min":{"1min":1.0049999999999999,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":1.5489999999999999,"5min":2.8319999999999999,"15min":2.8319999999999999},"last":1.3520000000000001}]},{"osd":3,"last update":"Fri Oct 6 03:03:50 2023","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2589999999999999},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.589,"5min":3.1789999999999998,"15min":3.1789999999999998},"last":1.399},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.296,"15min":1.28},"min":{"1min":0.90300000000000002,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":2.2549999999999999,"5min":2.2549999999999999,"15min":2.2549999999999999},"last":1.5449999999999999}]},{"osd":4,"last update":"Fri Oct 6 03:03:50 2023","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.2370000000000001,"15min":1.28},"min":{"1min":0.81100000000000005,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.4570000000000001,"5min":2.5899999999999999,"15min":2.5899999999999999},"last":1.224},{"interface":"front","average":{"1min":1.369,"5min":1.4570000000000001,"15min":1.496},"min":{"1min":0.96899999999999997,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.764,"5min":4.5419999999999998,"15min":4.5419999999999998},"last":1.6459999999999999}]},{"osd":6,"last update":"Fri Oct 6 03:03:50 2023","interfaces":[{"interface":"back","average":{"1min":1.208,"5min":1.3380000000000001,"15min":1.3720000000000001},"min":{"1min":0.82399999999999995,"5min":0.754,"15min":0.754},"max":{"1min":1.5980000000000001,"5min":1.847,"15min":1.847},"last":1.593},{"interface":"front","average":{"1min":1.319,"5min":1.3620000000000001,"15min":1.3759999999999999},"min":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"max":{"1min":1.599,"5min":2.9239999999999999,"15min":2.9239999999999999},"last":1.4410000000000001}]},{"osd":7,"last update":"Fri Oct 6 03:03:50 2023","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.3700000000000001,"15min":1.3979999999999999},"min":{"1min":1.0169999999999999,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.8080000000000001,"5min":4.4489999999999998,"15min":4.4489999999999998},"last":1.2629999999999999},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.387,"15min":1.419},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.7130000000000001,"5min":1.98,"15min":1.98},"last":1.1719999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574889,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302076,"kb_used_data":692,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069764,"statfs":{"total":96636764160,"available":96327438336,"internally_reserved":0,"allocated":708608,"data_stored":312809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:03:51 2023","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.093,"15min":1.089},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.5509999999999999,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":0.97499999999999998},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.093,"15min":1.079},"min":{"1min":0.80600000000000005,"5min":0.625,"15min":0.625},"max":{"1min":1.4359999999999999,"5min":1.585,"15min":1.585},"last":0.85199999999999998}]},{"osd":1,"last update":"Fri Oct 6 03:03:51 2023","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":1.0740000000000001,"15min":1.0569999999999999},"min":{"1min":0.75600000000000001,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.3999999999999999,"5min":1.621,"15min":1.621},"last":1.052},{"interface":"front","average":{"1min":1.133,"5min":1.1759999999999999,"15min":1.171},"min":{"1min":0.80200000000000005,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.411,"5min":1.73,"15min":1.73},"last":0.76500000000000001}]},{"osd":2,"last update":"Fri Oct 6 03:03:51 2023","interfaces":[{"interface":"back","average":{"1min":1.296,"5min":1.2889999999999999,"15min":1.2849999999999999},"min":{"1min":0.95299999999999996,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.5589999999999999,"5min":1.696,"15min":1.696},"last":1.3440000000000001},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.329,"15min":1.3360000000000001},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.571,"5min":1.788,"15min":1.788},"last":1.0980000000000001}]},{"osd":3,"last update":"Fri Oct 6 03:03:51 2023","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.222,"15min":1.2390000000000001},"min":{"1min":0.76500000000000001,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.407,"5min":1.706,"15min":1.706},"last":1.012},{"interface":"front","average":{"1min":1.1890000000000001,"5min":1.2370000000000001,"15min":1.2330000000000001},"min":{"1min":0.96999999999999997,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.3799999999999999,"5min":2.1960000000000002,"15min":2.1960000000000002},"last":1.286}]},{"osd":5,"last update":"Fri Oct 6 03:03:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.2110000000000001,"15min":1.202},"min":{"1min":0.86299999999999999,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.496,"5min":1.71,"15min":1.71},"last":0.91200000000000003},{"interface":"front","average":{"1min":1.206,"5min":1.302,"15min":1.343},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.4990000000000001,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":1.25}]},{"osd":6,"last update":"Fri Oct 6 03:03:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2609999999999999,"5min":1.327,"15min":1.371},"min":{"1min":0.63500000000000001,"5min":0.629,"15min":0.629},"max":{"1min":1.7949999999999999,"5min":2.9100000000000001,"15min":2.9100000000000001},"last":1.466},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.429,"15min":1.4610000000000001},"min":{"1min":1.0329999999999999,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.605,"5min":3.282,"15min":3.282},"last":1.0329999999999999}]},{"osd":7,"last update":"Fri Oct 6 03:03:51 2023","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":1.4490000000000001,"15min":1.512},"min":{"1min":0.91900000000000004,"5min":0.88700000000000001,"15min":0.88700000000000001},"max":{"1min":1.591,"5min":2.145,"15min":2.145},"last":1.1679999999999999},{"interface":"front","average":{"1min":1.411,"5min":1.4330000000000001,"15min":1.4350000000000001},"min":{"1min":0.874,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.7350000000000001,"5min":1.927,"15min":1.927},"last":1.526}]}]},{"osd":3,"up_from":13,"seq":55834574889,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302076,"kb_used_data":692,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069764,"statfs":{"total":96636764160,"available":96327438336,"internally_reserved":0,"allocated":708608,"data_stored":312809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:03:49 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.95799999999999996,"15min":0.99399999999999999},"min":{"1min":0.67100000000000004,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.3919999999999999,"5min":2.298,"15min":2.298},"last":0.81299999999999994},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.01,"15min":1.002},"min":{"1min":0.752,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.339,"5min":2.1850000000000001,"15min":2.1850000000000001},"last":1.5149999999999999}]},{"osd":1,"last update":"Fri Oct 6 03:03:49 2023","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.97399999999999998,"15min":0.98599999999999999},"min":{"1min":0.65800000000000003,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.3480000000000001,"5min":1.974,"15min":1.974},"last":0.876},{"interface":"front","average":{"1min":1.127,"5min":1.1240000000000001,"15min":1.1319999999999999},"min":{"1min":0.86899999999999999,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.4710000000000001,"5min":1.71,"15min":1.71},"last":1.2370000000000001}]},{"osd":2,"last update":"Fri Oct 6 03:03:49 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":1.034,"15min":1.054},"min":{"1min":0.67600000000000005,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.4099999999999999,"5min":2.8849999999999998,"15min":2.8849999999999998},"last":1.329},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.0860000000000001,"15min":1.0920000000000001},"min":{"1min":0.84199999999999997,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.5780000000000001,"5min":2.8220000000000001,"15min":2.8220000000000001},"last":1.0029999999999999}]},{"osd":4,"last update":"Fri Oct 6 03:03:49 2023","interfaces":[{"interface":"back","average":{"1min":1.2849999999999999,"5min":1.393,"15min":1.4350000000000001},"min":{"1min":0.95299999999999996,"5min":0.751,"15min":0.751},"max":{"1min":1.7130000000000001,"5min":3.6560000000000001,"15min":3.6560000000000001},"last":1.6060000000000001},{"interface":"front","average":{"1min":1.335,"5min":1.401,"15min":1.444},"min":{"1min":1.0820000000000001,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.796,"5min":3.7749999999999999,"15min":3.7749999999999999},"last":1.393}]},{"osd":5,"last update":"Fri Oct 6 03:03:49 2023","interfaces":[{"interface":"back","average":{"1min":1.4119999999999999,"5min":1.478,"15min":1.5149999999999999},"min":{"1min":1.1679999999999999,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":1.8460000000000001,"5min":3.4910000000000001,"15min":3.4910000000000001},"last":1.5740000000000001},{"interface":"front","average":{"1min":1.377,"5min":1.4370000000000001,"15min":1.4750000000000001},"min":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"max":{"1min":1.6519999999999999,"5min":2.6240000000000001,"15min":2.6240000000000001},"last":1.0980000000000001}]},{"osd":6,"last update":"Fri Oct 6 03:03:49 2023","interfaces":[{"interface":"back","average":{"1min":1.359,"5min":1.4870000000000001,"15min":1.5469999999999999},"min":{"1min":1.0349999999999999,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":1.7549999999999999,"5min":3.7050000000000001,"15min":3.7050000000000001},"last":1.6819999999999999},{"interface":"front","average":{"1min":1.3540000000000001,"5min":1.4990000000000001,"15min":1.5549999999999999},"min":{"1min":0.97699999999999998,"5min":0.80900000000000005,"15min":0.80900000000000005},"max":{"1min":1.901,"5min":3.9300000000000002,"15min":3.9300000000000002},"last":1.4830000000000001}]},{"osd":7,"last update":"Fri Oct 6 03:03:49 2023","interfaces":[{"interface":"back","average":{"1min":1.4299999999999999,"5min":1.5449999999999999,"15min":1.605},"min":{"1min":1.073,"5min":1.0369999999999999,"15min":1.0369999999999999},"max":{"1min":1.9330000000000001,"5min":2.96,"15min":2.96},"last":1.4379999999999999},{"interface":"front","average":{"1min":1.4950000000000001,"5min":1.6579999999999999,"15min":1.734},"min":{"1min":1.1419999999999999,"5min":0.90600000000000003,"15min":0.90600000000000003},"max":{"1min":1.9810000000000001,"5min":3.8559999999999999,"15min":3.8559999999999999},"last":1.7310000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574889,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302076,"kb_used_data":692,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069764,"statfs":{"total":96636764160,"available":96327438336,"internally_reserved":0,"allocated":708608,"data_stored":312809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:03:50 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.86099999999999999,"15min":0.86799999999999999},"min":{"1min":0.54500000000000004,"5min":0.496,"15min":0.496},"max":{"1min":1.2290000000000001,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.91700000000000004,"15min":0.93799999999999994},"min":{"1min":0.61799999999999999,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.3340000000000001,"5min":1.502,"15min":1.502},"last":1.056}]},{"osd":1,"last update":"Fri Oct 6 03:03:50 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.075,"15min":1.087},"min":{"1min":0.64700000000000002,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":1.508},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.1899999999999999,"15min":1.218},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.484,"5min":2.1800000000000002,"15min":2.1800000000000002},"last":1.173}]},{"osd":3,"last update":"Fri Oct 6 03:03:50 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.94599999999999995,"15min":0.96199999999999997},"min":{"1min":0.63100000000000001,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.2430000000000001,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":1.2569999999999999},{"interface":"front","average":{"1min":1.125,"5min":1.147,"15min":1.1719999999999999},"min":{"1min":0.73699999999999999,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.5289999999999999,"5min":2.806,"15min":2.806},"last":1.3779999999999999}]},{"osd":4,"last update":"Fri Oct 6 03:03:50 2023","interfaces":[{"interface":"back","average":{"1min":1.266,"5min":1.339,"15min":1.3720000000000001},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.7090000000000001,"5min":2.1739999999999999,"15min":2.1739999999999999},"last":1.782},{"interface":"front","average":{"1min":1.242,"5min":1.3779999999999999,"15min":1.431},"min":{"1min":0.996,"5min":0.83699999999999997,"15min":0.83699999999999997},"max":{"1min":1.5429999999999999,"5min":3.028,"15min":3.028},"last":1.5900000000000001}]},{"osd":5,"last update":"Fri Oct 6 03:03:50 2023","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.4650000000000001,"15min":1.5209999999999999},"min":{"1min":1.1000000000000001,"5min":0.90100000000000002,"15min":0.90100000000000002},"max":{"1min":1.5469999999999999,"5min":3.1499999999999999,"15min":3.1499999999999999},"last":1.669},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.4259999999999999,"15min":1.4830000000000001},"min":{"1min":0.95599999999999996,"5min":0.85899999999999999,"15min":0.85899999999999999},"max":{"1min":1.704,"5min":2.8580000000000001,"15min":2.8580000000000001},"last":1.8220000000000001}]},{"osd":6,"last update":"Fri Oct 6 03:03:50 2023","interfaces":[{"interface":"back","average":{"1min":1.2789999999999999,"5min":1.397,"15min":1.45},"min":{"1min":0.91900000000000004,"5min":0.86299999999999999,"15min":0.86299999999999999},"max":{"1min":1.829,"5min":2.6659999999999999,"15min":2.6659999999999999},"last":1.5489999999999999},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.4490000000000001,"15min":1.4970000000000001},"min":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"max":{"1min":1.6759999999999999,"5min":2.411,"15min":2.411},"last":1.6319999999999999}]},{"osd":7,"last update":"Fri Oct 6 03:03:50 2023","interfaces":[{"interface":"back","average":{"1min":1.3759999999999999,"5min":1.544,"15min":1.6040000000000001},"min":{"1min":1.0880000000000001,"5min":1.01,"15min":1.01},"max":{"1min":1.579,"5min":3.2160000000000002,"15min":3.2160000000000002},"last":1.4590000000000001},{"interface":"front","average":{"1min":1.3979999999999999,"5min":1.5369999999999999,"15min":1.599},"min":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"max":{"1min":1.8879999999999999,"5min":3.1059999999999999,"15min":3.1059999999999999},"last":1.694}]}]},{"osd":1,"up_from":13,"seq":55834574890,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302076,"kb_used_data":692,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069764,"statfs":{"total":96636764160,"available":96327438336,"internally_reserved":0,"allocated":708608,"data_stored":312809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:03:48 2023","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":0.93700000000000006,"15min":0.94899999999999995},"min":{"1min":0.57799999999999996,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.3759999999999999,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":1.0109999999999999},{"interface":"front","average":{"1min":1.113,"5min":1.0860000000000001,"15min":1.091},"min":{"1min":0.71499999999999997,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.4690000000000001,"5min":2.3260000000000001,"15min":2.3260000000000001},"last":1.399}]},{"osd":2,"last update":"Fri Oct 6 03:03:48 2023","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.98099999999999998,"15min":0.995},"min":{"1min":0.77500000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.27,"5min":3.5459999999999998,"15min":3.5459999999999998},"last":1.1899999999999999},{"interface":"front","average":{"1min":1.165,"5min":1.042,"15min":1.03},"min":{"1min":0.76400000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.5820000000000001,"5min":1.706,"15min":1.706},"last":1.2629999999999999}]},{"osd":3,"last update":"Fri Oct 6 03:03:48 2023","interfaces":[{"interface":"back","average":{"1min":1.218,"5min":1.1539999999999999,"15min":1.1459999999999999},"min":{"1min":0.71299999999999997,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.5760000000000001,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":1.071},{"interface":"front","average":{"1min":1.151,"5min":1.167,"15min":1.1859999999999999},"min":{"1min":0.93300000000000005,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.4730000000000001,"5min":3.331,"15min":3.331},"last":1.3180000000000001}]},{"osd":4,"last update":"Fri Oct 6 03:03:48 2023","interfaces":[{"interface":"back","average":{"1min":1.3080000000000001,"5min":1.3089999999999999,"15min":1.329},"min":{"1min":1.048,"5min":0.85899999999999999,"15min":0.85899999999999999},"max":{"1min":1.5640000000000001,"5min":2.0169999999999999,"15min":2.0169999999999999},"last":1.46},{"interface":"front","average":{"1min":1.238,"5min":1.298,"15min":1.3180000000000001},"min":{"1min":0.90900000000000003,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.639,"5min":3.2250000000000001,"15min":3.2250000000000001},"last":1.145}]},{"osd":5,"last update":"Fri Oct 6 03:03:48 2023","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":1.389,"15min":1.421},"min":{"1min":0.96599999999999997,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":1.704,"5min":2.8439999999999999,"15min":2.8439999999999999},"last":1.4339999999999999},{"interface":"front","average":{"1min":1.4470000000000001,"5min":1.4510000000000001,"15min":1.4730000000000001},"min":{"1min":1.0980000000000001,"5min":0.89800000000000002,"15min":0.89800000000000002},"max":{"1min":1.7390000000000001,"5min":2.4590000000000001,"15min":2.4590000000000001},"last":1.508}]},{"osd":6,"last update":"Fri Oct 6 03:03:48 2023","interfaces":[{"interface":"back","average":{"1min":1.3500000000000001,"5min":1.427,"15min":1.4530000000000001},"min":{"1min":0.89400000000000002,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.76,"5min":2.96,"15min":2.96},"last":1.3560000000000001},{"interface":"front","average":{"1min":1.472,"5min":1.474,"15min":1.494},"min":{"1min":1.0149999999999999,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.8080000000000001,"5min":2.5859999999999999,"15min":2.5859999999999999},"last":1.609}]},{"osd":7,"last update":"Fri Oct 6 03:03:48 2023","interfaces":[{"interface":"back","average":{"1min":1.415,"5min":1.512,"15min":1.573},"min":{"1min":1.1459999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":2.1299999999999999,"5min":3.4460000000000002,"15min":3.4460000000000002},"last":1.546},{"interface":"front","average":{"1min":1.458,"5min":1.5,"15min":1.5249999999999999},"min":{"1min":1.212,"5min":0.94099999999999995,"15min":0.94099999999999995},"max":{"1min":1.734,"5min":3.113,"15min":3.113},"last":1.4910000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574889,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302656,"kb_used_data":1272,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069184,"statfs":{"total":96636764160,"available":96326844416,"internally_reserved":0,"allocated":1302528,"data_stored":903177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 03:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.85099999999999998,"15min":0.82399999999999995},"min":{"1min":0.66700000000000004,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.2490000000000001,"5min":1.583,"15min":1.583},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.97799999999999998,"15min":0.99199999999999999},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.571,"5min":1.571,"15min":1.571},"last":0.55700000000000005}]},{"osd":2,"last update":"Fri Oct 6 03:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.98599999999999999,"15min":0.98399999999999999},"min":{"1min":0.71799999999999997,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.3220000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.998,"5min":1.089,"15min":1.1120000000000001},"min":{"1min":0.76100000000000001,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.2949999999999999,"5min":1.794,"15min":1.794},"last":0.69899999999999995}]},{"osd":3,"last update":"Fri Oct 6 03:03:46 2023","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":1.0349999999999999,"15min":1.018},"min":{"1min":0.70799999999999996,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.554,"5min":1.554,"15min":1.554},"last":0.82899999999999996},{"interface":"front","average":{"1min":1.298,"5min":1.226,"15min":1.2030000000000001},"min":{"1min":1.004,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.569,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.90100000000000002}]},{"osd":4,"last update":"Fri Oct 6 03:03:46 2023","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.244,"15min":1.2310000000000001},"min":{"1min":0.88400000000000001,"5min":0.86699999999999999,"15min":0.86699999999999999},"max":{"1min":1.5669999999999999,"5min":2.0680000000000001,"15min":2.0680000000000001},"last":1.0649999999999999},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.3300000000000001,"15min":1.3360000000000001},"min":{"1min":1.0409999999999999,"5min":0.93400000000000005,"15min":0.93400000000000005},"max":{"1min":1.5800000000000001,"5min":1.647,"15min":1.647},"last":0.94999999999999996}]},{"osd":5,"last update":"Fri Oct 6 03:03:46 2023","interfaces":[{"interface":"back","average":{"1min":1.256,"5min":1.379,"15min":1.4019999999999999},"min":{"1min":0.92500000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":1.728,"5min":1.8959999999999999,"15min":1.8959999999999999},"last":0.92700000000000005},{"interface":"front","average":{"1min":1.359,"5min":1.2909999999999999,"15min":1.2729999999999999},"min":{"1min":1.0449999999999999,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":1.6160000000000001,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":0.95899999999999996}]},{"osd":6,"last update":"Fri Oct 6 03:03:46 2023","interfaces":[{"interface":"back","average":{"1min":1.373,"5min":1.4199999999999999,"15min":1.4199999999999999},"min":{"1min":1.1459999999999999,"5min":0.89400000000000002,"15min":0.89400000000000002},"max":{"1min":1.7090000000000001,"5min":1.96,"15min":1.96},"last":0.98999999999999999},{"interface":"front","average":{"1min":1.389,"5min":1.4930000000000001,"15min":1.532},"min":{"1min":1.117,"5min":0.89800000000000002,"15min":0.89800000000000002},"max":{"1min":1.859,"5min":2.0539999999999998,"15min":2.0539999999999998},"last":1.161}]},{"osd":7,"last update":"Fri Oct 6 03:03:46 2023","interfaces":[{"interface":"back","average":{"1min":1.4039999999999999,"5min":1.5569999999999999,"15min":1.607},"min":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"max":{"1min":1.7989999999999999,"5min":2.1019999999999999,"15min":2.1019999999999999},"last":1.3100000000000001},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.413,"15min":1.425},"min":{"1min":1.091,"5min":0.875,"15min":0.875},"max":{"1min":1.681,"5min":2.1499999999999999,"15min":2.1499999999999999},"last":1.361}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:04:00.617 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:04:00.763 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.760+0000 7fa30dee3700 1 Processor -- start 2023-10-06T03:04:00.764 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.760+0000 7fa30dee3700 1 -- start start 2023-10-06T03:04:00.765 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.760+0000 7fa30dee3700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fa30806d030 0x7fa30806a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:00.765 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.760+0000 7fa30dee3700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa30806acd0 con 0x7fa308159160 2023-10-06T03:04:00.766 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.760+0000 7fa30dee3700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa30806afb0 con 0x7fa308158d90 2023-10-06T03:04:00.766 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.760+0000 7fa30dee3700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa30806b290 con 0x7fa30806d030 2023-10-06T03:04:00.766 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.760+0000 7fa30d6e2700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fa308159160 0x7fa308162b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:54332/0 (socket says 172.21.15.57:54332) 2023-10-06T03:04:00.766 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.760+0000 7fa30d6e2700 1 -- 172.21.15.57:0/1336712551 learned_addr learned my addr 172.21.15.57:0/1336712551 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:04:00.766 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.760+0000 7fa307fff700 1 --2- 172.21.15.57:0/1336712551 >> v2:172.21.15.105:3300/0 conn(0x7fa30806d030 0x7fa30806a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:00.767 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.764+0000 7fa3077fe700 1 -- 172.21.15.57:0/1336712551 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1554456112 0 0) 0x7fa30806acd0 con 0x7fa308159160 2023-10-06T03:04:00.767 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.764+0000 7fa3077fe700 1 -- 172.21.15.57:0/1336712551 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2f8003570 con 0x7fa308159160 2023-10-06T03:04:00.767 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.764+0000 7fa307fff700 1 -- 172.21.15.57:0/1336712551 >> v1:172.21.15.105:6789/0 conn(0x7fa308158d90 legacy=0x7fa30806c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:00.767 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.764+0000 7fa3077fe700 1 -- 172.21.15.57:0/1336712551 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1970449431 0 0) 0x7fa2f8003570 con 0x7fa308159160 2023-10-06T03:04:00.768 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.764+0000 7fa307fff700 1 -- 172.21.15.57:0/1336712551 >> v1:172.21.15.57:6789/0 conn(0x7fa308159160 legacy=0x7fa308162b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:00.768 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.764+0000 7fa307fff700 1 -- 172.21.15.57:0/1336712551 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa30806b570 con 0x7fa30806d030 2023-10-06T03:04:00.768 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.764+0000 7fa307fff700 1 --2- 172.21.15.57:0/1336712551 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa30806d030 0x7fa30806a6f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fa2f40098e0 tx=0x7fa2f40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=edb3f2e44b52e983 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:00.768 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.764+0000 7fa3077fe700 1 -- 172.21.15.57:0/1336712551 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3000017f0 con 0x7fa30806d030 2023-10-06T03:04:00.769 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.764+0000 7fa3077fe700 1 -- 172.21.15.57:0/1336712551 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2f4011420 con 0x7fa30806d030 2023-10-06T03:04:00.769 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.764+0000 7fa3077fe700 1 -- 172.21.15.57:0/1336712551 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f40117c0 con 0x7fa30806d030 2023-10-06T03:04:00.769 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.764+0000 7fa30dee3700 1 -- 172.21.15.57:0/1336712551 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa30806d030 msgr2=0x7fa30806a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:00.769 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.764+0000 7fa30dee3700 1 --2- 172.21.15.57:0/1336712551 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa30806d030 0x7fa30806a6f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fa2f40098e0 tx=0x7fa2f40091a0 comp rx=0 tx=0).stop 2023-10-06T03:04:00.770 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.764+0000 7fa30dee3700 1 -- 172.21.15.57:0/1336712551 shutdown_connections 2023-10-06T03:04:00.770 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.764+0000 7fa30dee3700 1 --2- 172.21.15.57:0/1336712551 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa30806d030 0x7fa30806a6f0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:00.770 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.764+0000 7fa30dee3700 1 -- 172.21.15.57:0/1336712551 >> 172.21.15.57:0/1336712551 conn(0x7fa3080c85e0 msgr2=0x7fa3080c89e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:00.770 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.764+0000 7fa30dee3700 1 -- 172.21.15.57:0/1336712551 shutdown_connections 2023-10-06T03:04:00.770 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.764+0000 7fa30dee3700 1 -- 172.21.15.57:0/1336712551 wait complete. 2023-10-06T03:04:00.771 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.768+0000 7fa30dee3700 1 Processor -- start 2023-10-06T03:04:00.772 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.768+0000 7fa30dee3700 1 -- start start 2023-10-06T03:04:00.773 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.768+0000 7fa30dee3700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa30806d030 0x7fa308155320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:00.774 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.768+0000 7fa30dee3700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa308158d90 0x7fa30815a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:00.774 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.768+0000 7fa30dee3700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa308159160 0x7fa30815ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:00.774 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.768+0000 7fa30dee3700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa308157720 con 0x7fa308159160 2023-10-06T03:04:00.774 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.768+0000 7fa30dee3700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3080c0be0 con 0x7fa30806d030 2023-10-06T03:04:00.774 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.768+0000 7fa30dee3700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa30815a100 con 0x7fa308158d90 2023-10-06T03:04:00.774 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.768+0000 7fa30d6e2700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa308159160 0x7fa30815ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:00.774 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.768+0000 7fa30d6e2700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa308159160 0x7fa30815ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:52230/0 (socket says 172.21.15.57:52230) 2023-10-06T03:04:00.774 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.768+0000 7fa30d6e2700 1 -- 172.21.15.57:0/3179211146 learned_addr learned my addr 172.21.15.57:0/3179211146 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:04:00.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.768+0000 7fa307fff700 1 --2- 172.21.15.57:0/3179211146 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa308158d90 0x7fa30815a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:00.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.768+0000 7fa30cee1700 1 --2- 172.21.15.57:0/3179211146 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa30806d030 0x7fa308155320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:00.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.772+0000 7fa30d6e2700 1 -- 172.21.15.57:0/3179211146 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa308158d90 msgr2=0x7fa30815a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:00.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.772+0000 7fa30d6e2700 1 --2- 172.21.15.57:0/3179211146 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa308158d90 0x7fa30815a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:00.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.772+0000 7fa30d6e2700 1 -- 172.21.15.57:0/3179211146 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa30806d030 msgr2=0x7fa308155320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:00.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.772+0000 7fa30d6e2700 1 --2- 172.21.15.57:0/3179211146 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa30806d030 0x7fa308155320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:00.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.772+0000 7fa30d6e2700 1 -- 172.21.15.57:0/3179211146 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2f4009420 con 0x7fa308159160 2023-10-06T03:04:00.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.772+0000 7fa307fff700 1 --2- 172.21.15.57:0/3179211146 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa308158d90 0x7fa30815a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:04:00.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.772+0000 7fa30cee1700 1 --2- 172.21.15.57:0/3179211146 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa30806d030 0x7fa308155320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:04:00.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.772+0000 7fa30d6e2700 1 --2- 172.21.15.57:0/3179211146 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa308159160 0x7fa30815ac90 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fa30000cc10 tx=0x7fa300001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:00.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.772+0000 7fa304ff9700 1 -- 172.21.15.57:0/3179211146 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa300004dc0 con 0x7fa308159160 2023-10-06T03:04:00.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.772+0000 7fa304ff9700 1 -- 172.21.15.57:0/3179211146 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa30000a720 con 0x7fa308159160 2023-10-06T03:04:00.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.772+0000 7fa304ff9700 1 -- 172.21.15.57:0/3179211146 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa30000aae0 con 0x7fa308159160 2023-10-06T03:04:00.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.772+0000 7fa30dee3700 1 -- 172.21.15.57:0/3179211146 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3081597d0 con 0x7fa308159160 2023-10-06T03:04:00.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.772+0000 7fa30dee3700 1 -- 172.21.15.57:0/3179211146 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa308159d90 con 0x7fa308159160 2023-10-06T03:04:00.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.772+0000 7fa30dee3700 1 -- 172.21.15.57:0/3179211146 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa30815a270 con 0x7fa308159160 2023-10-06T03:04:00.778 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.776+0000 7fa304ff9700 1 -- 172.21.15.57:0/3179211146 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fa300007150 con 0x7fa308159160 2023-10-06T03:04:00.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.776+0000 7fa304ff9700 1 --2- 172.21.15.57:0/3179211146 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fa2ec060580 0x7fa2ec062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:00.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.776+0000 7fa304ff9700 1 -- 172.21.15.57:0/3179211146 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5378+0+0 (secure 0 0 0) 0x7fa30007be30 con 0x7fa308159160 2023-10-06T03:04:00.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.776+0000 7fa30cee1700 1 --2- 172.21.15.57:0/3179211146 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fa2ec060580 0x7fa2ec062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:00.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.776+0000 7fa30cee1700 1 --2- 172.21.15.57:0/3179211146 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fa2ec060580 0x7fa2ec062a30 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fa2fc007fd0 tx=0x7fa2fc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:00.786 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.784+0000 7fa304ff9700 1 -- 172.21.15.57:0/3179211146 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fa30004c540 con 0x7fa308159160 2023-10-06T03:04:00.958 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.952+0000 7fa30dee3700 1 -- 172.21.15.57:0/3179211146 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa30804be40 con 0x7fa308159160 2023-10-06T03:04:00.959 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.956+0000 7fa304ff9700 1 -- 172.21.15.57:0/3179211146 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v59) v1 ==== 74+0+13909 (secure 0 0 0) 0x7fa300018020 con 0x7fa308159160 2023-10-06T03:04:00.959 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:04:00.959 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":59,"fsid":"eb56dc0f-9213-41cb-9aad-8ade6c802e98","created":"2023-10-06T03:00:30.806197+0000","modified":"2023-10-06T03:03:56.979824+0000","last_up_change":"2023-10-06T03:00:43.607454+0000","last_in_change":"2023-10-06T03:00:33.943513+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T03:00:44.360651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T03:00:50.466601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"58cf6c90-d704-43e0-b2db-dffe526d5e8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":33053},{"type":"v1","addr":"172.21.15.57:6801","nonce":33053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":33053},{"type":"v1","addr":"172.21.15.57:6803","nonce":33053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":33053},{"type":"v1","addr":"172.21.15.57:6807","nonce":33053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":33053},{"type":"v1","addr":"172.21.15.57:6805","nonce":33053}]},"public_addr":"172.21.15.57:6801/33053","cluster_addr":"172.21.15.57:6803/33053","heartbeat_back_addr":"172.21.15.57:6807/33053","heartbeat_front_addr":"172.21.15.57:6805/33053","state":["exists","up"]},{"osd":1,"uuid":"16afbe70-7f9e-4568-9c92-763e6e348119","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6809","nonce":33052},{"type":"v1","addr":"172.21.15.57:6810","nonce":33052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":33052},{"type":"v1","addr":"172.21.15.57:6813","nonce":33052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":33052},{"type":"v1","addr":"172.21.15.57:6822","nonce":33052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6815","nonce":33052},{"type":"v1","addr":"172.21.15.57:6818","nonce":33052}]},"public_addr":"172.21.15.57:6810/33052","cluster_addr":"172.21.15.57:6813/33052","heartbeat_back_addr":"172.21.15.57:6822/33052","heartbeat_front_addr":"172.21.15.57:6818/33052","state":["exists","up"]},{"osd":2,"uuid":"7255c62e-f92f-470f-a5ce-30228920d9f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":33058},{"type":"v1","addr":"172.21.15.57:6825","nonce":33058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":33058},{"type":"v1","addr":"172.21.15.57:6827","nonce":33058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":33058},{"type":"v1","addr":"172.21.15.57:6831","nonce":33058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":33058},{"type":"v1","addr":"172.21.15.57:6829","nonce":33058}]},"public_addr":"172.21.15.57:6825/33058","cluster_addr":"172.21.15.57:6827/33058","heartbeat_back_addr":"172.21.15.57:6831/33058","heartbeat_front_addr":"172.21.15.57:6829/33058","state":["exists","up"]},{"osd":3,"uuid":"152a236d-f799-4888-8544-74865508d5a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":33057},{"type":"v1","addr":"172.21.15.57:6811","nonce":33057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":33057},{"type":"v1","addr":"172.21.15.57:6816","nonce":33057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6821","nonce":33057},{"type":"v1","addr":"172.21.15.57:6823","nonce":33057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6817","nonce":33057},{"type":"v1","addr":"172.21.15.57:6819","nonce":33057}]},"public_addr":"172.21.15.57:6811/33057","cluster_addr":"172.21.15.57:6816/33057","heartbeat_back_addr":"172.21.15.57:6823/33057","heartbeat_front_addr":"172.21.15.57:6819/33057","state":["exists","up"]},{"osd":4,"uuid":"37db2a65-3566-41d0-9d60-e66c49e1e68e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":33368},{"type":"v1","addr":"172.21.15.105:6801","nonce":33368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":33368},{"type":"v1","addr":"172.21.15.105:6803","nonce":33368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":33368},{"type":"v1","addr":"172.21.15.105:6807","nonce":33368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":33368},{"type":"v1","addr":"172.21.15.105:6805","nonce":33368}]},"public_addr":"172.21.15.105:6801/33368","cluster_addr":"172.21.15.105:6803/33368","heartbeat_back_addr":"172.21.15.105:6807/33368","heartbeat_front_addr":"172.21.15.105:6805/33368","state":["exists","up"]},{"osd":5,"uuid":"35e77918-1bb4-42ca-9b20-f3c14eaa0c04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":33379},{"type":"v1","addr":"172.21.15.105:6818","nonce":33379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":33379},{"type":"v1","addr":"172.21.15.105:6823","nonce":33379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":33379},{"type":"v1","addr":"172.21.15.105:6831","nonce":33379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":33379},{"type":"v1","addr":"172.21.15.105:6827","nonce":33379}]},"public_addr":"172.21.15.105:6818/33379","cluster_addr":"172.21.15.105:6823/33379","heartbeat_back_addr":"172.21.15.105:6831/33379","heartbeat_front_addr":"172.21.15.105:6827/33379","state":["exists","up"]},{"osd":6,"uuid":"b4d9d510-7a45-4173-8287-c6c8d6547f2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":33369},{"type":"v1","addr":"172.21.15.105:6819","nonce":33369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":33369},{"type":"v1","addr":"172.21.15.105:6822","nonce":33369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":33369},{"type":"v1","addr":"172.21.15.105:6830","nonce":33369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":33369},{"type":"v1","addr":"172.21.15.105:6826","nonce":33369}]},"public_addr":"172.21.15.105:6819/33369","cluster_addr":"172.21.15.105:6822/33369","heartbeat_back_addr":"172.21.15.105:6830/33369","heartbeat_front_addr":"172.21.15.105:6826/33369","state":["exists","up"]},{"osd":7,"uuid":"74266fb0-cd84-463f-8bf0-092652a71dc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":33370},{"type":"v1","addr":"172.21.15.105:6809","nonce":33370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":33370},{"type":"v1","addr":"172.21.15.105:6811","nonce":33370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":33370},{"type":"v1","addr":"172.21.15.105:6815","nonce":33370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":33370},{"type":"v1","addr":"172.21.15.105:6813","nonce":33370}]},"public_addr":"172.21.15.105:6809/33370","cluster_addr":"172.21.15.105:6811/33370","heartbeat_back_addr":"172.21.15.105:6815/33370","heartbeat_front_addr":"172.21.15.105:6813/33370","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.596864+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.633851+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.636993+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.529681+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.608601+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.659752+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.661717+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:00:39.642221+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.57:6837/3347844181":"2023-10-07T03:03:53.729423+0000","172.21.15.57:6836/3347844181":"2023-10-07T03:03:53.729423+0000","172.21.15.57:6837/4147766471":"2023-10-07T03:02:52.815979+0000","172.21.15.57:6835/4147766471":"2023-10-07T03:02:52.815979+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:04:00.964 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.960+0000 7fa30dee3700 1 -- 172.21.15.57:0/3179211146 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fa2ec060580 msgr2=0x7fa2ec062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:00.964 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.960+0000 7fa30dee3700 1 --2- 172.21.15.57:0/3179211146 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fa2ec060580 0x7fa2ec062a30 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fa2fc007fd0 tx=0x7fa2fc009040 comp rx=0 tx=0).stop 2023-10-06T03:04:00.964 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.960+0000 7fa30dee3700 1 -- 172.21.15.57:0/3179211146 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa308159160 msgr2=0x7fa30815ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:00.964 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.960+0000 7fa30dee3700 1 --2- 172.21.15.57:0/3179211146 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa308159160 0x7fa30815ac90 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fa30000cc10 tx=0x7fa300001640 comp rx=0 tx=0).stop 2023-10-06T03:04:00.965 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.960+0000 7fa30dee3700 1 -- 172.21.15.57:0/3179211146 shutdown_connections 2023-10-06T03:04:00.965 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.960+0000 7fa30dee3700 1 --2- 172.21.15.57:0/3179211146 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa308159160 0x7fa30815ac90 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:00.965 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.960+0000 7fa30dee3700 1 --2- 172.21.15.57:0/3179211146 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fa2ec060580 0x7fa2ec062a30 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:00.965 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.960+0000 7fa30dee3700 1 --2- 172.21.15.57:0/3179211146 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa308158d90 0x7fa30815a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:00.965 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.960+0000 7fa30dee3700 1 --2- 172.21.15.57:0/3179211146 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa30806d030 0x7fa308155320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:00.965 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.960+0000 7fa30dee3700 1 -- 172.21.15.57:0/3179211146 >> 172.21.15.57:0/3179211146 conn(0x7fa3080c85e0 msgr2=0x7fa3080af110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:00.965 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.960+0000 7fa30dee3700 1 -- 172.21.15.57:0/3179211146 shutdown_connections 2023-10-06T03:04:00.965 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:00.960+0000 7fa30dee3700 1 -- 172.21.15.57:0/3179211146 wait complete. 2023-10-06T03:04:01.986 INFO:tasks.ceph:Scrubbing osd.0 2023-10-06T03:04:01.986 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-10-06T03:04:02.159 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.156+0000 7f65132e3700 1 Processor -- start 2023-10-06T03:04:02.160 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.156+0000 7f65132e3700 1 -- start start 2023-10-06T03:04:02.163 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.160+0000 7f65132e3700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f650c140820 0x7f650c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:02.163 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.160+0000 7f65132e3700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f650c15a940 0x7f650c068060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:02.163 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.160+0000 7f65132e3700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f650c06a840 con 0x7f650c140450 2023-10-06T03:04:02.163 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.160+0000 7f65132e3700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f650c0ac930 con 0x7f650c15a940 2023-10-06T03:04:02.163 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.160+0000 7f65132e3700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f650c15aec0 con 0x7f650c140820 2023-10-06T03:04:02.163 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.160+0000 7f65122e1700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f650c140450 0x7f650c0ac220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:54346/0 (socket says 172.21.15.57:54346) 2023-10-06T03:04:02.163 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.160+0000 7f65122e1700 1 -- 172.21.15.57:0/1922486969 learned_addr learned my addr 172.21.15.57:0/1922486969 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:04:02.164 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.160+0000 7f6511ae0700 1 --2- 172.21.15.57:0/1922486969 >> v2:172.21.15.105:3300/0 conn(0x7f650c140820 0x7f650c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:02.165 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.160+0000 7f6512ae2700 1 --2- 172.21.15.57:0/1922486969 >> v2:172.21.15.57:3300/0 conn(0x7f650c15a940 0x7f650c068060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:02.165 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.160+0000 7f65112df700 1 -- 172.21.15.57:0/1922486969 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2972078788 0 0) 0x7f650c06a840 con 0x7f650c140450 2023-10-06T03:04:02.165 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.160+0000 7f65112df700 1 -- 172.21.15.57:0/1922486969 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64f8003570 con 0x7f650c140450 2023-10-06T03:04:02.165 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.160+0000 7f6511ae0700 1 -- 172.21.15.57:0/1922486969 >> v2:172.21.15.57:3300/0 conn(0x7f650c15a940 msgr2=0x7f650c068060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:02.165 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.160+0000 7f6511ae0700 1 --2- 172.21.15.57:0/1922486969 >> v2:172.21.15.57:3300/0 conn(0x7f650c15a940 0x7f650c068060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:02.165 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.160+0000 7f6511ae0700 1 -- 172.21.15.57:0/1922486969 >> v1:172.21.15.57:6789/0 conn(0x7f650c140450 legacy=0x7f650c0ac220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:02.165 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.160+0000 7f6511ae0700 1 -- 172.21.15.57:0/1922486969 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f650c15b1a0 con 0x7f650c140820 2023-10-06T03:04:02.166 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.160+0000 7f6511ae0700 1 --2- 172.21.15.57:0/1922486969 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f650c140820 0x7f650c06c920 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f650c06de10 tx=0x7f64fc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=754ebc96b3458939 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:02.166 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.160+0000 7f65112df700 1 -- 172.21.15.57:0/1922486969 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64fc011630 con 0x7f650c140820 2023-10-06T03:04:02.166 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.160+0000 7f65112df700 1 -- 172.21.15.57:0/1922486969 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64fc0117b0 con 0x7f650c140820 2023-10-06T03:04:02.166 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.160+0000 7f65112df700 1 -- 172.21.15.57:0/1922486969 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64fc011b70 con 0x7f650c140820 2023-10-06T03:04:02.166 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.164+0000 7f65132e3700 1 -- 172.21.15.57:0/1922486969 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f650c140820 msgr2=0x7f650c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:02.167 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.164+0000 7f65132e3700 1 --2- 172.21.15.57:0/1922486969 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f650c140820 0x7f650c06c920 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f650c06de10 tx=0x7f64fc0091a0 comp rx=0 tx=0).stop 2023-10-06T03:04:02.167 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.164+0000 7f65132e3700 1 -- 172.21.15.57:0/1922486969 shutdown_connections 2023-10-06T03:04:02.167 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.164+0000 7f65132e3700 1 --2- 172.21.15.57:0/1922486969 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f650c140820 0x7f650c06c920 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:02.167 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.164+0000 7f65132e3700 1 --2- 172.21.15.57:0/1922486969 >> v2:172.21.15.57:3300/0 conn(0x7f650c15a940 0x7f650c068060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:02.167 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.164+0000 7f65132e3700 1 -- 172.21.15.57:0/1922486969 >> 172.21.15.57:0/1922486969 conn(0x7f650c0c85a0 msgr2=0x7f650c0c89a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:02.168 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.164+0000 7f65132e3700 1 -- 172.21.15.57:0/1922486969 shutdown_connections 2023-10-06T03:04:02.168 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.164+0000 7f65132e3700 1 -- 172.21.15.57:0/1922486969 wait complete. 2023-10-06T03:04:02.169 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.164+0000 7f65132e3700 1 Processor -- start 2023-10-06T03:04:02.169 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.164+0000 7f65132e3700 1 -- start start 2023-10-06T03:04:02.170 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.168+0000 7f65132e3700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f650c140450 0x7f650c0aff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:02.171 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.168+0000 7f65132e3700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f650c140820 0x7f650c1376d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:02.171 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.168+0000 7f65132e3700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f650c15a940 0x7f650c0aeaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:02.171 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.168+0000 7f65132e3700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f650c138fc0 con 0x7f650c140820 2023-10-06T03:04:02.171 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.168+0000 7f65132e3700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f650c0b0560 con 0x7f650c15a940 2023-10-06T03:04:02.171 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.168+0000 7f65132e3700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f650c0b0840 con 0x7f650c140450 2023-10-06T03:04:02.172 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.168+0000 7f6511ae0700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f650c140820 0x7f650c1376d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:02.172 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.168+0000 7f6511ae0700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f650c140820 0x7f650c1376d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:52244/0 (socket says 172.21.15.57:52244) 2023-10-06T03:04:02.172 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.168+0000 7f6511ae0700 1 -- 172.21.15.57:0/200501801 learned_addr learned my addr 172.21.15.57:0/200501801 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:04:02.172 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.168+0000 7f65122e1700 1 --2- 172.21.15.57:0/200501801 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f650c140450 0x7f650c0aff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:02.172 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.168+0000 7f6512ae2700 1 --2- 172.21.15.57:0/200501801 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f650c15a940 0x7f650c0aeaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:02.173 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.168+0000 7f6511ae0700 1 -- 172.21.15.57:0/200501801 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f650c140450 msgr2=0x7f650c0aff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:02.173 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.168+0000 7f6511ae0700 1 --2- 172.21.15.57:0/200501801 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f650c140450 0x7f650c0aff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:02.173 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.168+0000 7f6511ae0700 1 -- 172.21.15.57:0/200501801 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f650c15a940 msgr2=0x7f650c0aeaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:02.173 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.168+0000 7f6511ae0700 1 --2- 172.21.15.57:0/200501801 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f650c15a940 0x7f650c0aeaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:02.173 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.168+0000 7f6511ae0700 1 -- 172.21.15.57:0/200501801 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64fc009420 con 0x7f650c140820 2023-10-06T03:04:02.173 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.168+0000 7f65122e1700 1 --2- 172.21.15.57:0/200501801 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f650c140450 0x7f650c0aff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:04:02.173 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.168+0000 7f6512ae2700 1 --2- 172.21.15.57:0/200501801 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f650c15a940 0x7f650c0aeaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:04:02.173 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.168+0000 7f6511ae0700 1 --2- 172.21.15.57:0/200501801 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f650c140820 0x7f650c1376d0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f64fc013000 tx=0x7f64fc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:02.174 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.168+0000 7f65027fc700 1 -- 172.21.15.57:0/200501801 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64fc01f070 con 0x7f650c140820 2023-10-06T03:04:02.174 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.168+0000 7f65027fc700 1 -- 172.21.15.57:0/200501801 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64fc000bc0 con 0x7f650c140820 2023-10-06T03:04:02.174 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.168+0000 7f65132e3700 1 -- 172.21.15.57:0/200501801 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f650c0b0b20 con 0x7f650c140820 2023-10-06T03:04:02.174 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.168+0000 7f65027fc700 1 -- 172.21.15.57:0/200501801 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64fc011b70 con 0x7f650c140820 2023-10-06T03:04:02.174 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.168+0000 7f65132e3700 1 -- 172.21.15.57:0/200501801 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f650c15a370 con 0x7f650c140820 2023-10-06T03:04:02.174 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.172+0000 7f65132e3700 1 -- 172.21.15.57:0/200501801 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f650c04be40 con 0x7f650c140820 2023-10-06T03:04:02.176 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.172+0000 7f65027fc700 1 -- 172.21.15.57:0/200501801 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f64fc023070 con 0x7f650c140820 2023-10-06T03:04:02.178 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.172+0000 7f65027fc700 1 --2- 172.21.15.57:0/200501801 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f64f00605d0 0x7f64f0062a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:02.178 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.172+0000 7f65027fc700 1 -- 172.21.15.57:0/200501801 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5378+0+0 (secure 0 0 0) 0x7f64fc07dab0 con 0x7f650c140820 2023-10-06T03:04:02.178 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.176+0000 7f65122e1700 1 --2- 172.21.15.57:0/200501801 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f64f00605d0 0x7f64f0062a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:02.179 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.176+0000 7f65027fc700 1 --2- 172.21.15.57:0/200501801 >> [v2:172.21.15.57:6800/33053,v1:172.21.15.57:6801/33053] conn(0x7f64f0066ae0 0x7f64f0068ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:02.179 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.176+0000 7f65027fc700 1 -- 172.21.15.57:0/200501801 --> [v2:172.21.15.57:6800/33053,v1:172.21.15.57:6801/33053] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f64f00695a0 con 0x7f64f0066ae0 2023-10-06T03:04:02.179 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.176+0000 7f65027fc700 1 -- 172.21.15.57:0/200501801 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=59) v2 ==== 24+0+0 (secure 0 0 0) 0x7f64fc082200 con 0x7f650c140820 2023-10-06T03:04:02.179 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.176+0000 7f6512ae2700 1 --2- 172.21.15.57:0/200501801 >> [v2:172.21.15.57:6800/33053,v1:172.21.15.57:6801/33053] conn(0x7f64f0066ae0 0x7f64f0068ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:02.180 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.176+0000 7f65122e1700 1 --2- 172.21.15.57:0/200501801 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f64f00605d0 0x7f64f0062a80 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f65080058d0 tx=0x7f6508009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:02.180 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.176+0000 7f6512ae2700 1 --2- 172.21.15.57:0/200501801 >> [v2:172.21.15.57:6800/33053,v1:172.21.15.57:6801/33053] conn(0x7f64f0066ae0 0x7f64f0068ef0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:02.181 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.176+0000 7f65027fc700 1 -- 172.21.15.57:0/200501801 <== osd.0 v2:172.21.15.57:6800/33053 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f64f00695a0 con 0x7f64f0066ae0 2023-10-06T03:04:02.198 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.192+0000 7f65132e3700 1 -- 172.21.15.57:0/200501801 --> [v2:172.21.15.57:6800/33053,v1:172.21.15.57:6801/33053] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f650c15b480 con 0x7f64f0066ae0 2023-10-06T03:04:02.199 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.196+0000 7f65027fc700 1 -- 172.21.15.57:0/200501801 <== osd.0 v2:172.21.15.57:6800/33053 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f650c15b480 con 0x7f64f0066ae0 2023-10-06T03:04:02.199 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-10-06T03:04:02.199 INFO:teuthology.orchestra.run.smithi057.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T03:04:02.199 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-10-06T03:04:02.200 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.196+0000 7f65132e3700 1 -- 172.21.15.57:0/200501801 >> [v2:172.21.15.57:6800/33053,v1:172.21.15.57:6801/33053] conn(0x7f64f0066ae0 msgr2=0x7f64f0068ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:02.200 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.196+0000 7f65132e3700 1 --2- 172.21.15.57:0/200501801 >> [v2:172.21.15.57:6800/33053,v1:172.21.15.57:6801/33053] conn(0x7f64f0066ae0 0x7f64f0068ef0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:02.200 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.196+0000 7f65132e3700 1 -- 172.21.15.57:0/200501801 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f64f00605d0 msgr2=0x7f64f0062a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:02.200 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.196+0000 7f65132e3700 1 --2- 172.21.15.57:0/200501801 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f64f00605d0 0x7f64f0062a80 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f65080058d0 tx=0x7f6508009040 comp rx=0 tx=0).stop 2023-10-06T03:04:02.201 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.196+0000 7f65132e3700 1 -- 172.21.15.57:0/200501801 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f650c140820 msgr2=0x7f650c1376d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:02.201 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.196+0000 7f65132e3700 1 --2- 172.21.15.57:0/200501801 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f650c140820 0x7f650c1376d0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f64fc013000 tx=0x7f64fc017000 comp rx=0 tx=0).stop 2023-10-06T03:04:02.201 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.196+0000 7f6512ae2700 1 -- 172.21.15.57:0/200501801 reap_dead start 2023-10-06T03:04:02.201 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.196+0000 7f65132e3700 1 -- 172.21.15.57:0/200501801 shutdown_connections 2023-10-06T03:04:02.201 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.196+0000 7f65132e3700 1 -- 172.21.15.57:0/200501801 >> 172.21.15.57:0/200501801 conn(0x7f650c0c85a0 msgr2=0x7f650c06abd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:02.201 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.196+0000 7f65132e3700 1 -- 172.21.15.57:0/200501801 shutdown_connections 2023-10-06T03:04:02.201 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.196+0000 7f65132e3700 1 -- 172.21.15.57:0/200501801 wait complete. 2023-10-06T03:04:02.219 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-10-06T03:04:02.384 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.380+0000 7f44c1f45700 1 Processor -- start 2023-10-06T03:04:02.385 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.380+0000 7f44c1f45700 1 -- start start 2023-10-06T03:04:02.386 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.380+0000 7f44c1f45700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f44bc0cebf0 0x7f44bc06af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:02.386 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.380+0000 7f44c1f45700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44bc06ccf0 con 0x7f44bc150220 2023-10-06T03:04:02.386 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.380+0000 7f44c1f45700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44bc06c9c0 con 0x7f44bc14fe50 2023-10-06T03:04:02.387 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.380+0000 7f44c1f45700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44bc06bce0 con 0x7f44bc0cebf0 2023-10-06T03:04:02.387 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.384+0000 7f44baffd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f44bc0cebf0 0x7f44bc06af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:02.387 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.384+0000 7f44bbfff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f44bc150220 0x7f44bc06b4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:54362/0 (socket says 172.21.15.57:54362) 2023-10-06T03:04:02.387 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.384+0000 7f44bbfff700 1 -- 172.21.15.57:0/1200557407 learned_addr learned my addr 172.21.15.57:0/1200557407 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:04:02.388 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.384+0000 7f44ba7fc700 1 -- 172.21.15.57:0/1200557407 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3325543882 0 0) 0x7f44bc06ccf0 con 0x7f44bc150220 2023-10-06T03:04:02.388 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.384+0000 7f44ba7fc700 1 -- 172.21.15.57:0/1200557407 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44a4003570 con 0x7f44bc150220 2023-10-06T03:04:02.388 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.384+0000 7f44baffd700 1 -- 172.21.15.57:0/1200557407 >> v1:172.21.15.105:6789/0 conn(0x7f44bc14fe50 legacy=0x7f44bc0ce4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:02.388 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.384+0000 7f44baffd700 1 -- 172.21.15.57:0/1200557407 >> v1:172.21.15.57:6789/0 conn(0x7f44bc150220 legacy=0x7f44bc06b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:02.388 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.384+0000 7f44baffd700 1 -- 172.21.15.57:0/1200557407 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44bc06bfc0 con 0x7f44bc0cebf0 2023-10-06T03:04:02.389 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.384+0000 7f44baffd700 1 --2- 172.21.15.57:0/1200557407 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f44bc0cebf0 0x7f44bc06af70 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f44b00098e0 tx=0x7f44b00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59aa9ce0b999de9d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:02.389 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.384+0000 7f44ba7fc700 1 -- 172.21.15.57:0/1200557407 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b000b640 con 0x7f44bc0cebf0 2023-10-06T03:04:02.389 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.384+0000 7f44ba7fc700 1 -- 172.21.15.57:0/1200557407 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44b000b7a0 con 0x7f44bc0cebf0 2023-10-06T03:04:02.389 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.384+0000 7f44ba7fc700 1 -- 172.21.15.57:0/1200557407 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b000bb40 con 0x7f44bc0cebf0 2023-10-06T03:04:02.390 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.384+0000 7f44c1f45700 1 -- 172.21.15.57:0/1200557407 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f44bc0cebf0 msgr2=0x7f44bc06af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:02.390 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.384+0000 7f44c1f45700 1 --2- 172.21.15.57:0/1200557407 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f44bc0cebf0 0x7f44bc06af70 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f44b00098e0 tx=0x7f44b00091a0 comp rx=0 tx=0).stop 2023-10-06T03:04:02.390 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.384+0000 7f44c1f45700 1 -- 172.21.15.57:0/1200557407 shutdown_connections 2023-10-06T03:04:02.391 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.384+0000 7f44c1f45700 1 --2- 172.21.15.57:0/1200557407 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f44bc0cebf0 0x7f44bc06af70 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:02.391 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.384+0000 7f44c1f45700 1 -- 172.21.15.57:0/1200557407 >> 172.21.15.57:0/1200557407 conn(0x7f44bc0d0bf0 msgr2=0x7f44bc0ccb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:02.391 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.384+0000 7f44c1f45700 1 -- 172.21.15.57:0/1200557407 shutdown_connections 2023-10-06T03:04:02.391 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.384+0000 7f44c1f45700 1 -- 172.21.15.57:0/1200557407 wait complete. 2023-10-06T03:04:02.392 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.388+0000 7f44c1f45700 1 Processor -- start 2023-10-06T03:04:02.393 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.388+0000 7f44c1f45700 1 -- start start 2023-10-06T03:04:02.394 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.388+0000 7f44c1f45700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f44bc0cebf0 0x7f44bc14b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:02.394 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.388+0000 7f44c1f45700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f44bc14fe50 0x7f44bc14e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:02.394 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.388+0000 7f44c1f45700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f44bc150220 0x7f44bc14ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:02.395 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.388+0000 7f44c1f45700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44bc1522c0 con 0x7f44bc150220 2023-10-06T03:04:02.395 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.388+0000 7f44c1f45700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44bc0b4740 con 0x7f44bc0cebf0 2023-10-06T03:04:02.395 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.388+0000 7f44c1f45700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44bc0b4bd0 con 0x7f44bc14fe50 2023-10-06T03:04:02.396 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.392+0000 7f44bbfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f44bc150220 0x7f44bc14ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:02.396 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.392+0000 7f44bbfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f44bc150220 0x7f44bc14ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:52258/0 (socket says 172.21.15.57:52258) 2023-10-06T03:04:02.396 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.392+0000 7f44bbfff700 1 -- 172.21.15.57:0/2234738894 learned_addr learned my addr 172.21.15.57:0/2234738894 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:04:02.396 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.392+0000 7f44bb7fe700 1 --2- 172.21.15.57:0/2234738894 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f44bc0cebf0 0x7f44bc14b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:02.396 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.392+0000 7f44baffd700 1 --2- 172.21.15.57:0/2234738894 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f44bc14fe50 0x7f44bc14e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:02.396 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.392+0000 7f44bbfff700 1 -- 172.21.15.57:0/2234738894 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f44bc14fe50 msgr2=0x7f44bc14e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:02.396 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.392+0000 7f44bbfff700 1 --2- 172.21.15.57:0/2234738894 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f44bc14fe50 0x7f44bc14e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:02.396 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.392+0000 7f44bbfff700 1 -- 172.21.15.57:0/2234738894 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f44bc0cebf0 msgr2=0x7f44bc14b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:02.396 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.392+0000 7f44bbfff700 1 --2- 172.21.15.57:0/2234738894 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f44bc0cebf0 0x7f44bc14b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:02.396 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.392+0000 7f44bbfff700 1 -- 172.21.15.57:0/2234738894 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44b0009420 con 0x7f44bc150220 2023-10-06T03:04:02.397 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.392+0000 7f44bbfff700 1 --2- 172.21.15.57:0/2234738894 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f44bc150220 0x7f44bc14ecb0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f44b400cc40 tx=0x7f44b4001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:02.397 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.392+0000 7f44a37fe700 1 -- 172.21.15.57:0/2234738894 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b400a7d0 con 0x7f44bc150220 2023-10-06T03:04:02.397 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.392+0000 7f44a37fe700 1 -- 172.21.15.57:0/2234738894 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44b400a930 con 0x7f44bc150220 2023-10-06T03:04:02.397 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.392+0000 7f44c1f45700 1 -- 172.21.15.57:0/2234738894 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44bc0b3b30 con 0x7f44bc150220 2023-10-06T03:04:02.397 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.392+0000 7f44a37fe700 1 -- 172.21.15.57:0/2234738894 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b400acb0 con 0x7f44bc150220 2023-10-06T03:04:02.398 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.392+0000 7f44c1f45700 1 -- 172.21.15.57:0/2234738894 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44bc0b40f0 con 0x7f44bc150220 2023-10-06T03:04:02.398 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.396+0000 7f44c1f45700 1 -- 172.21.15.57:0/2234738894 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44bc04be40 con 0x7f44bc150220 2023-10-06T03:04:02.400 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.396+0000 7f44a37fe700 1 -- 172.21.15.57:0/2234738894 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f44b4007300 con 0x7f44bc150220 2023-10-06T03:04:02.402 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.396+0000 7f44a37fe700 1 --2- 172.21.15.57:0/2234738894 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f44a8060550 0x7f44a8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:02.402 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.396+0000 7f44a37fe700 1 -- 172.21.15.57:0/2234738894 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5378+0+0 (secure 0 0 0) 0x7f44b407ca20 con 0x7f44bc150220 2023-10-06T03:04:02.402 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.400+0000 7f44bb7fe700 1 --2- 172.21.15.57:0/2234738894 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f44a8060550 0x7f44a8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:02.403 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.400+0000 7f44bb7fe700 1 --2- 172.21.15.57:0/2234738894 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f44a8060550 0x7f44a8062a00 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f44ac003a80 tx=0x7f44ac007ec0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:02.409 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.404+0000 7f44a37fe700 1 -- 172.21.15.57:0/2234738894 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f44b404d0a0 con 0x7f44bc150220 2023-10-06T03:04:02.582 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.576+0000 7f44c1f45700 1 -- 172.21.15.57:0/2234738894 --> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f44bc0b4880 con 0x7f44a8060550 2023-10-06T03:04:02.583 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.580+0000 7f44a37fe700 1 -- 172.21.15.57:0/2234738894 <== mgr.4103 v2:172.21.15.57:6832/32947 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f44bc0b4880 con 0x7f44a8060550 2023-10-06T03:04:02.585 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.580+0000 7f44c1f45700 1 -- 172.21.15.57:0/2234738894 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f44a8060550 msgr2=0x7f44a8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:02.586 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.580+0000 7f44c1f45700 1 --2- 172.21.15.57:0/2234738894 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f44a8060550 0x7f44a8062a00 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f44ac003a80 tx=0x7f44ac007ec0 comp rx=0 tx=0).stop 2023-10-06T03:04:02.586 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.580+0000 7f44c1f45700 1 -- 172.21.15.57:0/2234738894 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f44bc150220 msgr2=0x7f44bc14ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:02.586 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.580+0000 7f44c1f45700 1 --2- 172.21.15.57:0/2234738894 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f44bc150220 0x7f44bc14ecb0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f44b400cc40 tx=0x7f44b4001a40 comp rx=0 tx=0).stop 2023-10-06T03:04:02.586 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.580+0000 7f44c1f45700 1 -- 172.21.15.57:0/2234738894 shutdown_connections 2023-10-06T03:04:02.586 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.580+0000 7f44c1f45700 1 --2- 172.21.15.57:0/2234738894 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f44bc150220 0x7f44bc14ecb0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:02.586 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.580+0000 7f44c1f45700 1 --2- 172.21.15.57:0/2234738894 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f44a8060550 0x7f44a8062a00 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:02.586 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.580+0000 7f44c1f45700 1 --2- 172.21.15.57:0/2234738894 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f44bc14fe50 0x7f44bc14e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:02.586 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.580+0000 7f44c1f45700 1 --2- 172.21.15.57:0/2234738894 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f44bc0cebf0 0x7f44bc14b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:02.586 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.580+0000 7f44c1f45700 1 -- 172.21.15.57:0/2234738894 >> 172.21.15.57:0/2234738894 conn(0x7f44bc0d0bf0 msgr2=0x7f44bc0c4ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:02.587 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.580+0000 7f44c1f45700 1 -- 172.21.15.57:0/2234738894 shutdown_connections 2023-10-06T03:04:02.587 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.580+0000 7f44c1f45700 1 -- 172.21.15.57:0/2234738894 wait complete. 2023-10-06T03:04:02.588 INFO:teuthology.orchestra.run.smithi057.stderr:instructed osd(s) 0 to deep-scrub 2023-10-06T03:04:02.608 INFO:tasks.ceph:Scrubbing osd.1 2023-10-06T03:04:02.609 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-10-06T03:04:02.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.780+0000 7fbc8afc5700 1 Processor -- start 2023-10-06T03:04:02.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.780+0000 7fbc8afc5700 1 -- start start 2023-10-06T03:04:02.785 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.780+0000 7fbc8afc5700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbc84067280 0x7fbc84067650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:02.785 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.780+0000 7fbc8afc5700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fbc840cb0f0 0x7fbc8406d680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:02.785 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.780+0000 7fbc8afc5700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc84159670 con 0x7fbc84158ae0 2023-10-06T03:04:02.785 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.780+0000 7fbc8afc5700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc840cecd0 con 0x7fbc840cb0f0 2023-10-06T03:04:02.785 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.780+0000 7fbc8afc5700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc840cb540 con 0x7fbc84067280 2023-10-06T03:04:02.786 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.780+0000 7fbc89562700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fbc84158ae0 0x7fbc84158f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:54372/0 (socket says 172.21.15.57:54372) 2023-10-06T03:04:02.786 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.780+0000 7fbc89562700 1 -- 172.21.15.57:0/4006548912 learned_addr learned my addr 172.21.15.57:0/4006548912 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:04:02.786 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.780+0000 7fbc83fff700 1 --2- 172.21.15.57:0/4006548912 >> v2:172.21.15.57:3300/0 conn(0x7fbc840cb0f0 0x7fbc8406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:02.786 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.780+0000 7fbc88d61700 1 --2- 172.21.15.57:0/4006548912 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbc84067280 0x7fbc84067650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:02.786 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.780+0000 7fbc837fe700 1 -- 172.21.15.57:0/4006548912 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3924945835 0 0) 0x7fbc84159670 con 0x7fbc84158ae0 2023-10-06T03:04:02.787 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.780+0000 7fbc837fe700 1 -- 172.21.15.57:0/4006548912 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc74003570 con 0x7fbc84158ae0 2023-10-06T03:04:02.787 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.784+0000 7fbc88d61700 1 -- 172.21.15.57:0/4006548912 >> v2:172.21.15.57:3300/0 conn(0x7fbc840cb0f0 msgr2=0x7fbc8406d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:02.787 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.784+0000 7fbc88d61700 1 --2- 172.21.15.57:0/4006548912 >> v2:172.21.15.57:3300/0 conn(0x7fbc840cb0f0 0x7fbc8406d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:02.787 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.784+0000 7fbc88d61700 1 -- 172.21.15.57:0/4006548912 >> v1:172.21.15.57:6789/0 conn(0x7fbc84158ae0 legacy=0x7fbc84158f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:02.787 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.784+0000 7fbc88d61700 1 -- 172.21.15.57:0/4006548912 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc8406dbc0 con 0x7fbc84067280 2023-10-06T03:04:02.788 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.784+0000 7fbc88d61700 1 --2- 172.21.15.57:0/4006548912 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbc84067280 0x7fbc84067650 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fbc780098e0 tx=0x7fbc780091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=655897fb21630fc1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:02.788 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.784+0000 7fbc837fe700 1 -- 172.21.15.57:0/4006548912 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc78011630 con 0x7fbc84067280 2023-10-06T03:04:02.788 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.784+0000 7fbc837fe700 1 -- 172.21.15.57:0/4006548912 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc78011790 con 0x7fbc84067280 2023-10-06T03:04:02.788 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.784+0000 7fbc837fe700 1 -- 172.21.15.57:0/4006548912 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc78011b30 con 0x7fbc84067280 2023-10-06T03:04:02.789 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.784+0000 7fbc8afc5700 1 -- 172.21.15.57:0/4006548912 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbc84067280 msgr2=0x7fbc84067650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:02.789 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.784+0000 7fbc8afc5700 1 --2- 172.21.15.57:0/4006548912 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbc84067280 0x7fbc84067650 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fbc780098e0 tx=0x7fbc780091a0 comp rx=0 tx=0).stop 2023-10-06T03:04:02.789 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.784+0000 7fbc8afc5700 1 -- 172.21.15.57:0/4006548912 shutdown_connections 2023-10-06T03:04:02.789 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.784+0000 7fbc8afc5700 1 --2- 172.21.15.57:0/4006548912 >> v2:172.21.15.57:3300/0 conn(0x7fbc840cb0f0 0x7fbc8406d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:02.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.784+0000 7fbc8afc5700 1 --2- 172.21.15.57:0/4006548912 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbc84067280 0x7fbc84067650 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:02.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.784+0000 7fbc8afc5700 1 -- 172.21.15.57:0/4006548912 >> 172.21.15.57:0/4006548912 conn(0x7fbc840d0bc0 msgr2=0x7fbc840ccb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:02.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.784+0000 7fbc8afc5700 1 -- 172.21.15.57:0/4006548912 shutdown_connections 2023-10-06T03:04:02.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.784+0000 7fbc8afc5700 1 -- 172.21.15.57:0/4006548912 wait complete. 2023-10-06T03:04:02.791 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.788+0000 7fbc8afc5700 1 Processor -- start 2023-10-06T03:04:02.792 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.788+0000 7fbc8afc5700 1 -- start start 2023-10-06T03:04:02.793 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.788+0000 7fbc8afc5700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbc84067280 0x7fbc84156d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:02.793 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.788+0000 7fbc8afc5700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbc840cb0f0 0x7fbc840c98d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:02.794 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.788+0000 7fbc8afc5700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbc84158ae0 0x7fbc8415ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:02.794 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.788+0000 7fbc8afc5700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc8416e890 con 0x7fbc84158ae0 2023-10-06T03:04:02.794 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.788+0000 7fbc8afc5700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc8416dc80 con 0x7fbc840cb0f0 2023-10-06T03:04:02.794 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.788+0000 7fbc8afc5700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc8416df60 con 0x7fbc84067280 2023-10-06T03:04:02.795 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.788+0000 7fbc89562700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbc84158ae0 0x7fbc8415ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:02.796 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.788+0000 7fbc89562700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbc84158ae0 0x7fbc8415ae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:52286/0 (socket says 172.21.15.57:52286) 2023-10-06T03:04:02.796 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.788+0000 7fbc89562700 1 -- 172.21.15.57:0/2738264695 learned_addr learned my addr 172.21.15.57:0/2738264695 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:04:02.796 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.788+0000 7fbc83fff700 1 --2- 172.21.15.57:0/2738264695 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbc840cb0f0 0x7fbc840c98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:02.796 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.788+0000 7fbc88d61700 1 --2- 172.21.15.57:0/2738264695 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbc84067280 0x7fbc84156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:02.796 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.792+0000 7fbc89562700 1 -- 172.21.15.57:0/2738264695 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbc84067280 msgr2=0x7fbc84156d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:02.796 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.792+0000 7fbc89562700 1 --2- 172.21.15.57:0/2738264695 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbc84067280 0x7fbc84156d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:02.796 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.792+0000 7fbc89562700 1 -- 172.21.15.57:0/2738264695 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbc840cb0f0 msgr2=0x7fbc840c98d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:02.796 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.792+0000 7fbc89562700 1 --2- 172.21.15.57:0/2738264695 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbc840cb0f0 0x7fbc840c98d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:02.796 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.792+0000 7fbc89562700 1 -- 172.21.15.57:0/2738264695 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc78009420 con 0x7fbc84158ae0 2023-10-06T03:04:02.796 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.792+0000 7fbc89562700 1 --2- 172.21.15.57:0/2738264695 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbc84158ae0 0x7fbc8415ae30 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c001460 tx=0x7fbc7c001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:02.797 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.792+0000 7fbc80ff9700 1 -- 172.21.15.57:0/2738264695 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc7c00a870 con 0x7fbc84158ae0 2023-10-06T03:04:02.797 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.792+0000 7fbc80ff9700 1 -- 172.21.15.57:0/2738264695 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc7c00a9d0 con 0x7fbc84158ae0 2023-10-06T03:04:02.797 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.792+0000 7fbc8afc5700 1 -- 172.21.15.57:0/2738264695 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc8416e240 con 0x7fbc84158ae0 2023-10-06T03:04:02.797 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.792+0000 7fbc80ff9700 1 -- 172.21.15.57:0/2738264695 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc7c00ad50 con 0x7fbc84158ae0 2023-10-06T03:04:02.797 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.792+0000 7fbc8afc5700 1 -- 172.21.15.57:0/2738264695 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc840b2350 con 0x7fbc84158ae0 2023-10-06T03:04:02.797 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.792+0000 7fbc8afc5700 1 -- 172.21.15.57:0/2738264695 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbc840712e0 con 0x7fbc84158ae0 2023-10-06T03:04:02.798 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.792+0000 7fbc80ff9700 1 -- 172.21.15.57:0/2738264695 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fbc7c007300 con 0x7fbc84158ae0 2023-10-06T03:04:02.800 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.796+0000 7fbc80ff9700 1 --2- 172.21.15.57:0/2738264695 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fbc68060580 0x7fbc68062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:02.800 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.796+0000 7fbc80ff9700 1 -- 172.21.15.57:0/2738264695 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5378+0+0 (secure 0 0 0) 0x7fbc7c07c9f0 con 0x7fbc84158ae0 2023-10-06T03:04:02.800 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.796+0000 7fbc88d61700 1 --2- 172.21.15.57:0/2738264695 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fbc68060580 0x7fbc68062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:02.800 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.796+0000 7fbc80ff9700 1 --2- 172.21.15.57:0/2738264695 >> [v2:172.21.15.57:6809/33052,v1:172.21.15.57:6810/33052] conn(0x7fbc68066a90 0x7fbc68068ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:02.801 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.796+0000 7fbc80ff9700 1 -- 172.21.15.57:0/2738264695 --> [v2:172.21.15.57:6809/33052,v1:172.21.15.57:6810/33052] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbc68069550 con 0x7fbc68066a90 2023-10-06T03:04:02.801 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.796+0000 7fbc80ff9700 1 -- 172.21.15.57:0/2738264695 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=59) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbc7c081200 con 0x7fbc84158ae0 2023-10-06T03:04:02.801 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.796+0000 7fbc83fff700 1 --2- 172.21.15.57:0/2738264695 >> [v2:172.21.15.57:6809/33052,v1:172.21.15.57:6810/33052] conn(0x7fbc68066a90 0x7fbc68068ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:02.802 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.796+0000 7fbc88d61700 1 --2- 172.21.15.57:0/2738264695 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fbc68060580 0x7fbc68062a30 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fbc780091e0 tx=0x7fbc78017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:02.802 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.796+0000 7fbc83fff700 1 --2- 172.21.15.57:0/2738264695 >> [v2:172.21.15.57:6809/33052,v1:172.21.15.57:6810/33052] conn(0x7fbc68066a90 0x7fbc68068ea0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:02.803 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.800+0000 7fbc80ff9700 1 -- 172.21.15.57:0/2738264695 <== osd.1 v2:172.21.15.57:6809/33052 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fbc68069550 con 0x7fbc68066a90 2023-10-06T03:04:02.822 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.816+0000 7fbc8afc5700 1 -- 172.21.15.57:0/2738264695 --> [v2:172.21.15.57:6809/33052,v1:172.21.15.57:6810/33052] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fbc840cb7b0 con 0x7fbc68066a90 2023-10-06T03:04:02.823 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.820+0000 7fbc80ff9700 1 -- 172.21.15.57:0/2738264695 <== osd.1 v2:172.21.15.57:6809/33052 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fbc840cb7b0 con 0x7fbc68066a90 2023-10-06T03:04:02.823 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-10-06T03:04:02.823 INFO:teuthology.orchestra.run.smithi057.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T03:04:02.823 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-10-06T03:04:02.824 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.820+0000 7fbc8afc5700 1 -- 172.21.15.57:0/2738264695 >> [v2:172.21.15.57:6809/33052,v1:172.21.15.57:6810/33052] conn(0x7fbc68066a90 msgr2=0x7fbc68068ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:02.824 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.820+0000 7fbc8afc5700 1 --2- 172.21.15.57:0/2738264695 >> [v2:172.21.15.57:6809/33052,v1:172.21.15.57:6810/33052] conn(0x7fbc68066a90 0x7fbc68068ea0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:02.825 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.820+0000 7fbc8afc5700 1 -- 172.21.15.57:0/2738264695 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fbc68060580 msgr2=0x7fbc68062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:02.825 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.820+0000 7fbc8afc5700 1 --2- 172.21.15.57:0/2738264695 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fbc68060580 0x7fbc68062a30 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fbc780091e0 tx=0x7fbc78017000 comp rx=0 tx=0).stop 2023-10-06T03:04:02.825 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.820+0000 7fbc8afc5700 1 -- 172.21.15.57:0/2738264695 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbc84158ae0 msgr2=0x7fbc8415ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:02.825 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.820+0000 7fbc8afc5700 1 --2- 172.21.15.57:0/2738264695 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbc84158ae0 0x7fbc8415ae30 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c001460 tx=0x7fbc7c001a40 comp rx=0 tx=0).stop 2023-10-06T03:04:02.825 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.820+0000 7fbc89562700 1 -- 172.21.15.57:0/2738264695 reap_dead start 2023-10-06T03:04:02.825 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.820+0000 7fbc8afc5700 1 -- 172.21.15.57:0/2738264695 shutdown_connections 2023-10-06T03:04:02.825 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.820+0000 7fbc8afc5700 1 -- 172.21.15.57:0/2738264695 >> 172.21.15.57:0/2738264695 conn(0x7fbc840d0bc0 msgr2=0x7fbc840b5580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:02.825 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.820+0000 7fbc8afc5700 1 -- 172.21.15.57:0/2738264695 shutdown_connections 2023-10-06T03:04:02.826 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:02.820+0000 7fbc8afc5700 1 -- 172.21.15.57:0/2738264695 wait complete. 2023-10-06T03:04:02.848 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-10-06T03:04:03.019 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.016+0000 7f6b0a345700 1 Processor -- start 2023-10-06T03:04:03.020 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.016+0000 7f6b0a345700 1 -- start start 2023-10-06T03:04:03.022 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.016+0000 7f6b0a345700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f6b04156d60 0x7f6b0406a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:03.022 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.016+0000 7f6b0a345700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b0406cf30 con 0x7f6b040ae290 2023-10-06T03:04:03.022 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.016+0000 7f6b0a345700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b0406b130 con 0x7f6b040aea60 2023-10-06T03:04:03.022 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.016+0000 7f6b0a345700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b0406b410 con 0x7f6b04156d60 2023-10-06T03:04:03.023 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.020+0000 7f6b03fff700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f6b04156d60 0x7f6b0406a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:03.023 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.020+0000 7f6b03fff700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f6b04156d60 0x7f6b0406a7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.57:41208/0 (socket says 172.21.15.57:41208) 2023-10-06T03:04:03.023 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.020+0000 7f6b03fff700 1 -- 172.21.15.57:0/481412943 learned_addr learned my addr 172.21.15.57:0/481412943 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:04:03.023 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.020+0000 7f6b037fe700 1 --1- 172.21.15.57:0/481412943 >> v1:172.21.15.57:6789/0 conn(0x7f6b040ae290 0x7f6b040ac070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:54380/0 (socket says 172.21.15.57:54380) 2023-10-06T03:04:03.023 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.020+0000 7f6b03fff700 1 -- 172.21.15.57:0/481412943 >> v1:172.21.15.105:6789/0 conn(0x7f6b040aea60 legacy=0x7f6b0406d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:03.024 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.020+0000 7f6b03fff700 1 -- 172.21.15.57:0/481412943 >> v1:172.21.15.57:6789/0 conn(0x7f6b040ae290 legacy=0x7f6b040ac070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:03.024 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.020+0000 7f6b03fff700 1 -- 172.21.15.57:0/481412943 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b0406b6f0 con 0x7f6b04156d60 2023-10-06T03:04:03.024 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.020+0000 7f6b03fff700 1 --2- 172.21.15.57:0/481412943 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6b04156d60 0x7f6b0406a7c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f6af40099e0 tx=0x7f6af4009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cb28f079ace71080 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:03.024 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.020+0000 7f6b02ffd700 1 -- 172.21.15.57:0/481412943 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6af400b820 con 0x7f6b04156d60 2023-10-06T03:04:03.025 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.020+0000 7f6b02ffd700 1 -- 172.21.15.57:0/481412943 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6af400b980 con 0x7f6b04156d60 2023-10-06T03:04:03.025 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.020+0000 7f6b02ffd700 1 -- 172.21.15.57:0/481412943 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6af400bd20 con 0x7f6b04156d60 2023-10-06T03:04:03.026 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.020+0000 7f6b0a345700 1 -- 172.21.15.57:0/481412943 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6b04156d60 msgr2=0x7f6b0406a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:03.026 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.020+0000 7f6b0a345700 1 --2- 172.21.15.57:0/481412943 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6b04156d60 0x7f6b0406a7c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f6af40099e0 tx=0x7f6af4009250 comp rx=0 tx=0).stop 2023-10-06T03:04:03.026 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.020+0000 7f6b0a345700 1 -- 172.21.15.57:0/481412943 shutdown_connections 2023-10-06T03:04:03.026 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.020+0000 7f6b0a345700 1 --2- 172.21.15.57:0/481412943 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6b04156d60 0x7f6b0406a7c0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:03.026 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.020+0000 7f6b0a345700 1 -- 172.21.15.57:0/481412943 >> 172.21.15.57:0/481412943 conn(0x7f6b040cbc90 msgr2=0x7f6b040cc090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:03.027 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.020+0000 7f6b0a345700 1 -- 172.21.15.57:0/481412943 shutdown_connections 2023-10-06T03:04:03.027 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.024+0000 7f6b0a345700 1 -- 172.21.15.57:0/481412943 wait complete. 2023-10-06T03:04:03.028 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.024+0000 7f6b0a345700 1 Processor -- start 2023-10-06T03:04:03.028 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.024+0000 7f6b0a345700 1 -- start start 2023-10-06T03:04:03.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.024+0000 7f6b0a345700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6b040ae290 0x7f6b0415e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:03.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.024+0000 7f6b0a345700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b040aea60 0x7f6b04158200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:03.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.024+0000 7f6b0a345700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6b04156d60 0x7f6b04158740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:03.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.024+0000 7f6b0a345700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b0415f840 con 0x7f6b040aea60 2023-10-06T03:04:03.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.024+0000 7f6b0a345700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b040c3140 con 0x7f6b04156d60 2023-10-06T03:04:03.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.024+0000 7f6b0a345700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b0415f280 con 0x7f6b040ae290 2023-10-06T03:04:03.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.024+0000 7f6b037fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b040aea60 0x7f6b04158200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:03.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.028+0000 7f6b037fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b040aea60 0x7f6b04158200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:52300/0 (socket says 172.21.15.57:52300) 2023-10-06T03:04:03.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.028+0000 7f6b037fe700 1 -- 172.21.15.57:0/2466962312 learned_addr learned my addr 172.21.15.57:0/2466962312 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:04:03.032 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.028+0000 7f6b03fff700 1 --2- 172.21.15.57:0/2466962312 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6b040ae290 0x7f6b0415e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:03.032 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.028+0000 7f6b088e2700 1 --2- 172.21.15.57:0/2466962312 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6b04156d60 0x7f6b04158740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:03.033 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.028+0000 7f6b037fe700 1 -- 172.21.15.57:0/2466962312 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6b040ae290 msgr2=0x7f6b0415e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:03.033 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.028+0000 7f6b037fe700 1 --2- 172.21.15.57:0/2466962312 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6b040ae290 0x7f6b0415e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:03.033 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.028+0000 7f6b037fe700 1 -- 172.21.15.57:0/2466962312 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6b04156d60 msgr2=0x7f6b04158740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:03.033 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.028+0000 7f6b037fe700 1 --2- 172.21.15.57:0/2466962312 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6b04156d60 0x7f6b04158740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:03.033 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.028+0000 7f6b037fe700 1 -- 172.21.15.57:0/2466962312 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6af40094f0 con 0x7f6b040aea60 2023-10-06T03:04:03.033 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.028+0000 7f6b037fe700 1 --2- 172.21.15.57:0/2466962312 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b040aea60 0x7f6b04158200 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f6af800c510 tx=0x7f6af8007f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:03.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.028+0000 7f6aebfff700 1 -- 172.21.15.57:0/2466962312 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6af800ce80 con 0x7f6b040aea60 2023-10-06T03:04:03.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.028+0000 7f6aebfff700 1 -- 172.21.15.57:0/2466962312 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6af8005a70 con 0x7f6b040aea60 2023-10-06T03:04:03.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.028+0000 7f6aebfff700 1 -- 172.21.15.57:0/2466962312 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6af8005e10 con 0x7f6b040aea60 2023-10-06T03:04:03.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.028+0000 7f6b0a345700 1 -- 172.21.15.57:0/2466962312 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b0415f560 con 0x7f6b040aea60 2023-10-06T03:04:03.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.028+0000 7f6b0a345700 1 -- 172.21.15.57:0/2466962312 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b04159460 con 0x7f6b040aea60 2023-10-06T03:04:03.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.028+0000 7f6b0a345700 1 -- 172.21.15.57:0/2466962312 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b0404be40 con 0x7f6b040aea60 2023-10-06T03:04:03.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.032+0000 7f6aebfff700 1 -- 172.21.15.57:0/2466962312 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f6af80072e0 con 0x7f6b040aea60 2023-10-06T03:04:03.038 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.032+0000 7f6aebfff700 1 --2- 172.21.15.57:0/2466962312 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f6af0060550 0x7f6af0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:03.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.032+0000 7f6aebfff700 1 -- 172.21.15.57:0/2466962312 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5378+0+0 (secure 0 0 0) 0x7f6af807ba40 con 0x7f6b040aea60 2023-10-06T03:04:03.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.036+0000 7f6b03fff700 1 --2- 172.21.15.57:0/2466962312 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f6af0060550 0x7f6af0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:03.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.036+0000 7f6b03fff700 1 --2- 172.21.15.57:0/2466962312 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f6af0060550 0x7f6af0062a00 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f6af40099e0 tx=0x7f6af4017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:03.044 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.040+0000 7f6aebfff700 1 -- 172.21.15.57:0/2466962312 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f6af804c0d0 con 0x7f6b040aea60 2023-10-06T03:04:03.214 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.208+0000 7f6b0a345700 1 -- 172.21.15.57:0/2466962312 --> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f6b040c3280 con 0x7f6af0060550 2023-10-06T03:04:03.214 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.212+0000 7f6aebfff700 1 -- 172.21.15.57:0/2466962312 <== mgr.4103 v2:172.21.15.57:6832/32947 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f6b040c3280 con 0x7f6af0060550 2023-10-06T03:04:03.220 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.216+0000 7f6b0a345700 1 -- 172.21.15.57:0/2466962312 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f6af0060550 msgr2=0x7f6af0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:03.220 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.216+0000 7f6b0a345700 1 --2- 172.21.15.57:0/2466962312 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f6af0060550 0x7f6af0062a00 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f6af40099e0 tx=0x7f6af4017000 comp rx=0 tx=0).stop 2023-10-06T03:04:03.220 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.216+0000 7f6b0a345700 1 -- 172.21.15.57:0/2466962312 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b040aea60 msgr2=0x7f6b04158200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:03.220 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.216+0000 7f6b0a345700 1 --2- 172.21.15.57:0/2466962312 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b040aea60 0x7f6b04158200 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f6af800c510 tx=0x7f6af8007f40 comp rx=0 tx=0).stop 2023-10-06T03:04:03.221 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.216+0000 7f6b0a345700 1 -- 172.21.15.57:0/2466962312 shutdown_connections 2023-10-06T03:04:03.221 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.216+0000 7f6b0a345700 1 --2- 172.21.15.57:0/2466962312 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6b04156d60 0x7f6b04158740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:03.221 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.216+0000 7f6b0a345700 1 --2- 172.21.15.57:0/2466962312 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b040aea60 0x7f6b04158200 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:03.221 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.216+0000 7f6b0a345700 1 --2- 172.21.15.57:0/2466962312 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f6af0060550 0x7f6af0062a00 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:03.221 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.216+0000 7f6b0a345700 1 --2- 172.21.15.57:0/2466962312 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6b040ae290 0x7f6b0415e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:03.221 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.216+0000 7f6b0a345700 1 -- 172.21.15.57:0/2466962312 >> 172.21.15.57:0/2466962312 conn(0x7f6b040cbc90 msgr2=0x7f6b040cc060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:03.221 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.216+0000 7f6b0a345700 1 -- 172.21.15.57:0/2466962312 shutdown_connections 2023-10-06T03:04:03.221 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.216+0000 7f6b0a345700 1 -- 172.21.15.57:0/2466962312 wait complete. 2023-10-06T03:04:03.223 INFO:teuthology.orchestra.run.smithi057.stderr:instructed osd(s) 1 to deep-scrub 2023-10-06T03:04:03.244 INFO:tasks.ceph:Scrubbing osd.2 2023-10-06T03:04:03.245 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-10-06T03:04:03.419 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.416+0000 7f41ff59e700 1 Processor -- start 2023-10-06T03:04:03.419 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.416+0000 7f41ff59e700 1 -- start start 2023-10-06T03:04:03.424 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.420+0000 7f41ff59e700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f4200156880 0x7f4200159f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:03.424 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.420+0000 7f41ff59e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f420006be50 0x7f42000ce7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:03.424 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.420+0000 7f41ff59e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42000cb090 con 0x7f420015cb00 2023-10-06T03:04:03.424 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.420+0000 7f41ff59e700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42000cc600 con 0x7f420006be50 2023-10-06T03:04:03.424 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.420+0000 7f41ff59e700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f420015a4c0 con 0x7f4200156880 2023-10-06T03:04:03.425 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.420+0000 7f41fdd9b700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f420015cb00 0x7f420006b740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:54392/0 (socket says 172.21.15.57:54392) 2023-10-06T03:04:03.425 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.420+0000 7f41fdd9b700 1 -- 172.21.15.57:0/2579281395 learned_addr learned my addr 172.21.15.57:0/2579281395 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:04:03.425 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.420+0000 7f41fed9d700 1 --2- 172.21.15.57:0/2579281395 >> v2:172.21.15.57:3300/0 conn(0x7f420006be50 0x7f42000ce7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:03.425 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.420+0000 7f41fe59c700 1 --2- 172.21.15.57:0/2579281395 >> v2:172.21.15.105:3300/0 conn(0x7f4200156880 0x7f4200159f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:03.426 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.420+0000 7f41fd59a700 1 -- 172.21.15.57:0/2579281395 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1426529416 0 0) 0x7f42000cb090 con 0x7f420015cb00 2023-10-06T03:04:03.426 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.420+0000 7f41fd59a700 1 -- 172.21.15.57:0/2579281395 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41e8003570 con 0x7f420015cb00 2023-10-06T03:04:03.426 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.420+0000 7f41fed9d700 1 -- 172.21.15.57:0/2579281395 >> v2:172.21.15.105:3300/0 conn(0x7f4200156880 msgr2=0x7f4200159f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:03.426 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.420+0000 7f41fed9d700 1 --2- 172.21.15.57:0/2579281395 >> v2:172.21.15.105:3300/0 conn(0x7f4200156880 0x7f4200159f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:03.426 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.420+0000 7f41fed9d700 1 -- 172.21.15.57:0/2579281395 >> v1:172.21.15.57:6789/0 conn(0x7f420015cb00 legacy=0x7f420006b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:03.426 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.420+0000 7f41fed9d700 1 -- 172.21.15.57:0/2579281395 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f420015cf90 con 0x7f420006be50 2023-10-06T03:04:03.427 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.420+0000 7f41fe59c700 1 --2- 172.21.15.57:0/2579281395 >> v2:172.21.15.105:3300/0 conn(0x7f4200156880 0x7f4200159f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:04:03.427 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.420+0000 7f41fed9d700 1 --2- 172.21.15.57:0/2579281395 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f420006be50 0x7f42000ce7e0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f42000695c0 tx=0x7f41f8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3e073f6da3cb6b1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:03.428 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.424+0000 7f41fd59a700 1 -- 172.21.15.57:0/2579281395 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f800e070 con 0x7f420006be50 2023-10-06T03:04:03.428 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.424+0000 7f41fd59a700 1 -- 172.21.15.57:0/2579281395 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41f800bab0 con 0x7f420006be50 2023-10-06T03:04:03.428 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.424+0000 7f41fd59a700 1 -- 172.21.15.57:0/2579281395 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f800be70 con 0x7f420006be50 2023-10-06T03:04:03.428 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.424+0000 7f41ff59e700 1 -- 172.21.15.57:0/2579281395 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f420006be50 msgr2=0x7f42000ce7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:03.428 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.424+0000 7f41ff59e700 1 --2- 172.21.15.57:0/2579281395 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f420006be50 0x7f42000ce7e0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f42000695c0 tx=0x7f41f8009780 comp rx=0 tx=0).stop 2023-10-06T03:04:03.428 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.424+0000 7f41ff59e700 1 -- 172.21.15.57:0/2579281395 shutdown_connections 2023-10-06T03:04:03.428 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.424+0000 7f41ff59e700 1 --2- 172.21.15.57:0/2579281395 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f420006be50 0x7f42000ce7e0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:03.429 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.424+0000 7f41ff59e700 1 --2- 172.21.15.57:0/2579281395 >> v2:172.21.15.105:3300/0 conn(0x7f4200156880 0x7f4200159f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:03.429 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.424+0000 7f41ff59e700 1 -- 172.21.15.57:0/2579281395 >> 172.21.15.57:0/2579281395 conn(0x7f42000cc9b0 msgr2=0x7f42000ccdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:03.429 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.424+0000 7f41ff59e700 1 -- 172.21.15.57:0/2579281395 shutdown_connections 2023-10-06T03:04:03.429 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.424+0000 7f41ff59e700 1 -- 172.21.15.57:0/2579281395 wait complete. 2023-10-06T03:04:03.430 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.424+0000 7f41ff59e700 1 Processor -- start 2023-10-06T03:04:03.430 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.424+0000 7f41ff59e700 1 -- start start 2023-10-06T03:04:03.431 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.428+0000 7f41ff59e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f420006be50 0x7f42000b0d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:03.431 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.428+0000 7f41ff59e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4200156880 0x7f42000c99e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:03.431 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.428+0000 7f41ff59e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f420015cb00 0x7f4200157600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:03.431 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.428+0000 7f41ff59e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42000c9f20 con 0x7f420015cb00 2023-10-06T03:04:03.431 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.428+0000 7f41ff59e700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4200157b40 con 0x7f420006be50 2023-10-06T03:04:03.432 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.428+0000 7f41ff59e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42001691e0 con 0x7f4200156880 2023-10-06T03:04:03.432 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.428+0000 7f41fed9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f420015cb00 0x7f4200157600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:03.433 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.428+0000 7f41fed9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f420015cb00 0x7f4200157600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:52310/0 (socket says 172.21.15.57:52310) 2023-10-06T03:04:03.433 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.428+0000 7f41fed9d700 1 -- 172.21.15.57:0/2601445617 learned_addr learned my addr 172.21.15.57:0/2601445617 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:04:03.433 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.428+0000 7f41fdd9b700 1 --2- 172.21.15.57:0/2601445617 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4200156880 0x7f42000c99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:03.433 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.428+0000 7f41fe59c700 1 --2- 172.21.15.57:0/2601445617 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f420006be50 0x7f42000b0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:03.433 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.428+0000 7f41fed9d700 1 -- 172.21.15.57:0/2601445617 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4200156880 msgr2=0x7f42000c99e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:03.433 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.428+0000 7f41fed9d700 1 --2- 172.21.15.57:0/2601445617 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4200156880 0x7f42000c99e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:03.433 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.428+0000 7f41fed9d700 1 -- 172.21.15.57:0/2601445617 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f420006be50 msgr2=0x7f42000b0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:03.433 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.428+0000 7f41fed9d700 1 --2- 172.21.15.57:0/2601445617 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f420006be50 0x7f42000b0d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:03.433 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.428+0000 7f41fed9d700 1 -- 172.21.15.57:0/2601445617 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41f0009420 con 0x7f420015cb00 2023-10-06T03:04:03.434 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.428+0000 7f41fed9d700 1 --2- 172.21.15.57:0/2601445617 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f420015cb00 0x7f4200157600 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f42000cd810 tx=0x7f41f8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:03.434 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.428+0000 7f41ee7fc700 1 -- 172.21.15.57:0/2601445617 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f8012dd0 con 0x7f420015cb00 2023-10-06T03:04:03.435 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.428+0000 7f41ee7fc700 1 -- 172.21.15.57:0/2601445617 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41f8027470 con 0x7f420015cb00 2023-10-06T03:04:03.435 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.428+0000 7f41ff59e700 1 -- 172.21.15.57:0/2601445617 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41f8009a20 con 0x7f420015cb00 2023-10-06T03:04:03.435 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.428+0000 7f41ee7fc700 1 -- 172.21.15.57:0/2601445617 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f8027830 con 0x7f420015cb00 2023-10-06T03:04:03.435 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.428+0000 7f41ff59e700 1 -- 172.21.15.57:0/2601445617 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4200157d40 con 0x7f420015cb00 2023-10-06T03:04:03.435 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.432+0000 7f41ff59e700 1 -- 172.21.15.57:0/2601445617 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4200168fb0 con 0x7f420015cb00 2023-10-06T03:04:03.437 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.432+0000 7f41ee7fc700 1 -- 172.21.15.57:0/2601445617 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f41f8024070 con 0x7f420015cb00 2023-10-06T03:04:03.438 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.432+0000 7f41ee7fc700 1 --2- 172.21.15.57:0/2601445617 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f41e0060580 0x7f41e0062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:03.438 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.432+0000 7f41ee7fc700 1 -- 172.21.15.57:0/2601445617 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5378+0+0 (secure 0 0 0) 0x7f41f807eff0 con 0x7f420015cb00 2023-10-06T03:04:03.439 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.432+0000 7f41ee7fc700 1 --2- 172.21.15.57:0/2601445617 >> [v2:172.21.15.57:6824/33058,v1:172.21.15.57:6825/33058] conn(0x7f41e0066a90 0x7f41e0068ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:03.439 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.436+0000 7f41ee7fc700 1 -- 172.21.15.57:0/2601445617 --> [v2:172.21.15.57:6824/33058,v1:172.21.15.57:6825/33058] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f41e0069550 con 0x7f41e0066a90 2023-10-06T03:04:03.439 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.436+0000 7f41ee7fc700 1 -- 172.21.15.57:0/2601445617 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=59) v2 ==== 24+0+0 (secure 0 0 0) 0x7f41f80815d0 con 0x7f420015cb00 2023-10-06T03:04:03.439 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.436+0000 7f41fe59c700 1 --2- 172.21.15.57:0/2601445617 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f41e0060580 0x7f41e0062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:03.439 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.436+0000 7f41fdd9b700 1 --2- 172.21.15.57:0/2601445617 >> [v2:172.21.15.57:6824/33058,v1:172.21.15.57:6825/33058] conn(0x7f41e0066a90 0x7f41e0068ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:03.440 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.436+0000 7f41fe59c700 1 --2- 172.21.15.57:0/2601445617 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f41e0060580 0x7f41e0062a30 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f41f0009f40 tx=0x7f41f00091a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:03.440 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.436+0000 7f41fdd9b700 1 --2- 172.21.15.57:0/2601445617 >> [v2:172.21.15.57:6824/33058,v1:172.21.15.57:6825/33058] conn(0x7f41e0066a90 0x7f41e0068ea0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:03.440 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.436+0000 7f41ee7fc700 1 -- 172.21.15.57:0/2601445617 <== osd.2 v2:172.21.15.57:6824/33058 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f41e0069550 con 0x7f41e0066a90 2023-10-06T03:04:03.457 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.452+0000 7f41ff59e700 1 -- 172.21.15.57:0/2601445617 --> [v2:172.21.15.57:6824/33058,v1:172.21.15.57:6825/33058] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f420004be40 con 0x7f41e0066a90 2023-10-06T03:04:03.457 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.452+0000 7f41ee7fc700 1 -- 172.21.15.57:0/2601445617 <== osd.2 v2:172.21.15.57:6824/33058 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f420004be40 con 0x7f41e0066a90 2023-10-06T03:04:03.457 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-10-06T03:04:03.458 INFO:teuthology.orchestra.run.smithi057.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T03:04:03.458 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-10-06T03:04:03.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.452+0000 7f41ff59e700 1 -- 172.21.15.57:0/2601445617 >> [v2:172.21.15.57:6824/33058,v1:172.21.15.57:6825/33058] conn(0x7f41e0066a90 msgr2=0x7f41e0068ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:03.458 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.452+0000 7f41ff59e700 1 --2- 172.21.15.57:0/2601445617 >> [v2:172.21.15.57:6824/33058,v1:172.21.15.57:6825/33058] conn(0x7f41e0066a90 0x7f41e0068ea0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:03.462 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.456+0000 7f41ff59e700 1 -- 172.21.15.57:0/2601445617 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f41e0060580 msgr2=0x7f41e0062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:03.462 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.456+0000 7f41ff59e700 1 --2- 172.21.15.57:0/2601445617 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f41e0060580 0x7f41e0062a30 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f41f0009f40 tx=0x7f41f00091a0 comp rx=0 tx=0).stop 2023-10-06T03:04:03.462 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.456+0000 7f41ff59e700 1 -- 172.21.15.57:0/2601445617 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f420015cb00 msgr2=0x7f4200157600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:03.462 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.456+0000 7f41ff59e700 1 --2- 172.21.15.57:0/2601445617 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f420015cb00 0x7f4200157600 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f42000cd810 tx=0x7f41f8019000 comp rx=0 tx=0).stop 2023-10-06T03:04:03.462 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.456+0000 7f41fed9d700 1 -- 172.21.15.57:0/2601445617 reap_dead start 2023-10-06T03:04:03.462 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.456+0000 7f41ff59e700 1 -- 172.21.15.57:0/2601445617 shutdown_connections 2023-10-06T03:04:03.462 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.456+0000 7f41ff59e700 1 -- 172.21.15.57:0/2601445617 >> 172.21.15.57:0/2601445617 conn(0x7f42000cc9b0 msgr2=0x7f42000678e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:03.462 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.456+0000 7f41ff59e700 1 -- 172.21.15.57:0/2601445617 shutdown_connections 2023-10-06T03:04:03.462 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.456+0000 7f41ff59e700 1 -- 172.21.15.57:0/2601445617 wait complete. 2023-10-06T03:04:03.478 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-10-06T03:04:03.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.644+0000 7fc6e5e4c700 1 Processor -- start 2023-10-06T03:04:03.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.644+0000 7fc6e5e4c700 1 -- start start 2023-10-06T03:04:03.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.648+0000 7fc6e5e4c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc6e0158dc0 0x7fc6e00cc660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:03.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.648+0000 7fc6e5e4c700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc6e0159190 0x7fc6e015d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:03.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.648+0000 7fc6e5e4c700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6e006b020 con 0x7fc6e006b4b0 2023-10-06T03:04:03.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.648+0000 7fc6e5e4c700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6e006a6f0 con 0x7fc6e0158dc0 2023-10-06T03:04:03.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.648+0000 7fc6e5e4c700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e006a9d0 con 0x7fc6e0159190 2023-10-06T03:04:03.652 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.648+0000 7fc6e4e4a700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc6e0158dc0 0x7fc6e00cc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:03.652 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.648+0000 7fc6e4e4a700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc6e0158dc0 0x7fc6e00cc660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:52322/0 (socket says 172.21.15.57:52322) 2023-10-06T03:04:03.652 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.648+0000 7fc6e4e4a700 1 -- 172.21.15.57:0/3296366703 learned_addr learned my addr 172.21.15.57:0/3296366703 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:04:03.652 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.648+0000 7fc6e564b700 1 --2- 172.21.15.57:0/3296366703 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc6e0159190 0x7fc6e015d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:03.653 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.648+0000 7fc6e4e4a700 1 -- 172.21.15.57:0/3296366703 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc6e0159190 msgr2=0x7fc6e015d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:03.653 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.648+0000 7fc6e4e4a700 1 --2- 172.21.15.57:0/3296366703 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc6e0159190 0x7fc6e015d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:03.653 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.648+0000 7fc6e4e4a700 1 -- 172.21.15.57:0/3296366703 >> v1:172.21.15.105:6789/0 conn(0x7fc6e006b4b0 legacy=0x7fc6e015ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:03.653 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.648+0000 7fc6e4e4a700 1 -- 172.21.15.57:0/3296366703 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6e006acb0 con 0x7fc6e0158dc0 2023-10-06T03:04:03.653 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.648+0000 7fc6e564b700 1 --2- 172.21.15.57:0/3296366703 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc6e0159190 0x7fc6e015d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:04:03.654 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.648+0000 7fc6e4e4a700 1 --2- 172.21.15.57:0/3296366703 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc6e0158dc0 0x7fc6e00cc660 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fc6d4009f20 tx=0x7fc6d4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3570afde9c926bee server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:03.654 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.648+0000 7fc6df7fe700 1 -- 172.21.15.57:0/3296366703 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6d400e070 con 0x7fc6e0158dc0 2023-10-06T03:04:03.654 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.648+0000 7fc6df7fe700 1 -- 172.21.15.57:0/3296366703 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6d400b9d0 con 0x7fc6e0158dc0 2023-10-06T03:04:03.654 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.648+0000 7fc6df7fe700 1 -- 172.21.15.57:0/3296366703 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6d40092e0 con 0x7fc6e0158dc0 2023-10-06T03:04:03.655 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.652+0000 7fc6e5e4c700 1 -- 172.21.15.57:0/3296366703 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc6e0158dc0 msgr2=0x7fc6e00cc660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:03.655 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.652+0000 7fc6e5e4c700 1 --2- 172.21.15.57:0/3296366703 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc6e0158dc0 0x7fc6e00cc660 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fc6d4009f20 tx=0x7fc6d4009840 comp rx=0 tx=0).stop 2023-10-06T03:04:03.656 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.652+0000 7fc6e5e4c700 1 -- 172.21.15.57:0/3296366703 shutdown_connections 2023-10-06T03:04:03.656 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.652+0000 7fc6e5e4c700 1 --2- 172.21.15.57:0/3296366703 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc6e0159190 0x7fc6e015d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:03.656 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.652+0000 7fc6e5e4c700 1 --2- 172.21.15.57:0/3296366703 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc6e0158dc0 0x7fc6e00cc660 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:03.656 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.652+0000 7fc6e5e4c700 1 -- 172.21.15.57:0/3296366703 >> 172.21.15.57:0/3296366703 conn(0x7fc6e0067050 msgr2=0x7fc6e0067450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:03.656 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.652+0000 7fc6e5e4c700 1 -- 172.21.15.57:0/3296366703 shutdown_connections 2023-10-06T03:04:03.656 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.652+0000 7fc6e5e4c700 1 -- 172.21.15.57:0/3296366703 wait complete. 2023-10-06T03:04:03.657 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.652+0000 7fc6e5e4c700 1 Processor -- start 2023-10-06T03:04:03.658 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.652+0000 7fc6e5e4c700 1 -- start start 2023-10-06T03:04:03.659 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.656+0000 7fc6e5e4c700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc6e006b4b0 0x7fc6e00ca4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:03.659 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.656+0000 7fc6e5e4c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc6e0158dc0 0x7fc6e00caa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:03.659 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.656+0000 7fc6e5e4c700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc6e0159190 0x7fc6e00cf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:03.659 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.656+0000 7fc6e5e4c700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e016d080 con 0x7fc6e0158dc0 2023-10-06T03:04:03.660 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.656+0000 7fc6e5e4c700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e016d360 con 0x7fc6e006b4b0 2023-10-06T03:04:03.660 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.656+0000 7fc6e5e4c700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e016d640 con 0x7fc6e0159190 2023-10-06T03:04:03.661 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.656+0000 7fc6dffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc6e0158dc0 0x7fc6e00caa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:03.661 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.656+0000 7fc6e4e4a700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc6e006b4b0 0x7fc6e00ca4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:03.661 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.656+0000 7fc6e4e4a700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc6e006b4b0 0x7fc6e00ca4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.57:41242/0 (socket says 172.21.15.57:41242) 2023-10-06T03:04:03.661 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.656+0000 7fc6e4e4a700 1 -- 172.21.15.57:0/2538505545 learned_addr learned my addr 172.21.15.57:0/2538505545 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:04:03.661 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.656+0000 7fc6e564b700 1 --2- 172.21.15.57:0/2538505545 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc6e0159190 0x7fc6e00cf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:03.661 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.656+0000 7fc6e4e4a700 1 -- 172.21.15.57:0/2538505545 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc6e0159190 msgr2=0x7fc6e00cf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:03.661 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.656+0000 7fc6e4e4a700 1 --2- 172.21.15.57:0/2538505545 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc6e0159190 0x7fc6e00cf9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:03.661 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.656+0000 7fc6e4e4a700 1 -- 172.21.15.57:0/2538505545 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc6e0158dc0 msgr2=0x7fc6e00caa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:03.661 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.656+0000 7fc6e4e4a700 1 --2- 172.21.15.57:0/2538505545 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc6e0158dc0 0x7fc6e00caa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:03.661 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.656+0000 7fc6e4e4a700 1 -- 172.21.15.57:0/2538505545 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6d8009420 con 0x7fc6e006b4b0 2023-10-06T03:04:03.662 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.656+0000 7fc6dffff700 1 --2- 172.21.15.57:0/2538505545 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc6e0158dc0 0x7fc6e00caa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:04:03.662 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.656+0000 7fc6e4e4a700 1 --2- 172.21.15.57:0/2538505545 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc6e006b4b0 0x7fc6e00ca4c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fc6d400b610 tx=0x7fc6d4018000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:03.662 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.656+0000 7fc6dcff9700 1 -- 172.21.15.57:0/2538505545 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6d40089a0 con 0x7fc6e006b4b0 2023-10-06T03:04:03.663 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.656+0000 7fc6dcff9700 1 -- 172.21.15.57:0/2538505545 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6d4008b00 con 0x7fc6e006b4b0 2023-10-06T03:04:03.663 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.656+0000 7fc6e5e4c700 1 -- 172.21.15.57:0/2538505545 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6d4009ae0 con 0x7fc6e006b4b0 2023-10-06T03:04:03.663 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.656+0000 7fc6dcff9700 1 -- 172.21.15.57:0/2538505545 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6d4025460 con 0x7fc6e006b4b0 2023-10-06T03:04:03.663 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.656+0000 7fc6e5e4c700 1 -- 172.21.15.57:0/2538505545 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6e016dc00 con 0x7fc6e006b4b0 2023-10-06T03:04:03.663 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.660+0000 7fc6e5e4c700 1 -- 172.21.15.57:0/2538505545 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6e016de20 con 0x7fc6e006b4b0 2023-10-06T03:04:03.666 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.660+0000 7fc6dcff9700 1 -- 172.21.15.57:0/2538505545 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fc6d4003040 con 0x7fc6e006b4b0 2023-10-06T03:04:03.667 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.664+0000 7fc6dcff9700 1 --2- 172.21.15.57:0/2538505545 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fc6c4060580 0x7fc6c4062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:03.667 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.664+0000 7fc6dcff9700 1 -- 172.21.15.57:0/2538505545 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5378+0+0 (secure 0 0 0) 0x7fc6d407e860 con 0x7fc6e006b4b0 2023-10-06T03:04:03.667 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.664+0000 7fc6dffff700 1 --2- 172.21.15.57:0/2538505545 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fc6c4060580 0x7fc6c4062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:03.668 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.664+0000 7fc6dffff700 1 --2- 172.21.15.57:0/2538505545 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fc6c4060580 0x7fc6c4062a30 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fc6e00cf8b0 tx=0x7fc6cc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:03.673 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.668+0000 7fc6dcff9700 1 -- 172.21.15.57:0/2538505545 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fc6d404efb0 con 0x7fc6e006b4b0 2023-10-06T03:04:03.845 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.840+0000 7fc6e5e4c700 1 -- 172.21.15.57:0/2538505545 --> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7fc6e016d4a0 con 0x7fc6c4060580 2023-10-06T03:04:03.846 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.840+0000 7fc6dcff9700 1 -- 172.21.15.57:0/2538505545 <== mgr.4103 v2:172.21.15.57:6832/32947 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fc6e016d4a0 con 0x7fc6c4060580 2023-10-06T03:04:03.850 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.844+0000 7fc6e5e4c700 1 -- 172.21.15.57:0/2538505545 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fc6c4060580 msgr2=0x7fc6c4062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:03.851 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.844+0000 7fc6e5e4c700 1 --2- 172.21.15.57:0/2538505545 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fc6c4060580 0x7fc6c4062a30 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fc6e00cf8b0 tx=0x7fc6cc009040 comp rx=0 tx=0).stop 2023-10-06T03:04:03.851 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.844+0000 7fc6e5e4c700 1 -- 172.21.15.57:0/2538505545 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc6e006b4b0 msgr2=0x7fc6e00ca4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:03.851 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.844+0000 7fc6e5e4c700 1 --2- 172.21.15.57:0/2538505545 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc6e006b4b0 0x7fc6e00ca4c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fc6d400b610 tx=0x7fc6d4018000 comp rx=0 tx=0).stop 2023-10-06T03:04:03.851 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.844+0000 7fc6e5e4c700 1 -- 172.21.15.57:0/2538505545 shutdown_connections 2023-10-06T03:04:03.851 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.844+0000 7fc6e5e4c700 1 --2- 172.21.15.57:0/2538505545 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fc6c4060580 0x7fc6c4062a30 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:03.851 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.844+0000 7fc6e5e4c700 1 --2- 172.21.15.57:0/2538505545 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc6e0159190 0x7fc6e00cf9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:03.851 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.844+0000 7fc6e5e4c700 1 --2- 172.21.15.57:0/2538505545 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc6e0158dc0 0x7fc6e00caa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:03.851 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.844+0000 7fc6e5e4c700 1 --2- 172.21.15.57:0/2538505545 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc6e006b4b0 0x7fc6e00ca4c0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:03.851 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.844+0000 7fc6e5e4c700 1 -- 172.21.15.57:0/2538505545 >> 172.21.15.57:0/2538505545 conn(0x7fc6e0067050 msgr2=0x7fc6e00c6810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:03.851 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.848+0000 7fc6e5e4c700 1 -- 172.21.15.57:0/2538505545 shutdown_connections 2023-10-06T03:04:03.852 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:03.848+0000 7fc6e5e4c700 1 -- 172.21.15.57:0/2538505545 wait complete. 2023-10-06T03:04:03.854 INFO:teuthology.orchestra.run.smithi057.stderr:instructed osd(s) 2 to deep-scrub 2023-10-06T03:04:03.874 INFO:tasks.ceph:Scrubbing osd.3 2023-10-06T03:04:03.874 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-10-06T03:04:04.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.040+0000 7f4757185700 1 Processor -- start 2023-10-06T03:04:04.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.040+0000 7f4757185700 1 -- start start 2023-10-06T03:04:04.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.044+0000 7f4757185700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4750067280 0x7f4750067650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:04.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.044+0000 7f4757185700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f47500cb0f0 0x7f475006d680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:04.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.044+0000 7f4757185700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4750158ae0 0x7f4750158f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:04.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.044+0000 7f4757185700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47500cb540 con 0x7f4750067280 2023-10-06T03:04:04.049 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.044+0000 7f4757185700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f475006dbc0 con 0x7f47500cb0f0 2023-10-06T03:04:04.049 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.044+0000 7f4757185700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47500cb7b0 con 0x7f4750158ae0 2023-10-06T03:04:04.049 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.044+0000 7f4754f21700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4750067280 0x7f4750067650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:04.049 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.044+0000 7f4754f21700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4750067280 0x7f4750067650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:52342/0 (socket says 172.21.15.57:52342) 2023-10-06T03:04:04.050 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.044+0000 7f4754f21700 1 -- 172.21.15.57:0/3158371724 learned_addr learned my addr 172.21.15.57:0/3158371724 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:04:04.050 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.044+0000 7f4755722700 1 --2- 172.21.15.57:0/3158371724 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4750158ae0 0x7f4750158f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:04.050 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.044+0000 7f474ffff700 1 --2- 172.21.15.57:0/3158371724 >> v2:172.21.15.105:3300/0 conn(0x7f47500cb0f0 0x7f475006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:04.050 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.044+0000 7f4754f21700 1 -- 172.21.15.57:0/3158371724 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4750158ae0 msgr2=0x7f4750158f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:04.050 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.044+0000 7f4754f21700 1 --2- 172.21.15.57:0/3158371724 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4750158ae0 0x7f4750158f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:04.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.044+0000 7f4754f21700 1 -- 172.21.15.57:0/3158371724 >> v2:172.21.15.105:3300/0 conn(0x7f47500cb0f0 msgr2=0x7f475006d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:04.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.044+0000 7f4754f21700 1 --2- 172.21.15.57:0/3158371724 >> v2:172.21.15.105:3300/0 conn(0x7f47500cb0f0 0x7f475006d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:04.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.044+0000 7f4754f21700 1 -- 172.21.15.57:0/3158371724 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47500cba90 con 0x7f4750067280 2023-10-06T03:04:04.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.048+0000 7f4754f21700 1 --2- 172.21.15.57:0/3158371724 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4750067280 0x7f4750067650 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f47500634e0 tx=0x7f4744009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cce9e592ec201fc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:04.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.048+0000 7f474f7fe700 1 -- 172.21.15.57:0/3158371724 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f474400b640 con 0x7f4750067280 2023-10-06T03:04:04.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.048+0000 7f474f7fe700 1 -- 172.21.15.57:0/3158371724 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f474400b7a0 con 0x7f4750067280 2023-10-06T03:04:04.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.048+0000 7f474f7fe700 1 -- 172.21.15.57:0/3158371724 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f474400bb60 con 0x7f4750067280 2023-10-06T03:04:04.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.048+0000 7f4757185700 1 -- 172.21.15.57:0/3158371724 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4750067280 msgr2=0x7f4750067650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:04.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.048+0000 7f4757185700 1 --2- 172.21.15.57:0/3158371724 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4750067280 0x7f4750067650 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f47500634e0 tx=0x7f4744009250 comp rx=0 tx=0).stop 2023-10-06T03:04:04.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.048+0000 7f4757185700 1 -- 172.21.15.57:0/3158371724 shutdown_connections 2023-10-06T03:04:04.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.048+0000 7f4757185700 1 --2- 172.21.15.57:0/3158371724 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4750158ae0 0x7f4750158f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:04.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.048+0000 7f4757185700 1 --2- 172.21.15.57:0/3158371724 >> v2:172.21.15.105:3300/0 conn(0x7f47500cb0f0 0x7f475006d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:04.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.048+0000 7f4757185700 1 --2- 172.21.15.57:0/3158371724 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4750067280 0x7f4750067650 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:04.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.048+0000 7f4757185700 1 -- 172.21.15.57:0/3158371724 >> 172.21.15.57:0/3158371724 conn(0x7f47500d0bc0 msgr2=0x7f47500ccb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:04.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.048+0000 7f4757185700 1 -- 172.21.15.57:0/3158371724 shutdown_connections 2023-10-06T03:04:04.054 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.048+0000 7f4757185700 1 -- 172.21.15.57:0/3158371724 wait complete. 2023-10-06T03:04:04.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.052+0000 7f4757185700 1 Processor -- start 2023-10-06T03:04:04.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.052+0000 7f4757185700 1 -- start start 2023-10-06T03:04:04.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.052+0000 7f4757185700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4750067280 0x7f475013e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:04.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.052+0000 7f4757185700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f47500cb0f0 0x7f47500b23b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:04.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.052+0000 7f4757185700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4750158ae0 0x7f4750067650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:04.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.052+0000 7f4757185700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f475016d800 con 0x7f47500cb0f0 2023-10-06T03:04:04.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.052+0000 7f4757185700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f475016cbf0 con 0x7f4750158ae0 2023-10-06T03:04:04.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.052+0000 7f4757185700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f475016ced0 con 0x7f4750067280 2023-10-06T03:04:04.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.052+0000 7f474ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f47500cb0f0 0x7f47500b23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:04.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.052+0000 7f474ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f47500cb0f0 0x7f47500b23b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:52346/0 (socket says 172.21.15.57:52346) 2023-10-06T03:04:04.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.052+0000 7f474ffff700 1 -- 172.21.15.57:0/267751781 learned_addr learned my addr 172.21.15.57:0/267751781 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:04:04.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.052+0000 7f4754f21700 1 --2- 172.21.15.57:0/267751781 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4750067280 0x7f475013e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:04.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.052+0000 7f4755722700 1 --2- 172.21.15.57:0/267751781 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4750158ae0 0x7f4750067650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:04.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.052+0000 7f474ffff700 1 -- 172.21.15.57:0/267751781 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4750067280 msgr2=0x7f475013e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:04.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.052+0000 7f474ffff700 1 --2- 172.21.15.57:0/267751781 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4750067280 0x7f475013e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:04.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.052+0000 7f474ffff700 1 -- 172.21.15.57:0/267751781 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4750158ae0 msgr2=0x7f4750067650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:04.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.052+0000 7f474ffff700 1 --2- 172.21.15.57:0/267751781 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4750158ae0 0x7f4750067650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:04.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.052+0000 7f474ffff700 1 -- 172.21.15.57:0/267751781 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47440094f0 con 0x7f47500cb0f0 2023-10-06T03:04:04.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.052+0000 7f4755722700 1 --2- 172.21.15.57:0/267751781 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4750158ae0 0x7f4750067650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:04:04.060 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.056+0000 7f474ffff700 1 --2- 172.21.15.57:0/267751781 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f47500cb0f0 0x7f47500b23b0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f473c00ec80 tx=0x7f473c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:04.060 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.056+0000 7f474cff9700 1 -- 172.21.15.57:0/267751781 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f473c00c850 con 0x7f47500cb0f0 2023-10-06T03:04:04.060 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.056+0000 7f474cff9700 1 -- 172.21.15.57:0/267751781 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f473c00c9b0 con 0x7f47500cb0f0 2023-10-06T03:04:04.061 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.056+0000 7f4757185700 1 -- 172.21.15.57:0/267751781 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f475016d1b0 con 0x7f47500cb0f0 2023-10-06T03:04:04.061 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.056+0000 7f474cff9700 1 -- 172.21.15.57:0/267751781 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f473c00cd50 con 0x7f47500cb0f0 2023-10-06T03:04:04.061 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.056+0000 7f4757185700 1 -- 172.21.15.57:0/267751781 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f475013e760 con 0x7f47500cb0f0 2023-10-06T03:04:04.061 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.056+0000 7f4757185700 1 -- 172.21.15.57:0/267751781 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f47500712e0 con 0x7f47500cb0f0 2023-10-06T03:04:04.062 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.056+0000 7f474cff9700 1 -- 172.21.15.57:0/267751781 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f473c013680 con 0x7f47500cb0f0 2023-10-06T03:04:04.064 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.060+0000 7f474cff9700 1 --2- 172.21.15.57:0/267751781 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f4734060620 0x7f4734062ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:04.064 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.060+0000 7f474cff9700 1 -- 172.21.15.57:0/267751781 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5378+0+0 (secure 0 0 0) 0x7f473c07cca0 con 0x7f47500cb0f0 2023-10-06T03:04:04.065 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.060+0000 7f474cff9700 1 --2- 172.21.15.57:0/267751781 >> [v2:172.21.15.57:6808/33057,v1:172.21.15.57:6811/33057] conn(0x7f4734066b30 0x7f4734068f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:04.065 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.060+0000 7f474cff9700 1 -- 172.21.15.57:0/267751781 --> [v2:172.21.15.57:6808/33057,v1:172.21.15.57:6811/33057] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f47340695f0 con 0x7f4734066b30 2023-10-06T03:04:04.065 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.060+0000 7f474cff9700 1 -- 172.21.15.57:0/267751781 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=59) v2 ==== 24+0+0 (secure 0 0 0) 0x7f473c081220 con 0x7f47500cb0f0 2023-10-06T03:04:04.065 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.060+0000 7f4754f21700 1 --2- 172.21.15.57:0/267751781 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f4734060620 0x7f4734062ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:04.065 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.060+0000 7f4755722700 1 --2- 172.21.15.57:0/267751781 >> [v2:172.21.15.57:6808/33057,v1:172.21.15.57:6811/33057] conn(0x7f4734066b30 0x7f4734068f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:04.066 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.060+0000 7f4754f21700 1 --2- 172.21.15.57:0/267751781 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f4734060620 0x7f4734062ad0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f47500634e0 tx=0x7f4744017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:04.066 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.060+0000 7f4755722700 1 --2- 172.21.15.57:0/267751781 >> [v2:172.21.15.57:6808/33057,v1:172.21.15.57:6811/33057] conn(0x7f4734066b30 0x7f4734068f40 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:04.067 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.064+0000 7f474cff9700 1 -- 172.21.15.57:0/267751781 <== osd.3 v2:172.21.15.57:6808/33057 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f47340695f0 con 0x7f4734066b30 2023-10-06T03:04:04.084 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.080+0000 7f4757185700 1 -- 172.21.15.57:0/267751781 --> [v2:172.21.15.57:6808/33057,v1:172.21.15.57:6811/33057] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f47500cbd70 con 0x7f4734066b30 2023-10-06T03:04:04.085 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.080+0000 7f474cff9700 1 -- 172.21.15.57:0/267751781 <== osd.3 v2:172.21.15.57:6808/33057 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f47500cbd70 con 0x7f4734066b30 2023-10-06T03:04:04.085 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-10-06T03:04:04.086 INFO:teuthology.orchestra.run.smithi057.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T03:04:04.086 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-10-06T03:04:04.086 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.080+0000 7f4757185700 1 -- 172.21.15.57:0/267751781 >> [v2:172.21.15.57:6808/33057,v1:172.21.15.57:6811/33057] conn(0x7f4734066b30 msgr2=0x7f4734068f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:04.086 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.080+0000 7f4757185700 1 --2- 172.21.15.57:0/267751781 >> [v2:172.21.15.57:6808/33057,v1:172.21.15.57:6811/33057] conn(0x7f4734066b30 0x7f4734068f40 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:04.087 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.084+0000 7f4757185700 1 -- 172.21.15.57:0/267751781 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f4734060620 msgr2=0x7f4734062ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:04.087 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.084+0000 7f4757185700 1 --2- 172.21.15.57:0/267751781 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f4734060620 0x7f4734062ad0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f47500634e0 tx=0x7f4744017000 comp rx=0 tx=0).stop 2023-10-06T03:04:04.087 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.084+0000 7f4757185700 1 -- 172.21.15.57:0/267751781 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f47500cb0f0 msgr2=0x7f47500b23b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:04.087 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.084+0000 7f4757185700 1 --2- 172.21.15.57:0/267751781 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f47500cb0f0 0x7f47500b23b0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f473c00ec80 tx=0x7f473c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:04:04.087 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.084+0000 7f4755722700 1 -- 172.21.15.57:0/267751781 reap_dead start 2023-10-06T03:04:04.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.084+0000 7f4757185700 1 -- 172.21.15.57:0/267751781 shutdown_connections 2023-10-06T03:04:04.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.084+0000 7f4757185700 1 -- 172.21.15.57:0/267751781 >> 172.21.15.57:0/267751781 conn(0x7f47500d0bc0 msgr2=0x7f4750151950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:04.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.084+0000 7f4757185700 1 -- 172.21.15.57:0/267751781 shutdown_connections 2023-10-06T03:04:04.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.084+0000 7f4757185700 1 -- 172.21.15.57:0/267751781 wait complete. 2023-10-06T03:04:04.109 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-10-06T03:04:04.272 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.268+0000 7fbaff3cc700 1 Processor -- start 2023-10-06T03:04:04.273 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.268+0000 7fbaff3cc700 1 -- start start 2023-10-06T03:04:04.276 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.272+0000 7fbaff3cc700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fbaf8158d90 0x7fbaf815d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:04.276 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.272+0000 7fbaff3cc700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbaf806b3c0 0x7fbaf80cc870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:04.276 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.272+0000 7fbaff3cc700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fbaf80ccdb0 0x7fbaf80ca4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:04.276 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.272+0000 7fbaff3cc700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbaf815daf0 con 0x7fbaf8158d90 2023-10-06T03:04:04.276 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.272+0000 7fbaff3cc700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbaf80cd230 con 0x7fbaf80ccdb0 2023-10-06T03:04:04.276 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.272+0000 7fbaff3cc700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaf806ccd0 con 0x7fbaf806b3c0 2023-10-06T03:04:04.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.272+0000 7fbafe3ca700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fbaf8158d90 0x7fbaf815d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:04.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.272+0000 7fbafdbc9700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbaf806b3c0 0x7fbaf80cc870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:04.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.272+0000 7fbafe3ca700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fbaf8158d90 0x7fbaf815d2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:52348/0 (socket says 172.21.15.57:52348) 2023-10-06T03:04:04.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.272+0000 7fbafe3ca700 1 -- 172.21.15.57:0/3684989511 learned_addr learned my addr 172.21.15.57:0/3684989511 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:04:04.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.272+0000 7fbafebcb700 1 --2- 172.21.15.57:0/3684989511 >> v2:172.21.15.105:3300/0 conn(0x7fbaf80ccdb0 0x7fbaf80ca4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:04.278 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.272+0000 7fbafdbc9700 1 -- 172.21.15.57:0/3684989511 >> v2:172.21.15.105:3300/0 conn(0x7fbaf80ccdb0 msgr2=0x7fbaf80ca4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:04.278 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.272+0000 7fbafdbc9700 1 --2- 172.21.15.57:0/3684989511 >> v2:172.21.15.105:3300/0 conn(0x7fbaf80ccdb0 0x7fbaf80ca4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:04.278 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.272+0000 7fbafdbc9700 1 -- 172.21.15.57:0/3684989511 >> v2:172.21.15.57:3300/0 conn(0x7fbaf8158d90 msgr2=0x7fbaf815d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:04.278 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.272+0000 7fbafdbc9700 1 --2- 172.21.15.57:0/3684989511 >> v2:172.21.15.57:3300/0 conn(0x7fbaf8158d90 0x7fbaf815d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:04.279 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.272+0000 7fbafdbc9700 1 -- 172.21.15.57:0/3684989511 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaf806cfb0 con 0x7fbaf806b3c0 2023-10-06T03:04:04.279 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.272+0000 7fbafdbc9700 1 --2- 172.21.15.57:0/3684989511 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbaf806b3c0 0x7fbaf80cc870 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fbaf80cfec0 tx=0x7fbae80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7757521e2e451afa server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:04.279 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.276+0000 7fbafd3c8700 1 -- 172.21.15.57:0/3684989511 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae8011630 con 0x7fbaf806b3c0 2023-10-06T03:04:04.280 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.276+0000 7fbafd3c8700 1 -- 172.21.15.57:0/3684989511 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbae8011790 con 0x7fbaf806b3c0 2023-10-06T03:04:04.280 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.276+0000 7fbafd3c8700 1 -- 172.21.15.57:0/3684989511 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae8011b30 con 0x7fbaf806b3c0 2023-10-06T03:04:04.280 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.276+0000 7fbaff3cc700 1 -- 172.21.15.57:0/3684989511 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbaf806b3c0 msgr2=0x7fbaf80cc870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:04.280 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.276+0000 7fbaff3cc700 1 --2- 172.21.15.57:0/3684989511 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbaf806b3c0 0x7fbaf80cc870 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fbaf80cfec0 tx=0x7fbae80091a0 comp rx=0 tx=0).stop 2023-10-06T03:04:04.280 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.276+0000 7fbaff3cc700 1 -- 172.21.15.57:0/3684989511 shutdown_connections 2023-10-06T03:04:04.280 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.276+0000 7fbaff3cc700 1 --2- 172.21.15.57:0/3684989511 >> v2:172.21.15.105:3300/0 conn(0x7fbaf80ccdb0 0x7fbaf80ca4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:04.280 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.276+0000 7fbaff3cc700 1 --2- 172.21.15.57:0/3684989511 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbaf806b3c0 0x7fbaf80cc870 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:04.280 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.276+0000 7fbaff3cc700 1 --2- 172.21.15.57:0/3684989511 >> v2:172.21.15.57:3300/0 conn(0x7fbaf8158d90 0x7fbaf815d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:04.280 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.276+0000 7fbaff3cc700 1 -- 172.21.15.57:0/3684989511 >> 172.21.15.57:0/3684989511 conn(0x7fbaf8067050 msgr2=0x7fbaf8067450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:04.280 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.276+0000 7fbaff3cc700 1 -- 172.21.15.57:0/3684989511 shutdown_connections 2023-10-06T03:04:04.280 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.276+0000 7fbaff3cc700 1 -- 172.21.15.57:0/3684989511 wait complete. 2023-10-06T03:04:04.281 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.276+0000 7fbaff3cc700 1 Processor -- start 2023-10-06T03:04:04.281 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.276+0000 7fbaff3cc700 1 -- start start 2023-10-06T03:04:04.282 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.280+0000 7fbaff3cc700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbaf806b3c0 0x7fbaf815a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:04.283 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.280+0000 7fbaff3cc700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbaf80ccdb0 0x7fbaf816d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:04.283 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.280+0000 7fbaff3cc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbaf8158d90 0x7fbaf8087890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:04.283 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.280+0000 7fbaff3cc700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaf80c54e0 con 0x7fbaf8158d90 2023-10-06T03:04:04.283 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.280+0000 7fbaff3cc700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaf815a850 con 0x7fbaf80ccdb0 2023-10-06T03:04:04.283 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.280+0000 7fbaff3cc700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaf808b0c0 con 0x7fbaf806b3c0 2023-10-06T03:04:04.284 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.280+0000 7fbafebcb700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbaf8158d90 0x7fbaf8087890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:04.284 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.280+0000 7fbafebcb700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbaf8158d90 0x7fbaf8087890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:52354/0 (socket says 172.21.15.57:52354) 2023-10-06T03:04:04.284 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.280+0000 7fbafebcb700 1 -- 172.21.15.57:0/1406146062 learned_addr learned my addr 172.21.15.57:0/1406146062 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:04:04.284 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.280+0000 7fbafe3ca700 1 --2- 172.21.15.57:0/1406146062 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbaf806b3c0 0x7fbaf815a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:04.284 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.280+0000 7fbafdbc9700 1 --2- 172.21.15.57:0/1406146062 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbaf80ccdb0 0x7fbaf816d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:04.284 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.280+0000 7fbafebcb700 1 -- 172.21.15.57:0/1406146062 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbaf806b3c0 msgr2=0x7fbaf815a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:04.284 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.280+0000 7fbafebcb700 1 --2- 172.21.15.57:0/1406146062 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbaf806b3c0 0x7fbaf815a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:04.284 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.280+0000 7fbafebcb700 1 -- 172.21.15.57:0/1406146062 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbaf80ccdb0 msgr2=0x7fbaf816d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:04.284 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.280+0000 7fbafebcb700 1 --2- 172.21.15.57:0/1406146062 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbaf80ccdb0 0x7fbaf816d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:04.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.280+0000 7fbafebcb700 1 -- 172.21.15.57:0/1406146062 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbae8009420 con 0x7fbaf8158d90 2023-10-06T03:04:04.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.280+0000 7fbafebcb700 1 --2- 172.21.15.57:0/1406146062 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbaf8158d90 0x7fbaf8087890 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fbaf0009fd0 tx=0x7fbaf0009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:04.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.280+0000 7fbaee7fc700 1 -- 172.21.15.57:0/1406146062 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaf000ebf0 con 0x7fbaf8158d90 2023-10-06T03:04:04.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.280+0000 7fbaee7fc700 1 -- 172.21.15.57:0/1406146062 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaf000ed50 con 0x7fbaf8158d90 2023-10-06T03:04:04.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.280+0000 7fbaee7fc700 1 -- 172.21.15.57:0/1406146062 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaf0014670 con 0x7fbaf8158d90 2023-10-06T03:04:04.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.280+0000 7fbaff3cc700 1 -- 172.21.15.57:0/1406146062 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbaf80c4bb0 con 0x7fbaf8158d90 2023-10-06T03:04:04.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.280+0000 7fbaff3cc700 1 -- 172.21.15.57:0/1406146062 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbaf80c5170 con 0x7fbaf8158d90 2023-10-06T03:04:04.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.284+0000 7fbaff3cc700 1 -- 172.21.15.57:0/1406146062 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbaf80c5690 con 0x7fbaf8158d90 2023-10-06T03:04:04.289 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.284+0000 7fbaee7fc700 1 -- 172.21.15.57:0/1406146062 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fbaf00149e0 con 0x7fbaf8158d90 2023-10-06T03:04:04.290 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.284+0000 7fbaee7fc700 1 --2- 172.21.15.57:0/1406146062 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fbadc060550 0x7fbadc062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:04.290 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.284+0000 7fbaee7fc700 1 -- 172.21.15.57:0/1406146062 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5378+0+0 (secure 0 0 0) 0x7fbaf007cd80 con 0x7fbaf8158d90 2023-10-06T03:04:04.291 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.288+0000 7fbafe3ca700 1 --2- 172.21.15.57:0/1406146062 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fbadc060550 0x7fbadc062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:04.291 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.288+0000 7fbafe3ca700 1 --2- 172.21.15.57:0/1406146062 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fbadc060550 0x7fbadc062a00 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fbaf4006fd0 tx=0x7fbaf4009250 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:04.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.292+0000 7fbaee7fc700 1 -- 172.21.15.57:0/1406146062 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fbaf80c5690 con 0x7fbaf8158d90 2023-10-06T03:04:04.468 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.464+0000 7fbaff3cc700 1 -- 172.21.15.57:0/1406146062 --> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7fbaf80c5690 con 0x7fbadc060550 2023-10-06T03:04:04.468 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.464+0000 7fbaee7fc700 1 -- 172.21.15.57:0/1406146062 <== mgr.4103 v2:172.21.15.57:6832/32947 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fbaf80c5690 con 0x7fbadc060550 2023-10-06T03:04:04.471 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.468+0000 7fbaff3cc700 1 -- 172.21.15.57:0/1406146062 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fbadc060550 msgr2=0x7fbadc062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:04.471 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.468+0000 7fbaff3cc700 1 --2- 172.21.15.57:0/1406146062 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fbadc060550 0x7fbadc062a00 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fbaf4006fd0 tx=0x7fbaf4009250 comp rx=0 tx=0).stop 2023-10-06T03:04:04.471 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.468+0000 7fbaff3cc700 1 -- 172.21.15.57:0/1406146062 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbaf8158d90 msgr2=0x7fbaf8087890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:04.471 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.468+0000 7fbaff3cc700 1 --2- 172.21.15.57:0/1406146062 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbaf8158d90 0x7fbaf8087890 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fbaf0009fd0 tx=0x7fbaf0009900 comp rx=0 tx=0).stop 2023-10-06T03:04:04.472 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.468+0000 7fbaff3cc700 1 -- 172.21.15.57:0/1406146062 shutdown_connections 2023-10-06T03:04:04.472 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.468+0000 7fbaff3cc700 1 --2- 172.21.15.57:0/1406146062 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbaf8158d90 0x7fbaf8087890 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:04.472 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.468+0000 7fbaff3cc700 1 --2- 172.21.15.57:0/1406146062 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbaf80ccdb0 0x7fbaf816d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:04.472 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.468+0000 7fbaff3cc700 1 --2- 172.21.15.57:0/1406146062 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fbadc060550 0x7fbadc062a00 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:04.472 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.468+0000 7fbaff3cc700 1 --2- 172.21.15.57:0/1406146062 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbaf806b3c0 0x7fbaf815a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:04.472 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.468+0000 7fbaff3cc700 1 -- 172.21.15.57:0/1406146062 >> 172.21.15.57:0/1406146062 conn(0x7fbaf8067050 msgr2=0x7fbaf8158140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:04.472 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.468+0000 7fbaff3cc700 1 -- 172.21.15.57:0/1406146062 shutdown_connections 2023-10-06T03:04:04.472 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.468+0000 7fbaff3cc700 1 -- 172.21.15.57:0/1406146062 wait complete. 2023-10-06T03:04:04.474 INFO:teuthology.orchestra.run.smithi057.stderr:instructed osd(s) 3 to deep-scrub 2023-10-06T03:04:04.491 INFO:tasks.ceph:Scrubbing osd.4 2023-10-06T03:04:04.491 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-10-06T03:04:04.659 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.656+0000 7f0995eae700 1 Processor -- start 2023-10-06T03:04:04.659 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.656+0000 7f0995eae700 1 -- start start 2023-10-06T03:04:04.663 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.656+0000 7f0995eae700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f0990152fa0 0x7f0990067050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:04.663 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.656+0000 7f0995eae700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0990153370 0x7f099006d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:04.663 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.656+0000 7f0995eae700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f09900c8e60 0x7f09900caad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:04.663 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.656+0000 7f0995eae700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0990156b90 con 0x7f09900c8e60 2023-10-06T03:04:04.663 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.656+0000 7f0995eae700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f099006d820 con 0x7f0990152fa0 2023-10-06T03:04:04.664 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.656+0000 7f0995eae700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0990155f80 con 0x7f0990153370 2023-10-06T03:04:04.664 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.660+0000 7f098ffff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f09900c8e60 0x7f09900caad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:04.664 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.660+0000 7f098ffff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f09900c8e60 0x7f09900caad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38152/0 (socket says 172.21.15.57:38152) 2023-10-06T03:04:04.664 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.660+0000 7f098ffff700 1 -- 172.21.15.57:0/2672907842 learned_addr learned my addr 172.21.15.57:0/2672907842 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:04:04.664 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.660+0000 7f098effd700 1 --2- 172.21.15.57:0/2672907842 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0990153370 0x7f099006d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:04.664 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.660+0000 7f098f7fe700 1 --2- 172.21.15.57:0/2672907842 >> v2:172.21.15.105:3300/0 conn(0x7f0990152fa0 0x7f0990067050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:04.665 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.660+0000 7f098effd700 1 -- 172.21.15.57:0/2672907842 >> v2:172.21.15.105:3300/0 conn(0x7f0990152fa0 msgr2=0x7f0990067050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:04.665 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.660+0000 7f098effd700 1 --2- 172.21.15.57:0/2672907842 >> v2:172.21.15.105:3300/0 conn(0x7f0990152fa0 0x7f0990067050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:04.665 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.660+0000 7f098effd700 1 -- 172.21.15.57:0/2672907842 >> v2:172.21.15.57:3300/0 conn(0x7f09900c8e60 msgr2=0x7f09900caad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:04.665 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.660+0000 7f098effd700 1 --2- 172.21.15.57:0/2672907842 >> v2:172.21.15.57:3300/0 conn(0x7f09900c8e60 0x7f09900caad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:04.665 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.660+0000 7f098effd700 1 -- 172.21.15.57:0/2672907842 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0990156260 con 0x7f0990153370 2023-10-06T03:04:04.666 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.660+0000 7f098ffff700 1 --2- 172.21.15.57:0/2672907842 >> v2:172.21.15.57:3300/0 conn(0x7f09900c8e60 0x7f09900caad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:04:04.666 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.660+0000 7f098effd700 1 --2- 172.21.15.57:0/2672907842 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0990153370 0x7f099006d2e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f099006ba30 tx=0x7f09840091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64b9b5f4a5cc65bd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:04.666 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.660+0000 7f098e7fc700 1 -- 172.21.15.57:0/2672907842 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0984011630 con 0x7f0990153370 2023-10-06T03:04:04.666 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.660+0000 7f098e7fc700 1 -- 172.21.15.57:0/2672907842 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09840117b0 con 0x7f0990153370 2023-10-06T03:04:04.666 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.660+0000 7f098e7fc700 1 -- 172.21.15.57:0/2672907842 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0984011b70 con 0x7f0990153370 2023-10-06T03:04:04.667 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.660+0000 7f0995eae700 1 -- 172.21.15.57:0/2672907842 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0990153370 msgr2=0x7f099006d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:04.667 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.660+0000 7f0995eae700 1 --2- 172.21.15.57:0/2672907842 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0990153370 0x7f099006d2e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f099006ba30 tx=0x7f09840091a0 comp rx=0 tx=0).stop 2023-10-06T03:04:04.667 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.664+0000 7f0995eae700 1 -- 172.21.15.57:0/2672907842 shutdown_connections 2023-10-06T03:04:04.667 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.664+0000 7f0995eae700 1 --2- 172.21.15.57:0/2672907842 >> v2:172.21.15.57:3300/0 conn(0x7f09900c8e60 0x7f09900caad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:04.667 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.664+0000 7f0995eae700 1 --2- 172.21.15.57:0/2672907842 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0990153370 0x7f099006d2e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:04.667 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.664+0000 7f0995eae700 1 --2- 172.21.15.57:0/2672907842 >> v2:172.21.15.105:3300/0 conn(0x7f0990152fa0 0x7f0990067050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:04.667 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.664+0000 7f0995eae700 1 -- 172.21.15.57:0/2672907842 >> 172.21.15.57:0/2672907842 conn(0x7f09900cc760 msgr2=0x7f09900c8750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:04.667 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.664+0000 7f0995eae700 1 -- 172.21.15.57:0/2672907842 shutdown_connections 2023-10-06T03:04:04.667 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.664+0000 7f0995eae700 1 -- 172.21.15.57:0/2672907842 wait complete. 2023-10-06T03:04:04.669 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.664+0000 7f0995eae700 1 Processor -- start 2023-10-06T03:04:04.669 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.664+0000 7f0995eae700 1 -- start start 2023-10-06T03:04:04.670 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.664+0000 7f0995eae700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f09900c8e60 0x7f09900b15d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:04.670 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.664+0000 7f0995eae700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0990152fa0 0x7f09901581d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:04.670 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.664+0000 7f0995eae700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0990153370 0x7f09901437d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:04.671 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.664+0000 7f0995eae700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0990158710 con 0x7f0990152fa0 2023-10-06T03:04:04.671 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.664+0000 7f0995eae700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0990143d10 con 0x7f0990153370 2023-10-06T03:04:04.671 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.664+0000 7f0995eae700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0990157d40 con 0x7f09900c8e60 2023-10-06T03:04:04.672 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.668+0000 7f098effd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0990152fa0 0x7f09901581d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:04.672 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.668+0000 7f098effd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0990152fa0 0x7f09901581d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38156/0 (socket says 172.21.15.57:38156) 2023-10-06T03:04:04.672 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.668+0000 7f098effd700 1 -- 172.21.15.57:0/1328023287 learned_addr learned my addr 172.21.15.57:0/1328023287 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:04:04.672 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.668+0000 7f098f7fe700 1 --2- 172.21.15.57:0/1328023287 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f09900c8e60 0x7f09900b15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:04.672 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.668+0000 7f098ffff700 1 --2- 172.21.15.57:0/1328023287 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0990153370 0x7f09901437d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:04.673 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.668+0000 7f098effd700 1 -- 172.21.15.57:0/1328023287 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f09900c8e60 msgr2=0x7f09900b15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:04.673 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.668+0000 7f098effd700 1 --2- 172.21.15.57:0/1328023287 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f09900c8e60 0x7f09900b15d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:04.673 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.668+0000 7f098effd700 1 -- 172.21.15.57:0/1328023287 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0990153370 msgr2=0x7f09901437d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:04.673 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.668+0000 7f098effd700 1 --2- 172.21.15.57:0/1328023287 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0990153370 0x7f09901437d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:04.673 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.668+0000 7f098effd700 1 -- 172.21.15.57:0/1328023287 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0988009ae0 con 0x7f0990152fa0 2023-10-06T03:04:04.673 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.668+0000 7f098effd700 1 --2- 172.21.15.57:0/1328023287 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0990152fa0 0x7f09901581d0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f0984013000 tx=0x7f0984017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:04.674 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.668+0000 7f09777fe700 1 -- 172.21.15.57:0/1328023287 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f098401f070 con 0x7f0990152fa0 2023-10-06T03:04:04.674 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.668+0000 7f09777fe700 1 -- 172.21.15.57:0/1328023287 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0984000bc0 con 0x7f0990152fa0 2023-10-06T03:04:04.674 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.668+0000 7f0995eae700 1 -- 172.21.15.57:0/1328023287 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0984009420 con 0x7f0990152fa0 2023-10-06T03:04:04.674 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.668+0000 7f09777fe700 1 -- 172.21.15.57:0/1328023287 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0984011b50 con 0x7f0990152fa0 2023-10-06T03:04:04.674 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.668+0000 7f0995eae700 1 -- 172.21.15.57:0/1328023287 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09901543f0 con 0x7f0990152fa0 2023-10-06T03:04:04.674 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.668+0000 7f0995eae700 1 -- 172.21.15.57:0/1328023287 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f09900712e0 con 0x7f0990152fa0 2023-10-06T03:04:04.675 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.672+0000 7f09777fe700 1 -- 172.21.15.57:0/1328023287 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f0984023070 con 0x7f0990152fa0 2023-10-06T03:04:04.677 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.672+0000 7f09777fe700 1 --2- 172.21.15.57:0/1328023287 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f097c060550 0x7f097c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:04.677 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.672+0000 7f09777fe700 1 -- 172.21.15.57:0/1328023287 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5378+0+0 (secure 0 0 0) 0x7f098407e090 con 0x7f0990152fa0 2023-10-06T03:04:04.677 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.672+0000 7f098f7fe700 1 --2- 172.21.15.57:0/1328023287 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f097c060550 0x7f097c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:04.678 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.672+0000 7f09777fe700 1 --2- 172.21.15.57:0/1328023287 >> [v2:172.21.15.105:6800/33368,v1:172.21.15.105:6801/33368] conn(0x7f097c066a60 0x7f097c068e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:04.678 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.672+0000 7f09777fe700 1 -- 172.21.15.57:0/1328023287 --> [v2:172.21.15.105:6800/33368,v1:172.21.15.105:6801/33368] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f097c069520 con 0x7f097c066a60 2023-10-06T03:04:04.678 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.672+0000 7f09777fe700 1 -- 172.21.15.57:0/1328023287 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=59) v2 ==== 24+0+0 (secure 0 0 0) 0x7f098407e380 con 0x7f0990152fa0 2023-10-06T03:04:04.679 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.676+0000 7f098ffff700 1 --2- 172.21.15.57:0/1328023287 >> [v2:172.21.15.105:6800/33368,v1:172.21.15.105:6801/33368] conn(0x7f097c066a60 0x7f097c068e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:04.679 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.676+0000 7f098f7fe700 1 --2- 172.21.15.57:0/1328023287 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f097c060550 0x7f097c062a00 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f0980009d10 tx=0x7f09800091a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:04.679 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.676+0000 7f098ffff700 1 --2- 172.21.15.57:0/1328023287 >> [v2:172.21.15.105:6800/33368,v1:172.21.15.105:6801/33368] conn(0x7f097c066a60 0x7f097c068e70 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:04.681 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.676+0000 7f09777fe700 1 -- 172.21.15.57:0/1328023287 <== osd.4 v2:172.21.15.105:6800/33368 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f097c069520 con 0x7f097c066a60 2023-10-06T03:04:04.699 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.696+0000 7f0995eae700 1 -- 172.21.15.57:0/1328023287 --> [v2:172.21.15.105:6800/33368,v1:172.21.15.105:6801/33368] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f09900c0b90 con 0x7f097c066a60 2023-10-06T03:04:04.700 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.696+0000 7f09777fe700 1 -- 172.21.15.57:0/1328023287 <== osd.4 v2:172.21.15.105:6800/33368 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f09900c0b90 con 0x7f097c066a60 2023-10-06T03:04:04.700 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-10-06T03:04:04.700 INFO:teuthology.orchestra.run.smithi057.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T03:04:04.701 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-10-06T03:04:04.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.696+0000 7f0995eae700 1 -- 172.21.15.57:0/1328023287 >> [v2:172.21.15.105:6800/33368,v1:172.21.15.105:6801/33368] conn(0x7f097c066a60 msgr2=0x7f097c068e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:04.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.696+0000 7f0995eae700 1 --2- 172.21.15.57:0/1328023287 >> [v2:172.21.15.105:6800/33368,v1:172.21.15.105:6801/33368] conn(0x7f097c066a60 0x7f097c068e70 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:04.702 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.696+0000 7f0995eae700 1 -- 172.21.15.57:0/1328023287 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f097c060550 msgr2=0x7f097c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:04.702 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.696+0000 7f0995eae700 1 --2- 172.21.15.57:0/1328023287 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f097c060550 0x7f097c062a00 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f0980009d10 tx=0x7f09800091a0 comp rx=0 tx=0).stop 2023-10-06T03:04:04.702 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.696+0000 7f0995eae700 1 -- 172.21.15.57:0/1328023287 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0990152fa0 msgr2=0x7f09901581d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:04.702 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.696+0000 7f0995eae700 1 --2- 172.21.15.57:0/1328023287 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0990152fa0 0x7f09901581d0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f0984013000 tx=0x7f0984017000 comp rx=0 tx=0).stop 2023-10-06T03:04:04.702 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.696+0000 7f098ffff700 1 -- 172.21.15.57:0/1328023287 reap_dead start 2023-10-06T03:04:04.702 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.696+0000 7f0995eae700 1 -- 172.21.15.57:0/1328023287 shutdown_connections 2023-10-06T03:04:04.702 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.696+0000 7f0995eae700 1 -- 172.21.15.57:0/1328023287 >> 172.21.15.57:0/1328023287 conn(0x7f09900cc760 msgr2=0x7f09900c9780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:04.702 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.696+0000 7f0995eae700 1 -- 172.21.15.57:0/1328023287 shutdown_connections 2023-10-06T03:04:04.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.696+0000 7f0995eae700 1 -- 172.21.15.57:0/1328023287 wait complete. 2023-10-06T03:04:04.722 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-10-06T03:04:04.893 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.888+0000 7f222fecd700 1 Processor -- start 2023-10-06T03:04:04.893 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.888+0000 7f222fecd700 1 -- start start 2023-10-06T03:04:04.898 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.892+0000 7f222fecd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f222806d2e0 0x7f22280c6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:04.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.892+0000 7f222fecd700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22280c7650 con 0x7f22280befb0 2023-10-06T03:04:04.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.892+0000 7f222fecd700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22280abfc0 con 0x7f22280c71f0 2023-10-06T03:04:04.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.892+0000 7f222fecd700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f222806e020 con 0x7f222806d2e0 2023-10-06T03:04:04.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.892+0000 7f222d468700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f222806d2e0 0x7f22280c6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:04.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.892+0000 7f222d468700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f222806d2e0 0x7f22280c6cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38166/0 (socket says 172.21.15.57:38166) 2023-10-06T03:04:04.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.892+0000 7f222d468700 1 -- 172.21.15.57:0/2630864716 learned_addr learned my addr 172.21.15.57:0/2630864716 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:04:04.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.892+0000 7f222dc69700 1 --1- 172.21.15.57:0/2630864716 >> v1:172.21.15.57:6789/0 conn(0x7f22280befb0 0x7f2228067490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:46406/0 (socket says 172.21.15.57:46406) 2023-10-06T03:04:04.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.892+0000 7f222d468700 1 -- 172.21.15.57:0/2630864716 >> v1:172.21.15.105:6789/0 conn(0x7f22280c71f0 legacy=0x7f22280ac450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:04.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.892+0000 7f222d468700 1 -- 172.21.15.57:0/2630864716 >> v1:172.21.15.57:6789/0 conn(0x7f22280befb0 legacy=0x7f2228067490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:04.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.892+0000 7f222d468700 1 -- 172.21.15.57:0/2630864716 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22280abc90 con 0x7f222806d2e0 2023-10-06T03:04:04.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.892+0000 7f222d468700 1 --2- 172.21.15.57:0/2630864716 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f222806d2e0 0x7f22280c6cb0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f22180099b0 tx=0x7f2218009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae256081f7332b66 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:04.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.892+0000 7f222cc67700 1 -- 172.21.15.57:0/2630864716 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f221800b820 con 0x7f222806d2e0 2023-10-06T03:04:04.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.892+0000 7f222cc67700 1 -- 172.21.15.57:0/2630864716 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f221800b980 con 0x7f222806d2e0 2023-10-06T03:04:04.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.892+0000 7f222cc67700 1 -- 172.21.15.57:0/2630864716 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f221800bd20 con 0x7f222806d2e0 2023-10-06T03:04:04.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.892+0000 7f222fecd700 1 -- 172.21.15.57:0/2630864716 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f222806d2e0 msgr2=0x7f22280c6cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:04.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.892+0000 7f222fecd700 1 --2- 172.21.15.57:0/2630864716 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f222806d2e0 0x7f22280c6cb0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f22180099b0 tx=0x7f2218009250 comp rx=0 tx=0).stop 2023-10-06T03:04:04.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.896+0000 7f222fecd700 1 -- 172.21.15.57:0/2630864716 shutdown_connections 2023-10-06T03:04:04.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.896+0000 7f222fecd700 1 --2- 172.21.15.57:0/2630864716 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f222806d2e0 0x7f22280c6cb0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:04.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.896+0000 7f222fecd700 1 -- 172.21.15.57:0/2630864716 >> 172.21.15.57:0/2630864716 conn(0x7f22280cbc90 msgr2=0x7f22280cc090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:04.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.896+0000 7f222fecd700 1 -- 172.21.15.57:0/2630864716 shutdown_connections 2023-10-06T03:04:04.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.896+0000 7f222fecd700 1 -- 172.21.15.57:0/2630864716 wait complete. 2023-10-06T03:04:04.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.896+0000 7f222fecd700 1 Processor -- start 2023-10-06T03:04:04.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.896+0000 7f222fecd700 1 -- start start 2023-10-06T03:04:04.903 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.896+0000 7f222fecd700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f222806d2e0 0x7f22280c5960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:04.903 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.896+0000 7f222fecd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22280befb0 0x7f22280ba7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:04.903 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.896+0000 7f222fecd700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f22280c71f0 0x7f2228170fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:04.903 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.896+0000 7f222fecd700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f222815c970 con 0x7f22280befb0 2023-10-06T03:04:04.903 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.896+0000 7f222fecd700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22280b14c0 con 0x7f22280c71f0 2023-10-06T03:04:04.903 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.896+0000 7f222fecd700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22280b0940 con 0x7f222806d2e0 2023-10-06T03:04:04.903 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.900+0000 7f222d468700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22280befb0 0x7f22280ba7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:04.903 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.900+0000 7f222d468700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22280befb0 0x7f22280ba7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38176/0 (socket says 172.21.15.57:38176) 2023-10-06T03:04:04.903 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.900+0000 7f222d468700 1 -- 172.21.15.57:0/729891064 learned_addr learned my addr 172.21.15.57:0/729891064 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:04:04.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.900+0000 7f222dc69700 1 --2- 172.21.15.57:0/729891064 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f222806d2e0 0x7f22280c5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:04.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.900+0000 7f222e46a700 1 --2- 172.21.15.57:0/729891064 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f22280c71f0 0x7f2228170fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:04.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.900+0000 7f222d468700 1 -- 172.21.15.57:0/729891064 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f222806d2e0 msgr2=0x7f22280c5960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:04.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.900+0000 7f222d468700 1 --2- 172.21.15.57:0/729891064 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f222806d2e0 0x7f22280c5960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:04.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.900+0000 7f222d468700 1 -- 172.21.15.57:0/729891064 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f22280c71f0 msgr2=0x7f2228170fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:04.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.900+0000 7f222d468700 1 --2- 172.21.15.57:0/729891064 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f22280c71f0 0x7f2228170fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:04.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.900+0000 7f222d468700 1 -- 172.21.15.57:0/729891064 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22180094f0 con 0x7f22280befb0 2023-10-06T03:04:04.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.900+0000 7f222dc69700 1 --2- 172.21.15.57:0/729891064 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f222806d2e0 0x7f22280c5960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:04:04.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.900+0000 7f222d468700 1 --2- 172.21.15.57:0/729891064 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22280befb0 0x7f22280ba7e0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f221800c010 tx=0x7f2218016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:04.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.900+0000 7f221dffb700 1 -- 172.21.15.57:0/729891064 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2218011e10 con 0x7f22280befb0 2023-10-06T03:04:04.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.900+0000 7f221dffb700 1 -- 172.21.15.57:0/729891064 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2218020070 con 0x7f22280befb0 2023-10-06T03:04:04.906 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.900+0000 7f221dffb700 1 -- 172.21.15.57:0/729891064 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f221801b6a0 con 0x7f22280befb0 2023-10-06T03:04:04.906 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.900+0000 7f222fecd700 1 -- 172.21.15.57:0/729891064 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22280b0c20 con 0x7f22280befb0 2023-10-06T03:04:04.906 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.900+0000 7f222fecd700 1 -- 172.21.15.57:0/729891064 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22280b11e0 con 0x7f22280befb0 2023-10-06T03:04:04.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.904+0000 7f222fecd700 1 -- 172.21.15.57:0/729891064 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f222804be40 con 0x7f22280befb0 2023-10-06T03:04:04.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.904+0000 7f221dffb700 1 -- 172.21.15.57:0/729891064 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f2218022030 con 0x7f22280befb0 2023-10-06T03:04:04.908 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.904+0000 7f221dffb700 1 --2- 172.21.15.57:0/729891064 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f220c060550 0x7f220c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:04.908 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.904+0000 7f221dffb700 1 -- 172.21.15.57:0/729891064 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5378+0+0 (secure 0 0 0) 0x7f221807e760 con 0x7f22280befb0 2023-10-06T03:04:04.909 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.904+0000 7f222dc69700 1 --2- 172.21.15.57:0/729891064 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f220c060550 0x7f220c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:04.909 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.904+0000 7f222dc69700 1 --2- 172.21.15.57:0/729891064 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f220c060550 0x7f220c062a00 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f2224007fd0 tx=0x7f2224007e10 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:04.915 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:04.912+0000 7f221dffb700 1 -- 172.21.15.57:0/729891064 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f221804edf0 con 0x7f22280befb0 2023-10-06T03:04:05.083 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.080+0000 7f222fecd700 1 -- 172.21.15.57:0/729891064 --> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f222804be40 con 0x7f220c060550 2023-10-06T03:04:05.084 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.080+0000 7f221dffb700 1 -- 172.21.15.57:0/729891064 <== mgr.4103 v2:172.21.15.57:6832/32947 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f222804be40 con 0x7f220c060550 2023-10-06T03:04:05.087 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.084+0000 7f222fecd700 1 -- 172.21.15.57:0/729891064 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f220c060550 msgr2=0x7f220c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:05.087 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.084+0000 7f222fecd700 1 --2- 172.21.15.57:0/729891064 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f220c060550 0x7f220c062a00 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f2224007fd0 tx=0x7f2224007e10 comp rx=0 tx=0).stop 2023-10-06T03:04:05.087 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.084+0000 7f222fecd700 1 -- 172.21.15.57:0/729891064 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22280befb0 msgr2=0x7f22280ba7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:05.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.084+0000 7f222fecd700 1 --2- 172.21.15.57:0/729891064 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22280befb0 0x7f22280ba7e0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f221800c010 tx=0x7f2218016000 comp rx=0 tx=0).stop 2023-10-06T03:04:05.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.084+0000 7f222fecd700 1 -- 172.21.15.57:0/729891064 shutdown_connections 2023-10-06T03:04:05.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.084+0000 7f222fecd700 1 --2- 172.21.15.57:0/729891064 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f22280c71f0 0x7f2228170fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:05.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.084+0000 7f222fecd700 1 --2- 172.21.15.57:0/729891064 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22280befb0 0x7f22280ba7e0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:05.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.084+0000 7f222fecd700 1 --2- 172.21.15.57:0/729891064 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f220c060550 0x7f220c062a00 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:05.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.084+0000 7f222fecd700 1 --2- 172.21.15.57:0/729891064 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f222806d2e0 0x7f22280c5960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:05.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.084+0000 7f222fecd700 1 -- 172.21.15.57:0/729891064 >> 172.21.15.57:0/729891064 conn(0x7f22280cbc90 msgr2=0x7f22280ad500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:05.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.084+0000 7f222fecd700 1 -- 172.21.15.57:0/729891064 shutdown_connections 2023-10-06T03:04:05.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.084+0000 7f222fecd700 1 -- 172.21.15.57:0/729891064 wait complete. 2023-10-06T03:04:05.090 INFO:teuthology.orchestra.run.smithi057.stderr:instructed osd(s) 4 to deep-scrub 2023-10-06T03:04:05.106 INFO:tasks.ceph:Scrubbing osd.5 2023-10-06T03:04:05.107 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-10-06T03:04:05.273 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.268+0000 7f0f01f23700 1 Processor -- start 2023-10-06T03:04:05.273 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.268+0000 7f0f01f23700 1 -- start start 2023-10-06T03:04:05.275 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.272+0000 7f0f01f23700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0efc15a940 0x7f0efc068060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:05.275 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.272+0000 7f0f01f23700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0efc06a840 con 0x7f0efc140820 2023-10-06T03:04:05.275 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.272+0000 7f0f01f23700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0efc15aec0 con 0x7f0efc140450 2023-10-06T03:04:05.275 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.272+0000 7f0f01f23700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0efc0ac930 con 0x7f0efc15a940 2023-10-06T03:04:05.275 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.272+0000 7f0f01722700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0efc15a940 0x7f0efc068060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:05.275 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.272+0000 7f0f01722700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0efc15a940 0x7f0efc068060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38180/0 (socket says 172.21.15.57:38180) 2023-10-06T03:04:05.276 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.272+0000 7f0f01722700 1 -- 172.21.15.57:0/3761078027 learned_addr learned my addr 172.21.15.57:0/3761078027 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:04:05.276 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.272+0000 7f0f01722700 1 -- 172.21.15.57:0/3761078027 >> v1:172.21.15.105:6789/0 conn(0x7f0efc140450 legacy=0x7f0efc0ac220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:05.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.272+0000 7f0f01722700 1 -- 172.21.15.57:0/3761078027 >> v1:172.21.15.57:6789/0 conn(0x7f0efc140820 legacy=0x7f0efc06c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:05.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.272+0000 7f0f01722700 1 -- 172.21.15.57:0/3761078027 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0efc15b1a0 con 0x7f0efc15a940 2023-10-06T03:04:05.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.272+0000 7f0f01722700 1 --2- 172.21.15.57:0/3761078027 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0efc15a940 0x7f0efc068060 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f0ef4009f20 tx=0x7f0ef4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a806d76c92398468 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:05.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.272+0000 7f0efb7fe700 1 -- 172.21.15.57:0/3761078027 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef400e070 con 0x7f0efc15a940 2023-10-06T03:04:05.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.272+0000 7f0efb7fe700 1 -- 172.21.15.57:0/3761078027 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ef400ba40 con 0x7f0efc15a940 2023-10-06T03:04:05.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.272+0000 7f0efb7fe700 1 -- 172.21.15.57:0/3761078027 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef40092e0 con 0x7f0efc15a940 2023-10-06T03:04:05.278 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.272+0000 7f0f01f23700 1 -- 172.21.15.57:0/3761078027 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0efc15a940 msgr2=0x7f0efc068060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:05.278 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.272+0000 7f0f01f23700 1 --2- 172.21.15.57:0/3761078027 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0efc15a940 0x7f0efc068060 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f0ef4009f20 tx=0x7f0ef4009840 comp rx=0 tx=0).stop 2023-10-06T03:04:05.279 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.272+0000 7f0f01f23700 1 -- 172.21.15.57:0/3761078027 shutdown_connections 2023-10-06T03:04:05.279 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.272+0000 7f0f01f23700 1 --2- 172.21.15.57:0/3761078027 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0efc15a940 0x7f0efc068060 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:05.279 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.272+0000 7f0f01f23700 1 -- 172.21.15.57:0/3761078027 >> 172.21.15.57:0/3761078027 conn(0x7f0efc0c85a0 msgr2=0x7f0efc0c89a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:05.279 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.272+0000 7f0f01f23700 1 -- 172.21.15.57:0/3761078027 shutdown_connections 2023-10-06T03:04:05.279 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.272+0000 7f0f01f23700 1 -- 172.21.15.57:0/3761078027 wait complete. 2023-10-06T03:04:05.279 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.276+0000 7f0f01f23700 1 Processor -- start 2023-10-06T03:04:05.280 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.276+0000 7f0f01f23700 1 -- start start 2023-10-06T03:04:05.282 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.276+0000 7f0f01f23700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0efc140450 0x7f0efc0c5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:05.282 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.276+0000 7f0f01f23700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0efc140820 0x7f0efc0c0a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:05.282 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.276+0000 7f0f01f23700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0efc15a940 0x7f0efc156730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:05.282 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.276+0000 7f0f01f23700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0efc13dba0 con 0x7f0efc140820 2023-10-06T03:04:05.282 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.276+0000 7f0f01f23700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0efc0c1140 con 0x7f0efc15a940 2023-10-06T03:04:05.282 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.276+0000 7f0f01f23700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0efc0c1420 con 0x7f0efc140450 2023-10-06T03:04:05.283 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.276+0000 7f0efbfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0efc140820 0x7f0efc0c0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:05.283 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.280+0000 7f0efbfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0efc140820 0x7f0efc0c0a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38194/0 (socket says 172.21.15.57:38194) 2023-10-06T03:04:05.283 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.280+0000 7f0efbfff700 1 -- 172.21.15.57:0/2796688852 learned_addr learned my addr 172.21.15.57:0/2796688852 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:04:05.284 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.280+0000 7f0f01722700 1 --2- 172.21.15.57:0/2796688852 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0efc15a940 0x7f0efc156730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:05.284 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.280+0000 7f0f00f21700 1 --2- 172.21.15.57:0/2796688852 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0efc140450 0x7f0efc0c5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:05.284 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.280+0000 7f0efbfff700 1 -- 172.21.15.57:0/2796688852 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0efc140450 msgr2=0x7f0efc0c5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:05.284 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.280+0000 7f0efbfff700 1 --2- 172.21.15.57:0/2796688852 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0efc140450 0x7f0efc0c5400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:05.284 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.280+0000 7f0efbfff700 1 -- 172.21.15.57:0/2796688852 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0efc15a940 msgr2=0x7f0efc156730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:05.284 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.280+0000 7f0efbfff700 1 --2- 172.21.15.57:0/2796688852 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0efc15a940 0x7f0efc156730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:05.284 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.280+0000 7f0efbfff700 1 -- 172.21.15.57:0/2796688852 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ef4009ae0 con 0x7f0efc140820 2023-10-06T03:04:05.284 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.280+0000 7f0f01722700 1 --2- 172.21.15.57:0/2796688852 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0efc15a940 0x7f0efc156730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:04:05.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.280+0000 7f0efbfff700 1 --2- 172.21.15.57:0/2796688852 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0efc140820 0x7f0efc0c0a60 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f0ee800c590 tx=0x7f0ee800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:05.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.280+0000 7f0ef8ff9700 1 -- 172.21.15.57:0/2796688852 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee8011590 con 0x7f0efc140820 2023-10-06T03:04:05.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.280+0000 7f0ef8ff9700 1 -- 172.21.15.57:0/2796688852 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ee8011710 con 0x7f0efc140820 2023-10-06T03:04:05.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.280+0000 7f0f01f23700 1 -- 172.21.15.57:0/2796688852 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0efc0c1700 con 0x7f0efc140820 2023-10-06T03:04:05.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.280+0000 7f0ef8ff9700 1 -- 172.21.15.57:0/2796688852 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee8011ad0 con 0x7f0efc140820 2023-10-06T03:04:05.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.280+0000 7f0f01f23700 1 -- 172.21.15.57:0/2796688852 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0efc0c1cc0 con 0x7f0efc140820 2023-10-06T03:04:05.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.280+0000 7f0f01f23700 1 -- 172.21.15.57:0/2796688852 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0efc04be40 con 0x7f0efc140820 2023-10-06T03:04:05.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.284+0000 7f0ef8ff9700 1 -- 172.21.15.57:0/2796688852 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f0ee801b3b0 con 0x7f0efc140820 2023-10-06T03:04:05.290 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.284+0000 7f0ef8ff9700 1 --2- 172.21.15.57:0/2796688852 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f0ee0060550 0x7f0ee0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:05.290 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.284+0000 7f0ef8ff9700 1 -- 172.21.15.57:0/2796688852 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5378+0+0 (secure 0 0 0) 0x7f0ee807bb90 con 0x7f0efc140820 2023-10-06T03:04:05.291 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.284+0000 7f0ef8ff9700 1 --2- 172.21.15.57:0/2796688852 >> [v2:172.21.15.105:6816/33379,v1:172.21.15.105:6818/33379] conn(0x7f0ee0066a60 0x7f0ee0068e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:05.291 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.284+0000 7f0ef8ff9700 1 -- 172.21.15.57:0/2796688852 --> [v2:172.21.15.105:6816/33379,v1:172.21.15.105:6818/33379] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0ee0069520 con 0x7f0ee0066a60 2023-10-06T03:04:05.291 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.284+0000 7f0ef8ff9700 1 -- 172.21.15.57:0/2796688852 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=59) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0ee8080220 con 0x7f0efc140820 2023-10-06T03:04:05.291 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.284+0000 7f0f00f21700 1 --2- 172.21.15.57:0/2796688852 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f0ee0060550 0x7f0ee0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:05.291 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.288+0000 7f0f01722700 1 --2- 172.21.15.57:0/2796688852 >> [v2:172.21.15.105:6816/33379,v1:172.21.15.105:6818/33379] conn(0x7f0ee0066a60 0x7f0ee0068e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:05.291 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.288+0000 7f0f00f21700 1 --2- 172.21.15.57:0/2796688852 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f0ee0060550 0x7f0ee0062a00 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f0ef0009ab0 tx=0x7f0ef0009060 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:05.292 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.288+0000 7f0f01722700 1 --2- 172.21.15.57:0/2796688852 >> [v2:172.21.15.105:6816/33379,v1:172.21.15.105:6818/33379] conn(0x7f0ee0066a60 0x7f0ee0068e70 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:05.294 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.288+0000 7f0ef8ff9700 1 -- 172.21.15.57:0/2796688852 <== osd.5 v2:172.21.15.105:6816/33379 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f0ee0069520 con 0x7f0ee0066a60 2023-10-06T03:04:05.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.304+0000 7f0f01f23700 1 -- 172.21.15.57:0/2796688852 --> [v2:172.21.15.105:6816/33379,v1:172.21.15.105:6818/33379] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f0efc156c70 con 0x7f0ee0066a60 2023-10-06T03:04:05.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.308+0000 7f0ef8ff9700 1 -- 172.21.15.57:0/2796688852 <== osd.5 v2:172.21.15.105:6816/33379 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f0efc156c70 con 0x7f0ee0066a60 2023-10-06T03:04:05.311 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-10-06T03:04:05.311 INFO:teuthology.orchestra.run.smithi057.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T03:04:05.312 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-10-06T03:04:05.312 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.308+0000 7f0f01f23700 1 -- 172.21.15.57:0/2796688852 >> [v2:172.21.15.105:6816/33379,v1:172.21.15.105:6818/33379] conn(0x7f0ee0066a60 msgr2=0x7f0ee0068e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:05.312 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.308+0000 7f0f01f23700 1 --2- 172.21.15.57:0/2796688852 >> [v2:172.21.15.105:6816/33379,v1:172.21.15.105:6818/33379] conn(0x7f0ee0066a60 0x7f0ee0068e70 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:05.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.308+0000 7f0f01f23700 1 -- 172.21.15.57:0/2796688852 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f0ee0060550 msgr2=0x7f0ee0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:05.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.308+0000 7f0f01f23700 1 --2- 172.21.15.57:0/2796688852 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f0ee0060550 0x7f0ee0062a00 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f0ef0009ab0 tx=0x7f0ef0009060 comp rx=0 tx=0).stop 2023-10-06T03:04:05.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.308+0000 7f0f01f23700 1 -- 172.21.15.57:0/2796688852 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0efc140820 msgr2=0x7f0efc0c0a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:05.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.308+0000 7f0f01f23700 1 --2- 172.21.15.57:0/2796688852 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0efc140820 0x7f0efc0c0a60 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f0ee800c590 tx=0x7f0ee800c8a0 comp rx=0 tx=0).stop 2023-10-06T03:04:05.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.308+0000 7f0f01722700 1 -- 172.21.15.57:0/2796688852 reap_dead start 2023-10-06T03:04:05.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.308+0000 7f0f01f23700 1 -- 172.21.15.57:0/2796688852 shutdown_connections 2023-10-06T03:04:05.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.308+0000 7f0f01f23700 1 -- 172.21.15.57:0/2796688852 >> 172.21.15.57:0/2796688852 conn(0x7f0efc0c85a0 msgr2=0x7f0efc0c8970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:05.314 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.308+0000 7f0f01f23700 1 -- 172.21.15.57:0/2796688852 shutdown_connections 2023-10-06T03:04:05.314 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.308+0000 7f0f01f23700 1 -- 172.21.15.57:0/2796688852 wait complete. 2023-10-06T03:04:05.336 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-10-06T03:04:05.506 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.500+0000 7fe544f85700 1 Processor -- start 2023-10-06T03:04:05.506 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.500+0000 7fe544f85700 1 -- start start 2023-10-06T03:04:05.510 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.504+0000 7fe544f85700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fe54014fe50 0x7fe5400ce4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:05.510 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.504+0000 7fe544f85700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe54006ccf0 con 0x7fe54006b680 2023-10-06T03:04:05.511 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.504+0000 7fe544f85700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe54006c9c0 con 0x7fe540150220 2023-10-06T03:04:05.511 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.504+0000 7fe544f85700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe54006bae0 con 0x7fe54014fe50 2023-10-06T03:04:05.515 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.508+0000 7fe53e59c700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fe54014fe50 0x7fe5400ce4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:05.515 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.508+0000 7fe53dd9b700 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7fe540150220 0x7fe54006af70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.57:60548/0 (socket says 172.21.15.57:60548) 2023-10-06T03:04:05.515 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.508+0000 7fe53ed9d700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fe54006b680 0x7fe54006d180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:46426/0 (socket says 172.21.15.57:46426) 2023-10-06T03:04:05.516 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.508+0000 7fe53dd9b700 1 -- 172.21.15.57:0/4014198875 learned_addr learned my addr 172.21.15.57:0/4014198875 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:04:05.516 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.508+0000 7fe53d59a700 1 -- 172.21.15.57:0/4014198875 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3043696955 0 0) 0x7fe54006c9c0 con 0x7fe540150220 2023-10-06T03:04:05.516 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.508+0000 7fe53e59c700 1 -- 172.21.15.57:0/4014198875 >> v1:172.21.15.105:6789/0 conn(0x7fe540150220 legacy=0x7fe54006af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:05.516 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.508+0000 7fe53e59c700 1 -- 172.21.15.57:0/4014198875 >> v1:172.21.15.57:6789/0 conn(0x7fe54006b680 legacy=0x7fe54006d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:05.516 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.508+0000 7fe53e59c700 1 -- 172.21.15.57:0/4014198875 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe54006bce0 con 0x7fe54014fe50 2023-10-06T03:04:05.516 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.508+0000 7fe53e59c700 1 --2- 172.21.15.57:0/4014198875 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe54014fe50 0x7fe5400ce4e0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fe5300098e0 tx=0x7fe5300091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f783aff7ef32478 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:05.517 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.508+0000 7fe53d59a700 1 -- 172.21.15.57:0/4014198875 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe530009e80 con 0x7fe54014fe50 2023-10-06T03:04:05.517 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.508+0000 7fe53d59a700 1 -- 172.21.15.57:0/4014198875 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe53000b760 con 0x7fe54014fe50 2023-10-06T03:04:05.517 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.508+0000 7fe53d59a700 1 -- 172.21.15.57:0/4014198875 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe53000bae0 con 0x7fe54014fe50 2023-10-06T03:04:05.517 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.508+0000 7fe544f85700 1 -- 172.21.15.57:0/4014198875 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe54014fe50 msgr2=0x7fe5400ce4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:05.517 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.508+0000 7fe544f85700 1 --2- 172.21.15.57:0/4014198875 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe54014fe50 0x7fe5400ce4e0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fe5300098e0 tx=0x7fe5300091a0 comp rx=0 tx=0).stop 2023-10-06T03:04:05.517 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.508+0000 7fe544f85700 1 -- 172.21.15.57:0/4014198875 shutdown_connections 2023-10-06T03:04:05.517 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.508+0000 7fe544f85700 1 --2- 172.21.15.57:0/4014198875 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe54014fe50 0x7fe5400ce4e0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:05.518 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.508+0000 7fe544f85700 1 -- 172.21.15.57:0/4014198875 >> 172.21.15.57:0/4014198875 conn(0x7fe5400d0bf0 msgr2=0x7fe5400ccb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:05.518 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.508+0000 7fe544f85700 1 -- 172.21.15.57:0/4014198875 shutdown_connections 2023-10-06T03:04:05.518 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.508+0000 7fe544f85700 1 -- 172.21.15.57:0/4014198875 wait complete. 2023-10-06T03:04:05.520 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.512+0000 7fe544f85700 1 Processor -- start 2023-10-06T03:04:05.520 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.512+0000 7fe544f85700 1 -- start start 2023-10-06T03:04:05.520 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.512+0000 7fe544f85700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe54006b680 0x7fe54014bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:05.520 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.512+0000 7fe544f85700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe54014fe50 0x7fe5400b4c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:05.520 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.512+0000 7fe544f85700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe540150220 0x7fe5400c6000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:05.520 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.512+0000 7fe544f85700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5400c71d0 con 0x7fe540150220 2023-10-06T03:04:05.520 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.512+0000 7fe544f85700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe540159250 con 0x7fe54006b680 2023-10-06T03:04:05.521 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.512+0000 7fe544f85700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5400c7ff0 con 0x7fe54014fe50 2023-10-06T03:04:05.521 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.516+0000 7fe53ed9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe540150220 0x7fe5400c6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:05.521 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.516+0000 7fe53ed9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe540150220 0x7fe5400c6000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38206/0 (socket says 172.21.15.57:38206) 2023-10-06T03:04:05.521 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.516+0000 7fe53ed9d700 1 -- 172.21.15.57:0/594624529 learned_addr learned my addr 172.21.15.57:0/594624529 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:04:05.521 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.516+0000 7fe53dd9b700 1 --2- 172.21.15.57:0/594624529 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe54014fe50 0x7fe5400b4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:05.521 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.516+0000 7fe53e59c700 1 --2- 172.21.15.57:0/594624529 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe54006b680 0x7fe54014bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:05.521 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.516+0000 7fe53ed9d700 1 -- 172.21.15.57:0/594624529 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe54014fe50 msgr2=0x7fe5400b4c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:05.521 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.516+0000 7fe53ed9d700 1 --2- 172.21.15.57:0/594624529 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe54014fe50 0x7fe5400b4c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:05.522 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.516+0000 7fe53ed9d700 1 -- 172.21.15.57:0/594624529 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe54006b680 msgr2=0x7fe54014bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:05.522 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.516+0000 7fe53ed9d700 1 --2- 172.21.15.57:0/594624529 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe54006b680 0x7fe54014bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:05.522 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.516+0000 7fe53ed9d700 1 -- 172.21.15.57:0/594624529 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe530009420 con 0x7fe540150220 2023-10-06T03:04:05.522 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.516+0000 7fe53ed9d700 1 --2- 172.21.15.57:0/594624529 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe540150220 0x7fe5400c6000 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fe53800cec0 tx=0x7fe538001c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:05.523 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.516+0000 7fe52e7fc700 1 -- 172.21.15.57:0/594624529 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe538005df0 con 0x7fe540150220 2023-10-06T03:04:05.523 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.516+0000 7fe52e7fc700 1 -- 172.21.15.57:0/594624529 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe53800a990 con 0x7fe540150220 2023-10-06T03:04:05.523 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.516+0000 7fe52e7fc700 1 -- 172.21.15.57:0/594624529 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe53800ad50 con 0x7fe540150220 2023-10-06T03:04:05.523 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.516+0000 7fe544f85700 1 -- 172.21.15.57:0/594624529 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5400c8480 con 0x7fe540150220 2023-10-06T03:04:05.523 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.516+0000 7fe544f85700 1 -- 172.21.15.57:0/594624529 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5400c7490 con 0x7fe540150220 2023-10-06T03:04:05.524 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.520+0000 7fe544f85700 1 -- 172.21.15.57:0/594624529 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5400c8160 con 0x7fe540150220 2023-10-06T03:04:05.524 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.520+0000 7fe52e7fc700 1 -- 172.21.15.57:0/594624529 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fe538007300 con 0x7fe540150220 2023-10-06T03:04:05.525 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.520+0000 7fe52e7fc700 1 --2- 172.21.15.57:0/594624529 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fe520060580 0x7fe520062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:05.525 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.520+0000 7fe52e7fc700 1 -- 172.21.15.57:0/594624529 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5378+0+0 (secure 0 0 0) 0x7fe53807c990 con 0x7fe540150220 2023-10-06T03:04:05.525 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.520+0000 7fe53e59c700 1 --2- 172.21.15.57:0/594624529 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fe520060580 0x7fe520062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:05.526 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.524+0000 7fe53e59c700 1 --2- 172.21.15.57:0/594624529 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fe520060580 0x7fe520062a30 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fe5300030c0 tx=0x7fe530016000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:05.530 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.528+0000 7fe52e7fc700 1 -- 172.21.15.57:0/594624529 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fe53804d150 con 0x7fe540150220 2023-10-06T03:04:05.704 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.700+0000 7fe544f85700 1 -- 172.21.15.57:0/594624529 --> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7fe54004be40 con 0x7fe520060580 2023-10-06T03:04:05.704 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.700+0000 7fe52e7fc700 1 -- 172.21.15.57:0/594624529 <== mgr.4103 v2:172.21.15.57:6832/32947 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fe54004be40 con 0x7fe520060580 2023-10-06T03:04:05.707 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.704+0000 7fe544f85700 1 -- 172.21.15.57:0/594624529 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fe520060580 msgr2=0x7fe520062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:05.707 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.704+0000 7fe544f85700 1 --2- 172.21.15.57:0/594624529 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fe520060580 0x7fe520062a30 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fe5300030c0 tx=0x7fe530016000 comp rx=0 tx=0).stop 2023-10-06T03:04:05.707 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.704+0000 7fe544f85700 1 -- 172.21.15.57:0/594624529 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe540150220 msgr2=0x7fe5400c6000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:05.707 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.704+0000 7fe544f85700 1 --2- 172.21.15.57:0/594624529 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe540150220 0x7fe5400c6000 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fe53800cec0 tx=0x7fe538001c20 comp rx=0 tx=0).stop 2023-10-06T03:04:05.708 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.704+0000 7fe544f85700 1 -- 172.21.15.57:0/594624529 shutdown_connections 2023-10-06T03:04:05.708 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.704+0000 7fe544f85700 1 --2- 172.21.15.57:0/594624529 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe540150220 0x7fe5400c6000 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:05.708 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.704+0000 7fe544f85700 1 --2- 172.21.15.57:0/594624529 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fe520060580 0x7fe520062a30 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:05.708 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.704+0000 7fe544f85700 1 --2- 172.21.15.57:0/594624529 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe54014fe50 0x7fe5400b4c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:05.709 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.704+0000 7fe544f85700 1 --2- 172.21.15.57:0/594624529 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe54006b680 0x7fe54014bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:05.709 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.704+0000 7fe544f85700 1 -- 172.21.15.57:0/594624529 >> 172.21.15.57:0/594624529 conn(0x7fe5400d0bf0 msgr2=0x7fe54006af50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:05.709 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.704+0000 7fe544f85700 1 -- 172.21.15.57:0/594624529 shutdown_connections 2023-10-06T03:04:05.709 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.704+0000 7fe544f85700 1 -- 172.21.15.57:0/594624529 wait complete. 2023-10-06T03:04:05.710 INFO:teuthology.orchestra.run.smithi057.stderr:instructed osd(s) 5 to deep-scrub 2023-10-06T03:04:05.728 INFO:tasks.ceph:Scrubbing osd.6 2023-10-06T03:04:05.728 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-10-06T03:04:05.894 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.888+0000 7f25008e3700 1 Processor -- start 2023-10-06T03:04:05.895 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.892+0000 7f25008e3700 1 -- start start 2023-10-06T03:04:05.898 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.892+0000 7f25008e3700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f24fc156880 0x7f24fc159f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:05.898 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.892+0000 7f25008e3700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f24fc15cb00 0x7f24fc06b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:05.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.896+0000 7f25008e3700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24fc0cb090 con 0x7f24fc156c50 2023-10-06T03:04:05.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.896+0000 7f25008e3700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24fc0cc600 con 0x7f24fc156880 2023-10-06T03:04:05.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.896+0000 7f25008e3700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24fc15a4c0 con 0x7f24fc15cb00 2023-10-06T03:04:05.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.896+0000 7f24fb7fe700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f24fc156880 0x7f24fc159f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:05.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.896+0000 7f24fb7fe700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f24fc156880 0x7f24fc159f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.57:57970/0 (socket says 172.21.15.57:57970) 2023-10-06T03:04:05.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.896+0000 7f24fb7fe700 1 -- 172.21.15.57:0/3707877090 learned_addr learned my addr 172.21.15.57:0/3707877090 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:04:05.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.896+0000 7f24fbfff700 1 --1- 172.21.15.57:0/3707877090 >> v1:172.21.15.105:6789/0 conn(0x7f24fc156c50 0x7f24fc06c920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.57:60554/0 (socket says 172.21.15.57:60554) 2023-10-06T03:04:05.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.896+0000 7f24faffd700 1 --2- 172.21.15.57:0/3707877090 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f24fc15cb00 0x7f24fc06b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:05.902 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.896+0000 7f24fb7fe700 1 -- 172.21.15.57:0/3707877090 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f24fc15cb00 msgr2=0x7f24fc06b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:05.902 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.896+0000 7f24fb7fe700 1 --2- 172.21.15.57:0/3707877090 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f24fc15cb00 0x7f24fc06b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:05.902 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.896+0000 7f24fb7fe700 1 -- 172.21.15.57:0/3707877090 >> v1:172.21.15.105:6789/0 conn(0x7f24fc156c50 legacy=0x7f24fc06c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:05.902 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.896+0000 7f24fb7fe700 1 -- 172.21.15.57:0/3707877090 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24fc15cf90 con 0x7f24fc156880 2023-10-06T03:04:05.902 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.896+0000 7f24fb7fe700 1 --2- 172.21.15.57:0/3707877090 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f24fc156880 0x7f24fc159f80 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f24ec0099b0 tx=0x7f24ec009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=95342cde540d3868 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:05.902 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.896+0000 7f24fa7fc700 1 -- 172.21.15.57:0/3707877090 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24ec009ea0 con 0x7f24fc156880 2023-10-06T03:04:05.903 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.896+0000 7f24fa7fc700 1 -- 172.21.15.57:0/3707877090 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24ec00b860 con 0x7f24fc156880 2023-10-06T03:04:05.903 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.896+0000 7f24fa7fc700 1 -- 172.21.15.57:0/3707877090 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24ec00bc00 con 0x7f24fc156880 2023-10-06T03:04:05.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.900+0000 7f25008e3700 1 -- 172.21.15.57:0/3707877090 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f24fc156880 msgr2=0x7f24fc159f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:05.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.900+0000 7f25008e3700 1 --2- 172.21.15.57:0/3707877090 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f24fc156880 0x7f24fc159f80 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f24ec0099b0 tx=0x7f24ec009250 comp rx=0 tx=0).stop 2023-10-06T03:04:05.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.900+0000 7f25008e3700 1 -- 172.21.15.57:0/3707877090 shutdown_connections 2023-10-06T03:04:05.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.900+0000 7f25008e3700 1 --2- 172.21.15.57:0/3707877090 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f24fc15cb00 0x7f24fc06b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:05.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.900+0000 7f25008e3700 1 --2- 172.21.15.57:0/3707877090 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f24fc156880 0x7f24fc159f80 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:05.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.900+0000 7f25008e3700 1 -- 172.21.15.57:0/3707877090 >> 172.21.15.57:0/3707877090 conn(0x7f24fc0cc9b0 msgr2=0x7f24fc0ccdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:05.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.900+0000 7f25008e3700 1 -- 172.21.15.57:0/3707877090 shutdown_connections 2023-10-06T03:04:05.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.900+0000 7f25008e3700 1 -- 172.21.15.57:0/3707877090 wait complete. 2023-10-06T03:04:05.906 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.900+0000 7f25008e3700 1 Processor -- start 2023-10-06T03:04:05.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.904+0000 7f25008e3700 1 -- start start 2023-10-06T03:04:05.908 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.904+0000 7f25008e3700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f24fc156880 0x7f24fc0cea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:05.908 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.904+0000 7f25008e3700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f24fc156c50 0x7f24fc0b54d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:05.908 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.904+0000 7f25008e3700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f24fc15cb00 0x7f24fc170e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:05.908 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.904+0000 7f25008e3700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24fc0b2eb0 con 0x7f24fc156c50 2023-10-06T03:04:05.909 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.904+0000 7f25008e3700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24fc0b3190 con 0x7f24fc15cb00 2023-10-06T03:04:05.909 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.904+0000 7f25008e3700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24fc0b3470 con 0x7f24fc156880 2023-10-06T03:04:05.910 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.904+0000 7f24faffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f24fc156c50 0x7f24fc0b54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:05.910 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.904+0000 7f24fbfff700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f24fc15cb00 0x7f24fc170e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:05.910 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.904+0000 7f24faffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f24fc156c50 0x7f24fc0b54d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38216/0 (socket says 172.21.15.57:38216) 2023-10-06T03:04:05.910 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.904+0000 7f24faffd700 1 -- 172.21.15.57:0/2520721634 learned_addr learned my addr 172.21.15.57:0/2520721634 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:04:05.910 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.904+0000 7f24fb7fe700 1 --2- 172.21.15.57:0/2520721634 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f24fc156880 0x7f24fc0cea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:05.911 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.904+0000 7f24fbfff700 1 -- 172.21.15.57:0/2520721634 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f24fc156880 msgr2=0x7f24fc0cea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:05.911 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.904+0000 7f24fbfff700 1 --2- 172.21.15.57:0/2520721634 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f24fc156880 0x7f24fc0cea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:05.911 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.904+0000 7f24fbfff700 1 -- 172.21.15.57:0/2520721634 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f24fc156c50 msgr2=0x7f24fc0b54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:05.911 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.904+0000 7f24fbfff700 1 --2- 172.21.15.57:0/2520721634 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f24fc156c50 0x7f24fc0b54d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:05.911 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.904+0000 7f24fbfff700 1 -- 172.21.15.57:0/2520721634 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24ec0094f0 con 0x7f24fc15cb00 2023-10-06T03:04:05.911 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.904+0000 7f24faffd700 1 --2- 172.21.15.57:0/2520721634 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f24fc156c50 0x7f24fc0b54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:04:05.911 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.904+0000 7f24fbfff700 1 --2- 172.21.15.57:0/2520721634 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f24fc15cb00 0x7f24fc170e90 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f24f4002230 tx=0x7f24f4001a50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:05.913 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.904+0000 7f24e37fe700 1 -- 172.21.15.57:0/2520721634 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f4005df0 con 0x7f24fc15cb00 2023-10-06T03:04:05.913 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.904+0000 7f24e37fe700 1 -- 172.21.15.57:0/2520721634 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24f400a6a0 con 0x7f24fc15cb00 2023-10-06T03:04:05.913 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.904+0000 7f24e37fe700 1 -- 172.21.15.57:0/2520721634 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f400aa60 con 0x7f24fc15cb00 2023-10-06T03:04:05.913 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.908+0000 7f25008e3700 1 -- 172.21.15.57:0/2520721634 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24fc0b3750 con 0x7f24fc15cb00 2023-10-06T03:04:05.913 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.908+0000 7f25008e3700 1 -- 172.21.15.57:0/2520721634 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24fc0cef50 con 0x7f24fc15cb00 2023-10-06T03:04:05.913 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.908+0000 7f25008e3700 1 -- 172.21.15.57:0/2520721634 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f24fc0b3300 con 0x7f24fc15cb00 2023-10-06T03:04:05.914 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.908+0000 7f24e37fe700 1 -- 172.21.15.57:0/2520721634 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f24f40070f0 con 0x7f24fc15cb00 2023-10-06T03:04:05.915 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.912+0000 7f24e37fe700 1 --2- 172.21.15.57:0/2520721634 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f24e8060550 0x7f24e8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:05.916 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.912+0000 7f24e37fe700 1 -- 172.21.15.57:0/2520721634 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5378+0+0 (secure 0 0 0) 0x7f24f407c640 con 0x7f24fc15cb00 2023-10-06T03:04:05.916 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.912+0000 7f24fb7fe700 1 --2- 172.21.15.57:0/2520721634 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f24e8060550 0x7f24e8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:05.917 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.912+0000 7f24e37fe700 1 --2- 172.21.15.57:0/2520721634 >> [v2:172.21.15.105:6817/33369,v1:172.21.15.105:6819/33369] conn(0x7f24e8066a60 0x7f24e8068e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:05.917 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.912+0000 7f24e37fe700 1 -- 172.21.15.57:0/2520721634 --> [v2:172.21.15.105:6817/33369,v1:172.21.15.105:6819/33369] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f24e8069520 con 0x7f24e8066a60 2023-10-06T03:04:05.917 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.912+0000 7f24e37fe700 1 -- 172.21.15.57:0/2520721634 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_get_version_reply(handle=1 version=59) v2 ==== 24+0+0 (secure 0 0 0) 0x7f24f407eba0 con 0x7f24fc15cb00 2023-10-06T03:04:05.917 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.912+0000 7f24faffd700 1 --2- 172.21.15.57:0/2520721634 >> [v2:172.21.15.105:6817/33369,v1:172.21.15.105:6819/33369] conn(0x7f24e8066a60 0x7f24e8068e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:05.917 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.912+0000 7f24fb7fe700 1 --2- 172.21.15.57:0/2520721634 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f24e8060550 0x7f24e8062a00 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f24ec0099b0 tx=0x7f24ec017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:05.918 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.912+0000 7f24faffd700 1 --2- 172.21.15.57:0/2520721634 >> [v2:172.21.15.105:6817/33369,v1:172.21.15.105:6819/33369] conn(0x7f24e8066a60 0x7f24e8068e70 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:05.919 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.916+0000 7f24e37fe700 1 -- 172.21.15.57:0/2520721634 <== osd.6 v2:172.21.15.105:6817/33369 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f24e8069520 con 0x7f24e8066a60 2023-10-06T03:04:05.937 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.932+0000 7f25008e3700 1 -- 172.21.15.57:0/2520721634 --> [v2:172.21.15.105:6817/33369,v1:172.21.15.105:6819/33369] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f24fc04be40 con 0x7f24e8066a60 2023-10-06T03:04:05.938 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.932+0000 7f24e37fe700 1 -- 172.21.15.57:0/2520721634 <== osd.6 v2:172.21.15.105:6817/33369 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f24fc04be40 con 0x7f24e8066a60 2023-10-06T03:04:05.938 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-10-06T03:04:05.938 INFO:teuthology.orchestra.run.smithi057.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T03:04:05.939 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-10-06T03:04:05.940 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.936+0000 7f25008e3700 1 -- 172.21.15.57:0/2520721634 >> [v2:172.21.15.105:6817/33369,v1:172.21.15.105:6819/33369] conn(0x7f24e8066a60 msgr2=0x7f24e8068e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:05.941 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.936+0000 7f25008e3700 1 --2- 172.21.15.57:0/2520721634 >> [v2:172.21.15.105:6817/33369,v1:172.21.15.105:6819/33369] conn(0x7f24e8066a60 0x7f24e8068e70 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:05.941 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.936+0000 7f25008e3700 1 -- 172.21.15.57:0/2520721634 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f24e8060550 msgr2=0x7f24e8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:05.941 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.936+0000 7f25008e3700 1 --2- 172.21.15.57:0/2520721634 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f24e8060550 0x7f24e8062a00 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f24ec0099b0 tx=0x7f24ec017000 comp rx=0 tx=0).stop 2023-10-06T03:04:05.941 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.936+0000 7f25008e3700 1 -- 172.21.15.57:0/2520721634 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f24fc15cb00 msgr2=0x7f24fc170e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:05.941 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.936+0000 7f25008e3700 1 --2- 172.21.15.57:0/2520721634 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f24fc15cb00 0x7f24fc170e90 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f24f4002230 tx=0x7f24f4001a50 comp rx=0 tx=0).stop 2023-10-06T03:04:05.941 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.936+0000 7f24fbfff700 1 -- 172.21.15.57:0/2520721634 reap_dead start 2023-10-06T03:04:05.941 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.936+0000 7f25008e3700 1 -- 172.21.15.57:0/2520721634 shutdown_connections 2023-10-06T03:04:05.941 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.936+0000 7f25008e3700 1 -- 172.21.15.57:0/2520721634 >> 172.21.15.57:0/2520721634 conn(0x7f24fc0cc9b0 msgr2=0x7f24fc067a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:05.941 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.936+0000 7f25008e3700 1 -- 172.21.15.57:0/2520721634 shutdown_connections 2023-10-06T03:04:05.941 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:05.936+0000 7f25008e3700 1 -- 172.21.15.57:0/2520721634 wait complete. 2023-10-06T03:04:05.958 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-10-06T03:04:06.125 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.120+0000 7faa91d45700 1 Processor -- start 2023-10-06T03:04:06.125 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.120+0000 7faa91d45700 1 -- start start 2023-10-06T03:04:06.129 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.124+0000 7faa91d45700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faa8c156d60 0x7faa8c06d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:06.129 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.124+0000 7faa91d45700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7faa8c0c6c40 0x7faa8c0c70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:06.129 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.124+0000 7faa91d45700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa8c06d250 con 0x7faa8c15a510 2023-10-06T03:04:06.129 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.124+0000 7faa91d45700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa8c0c7600 con 0x7faa8c0c6c40 2023-10-06T03:04:06.129 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.124+0000 7faa91d45700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa8c067af0 con 0x7faa8c156d60 2023-10-06T03:04:06.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.124+0000 7faa8bfff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7faa8c0c6c40 0x7faa8c0c70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:06.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.124+0000 7faa8bfff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7faa8c0c6c40 0x7faa8c0c70c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38226/0 (socket says 172.21.15.57:38226) 2023-10-06T03:04:06.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.124+0000 7faa8bfff700 1 -- 172.21.15.57:0/389963807 learned_addr learned my addr 172.21.15.57:0/389963807 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:04:06.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.124+0000 7faa8affd700 1 --1- 172.21.15.57:0/389963807 >> v1:172.21.15.57:6789/0 conn(0x7faa8c15a510 0x7faa8c067050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:46440/0 (socket says 172.21.15.57:46440) 2023-10-06T03:04:06.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.124+0000 7faa8b7fe700 1 --2- 172.21.15.57:0/389963807 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faa8c156d60 0x7faa8c06d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:06.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.124+0000 7faa8bfff700 1 -- 172.21.15.57:0/389963807 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faa8c156d60 msgr2=0x7faa8c06d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:06.131 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.124+0000 7faa8bfff700 1 --2- 172.21.15.57:0/389963807 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faa8c156d60 0x7faa8c06d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:06.131 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.124+0000 7faa8bfff700 1 -- 172.21.15.57:0/389963807 >> v1:172.21.15.57:6789/0 conn(0x7faa8c15a510 legacy=0x7faa8c067050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:06.131 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.124+0000 7faa8bfff700 1 -- 172.21.15.57:0/389963807 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa8c06c920 con 0x7faa8c0c6c40 2023-10-06T03:04:06.132 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.124+0000 7faa8bfff700 1 --2- 172.21.15.57:0/389963807 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faa8c0c6c40 0x7faa8c0c70c0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7faa84009f20 tx=0x7faa84009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2c857e3f2e67c9b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:06.132 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.128+0000 7faa8a7fc700 1 -- 172.21.15.57:0/389963807 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa8400e070 con 0x7faa8c0c6c40 2023-10-06T03:04:06.132 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.128+0000 7faa8a7fc700 1 -- 172.21.15.57:0/389963807 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa8400b9d0 con 0x7faa8c0c6c40 2023-10-06T03:04:06.132 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.128+0000 7faa8a7fc700 1 -- 172.21.15.57:0/389963807 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa840092e0 con 0x7faa8c0c6c40 2023-10-06T03:04:06.132 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.128+0000 7faa91d45700 1 -- 172.21.15.57:0/389963807 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faa8c0c6c40 msgr2=0x7faa8c0c70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:06.132 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.128+0000 7faa91d45700 1 --2- 172.21.15.57:0/389963807 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faa8c0c6c40 0x7faa8c0c70c0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7faa84009f20 tx=0x7faa84009840 comp rx=0 tx=0).stop 2023-10-06T03:04:06.133 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.128+0000 7faa91d45700 1 -- 172.21.15.57:0/389963807 shutdown_connections 2023-10-06T03:04:06.133 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.128+0000 7faa91d45700 1 --2- 172.21.15.57:0/389963807 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faa8c0c6c40 0x7faa8c0c70c0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:06.133 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.128+0000 7faa91d45700 1 --2- 172.21.15.57:0/389963807 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faa8c156d60 0x7faa8c06d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:06.133 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.128+0000 7faa91d45700 1 -- 172.21.15.57:0/389963807 >> 172.21.15.57:0/389963807 conn(0x7faa8c0cbc90 msgr2=0x7faa8c0cc090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:06.133 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.128+0000 7faa91d45700 1 -- 172.21.15.57:0/389963807 shutdown_connections 2023-10-06T03:04:06.133 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.128+0000 7faa91d45700 1 -- 172.21.15.57:0/389963807 wait complete. 2023-10-06T03:04:06.135 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.132+0000 7faa91d45700 1 Processor -- start 2023-10-06T03:04:06.135 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.132+0000 7faa91d45700 1 -- start start 2023-10-06T03:04:06.137 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.132+0000 7faa91d45700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faa8c0c6c40 0x7faa8c154220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:06.137 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.132+0000 7faa91d45700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faa8c156d60 0x7faa8c1582f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:06.137 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.132+0000 7faa91d45700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faa8c15a510 0x7faa8c155be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:06.137 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.132+0000 7faa91d45700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa8c154760 con 0x7faa8c15a510 2023-10-06T03:04:06.137 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.132+0000 7faa91d45700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa8c0ac6c0 con 0x7faa8c156d60 2023-10-06T03:04:06.137 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.132+0000 7faa91d45700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa8c0acb50 con 0x7faa8c0c6c40 2023-10-06T03:04:06.138 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.132+0000 7faa8bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faa8c15a510 0x7faa8c155be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:06.138 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.132+0000 7faa8bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faa8c15a510 0x7faa8c155be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38234/0 (socket says 172.21.15.57:38234) 2023-10-06T03:04:06.138 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.132+0000 7faa8bfff700 1 -- 172.21.15.57:0/3122789643 learned_addr learned my addr 172.21.15.57:0/3122789643 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:04:06.138 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.132+0000 7faa8b7fe700 1 --2- 172.21.15.57:0/3122789643 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faa8c0c6c40 0x7faa8c154220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:06.138 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.132+0000 7faa8affd700 1 --2- 172.21.15.57:0/3122789643 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faa8c156d60 0x7faa8c1582f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:06.139 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.132+0000 7faa8bfff700 1 -- 172.21.15.57:0/3122789643 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faa8c0c6c40 msgr2=0x7faa8c154220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:06.139 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.132+0000 7faa8bfff700 1 --2- 172.21.15.57:0/3122789643 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faa8c0c6c40 0x7faa8c154220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:06.139 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.132+0000 7faa8bfff700 1 -- 172.21.15.57:0/3122789643 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faa8c156d60 msgr2=0x7faa8c1582f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:06.139 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.132+0000 7faa8bfff700 1 --2- 172.21.15.57:0/3122789643 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faa8c156d60 0x7faa8c1582f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:06.139 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.132+0000 7faa8bfff700 1 -- 172.21.15.57:0/3122789643 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa84009ae0 con 0x7faa8c15a510 2023-10-06T03:04:06.139 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.136+0000 7faa8bfff700 1 --2- 172.21.15.57:0/3122789643 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faa8c15a510 0x7faa8c155be0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7faa8400b610 tx=0x7faa84018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:06.140 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.136+0000 7faa737fe700 1 -- 172.21.15.57:0/3122789643 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa84008ad0 con 0x7faa8c15a510 2023-10-06T03:04:06.140 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.136+0000 7faa737fe700 1 -- 172.21.15.57:0/3122789643 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa84008c30 con 0x7faa8c15a510 2023-10-06T03:04:06.140 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.136+0000 7faa91d45700 1 -- 172.21.15.57:0/3122789643 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa8c0abab0 con 0x7faa8c15a510 2023-10-06T03:04:06.140 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.136+0000 7faa737fe700 1 -- 172.21.15.57:0/3122789643 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa8401c410 con 0x7faa8c15a510 2023-10-06T03:04:06.140 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.136+0000 7faa91d45700 1 -- 172.21.15.57:0/3122789643 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa8c0ac070 con 0x7faa8c15a510 2023-10-06T03:04:06.141 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.136+0000 7faa91d45700 1 -- 172.21.15.57:0/3122789643 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa8c0ac850 con 0x7faa8c15a510 2023-10-06T03:04:06.142 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.140+0000 7faa737fe700 1 -- 172.21.15.57:0/3122789643 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7faa84003040 con 0x7faa8c15a510 2023-10-06T03:04:06.144 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.140+0000 7faa737fe700 1 --2- 172.21.15.57:0/3122789643 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7faa78060550 0x7faa78062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:06.144 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.140+0000 7faa737fe700 1 -- 172.21.15.57:0/3122789643 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5378+0+0 (secure 0 0 0) 0x7faa8407e1c0 con 0x7faa8c15a510 2023-10-06T03:04:06.144 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.140+0000 7faa8b7fe700 1 --2- 172.21.15.57:0/3122789643 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7faa78060550 0x7faa78062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:06.145 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.140+0000 7faa8b7fe700 1 --2- 172.21.15.57:0/3122789643 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7faa78060550 0x7faa78062a00 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7faa7c009db0 tx=0x7faa7c0091a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:06.149 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.144+0000 7faa737fe700 1 -- 172.21.15.57:0/3122789643 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7faa8404e850 con 0x7faa8c15a510 2023-10-06T03:04:06.315 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.312+0000 7faa91d45700 1 -- 172.21.15.57:0/3122789643 --> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7faa8c04be40 con 0x7faa78060550 2023-10-06T03:04:06.316 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.312+0000 7faa737fe700 1 -- 172.21.15.57:0/3122789643 <== mgr.4103 v2:172.21.15.57:6832/32947 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7faa8c04be40 con 0x7faa78060550 2023-10-06T03:04:06.319 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.316+0000 7faa91d45700 1 -- 172.21.15.57:0/3122789643 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7faa78060550 msgr2=0x7faa78062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:06.319 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.316+0000 7faa91d45700 1 --2- 172.21.15.57:0/3122789643 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7faa78060550 0x7faa78062a00 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7faa7c009db0 tx=0x7faa7c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:04:06.319 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.316+0000 7faa91d45700 1 -- 172.21.15.57:0/3122789643 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faa8c15a510 msgr2=0x7faa8c155be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:06.319 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.316+0000 7faa91d45700 1 --2- 172.21.15.57:0/3122789643 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faa8c15a510 0x7faa8c155be0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7faa8400b610 tx=0x7faa84018000 comp rx=0 tx=0).stop 2023-10-06T03:04:06.320 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.316+0000 7faa91d45700 1 -- 172.21.15.57:0/3122789643 shutdown_connections 2023-10-06T03:04:06.320 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.316+0000 7faa91d45700 1 --2- 172.21.15.57:0/3122789643 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faa8c15a510 0x7faa8c155be0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:06.320 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.316+0000 7faa91d45700 1 --2- 172.21.15.57:0/3122789643 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faa8c156d60 0x7faa8c1582f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:06.320 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.316+0000 7faa91d45700 1 --2- 172.21.15.57:0/3122789643 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7faa78060550 0x7faa78062a00 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:06.320 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.316+0000 7faa91d45700 1 --2- 172.21.15.57:0/3122789643 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faa8c0c6c40 0x7faa8c154220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:06.320 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.316+0000 7faa91d45700 1 -- 172.21.15.57:0/3122789643 >> 172.21.15.57:0/3122789643 conn(0x7faa8c0cbc90 msgr2=0x7faa8c06d5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:06.320 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.316+0000 7faa91d45700 1 -- 172.21.15.57:0/3122789643 shutdown_connections 2023-10-06T03:04:06.320 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.316+0000 7faa91d45700 1 -- 172.21.15.57:0/3122789643 wait complete. 2023-10-06T03:04:06.322 INFO:teuthology.orchestra.run.smithi057.stderr:instructed osd(s) 6 to deep-scrub 2023-10-06T03:04:06.339 INFO:tasks.ceph:Scrubbing osd.7 2023-10-06T03:04:06.340 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-10-06T03:04:06.505 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.500+0000 7f075ea2e700 1 Processor -- start 2023-10-06T03:04:06.505 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.500+0000 7f075ea2e700 1 -- start start 2023-10-06T03:04:06.508 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.504+0000 7f075ea2e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0758067280 0x7f0758067650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:06.508 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.504+0000 7f075ea2e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f07580cb0f0 0x7f075806d680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:06.508 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.504+0000 7f075ea2e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0758159670 con 0x7f0758158ae0 2023-10-06T03:04:06.508 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.504+0000 7f075ea2e700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07580cecd0 con 0x7f07580cb0f0 2023-10-06T03:04:06.508 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.504+0000 7f075ea2e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07580cb540 con 0x7f0758067280 2023-10-06T03:04:06.509 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.504+0000 7f0757fff700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0758067280 0x7f0758067650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:06.509 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.504+0000 7f075cfcb700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f0758158ae0 0x7f0758158f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:46450/0 (socket says 172.21.15.57:46450) 2023-10-06T03:04:06.509 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.504+0000 7f075cfcb700 1 -- 172.21.15.57:0/1160635761 learned_addr learned my addr 172.21.15.57:0/1160635761 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:04:06.509 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.504+0000 7f074ffff700 1 --2- 172.21.15.57:0/1160635761 >> v2:172.21.15.57:3300/0 conn(0x7f07580cb0f0 0x7f075806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:06.510 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.504+0000 7f07577fe700 1 -- 172.21.15.57:0/1160635761 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2471490593 0 0) 0x7f0758159670 con 0x7f0758158ae0 2023-10-06T03:04:06.510 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.504+0000 7f074ffff700 1 -- 172.21.15.57:0/1160635761 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0758067280 msgr2=0x7f0758067650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:06.510 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.504+0000 7f074ffff700 1 --2- 172.21.15.57:0/1160635761 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0758067280 0x7f0758067650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:06.511 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.504+0000 7f074ffff700 1 -- 172.21.15.57:0/1160635761 >> v1:172.21.15.57:6789/0 conn(0x7f0758158ae0 legacy=0x7f0758158f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:06.511 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.504+0000 7f074ffff700 1 -- 172.21.15.57:0/1160635761 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f075806dbc0 con 0x7f07580cb0f0 2023-10-06T03:04:06.511 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.504+0000 7f074ffff700 1 --2- 172.21.15.57:0/1160635761 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f07580cb0f0 0x7f075806d680 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f07400098e0 tx=0x7f07400091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f1e3ed478e755af server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:06.512 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.508+0000 7f07577fe700 1 -- 172.21.15.57:0/1160635761 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f074000b640 con 0x7f07580cb0f0 2023-10-06T03:04:06.512 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.508+0000 7f07577fe700 1 -- 172.21.15.57:0/1160635761 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f074000b7a0 con 0x7f07580cb0f0 2023-10-06T03:04:06.513 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.508+0000 7f07577fe700 1 -- 172.21.15.57:0/1160635761 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f074000bb40 con 0x7f07580cb0f0 2023-10-06T03:04:06.513 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.508+0000 7f075ea2e700 1 -- 172.21.15.57:0/1160635761 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f07580cb0f0 msgr2=0x7f075806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:06.513 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.508+0000 7f075ea2e700 1 --2- 172.21.15.57:0/1160635761 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f07580cb0f0 0x7f075806d680 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f07400098e0 tx=0x7f07400091a0 comp rx=0 tx=0).stop 2023-10-06T03:04:06.513 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.508+0000 7f075ea2e700 1 -- 172.21.15.57:0/1160635761 shutdown_connections 2023-10-06T03:04:06.513 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.508+0000 7f075ea2e700 1 --2- 172.21.15.57:0/1160635761 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f07580cb0f0 0x7f075806d680 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:06.513 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.508+0000 7f075ea2e700 1 --2- 172.21.15.57:0/1160635761 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0758067280 0x7f0758067650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:06.513 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.508+0000 7f075ea2e700 1 -- 172.21.15.57:0/1160635761 >> 172.21.15.57:0/1160635761 conn(0x7f07580d0bc0 msgr2=0x7f07580ccb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:06.513 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.508+0000 7f075ea2e700 1 -- 172.21.15.57:0/1160635761 shutdown_connections 2023-10-06T03:04:06.513 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.508+0000 7f075ea2e700 1 -- 172.21.15.57:0/1160635761 wait complete. 2023-10-06T03:04:06.515 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.512+0000 7f075ea2e700 1 Processor -- start 2023-10-06T03:04:06.515 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.512+0000 7f075ea2e700 1 -- start start 2023-10-06T03:04:06.516 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.512+0000 7f075ea2e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0758067280 0x7f075816ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:06.517 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.512+0000 7f075ea2e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f07580cb0f0 0x7f07580c98b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:06.517 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.512+0000 7f075ea2e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0758158ae0 0x7f075814aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:06.517 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.512+0000 7f075ea2e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07580afbf0 con 0x7f0758067280 2023-10-06T03:04:06.517 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.512+0000 7f075ea2e700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f075816d930 con 0x7f0758158ae0 2023-10-06T03:04:06.517 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.512+0000 7f075ea2e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07580c9df0 con 0x7f07580cb0f0 2023-10-06T03:04:06.518 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.512+0000 7f0757fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0758067280 0x7f075816ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:06.518 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.512+0000 7f0757fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0758067280 0x7f075816ca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38246/0 (socket says 172.21.15.57:38246) 2023-10-06T03:04:06.518 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.512+0000 7f0757fff700 1 -- 172.21.15.57:0/1305349338 learned_addr learned my addr 172.21.15.57:0/1305349338 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:04:06.518 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.512+0000 7f074ffff700 1 --2- 172.21.15.57:0/1305349338 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f07580cb0f0 0x7f07580c98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:06.518 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.512+0000 7f075cfcb700 1 --2- 172.21.15.57:0/1305349338 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0758158ae0 0x7f075814aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:06.518 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.512+0000 7f0757fff700 1 -- 172.21.15.57:0/1305349338 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f07580cb0f0 msgr2=0x7f07580c98b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:06.518 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.512+0000 7f0757fff700 1 --2- 172.21.15.57:0/1305349338 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f07580cb0f0 0x7f07580c98b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:06.518 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.512+0000 7f0757fff700 1 -- 172.21.15.57:0/1305349338 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0758158ae0 msgr2=0x7f075814aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:06.519 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.512+0000 7f0757fff700 1 --2- 172.21.15.57:0/1305349338 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0758158ae0 0x7f075814aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:06.519 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.512+0000 7f0757fff700 1 -- 172.21.15.57:0/1305349338 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0740009420 con 0x7f0758067280 2023-10-06T03:04:06.519 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.512+0000 7f0757fff700 1 --2- 172.21.15.57:0/1305349338 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0758067280 0x7f075816ca00 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f074800ec80 tx=0x7f07480091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:06.519 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.516+0000 7f0754ff9700 1 -- 172.21.15.57:0/1305349338 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f074800c9d0 con 0x7f0758067280 2023-10-06T03:04:06.519 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.516+0000 7f0754ff9700 1 -- 172.21.15.57:0/1305349338 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f074800cb30 con 0x7f0758067280 2023-10-06T03:04:06.519 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.516+0000 7f075ea2e700 1 -- 172.21.15.57:0/1305349338 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f075816d090 con 0x7f0758067280 2023-10-06T03:04:06.520 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.516+0000 7f0754ff9700 1 -- 172.21.15.57:0/1305349338 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0748013470 con 0x7f0758067280 2023-10-06T03:04:06.520 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.516+0000 7f075ea2e700 1 -- 172.21.15.57:0/1305349338 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f075816d650 con 0x7f0758067280 2023-10-06T03:04:06.520 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.516+0000 7f075ea2e700 1 -- 172.21.15.57:0/1305349338 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f07580712e0 con 0x7f0758067280 2023-10-06T03:04:06.521 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.516+0000 7f0754ff9700 1 -- 172.21.15.57:0/1305349338 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f0748013820 con 0x7f0758067280 2023-10-06T03:04:06.523 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.520+0000 7f0754ff9700 1 --2- 172.21.15.57:0/1305349338 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f0738060550 0x7f0738062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:06.523 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.520+0000 7f0754ff9700 1 -- 172.21.15.57:0/1305349338 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5378+0+0 (secure 0 0 0) 0x7f074807ca70 con 0x7f0758067280 2023-10-06T03:04:06.524 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.520+0000 7f074ffff700 1 --2- 172.21.15.57:0/1305349338 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f0738060550 0x7f0738062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:06.524 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.520+0000 7f0754ff9700 1 --2- 172.21.15.57:0/1305349338 >> [v2:172.21.15.105:6808/33370,v1:172.21.15.105:6809/33370] conn(0x7f0738066a60 0x7f0738068e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:06.524 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.520+0000 7f0754ff9700 1 -- 172.21.15.57:0/1305349338 --> [v2:172.21.15.105:6808/33370,v1:172.21.15.105:6809/33370] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0738069520 con 0x7f0738066a60 2023-10-06T03:04:06.524 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.520+0000 7f0754ff9700 1 -- 172.21.15.57:0/1305349338 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=59) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0748081220 con 0x7f0758067280 2023-10-06T03:04:06.524 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.520+0000 7f075cfcb700 1 --2- 172.21.15.57:0/1305349338 >> [v2:172.21.15.105:6808/33370,v1:172.21.15.105:6809/33370] conn(0x7f0738066a60 0x7f0738068e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:06.525 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.520+0000 7f074ffff700 1 --2- 172.21.15.57:0/1305349338 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f0738060550 0x7f0738062a00 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f07400093f0 tx=0x7f0740017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:06.525 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.520+0000 7f075cfcb700 1 --2- 172.21.15.57:0/1305349338 >> [v2:172.21.15.105:6808/33370,v1:172.21.15.105:6809/33370] conn(0x7f0738066a60 0x7f0738068e70 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:06.527 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.524+0000 7f0754ff9700 1 -- 172.21.15.57:0/1305349338 <== osd.7 v2:172.21.15.105:6808/33370 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f0738069520 con 0x7f0738066a60 2023-10-06T03:04:06.546 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.540+0000 7f075ea2e700 1 -- 172.21.15.57:0/1305349338 --> [v2:172.21.15.105:6808/33370,v1:172.21.15.105:6809/33370] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f07580cb7b0 con 0x7f0738066a60 2023-10-06T03:04:06.547 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.544+0000 7f0754ff9700 1 -- 172.21.15.57:0/1305349338 <== osd.7 v2:172.21.15.105:6808/33370 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f07580cb7b0 con 0x7f0738066a60 2023-10-06T03:04:06.548 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-10-06T03:04:06.548 INFO:teuthology.orchestra.run.smithi057.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T03:04:06.548 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-10-06T03:04:06.549 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.544+0000 7f075ea2e700 1 -- 172.21.15.57:0/1305349338 >> [v2:172.21.15.105:6808/33370,v1:172.21.15.105:6809/33370] conn(0x7f0738066a60 msgr2=0x7f0738068e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:06.549 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.544+0000 7f075ea2e700 1 --2- 172.21.15.57:0/1305349338 >> [v2:172.21.15.105:6808/33370,v1:172.21.15.105:6809/33370] conn(0x7f0738066a60 0x7f0738068e70 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:06.549 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.544+0000 7f075ea2e700 1 -- 172.21.15.57:0/1305349338 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f0738060550 msgr2=0x7f0738062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:06.549 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.544+0000 7f075ea2e700 1 --2- 172.21.15.57:0/1305349338 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f0738060550 0x7f0738062a00 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f07400093f0 tx=0x7f0740017000 comp rx=0 tx=0).stop 2023-10-06T03:04:06.549 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.544+0000 7f075ea2e700 1 -- 172.21.15.57:0/1305349338 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0758067280 msgr2=0x7f075816ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:06.549 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.544+0000 7f075ea2e700 1 --2- 172.21.15.57:0/1305349338 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0758067280 0x7f075816ca00 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f074800ec80 tx=0x7f07480091a0 comp rx=0 tx=0).stop 2023-10-06T03:04:06.549 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.544+0000 7f075cfcb700 1 -- 172.21.15.57:0/1305349338 reap_dead start 2023-10-06T03:04:06.549 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.544+0000 7f075ea2e700 1 -- 172.21.15.57:0/1305349338 shutdown_connections 2023-10-06T03:04:06.549 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.544+0000 7f075ea2e700 1 -- 172.21.15.57:0/1305349338 >> 172.21.15.57:0/1305349338 conn(0x7f07580d0bc0 msgr2=0x7f0758159820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:06.550 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.544+0000 7f075ea2e700 1 -- 172.21.15.57:0/1305349338 shutdown_connections 2023-10-06T03:04:06.550 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.544+0000 7f075ea2e700 1 -- 172.21.15.57:0/1305349338 wait complete. 2023-10-06T03:04:06.566 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-10-06T03:04:06.735 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.732+0000 7fc3613c5700 1 Processor -- start 2023-10-06T03:04:06.735 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.732+0000 7fc3613c5700 1 -- start start 2023-10-06T03:04:06.737 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.732+0000 7fc3613c5700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fc35c14fe50 0x7fc35c0ce4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:06.737 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.732+0000 7fc3613c5700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc35c06b680 0x7fc35c0cea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:06.738 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.732+0000 7fc3613c5700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc35c06ccf0 con 0x7fc35c150220 2023-10-06T03:04:06.738 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.732+0000 7fc3613c5700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc35c06bae0 con 0x7fc35c06b680 2023-10-06T03:04:06.738 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.732+0000 7fc3613c5700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc35c06c9c0 con 0x7fc35c14fe50 2023-10-06T03:04:06.738 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.732+0000 7fc35b7fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc35c06b680 0x7fc35c0cea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:06.738 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.732+0000 7fc35a7fc700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fc35c150220 0x7fc35c06af70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:46454/0 (socket says 172.21.15.57:46454) 2023-10-06T03:04:06.739 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.732+0000 7fc35a7fc700 1 -- 172.21.15.57:0/3603097956 learned_addr learned my addr 172.21.15.57:0/3603097956 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:04:06.739 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.732+0000 7fc35affd700 1 --2- 172.21.15.57:0/3603097956 >> v2:172.21.15.105:3300/0 conn(0x7fc35c14fe50 0x7fc35c0ce4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:06.742 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.736+0000 7fc35b7fe700 1 -- 172.21.15.57:0/3603097956 >> v2:172.21.15.105:3300/0 conn(0x7fc35c14fe50 msgr2=0x7fc35c0ce4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:06.742 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.736+0000 7fc35b7fe700 1 --2- 172.21.15.57:0/3603097956 >> v2:172.21.15.105:3300/0 conn(0x7fc35c14fe50 0x7fc35c0ce4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:06.742 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.736+0000 7fc35b7fe700 1 -- 172.21.15.57:0/3603097956 >> v1:172.21.15.57:6789/0 conn(0x7fc35c150220 legacy=0x7fc35c06af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:06.742 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.736+0000 7fc35b7fe700 1 -- 172.21.15.57:0/3603097956 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc35c06bce0 con 0x7fc35c06b680 2023-10-06T03:04:06.742 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.736+0000 7fc359ffb700 1 -- 172.21.15.57:0/3603097956 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3249933190 0 0) 0x7fc35c06ccf0 con 0x7fc35c150220 2023-10-06T03:04:06.742 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.736+0000 7fc35b7fe700 1 --2- 172.21.15.57:0/3603097956 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc35c06b680 0x7fc35c0cea20 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fc35c0cd6d0 tx=0x7fc3540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b116d4fbdfaed23 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:06.742 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.736+0000 7fc359ffb700 1 -- 172.21.15.57:0/3603097956 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc354011630 con 0x7fc35c06b680 2023-10-06T03:04:06.742 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.736+0000 7fc359ffb700 1 -- 172.21.15.57:0/3603097956 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc354011790 con 0x7fc35c06b680 2023-10-06T03:04:06.742 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.736+0000 7fc359ffb700 1 -- 172.21.15.57:0/3603097956 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc354011b30 con 0x7fc35c06b680 2023-10-06T03:04:06.743 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.736+0000 7fc3613c5700 1 -- 172.21.15.57:0/3603097956 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc35c06b680 msgr2=0x7fc35c0cea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:06.743 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.736+0000 7fc3613c5700 1 --2- 172.21.15.57:0/3603097956 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc35c06b680 0x7fc35c0cea20 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fc35c0cd6d0 tx=0x7fc3540091a0 comp rx=0 tx=0).stop 2023-10-06T03:04:06.743 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.736+0000 7fc3613c5700 1 -- 172.21.15.57:0/3603097956 shutdown_connections 2023-10-06T03:04:06.743 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.736+0000 7fc3613c5700 1 --2- 172.21.15.57:0/3603097956 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc35c06b680 0x7fc35c0cea20 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:06.743 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.736+0000 7fc3613c5700 1 --2- 172.21.15.57:0/3603097956 >> v2:172.21.15.105:3300/0 conn(0x7fc35c14fe50 0x7fc35c0ce4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:06.743 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.736+0000 7fc3613c5700 1 -- 172.21.15.57:0/3603097956 >> 172.21.15.57:0/3603097956 conn(0x7fc35c0d0bf0 msgr2=0x7fc35c0ccb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:06.743 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.736+0000 7fc3613c5700 1 -- 172.21.15.57:0/3603097956 shutdown_connections 2023-10-06T03:04:06.743 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.736+0000 7fc3613c5700 1 -- 172.21.15.57:0/3603097956 wait complete. 2023-10-06T03:04:06.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.740+0000 7fc3613c5700 1 Processor -- start 2023-10-06T03:04:06.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.740+0000 7fc3613c5700 1 -- start start 2023-10-06T03:04:06.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.740+0000 7fc3613c5700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc35c06b680 0x7fc35c0b0d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:06.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.740+0000 7fc3613c5700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc35c14fe50 0x7fc35c0cb0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:06.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.740+0000 7fc3613c5700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc35c150220 0x7fc35c0cb600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:06.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.740+0000 7fc3613c5700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc35c0b3870 con 0x7fc35c150220 2023-10-06T03:04:06.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.740+0000 7fc3613c5700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc35c0b3b10 con 0x7fc35c06b680 2023-10-06T03:04:06.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.740+0000 7fc3613c5700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc35c0b1690 con 0x7fc35c14fe50 2023-10-06T03:04:06.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.740+0000 7fc35b7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc35c150220 0x7fc35c0cb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:06.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.740+0000 7fc35b7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc35c150220 0x7fc35c0cb600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38258/0 (socket says 172.21.15.57:38258) 2023-10-06T03:04:06.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.740+0000 7fc35b7fe700 1 -- 172.21.15.57:0/3027981412 learned_addr learned my addr 172.21.15.57:0/3027981412 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:04:06.747 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.740+0000 7fc35a7fc700 1 --2- 172.21.15.57:0/3027981412 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc35c14fe50 0x7fc35c0cb0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:06.747 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.740+0000 7fc35affd700 1 --2- 172.21.15.57:0/3027981412 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc35c06b680 0x7fc35c0b0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:06.747 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.740+0000 7fc35b7fe700 1 -- 172.21.15.57:0/3027981412 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc35c14fe50 msgr2=0x7fc35c0cb0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:06.747 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.740+0000 7fc35b7fe700 1 --2- 172.21.15.57:0/3027981412 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc35c14fe50 0x7fc35c0cb0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:06.747 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.740+0000 7fc35b7fe700 1 -- 172.21.15.57:0/3027981412 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc35c06b680 msgr2=0x7fc35c0b0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:06.747 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.740+0000 7fc35b7fe700 1 --2- 172.21.15.57:0/3027981412 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc35c06b680 0x7fc35c0b0d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:06.747 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.740+0000 7fc35b7fe700 1 -- 172.21.15.57:0/3027981412 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc354009420 con 0x7fc35c150220 2023-10-06T03:04:06.747 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.740+0000 7fc35a7fc700 1 --2- 172.21.15.57:0/3027981412 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc35c14fe50 0x7fc35c0cb0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:04:06.747 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.740+0000 7fc35affd700 1 --2- 172.21.15.57:0/3027981412 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc35c06b680 0x7fc35c0b0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:04:06.748 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.744+0000 7fc35b7fe700 1 --2- 172.21.15.57:0/3027981412 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc35c150220 0x7fc35c0cb600 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fc354009f50 tx=0x7fc354017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:06.748 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.744+0000 7fc342ffd700 1 -- 172.21.15.57:0/3027981412 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc354011ad0 con 0x7fc35c150220 2023-10-06T03:04:06.748 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.744+0000 7fc342ffd700 1 -- 172.21.15.57:0/3027981412 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3540195c0 con 0x7fc35c150220 2023-10-06T03:04:06.748 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.744+0000 7fc342ffd700 1 -- 172.21.15.57:0/3027981412 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc354019980 con 0x7fc35c150220 2023-10-06T03:04:06.748 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.744+0000 7fc3613c5700 1 -- 172.21.15.57:0/3027981412 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc35c0b1970 con 0x7fc35c150220 2023-10-06T03:04:06.749 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.744+0000 7fc3613c5700 1 -- 172.21.15.57:0/3027981412 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc35c0b1f30 con 0x7fc35c150220 2023-10-06T03:04:06.749 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.744+0000 7fc3613c5700 1 -- 172.21.15.57:0/3027981412 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc35c0b3ca0 con 0x7fc35c150220 2023-10-06T03:04:06.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.744+0000 7fc342ffd700 1 -- 172.21.15.57:0/3027981412 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fc354019cf0 con 0x7fc35c150220 2023-10-06T03:04:06.751 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.748+0000 7fc342ffd700 1 --2- 172.21.15.57:0/3027981412 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fc348060550 0x7fc348062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:06.752 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.748+0000 7fc342ffd700 1 -- 172.21.15.57:0/3027981412 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5378+0+0 (secure 0 0 0) 0x7fc35407e300 con 0x7fc35c150220 2023-10-06T03:04:06.752 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.748+0000 7fc35affd700 1 --2- 172.21.15.57:0/3027981412 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fc348060550 0x7fc348062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:06.753 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.748+0000 7fc35affd700 1 --2- 172.21.15.57:0/3027981412 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fc348060550 0x7fc348062a00 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fc34c0076c0 tx=0x7fc34c00b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:06.760 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.756+0000 7fc342ffd700 1 -- 172.21.15.57:0/3027981412 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fc35404e990 con 0x7fc35c150220 2023-10-06T03:04:06.935 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.928+0000 7fc3613c5700 1 -- 172.21.15.57:0/3027981412 --> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7fc35c04be40 con 0x7fc348060550 2023-10-06T03:04:06.935 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.932+0000 7fc342ffd700 1 -- 172.21.15.57:0/3027981412 <== mgr.4103 v2:172.21.15.57:6832/32947 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fc35c04be40 con 0x7fc348060550 2023-10-06T03:04:06.938 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.932+0000 7fc3613c5700 1 -- 172.21.15.57:0/3027981412 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fc348060550 msgr2=0x7fc348062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:06.938 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.932+0000 7fc3613c5700 1 --2- 172.21.15.57:0/3027981412 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fc348060550 0x7fc348062a00 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fc34c0076c0 tx=0x7fc34c00b040 comp rx=0 tx=0).stop 2023-10-06T03:04:06.938 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.932+0000 7fc3613c5700 1 -- 172.21.15.57:0/3027981412 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc35c150220 msgr2=0x7fc35c0cb600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:06.939 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.932+0000 7fc3613c5700 1 --2- 172.21.15.57:0/3027981412 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc35c150220 0x7fc35c0cb600 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fc354009f50 tx=0x7fc354017000 comp rx=0 tx=0).stop 2023-10-06T03:04:06.939 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.932+0000 7fc3613c5700 1 -- 172.21.15.57:0/3027981412 shutdown_connections 2023-10-06T03:04:06.939 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.932+0000 7fc3613c5700 1 --2- 172.21.15.57:0/3027981412 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc35c150220 0x7fc35c0cb600 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:06.939 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.932+0000 7fc3613c5700 1 --2- 172.21.15.57:0/3027981412 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fc348060550 0x7fc348062a00 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:06.939 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.932+0000 7fc3613c5700 1 --2- 172.21.15.57:0/3027981412 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc35c14fe50 0x7fc35c0cb0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:06.939 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.932+0000 7fc3613c5700 1 --2- 172.21.15.57:0/3027981412 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc35c06b680 0x7fc35c0b0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:06.939 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.932+0000 7fc3613c5700 1 -- 172.21.15.57:0/3027981412 >> 172.21.15.57:0/3027981412 conn(0x7fc35c0d0bf0 msgr2=0x7fc35c14cc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:06.939 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.932+0000 7fc3613c5700 1 -- 172.21.15.57:0/3027981412 shutdown_connections 2023-10-06T03:04:06.939 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:06.936+0000 7fc3613c5700 1 -- 172.21.15.57:0/3027981412 wait complete. 2023-10-06T03:04:06.942 INFO:teuthology.orchestra.run.smithi057.stderr:instructed osd(s) 7 to deep-scrub 2023-10-06T03:04:06.959 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:04:07.120 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:07.116+0000 7fa4ed785700 1 Processor -- start 2023-10-06T03:04:07.120 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:07.116+0000 7fa4ed785700 1 -- start start 2023-10-06T03:04:07.123 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:07.120+0000 7fa4ed785700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa4e80cdaf0 0x7fa4e815d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:07.124 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:07.120+0000 7fa4ed785700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4e80b16b0 con 0x7fa4e806d9c0 2023-10-06T03:04:07.124 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:07.120+0000 7fa4ed785700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4e80b0dc0 con 0x7fa4e815d480 2023-10-06T03:04:07.124 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:07.120+0000 7fa4ed785700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4e80b1060 con 0x7fa4e80cdaf0 2023-10-06T03:04:07.124 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:07.120+0000 7fa4de7fc700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa4e80cdaf0 0x7fa4e815d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:07.124 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:07.120+0000 7fa4e7fff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fa4e806d9c0 0x7fa4e815dd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:46464/0 (socket says 172.21.15.57:46464) 2023-10-06T03:04:07.124 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:07.120+0000 7fa4de7fc700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa4e80cdaf0 0x7fa4e815d850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38268/0 (socket says 172.21.15.57:38268) 2023-10-06T03:04:07.124 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:07.120+0000 7fa4e7fff700 1 -- 172.21.15.57:0/2749896262 learned_addr learned my addr 172.21.15.57:0/2749896262 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:04:07.125 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:07.120+0000 7fa4de7fc700 1 -- 172.21.15.57:0/2749896262 >> v1:172.21.15.105:6789/0 conn(0x7fa4e815d480 legacy=0x7fa4e80cd3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:07.125 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:07.120+0000 7fa4de7fc700 1 -- 172.21.15.57:0/2749896262 >> v1:172.21.15.57:6789/0 conn(0x7fa4e806d9c0 legacy=0x7fa4e815dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:07.125 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:07.120+0000 7fa4de7fc700 1 -- 172.21.15.57:0/2749896262 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4e80b1340 con 0x7fa4e80cdaf0 2023-10-06T03:04:07.125 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:07.120+0000 7fa4e67fc700 1 -- 172.21.15.57:0/2749896262 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 323053244 0 0) 0x7fa4e80b16b0 con 0x7fa4e806d9c0 2023-10-06T03:04:07.126 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:07.120+0000 7fa4de7fc700 1 --2- 172.21.15.57:0/2749896262 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4e80cdaf0 0x7fa4e815d850 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fa4d00098e0 tx=0x7fa4d00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7046ec34bf61637 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:07.126 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:07.120+0000 7fa4e67fc700 1 -- 172.21.15.57:0/2749896262 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d0009e80 con 0x7fa4e80cdaf0 2023-10-06T03:04:07.126 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:07.120+0000 7fa4e67fc700 1 -- 172.21.15.57:0/2749896262 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4d000b860 con 0x7fa4e80cdaf0 2023-10-06T03:04:07.126 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:07.120+0000 7fa4e67fc700 1 -- 172.21.15.57:0/2749896262 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d000bbe0 con 0x7fa4e80cdaf0 2023-10-06T03:04:07.127 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:07.124+0000 7fa4ed785700 1 -- 172.21.15.57:0/2749896262 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4e80cdaf0 msgr2=0x7fa4e815d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:07.127 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:07.124+0000 7fa4ed785700 1 --2- 172.21.15.57:0/2749896262 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4e80cdaf0 0x7fa4e815d850 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fa4d00098e0 tx=0x7fa4d00091a0 comp rx=0 tx=0).stop 2023-10-06T03:04:07.127 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:07.124+0000 7fa4ed785700 1 -- 172.21.15.57:0/2749896262 shutdown_connections 2023-10-06T03:04:07.127 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:07.124+0000 7fa4ed785700 1 --2- 172.21.15.57:0/2749896262 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4e80cdaf0 0x7fa4e815d850 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:07.127 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:07.124+0000 7fa4ed785700 1 -- 172.21.15.57:0/2749896262 >> 172.21.15.57:0/2749896262 conn(0x7fa4e8067ad0 msgr2=0x7fa4e8068530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:07.127 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:07.124+0000 7fa4ed785700 1 -- 172.21.15.57:0/2749896262 shutdown_connections 2023-10-06T03:04:07.127 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:07.124+0000 7fa4ed785700 1 -- 172.21.15.57:0/2749896262 wait complete. 2023-10-06T03:04:07.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:07.124+0000 7fa4ed785700 1 Processor -- start 2023-10-06T03:04:07.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:07.128+0000 7fa4ed785700 1 -- start start 2023-10-06T03:04:07.132 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:07.128+0000 7fa4ed785700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa4e806d9c0 0x7fa4e80c2df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:07.132 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:07.128+0000 7fa4ed785700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa4e80cdaf0 0x7fa4e80cd3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:07.133 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:07.128+0000 7fa4ed785700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4e815d480 0x7fa4e816e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:07.133 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:07.128+0000 7fa4ed785700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e80cd8e0 con 0x7fa4e815d480 2023-10-06T03:04:07.133 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:07.128+0000 7fa4ed785700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e80c40e0 con 0x7fa4e80cdaf0 2023-10-06T03:04:07.133 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:07.128+0000 7fa4ed785700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e816e5f0 con 0x7fa4e806d9c0 2023-10-06T03:04:07.133 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:07.128+0000 7fa4e7fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4e815d480 0x7fa4e816e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:07.133 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:07.128+0000 7fa4e7fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4e815d480 0x7fa4e816e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38272/0 (socket says 172.21.15.57:38272) 2023-10-06T03:04:07.133 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:07.128+0000 7fa4e7fff700 1 -- 172.21.15.57:0/3307590536 learned_addr learned my addr 172.21.15.57:0/3307590536 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:04:07.133 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:07.128+0000 7fa4e6ffd700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa4e806d9c0 0x7fa4e80c2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:07.133 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:07.128+0000 7fa4de7fc700 1 --2- 172.21.15.57:0/3307590536 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa4e80cdaf0 0x7fa4e80cd3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:07.134 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:07.128+0000 7fa4e7fff700 1 -- 172.21.15.57:0/3307590536 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa4e806d9c0 msgr2=0x7fa4e80c2df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:07.135 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:07.128+0000 7fa4e7fff700 1 --2- 172.21.15.57:0/3307590536 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa4e806d9c0 0x7fa4e80c2df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:07.135 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:07.128+0000 7fa4e7fff700 1 -- 172.21.15.57:0/3307590536 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa4e80cdaf0 msgr2=0x7fa4e80cd3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:07.135 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:07.128+0000 7fa4e7fff700 1 --2- 172.21.15.57:0/3307590536 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa4e80cdaf0 0x7fa4e80cd3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:07.135 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:07.128+0000 7fa4e7fff700 1 -- 172.21.15.57:0/3307590536 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4d0009420 con 0x7fa4e815d480 2023-10-06T03:04:07.135 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:07.128+0000 7fa4e7fff700 1 --2- 172.21.15.57:0/3307590536 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4e815d480 0x7fa4e816e0b0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fa4e000cc90 tx=0x7fa4e0001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:07.135 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:07.128+0000 7fa4df7fe700 1 -- 172.21.15.57:0/3307590536 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e000a8b0 con 0x7fa4e815d480 2023-10-06T03:04:07.135 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:07.128+0000 7fa4df7fe700 1 -- 172.21.15.57:0/3307590536 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4e000aa10 con 0x7fa4e815d480 2023-10-06T03:04:07.135 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:07.128+0000 7fa4ed785700 1 -- 172.21.15.57:0/3307590536 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4e80c34d0 con 0x7fa4e815d480 2023-10-06T03:04:07.135 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:07.128+0000 7fa4df7fe700 1 -- 172.21.15.57:0/3307590536 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e000add0 con 0x7fa4e815d480 2023-10-06T03:04:07.135 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:07.132+0000 7fa4ed785700 1 -- 172.21.15.57:0/3307590536 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4e80c3a90 con 0x7fa4e815d480 2023-10-06T03:04:07.136 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:07.132+0000 7fa4ed785700 1 -- 172.21.15.57:0/3307590536 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4e80712e0 con 0x7fa4e815d480 2023-10-06T03:04:07.137 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:07.132+0000 7fa4df7fe700 1 -- 172.21.15.57:0/3307590536 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fa4e0007300 con 0x7fa4e815d480 2023-10-06T03:04:07.138 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:07.132+0000 7fa4df7fe700 1 --2- 172.21.15.57:0/3307590536 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fa4c8060550 0x7fa4c8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:07.139 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:07.136+0000 7fa4df7fe700 1 -- 172.21.15.57:0/3307590536 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5378+0+0 (secure 0 0 0) 0x7fa4e007cac0 con 0x7fa4e815d480 2023-10-06T03:04:07.139 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:07.136+0000 7fa4e6ffd700 1 --2- 172.21.15.57:0/3307590536 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fa4c8060550 0x7fa4c8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:07.140 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:07.136+0000 7fa4e6ffd700 1 --2- 172.21.15.57:0/3307590536 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fa4c8060550 0x7fa4c8062a00 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fa4d80039e0 tx=0x7fa4d8007ec0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:07.145 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:07.140+0000 7fa4df7fe700 1 -- 172.21.15.57:0/3307590536 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fa4e004d150 con 0x7fa4e815d480 2023-10-06T03:04:07.312 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:07.308+0000 7fa4ed785700 1 -- 172.21.15.57:0/3307590536 --> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa4e80c4220 con 0x7fa4c8060550 2023-10-06T03:04:07.317 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:07.312+0000 7fa4df7fe700 1 -- 172.21.15.57:0/3307590536 <== mgr.4103 v2:172.21.15.57:6832/32947 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+69903 (secure 0 0 0) 0x7fa4e80c4220 con 0x7fa4c8060550 2023-10-06T03:04:07.318 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:04:07.322 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:07.316+0000 7fa4ed785700 1 -- 172.21.15.57:0/3307590536 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fa4c8060550 msgr2=0x7fa4c8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:07.322 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:07.316+0000 7fa4ed785700 1 --2- 172.21.15.57:0/3307590536 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fa4c8060550 0x7fa4c8062a00 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fa4d80039e0 tx=0x7fa4d8007ec0 comp rx=0 tx=0).stop 2023-10-06T03:04:07.322 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:07.316+0000 7fa4ed785700 1 -- 172.21.15.57:0/3307590536 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4e815d480 msgr2=0x7fa4e816e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:07.322 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:07.316+0000 7fa4ed785700 1 --2- 172.21.15.57:0/3307590536 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4e815d480 0x7fa4e816e0b0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fa4e000cc90 tx=0x7fa4e0001a80 comp rx=0 tx=0).stop 2023-10-06T03:04:07.323 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:07.316+0000 7fa4ed785700 1 -- 172.21.15.57:0/3307590536 shutdown_connections 2023-10-06T03:04:07.323 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:07.316+0000 7fa4ed785700 1 --2- 172.21.15.57:0/3307590536 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4e815d480 0x7fa4e816e0b0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:07.323 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:07.316+0000 7fa4ed785700 1 --2- 172.21.15.57:0/3307590536 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa4e80cdaf0 0x7fa4e80cd3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:07.323 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:07.316+0000 7fa4ed785700 1 --2- 172.21.15.57:0/3307590536 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fa4c8060550 0x7fa4c8062a00 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:07.323 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:07.316+0000 7fa4ed785700 1 --2- 172.21.15.57:0/3307590536 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa4e806d9c0 0x7fa4e80c2df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:07.323 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:07.316+0000 7fa4ed785700 1 -- 172.21.15.57:0/3307590536 >> 172.21.15.57:0/3307590536 conn(0x7fa4e8067ad0 msgr2=0x7fa4e80ad770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:07.323 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:07.320+0000 7fa4ed785700 1 -- 172.21.15.57:0/3307590536 shutdown_connections 2023-10-06T03:04:07.323 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:07.320+0000 7fa4ed785700 1 -- 172.21.15.57:0/3307590536 wait complete. 2023-10-06T03:04:07.325 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2023-10-06T03:04:07.342 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":153,"stamp":"2023-10-06T03:04:06.336961+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2409576,"kb_used_data":6696,"kb_used_omap":0,"kb_used_meta":2402816,"kb_avail":752565144,"statfs":{"total":773094113280,"available":770626707456,"internally_reserved":0,"allocated":6856704,"data_stored":3683208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2460483584},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-7,"num_objects":-1,"num_object_clones":0,"num_object_copies":-2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-1,"num_write_kb":-1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.003098"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":193,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T03:03:55.987614+0000","last_change":"2023-10-06T03:00:45.709165+0000","last_active":"2023-10-06T03:03:55.987614+0000","last_peered":"2023-10-06T03:03:55.987614+0000","last_clean":"2023-10-06T03:03:55.987614+0000","last_became_active":"2023-10-06T03:00:45.707771+0000","last_became_peered":"2023-10-06T03:00:45.707771+0000","last_unstale":"2023-10-06T03:03:55.987614+0000","last_undegraded":"2023-10-06T03:03:55.987614+0000","last_fullsized":"2023-10-06T03:03:55.987614+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:44.625353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:44.625353+0000","last_clean_scrub_stamp":"2023-10-06T03:00:44.625353+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:31:31.774239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":41,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T03:03:56.147622+0000","last_change":"2023-10-06T03:00:51.905381+0000","last_active":"2023-10-06T03:03:56.147622+0000","last_peered":"2023-10-06T03:03:56.147622+0000","last_clean":"2023-10-06T03:03:56.147622+0000","last_became_active":"2023-10-06T03:00:51.904974+0000","last_became_peered":"2023-10-06T03:00:51.904974+0000","last_unstale":"2023-10-06T03:03:56.147622+0000","last_undegraded":"2023-10-06T03:03:56.147622+0000","last_fullsized":"2023-10-06T03:03:56.147622+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:15:19.182956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":40,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T03:03:55.987505+0000","last_change":"2023-10-06T03:00:51.906480+0000","last_active":"2023-10-06T03:03:55.987505+0000","last_peered":"2023-10-06T03:03:55.987505+0000","last_clean":"2023-10-06T03:03:55.987505+0000","last_became_active":"2023-10-06T03:00:51.905956+0000","last_became_peered":"2023-10-06T03:00:51.905956+0000","last_unstale":"2023-10-06T03:03:55.987505+0000","last_undegraded":"2023-10-06T03:03:55.987505+0000","last_fullsized":"2023-10-06T03:03:55.987505+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:15:19.182956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":42,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-10-06T03:03:57.222960+0000","last_change":"2023-10-06T03:00:51.902453+0000","last_active":"2023-10-06T03:03:57.222960+0000","last_peered":"2023-10-06T03:03:57.222960+0000","last_clean":"2023-10-06T03:03:57.222960+0000","last_became_active":"2023-10-06T03:00:51.901948+0000","last_became_peered":"2023-10-06T03:00:51.901948+0000","last_unstale":"2023-10-06T03:03:57.222960+0000","last_undegraded":"2023-10-06T03:03:57.222960+0000","last_fullsized":"2023-10-06T03:03:57.222960+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":41,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T03:03:56.146616+0000","last_change":"2023-10-06T03:00:51.904148+0000","last_active":"2023-10-06T03:03:56.146616+0000","last_peered":"2023-10-06T03:03:56.146616+0000","last_clean":"2023-10-06T03:03:56.146616+0000","last_became_active":"2023-10-06T03:00:51.903729+0000","last_became_peered":"2023-10-06T03:00:51.903729+0000","last_unstale":"2023-10-06T03:03:56.146616+0000","last_undegraded":"2023-10-06T03:03:56.146616+0000","last_fullsized":"2023-10-06T03:03:56.146616+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:17:25.070478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":40,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-10-06T03:03:57.358335+0000","last_change":"2023-10-06T03:00:52.484317+0000","last_active":"2023-10-06T03:03:57.358335+0000","last_peered":"2023-10-06T03:03:57.358335+0000","last_clean":"2023-10-06T03:03:57.358335+0000","last_became_active":"2023-10-06T03:00:52.483818+0000","last_became_peered":"2023-10-06T03:00:52.483818+0000","last_unstale":"2023-10-06T03:03:57.358335+0000","last_undegraded":"2023-10-06T03:03:57.358335+0000","last_fullsized":"2023-10-06T03:03:57.358335+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":40,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T03:03:55.989895+0000","last_change":"2023-10-06T03:00:52.485186+0000","last_active":"2023-10-06T03:03:55.989895+0000","last_peered":"2023-10-06T03:03:55.989895+0000","last_clean":"2023-10-06T03:03:55.989895+0000","last_became_active":"2023-10-06T03:00:52.484615+0000","last_became_peered":"2023-10-06T03:00:52.484615+0000","last_unstale":"2023-10-06T03:03:55.989895+0000","last_undegraded":"2023-10-06T03:03:55.989895+0000","last_fullsized":"2023-10-06T03:03:55.989895+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:17:25.070478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":40,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-10-06T03:03:57.358702+0000","last_change":"2023-10-06T03:00:51.903388+0000","last_active":"2023-10-06T03:03:57.358702+0000","last_peered":"2023-10-06T03:03:57.358702+0000","last_clean":"2023-10-06T03:03:57.358702+0000","last_became_active":"2023-10-06T03:00:51.902959+0000","last_became_peered":"2023-10-06T03:00:51.902959+0000","last_unstale":"2023-10-06T03:03:57.358702+0000","last_undegraded":"2023-10-06T03:03:57.358702+0000","last_fullsized":"2023-10-06T03:03:57.358702+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":39,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T03:03:55.987243+0000","last_change":"2023-10-06T03:00:51.903242+0000","last_active":"2023-10-06T03:03:55.987243+0000","last_peered":"2023-10-06T03:03:55.987243+0000","last_clean":"2023-10-06T03:03:55.987243+0000","last_became_active":"2023-10-06T03:00:51.902929+0000","last_became_peered":"2023-10-06T03:00:51.902929+0000","last_unstale":"2023-10-06T03:03:55.987243+0000","last_undegraded":"2023-10-06T03:03:55.987243+0000","last_fullsized":"2023-10-06T03:03:55.987243+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:00:50.863151+0000","last_clean_scrub_stamp":"2023-10-06T03:00:50.863151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:34:12.274158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574891,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302656,"kb_used_data":1272,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069184,"statfs":{"total":96636764160,"available":96326844416,"internally_reserved":0,"allocated":1302528,"data_stored":903177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:03:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.2270000000000001,"15min":1.3009999999999999},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.415,"5min":4.7930000000000001,"15min":4.7930000000000001},"last":0.96499999999999997},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.4099999999999999,"15min":1.522},"min":{"1min":0.86399999999999999,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.476,"5min":9.9689999999999994,"15min":9.9689999999999994},"last":1.113}]},{"osd":1,"last update":"Fri Oct 6 03:03:45 2023","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.3680000000000001,"15min":1.4710000000000001},"min":{"1min":0.95799999999999996,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.454,"5min":10.867000000000001,"15min":10.867000000000001},"last":1.0549999999999999},{"interface":"front","average":{"1min":1.3049999999999999,"5min":1.5169999999999999,"15min":1.6240000000000001},"min":{"1min":0.89100000000000001,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":1.599,"5min":10.255000000000001,"15min":10.255000000000001},"last":1.5229999999999999}]},{"osd":2,"last update":"Fri Oct 6 03:03:45 2023","interfaces":[{"interface":"back","average":{"1min":1.3300000000000001,"5min":1.5149999999999999,"15min":1.625},"min":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"max":{"1min":1.6830000000000001,"5min":7.9939999999999998,"15min":7.9939999999999998},"last":1.2569999999999999},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.552,"15min":1.6479999999999999},"min":{"1min":1.133,"5min":0.84899999999999998,"15min":0.84899999999999998},"max":{"1min":1.673,"5min":10.098000000000001,"15min":10.098000000000001},"last":1.282}]},{"osd":3,"last update":"Fri Oct 6 03:03:45 2023","interfaces":[{"interface":"back","average":{"1min":1.4099999999999999,"5min":1.4419999999999999,"15min":1.49},"min":{"1min":1.018,"5min":0.754,"15min":0.754},"max":{"1min":2.069,"5min":4.3090000000000002,"15min":4.3090000000000002},"last":1.427},{"interface":"front","average":{"1min":1.4179999999999999,"5min":1.542,"15min":1.6080000000000001},"min":{"1min":1.1160000000000001,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":1.7589999999999999,"5min":8.3770000000000007,"15min":8.3770000000000007},"last":1.371}]},{"osd":4,"last update":"Fri Oct 6 03:03:45 2023","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":1.5389999999999999,"15min":1.7050000000000001},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.8460000000000001,"5min":11.391999999999999,"15min":11.391999999999999},"last":1.637},{"interface":"front","average":{"1min":1.268,"5min":1.399,"15min":1.456},"min":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"max":{"1min":1.857,"5min":3.9220000000000002,"15min":3.9220000000000002},"last":1.3400000000000001}]},{"osd":5,"last update":"Fri Oct 6 03:03:45 2023","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.581,"15min":1.724},"min":{"1min":0.91200000000000003,"5min":0.89400000000000002,"15min":0.89400000000000002},"max":{"1min":2.004,"5min":11.951000000000001,"15min":11.951000000000001},"last":1.208},{"interface":"front","average":{"1min":1.359,"5min":1.6890000000000001,"15min":1.847},"min":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"max":{"1min":1.764,"5min":10.994999999999999,"15min":10.994999999999999},"last":1.71}]},{"osd":6,"last update":"Fri Oct 6 03:03:45 2023","interfaces":[{"interface":"back","average":{"1min":1.5009999999999999,"5min":1.7729999999999999,"15min":1.917},"min":{"1min":1.143,"5min":0.91300000000000003,"15min":0.91300000000000003},"max":{"1min":1.9510000000000001,"5min":11.513,"15min":11.513},"last":1.7689999999999999},{"interface":"front","average":{"1min":1.448,"5min":1.7290000000000001,"15min":1.881},"min":{"1min":1.024,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":2.1819999999999999,"5min":10.714,"15min":10.714},"last":1.583}]}]},{"osd":6,"up_from":13,"seq":55834574891,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297980,"kb_used_data":692,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073860,"statfs":{"total":96636764160,"available":96331632640,"internally_reserved":0,"allocated":708608,"data_stored":312809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:03:45 2023","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.1890000000000001,"15min":1.1930000000000001},"min":{"1min":0.78400000000000003,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.704,"5min":1.704,"15min":1.704},"last":1.395},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.345,"15min":1.361},"min":{"1min":1.0449999999999999,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.7270000000000001,"5min":2.1419999999999999,"15min":2.1419999999999999},"last":1.1719999999999999}]},{"osd":1,"last update":"Fri Oct 6 03:03:45 2023","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.2829999999999999,"15min":1.3049999999999999},"min":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.671,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":1.454},{"interface":"front","average":{"1min":1.2669999999999999,"5min":1.2509999999999999,"15min":1.254},"min":{"1min":0.90400000000000003,"5min":0.746,"15min":0.746},"max":{"1min":1.756,"5min":1.774,"15min":1.774},"last":1.2230000000000001}]},{"osd":2,"last update":"Fri Oct 6 03:03:45 2023","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.169,"15min":1.167},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.8220000000000001,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":1.04},{"interface":"front","average":{"1min":1.198,"5min":1.2150000000000001,"15min":1.2290000000000001},"min":{"1min":0.93999999999999995,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.595,"5min":1.78,"15min":1.78},"last":1.6120000000000001}]},{"osd":3,"last update":"Fri Oct 6 03:03:45 2023","interfaces":[{"interface":"back","average":{"1min":1.2749999999999999,"5min":1.274,"15min":1.28},"min":{"1min":1.004,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.488,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":1.2789999999999999},{"interface":"front","average":{"1min":1.3580000000000001,"5min":1.3220000000000001,"15min":1.3360000000000001},"min":{"1min":1.111,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.5700000000000001,"5min":2.2200000000000002,"15min":2.2200000000000002},"last":1.3340000000000001}]},{"osd":4,"last update":"Fri Oct 6 03:03:45 2023","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":1.248,"15min":1.2729999999999999},"min":{"1min":0.77700000000000002,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.5840000000000001,"5min":2.0960000000000001,"15min":2.0960000000000001},"last":1.52},{"interface":"front","average":{"1min":1.175,"5min":1.3500000000000001,"15min":1.399},"min":{"1min":0.89200000000000002,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.4370000000000001,"5min":2.2610000000000001,"15min":2.2610000000000001},"last":1.4370000000000001}]},{"osd":5,"last update":"Fri Oct 6 03:03:45 2023","interfaces":[{"interface":"back","average":{"1min":1.306,"5min":1.333,"15min":1.359},"min":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":1.7829999999999999,"5min":1.994,"15min":1.994},"last":1.5580000000000001},{"interface":"front","average":{"1min":1.294,"5min":1.3380000000000001,"15min":1.3720000000000001},"min":{"1min":0.89200000000000002,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.609,"5min":2.0129999999999999,"15min":2.0129999999999999},"last":1.581}]},{"osd":7,"last update":"Fri Oct 6 03:03:45 2023","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.425,"15min":1.4590000000000001},"min":{"1min":1.085,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.661,"5min":2.0920000000000001,"15min":2.0920000000000001},"last":1.4950000000000001},{"interface":"front","average":{"1min":1.448,"5min":1.492,"15min":1.528},"min":{"1min":0.93100000000000005,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":1.8720000000000001,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":1.6850000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574891,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297980,"kb_used_data":692,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073860,"statfs":{"total":96636764160,"available":96331632640,"internally_reserved":0,"allocated":708608,"data_stored":312809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:03:50 2023","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.0169999999999999,"15min":0.97299999999999998},"min":{"1min":0.82299999999999995,"5min":0.62,"15min":0.62},"max":{"1min":1.391,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":1.123},{"interface":"front","average":{"1min":1.153,"5min":1.0680000000000001,"15min":1.046},"min":{"1min":0.78500000000000003,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.5189999999999999,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":1.1739999999999999}]},{"osd":1,"last update":"Fri Oct 6 03:03:50 2023","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.222,"15min":1.212},"min":{"1min":0.89400000000000002,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":1.6879999999999999,"5min":1.984,"15min":1.984},"last":1.492},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.169,"15min":1.161},"min":{"1min":0.83999999999999997,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":2.0899999999999999,"5min":2.0899999999999999,"15min":2.0899999999999999},"last":1.3879999999999999}]},{"osd":2,"last update":"Fri Oct 6 03:03:50 2023","interfaces":[{"interface":"back","average":{"1min":1.3,"5min":1.3640000000000001,"15min":1.3839999999999999},"min":{"1min":0.94799999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":1.7350000000000001,"5min":1.78,"15min":1.78},"last":0.90600000000000003},{"interface":"front","average":{"1min":1.286,"5min":1.306,"15min":1.3049999999999999},"min":{"1min":1.0049999999999999,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":1.5489999999999999,"5min":2.8319999999999999,"15min":2.8319999999999999},"last":1.4339999999999999}]},{"osd":3,"last update":"Fri Oct 6 03:03:50 2023","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2589999999999999},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.589,"5min":3.1789999999999998,"15min":3.1789999999999998},"last":1.409},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.296,"15min":1.28},"min":{"1min":0.90300000000000002,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":2.2549999999999999,"5min":2.2549999999999999,"15min":2.2549999999999999},"last":1.232}]},{"osd":4,"last update":"Fri Oct 6 03:03:50 2023","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.2370000000000001,"15min":1.28},"min":{"1min":0.81100000000000005,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.4570000000000001,"5min":2.5899999999999999,"15min":2.5899999999999999},"last":1.343},{"interface":"front","average":{"1min":1.369,"5min":1.4570000000000001,"15min":1.496},"min":{"1min":0.96899999999999997,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.764,"5min":4.5419999999999998,"15min":4.5419999999999998},"last":1.5880000000000001}]},{"osd":6,"last update":"Fri Oct 6 03:03:50 2023","interfaces":[{"interface":"back","average":{"1min":1.208,"5min":1.3380000000000001,"15min":1.3720000000000001},"min":{"1min":0.82399999999999995,"5min":0.754,"15min":0.754},"max":{"1min":1.5980000000000001,"5min":1.847,"15min":1.847},"last":0.83599999999999997},{"interface":"front","average":{"1min":1.319,"5min":1.3620000000000001,"15min":1.3759999999999999},"min":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"max":{"1min":1.599,"5min":2.9239999999999999,"15min":2.9239999999999999},"last":1.5369999999999999}]},{"osd":7,"last update":"Fri Oct 6 03:03:50 2023","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.3700000000000001,"15min":1.3979999999999999},"min":{"1min":1.0169999999999999,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.8080000000000001,"5min":4.4489999999999998,"15min":4.4489999999999998},"last":1.294},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.387,"15min":1.419},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.7130000000000001,"5min":1.98,"15min":1.98},"last":0.96699999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574890,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302076,"kb_used_data":692,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069764,"statfs":{"total":96636764160,"available":96327438336,"internally_reserved":0,"allocated":708608,"data_stored":312809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:03:51 2023","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.093,"15min":1.089},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.5509999999999999,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":1.129},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.093,"15min":1.079},"min":{"1min":0.80600000000000005,"5min":0.625,"15min":0.625},"max":{"1min":1.4359999999999999,"5min":1.585,"15min":1.585},"last":1.089}]},{"osd":1,"last update":"Fri Oct 6 03:03:51 2023","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":1.0740000000000001,"15min":1.0569999999999999},"min":{"1min":0.75600000000000001,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.3999999999999999,"5min":1.621,"15min":1.621},"last":1.242},{"interface":"front","average":{"1min":1.133,"5min":1.1759999999999999,"15min":1.171},"min":{"1min":0.80200000000000005,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.411,"5min":1.73,"15min":1.73},"last":1.423}]},{"osd":2,"last update":"Fri Oct 6 03:03:51 2023","interfaces":[{"interface":"back","average":{"1min":1.296,"5min":1.2889999999999999,"15min":1.2849999999999999},"min":{"1min":0.95299999999999996,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.5589999999999999,"5min":1.696,"15min":1.696},"last":1.2909999999999999},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.329,"15min":1.3360000000000001},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.571,"5min":1.788,"15min":1.788},"last":1.363}]},{"osd":3,"last update":"Fri Oct 6 03:03:51 2023","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.222,"15min":1.2390000000000001},"min":{"1min":0.76500000000000001,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.407,"5min":1.706,"15min":1.706},"last":1.304},{"interface":"front","average":{"1min":1.1890000000000001,"5min":1.2370000000000001,"15min":1.2330000000000001},"min":{"1min":0.96999999999999997,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.3799999999999999,"5min":2.1960000000000002,"15min":2.1960000000000002},"last":1.329}]},{"osd":5,"last update":"Fri Oct 6 03:03:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.2110000000000001,"15min":1.202},"min":{"1min":0.86299999999999999,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.496,"5min":1.71,"15min":1.71},"last":1.254},{"interface":"front","average":{"1min":1.206,"5min":1.302,"15min":1.343},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.4990000000000001,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":0.999}]},{"osd":6,"last update":"Fri Oct 6 03:03:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2609999999999999,"5min":1.327,"15min":1.371},"min":{"1min":0.63500000000000001,"5min":0.629,"15min":0.629},"max":{"1min":1.7949999999999999,"5min":2.9100000000000001,"15min":2.9100000000000001},"last":1.1759999999999999},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.429,"15min":1.4610000000000001},"min":{"1min":1.0329999999999999,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.605,"5min":3.282,"15min":3.282},"last":1.472}]},{"osd":7,"last update":"Fri Oct 6 03:03:51 2023","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":1.4490000000000001,"15min":1.512},"min":{"1min":0.91900000000000004,"5min":0.88700000000000001,"15min":0.88700000000000001},"max":{"1min":1.591,"5min":2.145,"15min":2.145},"last":1.212},{"interface":"front","average":{"1min":1.411,"5min":1.4330000000000001,"15min":1.4350000000000001},"min":{"1min":0.874,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.7350000000000001,"5min":1.927,"15min":1.927},"last":0.96399999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574890,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302076,"kb_used_data":692,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069764,"statfs":{"total":96636764160,"available":96327438336,"internally_reserved":0,"allocated":708608,"data_stored":312809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:03:49 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.95799999999999996,"15min":0.99399999999999999},"min":{"1min":0.67100000000000004,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.3919999999999999,"5min":2.298,"15min":2.298},"last":0.81699999999999995},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.01,"15min":1.002},"min":{"1min":0.752,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.339,"5min":2.1850000000000001,"15min":2.1850000000000001},"last":1.1779999999999999}]},{"osd":1,"last update":"Fri Oct 6 03:03:49 2023","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.97399999999999998,"15min":0.98599999999999999},"min":{"1min":0.65800000000000003,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.3480000000000001,"5min":1.974,"15min":1.974},"last":0.76600000000000001},{"interface":"front","average":{"1min":1.127,"5min":1.1240000000000001,"15min":1.1319999999999999},"min":{"1min":0.86899999999999999,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.4710000000000001,"5min":1.71,"15min":1.71},"last":1.0700000000000001}]},{"osd":2,"last update":"Fri Oct 6 03:03:49 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":1.034,"15min":1.054},"min":{"1min":0.67600000000000005,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.4099999999999999,"5min":2.8849999999999998,"15min":2.8849999999999998},"last":0.86399999999999999},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.0860000000000001,"15min":1.0920000000000001},"min":{"1min":0.84199999999999997,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.5780000000000001,"5min":2.8220000000000001,"15min":2.8220000000000001},"last":1.022}]},{"osd":4,"last update":"Fri Oct 6 03:03:49 2023","interfaces":[{"interface":"back","average":{"1min":1.2849999999999999,"5min":1.393,"15min":1.4350000000000001},"min":{"1min":0.95299999999999996,"5min":0.751,"15min":0.751},"max":{"1min":1.7130000000000001,"5min":3.6560000000000001,"15min":3.6560000000000001},"last":1.7509999999999999},{"interface":"front","average":{"1min":1.335,"5min":1.401,"15min":1.444},"min":{"1min":1.0820000000000001,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.796,"5min":3.7749999999999999,"15min":3.7749999999999999},"last":1.3180000000000001}]},{"osd":5,"last update":"Fri Oct 6 03:03:49 2023","interfaces":[{"interface":"back","average":{"1min":1.4119999999999999,"5min":1.478,"15min":1.5149999999999999},"min":{"1min":1.1679999999999999,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":1.8460000000000001,"5min":3.4910000000000001,"15min":3.4910000000000001},"last":1.4319999999999999},{"interface":"front","average":{"1min":1.377,"5min":1.4370000000000001,"15min":1.4750000000000001},"min":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"max":{"1min":1.6519999999999999,"5min":2.6240000000000001,"15min":2.6240000000000001},"last":1.5269999999999999}]},{"osd":6,"last update":"Fri Oct 6 03:03:49 2023","interfaces":[{"interface":"back","average":{"1min":1.359,"5min":1.4870000000000001,"15min":1.5469999999999999},"min":{"1min":1.0349999999999999,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":1.7549999999999999,"5min":3.7050000000000001,"15min":3.7050000000000001},"last":1.639},{"interface":"front","average":{"1min":1.3540000000000001,"5min":1.4990000000000001,"15min":1.5549999999999999},"min":{"1min":0.97699999999999998,"5min":0.80900000000000005,"15min":0.80900000000000005},"max":{"1min":1.901,"5min":3.9300000000000002,"15min":3.9300000000000002},"last":1.5720000000000001}]},{"osd":7,"last update":"Fri Oct 6 03:03:49 2023","interfaces":[{"interface":"back","average":{"1min":1.4299999999999999,"5min":1.5449999999999999,"15min":1.605},"min":{"1min":1.073,"5min":1.0369999999999999,"15min":1.0369999999999999},"max":{"1min":1.9330000000000001,"5min":2.96,"15min":2.96},"last":1.4650000000000001},{"interface":"front","average":{"1min":1.4950000000000001,"5min":1.6579999999999999,"15min":1.734},"min":{"1min":1.1419999999999999,"5min":0.90600000000000003,"15min":0.90600000000000003},"max":{"1min":1.9810000000000001,"5min":3.8559999999999999,"15min":3.8559999999999999},"last":1.702}]}]},{"osd":2,"up_from":13,"seq":55834574890,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302076,"kb_used_data":692,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069764,"statfs":{"total":96636764160,"available":96327438336,"internally_reserved":0,"allocated":708608,"data_stored":312809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:03:50 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.86099999999999999,"15min":0.86799999999999999},"min":{"1min":0.54500000000000004,"5min":0.496,"15min":0.496},"max":{"1min":1.2290000000000001,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":0.753},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.91700000000000004,"15min":0.93799999999999994},"min":{"1min":0.61799999999999999,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.3340000000000001,"5min":1.502,"15min":1.502},"last":0.874}]},{"osd":1,"last update":"Fri Oct 6 03:03:50 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.075,"15min":1.087},"min":{"1min":0.64700000000000002,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.1899999999999999,"15min":1.218},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.484,"5min":2.1800000000000002,"15min":2.1800000000000002},"last":0.76500000000000001}]},{"osd":3,"last update":"Fri Oct 6 03:03:50 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.94599999999999995,"15min":0.96199999999999997},"min":{"1min":0.63100000000000001,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.2430000000000001,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.66500000000000004},{"interface":"front","average":{"1min":1.125,"5min":1.147,"15min":1.1719999999999999},"min":{"1min":0.73699999999999999,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.5289999999999999,"5min":2.806,"15min":2.806},"last":0.91800000000000004}]},{"osd":4,"last update":"Fri Oct 6 03:03:50 2023","interfaces":[{"interface":"back","average":{"1min":1.266,"5min":1.339,"15min":1.3720000000000001},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.7090000000000001,"5min":2.1739999999999999,"15min":2.1739999999999999},"last":1.0309999999999999},{"interface":"front","average":{"1min":1.242,"5min":1.3779999999999999,"15min":1.431},"min":{"1min":0.996,"5min":0.83699999999999997,"15min":0.83699999999999997},"max":{"1min":1.5429999999999999,"5min":3.028,"15min":3.028},"last":0.96399999999999997}]},{"osd":5,"last update":"Fri Oct 6 03:03:50 2023","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.4650000000000001,"15min":1.5209999999999999},"min":{"1min":1.1000000000000001,"5min":0.90100000000000002,"15min":0.90100000000000002},"max":{"1min":1.5469999999999999,"5min":3.1499999999999999,"15min":3.1499999999999999},"last":1.2969999999999999},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.4259999999999999,"15min":1.4830000000000001},"min":{"1min":0.95599999999999996,"5min":0.85899999999999999,"15min":0.85899999999999999},"max":{"1min":1.704,"5min":2.8580000000000001,"15min":2.8580000000000001},"last":1.157}]},{"osd":6,"last update":"Fri Oct 6 03:03:50 2023","interfaces":[{"interface":"back","average":{"1min":1.2789999999999999,"5min":1.397,"15min":1.45},"min":{"1min":0.91900000000000004,"5min":0.86299999999999999,"15min":0.86299999999999999},"max":{"1min":1.829,"5min":2.6659999999999999,"15min":2.6659999999999999},"last":0.83899999999999997},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.4490000000000001,"15min":1.4970000000000001},"min":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"max":{"1min":1.6759999999999999,"5min":2.411,"15min":2.411},"last":0.98199999999999998}]},{"osd":7,"last update":"Fri Oct 6 03:03:50 2023","interfaces":[{"interface":"back","average":{"1min":1.3759999999999999,"5min":1.544,"15min":1.6040000000000001},"min":{"1min":1.0880000000000001,"5min":1.01,"15min":1.01},"max":{"1min":1.579,"5min":3.2160000000000002,"15min":3.2160000000000002},"last":1.21},{"interface":"front","average":{"1min":1.3979999999999999,"5min":1.5369999999999999,"15min":1.599},"min":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"max":{"1min":1.8879999999999999,"5min":3.1059999999999999,"15min":3.1059999999999999},"last":0.93300000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574891,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302076,"kb_used_data":692,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069764,"statfs":{"total":96636764160,"available":96327438336,"internally_reserved":0,"allocated":708608,"data_stored":312809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:03:48 2023","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":0.93700000000000006,"15min":0.94899999999999995},"min":{"1min":0.57799999999999996,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.3759999999999999,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":0.72999999999999998},{"interface":"front","average":{"1min":1.113,"5min":1.0860000000000001,"15min":1.091},"min":{"1min":0.71499999999999997,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.4690000000000001,"5min":2.3260000000000001,"15min":2.3260000000000001},"last":0.90200000000000002}]},{"osd":2,"last update":"Fri Oct 6 03:03:48 2023","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.98099999999999998,"15min":0.995},"min":{"1min":0.77500000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.27,"5min":3.5459999999999998,"15min":3.5459999999999998},"last":0.94499999999999995},{"interface":"front","average":{"1min":1.165,"5min":1.042,"15min":1.03},"min":{"1min":0.76400000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.5820000000000001,"5min":1.706,"15min":1.706},"last":1.0720000000000001}]},{"osd":3,"last update":"Fri Oct 6 03:03:48 2023","interfaces":[{"interface":"back","average":{"1min":1.218,"5min":1.1539999999999999,"15min":1.1459999999999999},"min":{"1min":0.71299999999999997,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.5760000000000001,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":0.96799999999999997},{"interface":"front","average":{"1min":1.151,"5min":1.167,"15min":1.1859999999999999},"min":{"1min":0.93300000000000005,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.4730000000000001,"5min":3.331,"15min":3.331},"last":1.105}]},{"osd":4,"last update":"Fri Oct 6 03:03:48 2023","interfaces":[{"interface":"back","average":{"1min":1.3080000000000001,"5min":1.3089999999999999,"15min":1.329},"min":{"1min":1.048,"5min":0.85899999999999999,"15min":0.85899999999999999},"max":{"1min":1.5640000000000001,"5min":2.0169999999999999,"15min":2.0169999999999999},"last":1.268},{"interface":"front","average":{"1min":1.238,"5min":1.298,"15min":1.3180000000000001},"min":{"1min":0.90900000000000003,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.639,"5min":3.2250000000000001,"15min":3.2250000000000001},"last":1.159}]},{"osd":5,"last update":"Fri Oct 6 03:03:48 2023","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":1.389,"15min":1.421},"min":{"1min":0.96599999999999997,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":1.704,"5min":2.8439999999999999,"15min":2.8439999999999999},"last":1.4370000000000001},{"interface":"front","average":{"1min":1.4470000000000001,"5min":1.4510000000000001,"15min":1.4730000000000001},"min":{"1min":1.0980000000000001,"5min":0.89800000000000002,"15min":0.89800000000000002},"max":{"1min":1.7390000000000001,"5min":2.4590000000000001,"15min":2.4590000000000001},"last":1.52}]},{"osd":6,"last update":"Fri Oct 6 03:03:48 2023","interfaces":[{"interface":"back","average":{"1min":1.3500000000000001,"5min":1.427,"15min":1.4530000000000001},"min":{"1min":0.89400000000000002,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.76,"5min":2.96,"15min":2.96},"last":1.5449999999999999},{"interface":"front","average":{"1min":1.472,"5min":1.474,"15min":1.494},"min":{"1min":1.0149999999999999,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.8080000000000001,"5min":2.5859999999999999,"15min":2.5859999999999999},"last":1.47}]},{"osd":7,"last update":"Fri Oct 6 03:03:48 2023","interfaces":[{"interface":"back","average":{"1min":1.415,"5min":1.512,"15min":1.573},"min":{"1min":1.1459999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":2.1299999999999999,"5min":3.4460000000000002,"15min":3.4460000000000002},"last":1.2130000000000001},{"interface":"front","average":{"1min":1.458,"5min":1.5,"15min":1.5249999999999999},"min":{"1min":1.212,"5min":0.94099999999999995,"15min":0.94099999999999995},"max":{"1min":1.734,"5min":3.113,"15min":3.113},"last":1.635}]}]},{"osd":0,"up_from":13,"seq":55834574890,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302656,"kb_used_data":1272,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069184,"statfs":{"total":96636764160,"available":96326844416,"internally_reserved":0,"allocated":1302528,"data_stored":903177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 03:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.85099999999999998,"15min":0.82399999999999995},"min":{"1min":0.66700000000000004,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.2490000000000001,"5min":1.583,"15min":1.583},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.97799999999999998,"15min":0.99199999999999999},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.571,"5min":1.571,"15min":1.571},"last":1.3200000000000001}]},{"osd":2,"last update":"Fri Oct 6 03:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.98599999999999999,"15min":0.98399999999999999},"min":{"1min":0.71799999999999997,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.3220000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":1.085},{"interface":"front","average":{"1min":0.998,"5min":1.089,"15min":1.1120000000000001},"min":{"1min":0.76100000000000001,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.2949999999999999,"5min":1.794,"15min":1.794},"last":1.5760000000000001}]},{"osd":3,"last update":"Fri Oct 6 03:03:46 2023","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":1.0349999999999999,"15min":1.018},"min":{"1min":0.70799999999999996,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.554,"5min":1.554,"15min":1.554},"last":0.90400000000000003},{"interface":"front","average":{"1min":1.298,"5min":1.226,"15min":1.2030000000000001},"min":{"1min":1.004,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.569,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.96199999999999997}]},{"osd":4,"last update":"Fri Oct 6 03:03:46 2023","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.244,"15min":1.2310000000000001},"min":{"1min":0.88400000000000001,"5min":0.86699999999999999,"15min":0.86699999999999999},"max":{"1min":1.5669999999999999,"5min":2.0680000000000001,"15min":2.0680000000000001},"last":1.2749999999999999},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.3300000000000001,"15min":1.3360000000000001},"min":{"1min":1.0409999999999999,"5min":0.93400000000000005,"15min":0.93400000000000005},"max":{"1min":1.5800000000000001,"5min":1.647,"15min":1.647},"last":1.373}]},{"osd":5,"last update":"Fri Oct 6 03:03:46 2023","interfaces":[{"interface":"back","average":{"1min":1.256,"5min":1.379,"15min":1.4019999999999999},"min":{"1min":0.92500000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":1.728,"5min":1.8959999999999999,"15min":1.8959999999999999},"last":1.1890000000000001},{"interface":"front","average":{"1min":1.359,"5min":1.2909999999999999,"15min":1.2729999999999999},"min":{"1min":1.0449999999999999,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":1.6160000000000001,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":1.405}]},{"osd":6,"last update":"Fri Oct 6 03:03:46 2023","interfaces":[{"interface":"back","average":{"1min":1.373,"5min":1.4199999999999999,"15min":1.4199999999999999},"min":{"1min":1.1459999999999999,"5min":0.89400000000000002,"15min":0.89400000000000002},"max":{"1min":1.7090000000000001,"5min":1.96,"15min":1.96},"last":1.2290000000000001},{"interface":"front","average":{"1min":1.389,"5min":1.4930000000000001,"15min":1.532},"min":{"1min":1.117,"5min":0.89800000000000002,"15min":0.89800000000000002},"max":{"1min":1.859,"5min":2.0539999999999998,"15min":2.0539999999999998},"last":1.641}]},{"osd":7,"last update":"Fri Oct 6 03:03:46 2023","interfaces":[{"interface":"back","average":{"1min":1.4039999999999999,"5min":1.5569999999999999,"15min":1.607},"min":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"max":{"1min":1.7989999999999999,"5min":2.1019999999999999,"15min":2.1019999999999999},"last":1.4430000000000001},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.413,"15min":1.425},"min":{"1min":1.091,"5min":0.875,"15min":0.875},"max":{"1min":1.681,"5min":2.1499999999999999,"15min":2.1499999999999999},"last":1.5269999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:04:07.346 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-10-06T03:00:44.625353+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=0, tm_sec=44, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=4, tm_sec=0, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:04:07.347 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-06T03:00:50.863151+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=0, tm_sec=50, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=4, tm_sec=0, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:04:07.347 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-10-06T03:00:50.863151+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=0, tm_sec=50, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=4, tm_sec=0, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:04:07.347 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-10-06T03:00:50.863151+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=0, tm_sec=50, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=4, tm_sec=0, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:04:07.347 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-10-06T03:00:50.863151+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=0, tm_sec=50, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=4, tm_sec=0, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:04:07.347 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-06T03:00:50.863151+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=0, tm_sec=50, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=4, tm_sec=0, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:04:07.347 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-06T03:00:50.863151+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=0, tm_sec=50, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=4, tm_sec=0, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:04:07.347 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-06T03:00:50.863151+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=0, tm_sec=50, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=4, tm_sec=0, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:04:07.348 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-06T03:00:50.863151+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=0, tm_sec=50, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=4, tm_sec=0, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:04:07.348 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-06T03:04:18.472 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:04:18.480 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:04:27.349 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:04:27.520 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.516+0000 7f6e29f63700 1 Processor -- start 2023-10-06T03:04:27.520 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.516+0000 7f6e29f63700 1 -- start start 2023-10-06T03:04:27.522 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.516+0000 7f6e29f63700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6e2406d400 0x7f6e2415dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:27.522 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.516+0000 7f6e29f63700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6e2415e1f0 0x7f6e241605d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:27.522 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.516+0000 7f6e29f63700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e2406b4a0 con 0x7f6e2406c920 2023-10-06T03:04:27.522 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.516+0000 7f6e29f63700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e240af9d0 con 0x7f6e2406d400 2023-10-06T03:04:27.522 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.516+0000 7f6e29f63700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e2406a890 con 0x7f6e2415e1f0 2023-10-06T03:04:27.523 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.516+0000 7f6e23fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6e2406d400 0x7f6e2415dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:27.523 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.516+0000 7f6e23fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6e2406d400 0x7f6e2415dcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34042/0 (socket says 172.21.15.57:34042) 2023-10-06T03:04:27.523 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.516+0000 7f6e23fff700 1 -- 172.21.15.57:0/657824882 learned_addr learned my addr 172.21.15.57:0/657824882 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:04:27.523 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.520+0000 7f6e29762700 1 --2- 172.21.15.57:0/657824882 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6e2415e1f0 0x7f6e241605d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:27.523 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.520+0000 7f6e23fff700 1 -- 172.21.15.57:0/657824882 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6e2415e1f0 msgr2=0x7f6e241605d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:27.523 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.520+0000 7f6e23fff700 1 --2- 172.21.15.57:0/657824882 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6e2415e1f0 0x7f6e241605d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:27.523 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.520+0000 7f6e23fff700 1 -- 172.21.15.57:0/657824882 >> v1:172.21.15.105:6789/0 conn(0x7f6e2406c920 legacy=0x7f6e2406ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:27.524 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.520+0000 7f6e23fff700 1 -- 172.21.15.57:0/657824882 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e2406ab70 con 0x7f6e2406d400 2023-10-06T03:04:27.524 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.520+0000 7f6e23fff700 1 --2- 172.21.15.57:0/657824882 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6e2406d400 0x7f6e2415dcb0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f6e100099b0 tx=0x7f6e10009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5060d08c46b58729 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:27.524 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.520+0000 7f6e237fe700 1 -- 172.21.15.57:0/657824882 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e1000b860 con 0x7f6e2406d400 2023-10-06T03:04:27.524 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.520+0000 7f6e237fe700 1 -- 172.21.15.57:0/657824882 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e1000b9c0 con 0x7f6e2406d400 2023-10-06T03:04:27.524 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.520+0000 7f6e237fe700 1 -- 172.21.15.57:0/657824882 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e1000bd60 con 0x7f6e2406d400 2023-10-06T03:04:27.525 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.520+0000 7f6e29f63700 1 -- 172.21.15.57:0/657824882 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6e2406d400 msgr2=0x7f6e2415dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:27.525 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.520+0000 7f6e29f63700 1 --2- 172.21.15.57:0/657824882 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6e2406d400 0x7f6e2415dcb0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f6e100099b0 tx=0x7f6e10009250 comp rx=0 tx=0).stop 2023-10-06T03:04:27.525 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.520+0000 7f6e29f63700 1 -- 172.21.15.57:0/657824882 shutdown_connections 2023-10-06T03:04:27.525 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.520+0000 7f6e29f63700 1 --2- 172.21.15.57:0/657824882 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6e2415e1f0 0x7f6e241605d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:27.526 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.520+0000 7f6e29f63700 1 --2- 172.21.15.57:0/657824882 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6e2406d400 0x7f6e2415dcb0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:27.526 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.520+0000 7f6e29f63700 1 -- 172.21.15.57:0/657824882 >> 172.21.15.57:0/657824882 conn(0x7f6e240c85e0 msgr2=0x7f6e240c89e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:27.526 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.520+0000 7f6e29f63700 1 -- 172.21.15.57:0/657824882 shutdown_connections 2023-10-06T03:04:27.526 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.520+0000 7f6e29f63700 1 -- 172.21.15.57:0/657824882 wait complete. 2023-10-06T03:04:27.528 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.524+0000 7f6e29f63700 1 Processor -- start 2023-10-06T03:04:27.528 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.524+0000 7f6e29f63700 1 -- start start 2023-10-06T03:04:27.531 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.528+0000 7f6e29f63700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6e2406c920 0x7f6e241529d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:27.531 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.528+0000 7f6e29f63700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6e2406d400 0x7f6e24155560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:27.531 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.528+0000 7f6e29f63700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6e2415e1f0 0x7f6e240c2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:27.531 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.528+0000 7f6e29f63700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e24156020 con 0x7f6e2415e1f0 2023-10-06T03:04:27.531 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.528+0000 7f6e29f63700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e2415b580 con 0x7f6e2406c920 2023-10-06T03:04:27.531 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.528+0000 7f6e29f63700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e2415b860 con 0x7f6e2406d400 2023-10-06T03:04:27.531 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.528+0000 7f6e29762700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6e2415e1f0 0x7f6e240c2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:27.532 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.528+0000 7f6e29762700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6e2415e1f0 0x7f6e240c2b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34058/0 (socket says 172.21.15.57:34058) 2023-10-06T03:04:27.532 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.528+0000 7f6e29762700 1 -- 172.21.15.57:0/1624472229 learned_addr learned my addr 172.21.15.57:0/1624472229 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:04:27.532 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.528+0000 7f6e23fff700 1 --2- 172.21.15.57:0/1624472229 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6e2406d400 0x7f6e24155560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:27.532 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.528+0000 7f6e28f61700 1 --2- 172.21.15.57:0/1624472229 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6e2406c920 0x7f6e241529d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:27.533 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.528+0000 7f6e29762700 1 -- 172.21.15.57:0/1624472229 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6e2406d400 msgr2=0x7f6e24155560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:27.533 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.528+0000 7f6e29762700 1 --2- 172.21.15.57:0/1624472229 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6e2406d400 0x7f6e24155560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:27.533 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.528+0000 7f6e29762700 1 -- 172.21.15.57:0/1624472229 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6e2406c920 msgr2=0x7f6e241529d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:27.533 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.528+0000 7f6e29762700 1 --2- 172.21.15.57:0/1624472229 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6e2406c920 0x7f6e241529d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:27.533 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.528+0000 7f6e29762700 1 -- 172.21.15.57:0/1624472229 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e100094f0 con 0x7f6e2415e1f0 2023-10-06T03:04:27.533 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.528+0000 7f6e29762700 1 --2- 172.21.15.57:0/1624472229 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6e2415e1f0 0x7f6e240c2b80 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c007f20 tx=0x7f6e1c009800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:27.534 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.528+0000 7f6e20ff9700 1 -- 172.21.15.57:0/1624472229 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e1c00eb90 con 0x7f6e2415e1f0 2023-10-06T03:04:27.534 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.528+0000 7f6e20ff9700 1 -- 172.21.15.57:0/1624472229 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e1c00ed10 con 0x7f6e2415e1f0 2023-10-06T03:04:27.534 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.528+0000 7f6e20ff9700 1 -- 172.21.15.57:0/1624472229 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e1c014670 con 0x7f6e2415e1f0 2023-10-06T03:04:27.534 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.528+0000 7f6e29f63700 1 -- 172.21.15.57:0/1624472229 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e2415bb40 con 0x7f6e2415e1f0 2023-10-06T03:04:27.534 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.528+0000 7f6e29f63700 1 -- 172.21.15.57:0/1624472229 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e24154870 con 0x7f6e2415e1f0 2023-10-06T03:04:27.534 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.532+0000 7f6e29f63700 1 -- 172.21.15.57:0/1624472229 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e2415c040 con 0x7f6e2415e1f0 2023-10-06T03:04:27.537 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.532+0000 7f6e20ff9700 1 -- 172.21.15.57:0/1624472229 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f6e1c014a20 con 0x7f6e2415e1f0 2023-10-06T03:04:27.538 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.532+0000 7f6e20ff9700 1 --2- 172.21.15.57:0/1624472229 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f6e08060550 0x7f6e08062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:27.538 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.532+0000 7f6e20ff9700 1 -- 172.21.15.57:0/1624472229 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5378+0+0 (secure 0 0 0) 0x7f6e1c07cd00 con 0x7f6e2415e1f0 2023-10-06T03:04:27.538 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.536+0000 7f6e28f61700 1 --2- 172.21.15.57:0/1624472229 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f6e08060550 0x7f6e08062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:27.540 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.536+0000 7f6e28f61700 1 --2- 172.21.15.57:0/1624472229 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f6e08060550 0x7f6e08062a00 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f6e18003860 tx=0x7f6e18009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:27.546 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.544+0000 7f6e20ff9700 1 -- 172.21.15.57:0/1624472229 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f6e1c04d430 con 0x7f6e2415e1f0 2023-10-06T03:04:27.714 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.708+0000 7f6e29f63700 1 -- 172.21.15.57:0/1624472229 --> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6e2404be40 con 0x7f6e08060550 2023-10-06T03:04:27.717 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.712+0000 7f6e20ff9700 1 -- 172.21.15.57:0/1624472229 <== mgr.4103 v2:172.21.15.57:6832/32947 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+70179 (secure 0 0 0) 0x7f6e2404be40 con 0x7f6e08060550 2023-10-06T03:04:27.719 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:04:27.720 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.716+0000 7f6e29f63700 1 -- 172.21.15.57:0/1624472229 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f6e08060550 msgr2=0x7f6e08062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:27.720 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.716+0000 7f6e29f63700 1 --2- 172.21.15.57:0/1624472229 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f6e08060550 0x7f6e08062a00 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f6e18003860 tx=0x7f6e18009040 comp rx=0 tx=0).stop 2023-10-06T03:04:27.721 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.716+0000 7f6e29f63700 1 -- 172.21.15.57:0/1624472229 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6e2415e1f0 msgr2=0x7f6e240c2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:27.721 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.716+0000 7f6e29f63700 1 --2- 172.21.15.57:0/1624472229 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6e2415e1f0 0x7f6e240c2b80 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c007f20 tx=0x7f6e1c009800 comp rx=0 tx=0).stop 2023-10-06T03:04:27.721 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.716+0000 7f6e29f63700 1 -- 172.21.15.57:0/1624472229 shutdown_connections 2023-10-06T03:04:27.721 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.716+0000 7f6e29f63700 1 --2- 172.21.15.57:0/1624472229 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6e2415e1f0 0x7f6e240c2b80 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:27.721 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.716+0000 7f6e29f63700 1 --2- 172.21.15.57:0/1624472229 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f6e08060550 0x7f6e08062a00 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:27.721 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.716+0000 7f6e29f63700 1 --2- 172.21.15.57:0/1624472229 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6e2406d400 0x7f6e24155560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:27.721 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.716+0000 7f6e29f63700 1 --2- 172.21.15.57:0/1624472229 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6e2406c920 0x7f6e241529d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:27.721 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.716+0000 7f6e29f63700 1 -- 172.21.15.57:0/1624472229 >> 172.21.15.57:0/1624472229 conn(0x7f6e240c85e0 msgr2=0x7f6e240c9f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:27.722 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.716+0000 7f6e29f63700 1 -- 172.21.15.57:0/1624472229 shutdown_connections 2023-10-06T03:04:27.722 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.716+0000 7f6e29f63700 1 -- 172.21.15.57:0/1624472229 wait complete. 2023-10-06T03:04:27.723 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2023-10-06T03:04:27.741 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":163,"stamp":"2023-10-06T03:04:26.342681+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2409576,"kb_used_data":6696,"kb_used_omap":0,"kb_used_meta":2402816,"kb_avail":752565144,"statfs":{"total":773094113280,"available":770626707456,"internally_reserved":0,"allocated":6856704,"data_stored":3683208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2460483584},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003464"},"pg_stats":[{"pgid":"1.0","version":"59'119","reported_seq":206,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-10-06T03:04:09.875255+0000","last_change":"2023-10-06T03:04:09.875212+0000","last_active":"2023-10-06T03:04:09.875255+0000","last_peered":"2023-10-06T03:04:09.875255+0000","last_clean":"2023-10-06T03:04:09.875255+0000","last_became_active":"2023-10-06T03:00:45.707771+0000","last_became_peered":"2023-10-06T03:00:45.707771+0000","last_unstale":"2023-10-06T03:04:09.875255+0000","last_undegraded":"2023-10-06T03:04:09.875255+0000","last_fullsized":"2023-10-06T03:04:09.875255+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'119","last_scrub_stamp":"2023-10-06T03:04:09.875102+0000","last_deep_scrub":"59'119","last_deep_scrub_stamp":"2023-10-06T03:04:09.875102+0000","last_clean_scrub_stamp":"2023-10-06T03:04:09.875102+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:46:52.079128+0000","scrub_duration":0.017788447999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":52,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-10-06T03:04:11.754108+0000","last_change":"2023-10-06T03:04:11.754060+0000","last_active":"2023-10-06T03:04:11.754108+0000","last_peered":"2023-10-06T03:04:11.754108+0000","last_clean":"2023-10-06T03:04:11.754108+0000","last_became_active":"2023-10-06T03:00:51.904974+0000","last_became_peered":"2023-10-06T03:00:51.904974+0000","last_unstale":"2023-10-06T03:04:11.754108+0000","last_undegraded":"2023-10-06T03:04:11.754108+0000","last_fullsized":"2023-10-06T03:04:11.754108+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:11.753927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:11.753927+0000","last_clean_scrub_stamp":"2023-10-06T03:04:11.753927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:17:07.304755+0000","scrub_duration":0.0040591969999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":51,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-10-06T03:04:10.904064+0000","last_change":"2023-10-06T03:04:10.904002+0000","last_active":"2023-10-06T03:04:10.904064+0000","last_peered":"2023-10-06T03:04:10.904064+0000","last_clean":"2023-10-06T03:04:10.904064+0000","last_became_active":"2023-10-06T03:00:51.905956+0000","last_became_peered":"2023-10-06T03:00:51.905956+0000","last_unstale":"2023-10-06T03:04:10.904064+0000","last_undegraded":"2023-10-06T03:04:10.904064+0000","last_fullsized":"2023-10-06T03:04:10.904064+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:10.903780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:10.903780+0000","last_clean_scrub_stamp":"2023-10-06T03:04:10.903780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:50:56.522709+0000","scrub_duration":0.0046523889999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":52,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-10-06T03:04:12.818016+0000","last_change":"2023-10-06T03:04:12.817960+0000","last_active":"2023-10-06T03:04:12.818016+0000","last_peered":"2023-10-06T03:04:12.818016+0000","last_clean":"2023-10-06T03:04:12.818016+0000","last_became_active":"2023-10-06T03:00:51.901948+0000","last_became_peered":"2023-10-06T03:00:51.901948+0000","last_unstale":"2023-10-06T03:04:12.818016+0000","last_undegraded":"2023-10-06T03:04:12.818016+0000","last_fullsized":"2023-10-06T03:04:12.818016+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:12.817782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:12.817782+0000","last_clean_scrub_stamp":"2023-10-06T03:04:12.817782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:52:46.283917+0000","scrub_duration":0.0040120499999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":52,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-10-06T03:04:10.730845+0000","last_change":"2023-10-06T03:04:10.730739+0000","last_active":"2023-10-06T03:04:10.730845+0000","last_peered":"2023-10-06T03:04:10.730845+0000","last_clean":"2023-10-06T03:04:10.730845+0000","last_became_active":"2023-10-06T03:00:51.903729+0000","last_became_peered":"2023-10-06T03:00:51.903729+0000","last_unstale":"2023-10-06T03:04:10.730845+0000","last_undegraded":"2023-10-06T03:04:10.730845+0000","last_fullsized":"2023-10-06T03:04:10.730845+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:10.730524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:10.730524+0000","last_clean_scrub_stamp":"2023-10-06T03:04:10.730524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:50:56.349452+0000","scrub_duration":0.0047019979999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":50,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-10-06T03:04:05.472666+0000","last_change":"2023-10-06T03:04:05.472630+0000","last_active":"2023-10-06T03:04:05.472666+0000","last_peered":"2023-10-06T03:04:05.472666+0000","last_clean":"2023-10-06T03:04:05.472666+0000","last_became_active":"2023-10-06T03:00:52.483818+0000","last_became_peered":"2023-10-06T03:00:52.483818+0000","last_unstale":"2023-10-06T03:04:05.472666+0000","last_undegraded":"2023-10-06T03:04:05.472666+0000","last_fullsized":"2023-10-06T03:04:05.472666+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:05.472519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:05.472519+0000","last_clean_scrub_stamp":"2023-10-06T03:04:05.472519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:13:20.811826+0000","scrub_duration":0.0029379079999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":51,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-10-06T03:04:11.949562+0000","last_change":"2023-10-06T03:04:11.949480+0000","last_active":"2023-10-06T03:04:11.949562+0000","last_peered":"2023-10-06T03:04:11.949562+0000","last_clean":"2023-10-06T03:04:11.949562+0000","last_became_active":"2023-10-06T03:00:52.484615+0000","last_became_peered":"2023-10-06T03:00:52.484615+0000","last_unstale":"2023-10-06T03:04:11.949562+0000","last_undegraded":"2023-10-06T03:04:11.949562+0000","last_fullsized":"2023-10-06T03:04:11.949562+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:11.949258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:11.949258+0000","last_clean_scrub_stamp":"2023-10-06T03:04:11.949258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:39:31.034301+0000","scrub_duration":0.004492574,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":50,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-10-06T03:04:10.516861+0000","last_change":"2023-10-06T03:04:10.516764+0000","last_active":"2023-10-06T03:04:10.516861+0000","last_peered":"2023-10-06T03:04:10.516861+0000","last_clean":"2023-10-06T03:04:10.516861+0000","last_became_active":"2023-10-06T03:00:51.902959+0000","last_became_peered":"2023-10-06T03:00:51.902959+0000","last_unstale":"2023-10-06T03:04:10.516861+0000","last_undegraded":"2023-10-06T03:04:10.516861+0000","last_fullsized":"2023-10-06T03:04:10.516861+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:10.516526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:10.516526+0000","last_clean_scrub_stamp":"2023-10-06T03:04:10.516526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:46:52.720552+0000","scrub_duration":0.0043779659999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":50,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-10-06T03:04:08.273471+0000","last_change":"2023-10-06T03:04:08.273426+0000","last_active":"2023-10-06T03:04:08.273471+0000","last_peered":"2023-10-06T03:04:08.273471+0000","last_clean":"2023-10-06T03:04:08.273471+0000","last_became_active":"2023-10-06T03:00:51.902929+0000","last_became_peered":"2023-10-06T03:00:51.902929+0000","last_unstale":"2023-10-06T03:04:08.273471+0000","last_undegraded":"2023-10-06T03:04:08.273471+0000","last_fullsized":"2023-10-06T03:04:08.273471+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:08.273263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:08.273263+0000","last_clean_scrub_stamp":"2023-10-06T03:04:08.273263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:23:14.107575+0000","scrub_duration":0.004745867,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574895,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302656,"kb_used_data":1272,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069184,"statfs":{"total":96636764160,"available":96326844416,"internally_reserved":0,"allocated":1302528,"data_stored":903177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:03:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.2270000000000001,"15min":1.3009999999999999},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.415,"5min":4.7930000000000001,"15min":4.7930000000000001},"last":1.095},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.4099999999999999,"15min":1.522},"min":{"1min":0.86399999999999999,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.476,"5min":9.9689999999999994,"15min":9.9689999999999994},"last":0.98899999999999999}]},{"osd":1,"last update":"Fri Oct 6 03:03:45 2023","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.3680000000000001,"15min":1.4710000000000001},"min":{"1min":0.95799999999999996,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.454,"5min":10.867000000000001,"15min":10.867000000000001},"last":0.90800000000000003},{"interface":"front","average":{"1min":1.3049999999999999,"5min":1.5169999999999999,"15min":1.6240000000000001},"min":{"1min":0.89100000000000001,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":1.599,"5min":10.255000000000001,"15min":10.255000000000001},"last":1.264}]},{"osd":2,"last update":"Fri Oct 6 03:03:45 2023","interfaces":[{"interface":"back","average":{"1min":1.3300000000000001,"5min":1.5149999999999999,"15min":1.625},"min":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"max":{"1min":1.6830000000000001,"5min":7.9939999999999998,"15min":7.9939999999999998},"last":1.369},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.552,"15min":1.6479999999999999},"min":{"1min":1.133,"5min":0.84899999999999998,"15min":0.84899999999999998},"max":{"1min":1.673,"5min":10.098000000000001,"15min":10.098000000000001},"last":1.4019999999999999}]},{"osd":3,"last update":"Fri Oct 6 03:03:45 2023","interfaces":[{"interface":"back","average":{"1min":1.4099999999999999,"5min":1.4419999999999999,"15min":1.49},"min":{"1min":1.018,"5min":0.754,"15min":0.754},"max":{"1min":2.069,"5min":4.3090000000000002,"15min":4.3090000000000002},"last":1.4490000000000001},{"interface":"front","average":{"1min":1.4179999999999999,"5min":1.542,"15min":1.6080000000000001},"min":{"1min":1.1160000000000001,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":1.7589999999999999,"5min":8.3770000000000007,"15min":8.3770000000000007},"last":1.54}]},{"osd":4,"last update":"Fri Oct 6 03:03:45 2023","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":1.5389999999999999,"15min":1.7050000000000001},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.8460000000000001,"5min":11.391999999999999,"15min":11.391999999999999},"last":0.79500000000000004},{"interface":"front","average":{"1min":1.268,"5min":1.399,"15min":1.456},"min":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"max":{"1min":1.857,"5min":3.9220000000000002,"15min":3.9220000000000002},"last":1.2969999999999999}]},{"osd":5,"last update":"Fri Oct 6 03:03:45 2023","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.581,"15min":1.724},"min":{"1min":0.91200000000000003,"5min":0.89400000000000002,"15min":0.89400000000000002},"max":{"1min":2.004,"5min":11.951000000000001,"15min":11.951000000000001},"last":1.224},{"interface":"front","average":{"1min":1.359,"5min":1.6890000000000001,"15min":1.847},"min":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"max":{"1min":1.764,"5min":10.994999999999999,"15min":10.994999999999999},"last":1.333}]},{"osd":6,"last update":"Fri Oct 6 03:03:45 2023","interfaces":[{"interface":"back","average":{"1min":1.5009999999999999,"5min":1.7729999999999999,"15min":1.917},"min":{"1min":1.143,"5min":0.91300000000000003,"15min":0.91300000000000003},"max":{"1min":1.9510000000000001,"5min":11.513,"15min":11.513},"last":1.1799999999999999},{"interface":"front","average":{"1min":1.448,"5min":1.7290000000000001,"15min":1.881},"min":{"1min":1.024,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":2.1819999999999999,"5min":10.714,"15min":10.714},"last":1.5029999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574895,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297980,"kb_used_data":692,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073860,"statfs":{"total":96636764160,"available":96331632640,"internally_reserved":0,"allocated":708608,"data_stored":312809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:03:45 2023","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.1890000000000001,"15min":1.1930000000000001},"min":{"1min":0.78400000000000003,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.704,"5min":1.704,"15min":1.704},"last":1.484},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.345,"15min":1.361},"min":{"1min":1.0449999999999999,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.7270000000000001,"5min":2.1419999999999999,"15min":2.1419999999999999},"last":1.4319999999999999}]},{"osd":1,"last update":"Fri Oct 6 03:03:45 2023","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.2829999999999999,"15min":1.3049999999999999},"min":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.671,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":1.3620000000000001},{"interface":"front","average":{"1min":1.2669999999999999,"5min":1.2509999999999999,"15min":1.254},"min":{"1min":0.90400000000000003,"5min":0.746,"15min":0.746},"max":{"1min":1.756,"5min":1.774,"15min":1.774},"last":1.2609999999999999}]},{"osd":2,"last update":"Fri Oct 6 03:03:45 2023","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.169,"15min":1.167},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.8220000000000001,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":1.1479999999999999},{"interface":"front","average":{"1min":1.198,"5min":1.2150000000000001,"15min":1.2290000000000001},"min":{"1min":0.93999999999999995,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.595,"5min":1.78,"15min":1.78},"last":1.4610000000000001}]},{"osd":3,"last update":"Fri Oct 6 03:03:45 2023","interfaces":[{"interface":"back","average":{"1min":1.2749999999999999,"5min":1.274,"15min":1.28},"min":{"1min":1.004,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.488,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":1.1739999999999999},{"interface":"front","average":{"1min":1.3580000000000001,"5min":1.3220000000000001,"15min":1.3360000000000001},"min":{"1min":1.111,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.5700000000000001,"5min":2.2200000000000002,"15min":2.2200000000000002},"last":1.218}]},{"osd":4,"last update":"Fri Oct 6 03:03:45 2023","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":1.248,"15min":1.2729999999999999},"min":{"1min":0.77700000000000002,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.5840000000000001,"5min":2.0960000000000001,"15min":2.0960000000000001},"last":1.1080000000000001},{"interface":"front","average":{"1min":1.175,"5min":1.3500000000000001,"15min":1.399},"min":{"1min":0.89200000000000002,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.4370000000000001,"5min":2.2610000000000001,"15min":2.2610000000000001},"last":1.052}]},{"osd":5,"last update":"Fri Oct 6 03:03:45 2023","interfaces":[{"interface":"back","average":{"1min":1.306,"5min":1.333,"15min":1.359},"min":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":1.7829999999999999,"5min":1.994,"15min":1.994},"last":1.0089999999999999},{"interface":"front","average":{"1min":1.294,"5min":1.3380000000000001,"15min":1.3720000000000001},"min":{"1min":0.89200000000000002,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.609,"5min":2.0129999999999999,"15min":2.0129999999999999},"last":1.3979999999999999}]},{"osd":7,"last update":"Fri Oct 6 03:03:45 2023","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.425,"15min":1.4590000000000001},"min":{"1min":1.085,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.661,"5min":2.0920000000000001,"15min":2.0920000000000001},"last":1.331},{"interface":"front","average":{"1min":1.448,"5min":1.492,"15min":1.528},"min":{"1min":0.93100000000000005,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":1.8720000000000001,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":1.2949999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574895,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297980,"kb_used_data":692,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073860,"statfs":{"total":96636764160,"available":96331632640,"internally_reserved":0,"allocated":708608,"data_stored":312809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:03:50 2023","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.0169999999999999,"15min":0.97299999999999998},"min":{"1min":0.82299999999999995,"5min":0.62,"15min":0.62},"max":{"1min":1.391,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":1.107},{"interface":"front","average":{"1min":1.153,"5min":1.0680000000000001,"15min":1.046},"min":{"1min":0.78500000000000003,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.5189999999999999,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":1.073}]},{"osd":1,"last update":"Fri Oct 6 03:03:50 2023","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.222,"15min":1.212},"min":{"1min":0.89400000000000002,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":1.6879999999999999,"5min":1.984,"15min":1.984},"last":1.198},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.169,"15min":1.161},"min":{"1min":0.83999999999999997,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":2.0899999999999999,"5min":2.0899999999999999,"15min":2.0899999999999999},"last":1.2470000000000001}]},{"osd":2,"last update":"Fri Oct 6 03:03:50 2023","interfaces":[{"interface":"back","average":{"1min":1.3,"5min":1.3640000000000001,"15min":1.3839999999999999},"min":{"1min":0.94799999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":1.7350000000000001,"5min":1.78,"15min":1.78},"last":1.488},{"interface":"front","average":{"1min":1.286,"5min":1.306,"15min":1.3049999999999999},"min":{"1min":1.0049999999999999,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":1.5489999999999999,"5min":2.8319999999999999,"15min":2.8319999999999999},"last":1.222}]},{"osd":3,"last update":"Fri Oct 6 03:03:50 2023","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2589999999999999},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.589,"5min":3.1789999999999998,"15min":3.1789999999999998},"last":1.333},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.296,"15min":1.28},"min":{"1min":0.90300000000000002,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":2.2549999999999999,"5min":2.2549999999999999,"15min":2.2549999999999999},"last":1.4139999999999999}]},{"osd":4,"last update":"Fri Oct 6 03:03:50 2023","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.2370000000000001,"15min":1.28},"min":{"1min":0.81100000000000005,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.4570000000000001,"5min":2.5899999999999999,"15min":2.5899999999999999},"last":1.2969999999999999},{"interface":"front","average":{"1min":1.369,"5min":1.4570000000000001,"15min":1.496},"min":{"1min":0.96899999999999997,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.764,"5min":4.5419999999999998,"15min":4.5419999999999998},"last":1.5600000000000001}]},{"osd":6,"last update":"Fri Oct 6 03:03:50 2023","interfaces":[{"interface":"back","average":{"1min":1.208,"5min":1.3380000000000001,"15min":1.3720000000000001},"min":{"1min":0.82399999999999995,"5min":0.754,"15min":0.754},"max":{"1min":1.5980000000000001,"5min":1.847,"15min":1.847},"last":0.80800000000000005},{"interface":"front","average":{"1min":1.319,"5min":1.3620000000000001,"15min":1.3759999999999999},"min":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"max":{"1min":1.599,"5min":2.9239999999999999,"15min":2.9239999999999999},"last":1.3740000000000001}]},{"osd":7,"last update":"Fri Oct 6 03:03:50 2023","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.3700000000000001,"15min":1.3979999999999999},"min":{"1min":1.0169999999999999,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.8080000000000001,"5min":4.4489999999999998,"15min":4.4489999999999998},"last":1.454},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.387,"15min":1.419},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.7130000000000001,"5min":1.98,"15min":1.98},"last":0.93000000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574894,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302076,"kb_used_data":692,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069764,"statfs":{"total":96636764160,"available":96327438336,"internally_reserved":0,"allocated":708608,"data_stored":312809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:03:51 2023","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.093,"15min":1.089},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.5509999999999999,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":0.96799999999999997},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.093,"15min":1.079},"min":{"1min":0.80600000000000005,"5min":0.625,"15min":0.625},"max":{"1min":1.4359999999999999,"5min":1.585,"15min":1.585},"last":1.4390000000000001}]},{"osd":1,"last update":"Fri Oct 6 03:03:51 2023","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":1.0740000000000001,"15min":1.0569999999999999},"min":{"1min":0.75600000000000001,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.3999999999999999,"5min":1.621,"15min":1.621},"last":1.302},{"interface":"front","average":{"1min":1.133,"5min":1.1759999999999999,"15min":1.171},"min":{"1min":0.80200000000000005,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.411,"5min":1.73,"15min":1.73},"last":1.0880000000000001}]},{"osd":2,"last update":"Fri Oct 6 03:03:51 2023","interfaces":[{"interface":"back","average":{"1min":1.296,"5min":1.2889999999999999,"15min":1.2849999999999999},"min":{"1min":0.95299999999999996,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.5589999999999999,"5min":1.696,"15min":1.696},"last":1.22},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.329,"15min":1.3360000000000001},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.571,"5min":1.788,"15min":1.788},"last":1.264}]},{"osd":3,"last update":"Fri Oct 6 03:03:51 2023","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.222,"15min":1.2390000000000001},"min":{"1min":0.76500000000000001,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.407,"5min":1.706,"15min":1.706},"last":1.54},{"interface":"front","average":{"1min":1.1890000000000001,"5min":1.2370000000000001,"15min":1.2330000000000001},"min":{"1min":0.96999999999999997,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.3799999999999999,"5min":2.1960000000000002,"15min":2.1960000000000002},"last":1.135}]},{"osd":5,"last update":"Fri Oct 6 03:03:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.2110000000000001,"15min":1.202},"min":{"1min":0.86299999999999999,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.496,"5min":1.71,"15min":1.71},"last":1.357},{"interface":"front","average":{"1min":1.206,"5min":1.302,"15min":1.343},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.4990000000000001,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":1.7609999999999999}]},{"osd":6,"last update":"Fri Oct 6 03:03:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2609999999999999,"5min":1.327,"15min":1.371},"min":{"1min":0.63500000000000001,"5min":0.629,"15min":0.629},"max":{"1min":1.7949999999999999,"5min":2.9100000000000001,"15min":2.9100000000000001},"last":1.02},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.429,"15min":1.4610000000000001},"min":{"1min":1.0329999999999999,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.605,"5min":3.282,"15min":3.282},"last":1.171}]},{"osd":7,"last update":"Fri Oct 6 03:03:51 2023","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":1.4490000000000001,"15min":1.512},"min":{"1min":0.91900000000000004,"5min":0.88700000000000001,"15min":0.88700000000000001},"max":{"1min":1.591,"5min":2.145,"15min":2.145},"last":1.625},{"interface":"front","average":{"1min":1.411,"5min":1.4330000000000001,"15min":1.4350000000000001},"min":{"1min":0.874,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.7350000000000001,"5min":1.927,"15min":1.927},"last":1.3939999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574894,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302076,"kb_used_data":692,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069764,"statfs":{"total":96636764160,"available":96327438336,"internally_reserved":0,"allocated":708608,"data_stored":312809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:03:49 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.95799999999999996,"15min":0.99399999999999999},"min":{"1min":0.67100000000000004,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.3919999999999999,"5min":2.298,"15min":2.298},"last":1.139},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.01,"15min":1.002},"min":{"1min":0.752,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.339,"5min":2.1850000000000001,"15min":2.1850000000000001},"last":1.258}]},{"osd":1,"last update":"Fri Oct 6 03:03:49 2023","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.97399999999999998,"15min":0.98599999999999999},"min":{"1min":0.65800000000000003,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.3480000000000001,"5min":1.974,"15min":1.974},"last":1.0780000000000001},{"interface":"front","average":{"1min":1.127,"5min":1.1240000000000001,"15min":1.1319999999999999},"min":{"1min":0.86899999999999999,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.4710000000000001,"5min":1.71,"15min":1.71},"last":0.95399999999999996}]},{"osd":2,"last update":"Fri Oct 6 03:03:49 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":1.034,"15min":1.054},"min":{"1min":0.67600000000000005,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.4099999999999999,"5min":2.8849999999999998,"15min":2.8849999999999998},"last":0.89900000000000002},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.0860000000000001,"15min":1.0920000000000001},"min":{"1min":0.84199999999999997,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.5780000000000001,"5min":2.8220000000000001,"15min":2.8220000000000001},"last":1.22}]},{"osd":4,"last update":"Fri Oct 6 03:03:49 2023","interfaces":[{"interface":"back","average":{"1min":1.2849999999999999,"5min":1.393,"15min":1.4350000000000001},"min":{"1min":0.95299999999999996,"5min":0.751,"15min":0.751},"max":{"1min":1.7130000000000001,"5min":3.6560000000000001,"15min":3.6560000000000001},"last":1.0369999999999999},{"interface":"front","average":{"1min":1.335,"5min":1.401,"15min":1.444},"min":{"1min":1.0820000000000001,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.796,"5min":3.7749999999999999,"15min":3.7749999999999999},"last":1.2929999999999999}]},{"osd":5,"last update":"Fri Oct 6 03:03:49 2023","interfaces":[{"interface":"back","average":{"1min":1.4119999999999999,"5min":1.478,"15min":1.5149999999999999},"min":{"1min":1.1679999999999999,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":1.8460000000000001,"5min":3.4910000000000001,"15min":3.4910000000000001},"last":1.474},{"interface":"front","average":{"1min":1.377,"5min":1.4370000000000001,"15min":1.4750000000000001},"min":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"max":{"1min":1.6519999999999999,"5min":2.6240000000000001,"15min":2.6240000000000001},"last":1.3979999999999999}]},{"osd":6,"last update":"Fri Oct 6 03:03:49 2023","interfaces":[{"interface":"back","average":{"1min":1.359,"5min":1.4870000000000001,"15min":1.5469999999999999},"min":{"1min":1.0349999999999999,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":1.7549999999999999,"5min":3.7050000000000001,"15min":3.7050000000000001},"last":1.377},{"interface":"front","average":{"1min":1.3540000000000001,"5min":1.4990000000000001,"15min":1.5549999999999999},"min":{"1min":0.97699999999999998,"5min":0.80900000000000005,"15min":0.80900000000000005},"max":{"1min":1.901,"5min":3.9300000000000002,"15min":3.9300000000000002},"last":1.552}]},{"osd":7,"last update":"Fri Oct 6 03:03:49 2023","interfaces":[{"interface":"back","average":{"1min":1.4299999999999999,"5min":1.5449999999999999,"15min":1.605},"min":{"1min":1.073,"5min":1.0369999999999999,"15min":1.0369999999999999},"max":{"1min":1.9330000000000001,"5min":2.96,"15min":2.96},"last":1.5089999999999999},{"interface":"front","average":{"1min":1.4950000000000001,"5min":1.6579999999999999,"15min":1.734},"min":{"1min":1.1419999999999999,"5min":0.90600000000000003,"15min":0.90600000000000003},"max":{"1min":1.9810000000000001,"5min":3.8559999999999999,"15min":3.8559999999999999},"last":1.4279999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574894,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302076,"kb_used_data":692,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069764,"statfs":{"total":96636764160,"available":96327438336,"internally_reserved":0,"allocated":708608,"data_stored":312809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:03:50 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.86099999999999999,"15min":0.86799999999999999},"min":{"1min":0.54500000000000004,"5min":0.496,"15min":0.496},"max":{"1min":1.2290000000000001,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.91700000000000004,"15min":0.93799999999999994},"min":{"1min":0.61799999999999999,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.3340000000000001,"5min":1.502,"15min":1.502},"last":0.90200000000000002}]},{"osd":1,"last update":"Fri Oct 6 03:03:50 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.075,"15min":1.087},"min":{"1min":0.64700000000000002,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.99199999999999999},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.1899999999999999,"15min":1.218},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.484,"5min":2.1800000000000002,"15min":2.1800000000000002},"last":1.141}]},{"osd":3,"last update":"Fri Oct 6 03:03:50 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.94599999999999995,"15min":0.96199999999999997},"min":{"1min":0.63100000000000001,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.2430000000000001,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.94599999999999995},{"interface":"front","average":{"1min":1.125,"5min":1.147,"15min":1.1719999999999999},"min":{"1min":0.73699999999999999,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.5289999999999999,"5min":2.806,"15min":2.806},"last":1.1599999999999999}]},{"osd":4,"last update":"Fri Oct 6 03:03:50 2023","interfaces":[{"interface":"back","average":{"1min":1.266,"5min":1.339,"15min":1.3720000000000001},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.7090000000000001,"5min":2.1739999999999999,"15min":2.1739999999999999},"last":1.2549999999999999},{"interface":"front","average":{"1min":1.242,"5min":1.3779999999999999,"15min":1.431},"min":{"1min":0.996,"5min":0.83699999999999997,"15min":0.83699999999999997},"max":{"1min":1.5429999999999999,"5min":3.028,"15min":3.028},"last":1.1910000000000001}]},{"osd":5,"last update":"Fri Oct 6 03:03:50 2023","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.4650000000000001,"15min":1.5209999999999999},"min":{"1min":1.1000000000000001,"5min":0.90100000000000002,"15min":0.90100000000000002},"max":{"1min":1.5469999999999999,"5min":3.1499999999999999,"15min":3.1499999999999999},"last":1.077},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.4259999999999999,"15min":1.4830000000000001},"min":{"1min":0.95599999999999996,"5min":0.85899999999999999,"15min":0.85899999999999999},"max":{"1min":1.704,"5min":2.8580000000000001,"15min":2.8580000000000001},"last":1.393}]},{"osd":6,"last update":"Fri Oct 6 03:03:50 2023","interfaces":[{"interface":"back","average":{"1min":1.2789999999999999,"5min":1.397,"15min":1.45},"min":{"1min":0.91900000000000004,"5min":0.86299999999999999,"15min":0.86299999999999999},"max":{"1min":1.829,"5min":2.6659999999999999,"15min":2.6659999999999999},"last":1.609},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.4490000000000001,"15min":1.4970000000000001},"min":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"max":{"1min":1.6759999999999999,"5min":2.411,"15min":2.411},"last":1.5860000000000001}]},{"osd":7,"last update":"Fri Oct 6 03:03:50 2023","interfaces":[{"interface":"back","average":{"1min":1.3759999999999999,"5min":1.544,"15min":1.6040000000000001},"min":{"1min":1.0880000000000001,"5min":1.01,"15min":1.01},"max":{"1min":1.579,"5min":3.2160000000000002,"15min":3.2160000000000002},"last":1.333},{"interface":"front","average":{"1min":1.3979999999999999,"5min":1.5369999999999999,"15min":1.599},"min":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"max":{"1min":1.8879999999999999,"5min":3.1059999999999999,"15min":3.1059999999999999},"last":1.5409999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574895,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302076,"kb_used_data":692,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069764,"statfs":{"total":96636764160,"available":96327438336,"internally_reserved":0,"allocated":708608,"data_stored":312809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:03:48 2023","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":0.93700000000000006,"15min":0.94899999999999995},"min":{"1min":0.57799999999999996,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.3759999999999999,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":0.75700000000000001},{"interface":"front","average":{"1min":1.113,"5min":1.0860000000000001,"15min":1.091},"min":{"1min":0.71499999999999997,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.4690000000000001,"5min":2.3260000000000001,"15min":2.3260000000000001},"last":1.0720000000000001}]},{"osd":2,"last update":"Fri Oct 6 03:03:48 2023","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.98099999999999998,"15min":0.995},"min":{"1min":0.77500000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.27,"5min":3.5459999999999998,"15min":3.5459999999999998},"last":0.85199999999999998},{"interface":"front","average":{"1min":1.165,"5min":1.042,"15min":1.03},"min":{"1min":0.76400000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.5820000000000001,"5min":1.706,"15min":1.706},"last":1.4239999999999999}]},{"osd":3,"last update":"Fri Oct 6 03:03:48 2023","interfaces":[{"interface":"back","average":{"1min":1.218,"5min":1.1539999999999999,"15min":1.1459999999999999},"min":{"1min":0.71299999999999997,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.5760000000000001,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":1.1870000000000001},{"interface":"front","average":{"1min":1.151,"5min":1.167,"15min":1.1859999999999999},"min":{"1min":0.93300000000000005,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.4730000000000001,"5min":3.331,"15min":3.331},"last":1.393}]},{"osd":4,"last update":"Fri Oct 6 03:03:48 2023","interfaces":[{"interface":"back","average":{"1min":1.3080000000000001,"5min":1.3089999999999999,"15min":1.329},"min":{"1min":1.048,"5min":0.85899999999999999,"15min":0.85899999999999999},"max":{"1min":1.5640000000000001,"5min":2.0169999999999999,"15min":2.0169999999999999},"last":1.27},{"interface":"front","average":{"1min":1.238,"5min":1.298,"15min":1.3180000000000001},"min":{"1min":0.90900000000000003,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.639,"5min":3.2250000000000001,"15min":3.2250000000000001},"last":1.2370000000000001}]},{"osd":5,"last update":"Fri Oct 6 03:03:48 2023","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":1.389,"15min":1.421},"min":{"1min":0.96599999999999997,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":1.704,"5min":2.8439999999999999,"15min":2.8439999999999999},"last":1.4830000000000001},{"interface":"front","average":{"1min":1.4470000000000001,"5min":1.4510000000000001,"15min":1.4730000000000001},"min":{"1min":1.0980000000000001,"5min":0.89800000000000002,"15min":0.89800000000000002},"max":{"1min":1.7390000000000001,"5min":2.4590000000000001,"15min":2.4590000000000001},"last":1.5329999999999999}]},{"osd":6,"last update":"Fri Oct 6 03:03:48 2023","interfaces":[{"interface":"back","average":{"1min":1.3500000000000001,"5min":1.427,"15min":1.4530000000000001},"min":{"1min":0.89400000000000002,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.76,"5min":2.96,"15min":2.96},"last":1.6559999999999999},{"interface":"front","average":{"1min":1.472,"5min":1.474,"15min":1.494},"min":{"1min":1.0149999999999999,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.8080000000000001,"5min":2.5859999999999999,"15min":2.5859999999999999},"last":1.321}]},{"osd":7,"last update":"Fri Oct 6 03:03:48 2023","interfaces":[{"interface":"back","average":{"1min":1.415,"5min":1.512,"15min":1.573},"min":{"1min":1.1459999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":2.1299999999999999,"5min":3.4460000000000002,"15min":3.4460000000000002},"last":1.512},{"interface":"front","average":{"1min":1.458,"5min":1.5,"15min":1.5249999999999999},"min":{"1min":1.212,"5min":0.94099999999999995,"15min":0.94099999999999995},"max":{"1min":1.734,"5min":3.113,"15min":3.113},"last":1.5940000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574894,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302656,"kb_used_data":1272,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069184,"statfs":{"total":96636764160,"available":96326844416,"internally_reserved":0,"allocated":1302528,"data_stored":903177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 03:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.85099999999999998,"15min":0.82399999999999995},"min":{"1min":0.66700000000000004,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.2490000000000001,"5min":1.583,"15min":1.583},"last":0.997},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.97799999999999998,"15min":0.99199999999999999},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.571,"5min":1.571,"15min":1.571},"last":0.68899999999999995}]},{"osd":2,"last update":"Fri Oct 6 03:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.98599999999999999,"15min":0.98399999999999999},"min":{"1min":0.71799999999999997,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.3220000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":1.1950000000000001},{"interface":"front","average":{"1min":0.998,"5min":1.089,"15min":1.1120000000000001},"min":{"1min":0.76100000000000001,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.2949999999999999,"5min":1.794,"15min":1.794},"last":0.93899999999999995}]},{"osd":3,"last update":"Fri Oct 6 03:03:46 2023","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":1.0349999999999999,"15min":1.018},"min":{"1min":0.70799999999999996,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.554,"5min":1.554,"15min":1.554},"last":1.4490000000000001},{"interface":"front","average":{"1min":1.298,"5min":1.226,"15min":1.2030000000000001},"min":{"1min":1.004,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.569,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":1.538}]},{"osd":4,"last update":"Fri Oct 6 03:03:46 2023","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.244,"15min":1.2310000000000001},"min":{"1min":0.88400000000000001,"5min":0.86699999999999999,"15min":0.86699999999999999},"max":{"1min":1.5669999999999999,"5min":2.0680000000000001,"15min":2.0680000000000001},"last":1.3640000000000001},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.3300000000000001,"15min":1.3360000000000001},"min":{"1min":1.0409999999999999,"5min":0.93400000000000005,"15min":0.93400000000000005},"max":{"1min":1.5800000000000001,"5min":1.647,"15min":1.647},"last":1.3260000000000001}]},{"osd":5,"last update":"Fri Oct 6 03:03:46 2023","interfaces":[{"interface":"back","average":{"1min":1.256,"5min":1.379,"15min":1.4019999999999999},"min":{"1min":0.92500000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":1.728,"5min":1.8959999999999999,"15min":1.8959999999999999},"last":1.569},{"interface":"front","average":{"1min":1.359,"5min":1.2909999999999999,"15min":1.2729999999999999},"min":{"1min":1.0449999999999999,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":1.6160000000000001,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":1.244}]},{"osd":6,"last update":"Fri Oct 6 03:03:46 2023","interfaces":[{"interface":"back","average":{"1min":1.373,"5min":1.4199999999999999,"15min":1.4199999999999999},"min":{"1min":1.1459999999999999,"5min":0.89400000000000002,"15min":0.89400000000000002},"max":{"1min":1.7090000000000001,"5min":1.96,"15min":1.96},"last":1.4199999999999999},{"interface":"front","average":{"1min":1.389,"5min":1.4930000000000001,"15min":1.532},"min":{"1min":1.117,"5min":0.89800000000000002,"15min":0.89800000000000002},"max":{"1min":1.859,"5min":2.0539999999999998,"15min":2.0539999999999998},"last":1.669}]},{"osd":7,"last update":"Fri Oct 6 03:03:46 2023","interfaces":[{"interface":"back","average":{"1min":1.4039999999999999,"5min":1.5569999999999999,"15min":1.607},"min":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"max":{"1min":1.7989999999999999,"5min":2.1019999999999999,"15min":2.1019999999999999},"last":1.4630000000000001},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.413,"15min":1.425},"min":{"1min":1.091,"5min":0.875,"15min":0.875},"max":{"1min":1.681,"5min":2.1499999999999999,"15min":2.1499999999999999},"last":1.4970000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:04:27.743 DEBUG:teuthology.orchestra.run.smithi057:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-10-06T03:04:27.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.896+0000 7fd72bfff700 1 Processor -- start 2023-10-06T03:04:27.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.896+0000 7fd72bfff700 1 -- start start 2023-10-06T03:04:27.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.900+0000 7fd72bfff700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd72c0cb140 0x7fd72c0cb510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:27.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.900+0000 7fd72bfff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd72c0b0080 0x7fd72c0b04d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:27.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.900+0000 7fd72bfff700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fd72c06d930 0x7fd72c06ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:27.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.900+0000 7fd72bfff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd72c06e2f0 con 0x7fd72c0b0080 2023-10-06T03:04:27.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.900+0000 7fd72bfff700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd72c06c920 con 0x7fd72c06d930 2023-10-06T03:04:27.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.900+0000 7fd72bfff700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd72c06d4a0 con 0x7fd72c0cb140 2023-10-06T03:04:27.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.900+0000 7fd72a7fc700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd72c0b0080 0x7fd72c0b04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:27.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.900+0000 7fd72a7fc700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd72c0b0080 0x7fd72c0b04d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34074/0 (socket says 172.21.15.57:34074) 2023-10-06T03:04:27.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.900+0000 7fd72a7fc700 1 -- 172.21.15.57:0/1326525523 learned_addr learned my addr 172.21.15.57:0/1326525523 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:04:27.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.900+0000 7fd72b7fe700 1 --2- 172.21.15.57:0/1326525523 >> v2:172.21.15.105:3300/0 conn(0x7fd72c06d930 0x7fd72c06ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:27.906 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.900+0000 7fd72affd700 1 --2- 172.21.15.57:0/1326525523 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd72c0cb140 0x7fd72c0cb510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:27.908 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.900+0000 7fd72a7fc700 1 -- 172.21.15.57:0/1326525523 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd72c0cb140 msgr2=0x7fd72c0cb510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:27.908 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.900+0000 7fd72a7fc700 1 --2- 172.21.15.57:0/1326525523 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd72c0cb140 0x7fd72c0cb510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:27.908 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.900+0000 7fd72a7fc700 1 -- 172.21.15.57:0/1326525523 >> v2:172.21.15.105:3300/0 conn(0x7fd72c06d930 msgr2=0x7fd72c06ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:27.908 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.900+0000 7fd72a7fc700 1 --2- 172.21.15.57:0/1326525523 >> v2:172.21.15.105:3300/0 conn(0x7fd72c06d930 0x7fd72c06ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:27.908 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.900+0000 7fd72a7fc700 1 -- 172.21.15.57:0/1326525523 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd72c06cb70 con 0x7fd72c0b0080 2023-10-06T03:04:27.908 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.900+0000 7fd72a7fc700 1 --2- 172.21.15.57:0/1326525523 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd72c0b0080 0x7fd72c0b04d0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fd72c15ceb0 tx=0x7fd720009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccfc9a1203df21f5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:27.908 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.900+0000 7fd729ffb700 1 -- 172.21.15.57:0/1326525523 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd72000b640 con 0x7fd72c0b0080 2023-10-06T03:04:27.908 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.900+0000 7fd729ffb700 1 -- 172.21.15.57:0/1326525523 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd72000b7a0 con 0x7fd72c0b0080 2023-10-06T03:04:27.909 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.900+0000 7fd729ffb700 1 -- 172.21.15.57:0/1326525523 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd72000bb60 con 0x7fd72c0b0080 2023-10-06T03:04:27.909 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.904+0000 7fd72bfff700 1 -- 172.21.15.57:0/1326525523 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd72c0b0080 msgr2=0x7fd72c0b04d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:27.909 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.904+0000 7fd72bfff700 1 --2- 172.21.15.57:0/1326525523 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd72c0b0080 0x7fd72c0b04d0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fd72c15ceb0 tx=0x7fd720009250 comp rx=0 tx=0).stop 2023-10-06T03:04:27.909 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.904+0000 7fd72bfff700 1 -- 172.21.15.57:0/1326525523 shutdown_connections 2023-10-06T03:04:27.909 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.904+0000 7fd72bfff700 1 --2- 172.21.15.57:0/1326525523 >> v2:172.21.15.105:3300/0 conn(0x7fd72c06d930 0x7fd72c06ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:27.909 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.904+0000 7fd72bfff700 1 --2- 172.21.15.57:0/1326525523 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd72c0b0080 0x7fd72c0b04d0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:27.909 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.904+0000 7fd72bfff700 1 --2- 172.21.15.57:0/1326525523 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd72c0cb140 0x7fd72c0cb510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:27.910 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.904+0000 7fd72bfff700 1 -- 172.21.15.57:0/1326525523 >> 172.21.15.57:0/1326525523 conn(0x7fd72c0d0a50 msgr2=0x7fd72c0cca60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:27.910 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.904+0000 7fd72bfff700 1 -- 172.21.15.57:0/1326525523 shutdown_connections 2023-10-06T03:04:27.910 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.904+0000 7fd72bfff700 1 -- 172.21.15.57:0/1326525523 wait complete. 2023-10-06T03:04:27.911 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.908+0000 7fd72bfff700 1 Processor -- start 2023-10-06T03:04:27.912 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.908+0000 7fd72bfff700 1 -- start start 2023-10-06T03:04:27.914 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.908+0000 7fd72bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd72c06d930 0x7fd72c0c9520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:27.914 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.908+0000 7fd72bfff700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd72c0b0080 0x7fd72c159570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:27.914 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.908+0000 7fd72bfff700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd72c0cb140 0x7fd72c169590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:27.914 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.908+0000 7fd72bfff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd72c0c9a60 con 0x7fd72c06d930 2023-10-06T03:04:27.915 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.908+0000 7fd72bfff700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd72c0c7bf0 con 0x7fd72c0cb140 2023-10-06T03:04:27.915 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.908+0000 7fd72bfff700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd72c0c7000 con 0x7fd72c0b0080 2023-10-06T03:04:27.915 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.908+0000 7fd72affd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd72c06d930 0x7fd72c0c9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:27.915 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.908+0000 7fd72affd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd72c06d930 0x7fd72c0c9520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34080/0 (socket says 172.21.15.57:34080) 2023-10-06T03:04:27.915 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.908+0000 7fd72affd700 1 -- 172.21.15.57:0/1921335187 learned_addr learned my addr 172.21.15.57:0/1921335187 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:04:27.917 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.912+0000 7fd72a7fc700 1 --2- 172.21.15.57:0/1921335187 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd72c0b0080 0x7fd72c159570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:27.917 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.912+0000 7fd72b7fe700 1 --2- 172.21.15.57:0/1921335187 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd72c0cb140 0x7fd72c169590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:27.917 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.912+0000 7fd72affd700 1 -- 172.21.15.57:0/1921335187 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd72c0b0080 msgr2=0x7fd72c159570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:27.917 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.912+0000 7fd72affd700 1 --2- 172.21.15.57:0/1921335187 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd72c0b0080 0x7fd72c159570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:27.917 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.912+0000 7fd72affd700 1 -- 172.21.15.57:0/1921335187 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd72c0cb140 msgr2=0x7fd72c169590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:27.917 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.912+0000 7fd72affd700 1 --2- 172.21.15.57:0/1921335187 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd72c0cb140 0x7fd72c169590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:27.917 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.912+0000 7fd72affd700 1 -- 172.21.15.57:0/1921335187 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7200094f0 con 0x7fd72c06d930 2023-10-06T03:04:27.918 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.912+0000 7fd72b7fe700 1 --2- 172.21.15.57:0/1921335187 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd72c0cb140 0x7fd72c169590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:04:27.918 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.912+0000 7fd72affd700 1 --2- 172.21.15.57:0/1921335187 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd72c06d930 0x7fd72c0c9520 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fd71c00e950 tx=0x7fd71c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:27.918 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.912+0000 7fd712ffd700 1 -- 172.21.15.57:0/1921335187 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd71c013680 con 0x7fd72c06d930 2023-10-06T03:04:27.918 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.912+0000 7fd712ffd700 1 -- 172.21.15.57:0/1921335187 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd71c0137e0 con 0x7fd72c06d930 2023-10-06T03:04:27.918 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.912+0000 7fd72bfff700 1 -- 172.21.15.57:0/1921335187 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd72c0c8080 con 0x7fd72c06d930 2023-10-06T03:04:27.918 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.912+0000 7fd712ffd700 1 -- 172.21.15.57:0/1921335187 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd71c013ba0 con 0x7fd72c06d930 2023-10-06T03:04:27.919 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.912+0000 7fd72bfff700 1 -- 172.21.15.57:0/1921335187 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd72c0c75a0 con 0x7fd72c06d930 2023-10-06T03:04:27.919 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.912+0000 7fd72bfff700 1 -- 172.21.15.57:0/1921335187 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd72c04be40 con 0x7fd72c06d930 2023-10-06T03:04:27.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.916+0000 7fd712ffd700 1 -- 172.21.15.57:0/1921335187 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fd71c00c490 con 0x7fd72c06d930 2023-10-06T03:04:27.921 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.916+0000 7fd712ffd700 1 --2- 172.21.15.57:0/1921335187 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fd718060550 0x7fd718062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:27.921 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.916+0000 7fd712ffd700 1 -- 172.21.15.57:0/1921335187 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5378+0+0 (secure 0 0 0) 0x7fd71c07c8d0 con 0x7fd72c06d930 2023-10-06T03:04:27.922 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.916+0000 7fd72a7fc700 1 --2- 172.21.15.57:0/1921335187 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fd718060550 0x7fd718062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:27.923 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.920+0000 7fd72a7fc700 1 --2- 172.21.15.57:0/1921335187 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fd718060550 0x7fd718062a00 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fd72c15ceb0 tx=0x7fd720017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:27.925 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:27.920+0000 7fd712ffd700 1 -- 172.21.15.57:0/1921335187 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fd71c04cf60 con 0x7fd72c06d930 2023-10-06T03:04:28.094 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:28.088+0000 7fd72bfff700 1 -- 172.21.15.57:0/1921335187 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7fd72c06a310 con 0x7fd72c06d930 2023-10-06T03:04:28.104 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:28.100+0000 7fd712ffd700 1 -- 172.21.15.57:0/1921335187 <== mon.0 v2:172.21.15.57:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fd71c04cf60 con 0x7fd72c06d930 2023-10-06T03:04:28.105 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:28.100+0000 7fd712ffd700 1 -- 172.21.15.57:0/1921335187 <== mon.0 v2:172.21.15.57:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v14)=0 v14) v1 ==== 123+0+0 (secure 0 0 0) 0x7fd71c050580 con 0x7fd72c06d930 2023-10-06T03:04:28.108 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:28.104+0000 7fd72bfff700 1 -- 172.21.15.57:0/1921335187 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fd718060550 msgr2=0x7fd718062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:28.109 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:28.104+0000 7fd72bfff700 1 --2- 172.21.15.57:0/1921335187 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fd718060550 0x7fd718062a00 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fd72c15ceb0 tx=0x7fd720017000 comp rx=0 tx=0).stop 2023-10-06T03:04:28.109 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:28.104+0000 7fd72bfff700 1 -- 172.21.15.57:0/1921335187 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd72c06d930 msgr2=0x7fd72c0c9520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:28.109 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:28.104+0000 7fd72bfff700 1 --2- 172.21.15.57:0/1921335187 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd72c06d930 0x7fd72c0c9520 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fd71c00e950 tx=0x7fd71c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:04:28.109 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:28.104+0000 7fd72bfff700 1 -- 172.21.15.57:0/1921335187 shutdown_connections 2023-10-06T03:04:28.109 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:28.104+0000 7fd72bfff700 1 --2- 172.21.15.57:0/1921335187 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd72c0cb140 0x7fd72c169590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:28.109 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:28.104+0000 7fd72bfff700 1 --2- 172.21.15.57:0/1921335187 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7fd718060550 0x7fd718062a00 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:28.109 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:28.104+0000 7fd72bfff700 1 --2- 172.21.15.57:0/1921335187 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd72c0b0080 0x7fd72c159570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:28.109 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:28.104+0000 7fd72bfff700 1 --2- 172.21.15.57:0/1921335187 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd72c06d930 0x7fd72c0c9520 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:28.109 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:28.104+0000 7fd72bfff700 1 -- 172.21.15.57:0/1921335187 >> 172.21.15.57:0/1921335187 conn(0x7fd72c0d0a50 msgr2=0x7fd72c067050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:28.109 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:28.104+0000 7fd72bfff700 1 -- 172.21.15.57:0/1921335187 shutdown_connections 2023-10-06T03:04:28.110 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:28.104+0000 7fd72bfff700 1 -- 172.21.15.57:0/1921335187 wait complete. 2023-10-06T03:04:28.129 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T03:04:28.129 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:04:28.292 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:28.288+0000 7f879b6f0700 1 Processor -- start 2023-10-06T03:04:28.293 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:28.288+0000 7f879b6f0700 1 -- start start 2023-10-06T03:04:28.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:28.288+0000 7f879b6f0700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f87940671f0 0x7f87940675c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:28.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:28.288+0000 7f879b6f0700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f879406deb0 0x7f87940aff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:28.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:28.288+0000 7f879b6f0700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f879406aac0 0x7f879406af40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:28.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:28.292+0000 7f879b6f0700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f879406da20 con 0x7f87940671f0 2023-10-06T03:04:28.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:28.292+0000 7f879b6f0700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f879406ce10 con 0x7f879406aac0 2023-10-06T03:04:28.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:28.292+0000 7f879b6f0700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f879406d0f0 con 0x7f879406deb0 2023-10-06T03:04:28.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:28.292+0000 7f879948c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f87940671f0 0x7f87940675c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:28.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:28.292+0000 7f879948c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f87940671f0 0x7f87940675c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34092/0 (socket says 172.21.15.57:34092) 2023-10-06T03:04:28.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:28.292+0000 7f879948c700 1 -- 172.21.15.57:0/2716924574 learned_addr learned my addr 172.21.15.57:0/2716924574 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:04:28.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:28.292+0000 7f8799c8d700 1 --2- 172.21.15.57:0/2716924574 >> v2:172.21.15.105:3300/0 conn(0x7f879406aac0 0x7f879406af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:28.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:28.292+0000 7f8798c8b700 1 --2- 172.21.15.57:0/2716924574 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f879406deb0 0x7f87940aff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:28.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:28.292+0000 7f879948c700 1 -- 172.21.15.57:0/2716924574 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f879406deb0 msgr2=0x7f87940aff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:28.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:28.292+0000 7f879948c700 1 --2- 172.21.15.57:0/2716924574 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f879406deb0 0x7f87940aff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:28.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:28.292+0000 7f879948c700 1 -- 172.21.15.57:0/2716924574 >> v2:172.21.15.105:3300/0 conn(0x7f879406aac0 msgr2=0x7f879406af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:28.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:28.292+0000 7f879948c700 1 --2- 172.21.15.57:0/2716924574 >> v2:172.21.15.105:3300/0 conn(0x7f879406aac0 0x7f879406af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:28.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:28.292+0000 7f879948c700 1 -- 172.21.15.57:0/2716924574 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f879406d3d0 con 0x7f87940671f0 2023-10-06T03:04:28.298 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:28.292+0000 7f879948c700 1 --2- 172.21.15.57:0/2716924574 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f87940671f0 0x7f87940675c0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f879406d990 tx=0x7f8790009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d71013076465c3c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:28.298 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:28.292+0000 7f878bfff700 1 -- 172.21.15.57:0/2716924574 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f879000b640 con 0x7f87940671f0 2023-10-06T03:04:28.298 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:28.292+0000 7f878bfff700 1 -- 172.21.15.57:0/2716924574 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f879000b7a0 con 0x7f87940671f0 2023-10-06T03:04:28.298 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:28.292+0000 7f878bfff700 1 -- 172.21.15.57:0/2716924574 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f879000bb80 con 0x7f87940671f0 2023-10-06T03:04:28.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:28.296+0000 7f879b6f0700 1 -- 172.21.15.57:0/2716924574 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f87940671f0 msgr2=0x7f87940675c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:28.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:28.296+0000 7f879b6f0700 1 --2- 172.21.15.57:0/2716924574 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f87940671f0 0x7f87940675c0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f879406d990 tx=0x7f8790009250 comp rx=0 tx=0).stop 2023-10-06T03:04:28.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:28.296+0000 7f879b6f0700 1 -- 172.21.15.57:0/2716924574 shutdown_connections 2023-10-06T03:04:28.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:28.296+0000 7f879b6f0700 1 --2- 172.21.15.57:0/2716924574 >> v2:172.21.15.105:3300/0 conn(0x7f879406aac0 0x7f879406af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:28.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:28.296+0000 7f879b6f0700 1 --2- 172.21.15.57:0/2716924574 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f879406deb0 0x7f87940aff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:28.300 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:28.296+0000 7f879b6f0700 1 --2- 172.21.15.57:0/2716924574 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f87940671f0 0x7f87940675c0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:28.300 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:28.296+0000 7f879b6f0700 1 -- 172.21.15.57:0/2716924574 >> 172.21.15.57:0/2716924574 conn(0x7f87940cbdd0 msgr2=0x7f87940cc1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:28.300 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:28.296+0000 7f879b6f0700 1 -- 172.21.15.57:0/2716924574 shutdown_connections 2023-10-06T03:04:28.300 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:28.296+0000 7f879b6f0700 1 -- 172.21.15.57:0/2716924574 wait complete. 2023-10-06T03:04:28.302 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:28.296+0000 7f879b6f0700 1 Processor -- start 2023-10-06T03:04:28.302 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:28.300+0000 7f879b6f0700 1 -- start start 2023-10-06T03:04:28.307 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:28.300+0000 7f879b6f0700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f87940671f0 0x7f8794171ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:28.307 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:28.300+0000 7f879b6f0700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f879406aac0 0x7f8794155100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:28.308 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:28.300+0000 7f879b6f0700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f879406deb0 0x7f879415ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:28.308 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:28.300+0000 7f879b6f0700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8794160240 con 0x7f87940671f0 2023-10-06T03:04:28.308 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:28.300+0000 7f879b6f0700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f879415e160 con 0x7f879406aac0 2023-10-06T03:04:28.308 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:28.300+0000 7f879b6f0700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f879415e440 con 0x7f879406deb0 2023-10-06T03:04:28.308 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:28.300+0000 7f879948c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f87940671f0 0x7f8794171ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:28.308 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:28.300+0000 7f879948c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f87940671f0 0x7f8794171ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34108/0 (socket says 172.21.15.57:34108) 2023-10-06T03:04:28.309 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:28.300+0000 7f879948c700 1 -- 172.21.15.57:0/3399985165 learned_addr learned my addr 172.21.15.57:0/3399985165 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:04:28.309 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:28.300+0000 7f8799c8d700 1 --2- 172.21.15.57:0/3399985165 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f879406deb0 0x7f879415ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:28.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:28.300+0000 7f8798c8b700 1 --2- 172.21.15.57:0/3399985165 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f879406aac0 0x7f8794155100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:28.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:28.300+0000 7f879948c700 1 -- 172.21.15.57:0/3399985165 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f879406deb0 msgr2=0x7f879415ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:28.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:28.300+0000 7f879948c700 1 --2- 172.21.15.57:0/3399985165 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f879406deb0 0x7f879415ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:28.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:28.300+0000 7f879948c700 1 -- 172.21.15.57:0/3399985165 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f879406aac0 msgr2=0x7f8794155100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:28.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:28.300+0000 7f879948c700 1 --2- 172.21.15.57:0/3399985165 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f879406aac0 0x7f8794155100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:28.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:28.300+0000 7f879948c700 1 -- 172.21.15.57:0/3399985165 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87900094f0 con 0x7f87940671f0 2023-10-06T03:04:28.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:28.300+0000 7f8799c8d700 1 --2- 172.21.15.57:0/3399985165 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f879406deb0 0x7f879415ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:04:28.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:28.300+0000 7f879948c700 1 --2- 172.21.15.57:0/3399985165 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f87940671f0 0x7f8794171ac0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f87900094c0 tx=0x7f8790009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:28.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:28.304+0000 7f87897fa700 1 -- 172.21.15.57:0/3399985165 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8790011cc0 con 0x7f87940671f0 2023-10-06T03:04:28.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:28.304+0000 7f87897fa700 1 -- 172.21.15.57:0/3399985165 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f879001f070 con 0x7f87940671f0 2023-10-06T03:04:28.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:28.304+0000 7f879b6f0700 1 -- 172.21.15.57:0/3399985165 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8794160450 con 0x7f87940671f0 2023-10-06T03:04:28.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:28.304+0000 7f87897fa700 1 -- 172.21.15.57:0/3399985165 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87900266f0 con 0x7f87940671f0 2023-10-06T03:04:28.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:28.304+0000 7f879b6f0700 1 -- 172.21.15.57:0/3399985165 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f879415da40 con 0x7f87940671f0 2023-10-06T03:04:28.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:28.304+0000 7f879b6f0700 1 -- 172.21.15.57:0/3399985165 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87940712e0 con 0x7f87940671f0 2023-10-06T03:04:28.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:28.304+0000 7f87897fa700 1 -- 172.21.15.57:0/3399985165 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f879001a430 con 0x7f87940671f0 2023-10-06T03:04:28.312 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:28.308+0000 7f87897fa700 1 --2- 172.21.15.57:0/3399985165 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f8778060550 0x7f8778062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:28.312 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:28.308+0000 7f87897fa700 1 -- 172.21.15.57:0/3399985165 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5378+0+0 (secure 0 0 0) 0x7f8790021070 con 0x7f87940671f0 2023-10-06T03:04:28.312 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:28.308+0000 7f8798c8b700 1 --2- 172.21.15.57:0/3399985165 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f8778060550 0x7f8778062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:28.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:28.308+0000 7f8798c8b700 1 --2- 172.21.15.57:0/3399985165 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f8778060550 0x7f8778062a00 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f87940ab1d0 tx=0x7f8784008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:28.318 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:28.316+0000 7f87897fa700 1 -- 172.21.15.57:0/3399985165 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f879004eae0 con 0x7f87940671f0 2023-10-06T03:04:28.525 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:28.520+0000 7f879b6f0700 1 -- 172.21.15.57:0/3399985165 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f879406d6b0 con 0x7f87940671f0 2023-10-06T03:04:28.527 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:28.524+0000 7f87897fa700 1 -- 172.21.15.57:0/3399985165 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+3526 (secure 0 0 0) 0x7f8790015de0 con 0x7f87940671f0 2023-10-06T03:04:28.527 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:04:28.527 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":40,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5222,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/879829980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":879829980},{"type":"v1","addr":"172.21.15.105:6833","nonce":879829980}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5225,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/3705921279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":3705921279},{"type":"v1","addr":"172.21.15.105:6835","nonce":3705921279}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/251759282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":251759282},{"type":"v1","addr":"172.21.15.57:6835","nonce":251759282}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32},{"gid":5853,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6837/433514266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6836","nonce":433514266},{"type":"v1","addr":"172.21.15.57:6837","nonce":433514266}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":40}],"filesystems":[]} 2023-10-06T03:04:28.532 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:28.528+0000 7f879b6f0700 1 -- 172.21.15.57:0/3399985165 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f8778060550 msgr2=0x7f8778062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:28.532 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:28.528+0000 7f879b6f0700 1 --2- 172.21.15.57:0/3399985165 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f8778060550 0x7f8778062a00 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f87940ab1d0 tx=0x7f8784008040 comp rx=0 tx=0).stop 2023-10-06T03:04:28.533 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:28.528+0000 7f879b6f0700 1 -- 172.21.15.57:0/3399985165 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f87940671f0 msgr2=0x7f8794171ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:28.533 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:28.528+0000 7f879b6f0700 1 --2- 172.21.15.57:0/3399985165 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f87940671f0 0x7f8794171ac0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f87900094c0 tx=0x7f8790009250 comp rx=0 tx=0).stop 2023-10-06T03:04:28.533 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:28.528+0000 7f879b6f0700 1 -- 172.21.15.57:0/3399985165 shutdown_connections 2023-10-06T03:04:28.533 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:28.528+0000 7f879b6f0700 1 --2- 172.21.15.57:0/3399985165 >> [v2:172.21.15.57:6832/32947,v1:172.21.15.57:6833/32947] conn(0x7f8778060550 0x7f8778062a00 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:28.533 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:28.528+0000 7f879b6f0700 1 --2- 172.21.15.57:0/3399985165 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f879406deb0 0x7f879415ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:28.533 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:28.528+0000 7f879b6f0700 1 --2- 172.21.15.57:0/3399985165 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f879406aac0 0x7f8794155100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:28.533 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:28.528+0000 7f879b6f0700 1 --2- 172.21.15.57:0/3399985165 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f87940671f0 0x7f8794171ac0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:28.533 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:28.528+0000 7f879b6f0700 1 -- 172.21.15.57:0/3399985165 >> 172.21.15.57:0/3399985165 conn(0x7f87940cbdd0 msgr2=0x7f879415a380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:28.533 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:28.528+0000 7f879b6f0700 1 -- 172.21.15.57:0/3399985165 shutdown_connections 2023-10-06T03:04:28.533 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:04:28.528+0000 7f879b6f0700 1 -- 172.21.15.57:0/3399985165 wait complete. 2023-10-06T03:04:28.534 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 40 2023-10-06T03:04:28.550 DEBUG:tasks.cephfs.filesystem:already dead... 2023-10-06T03:04:28.550 INFO:teuthology.misc:Shutting down mds daemons... 2023-10-06T03:04:28.550 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-06T03:04:28.551 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:04:28.572 INFO:tasks.ceph.mds.a:Stopped 2023-10-06T03:04:28.572 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-06T03:04:28.572 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:04:28.641 INFO:tasks.ceph.mds.c:Stopped 2023-10-06T03:04:28.641 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-06T03:04:28.641 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:04:28.661 INFO:tasks.ceph.mds.b:Stopped 2023-10-06T03:04:28.661 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-06T03:04:28.662 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:04:28.731 INFO:tasks.ceph.mds.d:Stopped 2023-10-06T03:04:28.731 INFO:teuthology.misc:Shutting down osd daemons... 2023-10-06T03:04:28.731 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-10-06T03:04:28.731 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:04:31.997 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2023-10-06T03:04:34.833 INFO:tasks.ceph.osd.0:Stopped 2023-10-06T03:04:34.833 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-10-06T03:04:34.834 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:04:34.921 INFO:tasks.ceph.osd.1:Stopped 2023-10-06T03:04:34.921 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-10-06T03:04:34.922 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:04:35.003 INFO:tasks.ceph.osd.2:Stopped 2023-10-06T03:04:35.004 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-10-06T03:04:35.004 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:04:37.904 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2023-10-06T03:04:37.904 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2023-10-06T03:04:41.106 INFO:tasks.ceph.osd.3:Stopped 2023-10-06T03:04:41.106 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-10-06T03:04:41.106 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:04:41.176 INFO:tasks.ceph.osd.4:Stopped 2023-10-06T03:04:41.176 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-10-06T03:04:41.176 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:04:43.609 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2023-10-06T03:04:43.609 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2023-10-06T03:04:47.278 INFO:tasks.ceph.osd.5:Stopped 2023-10-06T03:04:47.278 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-10-06T03:04:47.279 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:04:47.343 INFO:tasks.ceph.osd.6:Stopped 2023-10-06T03:04:47.343 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-10-06T03:04:47.343 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:04:48.546 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:04:48.553 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:04:49.113 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2023-10-06T03:04:49.114 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2023-10-06T03:04:53.445 INFO:tasks.ceph.osd.7:Stopped 2023-10-06T03:04:53.445 INFO:teuthology.misc:Shutting down mgr daemons... 2023-10-06T03:04:53.446 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-10-06T03:04:53.446 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:04:53.503 INFO:tasks.ceph.mgr.y:Stopped 2023-10-06T03:04:53.504 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-10-06T03:04:53.504 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:04:53.561 INFO:tasks.ceph.mgr.x:Stopped 2023-10-06T03:04:53.561 INFO:teuthology.misc:Shutting down mon daemons... 2023-10-06T03:04:53.561 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-10-06T03:04:53.561 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:04:53.593 INFO:tasks.ceph.mon.a:Stopped 2023-10-06T03:04:53.594 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-10-06T03:04:53.594 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:04:53.624 INFO:tasks.ceph.mon.b:Stopped 2023-10-06T03:04:53.624 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-10-06T03:04:53.624 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:04:53.699 INFO:tasks.ceph.mon.c:Stopped 2023-10-06T03:04:53.700 INFO:tasks.ceph:Checking cluster log for badness... 2023-10-06T03:04:53.700 DEBUG:teuthology.orchestra.run.smithi057:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-10-06T03:04:53.747 INFO:teuthology.orchestra.run.smithi057.stdout:1696561256.9376287 mon.a (mon.0) 140 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-10-06T03:04:53.748 WARNING:tasks.ceph:Found errors (ERR|WRN|SEC) in cluster log 2023-10-06T03:04:53.749 DEBUG:teuthology.orchestra.run.smithi057:> sudo egrep '\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-10-06T03:04:53.844 DEBUG:teuthology.orchestra.run.smithi057:> sudo egrep '\[ERR\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-10-06T03:04:53.886 DEBUG:teuthology.orchestra.run.smithi057:> sudo egrep '\[WRN\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-10-06T03:04:53.975 INFO:teuthology.orchestra.run.smithi057.stdout:1696561256.9376287 mon.a (mon.0) 140 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-10-06T03:04:53.976 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi057.front.sepia.ceph.com 2023-10-06T03:04:53.976 DEBUG:teuthology.orchestra.run.smithi057:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-10-06T03:04:54.115 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2023-10-06T03:04:54.476 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi057.front.sepia.ceph.com 2023-10-06T03:04:54.477 DEBUG:teuthology.orchestra.run.smithi057:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-10-06T03:04:54.967 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi057.front.sepia.ceph.com 2023-10-06T03:04:54.967 DEBUG:teuthology.orchestra.run.smithi057:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-10-06T03:04:55.455 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi057.front.sepia.ceph.com 2023-10-06T03:04:55.455 DEBUG:teuthology.orchestra.run.smithi057:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-10-06T03:04:55.843 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi105.front.sepia.ceph.com 2023-10-06T03:04:55.843 DEBUG:teuthology.orchestra.run.smithi105:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-10-06T03:04:56.347 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi105.front.sepia.ceph.com 2023-10-06T03:04:56.347 DEBUG:teuthology.orchestra.run.smithi105:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-10-06T03:04:56.834 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi105.front.sepia.ceph.com 2023-10-06T03:04:56.834 DEBUG:teuthology.orchestra.run.smithi105:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-10-06T03:04:57.277 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi105.front.sepia.ceph.com 2023-10-06T03:04:57.278 DEBUG:teuthology.orchestra.run.smithi105:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-10-06T03:04:57.787 INFO:tasks.ceph:Archiving mon data... 2023-10-06T03:04:57.788 DEBUG:teuthology.misc:Transferring archived files from smithi057:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412172/data/mon.a.tgz 2023-10-06T03:04:57.788 DEBUG:teuthology.orchestra.run.smithi057:> mktemp 2023-10-06T03:04:57.805 INFO:teuthology.orchestra.run.smithi057.stdout:/tmp/tmp.AemVk0yW0g 2023-10-06T03:04:57.805 DEBUG:teuthology.orchestra.run.smithi057:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.AemVk0yW0g 2023-10-06T03:04:57.981 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 0666 /tmp/tmp.AemVk0yW0g 2023-10-06T03:04:58.081 DEBUG:teuthology.orchestra.remote:smithi057:/tmp/tmp.AemVk0yW0g is 365KB 2023-10-06T03:04:58.112 DEBUG:teuthology.orchestra.run.smithi057:> rm -fr /tmp/tmp.AemVk0yW0g 2023-10-06T03:04:58.129 DEBUG:teuthology.misc:Transferring archived files from smithi105:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412172/data/mon.b.tgz 2023-10-06T03:04:58.129 DEBUG:teuthology.orchestra.run.smithi105:> mktemp 2023-10-06T03:04:58.147 INFO:teuthology.orchestra.run.smithi105.stdout:/tmp/tmp.fJObANDpac 2023-10-06T03:04:58.147 DEBUG:teuthology.orchestra.run.smithi105:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.fJObANDpac 2023-10-06T03:04:58.347 DEBUG:teuthology.orchestra.run.smithi105:> sudo chmod 0666 /tmp/tmp.fJObANDpac 2023-10-06T03:04:58.443 DEBUG:teuthology.orchestra.remote:smithi105:/tmp/tmp.fJObANDpac is 471KB 2023-10-06T03:04:58.520 DEBUG:teuthology.orchestra.run.smithi105:> rm -fr /tmp/tmp.fJObANDpac 2023-10-06T03:04:58.539 DEBUG:teuthology.misc:Transferring archived files from smithi105:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412172/data/mon.c.tgz 2023-10-06T03:04:58.539 DEBUG:teuthology.orchestra.run.smithi105:> mktemp 2023-10-06T03:04:58.600 INFO:teuthology.orchestra.run.smithi105.stdout:/tmp/tmp.BMZb64WrxF 2023-10-06T03:04:58.601 DEBUG:teuthology.orchestra.run.smithi105:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.BMZb64WrxF 2023-10-06T03:04:58.799 DEBUG:teuthology.orchestra.run.smithi105:> sudo chmod 0666 /tmp/tmp.BMZb64WrxF 2023-10-06T03:04:58.896 DEBUG:teuthology.orchestra.remote:smithi105:/tmp/tmp.BMZb64WrxF is 471KB 2023-10-06T03:04:58.971 DEBUG:teuthology.orchestra.run.smithi105:> rm -fr /tmp/tmp.BMZb64WrxF 2023-10-06T03:04:58.990 INFO:tasks.ceph:Cleaning ceph cluster... 2023-10-06T03:04:58.990 DEBUG:teuthology.orchestra.run.smithi057:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-06T03:04:58.997 DEBUG:teuthology.orchestra.run.smithi105:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-06T03:04:59.066 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-10-06T03:04:59.067 DEBUG:teuthology.orchestra.run.smithi057:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-06T03:04:59.076 DEBUG:teuthology.orchestra.run.smithi105:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-06T03:04:59.128 INFO:teuthology.orchestra.run.smithi057.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-06T03:04:59.160 INFO:teuthology.orchestra.run.smithi105.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-06T03:04:59.174 INFO:tasks.ceph:Archiving crash dumps... 2023-10-06T03:04:59.176 DEBUG:teuthology.misc:Transferring archived files from smithi057:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412172/remote/smithi057/crash 2023-10-06T03:04:59.177 DEBUG:teuthology.orchestra.run.smithi057:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-06T03:04:59.214 DEBUG:teuthology.misc:Transferring archived files from smithi105:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412172/remote/smithi105/crash 2023-10-06T03:04:59.215 DEBUG:teuthology.orchestra.run.smithi105:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-06T03:04:59.247 INFO:tasks.ceph:Shutting down logrotate 2023-10-06T03:04:59.247 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:04:59.265 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:04:59.360 DEBUG:teuthology.orchestra.run.smithi057:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-06T03:04:59.394 DEBUG:teuthology.orchestra.run.smithi105:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-06T03:04:59.428 INFO:tasks.ceph:Compressing logs... 2023-10-06T03:04:59.428 DEBUG:teuthology.orchestra.run.smithi057:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-06T03:04:59.445 DEBUG:teuthology.orchestra.run.smithi105:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-06T03:05:00.870 INFO:tasks.ceph:Archiving logs... 2023-10-06T03:05:00.870 DEBUG:teuthology.misc:Transferring archived files from smithi057:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412172/remote/smithi057/log 2023-10-06T03:05:00.871 DEBUG:teuthology.orchestra.run.smithi057:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-06T03:05:01.252 DEBUG:teuthology.misc:Transferring archived files from smithi105:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412172/remote/smithi105/log 2023-10-06T03:05:01.253 DEBUG:teuthology.orchestra.run.smithi105:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-06T03:05:01.421 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-10-06T03:05:01.442 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-10-06T03:05:01.443 DEBUG:teuthology.orchestra.run.smithi057:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-06T03:05:01.450 DEBUG:teuthology.orchestra.run.smithi105:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-06T03:05:01.528 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-10-06T03:05:01.537 INFO:teuthology.task.clock:Checking final clock skew... 2023-10-06T03:05:01.537 DEBUG:teuthology.orchestra.run.smithi057:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-06T03:05:01.544 DEBUG:teuthology.orchestra.run.smithi105:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-06T03:05:01.585 INFO:teuthology.orchestra.run.smithi057.stdout: remote refid st t when poll reach delay offset jitter 2023-10-06T03:05:01.585 INFO:teuthology.orchestra.run.smithi057.stdout:============================================================================== 2023-10-06T03:05:01.585 INFO:teuthology.orchestra.run.smithi057.stdout:*hv01.front.sepi 44.4.53.2 2 u 41 64 377 0.114 0.978 0.486 2023-10-06T03:05:01.585 INFO:teuthology.orchestra.run.smithi057.stdout:+hv02.front.sepi 63.231.80.2 3 u 43 64 377 0.132 0.966 0.488 2023-10-06T03:05:01.586 INFO:teuthology.orchestra.run.smithi057.stdout:+hv03.front.sepi 74.6.168.72 3 u 47 64 377 0.175 -0.020 0.490 2023-10-06T03:05:01.586 INFO:teuthology.orchestra.run.smithi057.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-06T03:05:01.587 INFO:teuthology.orchestra.run.smithi105.stdout: remote refid st t when poll reach delay offset jitter 2023-10-06T03:05:01.587 INFO:teuthology.orchestra.run.smithi105.stdout:============================================================================== 2023-10-06T03:05:01.587 INFO:teuthology.orchestra.run.smithi105.stdout:*hv01.front.sepi 44.4.53.2 2 u 47 64 377 0.110 0.965 0.642 2023-10-06T03:05:01.587 INFO:teuthology.orchestra.run.smithi105.stdout:+hv02.front.sepi 63.231.80.2 3 u 43 64 377 0.089 0.464 0.726 2023-10-06T03:05:01.587 INFO:teuthology.orchestra.run.smithi105.stdout:+hv03.front.sepi 74.6.168.72 3 u 41 64 377 0.099 0.021 0.632 2023-10-06T03:05:01.588 INFO:teuthology.orchestra.run.smithi105.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-06T03:05:01.589 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-10-06T03:05:01.598 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-10-06T03:05:01.599 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-10-06T03:05:01.625 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-10-06T03:05:01.676 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-10-06T03:05:01.725 INFO:teuthology.task.internal:Duration was 982.845389 seconds 2023-10-06T03:05:01.727 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-10-06T03:05:01.776 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-10-06T03:05:01.776 DEBUG:teuthology.orchestra.run.smithi057:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-06T03:05:01.784 DEBUG:teuthology.orchestra.run.smithi105:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-06T03:05:01.929 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-10-06T03:05:01.929 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi057.front.sepia.ceph.com 2023-10-06T03:05:01.930 DEBUG:teuthology.orchestra.run.smithi057:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-06T03:05:01.966 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi105.front.sepia.ceph.com 2023-10-06T03:05:01.966 DEBUG:teuthology.orchestra.run.smithi105:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-06T03:05:02.000 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-10-06T03:05:02.000 DEBUG:teuthology.orchestra.run.smithi057:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-06T03:05:02.020 DEBUG:teuthology.orchestra.run.smithi105:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-06T03:05:02.103 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-10-06T03:05:02.103 DEBUG:teuthology.orchestra.run.smithi057:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-06T03:05:02.111 DEBUG:teuthology.orchestra.run.smithi105:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-06T03:05:02.209 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-10-06T03:05:02.219 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-10-06T03:05:02.219 DEBUG:teuthology.orchestra.run.smithi057:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-06T03:05:02.253 DEBUG:teuthology.orchestra.run.smithi105:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-06T03:05:02.289 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-10-06T03:05:02.298 DEBUG:teuthology.orchestra.run.smithi057:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-06T03:05:02.304 DEBUG:teuthology.orchestra.run.smithi105:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-06T03:05:02.336 INFO:teuthology.orchestra.run.smithi057.stdout:kernel.core_pattern = core 2023-10-06T03:05:02.368 INFO:teuthology.orchestra.run.smithi105.stdout:kernel.core_pattern = core 2023-10-06T03:05:02.403 DEBUG:teuthology.orchestra.run.smithi057:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-06T03:05:02.431 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T03:05:02.431 DEBUG:teuthology.orchestra.run.smithi105:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-06T03:05:02.463 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T03:05:02.464 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-10-06T03:05:02.474 INFO:teuthology.task.internal:Transferring archived files... 2023-10-06T03:05:02.475 DEBUG:teuthology.misc:Transferring archived files from smithi057:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412172/remote/smithi057 2023-10-06T03:05:02.475 DEBUG:teuthology.orchestra.run.smithi057:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-06T03:05:02.522 DEBUG:teuthology.misc:Transferring archived files from smithi105:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412172/remote/smithi105 2023-10-06T03:05:02.522 DEBUG:teuthology.orchestra.run.smithi105:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-06T03:05:02.563 INFO:teuthology.task.internal:Removing archive directory... 2023-10-06T03:05:02.564 DEBUG:teuthology.orchestra.run.smithi057:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-06T03:05:02.571 DEBUG:teuthology.orchestra.run.smithi105:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-06T03:05:02.627 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-10-06T03:05:02.637 INFO:teuthology.task.internal:Not uploading archives. 2023-10-06T03:05:02.637 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-10-06T03:05:02.660 INFO:teuthology.task.internal:Tidying up after the test... 2023-10-06T03:05:02.660 DEBUG:teuthology.orchestra.run.smithi057:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-06T03:05:02.667 DEBUG:teuthology.orchestra.run.smithi105:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-06T03:05:02.685 INFO:teuthology.orchestra.run.smithi057.stdout: 1048609 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 6 03:05 /home/ubuntu/cephtest 2023-10-06T03:05:02.695 INFO:teuthology.orchestra.run.smithi105.stdout: 1048603 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 6 03:05 /home/ubuntu/cephtest 2023-10-06T03:05:02.701 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-10-06T03:05:02.713 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-10-06T03:05:02.811 INFO:teuthology.nuke:Checking targets against current locks 2023-10-06T03:05:02.835 DEBUG:teuthology.nuke:shortname: smithi057 2023-10-06T03:05:02.836 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-06T03:05:02.858 DEBUG:teuthology.nuke:shortname: smithi105 2023-10-06T03:05:02.858 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-06T03:05:02.861 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi057.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412172', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 02:38:25.243163', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-10-06T03:05:02.882 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi105.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412172', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 02:38:25.241676', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-10-06T03:05:02.914 INFO:teuthology.orchestra.console.smithi057:Power off 2023-10-06T03:05:02.914 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-06T03:05:02.940 DEBUG:teuthology.orchestra.console.smithi057:power off output: Chassis Power Control: Down/Off 2023-10-06T03:05:02.941 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T03:05:02.953 INFO:teuthology.orchestra.console.smithi105:Power off 2023-10-06T03:05:02.954 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-06T03:05:02.962 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is on 2023-10-06T03:05:02.974 DEBUG:teuthology.orchestra.console.smithi105:power off output: Chassis Power Control: Down/Off 2023-10-06T03:05:02.974 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T03:05:02.994 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is on 2023-10-06T03:05:06.963 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T03:05:06.995 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T03:05:07.073 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is on 2023-10-06T03:05:07.105 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is on 2023-10-06T03:05:11.074 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T03:05:11.106 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T03:05:11.184 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is off 2023-10-06T03:05:11.214 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is on 2023-10-06T03:05:11.286 INFO:teuthology.orchestra.console.smithi057:Power off completed 2023-10-06T03:05:15.216 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T03:05:15.325 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is off 2023-10-06T03:05:15.426 INFO:teuthology.orchestra.console.smithi105:Power off completed 2023-10-06T03:05:15.531 INFO:teuthology.run:Summary data: client.0-kernel-sha1: fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c client.1-kernel-sha1: fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/openfiletable} duration: 982.8453891277313 failure_reason: '"1696561256.9376287 mon.a (mon.0) 140 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log' flavor: default owner: scheduled_yuriw@teuthology success: false 2023-10-06T03:05:15.531 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T03:05:15.617 INFO:teuthology.run:FAIL